Belief Elicitation: A Horse Race Among Truth Serums

CentER Discussion Paper Series No. 2011-117

38 Pages Posted: 8 Nov 2011

See all articles by Stefan T. Trautmann

Stefan T. Trautmann

Heidelberg University - Alfred Weber Institute for Economics

Gijs van de Kuilen

Tilburg University

Multiple version iconThere are 2 versions of this paper

Date Written: November 8, 2011

Abstract

In survey studies, probabilistic expectations about uncertain events are typically elicited by asking respondents for their introspective beliefs. If more complex procedures are feasible, beliefs can be elicited by incentive compatible revealed preference mechanisms (“truth serums”). Various mechanisms have been proposed in the literature, which differ in the degree to which they account for respondents’ deviations from expected value maximization. In this paper, we pit non-incentivized introspection against five truth serums, to elicit beliefs in a simple two-player game. We test the internal validity (additivity and predictive power for own behavior), and the external validity (predictive power for other players’ behavior, or accuracy) of each method. We find no differences among the truth serums. Beliefs from incentivized methods are better predictors of subjects’ own behavior compared to introspection. However, introspection performs equally well as the truth serums in terms of accuracy and additivity.

Keywords: belief measurement, subjective probability, scoring rules, outcome matching

JEL Classification: D81, C83, C91

Suggested Citation

Trautmann, Stefan T. and van de Kuilen, Gijs, Belief Elicitation: A Horse Race Among Truth Serums (November 8, 2011). CentER Discussion Paper Series No. 2011-117, Available at SSRN: https://ssrn.com/abstract=1956480 or http://dx.doi.org/10.2139/ssrn.1956480

Stefan T. Trautmann (Contact Author)

Heidelberg University - Alfred Weber Institute for Economics ( email )

Grabengasse 14
Heidelberg, D-69117
Germany

Gijs Van de Kuilen

Tilburg University ( email )

P.O. Box 90153
Tilburg, DC Noord-Brabant 5000 LE
Netherlands

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
103
Abstract Views
707
Rank
329,180
PlumX Metrics