Skip to main content

Learning to hesitate

Abstract

We investigate how people make choices when they are unsure about the value of the options they face and have to decide whether to choose now or wait and acquire more information first. In an experiment, we find that participants deviate from optimal information acquisition in a systematic manner. They acquire too much information (when they should only collect little) or not enough (when they should collect a lot). We show that this pattern can be explained as naturally emerging from Fechner cognitive errors. Over time participants tend to learn to approximate the optimal strategy when information is relatively costly.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Notes

  1. This is clearly the case when the DM can access new external information when waiting to make a choice. The framework we describe can also be used in situations where no new external information is available. In such situations, taking more time to engage in cognitive introspection can help reduce the uncertainty about the values of the different choices by matching previous memories with perceived features of the available choices (Ratcliff et al. 2016).

  2. That is \(U(d_{t}=a;\pi _t) = \pi _{t} U_0 + (1- \pi _{t}) U_1\) if \(d_{t} = a\) and \(U(d_{t}=b;\pi _t) = \pi _{t} U_1 + (1- \pi _{t}) U_0\) if \(d_{t} = b\).

  3. Among all the possible choices of urn compositions, we chose this one to have signals which are moderately informative. We can therefore study participants facing a flow of moderately informative signals and deciding when to stop.

  4. Ideally, one could prefer a constant optimal threshold, but it would require an infinite horizon. Since the participants have to pay to sample signals, we provide them with a budget to do so. This budget is finite and, as a consequence, the experiment has a finite horizon and an optimal threshold which is not constant. Our analyses rely on the identification assumption that participants are not influenced by the length of the horizon as such (e.g. via some heuristic using a proportion of the horizon to decide when to stop). Note that an alternative solution would have been to vary the budget of participants across treatments to provide the same horizon. But such design implies potential wealth effect issues as a major drawback.

  5. This choice is identical to choosing an action \(d_t \in \{a,b\}\) mirroring the state of the world.

  6. All amounts are in Australian dollars.

  7. It is enough to reach the expected stopping time in each treatment. Time horizons were the following: \(T=100\) in the $0.10 condition, \(T=20\) in the $0.50 condition and \(T=10\) in the $1 condition.

  8. In the loss frame we inform the participants that they are all given $20 at the start of the session, and that correctly guessing the nature of the urn will allow them to keep this money. On the other hand, in the gain frame we tell them that if they make the right guess, they will get $20.

  9. According to the optimal sequential sampling model, framing the payoffs as gains or losses should not matter. However, there is extensive evidence that individual behaviour substantially changes depending on whether a prospect is framed as leading to possible gains or losses (Kahneman and Tversky 1979; Wakker 2010). A simple way to introduce the idea that “losses loom larger than gains”, is to consider that when the DM faces a potential loss, the payoff V is subjectively transformed in \(\mu V\), with \(\mu >1\). Mechanically, the higher stakes push the optimal frontier outwards and make the marginal incentive to sample greater. We did not find any effect of framing. We report these analyses in “Framing effects” section of Appendix in Electronic Supplementary Material.

  10. The results of the CRT are provided in “CRT” section of Appendix in Electronic Supplementary Material.

  11. This has been shown to be an efficient way to allocate payment in experiments with repeated choices, see Baltussen et al. (2012).

  12. All the Wilcoxon signed-rank tests reported are performed on subject-wise moments and bootstrapped 10,000 times

  13. The previous analyses only made comparison between average optimal strategy and average behaviour over all the rounds.

  14. In the $0.1, $0.50, and $1 treatments, this is equivalent to increasing the size of the sampling set by 10%, 25% and 100% respectively.

  15. All regressions are clustered at the individual level.

  16. The slope of the regression line is neither statistically significant for the average stopping time (\(p=0.21\)) nor for the signal intensity (\(p=0.54\)).

  17. We did not find any significant difference in individual characteristics such as gender or CRT score on their tendency to make mistakes.

  18. We thank a reviewer for making this very useful suggestion.

References

  • Abdellaoui, M., Bleichrodt, H., & Paraschiv, C. (2007). Loss aversion under prospect theory: A parameter-free measurement. Management Science, 53, 1659–1674.

    Google Scholar 

  • Baltussen, G., Post, G. T., van den Assem, M. J., & Wakker, P. P. (2012). Random incentive systems in a dynamic choice experiment. Experimental Economics, 15, 418–443.

    Google Scholar 

  • Bearden, J. N., Rapoport, A., & Murphy, R. O. (2006). Sequential observation and selection with rank-dependent payoffs: An experimental study. Management Science, 52, 1437–1449.

    Google Scholar 

  • Bleichrodt, H., & Wakker, P. P. (2015). Regret theory: A bold alternative to the alternatives. The Economic Journal, 125, 493–532.

    Google Scholar 

  • Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006). The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113, 700.

    Google Scholar 

  • Caplin, A., & Martin, D. (2016). The dual-process drift diffusion model: evidence from response times. Economic Inquiry, 54, 1274–1282.

    Google Scholar 

  • Charness, G., & Dave, C. (2017). Confirmation bias with motivated beliefs. Games and Economic Behavior, 104, 1–23.

    Google Scholar 

  • Conte, A., Hey, J. D., & Moffatt, P. G. (2011). Mixture models of choice under risk. Journal of Econometrics, 162, 79–88.

    Google Scholar 

  • Della Seta, M., Gryglewicz, S., & Kort, P. M. (2014). Willingness to wait under risk and ambiguity. Berkeley: mimeo.

    Google Scholar 

  • El-Gamal, M. A., & Grether, D. M. (1995). Are people Bayesian? Uncovering behavioral strategies. Journal of the American Statistical Association, 90, 1137–1145.

    Google Scholar 

  • Fehr, E., & Rangel, A. (2011). Neuroeconomic foundations of economic choice-recent advances. The Journal of Economic Perspectives, 25, 3–30.

    Google Scholar 

  • Fischbacher, U. (2007). z-Tree: Zurich toolbox for ready-made economic experiments. Experimental Economics, 10, 171–178.

    Google Scholar 

  • Frederick, S. (2005). Cognitive reflection and decision making. The Journal of Economic Perspectives, 19, 25–42.

    Google Scholar 

  • Friedman, D., & Rust, J. (1993). The double auction market: Institutions, theories, and evidence (Vol. 14). Boulder: Westview Press.

    Google Scholar 

  • Fudenberg, D., Strack, P., & Strzalecki, T. (2015). Stochastic choice and optimal sequential sampling. Available at SSRN 2602927.

  • Fudenberg, D., Strack, P., & Strzalecki, T. (2018). Speed, accuracy, and the optimal timing of choices. American Economic Review, 108, 3651–84.

    Google Scholar 

  • Gabaix, X., Laibson, D., Moloche, G., & Weinberg, S. (2006). Costly information acquisition: Experimental analysis of a boundedly rational model. The American Economic Review, 96, 1043–1068.

    Google Scholar 

  • Gold, J. I., & Shadlen, M. N. (2002). Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward. Neuron, 36, 299–308.

    Google Scholar 

  • Gollier, C. (2004). The economics of risk and time. Cambridge: MIT Press.

    Google Scholar 

  • Greiner, B. (2015). Subject pool recruitment procedures: Organizing experiments with ORSEE. Journal of the Economic Science Association, 1, 114–125.

    Google Scholar 

  • Hey, J. D., & Orme, C. (1994). Investigating generalizations of expected utility theory using experimental data. Econometrica: Journal of the Econometric Society, 62, 1291–1326.

    Google Scholar 

  • Holt, C. A., & Laury, S. K. (2002). Risk aversion and incentive effects. American Economic Review, 92, 1644–1655.

    Google Scholar 

  • Jones, M., & Sugden, R. (2001). Positive confirmation bias in the acquisition of information. Theory and Decision, 50, 59–99.

    Google Scholar 

  • Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. The American Economic Review, 93, 1449–1475.

    Google Scholar 

  • Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica: Journal of the Econometric Society, 47, 263–291.

    Google Scholar 

  • Krajbich, I., Oud, B., & Fehr, E. (2014). Benefits of neuroeconomic modeling: New policy interventions and predictors of preference. The American Economic Review, 104, 501–506.

    Google Scholar 

  • Kruse, T., & Strack, P. (2015). Optimal stopping with private information. Journal of Economic Theory, 159, 702–727.

    Google Scholar 

  • Loomes, G., & Sugden, R. (1986). Disappointment and dynamic consistency in choice under uncertainty. The Review of Economic Studies, 53, 271–282.

    Google Scholar 

  • Martin, V., Hurn, S., & Harris, D. (2012). Econometric modelling with time series: Specification, estimation and testing. Cambridge: Cambridge University Press.

    Google Scholar 

  • McDonald, R., & Siegel, D. (1986). The value of waiting to invest. The Quarterly Journal of Economics, 101, 707–728.

    Google Scholar 

  • Oprea, R., Friedman, D., & Anderson, S. T. (2009). Learning to wait: A laboratory investigation. The Review of Economic Studies, 76, 1103–1124.

    Google Scholar 

  • Perlow, L. A., Okhuysen, G. A., & Repenning, N. P. (2002). The speed trap: Exploring the relationship between decision making and temporal context. Academy of Management Journal, 45, 931–955.

    Google Scholar 

  • Rabin, M., & Schrag, J. L. (1999). First impressions matter: A model of confirmatory bias. Quarterly Journal of Economics, 114, 37–82.

    Google Scholar 

  • Radner, R., & Stiglitz, J. (1984). A nonconcavity in the value of information. Bayesian Models in Economic Theory, 5, 33–52.

    Google Scholar 

  • Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016). Diffusion decision model: Current issues and history. Trends in Cognitive Sciences, 20, 260–281.

    Google Scholar 

  • Sela, A., & Berger, J. (2012). Decision quicksand: How trivial choices suck us in. Journal of Consumer Research, 39, 360–370.

    Google Scholar 

  • Tartakovsky, A., Nikiforov, I., & Basseville, M. (2014). Sequential analysis: Hypothesis testing and changepoint detection. Boca Raton: CRC Press.

    Google Scholar 

  • Treich, N. (1997). Risk tolerance and value of information in the standard portfolio model. Economics Letters, 55, 361–363.

    Google Scholar 

  • Viefers, P., Strack, P. (2014). Too proud to stop: Regret in dynamic decisions. Available at SSRN 2465840.

  • Wakker, P. P. (2010). Prospect theory: For risk and ambiguity. Cambridge: Cambridge University Press.

    Google Scholar 

  • Wald, A. (1945). Sequential tests of statistical hypotheses. The Annals of Mathematical Statistics, 16, 117–186.

    Google Scholar 

  • Wald, A., & Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. The Annals of Mathematical Statistics, 19, 326–339.

    Google Scholar 

  • Webb, R. (2013). Dynamic constraints on the distribution of stochastic choice: Drift Diffusion implies Random Utility. Unpublished, New York University.

  • Weiß, C. H. (2008). Thinning operations for modeling time series of counts—A survey. AStA Advances in Statistical Analysis, 92, 319–341.

    Google Scholar 

  • Wilson, A. (2014). Bounded memory and biases in information processing. Econometrica, 82, 2257–2294.

    Google Scholar 

  • Woodford, M. (2014). Stochastic choice: An optimizing neuroeconomic model. The American Economic Review, 104, 495–500.

    Google Scholar 

  • Yariv, L. (2002). I’ll see it when i believe it? A simple model of cognitive consistency.

  • Zwick, R., Rapoport, A., Lo, A. K. C., & Muthukrishnan, A. V. (2003). Consumer sequential search: Not enough or too much? Marketing Science, 22, 503–519.

    Google Scholar 

Download references

Acknowledgements

For detailed and constructive comments we gratefully thank Martijn van den Assem, Aurélien Baillon, Sebastian Ebert, Drew Fudenberg, Changxia Ke, Martin Kocher, Morten Lau, Philipp Strack, Susan Thorp, Peter Wakker, Joel van der Weele and Leonard Wolk. We also benefited from comments by seminar and conference participants at the Economic Science Association World Meetings (Sydney), Erasmus School of Economics in Rotterdam, Monash University, University of Technology of Sydney, University of Sydney, University of Melbourne, VU Amsterdam, Griffith University, Australian Meeting of the Econometric Society (Sydney), Australian Conference of Economists (Adelaide), Econometric Society Summer School (Kyoto), Asian Meeting of the Econometric Society (Kyoto). The final version of the paper greatly benefited from insights and suggestions from two reviewers which led us to improve the main interpretation of the results. Harriet Smith provided excellent research assistance. For S. Massoni, the project has been conducted in the framework of the program FUTURE LEADER of Lorraine Université d’Excellence within the program Investissements Avenir (ANR-15-IDEX-04-LUE) operated by the French National Research Agency (ANR). The views expressed in this article are those of the authors alone.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lionel Page.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Descamps, A., Massoni, S. & Page, L. Learning to hesitate. Exp Econ 25, 359–383 (2022). https://doi.org/10.1007/s10683-021-09718-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10683-021-09718-7

Keywords

  • Search
  • Decision under uncertainty
  • Information
  • Optimal stopping
  • Real option

JEL Classification

  • C91
  • D81
  • D83