Abstract
In this study, we conduct a laboratory experiment in which the subjects make choices between real-world lottery tickets typically purchased by lottery customers. In this way, we can reliably offer extremely high potential payoffs, something rarely possible in economic experiments. In a between-subject design, we separately manipulate several features that distinguish the situation faced by the customers in the field and by subjects in typical laboratory experiments. We also have the unique opportunity to compare our data to actual sales data provided by the operator of the lottery. We find the distributions to be highly similar (meaning high external validity for this particular setting). The only manipulation that makes a major difference is that when the probabilities of winning specific amounts are explicitly provided (which is not the case in the field), choices shift towards options with lower maximum possible payoff and lower payoff variance. We also find that subjects generally show preference for long shots and that standard laboratory measures of risk posture fail to explain their behavior in the main task.
Similar content being viewed by others
Notes
Indeed, surprisingly few authors have used real-world lottery tickets in the lab to explore risk preference. A valued early exception is a paper by Bohm and Lind (1993) documenting that preference reversals are less common in real-world lotteries. An important recent example is Chark (Chark et al. 2020) who use Chinese state lottery tickets. The experiment was run online, with only a small fraction of subjects receiving choice-dependent payments up to 3 months after taking the experiment. They observe a peculiar combination of long-shot preference for low expected payoffs and long-shot aversion for high expected payoffs.
To ensure that the subjects believed our assurances, we ran an online pilot; 48 participants were asked to imagine they had participated in an experiment in our lab, in which extremely high payoffs were possible (albeit with low probabilities) and to answer on a scale from 1 to 10 to what extent they would trust the experimenter and the instructions. 71% chose 9 or 10. The distribution was virtually identical in the control group in which the description was analogous, but we did not mention that the payoffs could be very high.
The specific wording was as follows: „remember that during experiments at the [faculty and university name] we never mislead participants nor lie. The payouts we offer here are secured and actually possible to receive. If you have any doubts about how we can guarantee such high payouts, ask the experimenter, for example when returning the form.”
Some variables, for example education and income, are measured on an ordinal scale, so including them directly is only correct under the assumption that each change to a higher level has the same effect upon the left-hand variable. Still, it provides a simplified view of their impact; representing any of them as a set of dummy variables leads to analogous conclusions concerning their significance and the direction of their influence.
Of course, the question arises of why subjects did not tend to report higher WTP when the probabilities were provided (turning out to be higher than most people had thought). This could be understood in terms of mild ambiguity seeking (in our domain of low probabilities and high payoffs).
References
Abt, V., McGurrin, M. C., & Smith, J. F. (1985). Toward a synoptic model of gambling behavior. Journal of Gambling, 1, 79–88. https://doi.org/10.1007/BF01019860.
Alm, J., Bloomquist, K. M., & McKee, M. (2015). On the external validity of laboratory tax compliance experiments. Economic Inquiry, 53, 1170–1186.
Andersen, S., Ertaç, S., Gneezy, U., Hoffman, M., & List, J. A. (2011). Stakes matter in ultimatum games. American Economic Review, 101, 3427–3439. https://doi.org/10.1257/aer.101.7.3427.
Ariyabuddhiphongs, V., & Chanchalermporn, N. (2007). A test of social cognitive theory reciprocal and sequential effects: Hope, superstitious belief and environmental factors among lottery gamblers in Thailand. Journal of Gambling Studies, 23, 201–214.
Armantier, O., & Treich, N. (2015). The Rich Domain Of Risk. Management Science. https://doi.org/10.1287/mnsc.2015.2215.
Aydogan, I., & Gao, Y. (2020). Experience and rationality under risk: Re-examining the impact of sampling experience. Exp Econ. https://doi.org/10.1007/s10683-019-09641-y.
Barseghyan, L., Prince, J., & Teitelbaum, J. C. (2011). Are risk preferences stable across contexts? Evidence from insurance data. American Economic Review, 101, 591–631.
Beyerlein, K., & Sallaz, J. J. (2017). Faith’s wager: How religion deters gambling. Social Science Research, 62, 204–218.
Bohm, P., & Lind, H. (1993). Preference reversal, real-world lotteries, and lottery-interested subjects. Journal of Economic Behavior & Organization, 22, 327–348. https://doi.org/10.1016/0167-2681(93)90005-A.
Chark, R., Chew, S. H., & Zhong, S. (2020). Individual preference for longshots. Journal of the European Economic Association, 18, 1009–1039. https://doi.org/10.1093/jeea/jvz004.
Charness, G., Garcia, T., Offerman, T., & Villeval, M. C. (2019). Do measures of risk attitude in the laboratory predict behavior under risk in and outside of the laboratory? GATE WP 1921. https://doi.org/10.2139/ssrn.3398841.
Charness, G., Gneezy, U., & Imas, A. (2013). Experimental methods: Eliciting risk preferences. Journal of Economic Behavior & Organization, 87, 43–51.
Cleave, B. L., Nikiforakis, N., & Slonim, R. (2013). Is there selection bias in laboratory experiments? The case of social and risk preferences. Experimental Economics, 16, 372–382.
Coups, E., Haddock, G., & Webley, P. (1998). Correlates and predictors of lottery play in the United Kingdom. Journal of Gambling Studies, 14, 285–303. https://doi.org/10.1023/A:1022009726406.
Dai, Z., Galeotti, F., & Villeval, M. C. (2017). Cheating in the lab predicts fraud in the field: An experiment in public transportation. Management Science, 64, 1081–1100. https://doi.org/10.1287/mnsc.2016.2616.
Dohmen, T., Falk, A., Huffman, D., Sunde, U., Schupp, J., & Wagner, G. G. (2011). Individual risk attitudes: Measurement, determinants, and behavioral consequences. Journal of the European Economic Association, 9, 522–550.
Dorsey, R., & Razzolini, L. (2003). Explaining overbidding in first price auctions using controlled lotteries. Experimental Economics, 6, 123–140.
Einav, L., Finkelstein, A., Pascu, I., & Cullen, M. R. (2012). How general are risk preferences? Choices under uncertainty in different domains. American Economic Review, 102, 2606–2638.
Exadaktylos, F., Espín, A. M., & Brañas-Garza, P. (2013). Experimental subjects are not different. Sci Rep, 3, 1–6. https://doi.org/10.1038/srep01213.
Falk, A., Meier, S., & Zehnder, C. (2013). Do lab experiments misrepresent social preferences? The case of self-selected student samples. Journal of the European Economic Association, 11, 839–852.
Fehr-Duda, H., Bruhin, A., Epper, T., & Schubert, R. (2010). Rationality on the rise: Why relative risk aversion increases with stake size. Journal of Risk and Uncertainty, 40, 147–180.
Galizzi, M. M., Machado, S. R., & Miniaci, R. (2016). Temporal stability, cross-validity, and external validity of risk preferences measures: Experimental evidence from a UK representative sample. (p. 127). https://doi.org/10.2139/ssrn.2822613.
Galizzi, M. M., & Navarro-Martinez, D. (2019). On the external validity of social preference games: a systematic lab-field study. Management Science, 65, 976–1002.
George, B. (2002). The relationship between lottery ticket and scratch-card buying behaviour, personality and other compulsive behaviours. Journal of Consumer Behaviour: An International Research Review, 2, 7–22.
Golec, J., & Tamarkin, M. (1998). Bettors love skewness, not risk, at the horse track. Journal of Political Economy, 106, 205–225.
Gosling, S. D., Rentfrow, P. J., & Swann, W. B., Jr. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality, 37, 504–528.
Griffiths, M., & Wood, R. (2001). The psychology of lottery gambling. International Gambling Studies, 1, 27–45.
Grossman, P. J., & Eckel, C. C. (2015). Loving the long shot: Risk taking with skewed lotteries. Journal of Risk and Uncertainty, 51, 195–217.
Harrison, G. W., & List, J. A. (2004). Field experiments. Journal of Economic Literature, 42, 1009–1055.
Hertwig, R., Barron, G., Weber, E. U., & Erev, I. (2004). Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15, 534–539.
Holt, C. A., & Laury, S. K. (2002). Risk aversion and incentive effects. American Economic Review, 92, 1644–1655.
Kessler, J. B., & Vesterlund, L. (2015). The external validity of laboratory experiments: Qualitative rather than quantitative effects. In Handbook of experimental economic methodology. https://doi.org/10.1093/acprof:oso/9780195328325.003.0020.
Kontek, K., & Lewandowski, M. (2018). Range-dependent utility. Management Science, 64, 2812–2832.
Landis, J. R., & Koch, G. G. (1977). An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics, 363–374. https://doi.org/10.2307/2529786.
Levitt, S. D. & List, J. A. (2006). What do laboratory experiments tell us about the real world. Presented at the Journal of Economic Perspectives, Citeseer.
List, J. A. (2020). Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial (Working Paper No. 27535), Working Paper Series. National Bureau of Economic Research. https://doi.org/10.3386/w27535.
Mata, R., Frey, R., Richter, D., Schupp, J., & Hertwig, R. (2018). Risk preference: A view from psychology. Journal of Economic Perspectives, 32, 155–172.
McDaniel, S. R., & Zuckerman, M. (2003). The relationship of impulsive sensation seeking and gender to interest and participation in gambling activities. Personality and Individual Differences, 35, 1385–1400. https://doi.org/10.1016/S0191-8869(02)00357-4.
Murphy, J. J., & Stevens, T. H. (2004). Contingent valuation, hypothetical bias, and experimental economics. Agricultural and Resource Economics Review, 33, 182–192.
Rogers, P. (1998). The cognitive psychology of lottery gambling: A theoretical review. Journal of Gambling Studies, 14, 111–134. https://doi.org/10.1023/A:1023042708217.
Rogers, P., & Webley, P. (2001). “It Could Be Us!”: Cognitive and social psychological factors in UK national lottery play. Applied Psychology, 50, 181–199. https://doi.org/10.1111/1464-0597.00053.
Trautmann, S. T., & Van De Kuilen, G. (2015). Ambiguity attitudes. The Wiley Blackwell Handbook of Judgment and Decision Making, 1, 89–116.
Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and uncertainty, 5, 297–323.
Vollmer, E., Hermann, D., & Mußhoff, O. (2017). Is the risk attitude measured with the Holt and Laury task reflected in farmers’ production risk? European Review of Agricultural Economics, 44, 399–424.
Acknowledgements
Helpful comments made by the participants of the 2020 WIEM Conference at the University of Warsaw, Poland and the 2020 SABE Annual Conference at the HSE University, Moscow, the Russian Federation are gratefully acknowledged. This project was supported by the National Science Centre of Poland, grant 2016/21/B/HS4/00688.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Kachurka, R., Krawczyk, M. & Rachubik, J. State lottery in the lab: an experiment in external validity. Exp Econ 24, 1242–1266 (2021). https://doi.org/10.1007/s10683-020-09696-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10683-020-09696-2