Abstract
The replication crisis across several disciplines raises challenges for behavioural sciences in general. In this report, we review the lessons for experimental economists of these developments. We present the new research methods and practices which are being proposed to improve the replicability of scientific studies. We discuss how these methods and practices can have a positive impact in experimental economics and the extent to which they should be encouraged.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Brodeur, A., Lé, M., Sangnier, M., & Zylberberg, Y. (2016). Star wars: the empirics strike back. American Economic Journal: Applied Economics, 8(1), 1–32.
Brodeur, A., Lé, M., Sangnier, M., Zylberberg, Y., (2013). Star wars: the empirics strike back. IZA Discussion Paper No. 7268.
Camerer, C. F., Dreber, A., Forsell, E., Ho, T. H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., & Heikensten, E. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351(6280), 1433–1436.
Christensen, G., & Miguel, E. (2018). Transparency, reproducibility, and the credibility of economics research. Journal of Economic Literature, 56(3), 920–980.
Coffman, L. C., & Niederle, M. (2015). Pre-analysis plans have limited upside, especially where replications are feasible. Journal of Economic Perspectives, 29(3), 81–98.
Dufwenberg, M., Martinsson, P. (2014). Keeping researchers honest: The case for sealed-envelopesubmissions. IGIER (Innocenzo Gasparini Institute for Economic Research), 533.
Duyx, B., Urlings, M. J., Swaen, G. M., Bouter, L. M., & Zeegers, M. P. (2017). Scientific citations favor positive results: a systematic review and meta-analysis. Journal of Clinical Epidemiology, 88, 92–101.
Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124.
Kasy, M. (2021). Of forking paths and tied hands: Selective publication of findings, and what economists should do about it. Journal of Economic Perspectives, 35(3), 175–192.
Maniadis, Z., Tufano, F., & List, J. A. (2015). How to make experimental economics research more reproducible: Lessons from other disciplines and a new proposal. Replication in experimental economics. Emerald Group Publishing Limited.
Olken, B. A. (2015). Promises and perils of pre-analysis plans. Journal of Economic Perspectives, 29(3), 61–80.
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2018). False-positive citations. Perspectives on Psychological Science, 13(2), 255–259.
Acknowledgements
This report benefited from comments, feedback and suggestions from a large number of ESA members. Among those, we would like to thank particularly Edward Cartwright, Noemi Peter, Alex Roomets, Egon Tripodi, Irenaeus Wolff and the JESA editors Maria Bigoni and Dirk Engelmann.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Page, L., Noussair, C.N. & Slonim, R. The replication crisis, the rise of new research practices and what it means for experimental economics. J Econ Sci Assoc 7, 210–225 (2021). https://doi.org/10.1007/s40881-021-00107-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40881-021-00107-7