Why the Con Hasn't Been Taken Out of Econometrics Authors
First Online: 17 December 2007 DOI:
Cite this article as: Zelder, M. Eastern Econ J (2008) 34: 115. doi:10.1057/palgrave.eej.9050006 Abstract
Economists often decry the perceived tendency towards selective reporting of empirical results (“specification search”) in scholarly work. Yet, economists have largely neglected to analyze the incentive structures underlying this phenomenon of econometric “cons”. This paper endeavors to provide this analysis, posing a game-theoretic model of specification search. In this three-player game (author, journal, and profession), academic authors choose whether to report the “true”
t-statistic associated with an empirical result, or whether to “con” by reporting a distorted t-statistic. Subsequently, both journal and profession must choose whether to bear the cost of “scrutinizing” the author's work (e.g., by reanalyzing his data). Multiple perfect Bayesian equilibria are found, including one where authors “con” and arc not detected, an equilibrium which may be Kaldor–Hicks efficient. Moreover, public and private mechanisms (existing or proposed) to curtail “conning” seem ineffectual. Keywords econometrics specification search academic refereeing References
Akerlof, George A. 1970. The Market for ‘Lemons’: Quality Uncertainty and the Market Mechanism. Quarterly Journal of Economics, 84: 488–500.
Becker, Gary S. 1968. Crime and Punishment: An Economic Approach. Journal of Political Economy, 76: 169–217.
Cooley, Thomas F., and Stephen F. LeRoy. 1986. What Will Take the Con Out of Econometrics? A Reply to McAleer, Pagan, and Volker. American Economic Review, 76: 504–507.
Darby, Michael R., and Edi Karni. 1973. Free Competition and the Optimal Amount of Fraud. Journal of Law and Economics, 16: 67–88.
De Long, J.Bradford, and Kevin Lang. 1992. Are All Economic Hypotheses False? Journal of Political Economy, 100: 1257–1272.
Dewald, Willliam G., Jerry G. Thursby, and Richard G. Anderson. 1986. Replication in Empirical Economics: The
Journal of Money, Credit and Banking Project. American Economic Review, 76: 587–603.
Ellison, Glenn. 2002. Evolving Standards for Academic Publishing: A
Theory. Journal of Political Economy, 110: 994–1034.
Engers, Maxim, and Joshua S. Gans. 1998. Why Referees Are Not Paid (Enough). American Economic Review, 88: 1341–1349.
Feige, Edgar L. 1975. The Consequences of Journal Editorial Policies and a Suggestion for Revision. Journal of Political Economy, 83: 1291–1296.
Feigenbaum, Susan, and David M. Levy. 1993a. The Market for (Ir)Reproducible Results in Econometrics. Social Epistemology, 7: 215–232.
Feigenbaum, Susan., 1993b. Response to the Commentaries. Social Epistemology, 7: 286–292.
Feigenbaum, Susan., 1996. The Technological Obsolescence of Scientific Fraud. Rationality and Society, 8: 261–276.
Fölster, S. 1995. The Perils of Peer Review in Economics and Other Sciences. Journal of Evolutionary Economics, 5: 43–57.
Freedman, Craig. 2000. Do Economic Journals Obey Economic Prescriptions? Review of Industrial Organization, 17: 371–384.
Gibbons, Robert. 1992. Game Theory for Applied Economists. Princeton: Princeton University Press.
Hedges, Larry V. 1997. The Promise of Replication in Labour Economics. Labour Economics, 4: 111–114.
Hendry, David F. 1980. Econometrics — Alchemy or Science? Economica, 47: 387–406.
Karpoff, Jonathan, and John R. Lott, Jr.. 1993. The Reputational Penalty Firms Bear from Committing Criminal Fraud. Journal of Law and Economics, 36: 756–802.
Kuznik, Frank. 1991. Fraud Busters. Washington Post Magazine (April 14): 22–26, 31–33.
LaFollette, Marcel C. 1992. Stealing into Print: Fraud, Plagiarism, and Misconduct in Scientific Publishing. Berkeley: University of California Press.
Leamer, Edward E. 1983. Let's Take the Con Out of Econometrics. American Economic Review, 73: 31–43.
Leamer, Edward E., 1978. Specification Searches: Ad Hoc Inference with Nonexperimental Data. New York: John Wiley & Sons.
Leamer, Edward E., and Herman Leonard. 1983. Reporting the Fragility of Regression Estimates. Review of Economics and Statistics, 65: 306–317.
Levy, David M., and Sandra J. Peart. 2003. Why Would Truth-Seekers Need a Code of Ethics?, Unpublished manuscript.
Lovell, Michael C. 1983. Data Mining. Review of Economics and Statistics, 65: 1–12.
Matsumura, Ella Mae, and Robert R. Tucker. 1992. Fraud Detection: A Theoretical Foundation. Accounting Review, 67: 753–782.
McAleer, Michael, Adrian R. Pagan, and Paul A. Volker. 1985. What Will Take the Con Out of Econometrics? American Economic Review, 75: 293–307.
© Eastern Economic Association 2008