Abstract
Academic economists today are caught in a “Publication Impossibility Theorem System” or PITS. In order to further their careers, they are required to publish in A-journals, but for the vast majority this is impossible because there are few slots open for them in such journals. Such academic competition maybe useful to generate hard work; however, there may be serious negative consequences: the wrong output may be produced in an inefficient way, the wrong people may be selected, and losers may react in a harmful way. This article suggests several ways to remedy this situation.
Similar content being viewed by others
Notes
See, e.g., Lee (2006) for various definitions and the corresponding literature.
Faculties of economics at numerous universities (e.g., the University of Linz in Austria), as well as economics associations (e.g., the Verein fuer Socialpolitik, the association of economists in Germany, Austria, and Switzerland), have an official list in which they assign points for publishing in A-, B-, C- etc. journals. Typically, a publication in one of the A-journals listed above gives three times as many points as a B-journal publication. There are also universities that explicitly offer a monetary reward for publishing in highly ranked journals. The University of Economics and Business Administration in Vienna, for example, pays authors 3,000 Euros for publication in what they define as an A+-journal (which, in economics, includes the five journals in the text above, as well as six more), and 1,000 Euros for publication in an A-journal, i.e., a top publication is defined to be worth three times as much as a second-rate one (http://wu-wien.ac.at/forschung.praemie). The Tinbergen Institute in the Netherlands distinguishes between journals ranked “AA”, “A,” and “B”. Among the latter, are (otherwise highly regarded) the reviews such as Economica, Journal of Economic Behavior and Organization, or Economic Letters. Other universities do not consider journal publications lower than A at all. It is sometimes rumored that to publish in B, C, or other lower-ranked journals has even a negative effect on one’s career.
As always, it is difficult to state whether, and to what extent, this and the following arguments apply to the United States academic system because it is characterized by such a wide variety: The top universities are very different from minor institutions which also call themselves universities. Another question is to what extent the observations and suggestions discussed here also apply to disciplines outside economics. While they can certainly not be directly transferred, there are indications that many aspects are also relevant elsewhere, see, e.g., the discussion by Hewstone and Stroebe (2008) on social psychology.
See the charges of “autism” made against standard economics from many quarters. The movement, which started in the Grandes Ecoles in France and led to an online journal, Post-Autistic Economics Review, is well known.
It can be argued that an economist who manages to publish one or two articles in an A-journal is often worse than somebody who engages in broader academic activities, and has published articles in respectable, but not top, journals. The former has devoted all effort to writing articles acceptable to the referees of the top journals, but otherwise is not well trained for the other academic tasks (I owe this point to Reiner Eichenberger).
French or German scholars traditionally developed their ideas in a way, which differs fundamentally from the way Americans do today. However, it should not be forgotten that this kind of writing was used by some of the most original and best scholars in the discipline.
Such behavior is, of course, inconsistent with the generally held view of referees solely acting according to professional standards and ethics. It is, however, difficult to see why the economic model of behavior essentially based on self-interest should not apply to scholars in their role as referees.
The academic system in some countries works in this way: full professors in particular are not required to show that they continue to publish (or not). To the extent this is the case, the second suggestion has already been realized.
It should be kept in mind that no system is able to exclude persons who do not perform well after having entered it. The relevant question is how large their share is, and how badly they affect the system. In the case of academia, the damage is not so large because such people normally decide to engage more in teaching and in administrative tasks. This helps the more productive scholars to have time to do research.
According to a recent analysis by Oswald (2009) for the United Kingdom, outstanding work—a set of genuinely world-leading articles—comes from a wide range of sources, namely 21 different universities not normally considered in the top half-dozen in the country.
Somewhat surprisingly, as more journals become available online, more recent and fewer journals and articles are cited. Researchers are more quickly put in touch with prevailing opinion tending to accelerate consensus and narrowing the range of ideas and findings (Evans 2008). Alternative procedures to the present publication system are provided by Prüfer and Zetland (2007) and Tsang and Frey (2007).
The evidence refers to psychology journals, Peters and Ceci (1982).
References
Bedeian AG (2006) The manuscript review process: the proper roles of authors, referees, and editors. In: Baruch Y, Sullivan S, Schepmyer H (eds) Winning reviews: a guide for evaluating scholarly writing. Palgrave MacMillan, London, pp 104–116
Bedford NM (1978) The impact of a priori theory and research on accounting practice. In: Abdel-Khalik AR, Keller T (eds) The impact of accounting research on practice and disclosure. Duke University Press, Durham, pp 2–31
Bénabou R, Tirole J (2003) Intrinsic and extrinsic motivation. Rev Econ Stud 70(3):489–520
Black D, Brown S, Day A, Race P (1998) 500 tips for getting published: a guide for educators, researchers and professionals. Taylor & Francis Group, London
Colander D, Föllmer H, Haas A, Goldberg M, Juselius K, Kirman A, Lux T, Sloth B (2009) The financial crisis and the systematic failure of academic economists. Kiel Working Paper 1489, Kiel Institute for the World Economy
Daniel HD (1993) Guardians of science: fairness and reliability of peer reviews. Wiley, Weinheim
Dyckman TR, Gibbins M, Swieringa RJ (1978) Experimental and survey research in financial accounting: a review and evaluation. In: Abdel-Khalik AR, Keller T (eds) The impact of accounting research on practice and disclosure. Duke University Press, Durham, pp 48–105
Ellison G (2002) Evolving standards for academic publishing: a q-r theory. J Polit Econ 110(5):994–1034
Evans JA (2008) Electronic publication and the narrowing of science and scholarship. Science 321:395–399
Frank RH (2001) Higher education: the ultimate winner-take-all market? In: Devlin M, Meyerson J (eds) Exploring the future of higher education, forum futures 2000 papers, Forum Strategy Series, vol 3. Jossey-Bass, San Francisco, pp 2–12
Frank RH (2004) Are arms races in higher education a problem? In: Devlin M (ed) Publications from the Forum for the Future of Higher Education. Forum for the Future of Higher Education, Cambridge, pp 49–42
Frey BS (1997) Not just for the money. Edward Elgar, Cheltenham
Frey BS (2003) Publication as prostitution. Public Choice 116:205–223
Frey BS (2006) How influential is economics? De Economist 154(2):1–17
Frey BS, Eichenberger R, Frey RL (2009) Editorial ruminations: publishing Kyklos. Kyklos 62:151–160
Gans JS, Shepard GB (1994) How are the mighty fallen: rejected classic articles by leading economists. J Econ Perspect 8:165–180
Gigerenzer G (2002) Calculated risk. Simon & Schuster/Penguin, New York
Gigerenzer G (2007) Gut feelings. Penguin/Viking, New York
Gillies D (2008) How should research be organized? College Publications, London
Gladwell M (2005) Blink. The power of thinking without thinking. Little, Brown and Company, New York
Hewstone M, Stroebe W (2008) Moving at a snail’s pace: some observations on the publication process in social psychology. Mimeo, Department of Psychology, University of Utrecht
Holmström B, Milgrom P (1991) Multi-task principal agent analysis: incentive contracts, asset ownership and job design. J Law Econ Organ 7:24–52
Kaplan RS (1978) Information content of financial accounting numbers: a survey of empirical evidence. In: Abdel-Khalik AR, Keller T (eds) The impact of accounting research on practice and disclosure. Duke University Press, Durham, pp 134–173
Laband DN, Tollison RD (2003) Dry holes in economic research. Kyklos 56:161–174
Lazear E (1995) Personnel economics. MIT Press, Cambridge
Lazear E, Rosen S (1981) Rank-order tournaments as optimum labor contracts. J Polit Econ 89(5):841–864
Lee FS (2006) The ranking game, class, and scholarship in American mainstream economics. Mimeo, Department of Economics, University of Missouri
Merton RK (1973) Sociology of science: theoretical and empirical investigations. The University of Chicago Press, Chicago
Miller CC (2006) Peer review in the organizational and management sciences: prevalence and effects on reviewer hostility, bias, and dissensus. Acad Manag J 49:425–431
Moizer P (2009) Publishing in accounting journals: a fair game? Acc Organ Soc 34(2):285–304
Osterloh M, Frey BS (2009a) Are more and better indicators the solution? Scand J Manag 25:225–227
Osterloh M, Frey BS (2009b) The role of incentives for academic research. Integrating to different perspectives. Mimeo, Institute of Organization and Administrative Sciences, University of Zurich
Oswald AJ (2007) An examination of the reliability of prestigious scholarly journals: evidence and implications for decision-makers. Economica 74:21–31
Oswald AJ (2009) World-leading research and its measurement. Warwick economic research papers, no. 887
Peters DP, Ceci SJ (1982) Peer-review practices of psychological journals: the fate of published articles, submitted again. Behav Brain Sci 5:187–255
Polanyi M (1967) Science and reality. Br J Philos Sci 18(3):177–196
Posner RA (2002) Public intellectuals: a study of decline. Harvard University Press, Cambridge
Prendergast C (1999) The provision of incentives in firms. J Econ Lit 37:7–63
Prüfer J, Zetland D (2007) An auction market for journal articles. CentER discussion paper 2007-79
Raelin JA (2008) Refereeing the game of peer review. Acad Manag Learn Educ 7(1):124–129
Starbuck WH (2005) How much better are the most prestigious journals? The statistics of academic publication. Organ Sci 16:180–200
Starbuck WH (2006) The production of knowledge. The challenge of social science research. Oxford University Press, Oxford
Sullivan JB (1993) The impact of auditing research on auditing practice. Audit J Pract Theory 12:1–2
Tsang EWK, Frey BS (2007) The as-is journal review process: let authors own their ideas. Acad Manag Learn Educ 6(1):128–136
Weingart P (2005) Impact of bibliometrics upon the science system: inadvertent consequences. Scientometrics 62:117–131
Acknowledgments
The author is grateful to the reviewers for their helpful comments on earlier versions, and for discussions with Charles Blankart, Hans-Dietrich Daniel, Reiner Eichenberger, Lars Feld, Gerd Gigerenzer, Donald Gillies, Berthold Herrendorf, Bengt Holmström, Todd Kaplan, Alfred Kieser, Gebhard Kirchgaessner, Frederic Lee, Simon Luechinger, Simon Milligan, Peter Moizer, Andrew Oswald, Matteo Rizzolli, Katja Rost, Bill Starbuck, Bodo Steiner, Wolfgang Stroebe, Alois Stutzer, Jean Tirole, and Peter Weingart. The extensive conversations with Margit Osterloh were especially useful. While several of the above persons agreed with me, I wish to state that some of them disagreed, sometimes strongly.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Frey, B.S. Economists in the PITS?. Int Rev Econ 56, 335–346 (2009). https://doi.org/10.1007/s12232-009-0081-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12232-009-0081-x