By the Numbers: Track Record, Flawed Reviews, Journal Space, and the Fate of Talented Authors

Conference paper

DOI: 10.1007/978-3-642-39829-2_16

Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 229)
Cite this paper as:
Thorngate W., Chowdhury W. (2014) By the Numbers: Track Record, Flawed Reviews, Journal Space, and the Fate of Talented Authors. In: Kamiński B., Koloch G. (eds) Advances in Social Simulation. Advances in Intelligent Systems and Computing, vol 229. Springer, Berlin, Heidelberg

Abstract

We conducted a computer simulation of hundreds of competitions for limited journal space, varying (a) the correlation between the talent of authors and the quality of their manuscripts, (b) the correlation between manuscript quality and quality judged by peer reviewers, (c) the weights reviewers and editors gave judged quality versus number of previous publications (tract record), and (d) the proportion of manuscripts accepted for publication. The results show that even small decreases in the correlations, and small increases in the weight given to track record, quickly skew the outcomes of the peer review process, favouring authors who develop a track record of publications in the first cycles of journal publication while excluding many equally-talented or more-talented authors from publishing (the Matthew Effect; Merton, 1968). Implications for declines in the quality of published manuscripts and for wasting talent are discussed.

Keywords

peer review reputation track record competition 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Psychology Department and Institute of Cognitive ScienceCarleton UniversityOttawaCanada

Personalised recommendations