Advances in Social Simulation pp 177-188
By the Numbers: Track Record, Flawed Reviews, Journal Space, and the Fate of Talented Authors
- Cite this paper as:
- Thorngate W., Chowdhury W. (2014) By the Numbers: Track Record, Flawed Reviews, Journal Space, and the Fate of Talented Authors. In: Kamiński B., Koloch G. (eds) Advances in Social Simulation. Advances in Intelligent Systems and Computing, vol 229. Springer, Berlin, Heidelberg
We conducted a computer simulation of hundreds of competitions for limited journal space, varying (a) the correlation between the talent of authors and the quality of their manuscripts, (b) the correlation between manuscript quality and quality judged by peer reviewers, (c) the weights reviewers and editors gave judged quality versus number of previous publications (tract record), and (d) the proportion of manuscripts accepted for publication. The results show that even small decreases in the correlations, and small increases in the weight given to track record, quickly skew the outcomes of the peer review process, favouring authors who develop a track record of publications in the first cycles of journal publication while excluding many equally-talented or more-talented authors from publishing (the Matthew Effect; Merton, 1968). Implications for declines in the quality of published manuscripts and for wasting talent are discussed.
Keywordspeer review reputation track record competition
Unable to display preview. Download preview PDF.