Scientometrics

, Volume 19, Issue 1, pp 91–106

Neglected considerations in the analysis of agreement among journal referees

  • L. L. Hargens
  • J. R. Herting
Article

DOI: 10.1007/BF02130467

Cite this article as:
Hargens, L.L. & Herting, J.R. Scientometrics (1990) 19: 91. doi:10.1007/BF02130467

Abstract

Studies of representative samples of submissions to scientific journals show statistically significant associations between referees' recommendations. These associations are moderately large given the multidimensional and unstable character of scientists' evaluations of papers, and composites of referees' recommendations can significantly aid editors in selecting manuscripts for publication, especially when there is great variability in the quality of submissions and acceptance rates are low. Assessments of the value of peer-review procedures in journal manuscript evaluation should take into account features of the entire scholarly communications system present in a field.

Copyright information

© Akadémiai Kiadó 1990

Authors and Affiliations

  • L. L. Hargens
    • 1
  • J. R. Herting
    • 2
  1. 1.Department of SociologyUniversity of IllinoisUrbana(USA)
  2. 2.Department of Sociology Stanford UniversityStanford(USA)