Advances in Health Sciences Education

, Volume 8, Issue 1, pp 75–96

Impartial Judgment by the “Gatekeepers” of Science: Fallibility and Accountability in the Peer Review Process

  • Mohammadreza Hojat
  • Joseph S. Gonnella
  • Addeane S. Caelleigh
Article

DOI: 10.1023/A:1022670432373

Cite this article as:
Hojat, M., Gonnella, J.S. & Caelleigh, A.S. Adv Health Sci Educ Theory Pract (2003) 8: 75. doi:10.1023/A:1022670432373

Abstract

High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the “gate keepers of science.” In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and “political correctness.” We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

gatekeepers of science Journal reviewer guidelines Journal editor's responsibilities peer review publication bias 

Copyright information

© Kluwer Academic Publishers 2003

Authors and Affiliations

  • Mohammadreza Hojat
    • 1
  • Joseph S. Gonnella
    • 1
  • Addeane S. Caelleigh
    • 3
  1. 1.Center for Research in Medical Education and Health CareJefferson Medical College of Thomas Jefferson UniversityUSA
  2. 2.Jefferson Medical CollegePhiladelphiaUSA
  3. 3.George Washington University School of MedicineUSA