Peer-review reciprocity and commitment to manuscript evaluation
Ideally, peer review ensures published results of scientific research have been expertly validated without bias and can be trusted. This system of verification is unique to science publishing and central to the evidence-based construction of knowledge. Whether conducted anonymously or with full transparency, commitment to ethically participate in the practice of peer review is required. Invitations to review manuscripts have increased with the burgeoning growth and diversification of science, mirrored in the publication of 2.5 million articles annually (Boon 2017). This places additional demands on time budgets limited by research, writing, teaching, mentoring, and administrative responsibilities.
Peer review only works when authoritative peers are willing to serve as reviewers, and it works best when the number of scientists deciding the fate of a manuscript is not constrained. How can the obligations of peer review be satisfied? What are reasonable expectations for participation in peer review?
There is a professional mutualism among scientists that should be acknowledged, as authors and reviewers alternate roles and in doing so form a reciprocal network of critical analysis. Recognition of responsibility and commitment to participation in this system of scholarship is required. For the system to be self-supporting, resilient, and effective, authors of each manuscript submitted to and reviewed by a peer-review journal should accept two to three (the typical number of reviewers in many journals) requests to review manuscripts in return. In the case of multiple-author papers, which represent the great majority of papers today, it can be difficult to keep track of this important ethical obligation due to the lack of awareness of the reviewing activities of co-authors. Nevertheless, effort should be made to maintain the same ratio. Additionally, if a manuscript has been rejected and resubmitted to another journal(s), the number of resubmissions must be considered. For a three-author paper that had been submitted to two journals before acceptance, each co-author should be willing to review one to two manuscripts in return. This pattern seems to be characteristic of peer review in regions where science is well established (on average 1.95 reviews/submission), but is clearly lower in emerging regions like China, India, and Turkey (on average 0.66 reviews/submission) (Publons 2018).
The share of manuscript reviewing for high-output scientists is relatively heavy and may be exacerbated by the ever-growing number of papers (Larsen and von Ins 2010; Bornmann and Mutz 2015; Boon 2017; Publons 2018). A high review load and extensive commitments otherwise are indicated as the main reasons for declining an invitation to review a manuscript (Tite and Schroter 2007; Breuning et al. 2015; Willis 2016). Other reasons include mismatch of expertise, conflict of interest, and unavailability (Breuning et al. 2015; Willis 2016; Publons 2018).
Ortega (2017) attempted to explain variation in the willingness to review manuscripts using Publons-registered reviewer data from the Health Sciences, Physical Sciences and Engineering, Life Sciences and Social Sciences, and Humanities. Only a weak positive correlation (Pearson correlation < 0.1) was found between peer-review activity and reviewer bibliometric performance (number of citations and h-index), and between reviewer productivity and number of reviews (Pearson correlation = 0.204). The latter correlation was expected on the basis of a “fair” review share. Most reviews were made by academically established men of varying rank (Ortega 2017). Willingness to review may also be related to journal impact. In a survey of peer reviewers from five biomedical journals, journal reputation was indicated as an important factor to accept, but not to decline, a request to review a manuscript (Tite and Schroter 2007). Variation in the willingness to review may be related to manuscript subfield (Breuning et al. 2015). If journal impact factor is found to influence decisions to decline to review and as a consequence negatively affect the quality of published work, then ethical obligations in peer review should be critically examined.
If the peer-review process is compromised, the consequences will be significant, as the ultimate goal of scientific publishing cannot be guaranteed. Serious threats to the critical and unbiased peer-review system occur, and the emergence of raptorial pseudojournals could become broader and more serious in a socially digital post-truth environment. For example, fake peer review—facilitated by soliciting authors for potential reviewers of their manuscripts (Haug 2015)—has been reported. Such misconduct—more appropriately called fraud—suggests pressures of a “publish or perish” mentality intrinsically linked to appointment, tenure, promotion, funding decisions, and most other criteria for career advancement.
Peer review will remain the golden standard. Alternative publication models such as F1000Research, an open peer-review platform, and publications on preprint-servers like arXiv that stimulate scientific discussion in the research community after posting may increase in importance. Together with invited or unsolicited commentaries in many journals, they contribute to post-publication self-policing.
Can what appears to be inadequate reviewer cooperation be reversed and the nature of reciprocity in peer review be better recognized? Sustained efforts to counter this disappointing and potentially disturbing trend should involve portable peer review, which as mentioned, may reduce reviewer workload. An important step forward will also be made when academic institutions and funding agencies recognize peer-review contributions as a skill and valued metric of scholarship and productivity that is treated more equitably with publication and citation records, rather than marginalized as generic professional service (Publons 2018). Web platforms, like Publons, anticipated the need for referee acknowledgement by offering official certificates for reviewing activity. Reviewers from emerging global communities of science should be encouraged to continue their commitment to the peer-review process. Although underrepresented today most likely due to language, they are more willing to review (invitation acceptance rate of 56.6%) than scientists in established regions (49.5%) (Publons 2018). Additionally, opportunities for training in formal courses and mentoring of doctoral students, post-doctoral associates, and newly appointed faculty in peer review must be enhanced (Schiermeier 2016).
We thank Associate Editor Dr. Thomas Madsen, whose invitations to review a single manuscript were declined 14 times, for suggesting this editorial and providing insights. We thank our entire Editorial Board for their dedication, and effectively handling the challenge of securing authoritative manuscript evaluations at a time of declining willingness to review.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- Boon S (2017) 21st Century Science Overload, http://blog.cdnsciencepub.com/21st-century-science-overload/
- Publons (2018) Global state of peer review 2018, https://doi.org/10.14322/publons.GSPR2018