Avoid common mistakes on your manuscript.
Research integrity is the cornerstone of academic medicine. The basic principles of research integrity are ethical writing, honest authorship, and formal peer review [1, 2]. Peer review is the academic evaluation of scholarship by scientists in the same field (peers) that aim to ensure scientifically valid and ethical research [3, 4]. The principles of peer review are largely based on professionalism and academic attitude. Although peer review has been considered the standard to evaluate research, it has problems, bias, flaws, and limitations that should be addressed and optimized [5]. Currently, in the demand for abundant publications on researchers, it may be easy to get attracted by predatory journals inviting to submit a paper in the gold open access route that requires the author to pay a fee if the paper is published. In this publication factory, the journals will publish almost anything for a fee, with a short or without a peer review; therefore, effortless and useless publications will be increasing. Other journals have notorious high rejection rates. Although the high number of submissions justifies a high rejection rate, this reflects another bias of the peer-review process; the reviewers are encouraged to reject manuscripts in most cases in order to preserve this quality measure, and solely manuscripts that find favour within the reviewers get published [5,6,7,8].
Peer review is considered a biased process with identified defects; it is a compromise between the likelihood of accepting a bad paper (type I error) and the likelihood of rejecting a good paper (type II error). Although peer review is supposed to reduce type I errors, it also increases the chances of a type II error. Minimizing the likelihood of a type I error will lead to very few papers being accepted for publication but may also result in a number of good papers being rejected from publication [9]. When the risk of a type I error is high, peer review measures should be more rigorous, and the process should be finalized within one to two months to avoid publication of outdated research [9,10,11]. Peer review is the core of the editorial process and the basis of the publication system. It is expected to detect fraud, identify bad science, assess technical details and methodology, and improve the presentation of results with the optimal writing style of the paper [12]. A demanding, rigorous, constructive, and objective peer review is the best method to validate the quality of the accepted papers, and the solution to avoid drawbacks in medical writing and publishing. Even with its inherent limitations and biases, eliminating peer review is unwise. Improving the peer review reduces the risk of publishing research that does not provide new knowledge, or that has substantial flaws [9, 13]. The present editorial note aims to communicate to the readers of the journal a unified set of criteria for the best peer reviewers and to list the methods to optimize the process.
The best peer reviewers
According to the International Committee on Medical Journal Editors (ICMJE), peer reviewers are experts involved in the evaluation process who are able to timely respond to invitations, submit unbiased and constructive comments, and keep confidentiality [14]. The roles and responsibilities of the peer reviewers have been listed in the updated recommendations of the Council of Science Editors (CSE), where ethical conduct is viewed as a premise of quality [15]. The Committee on Publication Ethics (COPE) further emphasizes editorial strategies that ensure transparent and unbiased reviewer evaluations by trained professionals [16]. The World Association of Medical Editors (WAME) prioritizes selecting the best reviewers with validated profiles to avoid substandard or fraudulent comments [17]. Accordingly, the Sarajevo Declaration on Integrity and Visibility of Scholarly Publications encourages peer reviewers to register with the Open Researcher and Contributor ID (ORCID) platform to validate and publicize their academic activities [18].
Peer reviewers without biases, self-interest, and conflicts are supposed to ensure that journals publish high-quality science by evaluating manuscripts and offering suggestions for improvement [5]. However, finding experienced peer reviewers, seniors, and experts is time-consuming and difficult. Moreover, not all reviewers evaluate personally; they could be assisted by a resident or a junior research fellow or a staff member leading to a debatable result. Differences between peer reviewers’ skills and experience could generate inconsistency [5,6,7,8]. Very few individuals have had formal training and assessment methods for reviewing [19, 20]. The variability of the reviewers is a major weakness of the process and generates the subsequent disparate quality of evaluations. Additional challenges are the limited formal training and assessment methods for review compared to other research topics. Moreover, the evaluation of peer reviewers is difficult and incorporates a lot of biases related to authors’ and reviewers’ gender, nationality, native language, and personal and institutional preferences [6, 21, 22]. Specific criticisms associated with peer reviewers include difficulty in identifying the appropriate peers to serve as qualified reviewers, suffering bias and conflicts of interest between authors and reviewers, tolerating inconsistent results, and being slow and expensive. Often, peer reviewers, especially those suggested by the authors, are viewed suspiciously by the scientific community [12]. Last, inaccurate reviews and occasionally rude or unprofessional and inappropriate comments remain significant problems [5]; in a study, more than half of 1106 anonymous respondents reported receiving at least one unprofessional review, and a majority of those said they had received multiple problematic comments including comments tended to personally target a scientist, lacking constructive criticism, or being unnecessarily harsh or cruel [23, 24].
Although there are no universally accepted criteria for acknowledging the best peer reviewers, it is apparent that they should be active researchers with extensive experience in the subject and have a significant list of relevant and recent publications [25, 26]. Ideally, the reviewers should have equal scholarly ranks and credentials with the authors. The best reviewers should provide comments to guide authors on how to correct mistakes, discuss study limitations, and highlight their strengths. It is recommended that reviewers avoid engaging in the authors’ research and refrain from recommending additional tests and data collection, as these may complicate the research and delay publication [5, 26]. A rigorous peer review is a method against predatory publishing practices, while a short peer review may point to the absence of quality evaluation and apparently predatory publishing practices. A fake peer review is another form of misconduct in the medical publishing of articles without quality checks. Fake reviews are generated by manipulating authors and commercial editing agencies with full access to their own manuscripts and peer review evaluations in the journal editorial manager systems [27]. Assigning independent reviewers and requesting their ORCID IDs may overcome this issue [26, 28].
As previously emphasized, best peer reviewers should be objective, instructional, and informative; provide critical comments to help the editor make his decision and the authors to improve their manuscript; indicate the novelty and significance of the work and if/how it adds to the current literature; identify major flaws in the study hypothesis, materials and methods, techniques, approaches, and statistics; denote statements requiring clarifications; give details for areas to be improved and list changes to be made; write formal but clear to be understood by authors whose native language is not English and avoid complex or unusual words; number the points and refer to pages, paragraphs of sections, or lines in the manuscript; and review all sections of the manuscript including the citations and illustrations [5, 6]. Best peer reviewers should be polite, honest, clear, responsible, and reliable to the authors; should accept promptly and not turn down an invitation for review; return the peer review on time to avoid delays; provide confidential comments to the editor if he/she detects any misconduct such as plagiarism, unattributed work, unethical procedures, or duplicate publication; and disclose potential conflicts of interest [5, 6, 29]. For editorials, letters, and perspectives, the review process should take no more than two weeks by the editors (a rapid rejection policy is welcome if necessary), and some manuscripts such as opinion notes may not require peer reviews as these manuscripts contain normative statements which can be debated by scholars [9].
Given the wide availability of in-journal editorial office services, reviewers’ comments on language typing and syntax errors are categorized as minor [2, 5, 26]. Language problems should be brought up only if they make the paper difficult to understand; but this should be done politely and can be communicated with confidential comments to the editor [29,30,31]. Native English-speaking authors have an advantage in paper writing and reviewing. It is always a matter of huge respect that non-native English speakers can conduct themselves so well in a foreign language both for journals and in meetings. Peer reviewers should not make assumptions about the quality of a paper based on the authors’ nationality and affiliations. Instead, they should focus on the research and communicate to the Editor if the English is so poor that the paper cannot be reviewed or he/she cannot provide feedback on the science [32]. The use of English as the scientific common language began only 400 years ago and continued to expand after the World War with its linguistic advantages including relatively simple and genderless grammar, and the increasing military, economic, and technological clout of the USA. Today, English is the official language of most scientific events and international and indexed academic journals [33]. However, although a common language facilitates international scientific communication and creates a monolingual repository for publications and data; overlooking non-English studies can result in large gaps within global databases [34, 35]. Additionally, non-English speaking authors often publish in lesser-known journals or in regional journals making their research less visible. Depending on scientists with higher English proficiency increases the risk for authorship-related misconduct (fraud) practices [2, 36] and can be a source of anxiety and emotional burden [36, 37]. In the future, multilingual science and publishing are anticipated to promote contributions in different languages.
Options to improve peer review
Peer-reviewing is as good as we make it. It is not perfect, does not prevent errors, and does not impede the publishing of bad papers. Yet, it is the best available quality control system for the scientific literature [38]. Currently, there are many options to improve the drawbacks of the peer-review process including interactive models, standardized processes, open peer-review processes, technological advances, and post-publication peer review [9, 13]. Peer review models have evolved from single-handed editorial evaluations to collegial discussions [39]. Editors ask specific review questions and develop templated documents to focus on reviewers’ comments and authors’ replies. Reviewers’ training has been proposed to improve peer review, and scores have been designed to help improve by process evaluation [5, 6, 12]. Publication including open peer-review reports, authors’ responses, and editorial comments, and decisions is a proposed standardized method to optimize peer review and minimize the risks of publishing questionable original research [9]. Peer review is double-blinded most of the time. However, the research community is small and nothing is hidden under the sun. Blinding fails about one-third of the time; researchers can still be identified in a blinded manuscript such as by content or references cited since researchers often cite themselves and their previous work [40]. Additionally, when reviewers are anonymous, their reviews are more common, bad, and rude [5]. Open peer review may be a solution to poor quality and rude reviews. In a study, a sufficient number (76%) of reviewers agreed to have their names revealed to the authors whose papers they reviewed, making open peer review feasible. Non-blinded reviews were at least as good as blinded reviews, and maybe of better quality, however, they were more likely to recommend acceptance of the paper [41]. Importantly, open peer review can provide the reader with an understanding of the thought process leading to the published work, clarify the decisions that led to the publication, and help improve the quality of scientific communications [12, 42]. The idea is to change the status of peer reviewing from a hobby to a mandatory duty of each academic physician, at least those with dignity and ethos. Reviewing should be taught formally to early career researchers, and possibly it should be financially rewarding for the individuals or their institutions [38]. All researchers should do their share in reviewing papers in their field and should do so as they would like others to perform if they were receiving their own papers [5, 6, 38, 43].
Reviewing for International Orthopaedics
SICOT (Société Internationale de Chirurgie Orthopaedique et Traumatologique) and International Orthopaedics are growing. Over the last year, we appreciated an unprecedented rise of submissions to International Orthopaedics [44] and SICOT-J [45] official journals and academic faces of SICOT. The previous year, the volume of received manuscripts increased in a plethoric way and the acceptance ratio was less than 14%. A large number of papers are immediately rejected as being out of the scope of the journal or with a limited interest for the readers of the journal. The high number of submissions places a substantial strain on publishers, editors, and reviewers, creating a challenging problem of balance between the interests of our authors and readers, and the quality standards growth [22].
International Orthopaedics has been and remains a general-interest orthopaedic journal that accepts and publishes interesting, useful, well-written, and presented orthopaedic research [8]; our intention is to keep our readers updated on the major developments in orthopaedic science, as well as to preserve the historical and cultural memory of orthopaedic heritage. We encourage orthopaedic surgeons to read online the pages of International Orthopaedics for quality innovative papers. These are expected to help in clinical and research, and possibly, they might lead to a change in practice.
We acknowledge the amount of time and effort that is required to perform a study and to prepare and submit a paper, and we aim for a constructive, fair, honest, and ethical peer-review process performed in a timely appropriate fashion. More than 1500 scientists currently review for International Orthopaedics and for SICOT-J. They provide pro-bono work consistently with high standards of quality, responsibility, and talent. Their work and commitment are highly noted and appreciated.
We are strong advocates that medical writing should include both medical knowledge and expertise in writing and should have formal rules and standards. As the official journal of SICOT, we publish articles from many countries around the world including articles from authors in developing countries. Linguistic variations can generate misunderstanding for non-native English-speaking authors, reviewers, and editors. The quality is not always the same, but we presume that the authors improve with each written paper, and our aim is to support the spirit of the SICOT where every surgeon could join to learn and improve. As a major general scientific journal, International Orthopaedics has been a catalyst for change and we foresee this continuing in the future. As editors, we support continuous orthopaedic education, and we look forward to reading and evaluating your work.
References
Mavrogenis AF, Quaile A, Pećina M, Scarlat MM (2018) Citations, non-citations and visibility of International Orthopaedics in 2017. Int Orthop 42(11):2499–2505
Mavrogenis AF, Scarlat MM (2021) Writing for “International Orthopaedics”: authorship, fraud, and ethical concerns. Int Orthop 45(10):2461–2464. https://doi.org/10.1007/s00264-021-05226-8
Tennant JP, Ross-Hellauer T (2020) The limitations to our understanding of peer review. Res Integr Peer Rev 5:6. https://doi.org/10.1186/s41073-020-00092-1
Fraser S (2022) Opportunities to enhance peer review. Can Fam Physician. 68(9):632. https://doi.org/10.46747/cfp.6809632
Mavrogenis AF, Quaile A, Scarlat MM (2020) The good, the bad and the rude peer-review. Int Orthop 44(3):413–415. https://doi.org/10.1007/s00264-020-04504-1
Mavrogenis AF, Sun J, Quaile A, Scarlat MM (2019) How to evaluate reviewers – the international orthopedics reviewers score (INOR-RS). Int Orthop 43(8):1773–1777
Lawrence PA (2003) The politics of publication. Nature 422(6929):259–261. https://doi.org/10.1038/422259a
Mavrogenis AF, Pećina M, Chen W, Scarlat MM (2020) Useful and useless publications measured by bibliometrics and scientometrics in orthopaedic surgery. Are the relevance of a journal and publication metrics useful enough for the scientific promotion of surgeons? Int Orthop 44(10):1875–1879. https://doi.org/10.1007/s00264-020-04803-7
Teixeira da Silva JA, Bornemann-Cimenti H, Tsigaris P (2021) Optimizing peer review to minimize the risk of retracting COVID-19-related literature. Med Health Care Philos. 24(1):21–26. https://doi.org/10.1007/s11019-020-09990-z
Bauchner H (2017) The rush to publication: an editorial and scientific mistake. JAMA 318(12):1109–1110. https://doi.org/10.1001/jama.2017.11816
Ioannidis JPA (2020) Coronavirus disease 2019: The harms of exaggerated information and non-evidence-based measures. Eur J Clin Invest 50(4):e13222. https://doi.org/10.1111/eci.13222
Hall RP 3rd (2021) JID Innovations and Peer Review. JID Innov 1(3):100056. https://doi.org/10.1016/j.xjidi.2021.100056
Interactive public discussion, peer review, and publication in GMD (2020) Geosci Model Dev 2020. https://www.geoscientific-model-development.net/peer-review_process/interactive_review_process.html. Accessed 10 Aug 2022
Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals updated December 2019. http://www.icmje.org/icmje-recommendations.pdf . Accessed 5.12.2020
CSE’s white paper on promoting integrity in scientific journal publications. https://www.councilscienceeditors.org/wp-content/uploads/CSE-White-Paper_2018-update-050618.pdf. Accessed 5.12.2020
Core practices.https://publicationethics.org/core-practices. Accessed 10.12.2020
Best practices for peer reviewer selection and contact to prevent peer review manipulation by authors. https://wame.org/best-practices-for-peer-reviewer-selection-and-contact-to-prevent-peer-review-manipulation-byauthors. Accessed 5.12.2020
Mašić I, Begić E, Donev DM, Gajović S, Gasparyan AY, Jakovljević M, Milošević DB, Sinanović O, Sokolović Š, Uzunović S, Zerem E (2016) Sarajevo Declaration on Integrity and Visibility of Scholarly Publications. Croat Med J 57(6):527–529. https://doi.org/10.3325/cmj.2016.57.527
Knobloch-Westerwick S, Glynn CJ (2013) The Matilda effect in science communication: an experiment on gender bias in publication quality perceptions and collaboration interest. Sci Commun 35:603–625
Wren JD, Valencia A, Kelso J (2019) Reviewer-coerced citation: case report, update on journal policy and suggestions for future prevention. Bioinformatics 35(18):3217–3218
Kowalczuk MK, Dudbridge F, Nanda S, Harriman SL, Patel J, Moylan EC (2015) Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models. BMJ Open 5(9):e008707
Mavrogenis AF, Scarlat MM (2022) The editor endeavours, aims and standards in a surgery journal: our experience with “International Orthopaedics” and the Société Internationale de Chirurgie Orthopédique et de Traumatologie publications. Int Orthop 46(6):1211–1213. https://doi.org/10.1007/s00264-022-05424-y
Lee CJ, Sugimoto CR, Zhang G, Cronin B (2013) Bias in peer review. J Am Soc Inform Sci Tech 64(1):2–17
Silbiger NJ, Stubler AD (2019) Unprofessional peer reviews disproportionately harm underrepresented groups in STEM. PeerJ 7:e8247
Gasparyan AY, Kitas GD (2012) Best peer reviewers and the quality of peer review in biomedical journals. Croat Med J 53:386–389. https://doi.org/10.3325/cmj.2012.53.386
Zimba O, Gasparyan AY (2021) Peer review guidance: a primer for researchers. Reumatologia 59(1):3–8. https://doi.org/10.5114/reum.2021.102709
Cyranoski D (2017) China cracks down on fake peer reviews. Nature 546:464. https://doi.org/10.1038/546464a
Ferguson C, Marcus A, Oransky I (2014) Publishing: The peer-review scam. Nature 515:480–482
Zazgyva A, Kon E, Mauffrey C, Mavrogenis AF, Scarlat MM (2017) Reviews, reviewers and reviewing. Int Orthop 41(1):1–2
Quaile A, Scarlat MM, Mavrogenis AF, Mauffrey C (2019) International Orthopaedics – instructions for authors, English expression, style and rules. Int Orthop 43(11):2425–2427
Available at: https://www.natureindex.com/news-blog/linda-beaumont-research-journals-should-take-action-against-toxic-peer-reviews. Accessed 6 Jan 2023
Romero-Olivares AL (2019) Reviewers, don’t be rude to nonnative English speakers. Available at: https://www.sciencemag.org/careers/2019/10/reviewers-don-t-be-rude-nonnative-english-speakers. Accessed 6 Jan 2020
Steigerwald E, Ramírez-Castañeda V, Brandt DYC, Báldi A, Shapiro JT, Bowker L, Tarvin RD (2022) Overcoming Language Barriers in Academia: Machine Translation Tools and a Vision for a Multilingual Future. Bioscience 72(10):988–998. https://doi.org/10.1093/biosci/biac062
Amano T, González-Varo JP, Sutherland WJ (2016) Languages Are Still a Major Barrier to Global Science. PLoS Biol 14(12):e2000933. https://doi.org/10.1371/journal.pbio.2000933
Angulo E, Diagne C, Ballesteros-Mejia L, Adamjy T, Ahmed DA, Akulov E, Banerjee AK, Capinha C, Dia CAKM, Dobigny G, Duboscq-Carra VG, Golivets M, Haubrock PJ, Heringer G, Kirichenko N, Kourantidou M, Liu C, Nuñez MA, Renault D, Roiz D, Taheri A, Verbrugge LNH, Watari Y, Xiong W, Courchamp F (2021) Non-English languages enrich scientific knowledge: the example of economic costs of biological invasions. Sci Total Environ 775:144441. https://doi.org/10.1016/j.scitotenv.2020.144441
Ramírez-Castañeda V (2020) Disadvantages in preparing and publishing scientific papers caused by the dominance of the English language in science: The case of Colombian researchers in biological sciences. PLoS One 15(9). https://doi.org/10.1371/journal
Mavrogenis AF, Scarlat MM (2022) Stress, anxiety, and burnout of orthopaedic surgeons in COVID-19 pandemic. Int Orthop 46(5):931–935. https://doi.org/10.1007/s00264-022-05393-2
Della-Sala S (2022) Individual integrity and public morality in scientific publishing. Dement Neuropsychol 16(2):129–134. https://doi.org/10.1590/1980-5764-DN-2022-V001
Peer review should be an honest (2020) but collegial, conversation. Nature 582:314. https://doi.org/10.1038/d41586-020-01622-z
Chung KC, Shauver MJ, Malay S, Zhong L, Weinstein A, Rohrich RJ (2015) Is double-blinded peer review necessary? The effect of blinding on review quality. Plast Reconstr Surg 136(6):1369–1377. https://doi.org/10.1097/PRS.0000000000001820
Walsh E, Rooney M, Appleby L, Wilkinson G (2000) Open peer review: a randomized controlled trial. Br J Psychiatry 176:47–51
Ross-Hellauer T, Görögh E (2019) Guidelines for open peer review implementation. Res Integr Peer Rev 4:4. https://doi.org/10.1186/s41073-019-0063-9
Della Sala S (2015) Author/reviewer: a case of split personality. Cortex 69:A1. https://doi.org/10.1016/j.cortex.2015.04.012
https://www.springer.com/journal/264. Accessed 29 Jan 2023
https://www.sicot-j.org/. Accessed 29 Jan 2023
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mavrogenis, A.F., Scarlat, M.M. Quality peer review is mandatory for scientific journals: ethical constraints, computers, and progress of communication with the reviewers of International Orthopaedics. International Orthopaedics (SICOT) 47, 605–609 (2023). https://doi.org/10.1007/s00264-023-05715-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00264-023-05715-y