Skip to main content
Log in

Impact and perceived value of journal reporting guidelines among Radiology authors and reviewers

  • Imaging Informatics and Artificial Intelligence
  • Published:
European Radiology Aims and scope Submit manuscript

Abstract

Objectives

To analyse the author-perceived impact on the final manuscript and perceived value of journal reporting guidelines among Radiology authors and reviewers.

Methods

This survey was conducted among all corresponding authors of original research submissions to Radiology. Separately, we surveyed active Radiology reviewers. Results were analysed using logistic multivariate regression.

Results

Overall, 60% of authors (831/1391) completed the survey. Only 15% (120/821) had used the guideline and checklist when designing the study, significantly more so for PRISMA (55%, 16/29) compared with STARD and STROBE users (17%, 52/310; p < 0.001 and 10%, 46/443; p < 0.001). For 23% of the surveyed manuscripts (189/821), authors used the guidelines when writing the manuscript; these authors more often reported an impact on the final manuscript (i.e. changes in the content, 57%, 107/189) compared to those who used the guideline when submitting the manuscript (35%, 95/272; p < 0.001; OR 0.433, 95% confidence interval [CI] 0.288–0.648, p < 0.001) or when the checklist was requested by the editorial office (17%, 41/240; p < 0.001; OR 0.156, CI 0.097–0.247, p < 0.001). The perceived value of the reporting guideline was rated significantly higher the earlier the authors used the guideline in the research process (p < 0.001). The checklist was used by 77% of reviewers (200/259) some or all of the time; 60% (119/199) said it affected their reviews.

Conclusion

Reporting guidelines had more author-perceived impact on the final manuscript and higher perceived value the earlier they were used, suggesting that there is a need for enhanced education on the use of these guidelines.

Key Points

• Only 15% of authors had used the respective reporting guideline and checklist when designing the study.

• Almost 4 out of 5 Radiology authors and half of reviewers judged the guideline checklists to be useful or very useful.

• Reporting guidelines had more author-perceived impact on manuscripts, i.e. changes that were made in the final manuscript, the earlier authors used them in the research process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Abbreviations

CONSORT:

Consolidated Standards of Reporting Trials

PRISMA:

Preferred Reporting Items for Systematic reviews and Meta-Analyses)

STARD:

Standards for Reporting Diagnostic Accuracy

STROBE:

Strengthening the Reporting of Observational Studies in Epidemiology

References

  1. Topol EJ (2016) Money back guarantees for non-reproducible results? BMJ 353:i2770

    Article  PubMed  Google Scholar 

  2. Rennie D, Flanagin A (2014) Research on peer review and biomedical publication: furthering the quest to improve the quality of reporting. JAMA 311:1019–1020

    Article  CAS  PubMed  Google Scholar 

  3. The Equator Network. Available via http://www.equator-network.org/. Accessed 28 Sept 2017

  4. Moher D, Hopewell S, Schulz KF et al (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:c869

    Article  PubMed  PubMed Central  Google Scholar 

  5. Schulz KF, Altman DG, Moher D; CONSORT Group (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 340:c332

  6. Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 351:h5527

    Article  PubMed  PubMed Central  Google Scholar 

  7. Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Radiology 226:24–28

    Article  PubMed  Google Scholar 

  8. Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700

    Article  PubMed  PubMed Central  Google Scholar 

  9. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535

  10. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP; STROBE Initiative (2007) Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 335:806–808

  11. O'Leary JD, Crawford MW (2013) Review article: reporting guidelines in the biomedical literature. Can J Anaesth 60:813–821

    Article  PubMed  Google Scholar 

  12. Grant SP, Mayo-Wilson E, Melendez-Torres GJ, Montgomery P (2013) Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications. PLoS One 8:e65442

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Cobo E, Cortés J, Ribera JM et al (2011) Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ 343:d6783

  14. Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ (2018) ARRIVE has not ARRIVEd: support for the ARRIVE (animal research: reporting of in vivo experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS One 13:e0197882

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Moher D, Jones A, Lepage L; CONSORT Group (Consolidated Standards for Reporting of Trials) (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995

  16. Plint AC, Moher D, Morrison A et al (2006) Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 185:263–267

    PubMed  Google Scholar 

  17. Korevaar DA, Wang J, van Enst WA et al (2015) Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 274:781–789

    Article  PubMed  Google Scholar 

  18. Pouwels KB, Widyakusuma NN, Groenwold RH, Hak E (2016) Quality of reporting of confounding remained suboptimal after the STROBE guideline. J Clin Epidemiol 69:217–224

    Article  PubMed  Google Scholar 

  19. Page MJ, Moher D (2017) Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement and extensions: a scoping review. Syst Rev 6:263

    Article  PubMed  PubMed Central  Google Scholar 

  20. Levine D, Kressel HY (2016) Radiology 2016: the care and scientific rigor used to process and evaluate original research manuscripts for publication. Radiology 278:6–10

    Article  PubMed  Google Scholar 

  21. McInnes MD, Bossuyt PM (2015) Pitfalls of systematic reviews and meta-analyses in imaging research. Radiology 277:13–21

    Article  PubMed  Google Scholar 

  22. Mannocci A, Saulle R, Colamesta V et al (2015) What is the impact of reporting guidelines on public health journals in Europe? The case of STROBE, CONSORT and PRISMA. J Public Health (Oxf) 37:737–740

    Google Scholar 

  23. Barnes C, Boutron I, Giraudeau B, Porcher R, Altman DG, Ravaud P (2015) Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Med 13:221

    Article  PubMed  PubMed Central  Google Scholar 

  24. Schueler S, Walther S, Schuetz GM, Schlattmann P, Dewey M (2013) Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (quality assessment of diagnostic accuracy studies included in systematic reviews) items on sensitivity and specificity. Eur Radiol 23:1603–1622

    Article  PubMed  Google Scholar 

  25. Frank RA, Sharifabadi AD, Salameh JP et al (2018) Citation bias in imaging research: are studies with higher diagnostic accuracy estimates cited more often? Eur Radiol. https://doi.org/10.1007/s00330-018-5801-8

  26. Sardanelli F, Alì M, Hunink MG, Houssami N, Sconfienza LM, Di Leo G (2018) To share or not to share? Expected pros and cons of data sharing in radiological research. Eur Radiol 28:2328–2335

Download references

Acknowledgments

We thank all authors and reviewers for participation in this study. Without the help of the staff at the Radiological Society of Northern America (RSNA), this study would not have been possible. We are also thankful to other members on the editorial board of Radiology for discussions. We are thankful to Bettina Herwig for copy editing, to Kyllan Wescott for data management, and to Ivan Perez for help with the multivariable analysis.

Funding

Prof. Dewey has received support for this study from the International Society for Strategic Studies in Radiology (Young Leaders Club).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marc Dewey.

Ethics declarations

Guarantor

The scientific guarantor of this publication is Prof. Dr. Marc Dewey.

Conflict of interest

The authors of this manuscript declare no relevant relationships with companies and no conflicts of interest.

Statistics and biometry

No complex statistical methods were necessary for this paper.

Informed consent

This investigation received a waiver of exemption from the committee on clinical investigations at Beth Israel Deaconess Medical Center.

Ethical approval

This investigation received a waiver of exemption from the committee on clinical investigations at Beth Israel Deaconess Medical Center.

Methodology

• Prospective

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(PDF 181 kb)

ESM 2

(PDF 183 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dewey, M., Levine, D., Bossuyt, P.M. et al. Impact and perceived value of journal reporting guidelines among Radiology authors and reviewers. Eur Radiol 29, 3986–3995 (2019). https://doi.org/10.1007/s00330-018-5980-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00330-018-5980-3

Keywords

Navigation