Skip to main content
SpringerLink
Log in

Reference Accuracy in the General Surgery Literature

  • Published:
World Journal of Surgery Aims and scope Submit manuscript

Abstract

Background

Reference inaccuracy in scientific articles brings the scientific validity of the research into question and may create difficulty when accessing the cited background data. The objective of this study was to examine the reference accuracy in the general surgery literature and its correlation with the journal impact factor.

Methods

Five general surgery journals were chosen with varying impact factors. From the year 2007, one issue was randomly chosen from each journal, and from each issue 180 citations were randomly chosen for review. Three investigators evaluated the chosen references for primary, citational, and quotational errors. The impact factor of each journal was compared to the percentage of errors detected.

Results

The total number of errors per journal ranged from 31.3 to 39.3%, with a total of 35.4% of all citations reviewed containing some type of error. The most common error type detected was incorrect citation of the primary source supporting a statement, the incidence of which ranged from 13.8 to 25.2%, depending on the journal, and accounting for 53.6% of the total errors found. Citational errors, which included incorrect author names, pagination, dates, and issue and volume numbers, ranged from 1.8 to 18.1% and accounted for 20.4% of the total errors detected. Qualitative errors, which occurred when the author misquoted another author’s written assertions or conclusions, ranged from 7.4 to 16.0% and accounted for 34.7% of the total errors detected. Quantitative errors (misquoted numerical data) ranged from 3.1 to 8.6% and accounted for 17.9% of the total errors detected. No association between impact factor and error rate was demonstrated.

Conclusions

Reference inaccuracy is common in the general surgery literature. The impact factor has no clear association with the error rate, demonstrating that journal quality does not necessarily correlate with reference quality. Further investigation into potential methods for improving reference accuracy in the general surgery literature is warranted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Anonymous (2010) Statistical reports on MEDLINE/PubMed baseline data. Available at: http://www.nlm.nih.gov/bsd/licensee/baselinestats.html. Accessed March 2010

  2. Brooke BS, Nathan H, Pawlik TM (2009) Trends in the quality of highly cited surgical research over the past 20 years. Ann Surg 249:162–167

    Article  PubMed  Google Scholar 

  3. Reddy MS, Srinivas S, Sabanayagam N et al (2008) Accuracy of references in general surgical journals: an old problem revisited. Surgeon 6:71–74

    Article  CAS  PubMed  Google Scholar 

  4. Mohammad AE, Laskin DM (2008) Citation accuracy in the oral and maxillofacial surgery literature. J Oral Maxillofac Surg 66:3–6

    Article  PubMed  Google Scholar 

  5. Celayir AC, Sander S, Celayir S (2003) Accuracy of references in the pediatric surgery journals. J Pediatr Surg 38:653–654

    Article  PubMed  Google Scholar 

  6. Evans JT, Nadjari HI, Burchell SA (1990) Quotational and reference accuracy in surgical journals: a continuing peer review problem. JAMA 263:1353–1354

    Article  CAS  PubMed  Google Scholar 

  7. Lee KP, Schotland M, Bacchetti P et al (2002) Association of journal quality indicators with methodological quality of clinical research articles. JAMA 287:2805–2808

    Article  PubMed  Google Scholar 

  8. Browne RF, Logan PM, Lee MJ et al (2004) The accuracy of references in manuscripts submitted for publication. Can Assoc Radiol J 55:170–173

    PubMed  Google Scholar 

  9. Gupta P, Yadav M, Mohta A et al (2005) References in Indian Pediatrics: authors need to be accurate. Indian Pediatr 42:140–145

    PubMed  Google Scholar 

  10. Cakir V, Ilhan F, Kilicoglu G et al (2003) The accuracy of references in Turkish journals in orthopedics and traumatology [abstract]. Acta Orthop Traumatol Turc 37:319–322

    PubMed  Google Scholar 

  11. Ngan Kee WD, Roach VJ, Lau TK (1997) How accurate are references in the Australian and New Zealand Journal of Surgery? Aust N Z J Surg 67:417–419

    Article  CAS  PubMed  Google Scholar 

  12. Gavras H (2002) Inappropriate attribution: the “lazy author syndrome”. Am J Hypertens 15:831

    Article  PubMed  Google Scholar 

  13. Saha S, Saint S, Christakis DA (2003) Impact factor: a valid measure of journal quality? J Med Libr Assoc 91:42–46

    PubMed  Google Scholar 

  14. Berghmans T, Meert AP, Mascaux C et al (2003) Citation indexes do not reflect methodological quality in lung cancer randomised trials. Ann Oncol 14:715–721

    Article  CAS  PubMed  Google Scholar 

  15. Lok CK, Chan MT, Martinson IM (2001) Risk factors for citation errors in peer-reviewed nursing journals. J Adv Nurs 34:223–229

    Article  CAS  PubMed  Google Scholar 

  16. Eichorn P, Yankauer A (1987) Do authors check their references? A survey of accuracy of references in three public health journals. Am J Public Health 77:1011–1012

    Article  CAS  PubMed  Google Scholar 

  17. Schulmeister L (1998) Quotation and reference accuracy of three nursing journals. Image J Nurs Sch 30:143–146

    Article  CAS  PubMed  Google Scholar 

  18. Fenton JE, Brazier H, De Souza A et al (2000) The accuracy of citation and quotation in otolaryngology/head and neck surgery journals. Clin Otolaryngol Allied Sci 25:40–44

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Division of Trauma Surgery and Surgical Critical Care, Los Angeles County + University of Southern California (LAC+USC) Medical Center, 1200 North State Street, Inpatient Tower (C), Room C5L100, Los Angeles, California, 90033, USA

    Julianne Awrey, Kenji Inaba, Galinos Barmparas, Gustavo Recinos, Pedro G. R. Teixeira, Linda S. Chan, Peep Talving & Demetrios Demetriades

Authors
  1. Julianne Awrey
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kenji Inaba
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Galinos Barmparas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gustavo Recinos
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pedro G. R. Teixeira
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Linda S. Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Peep Talving
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Demetrios Demetriades
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kenji Inaba.

Appendix

Appendix

See Table 2.

Table 2 Fictional examples of errors
Full size table

Rights and permissions

Reprints and permissions

About this article

Cite this article

Awrey, J., Inaba, K., Barmparas, G. et al. Reference Accuracy in the General Surgery Literature. World J Surg 35, 475–479 (2011). https://doi.org/10.1007/s00268-010-0912-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00268-010-0912-7

Keywords

Search

Navigation