Indian Journal of Gastroenterology

, Volume 37, Issue 1, pp 58–62 | Cite as

A review of publication bias in the gastroenterology literature

  • Trace Heavener
  • Matt Vassar
Short Report


In systematic reviews and meta-analyses, publication bias is particularly problematic, given that combining only statistically significant outcomes is likely to overestimate the true effect of an intervention since non-significant findings have been omitted. We examined practices for evaluating publication bias from gastroenterology literature. We performed a PubMed search to identify systematic reviews published in American Journal of Gastroenterology, Gut, and Gastroenterology from 2005 to 2015. Of the 304 found, 215 studies were eligible for inclusion based on relevant study characteristics. There were 190 systematic reviews which used at least one method to evaluate publication bias and/or included ten or more primary studies. There were 115/190 (60.53%) systematic reviews which used at least one method to evaluate publication bias. Most (105/115, 91.27%) qualified reviews used at least one method to evaluate publication bias and 78/115 (67.83%) used a combination of methods. The most common methods were funnel plot (100/115, 86.96%), Egger’s regression (67/115, 58.26%), and Begg’s (28/115, 24.35%). Of the 115 reviews that performed evaluations, 26 (22.61%) conducted these analyses with fewer than ten primary studies, and a minority (24/115, 20.87%) reached the conclusion that publication bias was present in their work. While methods to assess publication bias were frequently noted among qualified systematic reviews, these methods are limited in value and could be improved by incorporating approaches that assess the degree of publication bias severity.


Gastroenterology Meta-analysis Publication bias Systematic review 


Compliance with ethical standards

Conflict of interest

TH, and MV declare that they have no conflict of interest.

Ethics statement

This study did not utilize animal or human subjects and was approved by the Oklahoma State University Center for Health Sciences Institutional Review Board.

Supplementary material

12664_2018_824_MOESM1_ESM.docx (26 kb)
ESM 1 (DOCX 25 kb)


  1. 1.
    Nikolaos A, Patsopoulos MD, Apostolos AA, et al. Relative citation impact of various study designs in the health sciences. JAMA. 2005;293:2362–6.CrossRefGoogle Scholar
  2. 2.
    Sutton AJ. Evidence concerning the consequences of publication and related biases. In: Rothstein HR, Sutton AJ, Borenstein M, eds. Publication Bias in Meta-Analysis-Prevention, Assessment and Adjustments. Chichester: John Wiley & Sons; 2005.Google Scholar
  3. 3.
    Kepes S, Banks G, McDaniel M, et al. Publication bias in the organizational sciences. Organ Res Methods. 2012;15:624–62.CrossRefGoogle Scholar
  4. 4.
    Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 1990;263:1385–9.CrossRefPubMedGoogle Scholar
  5. 5.
    Song F, Parekh S, Hooper L, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14:1–193.CrossRefGoogle Scholar
  6. 6.
    Moreno SG, Sutton AJ, Ades AE, et al. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Methodol. 2009;9:2.Google Scholar
  7. 7.
    Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Stat Med. 2003;22:2113–26.CrossRefPubMedGoogle Scholar
  8. 8.
    Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration, 2011.Google Scholar
  9. 9.
    van Enst WA, Ochodo E, Scholten RJ, Hooft L, Leeflang MM. Investigation of publication bias in meta-analyses of diagnostic test accuracy: a meta-epidemiological study. BMC Med Res Methodol. 2014;14:70.CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.Google Scholar
  11. 11.
    Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007;4:e78.CrossRefPubMedPubMedCentralGoogle Scholar
  12. 12.
    Onishi A, Furukawa TA. Publication bias is underreported in systematic reviews published in high-impact-factor journals: metaepidemiologic study. J Clin Epidemiol. 2014;67:1320–6.CrossRefPubMedGoogle Scholar
  13. 13.
    Atakpo P, Vassar M. Publication bias in dermatology systematic reviews and meta-analyses. J Dermatol Sci. 2016;82:69–74.CrossRefPubMedGoogle Scholar
  14. 14.
    Hedin RJ, Umberham BA, Detweiler BN, Kollmorgen L, Vassar M. Publication bias and nonreporting found in majority of systematic reviews and meta-analyses in anesthesiology journals. Anesth Analg. 2016;123:1018–25.CrossRefPubMedGoogle Scholar
  15. 15.
    Montori VM, Wilczynski NL, Morgan D. Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005;330:68–0.CrossRefPubMedPubMedCentralGoogle Scholar
  16. 16.
    Haynes RB, Cotoi C, Holland J, et al. Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006;19:1801–8.CrossRefGoogle Scholar
  17. 17.
    Garg AX, Hackam D, Marcello T. Systematic review and meta-analysis: when one study is just not enough. Clin J Am Soc Nephrol. 2008;3:253–60.CrossRefPubMedGoogle Scholar

Copyright information

© Indian Society of Gastroenterology 2018

Authors and Affiliations

  1. 1.Baylor Scott and White Health SystemTempleUSA
  2. 2.Oklahoma State University Center for Health SciencesTulsaUSA

Personalised recommendations