Skip to main content

Advertisement

Log in

Poor inter-observer agreement on the endoscopic diagnosis of eosinophilic esophagitis among Japanese endoscopists

  • Original Article
  • Published:
Esophagus Aims and scope Submit manuscript

Abstract

Background

A variety of endoscopic findings are considered useful for the diagnosis of eosinophilic esophagitis (EoE). However, the diagnostic consistency among Japanese endoscopists for those findings has not been fully examined. The aim of this study was to investigate the inter- and intra-observer agreement for endoscopic findings suggesting EoE.

Methods

Forty endoscopists, including 20 with board certification from the Japan Gastroenterological Endoscopy Society (JGES), participated in this study. Initially, they examined 50 randomized white-light endoscopic images from 30 patients with EoE and 20 without EoE. Four weeks later, the same 50 endoscopic images were re-examined in a different random order. Inter- and intra-observer agreement was calculated using kappa statistics for multiple observers.

Results

The kappa coefficient of reliability [95% confidence interval (CI)] for all 40 endoscopists for diagnosis of EoE was 0.34 (0.33–0.35), indicating poor level of inter-observer agreement, while intra-observer agreement showed a moderate value of 0.52 (0.47–0.57). Among 4 possible endoscopic findings (linear furrows, concentric rings, edema, white exudates) for EoE, acceptable levels (kappa value >0.4) of inter- and intra-observer agreement were seen only for linear furrows. When the JGES board-certified and non-certified endoscopists were compared for successful diagnosis of EoE, the value was significantly higher for the board-certified group. However, the level of inter-observer agreement remained poor level.

Conclusion

We concluded that inter-observer agreement on the endoscopic diagnosis of EoE among Japanese endoscopists did not reach a clinically acceptable level.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Kinoshita Y, Ishimura N, Mishiro T, et al. Diagnosis and treatment of eosinophilic esophagitis in Japan. Esophagus. 2016;14:66–75.

    Article  Google Scholar 

  2. Rothenberg ME. Molecular, genetic, and cellular bases for treating eosinophilic esophagitis. Gastroenterology. 2015;148:1143–57.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Arias A, Perez-Martinez I, Tenias JM, et al. Systematic review with meta-analysis: the incidence and prevalence of eosinophilic oesophagitis in children and adults in population-based studies. Aliment Pharmacol Ther. 2016;43:3–15.

    Article  CAS  PubMed  Google Scholar 

  4. Kinoshita Y, Ishimura N, Oshima N, et al. Systematic review: eosinophilic esophagitis in Asian countries. World J Gastroenterol. 2015;21:8433–40.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Aceves SS. Remodeling and fibrosis in chronic eosinophil inflammation. Dig Dis. 2014;32:15–21.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Oshima N, Ishihara S, Fukuba N, et al. Epidermal differentiation complex protein involucrin is down-regulated in eosinophilic esophagitis. Esophagus. 2017;14:171–7.

    Article  Google Scholar 

  7. Kinoshita Y, Furuta K, Ishimura N, et al. Clinical characteristics of Japanese patients with eosinophilic esophagitis and eosinophilic gastroenteritis. J Gastroenterol. 2013;48:333–9.

    Article  PubMed  Google Scholar 

  8. Dellon ES, Rusin S, Gebhart JH, et al. Utility of a noninvasive serum biomarker panel for diagnosis and monitoring of eosinophilic esophagitis: a prospective study. Am J Gastroenterol. 2015;110:821–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Kinoshita Y, Furuta K, Ishimura N, et al. Elevated plasma cytokines in Japanese patients with eosinophilic esophagitis and gastroenteritis. Digestion. 2012;86:238–43.

    Article  CAS  PubMed  Google Scholar 

  10. Dellon ES, Gonsalves N, Hirano I, et al. ACG clinical guideline: evidenced based approach to the diagnosis and management of esophageal eosinophilia and eosinophilic esophagitis (EoE). Am J Gastroenterol. 2013;108:679–92.

    Article  PubMed  Google Scholar 

  11. Liacouras CA, Furuta GT, Hirano I, et al. Eosinophilic esophagitis: updated consensus recommendations for children and adults. J Allergy Clin Immunol. 2011;128:3–20.

    Article  PubMed  Google Scholar 

  12. Hirano I, Moy N, Heckman MG, et al. Endoscopic assessment of the oesophageal features of eosinophilic oesophagitis: validation of a novel classification and grading system. Gut. 2013;62:489–95.

    Article  PubMed  Google Scholar 

  13. Kim HP, Vance RB, Shaheen NJ, et al. The prevalence and diagnostic utility of endoscopic features of eosinophilic esophagitis: a meta-analysis. Clin Gastroenterol Hepatol. 2012;10:988–96.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Salek J, Clayton F, Vinson L, et al. Endoscopic appearance and location dictate diagnostic yield of biopsies in eosinophilic esophagitis. Aliment Pharmacol Ther. 2015;41:1288–95.

    Article  CAS  PubMed  Google Scholar 

  15. Shimura S, Ishimura N, Tanimura T, et al. Reliability of symptoms and endoscopic findings for diagnosis of esophageal eosinophilia in a Japanese population. Digestion. 2014;90:49–57.

    Article  PubMed  Google Scholar 

  16. van Rhijn BD, Warners MJ, Curvers WL, et al. Evaluating the endoscopic reference score for eosinophilic esophagitis: moderate to substantial intra- and interobserver reliability. Endoscopy. 2014;46:1049–55.

    Article  PubMed  Google Scholar 

  17. Peery AF, Cao H, Dominik R, et al. Variable reliability of endoscopic findings with white-light and narrow-band imaging for patients with suspected eosinophilic esophagitis. Clin Gastroenterol Hepatol. 2011;9:475–80.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cohen J. A Coefficient of Agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.

    Article  Google Scholar 

  19. Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychol Bull. 1979;86:974–7.

    Article  Google Scholar 

  20. Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci. 1986;1:54–75.

    Article  Google Scholar 

  21. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  22. Straumann A, Rossi L, Simon HU, et al. Fragility of the esophageal mucosa: a pathognomonic endoscopic sign of primary eosinophilic esophagitis? Gastrointest Endosc. 2003;57:407–12.

    Article  PubMed  Google Scholar 

  23. Dellon ES, Gebhart JH, Higgins LL, et al. The esophageal biopsy “pull” sign: a highly specific and treatment-responsive endoscopic finding in eosinophilic esophagitis (with video). Gastrointest Endosc. 2016;83:92–100.

    Article  PubMed  Google Scholar 

  24. Okimoto E, Ishimura N, Okada M, et al. Specific locations of linear furrows in patients with esophageal eosinophilia. Dig Endosc. 2017;29:49–56.

    Article  PubMed  Google Scholar 

  25. Katsube T, Adachi K, Furuta K, et al. Difference in localization of esophageal mucosal breaks among grades of esophagitis. J Gastroenterol Hepatol. 2006;21:1656–9.

    Article  PubMed  Google Scholar 

  26. Ishimura N, Amano Y, Uno G, et al. Endoscopic characteristics of short-segment Barrett’s esophagus, focusing on squamous islands and mucosal folds. J Gastroenterol Hepatol. 2012;27(Suppl 3):82–7.

    Article  PubMed  Google Scholar 

  27. Mann NS, Leung JW. Pathogenesis of esophageal rings in eosinophilic esophagitis. Med Hypotheses. 2005;64:520–3.

    Article  CAS  PubMed  Google Scholar 

  28. Adachi K, Mishiro T, Tanaka S, et al. Suitable biopsy site for detection of esophageal eosinophilia in eosinophilic esophagitis suspected cases. Dig Endosc. 2016;28:139–44.

    Article  PubMed  Google Scholar 

  29. Amano Y, Ishimura N, Furuta K, et al. Interobserver agreement on classifying endoscopic diagnoses of nonerosive esophagitis. Endoscopy. 2006;38:1032–5.

    Article  CAS  PubMed  Google Scholar 

  30. Miwa H, Yokoyama T, Hori K, et al. Interobserver agreement in endoscopic evaluation of reflux esophagitis using a modified Los Angeles classification incorporating grades N and M: a validation study in a cohort of Japanese endoscopists. Dis Esophagus. 2008;21:355–63.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This study was supported by the Health and Labour Sciences Research Grants for research on intractable diseases from the Ministry of Health, Labour and Welfare of Japan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Norihisa Ishimura.

Ethics declarations

Ethical Statement

The present study was performed at the Shimane University Hospital in accordance with the Declaration of Helsinki and the protocol was approved by the ethics committee of the Shimane University School of Medicine. This study was registered with the University Hospital Medical Information Network (UMIN) clinical trials registry (UMIN 000018704).

Conflict of interest

The authors declare no conflict of interests for this article.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Izumi, D., Ishimura, N., Okada, M. et al. Poor inter-observer agreement on the endoscopic diagnosis of eosinophilic esophagitis among Japanese endoscopists. Esophagus 14, 309–316 (2017). https://doi.org/10.1007/s10388-017-0581-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10388-017-0581-9

Keywords

Navigation