A critical review of endoscopic indices in ulcerative colitis: inter-observer variation of the endoscopic index
First Online: 27 June 2008 Received: 29 April 2008 Accepted: 23 May 2008 DOI:
Cite this article as: Hirai, F. & Matsui, T. Clin J Gastroenterol (2008) 1: 40. doi:10.1007/s12328-008-0018-z Abstract
Various endoscopic indices (EIs) are available for evaluating the endoscopic features of ulcerative colitis (UC), but those currently used in clinical trials are not uniform and have been reported to vary considerably. The currently available EIs for UC include qualitative indices (Baron, Matts and Blackstone scores), the Rachmilewitz endoscopic index (REI; total sum of scores of four types of severity of mucosal lesions), among others. As each of these indices has its own unique characteristics, the selection of the proper EI has to be taken into account in the design of the clinical trial. Endoscopy is an observer-dependent diagnostic method, and inter-observer and intra-observer variations are often problematic. Among other factors, the reliability of clinical trials might be reduced considerably if inter-observer agreement is too low. To date, however, few analyses have focused on inter-observer variation in EIs for UC. The study reported here was undertaken to analyze inter-observer variations in the Baron score and REI. The
κ statistics, an indicator of inter-observer agreement, was fair and not particularly high for either the Baron score ( κ = 0.31) or REI ( κ = 0.27). Modifications made to the REI (modified into a 4-point scale by the authors of this study), making it similar to the Baron score, resulted in κ statistics of 0.44 (moderate). The REI, designed to evaluate many mucosal abnormalities, seemed to enhance the validity of endoscopic grading of UC. It is desirable that inter-observer variations in various EIs are analyzed properly and reviewed comparatively. We emphasize the necessity of establishing the optimal EI for designing clinical trials of UC. Keywords Clinical trials Endoscopic indices Inter-observer variation Ulcerative colitis References
Asfeldt AM, Straume B, Paulssen EJ. Impact of observer variability on the usefulness of endoscopic images for the documentation of upper gastrointestinal endoscopy. Scand J Gastroenterol. 2007;42:1106–12.
Baron JH, Connell AM, Lennard-Jones JE. Variation between observers in describing mucosal appearances in proctocolitis. Br Med J. 1964;1:89–92.
Rcahmilwits D. Coated mesalazine (5-aminosalicylic acid) versus sulphasalazine in the treatment of active ulcerative colitis: a randomised trial. Br Med J. 1989;298:82–6.
D’Haens G, Sandborn WJ, Feagan BG, Geboes K, Hanauer SB, Irvine EJ, et al. A review of activity indices and efficacy end points for clinical trials of medical therapy in adults with ulcerative colitis. Gastroenterology. 2007;132:763–86.
Matts SGF. The value of rectal biopsy in the diagnosis of ulcerative colitis. Q J Med. 1961;30:393–407.
Blackstone MO. Differentiation ulcerative colitis from Crohn’s disease. In: Blackstone MO, editor. Endoscopic interpretation: normal and pathologic appearance of the gastrointestinal tract. New York: Raven;1984. p. 464–96
Sutherland LR, Martin F, Greer S, Robinson M, Greenberger N, Saibil F, et al. 5-aminosalicylic acid enema in the treatment of distal ulcerative colitis, proctosigmoiditis, and proctitis. Gastroenterology. 1987;92:1894–8.
Schroeder KW, Tremaine WJ, Ilstrup DM. Coated oral 5-aminosalicylic acid therapy for mildly to moderately active ulcerative colitis. A randomized study. N Engl J Med. 1987;317:1625–29.
Rutgeerts P, Sandborn WJ, Feagan BG, Reinisch W, Olson A, Johanns J, et al. Infliximab induction and maintenance therapy for ulcerative colitis. N Engl J Med. 2005;353:2462–76.
Chinyu SU, Lewis JD, Goldberg B, Brensinger C, Lichtenstein GR. A metaanalysis of the placebo rates of remission and response in clinical trial of active ulcerative colitis. Gastroenterology. 2007;132:516–26.
Feagan BG, Greenberg GR, Wild G, Fedrak RN, Pare P, McDonald JW, et al. Treatment of ulcerative colitis with a humanized antibody to the alpha4beta7 integrin. N Engl J Med. 2005;352:2499–507.
Pullan RD, Ganesh S, Mani V, Morris J, Evans BK, Williams GT, et al. Comparison of bismuth citrate and 5-aminosalicylic acid enemas in distal ulcerative colitis: a controlled trial. Gut. 1993;34:676–9.
Riley SA, Mani V, Goodman MJ, Herd ME, Dutt S, Turnberg LA, et al. Comparison of delayed release 5 aminosalicylic acid (mesalazine) and sulphasalazine in the treatment of mild to moderate ulcerative colitis relapse. Gut. 1988;29:669–74.
Hawthorne AB, Logan RF, Hawkey CJ. Randomised controlled trial of azathioprine withdrawal in ulcerative colitis. Br Med J. 1992;305:20–2.
Rembacken BJ, Snelling AM, Hawkey PM, Chalmers DM, Axon AT. Non-pathogenic
versus mesalazine for the treatment of ulcerative colitis: a randomised trial. Lancet. 1999;354:635–9.
Matsui T, Wada Y, Hirai F, Sou S. Endoscopy in clinics of inflammatory bowel disease. Gastroentrol Endosc. 2006;48:291–302.
Dancygier H, Wurbs D, Classen M. A new method for the endoscopic determination of gastrointestinal ulcer area. Endoscopy. 1981;13:214–6.
Rondonotti E, Spada C, Cave D, Pennazio M, Riccinoni ME, DeVitis I, et al. Video capsule enteroscopy in the diagnosis of celiac disease: a multicenter study. Am J Gastroenterol. 2007;102:1624–31.
Delvaux M, Papanikolaou IS, Fassler I, Pohl H, Voderholzer W, Rosch T, et al. Esophageal capsule endoscopy in patients with suspected esophageal disease: double blinded comparison with esophagogastroduodenoscopy and assessment of interobserver variability. Endoscopy. 2008;40:16–22.
Lee YC, Lin JT, Chiu HM, Liao WC, Chen CC, Tu CH, et al. Intraobserver and interobserver consistency for grading esophagitis with narrow-band imaging. Gastrointest Endosc. 2007;66:230–6.
Edebo A, Tam W, Bruno M, Van Berkel AM, Johnson C, Schoeman M, et al. Magnification endoscopy for diagnosis of nonerosive reflux disease: a proposal of diagnostic criteria and critical analysis of observer variability. Endoscopy. 2007;39:195–201.
Orlandi F, Brunelli E, Feliciangeli G, Svegliati-Baroni G, DiSario A, Benedetti A, et al. Observer agreement in endoscopic assessment of ulcerative colitis. Ital J Gastroenterol Hepatol. 1998;30:539–41.
de Lange T, Larsen S, Aabakken L. Inter-observer agreement in the assessment of endoscopic findings in ulcerative colitis. BMC Gastroenterol. 2004;4:9.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Agresti A. Categorical data analysis. New York: Wiley; 1990.