Skip to main content

Colour Image Analysis of Wireless Capsule Endoscopy Video: A Review

  • Chapter
Color Medical Image Analysis

Part of the book series: Lecture Notes in Computational Vision and Biomechanics ((LNCVB,volume 6))

Abstract

Wireless capsule endoscopy (CE) has been available since 2001 and is now established as one of the principal approaches used to examine the small bowel, with a range of devices available from four manufacturers. But although its use is widespread the reading of CE videos remains an arduous and time consuming exercise for gastroenterologists because relevant frames which are of interest to the physician constitute only about 1 % of the video. CE exam viewing times vary from 40–90 minutes, depending on the clinician’s experience, the complexity of the case and the small bowel transit time. Colour image analysis has been applied by manufacturers to speed up this process, for example, Given Imaging’s Rapid Reader Software includes a suspected blood indicator (SBI) designed to detect bleeding in the video. However, some evaluations of this tool reported concerns with regard to its specificity and sensitivity and so it does not free the specialist from reviewing the entire footage and can only be used as a fast screening aid. Over the past decade a number of papers have proposed a range of colour image processing and computer vision applications to assist the gastroenterologist in the analysis of CE video. These techniques can be divided into three categories, the first considers the topographic segmentation of CE video into meaningful parts such as mouth, oesophagus, stomach, small intestine, and colon. The second involves the detection of clinically significant video events (both abnormal and normal) and the third attempts to adaptively adjust the video viewing speed. This chapter reviews this research focusing particularly on the role of colour and texture descriptors and concludes by suggesting possible future directions for CE analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Iddan G, Meron G, Glukhovsky A, Swain P (2000) Wireless capsule endoscopy. Nature 405:725–729

    Article  Google Scholar 

  2. Ravens AF, Swain P (2002) The wireless capsule: new light in the darkness. Dig Dis 20:127–133

    Article  Google Scholar 

  3. Swain M, Ballard D (1991) Color indexing. Int J of Computer Vision 11–32

    Google Scholar 

  4. Cox J (2005) Finding blood in capsule endoscopy. Master’s thesis, The University of Texas at Arlington

    Google Scholar 

  5. Bourbakis N, Makrogiannis S, Kavraki D (2005) A neural network-based detection of bleeding in sequences of WCE images. In: Proceedings of the 5th IEEE symposium on bioinformatics and bioengineering (BIBE’05)

    Google Scholar 

  6. Hwang S, Oh J, Tang SJ (2006) Expectation maximization based bleeding detection for wireless capsule endoscopy (WCE) images. In: Proceedings of SPIE, vol 6144, pp 577–587

    Chapter  Google Scholar 

  7. Berens J (2002) Image indexing using compressed colour histograms. PhD thesis, School of Information Systems, University of East Anglia, Norwich, UK

    Google Scholar 

  8. Berens J, Finlayson GD, Qiu G (2000) Image indexing using compressed colour histograms. IEE Proc, Vis Image Signal Process 147(4):349–354

    Article  Google Scholar 

  9. Berens J, Finlayson GD (2002) An efficient coding of three dimensional colour distributions for image retrieval. In: CIVR2002. Lecture notes in computer science, vol 2383, pp 245–252

    Google Scholar 

  10. Berens J, Mackiewicz M, Bell GD (2005) Stomach, intestine and colon tissue discriminators for wireless capsule endoscopy (WCE) images. In: Proceedings of SPIE, vol 5747, pp 283–290

    Chapter  Google Scholar 

  11. Berens J, Mackiewicz M, Fisher M, Bell GD (2005) Using colour distributions to discriminate tissues in wireless capsule endoscopy images. In: Proceedings of medical image understanding and analyses 2005 conference, Bristol, UK, July 2005, pp 107–110

    Google Scholar 

  12. Mackiewicz M, Berens J, Fisher M (2008) Wireless capsule endoscopy colour video segmentation. IEEE Trans Med Imaging 27(12):1769–1781

    Article  Google Scholar 

  13. Mackiewicz M (2007) Computer-assisted wireless capsule endoscopy video analysis. PhD thesis, School of Computing Sciences, University of East Anglia, Norwich, UK

    Google Scholar 

  14. Connah D, Finlayson GD (2006) Using local binary pattern operators for colour constant image indexing. In: CGIV 2006 conference proceedings

    Google Scholar 

  15. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  16. Mäenpää T, Pietikäinen M (2004) Classification with color and texture: jointly or separately. Pattern Recognit 37:1629–1640

    Article  Google Scholar 

  17. Pietikäinen M, Hadid A, Zhao G, Ahonen T (2011) Computer vision using local binary patterns. Springer, Berlin

    Book  Google Scholar 

  18. Berens J, Finlayson GD (2002) An efficient coding of three dimensional colour distributions for image retrieval. In: Proc. CIVR2002. Lecture notes in computer science, vol 2383, pp 245–252

    Google Scholar 

  19. Lee J, Oh J, Shah SK, Yuan X, Tang SJ (2007) Automatic classification of digestive organs in wireless capsule endoscopy videos. In: Proceedings of the 2007 ACM symposium on applied computing, SAC’07. ACM, New York, pp 1041–1045

    Chapter  Google Scholar 

  20. Li B, Meng MQ-H (2009) Computer-based detection of bleeding and ulcer in wireless capsule endoscopy images by chromaticity moments. Comput Biol Med 39:141–147

    Article  Google Scholar 

  21. Li B, Meng MQ-H (2009) Computer-aided detection of bleeding regions for capsule endoscopy images. IEEE Trans Biomed Eng 56(4):1032–1039

    Article  Google Scholar 

  22. Li B, Meng MQ-H, Lau JYW (2011) Computer-aided small bowel tumor detection for capsule endoscopy. Artif Intell Med 52(1):11–16

    Article  Google Scholar 

  23. Coimbra M, Campos P, Silva Cunha JP (2005) Extracting clinical information from endoscopic capsules exams using MPEG-7 visual descriptors. In: 2nd European workshop on the integration of knowledge semantic and digital media technologies, November 2005. IEE, New York

    Google Scholar 

  24. Coimbra M, Campos P, Silva Cunha JP (2006) Topographic segmentation and transit times estimation for endoscopic capsule exams. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing, vol II, Toulouse, France, May 2006, pp 1164–1167

    Google Scholar 

  25. Coimbra M, Campos P, Silva Cunha JP (2006) MPEG-7 visual descriptors—contributions for automated feature extraction in capsule endoscopy. IEEE Trans Circuits Syst Video Technol 16:628–637

    Article  Google Scholar 

  26. Coimbra M, Kustra J, Silva Cunha JP, Campos P (2006) Combining color with spatial and temporal position of the endoscopic capsule for improved topographic classification and segmentation. In: Proceedings of the 1st international conference on semantic and digital media technologies, Athens, Greece, December 2006

    Google Scholar 

  27. Silva Cunha JP, Coimbra M, Campos P, Soares JM (2008) Automated topographic segmentation and transit time estimation in endoscopic capsule exams. IEEE Trans Medical Imaging 27(1):19–27

    Article  Google Scholar 

  28. Chang S-F, Sikora T, Puri A (2001) Overview of the MPEG-7 standard. IEEE Trans Circuits Syst Video Technol 11(6):688–695. Special issue on MPEG-7

    Article  Google Scholar 

  29. Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circuits Syst Video Technol 11(6):703–715

    Article  Google Scholar 

  30. Wu P, Ro YM, Won CS, Choi Y (2001) Texture descriptors in MPEG-7. In: Skarbek W (ed) Proceedings CAIP 2001. LNCS, vol 2124, pp 21–28

    Google Scholar 

  31. Duda K, Zielinski T, Fraczek R, Bulat J, Duplaga M (2007) Localization of endoscopic capsule in the GI tract based on MPEG-7 visual descriptors. In: IEEE international workshop on imaging systems and techniques, IST’07, May 2007, pp 1–4

    Chapter  Google Scholar 

  32. Duda K, Zielinski T, Duplaga M, Grega M, Leszczuk M (2007) VQ classification based on MPEG-7 visual descriptors for video endoscopic capsule localisation in the gastrointestinal tract. In: 15th European signal processing conference (EUSIPCO 2007), Poznan, Poland, September 2007

    Google Scholar 

  33. Vilarino F, Kuncheva LI, Radeva P (2005) ROC curves and video analysis optimization in intestinal capsule endoscopy. Pattern Recognit Lett, Special Issue on ROC analysis

    Google Scholar 

  34. Vilarino F, Spyridonos P, Puyol O, Vitrià J, Radeva P (2006) Automatic detection of intestinal juices in wireless capsule video endoscopy. In: Proceedings of ICPR, pp 531–537

    Google Scholar 

  35. Vilarino F, Spyridonos P, DeIorio F, Vitrià J, Azpiroz F, Radeva P (2010) Intestinal motility assessment with video capsule endoscopy: automatic annotation of phasic intestinal contractions. IEEE Trans Med Imaging 29(2):246–259

    Article  Google Scholar 

  36. Mackiewicz M, Fisher M, Jamieson C (2008) Bleeding detection in wireless capsule endoscopy using adaptive colour histogram model and support vector classification. In: Proceedings of SPIE, vol 6914

    Chapter  Google Scholar 

  37. Ortiz F, Torres F (2006) Automatic detection and elimination of specular reflectance in color images by means of MS diagram and vector connected filters. IEEE Trans Syst, Man, Cybern, Part C 36(5):681–687

    Article  Google Scholar 

  38. Igual L, Seguí S, Vitrià J, Azpiroz F, Radeva P (2007) Eigenmotion-based detection of intestinal contractions. Lect Notes Comput Sci 4673(2007):293–300

    Article  Google Scholar 

  39. Hai V, Echigo T, Sagawa R, Yagi K, Schiba M, Higuchi K, Arakawa T, Yagi Y (2006) Adaptive control of video display for diagnostic assistance by analysis of capsule endoscopic images. In: Proceedings of ICPR, pp 531–537

    Google Scholar 

  40. Zheng Y, Hawkins L, Wolff J, Goloubeva O, Goldberg E (2012) Detection of lesions during capsule endoscopy: physician performance is disappointing. Am J Gastroenterol

    Google Scholar 

  41. Mackiewicz M (2011) Capsule endoscopy—state of the technology and computer vision tools after the first decade. In: Pascu O (ed) New techniques in gastrointestinal endoscopy. InTech, New York

    Google Scholar 

  42. Multimedia content description interfaces. Part 6: reference software. MPEG-7 ISO/IEC 15938-6, 2003

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark Fisher .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Fisher, M., Mackiewicz, M. (2013). Colour Image Analysis of Wireless Capsule Endoscopy Video: A Review. In: Celebi, M., Schaefer, G. (eds) Color Medical Image Analysis. Lecture Notes in Computational Vision and Biomechanics, vol 6. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-5389-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-94-007-5389-1_7

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-007-5388-4

  • Online ISBN: 978-94-007-5389-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics