Skip to main content

LDPolypVideo Benchmark: A Large-Scale Colonoscopy Video Dataset of Diverse Polyps

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 (MICCAI 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12905))

Abstract

Computer-Aided Diagnosis (CAD) systems for polyp detection provide essential support for colorectal cancer screening and prevention. Recently, deep learning technology has made breakthrough progress in medical image computation and computer-aided diagnosis. However, the deficiency of training data seriously impedes the development of polyp detection techniques. Existing fully-annotated databases, including CVC-ClinicDB, ETIS-Larib, CVC-Colon dataset, Kvasir-Seg, and CVC-ClinicVideoDB, are very limited in polyp size and shape diversity, which is far from the significant complexity in the actual clinical situation. In this paper, we propose LDPolypVideo, a large-scale colonoscopy video database that contains a variety of polyps and more complex bowel environments. Our database contains 160 colonoscopy videos and 40,266 frames in total with polyp annotations, which are four times the size of the largest existing colonoscopy video database CVC-ClinicVideoDB. In order to improve the efficiency of polyp annotation, we design an intelligent annotation tool based on object tracking. Extensive experiments have been conducted to evaluate state-of-the-art object detection approaches on our LDPolypVideo dataset. The average drops of Recall and Precision of four SOTA approaches on this dataset are 26% and 15%, respectively. The great performance drop demonstrates the significant challenges but also the great value of our large-scale and diverse polyp video dataset to facilitate the research on polyp detection. Our dataset is available at https://github.com/dashishi/LDPolypVideo-Benchmark.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Angermann, Q., et al.: Towards real-time polyp detection in colonoscopy videos: Adapting still frame-based methodologies for video sequences analysis. In: Proceedings of the International Workshop Comput. Assisted Robot. Endoscopy Clinical Image-Based Procedures, pp. 29–41 (2017)

    Google Scholar 

  2. Bernal, J., et al.: Wm-dova maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput. Med. Imaging Graph 43, 99–111 (2015)

    Google Scholar 

  3. Bernal, J., et al.: Polyp detection benchmark in colonoscopy videos using gtcreator: a novel fully configurable tool for easy and fast annotation of image databases. In: Proceedings of 32nd CARS Conference (2018)

    Google Scholar 

  4. Bernal, J., Snchez, J., et al.: Towards automatic polyp detection with a polyp appearance model. Pattern Recognition 45(9), 3166–3182 (2012)

    Article  Google Scholar 

  5. Billah, M., Waheed, S., et al.: An automatic gastrointestinal polyp detection system in video endoscopy using fusion of color wavelet and convolutional neural network features. Int. J. Biomed. Imaging, 1–9 (2017)

    Google Scholar 

  6. Borgli, H., et al.: Hyper-kvasir: a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci. Data 7(283), 1–14 (2020)

    Google Scholar 

  7. Brandao, P., Zisimopoulos, O., et al.: Towards a computed-aided diagnosis system in colonoscopy: automatic polyp segmentation using convolution neural networks. Journal of Medical Robotics Research 3(02), 1840002 (2018)

    Article  Google Scholar 

  8. Deng, J., Dong, W., other: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. pp. 248–255. Ieee (2009)

    Google Scholar 

  9. Duan, K., Bai, S., et al.: Centernet: keypoint triplets for object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6569–6578 (2019)

    Google Scholar 

  10. He, K., Zhang, X., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  11. Henriques, J., et al.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37, 583–596 (2015)

    Article  Google Scholar 

  12. Lin, T., Goyal, P., et al.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)

    Google Scholar 

  13. Qadir, H., et al.: Improving automatic polyp detection using cnn by exploiting temporal dependency in colonoscopy video. IEEE J. Biomed. Health Inf. (2019)

    Google Scholar 

  14. Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767 (2018)

  15. Ren, S., He, K., et al.: Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2016)

    Article  Google Scholar 

  16. Shin, Y., et al.: Automatic colon polyp detection using region-based deep cnn and posting learning approached. IEEE Access 6, 40950–40962 (2018)

    Article  Google Scholar 

  17. Siegel, R., Miller, K., Jemal, A.: Cancer statistics. CA A Cancer J. Clinicians 69(1), 7–34 (2019)

    Google Scholar 

  18. Silva, J., Histace, A., et al.: Toward embedded detection of polyps in wce images for early diagnosis of colorectal cancer. Int. J. Comput. Assisted Radiol. Surg. 9(2), 283–293 (2013)

    Article  Google Scholar 

  19. Sornapudi, S., Meng, F., Yi, S.: Region-based automated localization of colonoscopy and wireless capsule endoscopy polyps. Appl. Sci. 9(12) (2019)

    Google Scholar 

  20. Tajbakhsh, N., et al.: Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans. Med. Imaging 35(2), 630–644 (2016)

    Article  MathSciNet  Google Scholar 

  21. Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)

    Article  Google Scholar 

  22. Wang, P., Xiao, X., et al.: Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nature Biomed. Eng. 2(10), 741–748 (2018)

    Article  Google Scholar 

  23. Wang, S., Tao, J., et al.: Improved classifier for computer-aided polyp detection in ct colonography by nonlinear dimensionality reduction. Med. Phys. 35(4), 1377–1386 (2008)

    Article  Google Scholar 

  24. Wang, Z., et al.: Computer aided detection and diagnosis of colon polyps with morphological and texture features. In: Proceedings of SPIE - The International Society for Optical Engineering, vol. 5370, pp. 972–980 (2004)

    Google Scholar 

  25. Wittenberg, T., Zobel, P., et al.: Computer aided detection of polyps in whitelight-colonoscopy images using deep neural networks. Current Directions Biomed. Eng. 5(1), 231–234 (2019)

    Article  Google Scholar 

  26. Yu, Y., Chen, H., et al.: Integrating online and offline three-dimensional deep learning for automated polyp detection in colonoscopy videos. IEEE J. Biomed. Health Inf. 21(1), 65–75 (2017)

    Article  MathSciNet  Google Scholar 

  27. Zhang, R., Zheng, Y., et al.: Polyp detection during colonoscopy using a regression-based convolutional neural network with a tracker. Pattern Recogn. 83, 209–219 (2018)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the National Natural Science Foundation of China under Grants 61976007 and 62076230.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xuejin Chen .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (avi 165086 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ma, Y., Chen, X., Cheng, K., Li, Y., Sun, B. (2021). LDPolypVideo Benchmark: A Large-Scale Colonoscopy Video Dataset of Diverse Polyps. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12905. Springer, Cham. https://doi.org/10.1007/978-3-030-87240-3_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87240-3_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87239-7

  • Online ISBN: 978-3-030-87240-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics