Skip to main content

Detection of Healthy and Diseased Pylorus Natural Anatomical Center with Convolutional Neural Network Classification and Filters

Abstract

Purpose

The detection of pylorus, a natural gastrointestinal (GI) anatomical structure, is one of the fundamental techniques that enables a high-autonomy digestive tract robot to move from the stomach to the duodenum. The pyloric center is the optimal position for passing pylorus from the soft-tissue protection standpoint. Thus, detection of the pylorus center should be investigated further in view of its indispensability for a high-autonomy GI robot. However, to the best of our knowledge, no result of pylorus center detection has been published thus far.

Methods

In this paper, we have developed a pylorus center detection method using CNN classification, Sobel and Laplace operators. The proposed algorithm’s effectiveness is demonstrated by the precise center detection of six types of healthy pylori and six settings of diseased pylori.

Results

The average detection accuracy of the pylorus center is 22.33 pixels, which corresponds to a relative error of 2.33% when compared to 960 pixels, which corresponds to the diagonal length of an endoscopic image. A single image takes an average of 26.51 ms to process.

Conclusion

The clinical feasibility of the algorithm for real-time pylorus center tracking is established. The developed algorithm enables GI robots to autonomously locate and pass the pylorus.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. Paspatis, G. A., Dumonceau, J. M., Barthet, M., Meisner, S., Repici, A., Saunders, B. P., ... & Hassan, C. (2014). Diagnosis and management of iatrogenic endoscopic perforations: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement. Endoscopy, 46(08), 693–711.

    Article  Google Scholar 

  2. Fujimoto, A., Goto, O., Nishizawa, T., Ochiai, Y., Horii, J., Maehata, T., ... & Yahagi, N. (2017). Gastric ESD may be useful as accurate staging and decision of future therapeutic strategy. Endoscopy International Open, 5(02), E90–E95.

    Article  Google Scholar 

  3. Ben-Menachem, T., Decker, G. A., Early, D. S., Evans, J., Fanelli, R. D., Fisher, D. A., ... & Cash, B. D. (2012). Adverse events of upper GI endoscopy. Gastrointestinal Endoscopy, 76(4), 707–718.

    Article  Google Scholar 

  4. Ciuti, G., Caliò, R., Camboni, D., Neri, L., Bianchi, F., Arezzo, A., ... & Dario, P. (2016). Frontiers of robotic endoscopic capsules: A review. Journal of Micro-bio Robotics, 11(1), 1–18.

    Article  Google Scholar 

  5. Ivanov, A. P. (2020). Analysis of an impact-driven capsule robot. International Journal of Non-Linear Mechanics, 119, 103257.

    Article  Google Scholar 

  6. Norton, J. C., Slawinski, P. R., Lay, H. S., Martin, J. W., Cox, B. F., Cummins, G., ... & Valdastri, P. (2019). Intelligent magnetic manipulation for gastrointestinal ultrasound. Science Robotics, 4(31), eaav7725.

    Article  Google Scholar 

  7. Lau, K. C., Leung, Y. Y., Yam, Y., & Chiu, P. W. Y. (2020). Applications of flexible robots in endoscopic surgery. In Handbook of robotic and image-guided surgery (pp. 303–322). Elsevier.

  8. Cheng, W. B., Moser, M., Kanagaratnam, S., & Zhang, W. J. (2011). Development of autonomous microrobotics in endoscopy. Journal of Medical Engineering & Technology, 35(8), 391–401.

    CAS  Article  Google Scholar 

  9. Yang, G. Z., Cambias, J., Cleary, K., Daimler, E., Drake, J., Dupont, P. E., ... & Taylor, R. H. (2017). Medical robotics—Regulatory, ethical, and legal considerations for increasing levels of autonomy. Science Robotics, 2(4), eaam8638.

    Article  Google Scholar 

  10. Liu, Y., Duan, C., Liang, J., Hu, J., Lu, H., & Luo, M. (2017). Haustral loop extraction for CT colonography using geodesics. International Journal for Computer Assisted Radiology and Surgery, 12, 379–388.

    Article  Google Scholar 

  11. Wei, Z., Yao, J., Wang, S., & Summers, R. M. (2010). Haustral fold detection for ct colonography images using gabor filter. In 2010 Conference record of the forty fourth asilomar conference on signals, systems and computers (pp. 329–331). IEEE.

  12. Zhu, H., Barish, M., Pickhardt, P., & Liang, Z. (2012). Haustral fold segmentation with curvature-guided level set evolution. IEEE Transactions on Biomedical Engineering, 60(2), 321–331.

    Article  Google Scholar 

  13. Vazharov, I. P. (2012). Perforation as a complication of the diagnostic upper and lower endoscopy of the gastrointestinal tract. Journal of IMAB–Annual Proceeding Scientific Papers, 18(3), 273–275.

    Article  Google Scholar 

  14. Lee, S. H., Park, Y. K., Cho, S. M., Kang, J. K., & Lee, D. J. (2015). Technical skills and training of upper gastrointestinal endoscopy for new beginners. World Journal of Gastroenterology WJG, 21(3), 759.

    Article  Google Scholar 

  15. Ahmed, M., & Laskar, R. H. (2019). Eye center localization in a facial image based on geometric shapes of iris and eyelid under natural variability. Image and Vision Computing, 88, 52–66.

    Article  Google Scholar 

  16. Kan, N., Kondo, N., Chinsatit, W., & Saitoh, T. (2018). Effectiveness of data augmentation for cnn-based pupil center point detection. In 2018 57th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) (pp. 41–46). IEEE.

  17. Zhang, W., Smith, M. L., Smith, L. N., & Farooq, A. (2016). Eye center localization and gaze gesture recognition for human–computer interaction. JOSA A, 33(3), 314–325.

    Article  Google Scholar 

  18. Harezlak, K., & Kasprowski, P. (2018). Application of eye tracking in medicine: A survey, research issues and challenges. Computerized Medical Imaging and Graphics, 65, 176–190.

    Article  Google Scholar 

  19. Faraji, M., Cheng, I., Naudin, I., & Basu, A. (2018). Segmentation of arterial walls in intravascular ultrasound cross-sectional images using extremal region selection. Ultrasonics, 84, 356–365.

    Article  Google Scholar 

  20. Gao, Z., Hau, W. K., Lu, M., Huang, W., Zhang, H., Wu, W., ... & Zhang, Y. T. (2015). Automated framework for detecting lumen and media–adventitia borders in intravascular ultrasound images. Ultrasound in Medicine & Biology, 41(7), 2001–2021.

    Article  Google Scholar 

  21. Zakeri, F. S., Setarehdan, S. K., & Norouzi, S. (2017). Automatic media-adventitia IVUS image segmentation based on sparse representation framework and dynamic directional active contour model. Computers in Biology and Medicine, 89, 561–572.

    Article  Google Scholar 

  22. Su, B., Teng, Y., Wang, Z., Hu, Y., Kuang, S., Wang, Y., ... & Zong, Y. (2021). Center tracking for healthy and diseased cardia. Science China Information Sciences, 64(11), 1–2.

    Article  Google Scholar 

  23. Tayel, M. B., Massoud, M. A., & Farouk, Y. (2017). A modified segmentation method for determination of iv vessel boundaries. Alexandria Engineering Journal, 56(4), 449–457.

    Article  Google Scholar 

  24. Xia, M., Yan, W., Huang, Y., Guo, Y., Zhou, G., & Wang, Y. (2019). IVUS images segmentation using spatial fuzzy clustering and hierarchical level set evolution. Computers in Biology and Medicine, 109, 207–217.

    Article  Google Scholar 

  25. Katouzian, A., Angelini, E. D., Carlier, S. G., Suri, J. S., Navab, N., & Laine, A. F. (2012). A state-of-the-art review on segmentation algorithms in intravascular ultrasound (IVUS) images. IEEE Transactions on Information Technology in Biomedicine, 16(5), 823–834.

    Article  Google Scholar 

  26. Larrazabal, A. J., Cena, C. G., & Martínez, C. E. (2019). Video-oculography eye tracking towards clinical applications: A review. Computers in Biology and Medicine, 108, 57–66.

    CAS  Article  Google Scholar 

  27. Yoshino, J., et al. (2007). Stomach and intestine atlas—Upper digestive tract. Tokyo: Hongo.

    Google Scholar 

  28. Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., ... & Tsirigos, A. (2018). Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nature Medicine, 24(10), 1559–1567.

    CAS  Article  Google Scholar 

Download references

Acknowledgements

We appreciated the financial support of the National Natural Science Foundation of China (Grant Nos. 91748103, 61573208) and Beijing Natural Science Foundation (Grant No. Z170001).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Junchen Wang or Wei Yao.

Ethics declarations

Conflict of interest

We appreciated the financial support of the National Natural Science Foundation of China (Grant Nos. 91748103, 61573208) and Beijing Natural Science Foundation (Grant No. Z170001). The authors declare no other competing or fnancial interests.

Ethical Approval

The study was performed following the principles outlined in the Helsinki Declaration and was approved by the Ethics Committee (IRB-LN201703078).

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Su, B., Gong, Y., Chen, Y. et al. Detection of Healthy and Diseased Pylorus Natural Anatomical Center with Convolutional Neural Network Classification and Filters. J. Med. Biol. Eng. 42, 216–224 (2022). https://doi.org/10.1007/s40846-022-00696-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40846-022-00696-6

Keywords

  • Center detection
  • Gastrointestinal robot
  • Image guidance
  • Natural anatomical structures
  • Pylorus
  • Robot autonomy