Abstract
In recent years, endoscopic imaging technology has developed rapidly. Dual-mode optical imaging (DMOI) technology in endoscopy allows for rapid imaging of living tissue at the same position. It includes white light imaging (WLI) and compound band imaging (CBI), with each mode offering complementary advantages. WLI is the most commonly used mode in endoscopy. CBI is a virtual optical staining technique that highlights the small vascular structures of the gastrointestinal mucosa. It is essential to fuse their features to improve the image quality of endoscopy. This paper utilizes an image fusion network based on proportional maintenance of gradient and intensity for image fusion. A volunteer experiment was conducted in this study. The oral images were taken for the training and testing of the fusion network, and the results were obtained. We objectively evaluated the quality of the fused images and compared them with the WLI images. The results show that the fused images have natural color and rich details, and the image quality is significantly improved. This study is the first to propose the image fusion of DMOI in endoscopy. Our approach combines the strengths of both source images, which can assist medical professionals in making more precise diagnoses during clinical examinations. We think it has important significance for improving the detection rate of early lesions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nakamoto, S., et al.: Indications for the use of endoscopic mucosal resection for early gastric cancer in Japan: a comparative study with endoscopic submucosal dissection. Endoscopy 41(09), 746–750 (2009)
He, Z., Wang, P., Liang, Y., Fu, Z., Ye, X.: Clinically available optical imaging technologies in endoscopic lesion detection: current status and future perspective. J. Healthc. Eng. 2021 (2021)
Joren, R., Oldenburg, B.: Surveillance of long-standing colitis: the role of image-enhanced endoscopy. Best Pract. Res. Clin. Gastroenterol. 29(4), 687–697 (2015)
Yao, K.: Principles of magnifying endoscopy with narrow-band imaging. In: Zoom Gastroscopy, pp. 49–56. Springer (2014)
Yoshida, N., et al.: Ability of a novel blue laser imaging system for the diagnosis of colorectal polyps. Dig. Endosc. 26(2), 250–258 (2014)
Kuznetsov, K., Lambert, R., Rey, J.-F.: Narrow-band imaging: potential and limitations. Endoscopy 38(01), 76–81 (2006)
Meher, B., Agrawal, S., Panda, R., Abraham, A.: A survey on region based image fusion methods. Inf. Fusion 48, 119–132 (2019)
Zhang, H., Xu, H., Xiao, Y., Guo, X., Ma, J., (eds.): Rethinking the image fusion: a fast unified image fusion network based on proportional maintenance of gradient and intensity. In: Proceedings of the AAAI Conference on Artificial Intelligence (2020)
Zhang, H., Xu, H., Tian, X., Jiang, J., Ma, J.: Image fusion meets deep learning: a survey and perspective. Inf. Fusion 76, 323–336 (2021)
Li, Y., Zhao, J., Lv, Z., Li, J.: Medical image fusion method by deep learning. Int. J. Cogn. Comput. Eng. 2, 21–29 (2021)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q., (eds):. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Kaur, H., Koundal, D., Kadyan, V.: Image fusion techniques: a survey. Arch. Comput. Methods Eng. 28(7), 4425–4447 (2021)
Acknowledgment
The authors acknowledge supports from National Key Research and Development Program of China (2022YFC2405200), National Natural Science Foundation of China (82027807, U22A2051), Beijing Municipal Natural Science Foundation (7212202), Institute for Intelligent Healthcare, Tsinghua University (2022ZLB001), and Tsinghua-Foshan Innovation Special Fund(2021THFS0104).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, S. et al. (2024). An Image Fusion Method Combining the Advantages of Dual-Mode Optical Imaging in Endoscopy. In: Wang, G., Yao, D., Gu, Z., Peng, Y., Tong, S., Liu, C. (eds) 12th Asian-Pacific Conference on Medical and Biological Engineering. APCMBE 2023. IFMBE Proceedings, vol 104. Springer, Cham. https://doi.org/10.1007/978-3-031-51485-2_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-51485-2_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-51484-5
Online ISBN: 978-3-031-51485-2
eBook Packages: EngineeringEngineering (R0)