Abstract
Optical coherence tomography (OCT) has been widely used in the assessment of coronary atherosclerotic plaques. Traditional machine learning methods are mainly based on the image texture features for the plaque segmentation. However, the texture features only represent the information of the local area, which may lead to unsatisfactory results. U-Net and its improved versions use continuous convolution and pooling to extract more advanced features, resulting in the loss of image spatial information and low plaque segmentation accuracy. This paper introduces a spatial pyramid pooling module and a multi-scale dilated convolution module into the U-Net to capture more advanced features while retaining sufficient spatial information. Based on our method, the F1 Score of the segmentation results of the four types of plaques including fibrosis, calcification, lipid and background are 0.85, 0.81, 0.80, 0.99, and the mIOU is 0.7663. Compared to other state-of-the-art methods, our method achieves better plaque segmentation accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Prati, F., Guagliumi, G., Mintz, G.: Expert review document part 2: methodology, terminology and clinical applications of optical coherence tomography for the assessment of interventional procedures. Eur. Heart J. 33(20), 2513–2520 (2012). https://doi.org/10.1093/eurheartj/ehs095
Finet, G., Ohayon, J., Rioufol, G.: Biomechanical interaction between cap thickness, lipid core composition and blood pressure in vulnerable coronary plaque: impact on stability or instability. Coron. Artery Dis. 15(1), 13–20 (2004)
Prakash, A., Hewko, M., Sowa, M.: Texture based segmentation method to detect atherosclerotic plaque from optical tomography images. In: Bouma, R., Leitgeb, B. (eds.) Optical Coherence Tomography and Coherence Techniques VI. SPIE Proceedings, vol. 8802, p. 88020S. Optical Society of America, Munich (2013)
Celi, S., Berti, S.: In-vivo segmentation and quantification of coronary lesions by optical coherence tomography images for a lesion type definition and stenosis grading. Med. Image Anal. 18(7), 1157–1168 (2014). https://doi.org/10.1016/j.media.2014.06.011
Athanasiou, L.S., Bourantas, C.V., Rigas, G.: Methodology for fully automated segmentation and plaque characterization in intracoronary optical coherence tomography images. J. Biomed. Opt. 19(2), 1–14 (2014). https://doi.org/10.1117/1.JBO.19.2.026009
Shalev, R., Prabhu, D., Tanaka, K.: Intravascular optical coherence tomography image analysis method. In: 2015 41st Annual Northeast Biomedical Engineering Conference (NEBEC), pp. 1–2 (2015). https://doi.org/10.1109/NEBEC.2015.7117058
Guo, X., Tang, D., Molony, D.: A machine learning-based method for intracoronary oct segmentation and vulnerable coronary plaque cap thickness quantification. Int. J. Comput. Methods 16(03), 1842008 (2018). https://doi.org/10.1142/S0219876218420082
Rico-Jimenez, J.J., Campos-Delgado, D.U., Villiger, M.: Automatic classification of atherosclerotic plaques imaged with intravascular OCT. Biomed. Opt. Express 7(10), 4069–4085 (2016). https://doi.org/10.1364/BOE.7.004069
Abdolmanafi, A., Duong, L., Dahdah, N.: Characterization of coronary artery pathological formations from OCT imaging using deep learning. Biomed. Opt. Express 9(10), 4936–4960 (2018). https://doi.org/10.1364/BOE.9.004936
He, S., Zheng, J., Maehara, A.: Convolutional neural network based automatic plaque characterization for intracoronary optical coherence tomography images. In: Proceedings of SPIE, vol. 10574, March 2018. https://doi.org/10.1117/12.2293957
Zhang, C., Guo, X., Guo, X.: Machine Learning Model Comparison for Automatic Segmentation of Intracoronary Optical Coherence Tomography and Plaque Cap Thickness Quantification (2020). https://doi.org/10.32604/cmes.2020.09718
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Jegou, S., Drozdzal, M., Vazquez, D.: The one hundred layers tiramisu: fully convolutional densenets for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, July 2017
Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., Liang, J.: UNet++: a nested U-net architecture for medical image segmentation. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 3–11. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_1
Oktay, O., Schlemper, J., Folgoc, L.: Attention U-Net: Learning Where to Look for the Pancreas (2018)
Ibtehaz, N., Rahman, M.S.: MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74–87 (2020). https://doi.org/10.1016/j.neunet.2019.08.025
He, K., Zhang, X., Ren, S.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015). https://doi.org/10.1109/TPAMI.2015.2389824
Szegedy, C., Liu, W., Jia, Y.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015
Yu, F., Koltun, V.: Multi-Scale Context Aggregation by Dilated Convolutions, November 2016
Yushkevich, P.A., Piven, J., Hazlett, H.C.: User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31(3), 1116–1128 (2006). https://doi.org/10.1016/j.neuroimage.2006.01.015
Lin, T.Y., Goyal, P., Girshick, R.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), October 2017
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Cao, X., Zheng, J., Liu, Z., Jiang, P., Gao, D., Ma, R. (2021). Improved U-Net for Plaque Segmentation of Intracoronary Optical Coherence Tomography Images. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12893. Springer, Cham. https://doi.org/10.1007/978-3-030-86365-4_48
Download citation
DOI: https://doi.org/10.1007/978-3-030-86365-4_48
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86364-7
Online ISBN: 978-3-030-86365-4
eBook Packages: Computer ScienceComputer Science (R0)