Abstract
In recent years, U-Net has shown excellent performance in medical image segmentation, but it cannot accurately segment nodules of smaller size when segmenting pulmonary nodules. To make it more accurate to segment pulmonary nodules in CT images, U-Net is improved to REMU-Net. First, ResNeSt, which is the state-of-the-art ResNet variant, is used as the backbone of the U-Net, and a spatial attention module is introduced into the Split-Attention block of ResNeSt to enable the network to extract more diverse and efficient features. Secondly, a feature enhancement module based on the atrous spatial pyramid pooling (ASPP) is introduced in the U-Net, which is utilized to obtain more abundant context information. Finally, replacing the skip connection of the U-Net with a multi-scale skip connection overcomes the limitation that the decoder subnet can only accept same-scale feature information. Experiments show that REMU-Net has a Dice score of 84.76% on the LIDC-IDRI dataset. The network has better segmentation performance than most other existing U-Net improvement networks.
References
Bray F, Ferlay J, Soerjomataram I et al (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J Clin 68:394–424. https://doi.org/10.3322/caac.21492
Wu GX, Raz DJ (2016) Lung cancer screening. In: Reckamp KL (ed) Lung cancer. Springer, Cham, pp 1–23
Wu GX, Raz DJ, Brown L, Sun V (2016) Psychological burden associated with lung cancer screening: a systematic review. Clin Lung Cancer 17:315–324. https://doi.org/10.1016/j.cllc.2016.03.007
Wang S, Zhou M, Liu Z et al (2017) Central focused convolutional neural networks: developing a data-driven model for pulmonary nodule segmentation. Med Image Anal 40:172–183. https://doi.org/10.1016/j.media.2017.06.014
Liu H, Cao H, Song E et al (2019) A cascaded dual-pathway residual network for pulmonary nodule segmentation in CT images. Physica Med 63:112–121. https://doi.org/10.1016/j.ejmp.2019.06.003
Usman M, Lee B-D, Byon S-S et al (2020) Volumetric pulmonary nodule segmentation using adaptive ROI with multi-view residual learning. Sci Rep 10:12839. https://doi.org/10.1038/s41598-020-69817-y
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention—MICCAI 2015. Springer, Cham, pp 234–241
Zhou Z, Rahman Siddiquee MM, Tajbakhsh N, Liang J (2018) UNet++: a nested U-Net architecture for medical image segmentation. In: Stoyanov D, Taylor Z, Carneiro G et al (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Cham, pp 3–11
Oktay O, Schlemper J, Folgoc L, et al (2018) Attention U-Net: learning where to look for the pancreas. http://arxiv.org/abs/1804.03999
Huang H, Lin L, Tong R, et al (2020) UNet 3+: A full-scale connected UNet for medical image segmentation. In: ICASSP 2020—2020 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, Barcelona, Spain, pp 1055–1059. https://doi.org/10.1109/ICASSP40776.2020.9053405
Tong G, Li Y, Chen H et al (2018) Improved U-Net for pulmonary nodules segmentation. Optik 174:460–469. https://doi.org/10.1016/j.ijleo.2018.08.086
Rocha J, Cunha A, Mendonça AM (2020) Conventional filtering versus U-Net based models for pulmonary nodule segmentation in CT images. J Med Syst 44:81. https://doi.org/10.1007/s10916-020-1541-9
Shi J, Ye Y, Zhu D et al (2021) Comparative analysis of pulmonary nodules segmentation using multiscale residual U-Net and fuzzy C-means clustering. Comput Methods Programs Biomed 209:106332. https://doi.org/10.1016/j.cmpb.2021.106332
Rendon-Gonzalez E, Ponomaryov V (2016) Automatic Lung nodule segmentation and classification in CT images based on SVM. In: 2016 9th International Kharkiv symposium on physics and engineering of microwaves, millimeter and submillimeter waves (MSMW). IEEE, Kharkiv, Ukraine, pp 1–4. https://doi.org/10.1109/MSMW.2016.7537995
Li B, Chen Q, Peng G et al (2016) Segmentation of pulmonary nodules using adaptive local region energy with probability density function-based similarity distance and multi-features clustering. BioMed Eng OnLine 15:49. https://doi.org/10.1186/s12938-016-0164-3
Liu H, Geng F, Guo Q et al (2018) A fast weak-supervised pulmonary nodule segmentation method based on modified self-adaptive FCM algorithm. Soft Comput 22:3983–3995. https://doi.org/10.1007/s00500-017-2608-5
Qin Y, Zheng H, Huang X et al (2019) Pulmonary nodule segmentation with CT sample synthesis using adversarial networks. Med Phys 46:1218–1229. https://doi.org/10.1002/mp.13349
Huang X, Sun W, Tseng T-L et al (2019) Fast and fully-automated detection and segmentation of pulmonary nodules in thoracic CT scans using deep convolutional neural networks. Comput Med Imaging Graph 74:25–36. https://doi.org/10.1016/j.compmedimag.2019.02.003
Singadkar G, Mahajan A, Thakur M, Talbar S (2020) Deep deconvolutional residual network based automatic pulmonary nodule segmentation. J Digit Imaging 33:678–684. https://doi.org/10.1007/s10278-019-00301-4
Wang D, He K, Wang B et al (2021) Solitary pulmonary nodule segmentation based on pyramid and improved grab cut. Comput Methods Programs Biomed 199:105910. https://doi.org/10.1016/j.cmpb.2020.105910
Armato SG, McLennan G, Bidaut L et al (2011) The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans: the LIDC/IDRI thoracic CT database of lung nodules. Med Phys 38:915–931. https://doi.org/10.1118/1.3528204
Zhang H, Wu C, Zhang Z, et al (2020) ResNeSt: Split-Attention Networks. http://arxiv.org/abs/2004.08955
He K, Zhang X, Ren S, Sun J (2016) Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Las Vegas, NV, USA, pp 770–778. https://doi.org/10.1109/CVPR.2016.90
Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision—ECCV 2018. Springer, Cham, pp 3–19
Xiao X, Lian S, Luo Z, Li S (2018) Weighted Res-UNet for High-Quality Retina Vessel Segmentation. In: 2018 9th International Conference on Information Technology in Medicine and Education (ITME). IEEE, Hangzhou, pp 327–331. https://doi.org/10.1109/ITME.2018.00080
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Grant No. 51975170), Youth Innovation Fund of Heilongjiang Academy of Sciences (Grant No. CXJQ2020WL01), Basic Applied Technology of Heilongjiang Institutes Research Special Project (Grant No. ZNJZ2020WL01), Natural Science Foundation of Heilongjiang Province (Grant No. LH2019F024).
Funding
This work was supported by the National Natural Science Foundation of China (Grant No. 51975170), Youth Innovation Fund of Heilongjiang Academy of Sciences (Grant No. CXJQ2020WL01), Basic Applied Technology of Heilongjiang Institutes Research Special Project (Grant No. ZNJZ2020WL01), Natural Science Foundation of Heilongjiang Province (Grant No. LH2019F024).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by DL, SY, and GY. The first draft of the manuscript was written by SY, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, D., Yuan, S. & Yao, G. Pulmonary nodule segmentation based on REMU-Net. Phys Eng Sci Med 45, 995–1004 (2022). https://doi.org/10.1007/s13246-022-01157-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13246-022-01157-9