Deep Learning in Medical Image Analysis pp 47-58 | Cite as
Deep Learning for Pulmonary Image Analysis: Classification, Detection, and Segmentation
- 4 Citations
- 2 Mentions
- 2.4k Downloads
Abstract
Image-based computer-aided diagnosis (CAD) algorithms by the use of convolutional neural network (CNN) which do not require the image-feature extractor are powerful compared with conventional feature-based CAD algorithms which require the image-feature extractor for classification of lung abnormalities. Moreover, computer-aided detection and segmentation algorithms by the use of CNN are useful for analysis of lung abnormalities. Deep learning will improve the performance of CAD systems dramatically. Therefore, they will change the roles of radiologists in the near future. In this article, we introduce development and evaluation of such image-based CAD algorithms for various kinds of lung abnormalities such as lung nodules and diffuse lung diseases.
Keywords
Computer-aided diagnosis (CAD) Convolutional neural network (CNN) R-CNN Fully convolutional network (FCN) U-Net Residual U-Net V-Net Lung nodule Diffuse lung diseaseReferences
- 1.Global Health Estimate (2018) 2016: Death by cause, age sex, by country and by region, 2006–2016. World Health Organization, GenevaGoogle Scholar
- 2.The National Lung Screening Trial Research Team (2011) Reduced lung-cancer mortality with low-dose computed tomographic screening. N Eng J Med 365(5):395–409CrossRefGoogle Scholar
- 3.Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: NIPS’12 proceedings of the 25th international conference on neural information processing systems, vol 1. Curran Associates Inc, Lake Tahoe, pp 1097–1105Google Scholar
- 4.Murakami K, Kido S, Hashimoto N et al (2017) Computer-aided classification of diffuse lung disease patterns using convolutional neural network. In: Computer assisted radiology and surgery, 31th international congress and exhibition (CARS2017). Int J Comput Assist Radiol Surg, BarcelonaGoogle Scholar
- 5.Kido S, Hirano Y, Hashimoto N (2017) Computer-aided classification of pulmonary diseases: feature extraction based method versus non-feature extraction based method. In: Proceedings of the IWAIT2017. Institute of Electrical and Electronics Engineers (IEEE), Penang, pp 1–3Google Scholar
- 6.Ito T, Hirano Y, Kido S et al (2017) First-reader computerized system for distinction between malignant and benign nodules on thoracic CT images by means of end to end deep learning: convolutional neural network (CNN) and neural network convolution (NNC) approaches. In: RSNA 2017. Radiological Society of North America, ChicagoGoogle Scholar
- 7.Setio AAA, Ciompi F, Litjens G et al (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35:1160–1169CrossRefGoogle Scholar
- 8.Girshick R, Donahue J, Darrell T et al (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: CVPR’14 proceedings of the 2014 IEEE conference on computer vision and pattern recognition. Institute of Electrical and Electronics Engineers (IEEE), Columbus, pp 580–587CrossRefGoogle Scholar
- 9.Girshick R (2015) Fast R-CNN. In: The IEEE international conference on computer vision (ICCV). Institute of Electrical and Electronics Engineers (IEEE), Santiago, pp 1440–1448CrossRefGoogle Scholar
- 10.Ren S, He K, Girshick R et al (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS’15 Proceedings of the 28th international conference on neural information processing systems, vol 1. MIT Press, Cambridge, pp 91–99Google Scholar
- 11.Redmon J, Divvala S, Girshick R et al (2016) You only look once: unified, real-time object detection. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition (CVPR), vol 1. Institute of Electrical and Electronics Engineers (IEEE), Las Vegas, pp 779–788CrossRefGoogle Scholar
- 12.Liu W, Anguelov D, Erhan D et al (2016) SSD: Single shot multibox detector. In: European conference on computer vision ECCV 2016: computer vision - ECCV 2016. Springer, Amsterdam, pp 21–37CrossRefGoogle Scholar
- 13.Kido S, Hirano Y, Hashimoto N (2018) Detection and classification of lung abnormalities by the use of Convolutional Neural Network (CNN) and regions with CNN features. In: International workshop on advanced image technology 2018 (IWAIT 2018). Institute of Electrical and Electronics Engineers (IEEE), Chiang Mai. Special Session 2Google Scholar
- 14.Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR). Institute of Electrical and Electronics Engineers (IEEE), BostonGoogle Scholar
- 15.Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: MICCAI 2015: medical image computing and computer-assisted intervention – MICCAI 2015. Springer, Munich, pp 234–241Google Scholar
- 16.Zhang Z, Liu Q et al (2017) Road extraction by deep residual U-Net. IEEE Geosc Remote Sensing Lett 15(5):749–753. 1–5CrossRefGoogle Scholar
- 17.Murakami K, Kido S, Hirano Y et al (2019) Segmentation for diffuse lung disease opacities on CT images using U-Net and residual U-Net. In: IEICE technical report 2019, vol 118. The Institute of Electronics, Information and Communication Engineers (IEICE), Naha, pp 175–179Google Scholar
- 18.Noh H, Hong S, Han B (2015) Learning of deconvolution network for semantic segmentation. In: ICCV’15 proceedings of the 2015 IEEE international conference on computer vision (ICCV). IEEE Computer Society, Washington, pp 1520–1528CrossRefGoogle Scholar
- 19.Milletari F, Navab N, Ahmadi SA (2016) V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In: 2016 fourth international conference on 3D vision (3DV). Institute of Electrical and Electronics Engineers (IEEE), California, pp 565–571CrossRefGoogle Scholar
- 20.Kidera S, Kido S, Hirano Y, Mabu S, Tanaka N (2018) Segmentation of lung nodules on MDCT images by using 3D Conv-DeconvNet. In: Computer assisted radiology and surgery, 32th international congress and exhibition (CARS2018). Int J Comput Assist Radiol Surg, BarcelonaGoogle Scholar
- 21.Kidera S, Kido S, Hirano Y, Tanaka N (2019) Segmentation of lung nodules on 3D CT images by using DeconvNet and V-Net. In: IEICE technical report 2019, vol 118. The Institute of Electronics, Information and Communication Engineers (IEICE), Naha, pp 103–106Google Scholar