Skip to main content
SpringerLink
Log in

Novel convolutional neural network architecture for improved pulmonary nodule classification on computed tomography

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

Computed tomography (CT) is widely used to locate pulmonary nodules for preliminary diagnosis of the lung cancer. However, due to high visual similarities between malignant (cancer) and benign (non-cancer) nodules, distinguishing malignant from malign nodules is not an easy task for a thoracic radiologist. In this paper, a novel convolutional neural network (ConvNet) architecture is proposed to classify the pulmonary nodules as either benign or malignant. Due to the high variance of nodule characteristics in CT scans, such as size and shape, a multi-path, multi-scale architecture is proposed and applied in the proposed ConvNet to improve the classification performance. The multi-scale method utilizes filters with different sizes to more effectively extracted nodule features from local regions, and the multi-path architecture combines features extracted from different ConvNet layers thereby enhancing the nodule features with respect to global regions. The proposed ConvNet is trained and evaluated on the LUNGx Challenge database, and achieves a sensitivity of 0.887 and a specificity of 0.924 with an area under the curve (AUC) of 0.948. The proposed ConvNet achieves a 14% AUC improvement compared to the state-of-the-art unsupervised learning approach. The proposed ConvNet also outperforms the other state-of-the-art ConvNets explicitly designed for pulmonary nodule classification. For clinical usage, the proposed ConvNet could potentially assist the radiologists to make diagnostic decisions in CT screening.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • American Cancer Society. 2017. Retrieved January, 2019 from Cancer facts & figures 2017. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2017.html

  • Anthimopoulos, M., Christodoulidis, S., Ebner, L., Christe, A., & Mougiakakou, S. (2016). Lung pattern classification for interstitial lung diseases using a deep convolutional neural network. IEEE Transactions on Medical Imaging, 35(5), 1207–1216. https://doi.org/10.1109/TMI.2016.2535865.

    Article  Google Scholar 

  • Armato, S. G., Drukker, K., Li, F., Hadjiiski, L., Tourassi, G. D., Kirby, J. S., et al. (2016). LUNGx challenge for computerized lung nodule classification. Journal of Medical Imaging, 3, 3–9. https://doi.org/10.1117/1.JMI.3.4.044506.

    Article  Google Scholar 

  • Armato, S. G., Giger, M. L., Moran, C. J., Blackburn, J. T., Doi, K., & MacMahon, H. (1999). Computerized detection of pulmonary nodules on CT scans. RadioGraphics, 19(5), 1303–1311.

    Article  Google Scholar 

  • Bishop, C. M. (2006). Pattern recognition and machine learning (information science and statistics). Secaucus, NJ: Springer.

    MATH  Google Scholar 

  • Chen, J., & Shen, Y. (2017). The effect of kernel size of CNNs for lung nodule classification. In 2017 9th international conference on advanced infocomm technology (ICAIT) (pp. 340–344). https://doi.org/10.1109/ICAIT.2017.8388942.

  • Ciompi, F., Jacobs, C., Scholten, E. T., Wille, M. M. W., de Jong, P. A., Prokop, M., et al. (2015). Bag-of-frequencies: A descriptor of pulmonary nodules in computed tomography images. IEEE Transactions on Medical Imaging, 34(4), 962–973. https://doi.org/10.1109/TMI.2014.2371821.

    Article  Google Scholar 

  • Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition (pp. 248–255).

  • Duchi, J., Hazan, E., & Singer, Y. (2011). Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12, 2121–2159.

    MathSciNet  MATH  Google Scholar 

  • Efron, B. (1993). An introduction to the bootstrap. Monographs on statistics and applied probability (Series) (Vol. 57). New York: Chapman & Hall.

    Google Scholar 

  • Giger, M. L., Bae, K. T., & Macmahon, H. (1994). Computerized detection of pulmonary nodules in computed tomography images. Investigative Radiology, 29(4), 459–465.

    Article  Google Scholar 

  • He, K., Zhang, X., Ren, S., & Sun, J. (2015a). Deep residual learning for image recognition. CoRR arXiv:1512.03385.

  • He, K., Zhang, X., Ren, S., & Sun, J. (2015b). Deep residual learning for image recognition. CoRR arXiv:1512.03385.

  • Janowczyk, A., & Madabhushi, A. (2016). Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of Pathology Informatics, 7, 29. https://doi.org/10.4103/2153-3539.186902.

    Article  Google Scholar 

  • Jarrett, K., Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2009). What is the best multi-stage architecture for object recognition? In 2009 IEEE 12th international conference on computer vision (pp. 2146–2153).

  • Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093.

  • Kamiya, A., Murayama, S., Kamiya, H., Yamashiro, T., Oshiro, Y., & Tanaka, N. (2014). Kurtosis and skewness assessments of solid lung nodule density histograms: Differentiating malignant from benign nodules on CT. Japanese Journal of Radiology, 32(1), 14–21.

    Article  Google Scholar 

  • Kang, G., Liu, K., Hou, B., & Zhang, N. (2017). 3D multi-view convolutional neural networks for lung nodule classification. PLOS ONE, 12, 1–21. https://doi.org/10.1371/journal.pone.0188290.

    Article  Google Scholar 

  • Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th international conference on neural information processing systems—volume 1, Curran Associates Inc., USA, NIPS’12 (pp. 1097–1105).

  • Levi, G., & Hassncer, T. (2015). Age and gender classification using convolutional neural networks. In 2015 IEEE conference on computer vision and pattern recognition workshops (CVPRW) (pp. 34–42). https://doi.org/10.1109/CVPRW.2015.7301352.

  • Li, C., Diao, Y., Ma, H., & Li, Y. (2008). A statistical PCA method for face recognition. In 2008 Second international symposium on intelligent information technology application (vol. 3, pp. 376–380). https://doi.org/10.1109/IITA.2008.71.

  • Li, Q., Cai, W., Wang, X., Zhou, Y., Feng, D.D., & Chen, M. (2014). Medical image classification with convolutional neural network. In 2014 13th international conference on control automation robotics vision (ICARCV) (pp. 844–848).

  • Li, W., Cao, P., Zhao, D., & Wang, J. (2016). Pulmonary nodule classification with deep convolutional neural networks on computed tomography images. Computational and Mathematical Methods in Medicine, 2016, 6215085. https://doi.org/10.1155/2016/6215085.

    Article  Google Scholar 

  • Mazurowski, M. A., Habas, P. A., Zurada, J. M., Lo, J. Y., Baker, J. A., & Tourassi, G. D. (2008). Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural Networks, 21(2), 427–436. (Advances in Neural Networks Research: IJCNN ’07) .

    Article  Google Scholar 

  • Monkam, P., Qi, S., Xu, M., Han, F., Zhao, X., & Qian, W. (2018). CNN models discriminating between pulmonary micro-nodules and non-nodules from CT images. BioMedical Engineering OnLine, 17(1), 96. https://doi.org/10.1186/s12938-018-0529-x.

    Article  Google Scholar 

  • Nishio, M., & Nagashima, C. (2017). Computer-aided diagnosis for lung cancer: Usefulness of nodule heterogeneity. Academic Radiology, 24(3), 328–336.

    Article  Google Scholar 

  • Shen, W., Zhou, M., Yang, F., Yu, D., Dong, D., Yang, C., et al. (2017). Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification. Pattern Recognition, 61, 663–673. https://doi.org/10.1016/j.patcog.2016.05.029.

    Article  Google Scholar 

  • Shin, H., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., et al. (2016). Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning. IEEE Transactions on Medical Imaging, 35(5), 1285–1298. https://doi.org/10.1109/TMI.2016.2528162.

    Article  Google Scholar 

  • Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., et al. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529, 484–489.

    Article  Google Scholar 

  • Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. CoRR arXiv:1409.1556.

  • Song, Q., Zhao, L., Luo, X., & Dou, X. (2017). Using deep learning for classification of lung nodules on computed tomography images. Journal of Healthcare Engineering, 2017, 7. https://doi.org/10.1155/2017/8314740.

    Article  Google Scholar 

  • Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1), 1929–1958.

    MathSciNet  MATH  Google Scholar 

  • Szegedy, C., Ioffe, S., & Vanhoucke, V. (2016). Inception-v4, inception-resnet and the impact of residual connections on learning. CoRR. arXiv:1602.07261.

  • Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015a). Going deeper with convolutions. In Computer vision and pattern recognition (CVPR).

  • Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2015b). Rethinking the inception architecture for computer vision. CoRR arXiv:1512.00567.

  • Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., et al. (2016). Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging, 35(5), 1299–1312.

    Article  Google Scholar 

  • The National Lung Screening Trial Research Team. (2011). Reduced lung-cancer mortality with low-dose computed tomographic screening. New England Journal of Medicine, 365(5), 395–409.

    Article  Google Scholar 

  • van Beek, E. J., Mirsadraee, S., & Murchison, J. T. (2015). Lung cancer screening: Computed tomography or chest radiographs? World Journal of Radiology, 7(8), 189–193. https://doi.org/10.4329/wjr.v7.i8.189.

    Article  Google Scholar 

  • van Ginneken, B., Setio, A. A. A., Jacobs, C., & Ciompi, F. (2015). Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. In: 2015 IEEE 12th international symposium on biomedical imaging (ISBI) (pp. 286–289).

  • Zhang, F., Song, Y., Cai, W., Lee, M. Z., Zhou, Y., Huang, H., et al. (2014). Lung nodule classification with multilevel patch-based context analysis. IEEE Transactions on Biomedical Engineering, 61(4), 1155–1166.

    Article  Google Scholar 

  • Zhao, X., Liu, L., Qi, S., Teng, Y., Li, J., & Qian, W. (2018). Agile convolutional neural network for pulmonary nodule classification using CT images. International Journal of Computer Assisted Radiology and Surgery, 13(4), 585–595. https://doi.org/10.1007/s11548-017-1696-0.

    Article  Google Scholar 

  • Zhu, H., Cheng, H., & Fan, Y. (2015). Random local binary pattern based label learning for multi-atlas segmentation. ProcSPIE, 9413, 8.

    Google Scholar 

Download references

Acknowledgements

Data used in this study is obtained from The Cancer Imaging Archive (TCIA) sponsored by SPIE, NCI/NIH, AAPM and The University of Chicago, a public available medical database. This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI) and the Ministry of Health & Welfare, Republic of Korea (grant number: HI18C2383).

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Saskatchewan, 57 Campus Drive, Saskatoon, S7N 5A9, Canada

    Yi Wang, Hao Zhang, Younhee Choi & Seok-Bum Ko

  2. Department of Radiology, Jeonbuk National University Hospital, 20 Geonji-ro, Deokjin-gu, Jeonju, 54970, Korea

    Kum Ju Chae & Gong Yong Jin

Authors
  1. Yi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kum Ju Chae
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Younhee Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gong Yong Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Seok-Bum Ko
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seok-Bum Ko.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Zhang, H., Chae, K.J. et al. Novel convolutional neural network architecture for improved pulmonary nodule classification on computed tomography. Multidim Syst Sign Process 31, 1163–1183 (2020). https://doi.org/10.1007/s11045-020-00703-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-020-00703-6

Keywords

Search

Navigation