A manifold learning regularization approach to enhance 3D CT image-based lung nodule classification
Diagnosis of lung cancer requires radiologists to review every lung nodule in CT images. Such a process can be very time-consuming, and the accuracy is affected by many factors, such as experience of radiologists and available diagnosis time. To address this problem, we proposed to develop a deep learning-based system to automatically classify benign and malignant lung nodules.
The proposed method automatically determines benignity or malignancy given the 3D CT image patch of a lung nodule to assist diagnosis process. Motivated by the fact that real structure among data is often embedded on a low-dimensional manifold, we developed a novel manifold regularized classification deep neural network (MRC-DNN) to perform classification directly based on the manifold representation of lung nodule images. The concise manifold representation revealing important data structure is expected to benefit the classification, while the manifold regularization enforces strong, but natural constraints on network training, preventing over-fitting.
The proposed method achieves accurate manifold learning with reconstruction error of ~ 30 HU on real lung nodule CT image data. In addition, the classification accuracy on testing data is 0.90 with sensitivity of 0.81 and specificity of 0.95, which outperforms state-of-the-art deep learning methods.
The proposed MRC-DNN facilitates an accurate manifold learning approach for lung nodule classification based on 3D CT images. More importantly, MRC-DNN suggests a new and effective idea of enforcing regularization for network training, possessing the potential impact to a board range of applications.
KeywordsDiagnosis Lung nodule classification Deep learning Regularization Manifold learning
This work was supported by the China National Key Research and Development Program of China (Grant Nos. 2016YFE0125200 and 2016YFC0101100) and the China Fundamental Research Funds for the Central Universities (Grant No. 2019CDQYGD020).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Human and animal rights
This article does not contain any studies with human participants or animals performed by any of the authors.
This article does not contain patient data.
- 4.Shen W, Zhou M, Yang F, Yang C, Tian J (2015) Multi-scale convolutional neural networks for lung nodule classification. In: International conference on information processing in medical imaging. Springer, pp 588–599Google Scholar
- 5.Kumar D, Wong A, Clausi DA (2015) Lung nodule classification using deep features in CT images. In: 2015 12th conference on computer and robot vision. IEEE, pp 133–138Google Scholar
- 6.Hua K-L, Hsu C-H, Hidayati SC, Cheng W-H, Chen Y-J (2015) Computer-aided classification of lung nodules on computed tomography images via deep learning technique. OncoTargets and Ther 8:2015–2022Google Scholar
- 7.Ma J, Wang Q, Ren Y, Hu H, Zhao J (2016) Automatic lung nodule classification with radiomics approach. In: Medical imaging 2016: PACS and imaging informatics: next generation and innovations. International Society for Optics and Photonics, pp 978906Google Scholar
- 15.He X, Niyogi P (2003) Locality preserving projections. In: Thrun S, Saul LK, Schölkopf B (eds) Proceedings of the 16th international conference on neural information processing systems (NIPS'03), MIT Press, Cambridge, MA, USA, pp 153–160Google Scholar
- 17.Zhu J-Y, Krähenbühl P, Shechtman E, Efros AA (2016) Generative visual manipulation on the natural image manifold. In: European conference on computer vision, Springer, pp 597–613Google Scholar
- 18.Ma G, Shen C, Jia X (2018) Low dose ct reconstruction assisted by an image manifold prior. arXiv preprint arXiv:181012255
- 19.Brosch T, Tam R, Initiative AsDN (2013) Manifold learning of brain MRIS by deep learning. In: Mori K, Sakuma I, Sato Y, Barillot C, Navab N (eds) Medical image computing and computer-assisted intervention-MICCAI 2013. MICCAI 2013. Lecture notes in computer science. Springer, Berlin, pp 633–640Google Scholar
- 24.Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of compstat’2010, Springer, pp 177–186Google Scholar
- 25.Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA (2011) The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on ct scans. Med Phys 38:915–931CrossRefGoogle Scholar
- 27.Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M (2016) Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX symposium on operating systems design and implementation (OSDI ’16), pp 265–283Google Scholar
- 28.Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105Google Scholar
- 31.Chen M, Shi X, Zhang Y, Wu D, Guizani M (2017) Deep features learning for medical image analysis with convolutional autoencoder neural network. In: IEEE Transactions on Big DataGoogle Scholar