Abstract
Purpose
A large chunk of lung cancers are of the type non-small cell lung cancer (NSCLC). Both the treatment planning and patients’ prognosis depend greatly on factors like AJCC staging which is an abstraction over TNM staging. Many significant efforts have so far been made towards automated staging of NSCLC, but the groundbreaking application of a deep neural networks (DNNs) is yet to be observed in this domain of study. DNN is capable of achieving higher level of accuracy than the traditional artificial neural networks (ANNs) as it uses deeper layers of convolutional neural network (CNN). The objective of the present study is to propose a simple yet fast CNN model combined with recurrent neural network (RNN) for automated AJCC staging of NSCLC and to compare the outcome with a few standard machine learning algorithms along with a few similar studies.
Methods
The NSCLC radiogenomics collection from the cancer imaging archive (TCIA) dataset was considered for the study. The tumor images were refined and filtered by resizing, enhancing, de-noising, etc. The initial image processing phase was followed by texture based image segmentation. The segmented images were fed into a hybrid feature detection and extraction model which was comprised of two sequential phases: maximally stable extremal regions (MSER) and the speeded up robust features (SURF). After a prolonged experiment, the desired CNN-RNN model was derived and the extracted features were fed into the model.
Results
The proposed CNN-RNN model almost outperformed the other machine learning algorithms under consideration. The accuracy remained steadily higher than the other contemporary studies.
Conclusion
The proposed CNN-RNN model performed commendably during the study. Further studies may be carried out to refine the model and develop an improved auxiliary decision support system for oncologists and radiologists.
Similar content being viewed by others
References
Alberg AJ, Brock MV, Stuart JM. Epidemiology of lung cancer: looking to the future. J Clin Oncol. 2005;23:3175–85.
Horn L, Eisenberg R, Gius DR, Kimmelshue KN, Massion PP, Putnam JB, Robinson CG, Carbone DP. Cancer of the lung: non-small cell lung cancer and small cell lung Cancer. In: Abeloff’s Clinical Oncology: fifth edition. Elsevier Inc; 2013. pp. 1143–1192. https://doi.org/10.1016/B978-1-4557-2865-7.00072-2.
Gleason DF, Mellinger GT. Prediction of prognosis for prostatic adenocarcinoma by combined histological grading and clinical staging. J Urol. 2002;167(2 Pt 2):953–8. https://doi.org/10.1016/s0022-5347(02)80309-3 discussion 959.
Nivetha P, Manickavasagam R. Lung cancer detection at early stage using PET/CT imaging technique. Int J Innov Res Comput Commun Eng. 2014;2(3):358–3363.
Brierley JD, Gospodarowicz MK, Wittekind Ch, editors. TNM classification of malignant tumours. 8th ed. Chichester: Wiley-Blackwell; 2017. ISBN 978-1-4443-3241-4.
Zahoor H, Luketich JD, Weksler B, Winger DG, Christie NA, Levy RM, Gibson MK, Davison JM, Nason KS. The revised American Joint Committee on Cancer staging system improves prognostic stratification after minimally invasive esophagectomy for esophagogastric adenocarcinoma. Am J Surg. 2015;210(4):610–7. https://doi.org/10.1016/j.amjsurg.2015.05.010.
AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0. Springer, New York, Dordrecht, Heidelberg, London.
Napel S, Plevritis SK. NSCLC radiogenomics: initial Stanford study of 26 cases. Cancer Imaging Arch. 2014. https://doi.org/10.7937/K9/TCIA.2014.X7ONY6B1.
Breiman Leo. Random forests. Mach Learn. 2001;45(1):5–32.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. pp. 1–9.
Teramoto A, Tsukamoto T, Kiriyama Y, Fujita H. Automated classification of lung cancer types from cytological images using deep convolutional neural networks. BioMed Res Int. 2017;20:17. https://doi.org/10.1155/2017/4067832.
Chaunzwa TL, Christiani DC, Lanuti M, Shafer A, Diao N, Mak RH, Aerts H. Using deep-learning radiomics to predict lung cancer histology. J Clin Oncol. 2018;36(15):8545. https://doi.org/10.1200/jco.2018.36.15_suppl.8545.
Rossetto AM, Zhou W. Deep learning for categorization of lung cancer CT images. In: 2017 IEEE/ACM international conference on connected health: applications, systems and engineering technologies (CHASE), Philadelphia, PA; 2017. pp. 272–273. https://doi.org/10.1109/chase.2017.98
Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, Moreira AL, Razavian N, Tsirigos A. Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med. 2018;24(10):1559.
Selvanambi R, Natarajan J, Karuppiah M, et al. Lung cancer prediction using higher-order recurrent neural network based on glowworm swarm optimization. Neural Comput Appl. 2018;20:18. https://doi.org/10.1007/s00521-018-3824-3.
Mohsen H, El-Dahshan ES, El-Horbaty ES, Salem AB. Classification using deep learning neural networks for brain tumors. Future Comput Inf J. 2018;3(1):68–71. https://doi.org/10.1016/j.fcij.2017.12.001.
Bhatia S, Sinha Y, Goel L. Lung cancer detection: a deep learning approach. Soft Comput Probl Solving. 2019. https://doi.org/10.1007/978-981-13-1595-4_55.
Kuan K, Ravaut M, Manek G, Chen H, Lin J, Nazir B, Chen C, Howe TC, Zeng Z, Chandrasekhar V. Deep learning for lung cancer detection: tackling the kaggle data science bowl 2017 challenge; 2017. arXiv:1705.09435.
Serj MF, Lavi B, Hoff G, Valls DP. A deep convolutional neural network for lung cancer diagnostic; 2018. arXiv:1804.08170.
Nogueira Mariana A, Abreu Pedro H, Martins Pedro, Machado Penousal, Duarte Hugo, Santos João. An artificial neural networks approach for assessment treatment response in oncological patients using PET/CT images. BMC Med Imaging. 2017;17:13.
The MathWorks Inc. MATLAB and statistics toolbox release. Natick: The MathWorks Inc; 2015.
Waikato Environment for Knowledge Analysis version 3.7.2, The University of Waikato, Hamilton, New Zealand.
Vesselle H, Turcotte E, Wiens L, Haynor D. Application of a neural network to improve nodal staging accuracy with 18F-FDG PET in non-small cell lung cancer. J Nucl Med. 2003;44(12):1918–26.
Toney LK, Vesselle HJ. neural networks for nodal staging of non–small cell lung cancer with FDG PET and CT: importance of combining uptake values and sizes of nodes and primary tumor. Radiology. 2014;270:91–8.
Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. 2014. arXiv:1412.3555.
Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735–80.
Bowyer Kevin W, Hall Lawrence O, Philip Kegelmeyer W. Synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.
Moitra D. Comparison of multimodal tumor image segmentation techniques. Int J Adv Res Comput Sci. 2018;9(3):129–31. https://doi.org/10.26483/ijarcs.v9i3.6010.
Moitra Dipanjan. Segmentation strategy of pet brain tumor image. Indian J Comput Sci Eng. 2017;0976–5166(8):575–7.
Moitra D. Review of brain tumor detection using pattern recognition techniques. Int J Comput Sci Eng. 2017;5(2):2347–693.
Bakr S, Gevaert O, Echegaray S, Ayers K, Zhou M, Shafiq M, Zheng H, Zhang W, Leung A, Kadoch M, Shrager J, Quon A, Rubin D, Plevritis S, Napel S. Data for NSCLC radiogenomics collection. Cancer Imaging Arch. 2017. https://doi.org/10.7937/K9/TCIA.2017.7hs46erv.
Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26(6):1045–57.
Gevaert O, Xu J, Hoang CD, Leung AN, Xu Y, Quon A, Rubin DL, Napel S, Plevritis SK. Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. 2012;264(2):387–96. https://doi.org/10.1148/radiol.12111607.
Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9(1):62–6.
Sharma N, Ray AK, Sharma S, Shukla KK, Pradhan S, Aggarwal LM. Segmentation and classification of medical images using texture-primitive features: application of BAM-type artificial neural network. J Med Phys. 2008;33(3):119–26. https://doi.org/10.4103/0971-6203.42763.
Matas J, Chum O, Urba M, Pajdla T. Robust wide-baseline stereo from maximally stable extremal regions. Proceedings of British Machine Vision Conference; 2002, pp. 384–396.
Bay H, Ess A, Tuytelaars T, Van Gool L. SURF: speeded up robust features. Comput Vis Image Underst. 2008;110(3):346–59.
Donoser M, Bischof H. Efficient maximally stable extremal region (MSER) tracking. In: Proceedings of the 2006 IEEE computer society conference on computer vision and pattern recognition; 2006, pp. 553–560. https://doi.org/10.1109/cvpr.2006.107].
Pearson K. On lines and planes of closest fit to systems of points in space. Philos Mag. 1901;2(11):559–72. https://doi.org/10.1080/14786440109462720.
Aha D, Kibler D. Instance-based learning algorithms. Mach Learn. 1991;6:37–66.
Cortes Corinna, Vapnik Vladimir N. Support-vector networks. Mach Learn. 1995;20(3):273–97. https://doi.org/10.1007/BF00994018.
Collobert R, Bengio S. Links between perceptrons, MLPs and SVMs. In: Proceedings of international conference on machine learning (ICML); 2004.
Cohen Jacob. A coefficient of agreement for nominal scales. Educ Psychol Measur. 1960;20(1):37–46. https://doi.org/10.1177/001316446002000104.
Hyndman Rob J, Koehler Anne B. Another look at measures of forecast accuracy. Int J Forecast. 2006;22(4):679–88. https://doi.org/10.1016/j.ijforecast.2006.03.001.
Al-shamasneh AR, Obaidellah UH. Artificial intelligence techniques for cancer detection and classification: review study. Eur Sci J. 2017;13(3):342–70. https://doi.org/10.19044/esj.2016.v13n3p342.
Chollet F. Deep learning with python. Manning Publications, New York. ISBN: 9781617294433.
Nurtiyasari D, Rosadi D, Abdurakhman. The application of wavelet recurrent neural network for lung cancer classification. 2017 3rd International Conference on Science and Technology - Computer (lCST). https://doi.org/10.1109/ICSTC.2017.8011865.
Mobiny A, Moulik S, Van Nguyen H. Lung cancer screening using adaptive memory-augmented recurrent networks. arXiv:1710.05719.
Orozco H, Villegas O, Dominguez H, Sanchez V. Lung nodule classification in CT thorax images using support vector machines. 2013 12th Mexican International Conference on Artificial Intelligence (MICAI), pp. 277–283. https://doi.org/10.1109/MICAI.2013.38.
Adetiba E. Lung cancer prediction using neural network ensemble with histogram of oriented gradient genomic features. Sci World J. 2015. https://doi.org/10.1155/2015/786013.
Sivakumar S, Chandrasekar C. Lung nodule detection using fuzzy clustering and support vector machines. Int J Eng Tech. 2013;5(1):179–185.
Taher F, Werghi N, Al-Ahmad H. Bayesian classification and artificial neural network methods for lung cancer early diagnosis. 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012), Seville, 2012, pp. 773-776. https://doi.org/10.1109/ICECS.2012.6463545.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
For this type of study formal consent is not required.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Moitra, D., Mandal, R.K. Automated AJCC (7th edition) staging of non-small cell lung cancer (NSCLC) using deep convolutional neural network (CNN) and recurrent neural network (RNN). Health Inf Sci Syst 7, 14 (2019). https://doi.org/10.1007/s13755-019-0077-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13755-019-0077-1