Skip to main content
Log in

Automated AJCC (7th edition) staging of non-small cell lung cancer (NSCLC) using deep convolutional neural network (CNN) and recurrent neural network (RNN)

Health Information Science and Systems Aims and scope Submit manuscript

Abstract

Purpose

A large chunk of lung cancers are of the type non-small cell lung cancer (NSCLC). Both the treatment planning and patients’ prognosis depend greatly on factors like AJCC staging which is an abstraction over TNM staging. Many significant efforts have so far been made towards automated staging of NSCLC, but the groundbreaking application of a deep neural networks (DNNs) is yet to be observed in this domain of study. DNN is capable of achieving higher level of accuracy than the traditional artificial neural networks (ANNs) as it uses deeper layers of convolutional neural network (CNN). The objective of the present study is to propose a simple yet fast CNN model combined with recurrent neural network (RNN) for automated AJCC staging of NSCLC and to compare the outcome with a few standard machine learning algorithms along with a few similar studies.

Methods

The NSCLC radiogenomics collection from the cancer imaging archive (TCIA) dataset was considered for the study. The tumor images were refined and filtered by resizing, enhancing, de-noising, etc. The initial image processing phase was followed by texture based image segmentation. The segmented images were fed into a hybrid feature detection and extraction model which was comprised of two sequential phases: maximally stable extremal regions (MSER) and the speeded up robust features (SURF). After a prolonged experiment, the desired CNN-RNN model was derived and the extracted features were fed into the model.

Results

The proposed CNN-RNN model almost outperformed the other machine learning algorithms under consideration. The accuracy remained steadily higher than the other contemporary studies.

Conclusion

The proposed CNN-RNN model performed commendably during the study. Further studies may be carried out to refine the model and develop an improved auxiliary decision support system for oncologists and radiologists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Alberg AJ, Brock MV, Stuart JM. Epidemiology of lung cancer: looking to the future. J Clin Oncol. 2005;23:3175–85.

    Article  Google Scholar 

  2. Horn L, Eisenberg R, Gius DR, Kimmelshue KN, Massion PP, Putnam JB, Robinson CG, Carbone DP. Cancer of the lung: non-small cell lung cancer and small cell lung Cancer. In: Abeloff’s Clinical Oncology: fifth edition. Elsevier Inc; 2013. pp. 1143–1192. https://doi.org/10.1016/B978-1-4557-2865-7.00072-2.

  3. Gleason DF, Mellinger GT. Prediction of prognosis for prostatic adenocarcinoma by combined histological grading and clinical staging. J Urol. 2002;167(2 Pt 2):953–8. https://doi.org/10.1016/s0022-5347(02)80309-3 discussion 959.

    Article  Google Scholar 

  4. Nivetha P, Manickavasagam R. Lung cancer detection at early stage using PET/CT imaging technique. Int J Innov Res Comput Commun Eng. 2014;2(3):358–3363.

    Google Scholar 

  5. Brierley JD, Gospodarowicz MK, Wittekind Ch, editors. TNM classification of malignant tumours. 8th ed. Chichester: Wiley-Blackwell; 2017. ISBN 978-1-4443-3241-4.

    Google Scholar 

  6. Zahoor H, Luketich JD, Weksler B, Winger DG, Christie NA, Levy RM, Gibson MK, Davison JM, Nason KS. The revised American Joint Committee on Cancer staging system improves prognostic stratification after minimally invasive esophagectomy for esophagogastric adenocarcinoma. Am J Surg. 2015;210(4):610–7. https://doi.org/10.1016/j.amjsurg.2015.05.010.

    Article  Google Scholar 

  7. AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0. Springer, New York, Dordrecht, Heidelberg, London.

  8. Napel S, Plevritis SK. NSCLC radiogenomics: initial Stanford study of 26 cases. Cancer Imaging Arch. 2014. https://doi.org/10.7937/K9/TCIA.2014.X7ONY6B1.

    Article  Google Scholar 

  9. Breiman Leo. Random forests. Mach Learn. 2001;45(1):5–32.

    Article  Google Scholar 

  10. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. pp. 1–9.

  11. Teramoto A, Tsukamoto T, Kiriyama Y, Fujita H. Automated classification of lung cancer types from cytological images using deep convolutional neural networks. BioMed Res Int. 2017;20:17. https://doi.org/10.1155/2017/4067832.

    Article  Google Scholar 

  12. Chaunzwa TL, Christiani DC, Lanuti M, Shafer A, Diao N, Mak RH, Aerts H. Using deep-learning radiomics to predict lung cancer histology. J Clin Oncol. 2018;36(15):8545. https://doi.org/10.1200/jco.2018.36.15_suppl.8545.

    Article  Google Scholar 

  13. Rossetto AM, Zhou W. Deep learning for categorization of lung cancer CT images. In: 2017 IEEE/ACM international conference on connected health: applications, systems and engineering technologies (CHASE), Philadelphia, PA; 2017. pp. 272–273. https://doi.org/10.1109/chase.2017.98

  14. Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, Moreira AL, Razavian N, Tsirigos A. Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med. 2018;24(10):1559.

    Article  Google Scholar 

  15. Selvanambi R, Natarajan J, Karuppiah M, et al. Lung cancer prediction using higher-order recurrent neural network based on glowworm swarm optimization. Neural Comput Appl. 2018;20:18. https://doi.org/10.1007/s00521-018-3824-3.

    Article  Google Scholar 

  16. Mohsen H, El-Dahshan ES, El-Horbaty ES, Salem AB. Classification using deep learning neural networks for brain tumors. Future Comput Inf J. 2018;3(1):68–71. https://doi.org/10.1016/j.fcij.2017.12.001.

    Article  Google Scholar 

  17. Bhatia S, Sinha Y, Goel L. Lung cancer detection: a deep learning approach. Soft Comput Probl Solving. 2019. https://doi.org/10.1007/978-981-13-1595-4_55.

    Article  Google Scholar 

  18. Kuan K, Ravaut M, Manek G, Chen H, Lin J, Nazir B, Chen C, Howe TC, Zeng Z, Chandrasekhar V. Deep learning for lung cancer detection: tackling the kaggle data science bowl 2017 challenge; 2017. arXiv:1705.09435.

  19. Serj MF, Lavi B, Hoff G, Valls DP. A deep convolutional neural network for lung cancer diagnostic; 2018. arXiv:1804.08170.

  20. Nogueira Mariana A, Abreu Pedro H, Martins Pedro, Machado Penousal, Duarte Hugo, Santos João. An artificial neural networks approach for assessment treatment response in oncological patients using PET/CT images. BMC Med Imaging. 2017;17:13.

    Article  Google Scholar 

  21. The MathWorks Inc. MATLAB and statistics toolbox release. Natick: The MathWorks Inc; 2015.

    Google Scholar 

  22. Waikato Environment for Knowledge Analysis version 3.7.2, The University of Waikato, Hamilton, New Zealand.

  23. Vesselle H, Turcotte E, Wiens L, Haynor D. Application of a neural network to improve nodal staging accuracy with 18F-FDG PET in non-small cell lung cancer. J Nucl Med. 2003;44(12):1918–26.

    Google Scholar 

  24. Toney LK, Vesselle HJ. neural networks for nodal staging of non–small cell lung cancer with FDG PET and CT: importance of combining uptake values and sizes of nodes and primary tumor. Radiology. 2014;270:91–8.

    Article  Google Scholar 

  25. Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. 2014. arXiv:1412.3555.

  26. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735–80.

    Article  Google Scholar 

  27. Bowyer Kevin W, Hall Lawrence O, Philip Kegelmeyer W. Synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.

    Article  Google Scholar 

  28. Moitra D. Comparison of multimodal tumor image segmentation techniques. Int J Adv Res Comput Sci. 2018;9(3):129–31. https://doi.org/10.26483/ijarcs.v9i3.6010.

    Article  Google Scholar 

  29. Moitra Dipanjan. Segmentation strategy of pet brain tumor image. Indian J Comput Sci Eng. 2017;0976–5166(8):575–7.

    Google Scholar 

  30. Moitra D. Review of brain tumor detection using pattern recognition techniques. Int J Comput Sci Eng. 2017;5(2):2347–693.

    Google Scholar 

  31. Bakr S, Gevaert O, Echegaray S, Ayers K, Zhou M, Shafiq M, Zheng H, Zhang W, Leung A, Kadoch M, Shrager J, Quon A, Rubin D, Plevritis S, Napel S. Data for NSCLC radiogenomics collection. Cancer Imaging Arch. 2017. https://doi.org/10.7937/K9/TCIA.2017.7hs46erv.

    Article  Google Scholar 

  32. Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26(6):1045–57.

    Article  Google Scholar 

  33. Gevaert O, Xu J, Hoang CD, Leung AN, Xu Y, Quon A, Rubin DL, Napel S, Plevritis SK. Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. 2012;264(2):387–96. https://doi.org/10.1148/radiol.12111607.

    Article  Google Scholar 

  34. Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9(1):62–6.

    Article  Google Scholar 

  35. Sharma N, Ray AK, Sharma S, Shukla KK, Pradhan S, Aggarwal LM. Segmentation and classification of medical images using texture-primitive features: application of BAM-type artificial neural network. J Med Phys. 2008;33(3):119–26. https://doi.org/10.4103/0971-6203.42763.

    Article  Google Scholar 

  36. Matas J, Chum O, Urba M, Pajdla T. Robust wide-baseline stereo from maximally stable extremal regions. Proceedings of British Machine Vision Conference; 2002, pp. 384–396.

  37. Bay H, Ess A, Tuytelaars T, Van Gool L. SURF: speeded up robust features. Comput Vis Image Underst. 2008;110(3):346–59.

    Article  Google Scholar 

  38. Donoser M, Bischof H. Efficient maximally stable extremal region (MSER) tracking. In: Proceedings of the 2006 IEEE computer society conference on computer vision and pattern recognition; 2006, pp. 553–560. https://doi.org/10.1109/cvpr.2006.107].

  39. Pearson K. On lines and planes of closest fit to systems of points in space. Philos Mag. 1901;2(11):559–72. https://doi.org/10.1080/14786440109462720.

    Article  MATH  Google Scholar 

  40. Aha D, Kibler D. Instance-based learning algorithms. Mach Learn. 1991;6:37–66.

    MATH  Google Scholar 

  41. Cortes Corinna, Vapnik Vladimir N. Support-vector networks. Mach Learn. 1995;20(3):273–97. https://doi.org/10.1007/BF00994018.

    Article  MATH  Google Scholar 

  42. Collobert R, Bengio S. Links between perceptrons, MLPs and SVMs. In: Proceedings of international conference on machine learning (ICML); 2004.

  43. Cohen Jacob. A coefficient of agreement for nominal scales. Educ Psychol Measur. 1960;20(1):37–46. https://doi.org/10.1177/001316446002000104.

    Article  Google Scholar 

  44. Hyndman Rob J, Koehler Anne B. Another look at measures of forecast accuracy. Int J Forecast. 2006;22(4):679–88. https://doi.org/10.1016/j.ijforecast.2006.03.001.

    Article  Google Scholar 

  45. Al-shamasneh AR, Obaidellah UH. Artificial intelligence techniques for cancer detection and classification: review study. Eur Sci J. 2017;13(3):342–70. https://doi.org/10.19044/esj.2016.v13n3p342.

    Article  Google Scholar 

  46. Chollet F. Deep learning with python. Manning Publications, New York. ISBN: 9781617294433.

  47. Nurtiyasari D, Rosadi D, Abdurakhman. The application of wavelet recurrent neural network for lung cancer classification. 2017 3rd International Conference on Science and Technology - Computer (lCST). https://doi.org/10.1109/ICSTC.2017.8011865.

  48. Mobiny A, Moulik S, Van Nguyen H. Lung cancer screening using adaptive memory-augmented recurrent networks. arXiv:1710.05719.

  49. Orozco H, Villegas O, Dominguez H, Sanchez V. Lung nodule classification in CT thorax images using support vector machines. 2013 12th Mexican International Conference on Artificial Intelligence (MICAI), pp. 277–283. https://doi.org/10.1109/MICAI.2013.38.

  50. Adetiba E. Lung cancer prediction using neural network ensemble with histogram of oriented gradient genomic features. Sci World J. 2015. https://doi.org/10.1155/2015/786013.

    Article  Google Scholar 

  51. Sivakumar S, Chandrasekar C. Lung nodule detection using fuzzy clustering and support vector machines. Int J Eng Tech. 2013;5(1):179–185.

    Google Scholar 

  52. Taher F, Werghi N, Al-Ahmad H. Bayesian classification and artificial neural network methods for lung cancer early diagnosis. 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012), Seville, 2012, pp. 773-776. https://doi.org/10.1109/ICECS.2012.6463545.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dipanjan Moitra.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

For this type of study formal consent is not required.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moitra, D., Mandal, R.K. Automated AJCC (7th edition) staging of non-small cell lung cancer (NSCLC) using deep convolutional neural network (CNN) and recurrent neural network (RNN). Health Inf Sci Syst 7, 14 (2019). https://doi.org/10.1007/s13755-019-0077-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13755-019-0077-1

Keywords

Navigation