Brain Tumor Detection and Classification from Multi-sequence MRI: Study Using ConvNets

  • Subhashis BanerjeeEmail author
  • Sushmita Mitra
  • Francesco Masulli
  • Stefano Rovetta
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11383)


In this paper, we thoroughly investigate the power of Deep Convolutional Neural Networks (ConvNets) for classification of brain tumors using multi-sequence MR images. First we propose three ConvNets, which are trained from scratch, on MRI patches, slices, and multi-planar volumetric slices. The suitability of transfer learning for the task is next studied by applying two existing ConvNets models (VGGNet and ResNet) pre-trained on ImageNet dataset, through fine-tuning of the last few layers. Leave-one-patient-out (LOPO) testing scheme is used to evaluate the performance of the ConvNets. Results demonstrate that ConvNet achieves better accuracy in all cases where the model is trained on the multi-planar volumetric dataset. Unlike conventional models, it obtains a testing accuracy of \(97\%\) without any additional effort towards extraction and selection of features. We also study the properties of self-learned kernels/filters in different layers, through visualization of the intermediate layer outputs.


Convolutional neural network Deep learning Brain tumor Glioblastoma multiforme Multi-sequence MRI Transfer learning 


  1. 1.
    Louis, D.N., et al.: The 2007 WHO classification of tumours of the central nervous system. Acta Neuropathol. 114(2), 97–109 (2007)CrossRefGoogle Scholar
  2. 2.
    McGirt, M.J., et al.: Independent predictors of morbidity after image-guided stereotactic brain biopsy: a risk assessment of 270 cases. J. Neurosurg. 102(5), 897–901 (2005)CrossRefGoogle Scholar
  3. 3.
    Chandrasoma, P.T., Smith, M.M., Apuzzo, M.L.J.: Stereotactic biopsy in the diagnosis of brain masses: comparison of results of biopsy and resected surgical specimen. Neurosurgery 24(2), 160–165 (1989)CrossRefGoogle Scholar
  4. 4.
    Mitra, S., Uma Shankar, B.: Medical image analysis for cancer management in natural computing framework. Inf. Sci. 306, 111–131 (2015)CrossRefGoogle Scholar
  5. 5.
    Zhou, M., et al.: Radiomics in brain tumor: image assessment, quantitative feature descriptors, and machine-learning approaches. Am. J. Neuroradiol. 39(2), 208–216 (2017)CrossRefGoogle Scholar
  6. 6.
    Banerjee, S., Mitra, S., Shankar, B.U.: Synergetic neuro-fuzzy feature selection and classification of brain tumors. In: Proceedings of IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp. 1–6 (2017)Google Scholar
  7. 7.
    Banerjee, S., Mitra, S., Uma Shankar, B., Hayashi, Y.: A novel GBM saliency detection model using multi-channel MRI. PLoS ONE 11(1), e0146388 (2016)CrossRefGoogle Scholar
  8. 8.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  9. 9.
    Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)CrossRefGoogle Scholar
  10. 10.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556 (2014)
  11. 11.
    Scarpace, L., et al.: Radiology data from the cancer genome atlas glioblastoma multiforme [TCGA-GBM] collection. Cancer Imaging Arch. (2016)Google Scholar
  12. 12.
    Pedano, N., Flanders, A., Scarpace, L., et al.: Radiology data from the cancer genome atlas low grade glioma [TCGA-LGG] collection. Cancer Imaging Arch. (2016).
  13. 13.
    Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26, 1045–1057 (2013)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Subhashis Banerjee
    • 1
    • 2
    Email author
  • Sushmita Mitra
    • 1
  • Francesco Masulli
    • 3
  • Stefano Rovetta
    • 3
  1. 1.Machine Intelligence UnitIndian Statistical InstituteKolkataIndia
  2. 2.Department of CSEUniversity of CalcuttaKolkataIndia
  3. 3.DIBRISUniversity of GenovaGenoaItaly

Personalised recommendations