Holistic Brain Tumor Screening and Classification Based on DenseNet and Recurrent Neural Network

  • Yufan Zhou
  • Zheshuo Li
  • Hong Zhu
  • Changyou Chen
  • Mingchen Gao
  • Kai XuEmail author
  • Jinhui XuEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11383)


We present a holistic brain tumor screening and classification method for detecting and distinguishing multiple types of brain tumors on MR images. The challenges arise from the significant variations of location, shape, size, and contrast of these tumors. The proposed algorithms start with feature extraction from axial slices using dense convolutional neural networks; the obtained sequential features of multiple frames are then fed into a recurrent neural network for classification. Different from most other brain tumor classification algorithms, our framework is free from manual or automatic region of interests segmentation. The results reported on a public dataset and a population of 422 proprietary MRI scans diagnosed as normal, gliomas, meningiomas and metastatic brain tumors demonstrate the effectiveness and efficiency of our method.



This work was supported in part by NSF through grants IIS-1422591, CCF-1422324, and CCF-1716400 and by NSFC through grants 81771904 and 61828205. It was also supported in part by start-up funds (for Drs. Mingchen Gao and Changyou Chen) from the Department of Computer Science and Engineering, University at Buffalo, the State University of New York.


  1. 1.
    Brian tumor statistics. Accessed 16 Feb 2018
  2. 2.
    Afshar, P., Mohammadi, A., Plataniotis, K.N.: Brain tumor type classification via capsule networks. arXiv preprint arXiv:1802.10200 (2018)
  3. 3.
    Bauer, S., Nolte, L.-P., Reyes, M.: Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011. LNCS, vol. 6893, pp. 354–361. Springer, Heidelberg (2011). Scholar
  4. 4.
    Bauer, S., Wiest, R., Nolte, L.-P., Reyes, M.: A survey of MRI-based medical image analysis for brain tumor studies. Phys. Med. Biol. 58(13), R97 (2013)CrossRefGoogle Scholar
  5. 5.
    Cheng, J., et al.: Enhanced performance of brain tumor classification via tumor region augmentation and partition. PloS One 10(10), e0140381 (2015)CrossRefGoogle Scholar
  6. 6.
    El-Dahshan, E.-S.A., Mohsen, H.M., Revett, K., Salem, A.-B.M.: Computer-aided diagnosis of human brain tumor through MRI: a survey and a new algorithm. Expert Syst. Appl. 41(11), 5526–5545 (2014)CrossRefGoogle Scholar
  7. 7.
    Havaei, M., et al.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)CrossRefGoogle Scholar
  8. 8.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  9. 9.
    Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261–2269. IEEE (2017)Google Scholar
  10. 10.
    Menze, B.H., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2015)CrossRefGoogle Scholar
  11. 11.
    van der Maaten, L., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9(Nov), 2579–2605 (2008)zbMATHGoogle Scholar
  12. 12.
    Zhang, Y., Shen, D., Wang, G., Gan, Z., Henao, R., Carin, L.: Deconvolutional paragraph representation learning. In: Advances in Neural Information Processing Systems, pp. 4169–4179 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringUniversity at Buffalo, The State University of New YorkBuffaloUSA
  2. 2.School of Medical InformationXuzhou Medical UniversityXuzhouChina
  3. 3.Affiliated Hospital of Xuzhou Medical UniversityXuzhouChina

Personalised recommendations