Skip to main content
Log in

Classification of brain tumors from MR images using deep transfer learning

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Classification of brain tumors is of great importance in medical applications that benefit from computer-aided diagnosis. Misdiagnosis of brain tumor type will both prevent the patient from responding effectively to the applied treatment and decrease the patient’s chances of survival. In this study, we propose a solution for classifying brain tumors in MR images using transfer learning networks. The most common brain tumors are detected with VGG16, VGG19, ResNet50 and DenseNet21 networks using transfer learning. Deep transfer learning networks are trained and tested using four different optimization algorithms (Adadelta, ADAM, RMSprop and SGD) on the accessible Figshare dataset containing 3064 T1-weighted MR images from 233 patients with three common brain tumor types: glioma (1426 images), meningioma (708 images) and pituitary (930 images). The area under the curve (AUC) and accuracy metrics were used as performance measures. The proposed transfer learning methods have a level of success that can be compared with studies in the literature; the highest classification performance is 99.02% with ResNet50 using Adadelta. The classification result proved that the most common brain tumors can be classified with very high performance. Thus, the transfer learning model is promising in medicine and can help doctors make quick and accurate decisions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

Dataset is publicly available on https://figshare.com/articles/brain_tumor_dataset/1512427.

References

  1. Mohsen H, El-Dahshan EA, El-Horbaty EM, Salem AM (2018) Classification using deep learning neural networks for brain tumors. Future Computing Inform J 3:68–71. https://doi.org/10.1016/j.fcij.2017.12.001

    Article  Google Scholar 

  2. Usman K, Rajpoot K (2017) Brain tumor classification from multi-modality MRI using wavelets and machine learning. Pattern Anal Appl 20(3):871–881. https://doi.org/10.1007/s10044-017-0597-8

    Article  MathSciNet  Google Scholar 

  3. Cheng J, Huang W, Cao S, Yang R, Yang W et al (2015) Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS One 10(10):e0140381. https://doi.org/10.1371/journal.pone.0140381

    Article  Google Scholar 

  4. Ismael MR, Abdel-Qader I (2018) Brain tumor classification via statistical features and back-propagation neural network. IEEE International Conference on Electro/Information Technology; Rochester. MI, USA, pp 252–257

    Google Scholar 

  5. Rathi VPGP, Palani S (2015) Brain tumor detection and classification using deep learning classifier on MRI images. Res J Appl Sci Eng Technol 10(2):177–187

    Google Scholar 

  6. Talo M, Baloglu UB, Yıldırım Ö, Acharya UR (2019) Application of deep transfer learning for automated brain abnormality classification using MR images. Cognitive Sys Res 54:176–188. https://doi.org/10.1016/j.cogsys.2018.12.007

    Article  Google Scholar 

  7. Khan HA, Jue W, Mushtaq M, Mushtaq MU (2020) Brain tumor classification in MRI using convolutional neural network. Math Biosci Eng 17(5):6203–6216

    Article  MathSciNet  Google Scholar 

  8. Cheng J (2017) Figshare brain tumor dataset, https://doi.org/10.6084/m9.figshare.1512427.v5. Accessed 12 August 2020

  9. Abiwinanda N, Hanif M, Hesaputra ST, Handayani A, Mengko TR (2018) Brain tumor classification using convolutional neural network. Springer World Congr Med Phys Biomed Eng. https://doi.org/10.1007/978-981-10-9035-6_33

    Article  Google Scholar 

  10. Afshar P, Plataniotis KN, Mohammadi A (2018) Capsule networks for brain tumor classifications based on MRI images and course tumor boundaries. IEEE International Conference on Acoustics. Speech and Signal Processing; Toronto, ON, Canada, pp. 1368–1372

  11. Pashaei A, Sajedi H, Jazayeri N (2018). Brain tumor classification via convolutional neural network and extreme learning machines. In: IEEE 8th International Conference on Computer and Knowledge Engineering, Mashhad, Iran. pp. 314–319

  12. Phaye SSR, Sikka A, Dhall A, Bathula DR (2018) Dense and diverse capsule networks: making the capsules learn better. http://arxiv.org/abs/abs/1805.04001arXiv:abs/1805.04001

  13. Seetha J, Selvakumar Raja S (2018) Brain tumor classification using convolutional neural networks. Biomed Pharmacol J 11(3):1457–1461. https://doi.org/10.13005/bpj/1511

    Article  Google Scholar 

  14. Avşar E, Salçın K (2019) Detection and classification of brain tumours from MRI images using faster R-CNN. Tehnički Glasnik 13(4):337–342. https://doi.org/10.31803/tg-20190712095507

    Article  Google Scholar 

  15. Zhou Y, Li Z, Zhu H, Chen C, Gao M et al (2019) Holistic brain tumor screening and classification based on densenet and recurrent neural network glioma multiple sclerosis stroke and traumatic brain injuries. Springer International Publishing, Brainlesion, pp 208–217

    Google Scholar 

  16. Anaraki AK, Ayati M, Kazemi F (2019) Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms. Biocyber Biomed Eng 39(1):63–74. https://doi.org/10.1016/j.bbe.2018.10.004

    Article  Google Scholar 

  17. Gumaei A, Hassan MM, Hassan MR, Alelaiwi A, Fortino G (2019) A hybrid feature extraction method with regularized extreme learning machine for brain tumor classification. IEEE Access 7:36266–36273. https://doi.org/10.1109/ACCESS.2019.2904145

    Article  Google Scholar 

  18. Sultan HH, Salem NM, Al-Atabany W (2019) Multi-classification of brain tumor images using deep neural network. IEEE Access 7:69215–69225. https://doi.org/10.1109/ACCESS.2019.2919122

    Article  Google Scholar 

  19. Deepak S, Ameer PM (2019) Brain tumor classification using deep CNN features via transfer learning. Comput Biol Med 111:103345. https://doi.org/10.1016/j.compbiomed.2019.103345

    Article  Google Scholar 

  20. Kaplan K, Kaya Y, Kuncan M, Ertunç HM (2020) Brain tumor classification using modified local binary patterns (LBP) feature extraction methods. Med Hypotheses 139:109696. https://doi.org/10.1016/j.mehy.2020.109696

    Article  Google Scholar 

  21. Ghassemi N, Shoeibi A, Rouhani M (2020) Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images. Biomed Signal Process Control 57:101678. https://doi.org/10.1016/j.bspc.2019.101678

    Article  Google Scholar 

  22. Badža MM, Barjaktarović MČ (2020) Classification of brain tumors from MRI images using a convolutional neural network. Appl Sci 10(6):1999. https://doi.org/10.3390/app10061999

    Article  Google Scholar 

  23. Rehman A, Naz S, Razzak MI, Akram F, Imran M (2020) A deep learning-based framework for automatic brain tumors classification using transfer learning. Circuits Syst Signal Process 39(2):757–775. https://doi.org/10.1007/s00034-019-01246-3

    Article  Google Scholar 

  24. Chelghoum R, Ikhlef A, Hameurlaine A, Jacquir S (2020) Transfer learning using convolutional neural network architectures for brain tumor classification from MRI images. In: Maglogiannis I, Iliadis L, Pimenidis E (eds) Artificial intelligence applications and innovations AIAI 2020 IFIP advances in information and communication technology. Springer, Newyork

    Google Scholar 

  25. Ruba T, Tamilselvi R, Beham MP, Aparna N (2020) Accurate classification and detection of brain cancer cells in MRI and CT images using nano contrast agents. Biomed Pharmacol J 13(3):1227–1237. https://doi.org/10.13005/bpj/1991

    Article  Google Scholar 

  26. Guo Y, Liu Y, Oerlemans A, Lao S, Wu S et al (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48. https://doi.org/10.1016/j.neucom.2015.09.116

    Article  Google Scholar 

  27. LeCun Y, Boser B, Denker JS, Henderson D, Howard RE et al (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551. https://doi.org/10.1162/neco.1989.1.4.541

    Article  Google Scholar 

  28. Zeiler MD (2012). ADADELTA: An adaptive learning rate method. CoRR. arXiv:1212.5701

  29. Goodfellow I, Bengio Y, Courville A (2015) Deep learning. MIT Press. http://www.deeplearningbook.org

  30. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556v6

  31. Kaiming H, Xiangyu Z, Shaoqing R, Jian S (2015) Deep residual learning for image recognition. arXiv:1512.03385

  32. Huang G, Liu Z, Maaten L, Weinberger KQ (2016) Densely connected convolutional networks. arXiv:1608.06993

  33. Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874. https://doi.org/10.1016/j.patrec.2005.10.010

    Article  MathSciNet  Google Scholar 

Download references

Funding

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Author information

Authors and Affiliations

Authors

Contributions

ÖP designed the study, developed the software with Python, performed the experiments, analyzed the results and wrote the manuscript. CG performed some of the experiments.

Corresponding author

Correspondence to Özlem Polat.

Ethics declarations

Conflicts of interest

The authors declare that there is no conflicts of interest.

Code availability

Computer codes are publicly available on https://drive.google.com/drive/folders/12elz8QU9SMUiiC7GBzSf9v2Hq-wBjhz4

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Polat, Ö., Güngen, C. Classification of brain tumors from MR images using deep transfer learning. J Supercomput 77, 7236–7252 (2021). https://doi.org/10.1007/s11227-020-03572-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03572-9

Keywords

Navigation