Abstract
Classification of brain tumors is of great importance in medical applications that benefit from computer-aided diagnosis. Misdiagnosis of brain tumor type will both prevent the patient from responding effectively to the applied treatment and decrease the patient’s chances of survival. In this study, we propose a solution for classifying brain tumors in MR images using transfer learning networks. The most common brain tumors are detected with VGG16, VGG19, ResNet50 and DenseNet21 networks using transfer learning. Deep transfer learning networks are trained and tested using four different optimization algorithms (Adadelta, ADAM, RMSprop and SGD) on the accessible Figshare dataset containing 3064 T1-weighted MR images from 233 patients with three common brain tumor types: glioma (1426 images), meningioma (708 images) and pituitary (930 images). The area under the curve (AUC) and accuracy metrics were used as performance measures. The proposed transfer learning methods have a level of success that can be compared with studies in the literature; the highest classification performance is 99.02% with ResNet50 using Adadelta. The classification result proved that the most common brain tumors can be classified with very high performance. Thus, the transfer learning model is promising in medicine and can help doctors make quick and accurate decisions.
Similar content being viewed by others
Data availability
Dataset is publicly available on https://figshare.com/articles/brain_tumor_dataset/1512427.
References
Mohsen H, El-Dahshan EA, El-Horbaty EM, Salem AM (2018) Classification using deep learning neural networks for brain tumors. Future Computing Inform J 3:68–71. https://doi.org/10.1016/j.fcij.2017.12.001
Usman K, Rajpoot K (2017) Brain tumor classification from multi-modality MRI using wavelets and machine learning. Pattern Anal Appl 20(3):871–881. https://doi.org/10.1007/s10044-017-0597-8
Cheng J, Huang W, Cao S, Yang R, Yang W et al (2015) Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS One 10(10):e0140381. https://doi.org/10.1371/journal.pone.0140381
Ismael MR, Abdel-Qader I (2018) Brain tumor classification via statistical features and back-propagation neural network. IEEE International Conference on Electro/Information Technology; Rochester. MI, USA, pp 252–257
Rathi VPGP, Palani S (2015) Brain tumor detection and classification using deep learning classifier on MRI images. Res J Appl Sci Eng Technol 10(2):177–187
Talo M, Baloglu UB, Yıldırım Ö, Acharya UR (2019) Application of deep transfer learning for automated brain abnormality classification using MR images. Cognitive Sys Res 54:176–188. https://doi.org/10.1016/j.cogsys.2018.12.007
Khan HA, Jue W, Mushtaq M, Mushtaq MU (2020) Brain tumor classification in MRI using convolutional neural network. Math Biosci Eng 17(5):6203–6216
Cheng J (2017) Figshare brain tumor dataset, https://doi.org/10.6084/m9.figshare.1512427.v5. Accessed 12 August 2020
Abiwinanda N, Hanif M, Hesaputra ST, Handayani A, Mengko TR (2018) Brain tumor classification using convolutional neural network. Springer World Congr Med Phys Biomed Eng. https://doi.org/10.1007/978-981-10-9035-6_33
Afshar P, Plataniotis KN, Mohammadi A (2018) Capsule networks for brain tumor classifications based on MRI images and course tumor boundaries. IEEE International Conference on Acoustics. Speech and Signal Processing; Toronto, ON, Canada, pp. 1368–1372
Pashaei A, Sajedi H, Jazayeri N (2018). Brain tumor classification via convolutional neural network and extreme learning machines. In: IEEE 8th International Conference on Computer and Knowledge Engineering, Mashhad, Iran. pp. 314–319
Phaye SSR, Sikka A, Dhall A, Bathula DR (2018) Dense and diverse capsule networks: making the capsules learn better. http://arxiv.org/abs/abs/1805.04001arXiv:abs/1805.04001
Seetha J, Selvakumar Raja S (2018) Brain tumor classification using convolutional neural networks. Biomed Pharmacol J 11(3):1457–1461. https://doi.org/10.13005/bpj/1511
Avşar E, Salçın K (2019) Detection and classification of brain tumours from MRI images using faster R-CNN. Tehnički Glasnik 13(4):337–342. https://doi.org/10.31803/tg-20190712095507
Zhou Y, Li Z, Zhu H, Chen C, Gao M et al (2019) Holistic brain tumor screening and classification based on densenet and recurrent neural network glioma multiple sclerosis stroke and traumatic brain injuries. Springer International Publishing, Brainlesion, pp 208–217
Anaraki AK, Ayati M, Kazemi F (2019) Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms. Biocyber Biomed Eng 39(1):63–74. https://doi.org/10.1016/j.bbe.2018.10.004
Gumaei A, Hassan MM, Hassan MR, Alelaiwi A, Fortino G (2019) A hybrid feature extraction method with regularized extreme learning machine for brain tumor classification. IEEE Access 7:36266–36273. https://doi.org/10.1109/ACCESS.2019.2904145
Sultan HH, Salem NM, Al-Atabany W (2019) Multi-classification of brain tumor images using deep neural network. IEEE Access 7:69215–69225. https://doi.org/10.1109/ACCESS.2019.2919122
Deepak S, Ameer PM (2019) Brain tumor classification using deep CNN features via transfer learning. Comput Biol Med 111:103345. https://doi.org/10.1016/j.compbiomed.2019.103345
Kaplan K, Kaya Y, Kuncan M, Ertunç HM (2020) Brain tumor classification using modified local binary patterns (LBP) feature extraction methods. Med Hypotheses 139:109696. https://doi.org/10.1016/j.mehy.2020.109696
Ghassemi N, Shoeibi A, Rouhani M (2020) Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images. Biomed Signal Process Control 57:101678. https://doi.org/10.1016/j.bspc.2019.101678
Badža MM, Barjaktarović MČ (2020) Classification of brain tumors from MRI images using a convolutional neural network. Appl Sci 10(6):1999. https://doi.org/10.3390/app10061999
Rehman A, Naz S, Razzak MI, Akram F, Imran M (2020) A deep learning-based framework for automatic brain tumors classification using transfer learning. Circuits Syst Signal Process 39(2):757–775. https://doi.org/10.1007/s00034-019-01246-3
Chelghoum R, Ikhlef A, Hameurlaine A, Jacquir S (2020) Transfer learning using convolutional neural network architectures for brain tumor classification from MRI images. In: Maglogiannis I, Iliadis L, Pimenidis E (eds) Artificial intelligence applications and innovations AIAI 2020 IFIP advances in information and communication technology. Springer, Newyork
Ruba T, Tamilselvi R, Beham MP, Aparna N (2020) Accurate classification and detection of brain cancer cells in MRI and CT images using nano contrast agents. Biomed Pharmacol J 13(3):1227–1237. https://doi.org/10.13005/bpj/1991
Guo Y, Liu Y, Oerlemans A, Lao S, Wu S et al (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48. https://doi.org/10.1016/j.neucom.2015.09.116
LeCun Y, Boser B, Denker JS, Henderson D, Howard RE et al (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551. https://doi.org/10.1162/neco.1989.1.4.541
Zeiler MD (2012). ADADELTA: An adaptive learning rate method. CoRR. arXiv:1212.5701
Goodfellow I, Bengio Y, Courville A (2015) Deep learning. MIT Press. http://www.deeplearningbook.org
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556v6
Kaiming H, Xiangyu Z, Shaoqing R, Jian S (2015) Deep residual learning for image recognition. arXiv:1512.03385
Huang G, Liu Z, Maaten L, Weinberger KQ (2016) Densely connected convolutional networks. arXiv:1608.06993
Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874. https://doi.org/10.1016/j.patrec.2005.10.010
Funding
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Author information
Authors and Affiliations
Contributions
ÖP designed the study, developed the software with Python, performed the experiments, analyzed the results and wrote the manuscript. CG performed some of the experiments.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that there is no conflicts of interest.
Code availability
Computer codes are publicly available on https://drive.google.com/drive/folders/12elz8QU9SMUiiC7GBzSf9v2Hq-wBjhz4
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Polat, Ö., Güngen, C. Classification of brain tumors from MR images using deep transfer learning. J Supercomput 77, 7236–7252 (2021). https://doi.org/10.1007/s11227-020-03572-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-020-03572-9