Abstract
Coronal anatomic slices of structural MRI images clearly show the topographical structures of the Hippocampus and Amygdala, which are essential for early diagnosis of Alzheimer’s disease (AD). MR coronal sections are best appreciated for studying the complex topographical relationships of the amygdala and the topographical structures of the hippocampus, which helps in the early detection of disease. Early diagnosis helps prevent the disease’s progression to its final stage. It allows the patient to be aware of the severity of the disease and can take the necessary therapeutic medications to prevent its progression. A coronal view study of MR images is proposed in this paper for early diagnosis of disease using a wavelet-pooling-based multi-path and multi-scale convolutional neural network. This work aims to perform a three-way classification of 2D coronal slices of MRI images to diagnose Mild Cognitive Impairment, AD, and Normal Control in a single algorithm and learn the brain-affected regions through Gradcam visualization. wavelet-pooling is utilized to extract the texture details of the image and thus provide spatial attention to the texture features of the image, which is impossible using Max-pooling or Average-pooling. Multi-scale feature learning is incorporated using parallel multiple low-rank convolutional kernels to capture varying scales of atrophy regions. Multi-path mode compensates for the early loss of features and avoids vanishing gradient problems. The proposed model is trained and tested on the ADNI dataset comprising 900 subjects to give an accuracy of 96.5\(\%\) with ten-fold cross-validation. The multi-scale and multi-path methods significantly reduce the number of learnable parameters.
Similar content being viewed by others
References
Porsteinsson A P, Isaacson R S, Knox S, Sabbagh M N and Rubino I 2021 Diagnosis of Early Alzheimer’s Disease: Clinical Practice in 2021. J. Prev. Alzheimer’s Dis. 8(3):371–386. https://doi.org/10.14283/jpad.2021.23
Cuingnet R, Gerardin E, Tessieras J, Auzias G, Lehéricy S, Habert M O, Chupin M, Benali H and Colliot O 2011 Automatic classification of patients with Alzheimer’s disease from structural MRI: A comparison of ten methods using the ADNI database. Neuroimage 56(2): 766–781
Wang S L, Cai Z C and Xu C L 2013 Classification for Alzheimer’s disease based on SVM using a spatial texture feature of cortical thickness. In: 2013 10th International Computer Conference on Wavelet Active Media Technology and Information Processing ICCWAMTIP pp. 158–161. https://doi.org/10.1109/ICCWAMTIP.2013.6716622
Achterberg H C, Sørensen L, Wolters F J, Niessen W J, Vernooij M W, Ikram M A, Nielsen M and de Bruijne M 2019 The value of hippocampal volume, shape, and texture for 11-year prediction of dementia: a population-based study. Neurobiol Aging 81: 58–66
Oh K, Chung Y C, Kim K W, Kim W S and Oh IS 2019 Classification and Visualization of Alzheimer’s Disease using Volumetric Convolutional Neural Network and Transfer Learning. Sci. Reports 2019 91 9(1): 1. https://doi.org/10.1038/s41598-019-54548-6
Raju M, Sudila T V, Gopi V P, Anitha V S 2020 Classification of Mild Cognitive Impairment and Alzheimer’s Disease from Magnetic Resonance Images using Deep Learning. In: 2020 IEEE International Conference on Recent Trends in Electronics, Information &. Communication Technology RTEICT-2020 p. 52. https://doi.org/10.1109/RTEICT49044.2020.9315695
Liu S, Liu S, Cai W, Pujol S, Kikinis R and Feng D 2014 Early diagnosis of Alzheimer’s disease with deep learning. In: 2014 IEEE 11th International Symposium on Biomedical Imaging, ISBI 2014, Institute of Electrical and Electronics Engineers Inc., pp. 1015–1018. https://doi.org/10.1109/isbi.2014.6868045
Krizhevsky A, Sutskever I and Hinton G E 2012 Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges C, Bottou L, Weinberger K (eds) Advances in Neural Information Processing Systems, Curran Associates, Inc., vol 25. https://proceedings.neurips.cc/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
2020 Identification of Alzheimer’s disease using a convolutional neural network model based on T1-weighted magnetic resonance imaging. Sci. Rep. 10(1): 1–10. https://doi.org/10.1038/s41598-020-79243-9
Pan D, Zeng A, Jia L, Huang Y, Frizzell T and Song X 2020 Early Detection of Alzheimer’s Disease Using Magnetic Resonance Imaging: A Novel Approach Combining Convolutional Neural Networks and Ensemble Learning. Front. Neurosci. 14(May): 1–19. https://doi.org/10.3389/fnins.2020.00259
Hosseini-asl E, Keynton R, El-baz A, Drzezga A, Lautenschlager N, Siebner H, Riemenschneider M, Willoch F, Minoshima S, Schwaiger M and Kurz A 2016 Alzheimer’s Disease Diagnostics by Adaptation of 3D Convolutional Network Electrical and Computer Engineering Department, University of Louisville, Louisville, KY, USA. Eur. J. Nucl. Med. Mol. Imaging 30(8): 1104. https://doi.org/10.1007/s00259-003-1194-1
Pei Z, Gou Y, Ma M, Guo M, Leng C, Chen Y and Li J 2021 Alzheimer’s disease diagnosis based on long-range dependency mechanism using convolutional neural network. Multimed. Tools Appl.. https://doi.org/10.1007/s11042-021-11279-z
Raju M, Gopi V P, Anitha V S and Wahid K A 2020 Multi-class diagnosis of Alzheimer’s disease using cascaded three-dimensional-convolutional neural network. Phys. Eng. Sci. Med. 43(4): 1219. https://doi.org/10.1007/s13246-020-00924-w
Liu M, Cheng D, Wang K and Wang Y 2018 Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis. Neuroinformatics 16(3–4): 295–308. https://doi.org/10.1007/s12021-018-9370-4
Dolph C V, Alam M, Shboul Z, Samad M D and Iftekharuddin K M 2017 Deep learning of texture and structural features for multiclass Alzheimer’s disease classification. Proceedings of the International Joint Conference on Neural Networks 2017-May(1310353):2259–2266. https://doi.org/10.1109/IJCNN.2017.7966129
Fortuna-Cervantes J M, Ramírez-Torres M T, Mejía-Carlos M, Murguía J S, Martinez-Carranza J, Soubervielle-Montalvo C and Guerra-García C A 2022 Texture and Materials Image Classification Based on Wavelet Pooling Layer in CNN. Appl. Sci. 12(7): 1–26. https://doi.org/10.3390/app12073592
Fujieda S, Takayama K and Hachisuka T 2017 Wavelet Convolutional Neural Networks for Texture Classification. http://arxiv.org/abs/1707.07394, 1707.07394
Williams T and Li R 2018 Wavelet pooling for convolutional neural networks. 6th International Conference on Learning Representations, ICLR 2018 - Conference Track Proceedings pp. 1–12
Liu Z, Lu H, Pan X, Xu M, Lan R and Luo X 2022 Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network. Knowledge-Based Syst. 238: 107942
Wang X, Bao A, Lv E and Cheng Y 2020 Multiscale Multipath Ensemble Convolutional Neural Network. IEEE Trans. Syst. Man. Cybern. Syst. p. 1. https://doi.org/10.1109/tsmc.2020.2972695
2011 The diagnosis of mild cognitive impairment due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement 7(3): 270. https://doi.org/10.1016/J.JALZ.2011.03.008
Pini L, Pievani M, Bocchetta M, Altomare D, Bosco P, Cavedo E, Galluzzi S, Marizzoni M and Frisoni G B 2016 Brain atrophy in Alzheimer’s Disease and aging. Ageing Res. Rev. 30: 25. https://doi.org/10.1016/J.ARR.2016.01.002
Thomas A, Harikrishnan P, Ramachandran R, Ramachandran S, Manoj R, Palanisamy P and Gopi V P 2021 A novel multiscale and multipath convolutional neural network based age-related macular degeneration detection using oct images. Comput. Methods Progr. Biomed. 209: 106294
van der Lijn F, Den Heijer T, Breteler M M and Niessen W J 2008 Hippocampus segmentation in mr images using atlas registration, voxel classification, and graph cuts. Neuroimage 43(4): 708–720
Thomas A, Harikrishnan P, Krishna A K, Palanisamy P and Gopi V P 2021 A novel multiscale convolutional neural network based age-related macular degeneration detection using oct images. Biomed. Signal Process Control 67: 102538
Nisha J, Gopi V P and Palanisamy P 2022 Automated colorectal polyp detection based on image enhancement and dual-path cnn architecture. Biomed. Signal Process Control 73: 103465
Thomas A, Harikrishnan P, Krishna A K, Ponnusamy P and Gopi V P 2021 Automated detection of age-related macular degeneration from oct images using multipath cnn. J. Comput. Sci. Eng. 15(1): 34–46
Alzubaidi L, Zhang J, Humaidi A J, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel M A, Al-Amidie M and Farhan L 2021 Review of deep learning: Concepts, cnn architectures, challenges, applications, future directions. J. Big Data 8(1): 1–74
Lee S, Lee H and Kim K W 2020 Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume. J. Psychiatry Neurosci. 45(1): 7–14
Al-Kadi O S, Chung D Y, Carlisle R C, Coussios C C and Noble J A 2015 Quantification of ultrasonic texture intra-heterogeneity via volumetric stochastic modeling for tissue characterization. Med. Image Anal. 21(1): 59–71
Tao Z, Wei T and Li J 2021 Wavelet multi-level attention capsule network for texture classification. IEEE Signal Process. Lett. 28: 1215–1219. https://doi.org/10.1109/LSP.2021.3088052
Rossetto A M and Zhou W 2019 Improving classification with CNNs using wavelet pooling with nesterov-accelerated adam. Proceedings of 11th International Conference on Bioinformatics and Computational Biology, BiCOB 2019 60: 84–93, https://doi.org/10.29007/9c5j
Li Q, Shen L, Guo S and Lai Z 2020 Wavelet integrated cnns for noise-robust image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Frisoni G B, Fox N C, Jack C R, Scheltens P and Thompson P M 2010 The clinical use of structural MRI in Alzheimer disease. Nat. Rev. Neurol. 6(2): 67. https://doi.org/10.1038/nrneurol.2009.215
Simonyan K and Zisserman A 2015 Very deep convolutional networks for large-scale image recognition http://www.robots.ox.ac.uk/, 1409.1556v6
Chollet F 2017 Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1251–1258
He K, Zhang X, Ren S and Sun J 2016 Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778
Zoph B, Vasudevan V, Shlens J and Le Q V 2018 Learning transferable architectures for scalable image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 8697–8710
Tan M and Le Q 2019 Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning, PMLR, pp. 6105–6114
Iandola F, Moskewicz M, Karayev S, Girshick R, Darrell T and Keutzer K 2014 Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869
Song J, Zheng J, Li P, Lu X, Zhu G and Shen P 2021 An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer’s Disease Diagnosis. Front. Digit. Heal.19. https://doi.org/10.3389/FDGTH.2021.637386
Karasawa H, Liu C L, Ohwada H 2018 Deep 3D Convolutional Neural Network Architectures for Alzheimer’s Disease Diagnosis. In: Lecture Notes in Computer Science (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol 10751, p. 287, https://doi.org/10.1007/978-3-319-75417-8-27
Payan A and Montana G 2015 Predicting Alzheimer’s disease a neuroimaging study with 3D convolutional neural networks. In: ICPRAM 2015 - 4th The International Conference on Pattern Recognition Applications and Methods Proceedings 2: 355, arXiv:1502.02506v1
Lei H, Zhao Y and Lei B 2019 Predicting early stages of neurodegenerative diseases via multi-task low-rank feature learning. Lecture Notes in Computer Science (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 11767: 131. https://doi.org/10.1007/978-3-030-32251-9-15
Billones C D, Demetria O J L D, Hostallero D E D and Naval P C 2016 Demnet: A convolutional neural network for the detection of alzheimer’s disease and mild cognitive impairment. In: 2016 IEEE Region 10 Conference (TENCON), pp. 3724–3727, https://doi.org/10.1109/TENCON.2016.7848755
Raju M, Gopi V P and Anitha V S 2021 Multi-class Classification of Alzheimer’s Disease using 3DCNN Features and Multilayer Perceptron. In: 2021 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET) 2021: 368. https://doi.org/10.1109/WISPNET51692.2021.9419393
Raju M, Sudila T, Gopi V P, Anitha V 2020 Classification of mild cognitive impairment and alzheimer’s disease from magnetic resonance images using deep learning. In: 2020 International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT), IEEE, pp. 52–57
Sunija A, Gopi V P and Palanisamy P 2022 Redundancy reduced depthwise separable convolution for glaucoma classification using oct images. Biomed. Signal Process Control 71: 103192
Acknowledgements
Data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health www.fnih.org. The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
As authors hereby declare that we have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Rights and permissions
About this article
Cite this article
Raju, M., P. Gopi, V., Anitha, V.S. et al. Early diagnosis of Alzhiemer’s disease using wavelet-pooling based deep convolutional neural network. Sādhanā 48, 173 (2023). https://doi.org/10.1007/s12046-023-02219-8
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12046-023-02219-8