Abstract
Hippocampal atrophy is often considered as one of the important biomarkers for early diagnosis of Alzheimer’s disease (AD), which is an irreversible neurodegenerative disorder. Traditional methods for hippocampus analysis usually computed the shape and volume features from structural Magnetic Resonance Image (sMRI) for the computer-aided diagnosis of AD as well as its prodromal stage, i.e., mild cognitive impairment (MCI). Motivated by the success of deep learning, this paper proposes a deep learning method with the multi-channel cascaded convolutional neural networks (CNNs) to gradually learn the combined hierarchical representations of hippocampal shapes and asymmetries from the binary hippocampal masks for AD classification. First, image segmentation is performed to generate the bilateral hippocampus binary masks for each subject and the mask difference is obtained by subtracting them. Second, multi-channel 3D CNNs are individually constructed on the hippocampus masks and mask differences to extract features of hippocampal shapes and asymmetries for classification. Third, a 2D CNN is cascaded on the 3D CNNs to learn high-level correlation features. Finally, the features learned by multi-channel and cascaded CNNs are combined with a fully connected layer followed by a softmax classifier for disease classification. The proposed method can gradually learn the combined hierarchical features of hippocampal shapes and asymmetries to enhance the classification. Our method is verified on the baseline sMRIs from 807 subjects including 194 AD patients, 397 MCI (164 progressive MCI (pMCI) + 233 stable MCI (sMCI)), and 216 normal controls (NC) from Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset. Experimental results demonstrate that the proposed method achieves an AUC (Area Under the ROC Curve) of 88.4%, 74.6% and 71.9% for AD vs. NC, MCI vs. NC and pMCI vs. sMCI classifications, respectively. It proves the promising classification performance and also shows that both hippocampal shape and asymmetry are helpful for AD diagnosis.
Similar content being viewed by others
References
Barnes, J., Scahill, R. I., Schott, J. M., et al. (2005). Does Alzheimer's disease affect hippocampal asymmetry? Evidence from a cross-sectional and longitudinal volumetric MRI study. Dementia and Geriatric Cognitive Disorders, 19(5–6), 338–344.
Beg, M. F., Raamana, P. R., Barbieri, S., & Wang, L. (2013). Comparison of four shape features for detecting hippocampal shape changes in early Alzheimer's. Statistical Methods in Medical Research, 22(4), 439–462.
Chupin, M., Gérardin, E., Cuingnet, R., Boutet, C., Lemieux, L., Lehéricy, S., ... Colliot, O. (2010). Fully automatic hippocampus segmentation and classification in Alzheimer's disease and mild cognitive impairment applied on data from ADNI. Hippocampus, 19(6), 579–587.
Cui, R., & Liu, M. (2018). Hippocampus analysis by combination of 3D DenseNet and shapes for Alzheimer’s disease diagnosis. IEEE Journal of Biomedical & Health Informatics, 23(5), 2099–2107.
Emilie, G., Gaël, C., Marie, C., Rémi, C., Béatrice, D., Ho-Sung, K., et al. (2009). Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging. Neuroimage, 47(4), 1476–1486.
Gordon, E., Barnes, J., Bartlett, J., Rohrer, J., Cardoso, M., Ourselin, S., & Leung, K. (2013). Alzheimer's disease can be accurately differentiated from semantic dementia using automated measurement of hippocampal asymmetry. Alzheimers & Dementia the Journal of the Alzheimers Association, 9(4), P34–P35.
Herrup, K. (2011). Commentary on “Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease.” Addressing the challenge of Alzheimer's disease in the 21st century. Alzheimers Dement, 7(3), 335–337.
Ho, A. J., Raji, C. A., Priya, S., Andrew, D. G., Madsen, S. K., Hibar, D. P., ... Toga, A. W. (2011). Hippocampal volume is related to body mass index in Alzheimer's disease. Neuroreport, 22(1), 10–14.
Hou, G., Yang, X., Yuan T. (2013). Hippocampal asymmetry: Differences in structures and functions. Neurochemical Research, 38(3), 453–460.
Jacka, C. R., Knopman, D. S., Mckhann, G. M., Sperling, R. A., Carrillo, M. C., Thies, B., & Phelps, C. H. (2011). Introduction to the recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement, 7(3), 257–262.
Jenkinson, M., Beckmann, C. F., Behrens, T. E., Woolrich, M. W., & Smith, S. M. (2012). FSL. Fsl. Neuroimage, 62(2), 782–790.
Jyrki, L. T. N., Robin, W., Juha, K., Valtteri, J., Lennart, T., Roger, L., ... Daniel, R. (2011). Fast and robust extraction of hippocampus from MR images for diagnostics of Alzheimer's disease. Neuroimage, 56(1), 185–196.
Leung, K., Mahoney, C., Barnes, J., Ourselin, S., & Fox, N. (2011). Automated quantification of hippocampal asymmetry in MRI in semantic dementia and Alzheimer's disease. Alzheimers Dement, 7(4), S16–S16.
Lindberg, O., Walterfang, M., Looi, J. C., Malykhin, N., Ostberg, P., Zandbelt, B., ..., Orndahl, E. (2012). Hippocampal shape analysis in Alzheimer's disease and frontotemporal lobar degeneration subtypes. Journal of Alzheimers Disease Jad, 30(2), 355.
Liu, F., Suk, H. I., Wee, C. Y., Chen, H., & Shen, D. (2013). High-order graph matching based feature selection for Alzheimer’s disease identification. In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 311–318). Berlin, Heidelberg: Springer.
Liu, F., Wee, C.-Y., Chen, H., & Shen, D. (2013b). Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer\"s disease and mild cognitive impairment identification. Neuroimage, 84, 466–475.
Liu, S., Liu, S., Cai, W., Che, H., Pujol, S., Kikinis, R., & Feng, D. (2015). Multimodal neuroimaging feature learning for multiclass diagnosis of Alzheimer’s disease. IEEE Transactions on Biomedical Engineering, 62(4), 1132–1140.
Liu, M., Li, F., Yan, H., Wang, K., Ma, Y., Shen, L., ... Initiative, A. s. D. N. (2020). A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease. NeuroImage, 208, 116459.
Maruszak, A., & Thuret, S. (2014). Why looking at the whole hippocampus is not enough-a critical role for anteroposterior axis, subfield and activation analyses to enhance predictive value of hippocampal changes for Alzheimer's disease diagnosis. Frontiers in Cellular Neuroscience, 8, 95.
Minati, L., Edginton, T., Bruzzone, M. G., & Giaccone, G. (2009). Current concepts in Alzheimer's disease: A multidisciplinary review. American Journal of Alzheimers Disease & Other Dementias, 24(2), 95–121.
Prince, M. J., Wimo, A., Guerchet, M. M., Ali, G. C., Wu, Y-T., & Prina, M. (2015). World Alzheimer Report 2015 - The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends. Alzheimer's Disease International. http://www.alz.co.uk/research/world-report-2015.
Shen, K. K., Fripp, J., Mériaudeau, F., Chételat, G., Salvado, O., & Bourgeat, P. (2012). Detecting global and local hippocampal shape changes in Alzheimer's disease using statistical shape models. Neuroimage, 59(3), 2155–2166.
Shi, F., Liu, B., Zhou, Y., Yu, C., & Jiang, T. (2010). Hippocampal volume and asymmetry in mild cognitive impairment and Alzheimer's disease: Meta-analyses of MRI studies. Hippocampus, 19(11), 1055–1064.
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013). Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034.
Sled, J. G., Zijdenbos, A. P., & Evans, A. C. (1998). A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Transactions on Medical Imaging, 17(1), 87–97.
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E., Johansen-Berg, H., et al. (2004). Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage, 23, S208–S219.
Suk, H. I., Lee, S. W., & Shen, D. (2015). Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Structure & Function, 220(2), 841–859.
Wang, Y., Nie, J., Yap, P. T., Shi, F., Guo, L., & Shen, D. (2011). Robust deformable-surface-based skull-stripping for large-scale studies. Med Image Comput Comput Assist Interv, 14(3), 635–642.
Woolrich, M. W., Jbabdi, S., Patenaude, B., Chappell, M., Makni, S., Behrens, T., Beckmann, C., Jenkinson, M., & Smith, S. M. (2009). Bayesian analysis of neuroimaging data in FSL. Neuroimage, 45(1), S173–S186.
Yue, L., Wang, T., Wang, J., Li, G., Wang, J., Li, X., Li, W., Hu, M., & Xiao, S. (2018). Asymmetry of Hippocampus and amygdala defect in subjective cognitive decline among the community dwelling Chinese. Frontiers in Psychiatry, 9, 226.
Zhang, D., Wang, Y., Zhou, L., Yuan, H., Shen, D., & Initiative, A. s. D. N. (2011). Multimodal classification of Alzheimer's disease and mild cognitive impairment. NeuroImage, 55(3), 856–867.
Funding
This study was supported in part by the National Natural Science Foundation of China (NSFC) under grants (6181101049, 61981340415, 61773263), Natural Science Foundation of Shanghai (20ZR1426300), Shanghai Jiao Tong University Scientific and Technological Innovation Funds (2019QYB02), and an ECNU-SJTU joint grant from the Basic Research Project of Shanghai Science and Technology Commission (No.19JC1410102).
Data collection and sharing were funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). We just use the data from the ADNI dataset for this study. The ADNI investigators did not participate in the analysis or writing of this study. A complete list of ADNI investigators can be found online at http://adni.loni.usc.edu/about/governance/principal-investigators/.
Author information
Authors and Affiliations
Consortia
Corresponding author
Ethics declarations
Conflict of interest
There is no conflict of interest. All authors participated in experiment design, data acquisition and analysis, and wrote the manuscript. All authors approved the final version of the manuscript.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, A., Li, F., Elahifasaee, F. et al. Hippocampal shape and asymmetry analysis by cascaded convolutional neural networks for Alzheimer’s disease diagnosis. Brain Imaging and Behavior 15, 2330–2339 (2021). https://doi.org/10.1007/s11682-020-00427-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11682-020-00427-y