Nonlinear Graph Fusion for Multi-modal Classification of Alzheimer’s Disease

  • Tong TongEmail author
  • Katherine Gray
  • Qinquan Gao
  • Liang Chen
  • Daniel Rueckert
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9352)


Recent studies have demonstrated that biomarkers from multiple modalities contain complementary information for the diagnosis of Alzheimer’s disease (AD) and its prodromal stage mild cognitive impairment (MCI). In order to fuse data from multiple modalities, most previous approaches calculate a mixed kernel or a similarity matrix by linearly combining kernels or similarities from multiple modalities. However, the complementary information from multi-modal data are not necessarily linearly related. In addition, this linear combination is also sensitive to the weights assigned to each modality. In this paper, we propose a nonlinear graph fusion method to efficiently exploit the complementarity in the multi-modal data for the classification of AD. Specifically, a graph is first constructed for each modality individually. Afterwards, a single unified graph is obtained via a nonlinear combination of the graphs in an iterative cross diffusion process. Using the unified graphs, we achieved classification accuracies of 91.8% between AD subjects and normal controls (NC), 79.5% between MCI subjects and NC and 60.2% in a three-way classification, which are competitive with state-of-the-art results.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brookmeyer, R., Johnson, E., Ziegler-Graham, K., Arrighi, H.M.: Forecasting the global burden of Alzheimer’s disease. Alzheimer’s and Dementia 3(3), 186–191 (2007)CrossRefGoogle Scholar
  2. 2.
    Kohannim, O., Hua, X., Hibar, D.P., Lee, S., Chou, Y.Y., Toga, A.W., Jack, C.R., Weiner, M.W., Thompson, P.M.: Boosting power for clinical trials using classifiers based on multiple biomarkers. Neurobiology of Aging 31(8), 1429–1442 (2010)CrossRefGoogle Scholar
  3. 3.
    Zhang, D., Wang, Y., Zhou, L., Yuan, H., Shen, D.: ADNI: Multimodal classification of Alzheimer’s disease and mild cognitive impairment. NeuroImage 55(3), 856–867 (2011)CrossRefGoogle Scholar
  4. 4.
    Hinrichs, C., Singh, V., Xu, G., Johnson, S.C.: ADNI: Predictive markers for AD in a multi-modality framework: an analysis of MCI progression in the ADNI population. NeuroImage 55(2), 574–589 (2011)CrossRefGoogle Scholar
  5. 5.
    Zhang, D., Shen, D.: ADNI: Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer’s disease. Neuroimage 59(2), 895–907 (2012)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Yuan, L., Wang, Y., Thompson, P.M., Narayan, V.A., Ye, J.: ADNI: Multi-source feature learning for joint analysis of incomplete multiple heterogeneous neuroimaging data. NeuroImage 61(3), 622–632 (2012)CrossRefGoogle Scholar
  7. 7.
    Gray, K.R., Aljabar, P., Heckemann, R.A., Hammers, A., Rueckert, D.: ADNI: Random forest-based similarity measures for multi-modal classification of Alzheimer’s disease. NeuroImage 65, 167–175 (2013)CrossRefGoogle Scholar
  8. 8.
    Young, J., Modat, M., Cardoso, M.J., Mendelson, A., Cash, D., Ourselin, S.: ADNI: Accurate multimodal probabilistic prediction of conversion to Alzheimer’s disease in patients with mild cognitive impairment. NeuroImage: Clinical 2, 735–745 (2013)CrossRefGoogle Scholar
  9. 9.
    Liu, F., Wee, C.Y., Chen, H., Shen, D.: Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer’s disease and mild cognitive impairment identification. NeuroImage 84, 466–475 (2014)CrossRefGoogle Scholar
  10. 10.
    Thung, K.H., Wee, C.Y., Yap, P.T., Shen, D.: ADNI: Neurodegenerative disease diagnosis using incomplete multi-modality data via matrix shrinkage and completion. NeuroImage 91, 386–400 (2014)CrossRefGoogle Scholar
  11. 11.
    Jie, B., Zhang, D., Cheng, B., Shen, D.: Manifold regularized multitask feature learning for multimodality disease classification. Human Brain Mapping 36(2), 489–507 (2015)CrossRefGoogle Scholar
  12. 12.
    Pearl, J.: Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann (1988)Google Scholar
  13. 13.
    Wang, B., Jiang, J., Wang, W., Zhou, Z.H., Tu, Z.: Unsupervised metric fusion by cross diffusion. In: IEEE Conference on CVPR, pp. 2997–3004. IEEE (2012)Google Scholar
  14. 14.
    Breiman, L.: Random Forests. Machine Learning 45(1), 5–32 (2001)CrossRefGoogle Scholar
  15. 15.
    Moradi, E., Pepe, A., Gaser, C., Huttunen, H., Tohka, J.: ADNI: Machine learning framework for early MRI-based Alzheimer’s conversion prediction in MCI subjects. NeuroImage 104, 398–412 (2015)CrossRefGoogle Scholar
  16. 16.
    Heckemann, R.A., Keihaninejad, S., Aljabar, P., Gray, K.R., Nielsen, C., Rueckert, D., Hajnal, J.V., Hammers, A.: ADNI: Automatic morphometry in Alzheimer’s disease and mild cognitive impairment. NeuroImage 56(4), 2024–2037 (2011)CrossRefGoogle Scholar
  17. 17.
    Bron, E.E., Smits, M., et al.: Standardized evaluation of algorithms for computer-aided diagnosis of dementia based on structural MRI: The CADDementia challenge. NeuroImage (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Tong Tong
    • 1
    Email author
  • Katherine Gray
    • 1
  • Qinquan Gao
    • 2
  • Liang Chen
    • 1
  • Daniel Rueckert
    • 1
  1. 1.Department of ComputingImperial College LondonLondonUK
  2. 2.Fujian Province Key Lab of MIPTFuzhou UniversityFuzhouChina

Personalised recommendations