A Novel Dynamic Hyper-graph Inference Framework for Computer Assisted Diagnosis of Neuro-Diseases

  • Yingying ZhuEmail author
  • Xiaofeng Zhu
  • Minjeong Kim
  • Daniel Kaufer
  • Guorong Wu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10265)


Recently hyper-graph learning gains increasing attention in medical imaging area since the hyper-graph, a generalization of a graph, opts to characterize the complex subject-wise relationship behind multi-modal neuroimaging data. However, current hyper-graph methods mainly have two limitations: (1) The data representation encoded in the hyper-graph is learned only from the observed imaging features for each modality separately. Therefore, the learned subject-wise relationships are neither consistent across modalities nor fully consensus with the clinical labels or clinical scores. (2) The learning procedure of data representation is completely independent to the subsequent classification step. Since the data representation optimized in the feature domain is not exactly aligned with the clinical labels, such independent step-by-step workflow might result in sub-optimal classification. To address these limitations, we propose a novel dynamic hyper-graph inference framework, working in a semi-supervised manner, which iteratively estimates and adjusts the subject-wise relationship from multi-modal neuroimaging data until the learned data representation (encoded in the hyper-graph) achieves largest consensus with the observed clinical labels and scores. It is worth noting our inference framework is also flexible to integrate classification (identifying individuals with neuro-disease) and regression (predicting the clinical scores). We have demonstrated the performance of our proposed dynamic hyper-graph inference framework in identifying MCI (Mild Cognition Impairment) subjects and the fine-grained recognition of different progression stage of MCI, where we achieve more accurate diagnosis result than conventional counterpart methods.


  1. 1.
    Zhu, X., Suk, H.-I., Thung, K.-H., Zhu, Y., Wu, G., Shen, D.: Joint discriminative and representative feature selection for Alzheimer’s disease diagnosis. In: Wang, L., Adeli, E., Wang, Q., Shi, Y., Suk, H.-I. (eds.) MLMI 2016. LNCS, vol. 10019, pp. 77–85. Springer, Cham (2016). doi: 10.1007/978-3-319-47157-0_10 CrossRefGoogle Scholar
  2. 2.
    Zhang, D.: Multi-modal multi-task learning for joint feature prediction of multiple regression and classification variables in Alzheimer’s disease. Neuroimage 59, 895–907 (2012)CrossRefGoogle Scholar
  3. 3.
    Suk, H., Shen, D.: Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. Neuroimage 1 (2015)Google Scholar
  4. 4.
    Dong, P., Guo, Y., Shen, D., Wu, G.: Multi-atlas and multi-modal hippocampus segmentation for infant MR brain images by propagating anatomical labels on hypergraph. In: Wu, G., Coupé, P., Zhan, Y., Munsell, B., Rueckert, D. (eds.) Patch-MI 2015. LNCS, vol. 9467, pp. 188–196. Springer, Cham (2015). doi: 10.1007/978-3-319-28194-0_23 CrossRefGoogle Scholar
  5. 5.
    Gao, Y., Wee, C.-Y., Kim, M., Giannakopoulos, P., Montandon, M.-L., Haller, S., Shen, D.: MCI identification by joint learning on multiple MRI data. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9350, pp. 78–85. Springer, Cham (2015). doi: 10.1007/978-3-319-24571-3_10 CrossRefGoogle Scholar
  6. 6.
    Boyd, S., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3, 1–122 (2011)CrossRefGoogle Scholar
  7. 7.
    Smith, A.: Nonparametric regression on a graph. J. Comput. Graph. Stat. 20 (2011)Google Scholar
  8. 8.
    Zhu, Y.: Convolutional sparse coding for trajectory reconstruction. TPAMI 37, 529–540 (2015)CrossRefGoogle Scholar
  9. 9.
    Zhu, Y., Cox, M., Lucey, S.: 3D motion reconstruction for real-world camera motion. In: CVPR, pp. 1–8 (2011)Google Scholar
  10. 10.
    Zhu, Y., Huang, D., Torre, F.D.L., Lucey, S.: Complex non-rigid motion 3D reconstruction by union of subspaces. In: CVPR, pp. 23–34 (2014)Google Scholar
  11. 11.
    Thompson, P., et al.: Tracking Alzheimer’s disease. Ann. N. Y. Acad. Sci. 1097, 183–214 (2007)CrossRefGoogle Scholar
  12. 12.
    Risacher, S., Saykin, A.: Neuroimaging biomarkers of neurodegenerative diseases and dementia. Semin. Neurol. 33, 386–416 (2013)CrossRefGoogle Scholar
  13. 13.
    Reisberg, B., Ferris, S., Kluger, A., Franssen, E., Wegiel, J., De Leon, M.J.: Mild cognitive impairment (MCI): a historical perspective. Int. Psychogeriatr. 20, 18–31 (2008)Google Scholar
  14. 14.
    Zhang, D., Wang, Y., Zhou, L., Yuan, H., Shen, D.: Alzheimer’s Disease Neuroimaging Initiative: Multimodal classification of Alzheimer’s disease and mild cognitive impairment. NeuroImage, 55, 856–867 (2011)Google Scholar
  15. 15.
    Ganguli, M., Dodge, H., Shen, C., DeKosky, S.T.: Mild cognitive impairment, amnestic type an epidemiologic study. Neurology 63, 115–121 (2004)CrossRefGoogle Scholar
  16. 16.
    Guo, X., Wang, Z., Li, K., Li, Z., Qi, Z., Jin, Z., et al.: Voxel-based assessment of gray and white matter volumes in Alzheimer’s disease. Neurosci. Lett. 468, 146–150 (2010)CrossRefGoogle Scholar
  17. 17.
    Wang, Z., Zhu, X., Adeli, E., Zhu, Y., Zu, C., Nie, F., Shen, D., Wu, G.: Progressive graph-based transductive learning for multi-modal classification of brain disorder disease. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9900, pp. 291–299. Springer, Cham (2016). doi: 10.1007/978-3-319-46720-7_34 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Yingying Zhu
    • 1
    Email author
  • Xiaofeng Zhu
    • 1
  • Minjeong Kim
    • 1
  • Daniel Kaufer
    • 2
  • Guorong Wu
    • 1
  1. 1.Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillUSA
  2. 2.Department of NeurologyUniversity of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations