Abstract
One recent interest in computer-aided diagnosis of neurological diseases is to predict the clinical scores from brain images. Most existing methods usually estimate multiple clinical variables separately, without considering the useful correlation information among them. On the other hand, nearly all methods use only one modality of data (mostly structural MRI) for regression, and thus ignore the complementary information among different modalities. To address these issues, in this paper, we present a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Our method contains three major subsequent steps: (1) a multi-task feature selection which selects the common subset of relevant features for the related multiple clinical variables from each modality; (2) a kernel-based multimodal data fusion which fuses the above-selected features from all modalities; (3) a support vector regression which predicts multiple clinical variables based on the previously learnt mixed kernel. Experimental results on ADNI dataset with both imaging modalities (MRI and PET) and biological modality (CSF) validate the efficacy of the proposed M3T learning method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Kloppel, S., Stonnington, C.M., Chu, C., Draganski, B., Scahill, R.I., Rohrer, J.D., Fox, N.C., Jack Jr., C.R., Ashburner, J., Frackowiak, R.S.: Automatic classification of MR scans in Alzheimer’s disease. Brain 131, 681–689 (2008)
Vemuri, P., Wiste, H.J., Weigand, S.D., Shaw, L.M., Trojanowski, J.Q., Weiner, M.W., Knopman, D.S., Petersen, R.C., Jack Jr., C.R.: MRI and CSF biomarkers in normal, MCI, and AD subjects: predicting future clinical change. Neurology 73, 294–301 (2009)
Walhovd, K.B., Fjell, A.M., Dale, A.M., McEvoy, L.K., Brewer, J., Karow, D.S., Salmon, D.P., Fennema-Notestine, C.: Multi-modal imaging predicts memory performance in normal aging and cognitive decline. Neurobiol. Aging 31, 1107–1121 (2010)
Hinrichs, C., Singh, V., Xu, G., Johnson, S.: MKL for robust multi-modality AD classification. Med. Image Comput. Comput. Assist. Interv. 12, 786–794 (2009)
Ye, J., Chen, K., Wu, T., Li, J., Zhao, Z., Patel, R., Bae, M., Janardan, R., Liu, H., Alexander, G., Reiman, E.M.: Heterogeneous data fusion for Alzheimer’s disease study. In: ACM International Conference on Knowledge Discovery and Data Mining (2008)
Duchesne, S., Caroli, A., Geroldi, C., Frisoni, G.B., Collins, D.L.: Predicting clinical variable from MRI features: Application to MMSE in MCI. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 392–399. Springer, Heidelberg (2005)
Wang, Y., Fan, Y., Bhatt, P., Davatzikos, C.: High-dimensional pattern regression using machine learning: from medical images to continuous variables. NeuroImage 50, 1519–1535 (2010)
Stonnington, C.M., Chu, C., Kloppel, S., Jack Jr., C.R., Ashburner, J., Frackowiak, R.S.J.: Predicting clinical scores from magnetic resonance scans in Alzheimer’s disease. NeuroImage 51, 1405–1413 (2010)
Fan, Y., Kaufer, D., Shen, D.: Joint estimation of multiple clinical variables of neurological diseases from imaging patterns. In: The 2010 IEEE International Conference on Biomedical Imaging: from Nano to Macro, pp. 852–855 (2010)
Obozinski, G., Taskar, B., Jordan, M.I.: Multi-task feature selection. Technical report, Statistics Department, UC Berkeley (2006)
Liu, J., Ji, S., Ye, J.: Multi-task feature learning via efficient l2,1-norm minimization. In: Uncertainty in Artificial Intelligence (2009)
Yang, X., Kim, S., Xing, E.P.: Heterogeneous multitask learning with joint sparsity constraints. In: Advances in Neural Information Processing Systems (2009)
Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
Tibshirani, R.: Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B 58, 267–288 (1996)
Liu, J., Ji, S., Ye, J.: SLEP: Sparse Learning with Efficient Projections. Technical report, Arizona State University (2009)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, D., Shen, D. (2011). Multi-Modal Multi-Task Learning for Joint Prediction of Clinical Scores in Alzheimer’s Disease. In: Liu, T., Shen, D., Ibanez, L., Tao, X. (eds) Multimodal Brain Image Analysis. MBIA 2011. Lecture Notes in Computer Science, vol 7012. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24446-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-24446-9_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24445-2
Online ISBN: 978-3-642-24446-9
eBook Packages: Computer ScienceComputer Science (R0)