Multi-Modal Multi-Task Learning for Joint Prediction of Clinical Scores in Alzheimer’s Disease
One recent interest in computer-aided diagnosis of neurological diseases is to predict the clinical scores from brain images. Most existing methods usually estimate multiple clinical variables separately, without considering the useful correlation information among them. On the other hand, nearly all methods use only one modality of data (mostly structural MRI) for regression, and thus ignore the complementary information among different modalities. To address these issues, in this paper, we present a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Our method contains three major subsequent steps: (1) a multi-task feature selection which selects the common subset of relevant features for the related multiple clinical variables from each modality; (2) a kernel-based multimodal data fusion which fuses the above-selected features from all modalities; (3) a support vector regression which predicts multiple clinical variables based on the previously learnt mixed kernel. Experimental results on ADNI dataset with both imaging modalities (MRI and PET) and biological modality (CSF) validate the efficacy of the proposed M3T learning method.
KeywordsFeature Selection Mild Cognitive Impairment Mini Mental State Examination Support Vector Regression Clinical Score
Unable to display preview. Download preview PDF.
- 4.Hinrichs, C., Singh, V., Xu, G., Johnson, S.: MKL for robust multi-modality AD classification. Med. Image Comput. Comput. Assist. Interv. 12, 786–794 (2009)Google Scholar
- 5.Ye, J., Chen, K., Wu, T., Li, J., Zhao, Z., Patel, R., Bae, M., Janardan, R., Liu, H., Alexander, G., Reiman, E.M.: Heterogeneous data fusion for Alzheimer’s disease study. In: ACM International Conference on Knowledge Discovery and Data Mining (2008)Google Scholar
- 9.Fan, Y., Kaufer, D., Shen, D.: Joint estimation of multiple clinical variables of neurological diseases from imaging patterns. In: The 2010 IEEE International Conference on Biomedical Imaging: from Nano to Macro, pp. 852–855 (2010)Google Scholar
- 10.Obozinski, G., Taskar, B., Jordan, M.I.: Multi-task feature selection. Technical report, Statistics Department, UC Berkeley (2006)Google Scholar
- 11.Liu, J., Ji, S., Ye, J.: Multi-task feature learning via efficient l2,1-norm minimization. In: Uncertainty in Artificial Intelligence (2009)Google Scholar
- 12.Yang, X., Kim, S., Xing, E.P.: Heterogeneous multitask learning with joint sparsity constraints. In: Advances in Neural Information Processing Systems (2009) Google Scholar
- 15.Liu, J., Ji, S., Ye, J.: SLEP: Sparse Learning with Efficient Projections. Technical report, Arizona State University (2009)Google Scholar
- 16.Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001)Google Scholar