World Wide Web

, Volume 22, Issue 2, pp 907–925 | Cite as

Low-rank dimensionality reduction for multi-modality neurodegenerative disease identification

  • Xiaofeng Zhu
  • Heung-Il Suk
  • Dinggang ShenEmail author
Part of the following topical collections:
  1. Special Issue on Deep vs. Shallow: Learning for Emerging Web-scale Data Computing and Applications


In this paper, we propose a novel dimensionality reduction method of taking the advantages of the variability, sparsity, and low-rankness of neuroimaging data for Alzheimer’s Disease (AD) classification. We first take the variability of neuroimaging data into account by partitioning them into sub-classes by means of clustering, which thus captures the underlying multi-peak distributional characteristics in neuroimaging data. We then iteratively conduct Low-Rank Dimensionality Reduction (LRDR) and orthogonal rotation in a sparse linear regression framework, in order to find the low-dimensional structure of high-dimensional data. Experimental results on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset showed that our proposed model helped enhance the performances of AD classification, outperforming the state-of-the-art methods.


Alzheimer’s Disease (AD) Feature selection Subspace learning 



This work was supported in part by NIH grants (EB008374, AG041721, AG049371, AG042599, EB022880). X. Zhu was also supported by the National Natural Science Foundation of China (Grants No: 61573270 and 61876046); the Project of Guangxi Science and Technology (GuiKeAD17195062); the Guangxi Collaborative Innovation Center of Multi-Source Information Integration and Intelligent Processing; Strategic Research Excellence Fund at Massey University; and Marsden Fund of New Zealand (grant No: MAU1721). H.I. Suk was also supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (No. 2017-0-00451).


  1. 1.
    Chételat, G., Eustache, F., Viader, F., De La Sayette, V., Pélerin, A., Mézenge, F., Hannequin, D., Dupuy, B., Baron, J.-C., Desgranges, B.: FDG-PET measurement is more accurate than neuropsychological assessments to predict global cognitive deterioration in patients with mild cognitive impairment. Neurocase 11(1), 14–25 (2005)CrossRefGoogle Scholar
  2. 2.
    Chu, C., Hsu, A.-L., Chou, K.-H., Bandettini, P., Lin, C.: Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images. Neuroimage 60(1), 59–70 (2012)CrossRefGoogle Scholar
  3. 3.
    Deng, X., Li, Y., Weng, J., Zhang, J.: Feature selection for text classification: A review. Multimedia Tools and Applications, 1–20 (2018)Google Scholar
  4. 4.
    Fox, N.C., Schott, J.M.: Imaging cerebral atrophy: normal ageing to Alzheimer’s disease. Lancet 363(9406), 392–394 (2004)CrossRefGoogle Scholar
  5. 5.
    Gao, L., Guo, Z., Zhang, H., Xu, X., Shen, H.T.: Video captioning with attention-based LSTM and semantic consistency. IEEE Trans. Multimed. 19(9), 2045–2055 (2017)CrossRefGoogle Scholar
  6. 6.
    Gower, J.C., Dijksterhuis, G.B.: Procrustes problems, vol. 3 (2004)Google Scholar
  7. 7.
    Hu, R., Zhu, X., Cheng, D., He, W., Yan, Y., Song, J., Zhang, S.: Graph self-representation method for unsupervised feature selection. Neurocomputing 220, 130–137 (2017)CrossRefGoogle Scholar
  8. 8.
    Izenman, A.J.: Reduced-rank regression for the multivariate linear model. J. Multivar. Anal. 5(2), 248–264 (1975)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Johnson, S.C.: Hierarchical clustering schemes. Psychometrika 32(3), 241–254 (1967)CrossRefzbMATHGoogle Scholar
  10. 10.
    Jorgensen, M.: Iteratively reweighted least squares. Encyclopedia of Environmetrics (2006)Google Scholar
  11. 11.
    Kabani, N.J.: 3D anatomical atlas of the human brain. In: Human Brain Mapping Conference (1998)Google Scholar
  12. 12.
    Lahmiri, S.: Image characterization by fractal descriptors in variational mode decomposition domain: application to brain magnetic resonance. Physica A: Stat. Mech. Appl. 456, 235–243 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Lahmiri, S., Boukadoum, M.: New approach for automatic classification of Alzheimer’s disease, mild cognitive impairment and healthy brain magnetic resonance images. Healthcare Technol. Lett. 1(1), 32–36 (2014)CrossRefGoogle Scholar
  14. 14.
    Lei, C., Zhu, X.: Unsupervised feature selection via local structure learning and sparse learning., p. 11 (2017)
  15. 15.
    Liu, F., Wee, C.-Y., Chen, H., Shen, D.: Inter-modality relationship constrained multi-modality multi-task feature selection for alzheimer’s disease and mild cognitive impairment identification. Neuroimage 84, 466–475 (2014)CrossRefGoogle Scholar
  16. 16.
    Lu, C., Lin, Z., Yan, S.: Smoothed low rank and sparse matrix recovery by iteratively reweighted least squares minimization. IEEE Trans. Image Process. 24(2), 646–654 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Ma, Z., Sun, T.: Adaptive sparse reduced-rank regression. arXiv:1403.1922 (2014)
  18. 18.
    Misra, C., Fan, Y., Davatzikos, C.: Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: results from ADNI. Neuroimage 44(4), 1415–1422 (2009)CrossRefGoogle Scholar
  19. 19.
    Moradi, E., Pepe, A., Gaser, C., Huttunen, H., Tohka, J., Alzheimer’s Disease Neuroimaging Initiative, et al.: Machine learning framework for early MRI-based Alzheimer’s conversion prediction in MCI subjects. Neuroimage 104, 398–412 (2015)CrossRefGoogle Scholar
  20. 20.
    Noppeney, U., Penny, W.D., Price, C.J., Flandin, G., Friston, K.J.: Identification of degenerate neuronal systems based on intersubject variability. Neuroimage 30(3), 885–890 (2006)CrossRefGoogle Scholar
  21. 21.
    Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  22. 22.
    Rocchi, L., Chiari, L., Cappello, A., Horak, F.B: Identification of distinct characteristics of postural sway in parkinson’s disease: a feature selection procedure based on principal component analysis. Neurosci. Lett. 394(2), 140–145 (2006)CrossRefGoogle Scholar
  23. 23.
    Sato, J.R., Hoexter, M.Q., Fujita, A., Rohde, L.A.: Evaluation of pattern recognition and feature extraction methods in ADHD prediction. Frontiers in Systems Neuroscience, 6 (2012)Google Scholar
  24. 24.
    Shen, D., Davatzikos, C.: HAMMER: hierarchical attribute matching mechanism for elastic registration, vol. 21 (2002)Google Scholar
  25. 25.
    Song, J., Guo, Y., Gao, L., Li, X., Hanjalic, A., Shen, H.T.: From deterministic to generative: Multi-modal stochastic rnns for video captioning. IEEE Transactions on Neural Networks and Learning Systems. (2017)
  26. 26.
    Song, J., Zhang, H., Li, X., Gao, L., Wang, M., Hong, R.: Self-supervised video hashing with hierarchical binary auto-encoder. IEEE Trans. Image Process. 27 (7), 3210–3221 (2018)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    Sui, J., Adali, T., Yu, Q., Chen, J., Calhoun, V.D.: A review of multivariate methods for multimodal fusion of brain imaging data. J. Neurosci. Methods 204(1), 68–81 (2012)CrossRefGoogle Scholar
  28. 28.
    Velu, R., Reinsel, G.C.: Multivariate reduced-rank regression: theory and applications, vol. 136 (2013)Google Scholar
  29. 29.
    Wang, H., Nie, F., Huang, H., Risacher, S., Saykin, A.J., Li, S.: Identifying AD-sensitive and cognition-relevant imaging biomarkers via joint classification and regression. In: MICCAI, pp. 115–123 (2011)Google Scholar
  30. 30.
    Wang, X., Gao, L., Wang, P., Sun, X., Liu, X.: Two-stream 3-d convnet fusion for action recognition in videos with arbitrary size and length. IEEE Trans. Multimed. 20(3), 634–644 (2018)CrossRefGoogle Scholar
  31. 31.
    Yang, M., Zheng, H., Wang, H., McClean, S.: Feature selection and construction for the discrimination of neurodegenerative diseases based on gait analysis. In: PCTH, pp. 1–7 (2009)Google Scholar
  32. 32.
    Yang, Y., Zhou, J., Ai, J., Yi, B., Hanjalic, A., Shen, H.T.: Video captioning by adversarial lstm. IEEE Transactions on Image Processing. (2018)
  33. 33.
    Yi, B., Yang, Y., Shen, F., Xie, N., Shen, H.T., Li, X.: Describing video with attention based bidirectional lstm. IEEE Transactions on Cybernetics. (2018)
  34. 34.
    Zhang, D., Shen, D.: Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer’s disease. Neuroimage 59 (2), 895–907 (2012)MathSciNetCrossRefGoogle Scholar
  35. 35.
    Zhang, Y., Brady, M., Smith, S.: Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 20(1), 45–57 (2001)CrossRefGoogle Scholar
  36. 36.
    Zhang, S., Li, X., Zong, M., Zhu, X., Wang, R.: Efficient knn classification with different numbers of nearest neighbors. IEEE Trans. Neural Netw. Learn. Syst. 29 (5), 1774–1785 (2018)MathSciNetCrossRefGoogle Scholar
  37. 37.
    Zheng, W., Zhu, X., Zhu, Y., Hu, R., Lei, C.: Dynamic graph learning for spectral feature selection. Multimedia Tools and Applications. (2017)
  38. 38.
    Zheng, W., Zhu, X., Wen, G., Zhu, Y., Yu, H., Gan, J.: Unsupervised feature selection by self-paced learning regularization. Pattern Recognition Letters, (2018)
  39. 39.
    Zhu, M., Martinez, A.M: Subclass discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 28(8), 1274–1286 (2006)CrossRefGoogle Scholar
  40. 40.
    Zhu, X., Suk, H.-I., Shen, D.: A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis. Neuroimage 14(0), 1–30 (2014)CrossRefGoogle Scholar
  41. 41.
    Zhu, X., Zhang, L., Zi, H.: A sparse embedding and least variance encoding approach to hashing. IEEE Trans. Image Process. 23(9), 3737–3750 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  42. 42.
    Zhu, X., Li, X., Zhang, S.: Block-row sparse multiview multilabel learning for image classification. IEEE Trans. Cybern. 46(2), 450–461 (2016)CrossRefGoogle Scholar
  43. 43.
    Zhu, X., Suk, H.-I., Lee, S.-W., Shen, D.: Subspace regularized sparse multitask learning for multiclass neurodegenerative disease identification. IEEE Trans. Biomed. Eng. 63(3), 607–618 (2016)CrossRefGoogle Scholar
  44. 44.
    Zhu, X., Li, X., Zhang, S., Ju, C., Wu, X.: Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans. Neural Netw. Learn. Syst. 28 (6), 1263–1275 (2017)MathSciNetCrossRefGoogle Scholar
  45. 45.
    Zhu, X., Li, X., Zhang, S., Xu, Z., Yu, L., Wang, C.: Graph pca hashing for similarity search. IEEE Trans. Multimed. 19(9), 2033–2044 (2017)CrossRefGoogle Scholar
  46. 46.
    Zhu, X., Suk, H.-I., Huang, H., Shen, D.: Low-rank graph-regularized structured sparse regression for identifying genetic biomarkers. IEEE Trans. Big Data 3(4), 405–414 (2017)CrossRefGoogle Scholar
  47. 47.
    Zhu, X., Suk, H.-I., Wang, L., Lee, S.-W., Shen, D.: A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med. Image Anal. 38, 205–214 (2017)CrossRefGoogle Scholar
  48. 48.
    Zhu, X., Zhang, S., He, W., Hu, R., Lei, C., Zhu, P.: One-step multi-view spectral clustering. IEEE Transactions on Knowledge and Data Engineering, (2018)
  49. 49.
    Zhu, X., Zhang, S., Hu, R., Zhu, Y., et al.: Local and global structure preservation for robust unsupervised spectral feature selection. IEEE Trans. Knowl. Data Eng. 30(3), 517–529 (2018)CrossRefGoogle Scholar
  50. 50.
    Zhu, X., Zhang, S., Li, Y., Zhang, J., Yang, L., Fang, Y.: Low-rank sparse subspace for spectral clustering. IEEE Transactions on Knowledge and Data Engineering, (2018)

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Guangxi Key Lab of Multi-source Information Mining and SecurityGuangxi Normal UniversityGuilinPeople’s Republic of China
  2. 2.Institute of Natural and Mathematical SciencesMassey UniversityAucklandNew Zealand
  3. 3.Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillUSA
  4. 4.Department of Brain and Cognitive EngineeringKorea UniversitySeoulKorea

Personalised recommendations