Abstract
Multi-view dimensionality reduction is an importan subject in multi-view learning. Canonical correlation analysis and its various improved forms can effectively solve this problem. But most of these algorithms do not fully consider the discriminant information and view consistency information contained in the data itself simultaneously. To solve this problem, a new multi-view dimensionality reduction algorithm, consistent discriminant correlation analysis, is proposed in this paper. The algorithm integrates the class information and the consistency information between views into the dimension reduction process. By maximizing the within-class correlations and the consistency between views, and minimizing the between-class correlations simultaneously, it extracts the low-dimensional features that are more efficient to classification. Furthermore, a kernel consistent discriminant correlation analysis is proposed. The experimental results on several data sets demonstrate the effectiveness of the proposed methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Rping S, Scheffer T (2005) Learning with multiple views. Proc Icml Workshop Learn Mult Views 27(1):203–233
Hotelling H (1936) Relations between two sets of variates. Biometrika 28(3/4):321–377
Zheng W, Zhou X, Zou C et al (2006) Facial expression recognition using kernel canonical correlation analysis (KCCA). IEEE Trans Neural Netw 17(1):233–238
Zhao C, Chen Y, Wei Z et al (2019) A two-stage metric learning via QR-decomposition and KISS for person re-identification. Neural Process Lett 49(3):899–922
Zhou X, Chen X, Chen S (2013) Neighborhood correlation analysis for semi-paired two-view data. Neural Process Lett 37(3):335–354
Nielsen AA (2002) Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data. IEEE Trans Image Process 11(3):293–305
Dong X, Wu F, Jing X (2018) Multi-view Intact discriminant space learning for image classification. Neural Process Lett 50(2):1661–1685
Vlassis N, Motomura Y, Krose B (2000) Supervised linear feature extraction for mobile robot localization. In: IEEE international conference on robotics and automation, pp 2979–2984
Horikawa Y (2004) Use of Autocorrelation Kernels in Kernel Canonical Correlation Analysis for Texture Classification. Neural Information Processing. Springer, Berlin, pp 1235–1240
Tan H, Zhang X, Lan L et al (2018) Nonnegative constrained graph based canonical correlation analysis for multi-view feature learning. Neural Process Lett. https://doi.org/10.1007/s11063-018-9904-7
Melzer T, Reiter M, Bischof H (2001) Kernel canonical correlation analysis. J Financ Econ Policy 6(2):179–196
Sun T, Chen S, Yang J, et al (2008) A novel method of combined feature extraction for recognition. 8th IEEE international conference on data mining. IEEE computer society, pp 1043–1048
Peng Y, Zhang D, Zhang J (2010) A new canonical correlation analysis algorithm with local discrimination. Neural Process Lett 31(1):1–15
Kan M, Shan S, Zhang H et al (2012) Multi-view discriminant analysis. European conference on computer vision, pp 808–821
You X, Xu J, Yuan W, et al (2018) Multi-view Common Component Discriminant Analysis for Cross-view Classification. arXiv preprint arXiv:1805.05029
Andrew G, Arora R, Bilmes J et al (2013) Deep canonical correlation analysis. International conference on machine learning, pp 1247–1255
Gui J, Tao D, Sun Z et al (2014) Group sparse multiview patch alignment framework with view consistency for image classification. IEEE Trans Image Process 23(7):3126–3137
Shao W , Zhang J , He L , et al (2016) Multi-source multi-view clustering via discrepancy penalty. International joint conference on neural networks. IEEE
Kan M, Shan S, Zhang H et al (2016) Multi-view discriminant analysis. IEEE Trans Pattern Anal Mach Intell 38(1):188–194
Sun Q, Zeng S, Liu Y et al (2005) A new method of feature fusion and its application in image reconition. Pattern Recogn 38(12):2437–2448
Chen X, Yin H, Jiang F et al (2018) Multi-view dimensionality reduction based on universum learning. Neurocomputing 275:2279–2286
Zhang Z, Zhao M, Chow TWS (2012) Binary-and multi-class group sparse canonical correlation analysis for feature extraction and classification. IEEE Trans Knowl Data Eng 25(10):2192–2205
Luo Y, Tao D, Ramamohanarao K et al (2015) Tensor canonical correlation analysis for multi-view dimension reduction. IEEE Trans Knowl Data Eng 27(11):3111–3124
Acknowledgements
The authors would like to thank the anonymous referees for their helpful comments and suggestions to improve the presentation of this paper. This paper was partially supported by the Chinese NUAA funding, project no. NG2019004; NSFC funding, project no.61703206; National Key Research and Development Program of China (2018YFB2003300).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, E., Chen, X. & Wang, L. Consistent Discriminant Correlation Analysis. Neural Process Lett 52, 891–904 (2020). https://doi.org/10.1007/s11063-020-10285-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-020-10285-w