Skip to main content
Log in

A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction

Neural Processing Letters Aims and scope Submit manuscript

Abstract

Canonical correlation analysis (CCA) is a well-known technique for extracting linearly correlated features from multiple views (i.e., sets of features) of data. Recently, a locality-preserving CCA, named LPCCA, has been developed to incorporate the neighborhood information into CCA. Although LPCCA is proved to be better in revealing the intrinsic data structure than CCA, its discriminative power for subsequent classification is low on high-dimensional data sets such as face databases. In this paper, we propose an alternative formulation for integrating the neighborhood information into CCA and derive a new locality-preserving CCA algorithm called ALPCCA, which can better discover the local manifold structure of data and further enhance the discriminative power for high-dimensional classification. The experimental results on both synthetic and real-world data sets including multiple feature data set and face databases validate the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Long B, Yu PS, Zhang ZM (2008) A general model for multiple view unsupervised learning. In: Proceedings of the 2005 SIAM international conference on data mining (SDM). SIAM, Newport Beach, p 822–833

  2. Zhang D, Wang F, Zhang C, Li (2008) T Multi-view local learning. In: Proceedings of the 23rd AAAI conference on artificial intelligence (AAAI). AAAI, Chicago, p 752–757

  3. Brefeld U, Büscher C, Scheffer T (2005) Multi-view discriminative sequential learning. In: Proceedings of the 2005 European conference on machine learning (ECML). Springer, Berlin, p 60–71

  4. Sindhwani V, Rosenberg DS (2008) An rkhs for multi-view learning and manifold co-regularization. In: Proceedings of the 25th international conference on machine learning (ICML). ACM, Edinburgh, p 976–983

  5. Huopaniemi I, Suvitaival T, Nikkilä J, Orešič M, Kaski S (2009) Multi-way, multi-view learning. In: NIPS workshop on learning from multiple sources with applications to robotics. NIPS, Whistler

  6. Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview Fisher discriminant analysis. In: NIPS workshop on learning from multiple sources. NIPS, Whistler

  7. Hotelling H (1936) Relation between two sets of variables. Biometrica 28: 322–377

    Google Scholar 

  8. Jolliffe IT (2002) Principal component analysis, 2nd edn. Springer, New York

    MATH  Google Scholar 

  9. Nielsen AA (2002) Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data. IEEE Trans Image Process 11(3): 293–305

    Article  Google Scholar 

  10. Theodoridis S, Koutroumbas K (2006) Pattern recognition, 3rd edn. Academic Press, Orlando

    MATH  Google Scholar 

  11. Sun Q-S, Zeng S-G, Liu Y, Heng P-A, Xia D-S (2005) A new method of feature fusion and its application in image recognition. Pattern Recognit 38(12): 2437–2448

    Article  Google Scholar 

  12. Hel-Or Y (2004) The canonical correlations of color images and their use for demosaicing. Technical report. HP Laboratories, Israel

    Google Scholar 

  13. Hardoon DR, Szedmák S, Shawe-Taylor J (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12): 2639–2664

    Article  MATH  Google Scholar 

  14. Abraham B, Merola G (2005) Dimensionality reduction approach to multivariate prediction. Comput Stat Data Anal 48(1): 5–16

    Article  MathSciNet  MATH  Google Scholar 

  15. Hsieh WW (2000) Nonlinear canonical correlation analysis by neural networks. Neural Netw 13(10): 1095–1105

    Article  Google Scholar 

  16. Yamada M, Azimi-Sadjadi MR (2005) Nonlinear signal estimation using kernel wiener filter in canonical correlation analysis framework. In: Proceedings of the international conference on computational intelligence for modelling, control and automation. IEEE, Vienna, p 1095–1101

  17. Fukumizu K, Bach F, Gretton A (2007) Consistency of kernel canonical correlation analysis. J Mach Learn Res 8: 361–383

    MathSciNet  MATH  Google Scholar 

  18. Emdad F, Kirby M, Zekavat SA (2008) Feature extraction via kernelized signal fraction analysis vs kernelized principal component analysis. In: Proceedings of the 2008 international conference on data mining (DMIN). CSREA Press, Pisa, p 180–184

  19. Wu W, He J, Zhang J (2008) A kernelized discriminant analysis algorithm based on modified generalized singular value decomposition. In: Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, Taipei, p 1353–1356

  20. Zhang D-Q, Chen S-C (2003) Clustering incomplete data using kernel-based fuzzy c-means algorithm. Neural Process Lett 18(3): 155–162

    Article  Google Scholar 

  21. Lai PL, Fyfe C (2000) Kernel and nonlinear canonical correlation analysis. In: Proceedings of the IEEE-INNS-ENNS international joint conference on neural networks (IJCNN), vol 4. IEEE, Como, p 614

  22. Fern XZ, Brodley CE, Friedl MA (2005) Correlation clustering for learning mixtures of canonical correlation models. In: Proceedings of the 2005 SIAM international conference on data mining (SDM). SIAM, Newport Beach, p 439–446

  23. Klami A, Kaski S (2007) Local dependent components. In: Proceedings of the 24th international conference on machine learning (ICML), ACM, Edinburgh, p 425–432

  24. Bach F, Jordan M (2006) A probalilistic interpretation of canonical correlation analysis. Technical report. Computer Science Division, University of California, Berkeley

    Google Scholar 

  25. Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290: 2510–2522

    Article  Google Scholar 

  26. He X, Niyogi P (2003) Locality preserving projections. In: Advances in neural information processing systems. MIT Press, Cambridge

  27. Sun T, Chen S (2007) Locality preserving CCA with applications to data visualization and pose estimation. Image Vision Comput 25(5): 531–543

    Article  MATH  Google Scholar 

  28. Hoegaerts L, Suykens JAK, Vandewalle J, Moor BD (2005) Subset based least squares subspace regression in RKHS. Neurocomputing 63: 293–323

    Article  Google Scholar 

  29. Melzer T, Reiter M, Bischof H (2003) Appearance models based on kernel canonical correlation analysis. Pattern Recognit 36(9): 1961–1971

    Article  MATH  Google Scholar 

  30. Zhang J, Zhang D (2011) A novel ensemble construction method for multi-view data using random cross-view correlation between within-class examples. Pattern Recognit 44(6): 1162–1171

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daoqiang Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, F., Zhang, D. A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction. Neural Process Lett 37, 135–146 (2013). https://doi.org/10.1007/s11063-012-9238-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-012-9238-9

Keywords

Navigation