Multi-view Discriminant Analysis

  • Meina Kan
  • Shiguang Shan
  • Haihong Zhang
  • Shihong Lao
  • Xilin Chen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7572)


The same object can be observed at different viewpoints or even by different sensors, thus generating multiple distinct even heterogeneous samples. Nowadays, more and more applications need to recognize object from distinct views. Some seminal works have been proposed for object recognition across two views and applied to multiple views in some inefficient pairwise manner. In this paper, we propose a Multi-view Discriminant Analysis (MvDA) method, which seeks for a discriminant common space by jointly learning multiple view-specific linear transforms for robust object recognition from multiple views, in a non-pairwise manner. Specifically, our MvDA is formulated to jointly solve the multiple linear transforms by optimizing a generalized Rayleigh quotient, i.e., maximizing the between-class variations and minimizing the within-class variations of the low-dimensional embeddings from both intra-view and inter-view in the common space. By reformulating this problem as a ratio trace problem, an analytical solution can be achieved by using the generalized eigenvalue decomposition. The proposed method is applied to three multi-view face recognition problems: face recognition across poses, photo-sketch face recognition, and Visual (VIS) image vs. Near Infrared (NIR) image face recognition. Evaluations are conducted respectively on Multi-PIE, CUFSF and HFB databases. Intensive experiments show that MvDA can achieve a more discriminant common space, with up to 13% improvement compared with the best known results.


Multi-view Discriminant Analysis Multi-view Face Recognition Common space for Multi-view 


  1. 1.
    Gross, R., Matthews, I., Cohn, J., kanada, T., Baker, S.: The cmu multi-pose, illumination, and expression (multi-pie) face database. Technical report, Carnegie Mellon University Robotics Institute. TR-07-08 (2007)Google Scholar
  2. 2.
    Li, S.Z., Lei, Z., Ao, M.: The hfb face database for heterogeneous face biometrics research. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1–8 (2009)Google Scholar
  3. 3.
    Hotelling, H.: Relations between two sets of variates. Biometrika 28, 321–377 (1936)zbMATHGoogle Scholar
  4. 4.
    Akaho, S.: A kernel method for canonical correlation analysis (2006)Google Scholar
  5. 5.
    Tang, X., Wang, X.: Face sketch recognition. IEEE Transactions on Circuits and Systems for Video Technology 14, 50–57 (2004)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Tang, X., Jin, H., Lu, H., Ma, S.: A nonlinear approach for face sketch synthesis and recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1005–1010 (2005)Google Scholar
  7. 7.
    Sharma, A., Jacobs, D.W.: Bypassing synthesis: Pls for face recognition with pose, low-resolution and sketch. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 593–600 (2011)Google Scholar
  8. 8.
    Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 513–520 (2011)Google Scholar
  9. 9.
    Wang, S., Zhang, L., Liang, Y., Pan, Q.: Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch image synthesis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2012)Google Scholar
  10. 10.
    Ma, Y., Lao, S., Takikawa, E., Kawade, M.: Discriminant analysis in correlation similarity measure space. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 577–584 (2007)Google Scholar
  11. 11.
    Sun, T., Chen, S., Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: IEEE Intl. Conf. on Data Mining (ICDM), pp. 1043–1048 (2008)Google Scholar
  12. 12.
    Kim, T.-K., Kittler, J., Cipolla, R.: Learning Discriminative Canonical Correlations for Object Recognition with Image Sets. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 251–262. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  13. 13.
    Diethe, T., Hardoon, D.R., Shawe-Taylor, J.: Multiview fisher discriminant analysis. In: NIPS Workshop on Learning from Multiple Sources (2008)Google Scholar
  14. 14.
    Diethe, T., Hardoon, D.R., Shawe-Taylor, J.: Constructing Nonlinear Discriminants from Multiple Data Views. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds.) ECML PKDD 2010, Part I. LNCS, vol. 6321, pp. 328–343. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  15. 15.
    Lin, D., Tang, X.: Inter-modality Face Recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 13–26. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  16. 16.
    Chen, N., Zhu, J., Xing, E.P.: Predictive subspace learning for multi-view data: A large margin approach. In: Advances in Neural Information Processing Systems (NIPS), vol. 23 (2010)Google Scholar
  17. 17.
    Lei, Z., Li, S.Z.: Coupled spectral regression for matching heterogeneous faces. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1123–1128 (2009)Google Scholar
  18. 18.
    Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. on Pattern Analysis And Machine Intelligence 33, 39–646 (2011)CrossRefGoogle Scholar
  19. 19.
    Rupnik, J., Shawe-Taylor, J.: Multi-view canonical correlation analysis. In: SiKDD (2010)Google Scholar
  20. 20.
    Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 19, 711–720 (1997)CrossRefGoogle Scholar
  21. 21.
    Horst, P.: Relations among m sets of measures. Journal of Foo 26, 129–149 (1961)MathSciNetzbMATHGoogle Scholar
  22. 22.
    Wang, H., Yan, S., Xu, D., Tang, X., Huang, T.: Trace ratio vs. ratio trace for dimensionality reduction. In: IEEE Conf. on Computer Vision and Pattern Recognition, CVPR (2007)Google Scholar
  23. 23.
    A. Sharma, A. Kumar, H. Daume III, D.W. Jacobs: Generalized multiview analysis: A discriminative latent space. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2012)Google Scholar
  24. 24.
    Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Transactions on Pattern Analysis And Machine Intelligence (TPAMI) 31, 1955–1967 (2009)CrossRefGoogle Scholar
  25. 25.
    Phillips, P., Wechslerb, H., Huangb, J., Rauss, P.J.: The feret database and evaluation procedure for face-recognition algorithms. Image and Vision Computing 16, 295–306 (1998)CrossRefGoogle Scholar
  26. 26.
    Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 591, pp. 586–591 (1991)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Meina Kan
    • 1
  • Shiguang Shan
    • 1
  • Haihong Zhang
    • 2
  • Shihong Lao
    • 2
  • Xilin Chen
    • 1
  1. 1.Institute of Computing Technology, CASKey Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS)BeijingChina
  2. 2.Omron Social Solutions Co., LTD.KyotoJapan

Personalised recommendations