Common Subspace Based Low-Rank and Joint Sparse Representation for Multi-view Face Recognition

  • Ziqiang Wang
  • Yingzhi Ouyang
  • Weidan Zhu
  • Bin SunEmail author
  • Qiang Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11903)


Multi-view face data are very common in real-world application, since different viewpoints and various types of sensors attempt to better represent face data. However, these data have large pose variation, which dramatically degrades the performance of multi-view face recognition. To address this, we propose a common subspace based low-rank and joint sparse representation (CSLRJSR) method, which provides a framework encompassing divergence mitigation and feature fusion. In CSLRJSR method, common subspace is learnt to bridge the view, then low-rank and joint sparse representation are exploited to learn and then fuse the discriminative features. Experiments on multi-view face dataset demonstrate that CSLRJSR outperforms the state-of-the-art methods both in two-view and multi-view situations.


Multi-view face recognition Common subspace Low-rank representation Joint sparse 



The work was supported by National Natural Science Foundation of China (No. 61803075). We thank the anonymous reviewers for their comments and suggestions which make the paper much improved.


  1. 1.
    Yuan, X., Liu, X., Yan, S.: Visual classification with multitask joint sparse representation. IEEE Trans. Image Process. 21(10), 4349–4360 (2012)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Cao, L., Luo, J., Liang F., Huang, T.: Heterogeneous feature machines for visual recognition. In: IEEE International Conference on Computer Vision (2009)Google Scholar
  3. 3.
    Wright, J., Yang, A., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)CrossRefGoogle Scholar
  4. 4.
    Jiang, X., Lai, J.: Sparse and dense hybrid representation via dictionary decomposition for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(5), 1067–1079 (2015)CrossRefGoogle Scholar
  5. 5.
    Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: 2008 Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)Google Scholar
  6. 6.
    Wang, S., Zhang, L., Liang, Y., Pan, Q.: Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2216–2223 (2012)Google Scholar
  7. 7.
    Huang D., Wang, Y.: Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: IEEE International Conference on Computer Vision, pp. 2496–2503 (2013)Google Scholar
  8. 8.
    Mandal, D., Biswas, S.: Generalized coupled dictionary learning approach with applications to cross-modal matching. IEEE Trans. Image Process. 25(8), 3826–3837 (2016)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Ouyang, S., Hospedales, T., Song, Y., et al.: A survey on heterogeneous face recognition: sketch, infra-red, 3D and low-resolution. Image Vis. Comput. 56, 28–48 (2016)CrossRefGoogle Scholar
  10. 10.
    Turk, M., Pentland, A.: Eigenfaces for recognition. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRefGoogle Scholar
  11. 11.
    Li, S., Fu, Y.: Learning robust and discriminative subspace with low-rank constraints. IEEE Trans. Neural Netw. Learn. Syst. 27(11), 2160–2173 (2016)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Ding, Z., Fu, Y.: Low-rank common subspace for multi-view learning. In: Proceedings of the IEEE International Conference on Data Mining, pp. 110–119 (2014)Google Scholar
  13. 13.
    Ding, Z., Fu, Y.: Robust multiview data analysis through collective low-rank subspace. IEEE Trans. Neural Netw. Learn. Syst. 29(5), 1986–1997 (2018)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Li, J., Kong, Y., Zhao, H., Yang, J., Fu, Y.: Learning fast low-rank projection for image classification. IEEE Trans. Image Process. 25(10), 4803–4814 (2016)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Li, L., Li, S., Fu, Y.: Learning low-rank and discriminative dictionary for image classification. Image Vis. Comput. 32(10), 814–823 (2014)CrossRefGoogle Scholar
  16. 16.
    Zhang, H., Patel, V., Chellappa, R.: Robust multimodal recognition via multitask multivariate low-rank representations. In: 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp. 1–8 (2015)Google Scholar
  17. 17.
    Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 171–184 (2013)CrossRefGoogle Scholar
  18. 18.
    Shekhar, S., Patel, V., Nasrabadi, N., Chellappa, R.: Joint sparse representation for robust multimodal biometrics recognition. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 113–126 (2014)CrossRefGoogle Scholar
  19. 19.
    Kan, M., Shan, S., Zhang, H., Lao, S., Chen, X.: Multi-view discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 188–194 (2016)CrossRefGoogle Scholar
  20. 20.
    Li, S., Fu, Y.: Robust subspace discovery through supervised low-rank constraints. In: Proceedings of SIAM International Conference on Data Mining, pp. 163–171 (2014)Google Scholar
  21. 21.
    Yang, J., Zhang, Y.: Alternating direction algorithms for l1 problems in compressive sensing. SIAM J. Sci. Comput. 33(1), 250–278 (2011)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Afonso, M., Bioucas-Dias, J., Figueiredo, M.: An augmented lagrangian approach to the constrained optimization formulation of imaging inverse problems. IEEE Trans. Image Process. 20(3), 681–695 (2011)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Cai, J., Candès, E., Shen, Z.: A singular value Thresholding algorithm for matrix completion. SIAM J. Optimiz. 20(4), 1956–1982 (2010)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Schölkopf, B., Platt, J., Hofmann, T.: Efficient sparse coding algorithms. In: Advances in Neural Information Processing Systems, pp. 801–808 (2007)Google Scholar
  25. 25.
    Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (PIE) database of human faces. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp. 53–58 (2002)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ziqiang Wang
    • 1
    • 2
  • Yingzhi Ouyang
    • 1
    • 2
  • Weidan Zhu
    • 1
    • 2
  • Bin Sun
    • 1
    • 2
    Email author
  • Qiang Liu
    • 1
    • 2
  1. 1.School of Aeronautics and AstronauticsUniversity of Electronic Science and Technology of ChinaChengduChina
  2. 2.Aircraft Swarm Intelligent Sensing and Cooperative Control Key Laboratory of Sichuan ProvinceChengduChina

Personalised recommendations