Skip to main content

Latent Sparse Discriminative Learning for Face Image Set Classification

  • Conference paper
  • First Online:
Neural Computing for Advanced Applications (NCAA 2020)

Abstract

Image set classification has drawn much attention due to its promising performance to overcome various variations. Recently, the point-to-point distance-based methods have achieved the state-of-the-art performance by leveraging the distance between the gallery set and the probe set. However, there are two drawbacks that need to be defeated: 1) they do not fully exploit the discrimination that exists between different gallery sets; 2) they face the great challenge of high computational complexity as well as multi-parameters, usually caused by some obvious sparse constraints. To address these problems, this paper proposes a novel method, namely latent sparse discriminative learning (LSDL), for face image set classification. Specifically, a new term is proposed to exploit the relations between different gallery sets, which can boost the set discrimination so as to improve performance. Moreover, we use a latent sparse constraint to reduce the trade-off parameters and computational cost. Furthermore, an efficient solver is proposed to solve our LSDL. Experimental results on three benchmark datasets demonstrate the advantages of our propose.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cevikalp, H., Triggs, B.: Face recognition based on image sets. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2567–2573. IEEE (2010)

    Google Scholar 

  2. Cevikalp, H., Yavuz, H.S., Triggs, B.: Face recognition based on videos by using convex hulls. In: IEEE Trans. Circuits Syst. Video Technol. (2019)

    Google Scholar 

  3. Chen, L., Hassanpour, N.: Survey: how good are the current advances in imageset based face identification?–experiments on three popular benchmarks with a naïve approach. Comput. Vis. Image Underst. 160, 1–23 (2017)

    Google Scholar 

  4. Feng, Q., Zhou, Y., Lan, R.: Pairwise linear regression classification for image set retrieval. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4865–4872 (2016)

    Google Scholar 

  5. Gao, X., Sun, Q., Xu, H., Wei, D., Gao, J.: Multi-model fusion metric learning for image set classification. Knowl.-Based Syst. 164, 253–264 (2019)

    Article  Google Scholar 

  6. Hayat, M., Bennamoun, M., An, S.: Deep reconstruction models for image set classification. IEEE Trans. Pattern Anal. Mach. Intell. 37(4), 713–727 (2014)

    Article  Google Scholar 

  7. Hu, Y., Mian, A.S., Owens, R.: Face recognition using sparse approximated nearest points between image sets. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1992–2004 (2012)

    Article  Google Scholar 

  8. Huang, C., Li, Y., Chen, C.L., Tang, X.: Deep imbalanced learning for face recognition and attribute prediction. IEEE Trans. Pattern Anal. Mach. Intell. (2019)

    Google Scholar 

  9. Huang, Z., et al.: A benchmark and comparative study of video-based face recognition on cox face database. IEEE Trans. Image Process. 24(12), 5967–5981 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  10. Liu, B., Jing, L., Li, J., Yu, J., Gittens, A., Mahoney, M.W.: Group collaborative representation for image set classification. Int. J. Comput. Vis. 127(2), 181–206 (2019)

    Article  Google Scholar 

  11. Liu, X., Guo, Z., You, J., Kumar, B.V.: Dependency-aware attention control for image set-based face recognition. IEEE Trans. Inf. Forensics Secur. 15, 1501–1512 (2019)

    Article  Google Scholar 

  12. Mian, A., Hu, Y., Hartley, R., Owens, R.: Image set based face recognition using self-regularized non-negative coding and adaptive distance metric learning. IEEE Trans. Image Process. 22(12), 5252–5262 (2013)

    Article  Google Scholar 

  13. Moon, H.-M., Seo, C.H., Pan, S.B.: A face recognition system based on convolution neural network using multiple distance face. Soft. Comput. 21(17), 4995–5002 (2016). https://doi.org/10.1007/s00500-016-2095-0

    Article  Google Scholar 

  14. Nie, F., Wang, X., Jordan, M.I., Huang, H.: The constrained Laplacian rank algorithm for graph-based clustering. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)

    Google Scholar 

  15. Ren, Z., Sun, Q.: Simultaneous global and local graph structure preserving for multiple kernel clustering. IEEE Trans. Neural Networks Learn. Syst. (2020)

    Google Scholar 

  16. Ren, Z., Sun, Q., Wu, B., Zhang, X., Yan, W.: Learning latent low-rank and sparse embedding for robust image feature extraction. IEEE Trans. Image Process. 29(1), 2094–2107 (2019)

    Google Scholar 

  17. Ren, Z., Sun, Q., Yang, C.: Nonnegative discriminative encoded nearest points for image set classification. Neural Comput. Appl. 32(13), 9081–9092 (2019). https://doi.org/10.1007/s00521-019-04419-y

    Article  Google Scholar 

  18. Ren, Z., Wu, B., Zhang, X., Sun, Q.: Image set classification using candidate sets selection and improved reverse training. Neurocomputing 341, 60–69 (2019)

    Article  Google Scholar 

  19. Song, Z., Cui, K., Cheng, G.: Image set face recognition based on extended low rank recovery and collaborative representation. Int. J. Mach. Learn. Cybernet. 11(1), 71–80 (2019). https://doi.org/10.1007/s13042-019-00941-6

    Article  Google Scholar 

  20. Wang, H., Yang, Y., Liu, B., Fujita, H.: A study of graph-based system for multi-view clustering. Knowl.-Based Syst. 163, 1009–1019 (2019)

    Article  Google Scholar 

  21. Wang, W., Wang, R., Shan, S., Chen, X.: Prototype discriminative learning for face image set classification. In: Lai, S.-H., Lepetit, V., Nishino, K., Sato, Y. (eds.) ACCV 2016. LNCS, vol. 10113, pp. 344–360. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54187-7_23

    Chapter  Google Scholar 

  22. Wei, D., Shen, X., Sun, Q., Gao, X., Yan, W.: Prototype learning and collaborative representation using grassmann manifolds for image set classification. Pattern Recogn. 100, 107123 (2020)

    Article  Google Scholar 

  23. Yang, M., Wang, X., Liu, W., Shen, L.: Joint regularized nearest points for image set based face recognition. Image Vis. Comput. 58, 47–60 (2017)

    Article  Google Scholar 

  24. Yang, M., Zhu, P., Van Gool, L., Zhang, L.: Face recognition based on regularized nearest points between image sets. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp. 1–7. IEEE (2013)

    Google Scholar 

  25. Zhang, L., Yang, M., Feng, X., Ma, Y., Zhang, D.: Collaborative representation based classification for face recognition. arXiv preprint arXiv:1204.2358 (2012)

    Google Scholar 

  26. Zheng, P., Zhao, Z.Q., Gao, J., Wu, X.: Image set classification based on cooperative sparse representation. Pattern Recogn. 63, 206–217 (2017)

    Article  Google Scholar 

  27. Zhu, P., Zuo, W., Zhang, L., Shiu, S.C.K., Zhang, D.: Image set-based collaborative representation for face recognition. IEEE Trans. Inf. Forensics Secur. 9(7), 1120–1132 (2014)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Intelligent Manufacturing and Robot Special Project of Major Science and Technology Project in Sichuan (Grant no. 2020ZDZX0014), the Science and Technology Special Project of Major Scientific Instruments and Equipment Project in Sichuan (Grant no. 19ZDZX0119), the Undergraduate Innovation and Entrepreneurship Project of Sichuan Province of Sichuan (Grant no. 19xcy099).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Zhenwen Ren or Chao Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sun, Y., Ren, Z., Yang, C., Lei, H. (2020). Latent Sparse Discriminative Learning for Face Image Set Classification. In: Zhang, H., Zhang, Z., Wu, Z., Hao, T. (eds) Neural Computing for Advanced Applications. NCAA 2020. Communications in Computer and Information Science, vol 1265. Springer, Singapore. https://doi.org/10.1007/978-981-15-7670-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-7670-6_13

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-7669-0

  • Online ISBN: 978-981-15-7670-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics