Skip to main content
SpringerLink
Log in

Multi-pose face reconstruction and Gabor-based dictionary learning for face recognition

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Many methods based on data and model analysis have been proposed to overcome the adverse effect of poses, occlusion, and illumination on face recognition. Frontal face generation from multi-pose faces is still a widely studied and challenging problem due to its ill-posed. We focus on using a simple model to overcome the effect of pose changes on face recognition. This paper proposes a multi-pose face reconstruction model (MPFR) to generate available face information and combines the model with Gabor-based dictionary learning methods to learn discriminant features. The MPFR is adopted to generate the frontal face image. Given the distortion of the image only generated by Generative Adversarial Networks, the identity loss functions and the symmetry loss function are utilized in the multi-pose faces reconstruction model to reconstruct a more realistic reconstruction frontal image. Besides, we combine discriminative dictionary learning with Gabor features to better express face features for image classification. We report qualitative visualization results and quantitative recognition results of the MPFR model. Further, the experimental results demonstrate the application of the MPFR model in face recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Label consistent k-svd (2013) Learning a discriminative dictionary for recognition. IEEE Trans Pattern Anal Mach Intell 35(11):2651–2664

    Article  Google Scholar 

  2. Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. Siam J Imaging Sciences 2(1):183–202

    Article  MathSciNet  MATH  Google Scholar 

  3. Benaim S, Wolf L (2017) One-sided unsupervised domain mapping

  4. Blanz V, Vetter T, Rockwood A (2002) A morphable model for the synthesis of 3d faces. acm siggraph pp 187–194

  5. Cai S, Zuo W, Zhang L, Feng X, Wang P (2014) Support vector guided dictionary learning. In: European conference on computer vision

  6. Che Z, Liu B, Xiao Y, Cai H (2021) A new twin svm method with dictionary learning. Appl Intell, pp 1–17

  7. Choi Y, Choi M, Kim M, Ha JW, Choo J (2018) Stargan: unified generative adversarial networks for multi-domain image-to-image translation. In: 2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  8. Choi Y, Uh Y, Yoo J, Ha JW (2020) Stargan v2: diverse image synthesis for multiple domains. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  9. Deng J, Cheng S, Xue N, Zhou Y, Zafeiriou S (2018) Uv-gan: adversarial facial uv map completion for pose-invariant face recognition. In: 2018 IEEE/CVF conference on computer vision and pattern recognition

  10. Dong Y, Zhen L, Liao S, Li SZ (2014) Learning face representation from scratch. Comput Sci

  11. Dou H, Chen C, Hu X, Jia L, Peng S (2020) Asymmetric cyclegan for image-to-image translations with uneven complexities. Neurocomputing 415:114–122

    Article  Google Scholar 

  12. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Adv Neural Inf Process Syst 3:2672–2680

    Google Scholar 

  13. Guo Y, Lei Z, Hu Y, He X, Gao J (2016) Ms-celeb-1m: a dataset and benchmark for large-scale face recognition. European Conference on Computer Vision

  14. Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: 2015 IEEE Conference on computer vision and pattern recognition (CVPR), pp 4295–4304. https://doi.org/10.1109/CVPR.2015.7299058

  15. Hu Y, Wu X, Yu B, He R, Sun Z (2018) Pose-guided photorealistic face rotation. In: 2018 IEEE/CVF conference on computer vision and pattern recognition

  16. Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database forstudying face recognition in unconstrained environments. Month

  17. Huang R, Zhang S, Li T, He R (2017) Beyond face rotation: global and local perception gan for photorealistic and identity preserving frontal view synthesis. In: 2017 IEEE international conference on computer vision (ICCV)

  18. Isola P, Zhu JY, Zhou T, Efros AA (2016) Image-to-image translation with conditional adversarial networks. IEEE Conference on Computer Vision and Pattern Recognition, In

    Google Scholar 

  19. Kim T, Cha M, Kim H, Lee J, Kim J (2017) Learning to discover cross-domain relations with generative adversarial networks. Proc Int Conf Machine Learn (ICML)

  20. Liu S, Wang Y, Wu X, Li J, Lei T (2020) Discriminative dictionary learning algorithm based on sample diversity and locality of atoms for face recognition. J Vis Commun Image Represent 71:102,763

    Article  Google Scholar 

  21. Luan T, Xi Y, Liu X (2017) Disentangled representation learning gan for pose-invariant face recognition. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR)

  22. Luo F, Huang Y, Tu W, Liu J (2020) Local manifold sparse model for image classification. Neurocomputing 382:162–173

    Article  Google Scholar 

  23. Martínez A, Benavente R (1998) The ar face database. Cvc Technical Report vol 24

  24. Peng Y, Li L, Liu S, Wang X, Li J (2020) Weighted constraint based dictionary learning for image classification. Pattern Recogn Lett 130:99–106

    Article  Google Scholar 

  25. Ramirez I, Sprechmann P, Sapiro G (2010) Classification and clustering via dictionary learning with structured incoherence and shared features. In: Computer vision and pattern recognition (CVPR), 2010 IEEE Conference on

  26. Rosasco L, Verri A, Santoro M, Mosci S, Villa S (2009) Iterative projection methods for structured sparsity regularization. Computation

  27. Shu K, Wang D (2012) A dictionary learning approach for classification: separating the particularity and the commonality. In: European conference on computer vision

  28. Sla B, Yw B, Xw A, Jl C, Tao LD (2020) Discriminative dictionary learning algorithm based on sample diversity and locality of atoms for face recognition - sciencedirect. J Vis Commun Image Represent, vol 71

  29. Vu TH, Monga V (2016) Learning a low-rank shared dictionary for object classification. In: 2016 IEEE international conference on image processing (ICIP), pp 4428–4432. IEEE

  30. Vu TH, Mousavi HS, Monga V, Rao G, Rao U (2016) Histopathological image classification using discriminative feature-oriented dictionary learning. IEEE Trans Med Imaging 35(3):738–751

    Article  Google Scholar 

  31. Wang CP, Wei W, Zhang JS, Song HB (2018) Robust face recognition via discriminative and common hybrid dictionary learning. Applied Intelligence the International Journal of Artificial Intelligence Neural Networks & Complex Problem Solving Technologies

  32. Wang TC, Liu MY, Zhu JY, Tao A, Kautz J, Catanzaro B (2017) High-resolution image synthesis and semantic manipulation with conditional gans

  33. Gao W, Cao B, Shan S, Chen X, Delong Z (2008) The cas-peal large-scale chinese face database and baseline evaluations. IEEE Transactions on Systems Man & Cybernetics Part A

  34. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence

  35. Wu X, He R, Sun Z, Tan T (2018) A light cnn for deep face representation with noisy labels. IEEE Trans Inf Forensics Secur 13(11):2884–2896

    Article  Google Scholar 

  36. Yang M, Zhang L, Feng X, Zhang D (2011) Fisher discrimination dictionary learning for sparse representation. In: IEEE international conference on computer vision, ICCV 2011, Barcelona, Spain, November 6-13, 2011

  37. Yang M, Zhang L, Shiu SCK, Zhang D (2013) Gabor feature based robust representation and classification for face recognition with gabor occlusion dictionary. Pattern Recogn 46(7):1865–1878

    Article  Google Scholar 

  38. Zeng Y, Li Y, Chen J, Jia X, Huang GB (2020) Elm embedded discriminative dictionary learning for image classification. Neural Netw 123:331–342

    Article  Google Scholar 

  39. Zhang L, Yang M, Feng X (2012) Sparse representation or collaborative representation: Which helps face recognition?. In: International conference on computer vision

  40. Zhao Z, Shen Q, Feng G, Zhu J (2021) Collaborative coding and dictionary learning for nearest subspace classification. Soft Comput, pp 1–17

  41. Zhou H, Liu J, Liu Z, Liu Y (2020) Rotate-and-render: unsupervised photorealistic face rotation from single-view images

  42. Zhou S, Xiao T, Yang Y, Feng D, He W (2017) Genegan: learning object transfiguration and attribute subspace from unpaired data. In: British machine vision conference

  43. Zhu J, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: 2017 IEEE international conference on computer vision (ICCV), pp 2242–2251. https://doi.org/10.1109/ICCV.2017.244

Download references

Acknowledgements

This study is supported by Open Project of Key Laboratory of Ministry of Public Security for Road Traffic Safety(No.2021ZDSYSKFKT04), Jiangsu Engineering Research Center of Digital Twinning Technology for Key Equipment in Petrochemical Process(No.DT2020720).

Author information

Authors and Affiliations

  1. School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, 213164, China

    Huanjie He, Jiuzhen Liang & Zhenjie Hou

  2. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, China

    Lan Di

  3. Department of Mathematics and Statistics, University of North Carolina Charlotte, Charlotte, USA

    Yunfei Xia

  4. Jiangsu Engineering Research Center of Digital Twinning Technology for Key Equipment in Petrochemical Process, Changzhou University, Changzhou, 213164, China

    Jiuzhen Liang

Authors
  1. Huanjie He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiuzhen Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenjie Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lan Di
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yunfei Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiuzhen Liang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, H., Liang, J., Hou, Z. et al. Multi-pose face reconstruction and Gabor-based dictionary learning for face recognition. Appl Intell 53, 16648–16662 (2023). https://doi.org/10.1007/s10489-022-04336-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-04336-z

Keywords

Search

Navigation