Skip to main content
SpringerLink
Log in

Fast single sample face recognition based on sparse representation classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The extended sparse representation classification (ESRC) is one of the benchmark classification algorithms in the field of single sample face recognition (SSFR). However, when there are many single training samples, the execution time of ESRC cannot be acceptable in real face recognition systems. We assume the similarity principle of sparse representation under valid SSFR as that, if the test image is more similar to certain single training sample, the corresponding sparse coefficient of this single training sample may be larger, and the representation residual of this single training sample may be smaller. Based on this assumption, we propose the fast ESRC method to tackle many single training samples problem. Firstly, we propose the positive sparse coefficient based ESRC (PESRC) that selects to compute representation residuals of single training samples whose sparse coefficients of ESRC are positive. Then, we propose the statistical analysis of the sparse coefficient ratio, which is used to develop the large positive sparse coefficient based ESRC (LESRC) that calculates representation residuals of the single training samples corresponding to large positive sparse coefficients of PESRC. Finally, the experiment results on Extended Yale B, AR, CMU PIE and VGGFace2 face databases indicate that the proposed PESRC and LESRC can significantly improve the computation efficiency of ESRC. On our platform, the execution time of recognizing only one test image for ESRC or VGG + ESRC is over 130 s (the execution time of ESRC and VGG + ESRC are 562.71 s and 135.02 s) under 9125 single training samples, whereas the execution times of PESRC, LESRC, VGG + PESRC, and VGG + LESRC are 2.20s, 0.23 s, 0.71 s, and 0.03 s respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Abdelmaksoud M, Nabil E, Farag I, Hameed H-A (2020) A novel neural network method for face recognition with a single sample per person. IEEE Access 8:102212–102221

    Article  Google Scholar 

  2. Cao Q, Shen L, Xie W, Parkhi O, Zisserman A (2018). Vggface2: a dataset for recognising faces across pose and age. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp. 67–74

  3. Deng J, Guo J, Xue N, Zafeiriou S (2019). Arcface: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 4690–4699

  4. Deng W, Hu J, Guo J (2012) Extended SRC: Undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864–1870

    Article  Google Scholar 

  5. Donoho D, Tsaig Y (2008) Fast solution of L1-norm minimization problems when the solution may be sparse. IEEE Transactions on Information Forensics and Security 54(11):4789–4812

    Article  Google Scholar 

  6. Fan Z, Wei C (2020) Fast kernel sparse representation based classification for undersampling problem in face recognition. Multimed Tools Appl 79:7319–7337

    Article  Google Scholar 

  7. Fan Z, Zhang D, Wang X, Zhu Q, Wang Y (2018) Virtual dictionary based kernel sparse representation for face recognition. Pattern Recogn 76:1–13

    Article  Google Scholar 

  8. Gao S, Jia K, Zhuang L, Ma Y (2015) Neither global nor local: regularized patch-based representation for single sample per person face recognition. Int J Comput Vis 111(3):365–383

    Article  MathSciNet  Google Scholar 

  9. Gao Y, Ma J, Yuille A (2017) Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Trans Image Process 26(5):2545–2560

    Article  MathSciNet  Google Scholar 

  10. Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660

    Article  Google Scholar 

  11. He M, Zhang J, Shan S, Kan M, Chen X (2020) Deformable face net for pose invariant face recognition. Pattern Recogn 100:107113

    Article  Google Scholar 

  12. Lahasan B, Lutfi S, San-Segundo R (2019) A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression. Artif Intell Rev 52(2):949–979

    Article  Google Scholar 

  13. Li L, Peng Y, Liu S (2020) Compound dictionary learning based classification method with a novel virtual sample generation technology for face recognition. Multimed Tools Appl 79:23325–23346. https://doi.org/10.1007/s11042-020-08965-9

    Article  Google Scholar 

  14. Li Q, Shi X, Guo Z (2019) Similarity mapping for robust face recognition via a single training sample per person. Pattern Recogn Lett 128:459–466

    Article  Google Scholar 

  15. Liao M, Gu X (2019) Face recognition approach by subspace extended sparse representation and discriminative feature learning. Neurocomputing 373:35–49

    Article  Google Scholar 

  16. Lu J, Tan Y, Wang G (2013) Discriminative multimanifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal Mach Intell 35(1):39–51

    Article  Google Scholar 

  17. Martinez A, Benavente R (1998). The AR face database, CVC Tech. Rep. #24

  18. Mokhayeri F, Granger E (2020) A paired sparse representation model for robust face recognition from a single sample. Pattern Recogn 100:1–16

    Article  Google Scholar 

  19. Oloyede M-O, Hancke G-P, Myburgh H-C (2020). A review on face recognition systems: recent approaches and challenges. Multimed Tools Appl https://doi.org/10.1007/s11042-020-09261-2

  20. Parkhi O, Vedaldi A, Zisserman A (2015). Deep face recognition. In: Proceedings of the British Machine Vision Conference, pp. 1–12

  21. Peng Y, Li L, Liu S, Li J, Wang X (2018) Extended sparse representation-based classification method for face recognition. Mach Vis Appl 29(6):991–1007

    Article  Google Scholar 

  22. Schroff F, Kalenichenko D, Philbin J (2015). FaceNet: a unifiedembedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 815–823

  23. Sim T, Baker S, Bsat M (2003) The CMU pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25(12):504–507

    Google Scholar 

  24. Wang H, Wang Y, Zhou Z, Ji X, Gong D, Zhou J, Li Z, Liu W (2018). Cosface: large margin cosine loss for deep face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 5265–5274

  25. Wei C, Wang Y (2015) Undersampled face recognition via robust auxiliary dictionary learning. IEEE Trans Image Process 24(6):1722–1734

    Article  MathSciNet  Google Scholar 

  26. Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  27. Xu L, Yan Q, Xia Y, Jia J (2012) Structure extraction from texture via relative total variation. ACM Trans Graph 31(6):139:1–139:10

    Google Scholar 

  28. Zhang L, Liu J, Zhang B, Zhang D, Zhu C (2020) Deep cascade model-based face recognition: when deep-layered learning meets small data. IEEE Trans Image Process 29:1016–1029

    Article  MathSciNet  Google Scholar 

  29. Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letter 23(10):1499–1503

    Article  Google Scholar 

  30. Zhuang L, Yang A, Zhou Z, Sastry S, Ma Y (2013). Single sample face recognition with image corruption and misalignment via sparse illumination transfer. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 3546–3553

  31. Zou G, Fu G, Gao M, Pan J, Liu Z (2020) A new approach for small sample face recognition with pose variation by fusing Gabor encoding features and deep features. Multimed Tools Appl 79:23571–23598. https://doi.org/10.1007/s11042-020-09076-1

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No.61802203), Natural Science Foundation of Jiangsu Province (Grant No. BK20180761), China Postdoctoral Science Foundation Funded Project (Grant No.2019 M651653), Jiangsu Planned Projects for Postdoctoral Research Funds (No.2019 K124), and the Nanjing University of Posts and Telecommunications Science Foundation (Grant No. NY218119).

Author information

Authors and Affiliations

  1. College of Mechatronics Control Engineering, Hubei Normal University, Huangshi, 435002, China

    Meng-Jun Ye, Li-Guang Wan & Gai-Hui Lei

  2. College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing, 210023, China

    Chang-Hui Hu

Authors
  1. Meng-Jun Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chang-Hui Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Li-Guang Wan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gai-Hui Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chang-Hui Hu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ye, MJ., Hu, CH., Wan, LG. et al. Fast single sample face recognition based on sparse representation classification. Multimed Tools Appl 80, 3251–3273 (2021). https://doi.org/10.1007/s11042-020-09855-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09855-w

Keywords

Search

Navigation