Skip to main content

Advertisement

SpringerLink
Log in

Classical and modern face recognition approaches: a complete review

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Human face recognition have been an active research area for the last few decades. Especially, during the last five years, it has gained significant research attention from multiple domains like computer vision, machine learning and artificial intelligence due to its remarkable progress and broad social applications. The primary goal of any face recognition system is to recognize the human identity from the static images, video data, data-streams and the knowledge of the context in which these data components are being actively used. In this review, we have highlighted major applications, challenges and trends of face recognition systems in social and scientific domains. The prime objective of this research is to sum-up recent face recognition techniques and develop a broad understanding of how these techniques behave on different datasets. Moreover, we discuss some key challenges such as variability in illumination, pose, aging, cosmetics, scale, occlusion, and background. Along with classical face recognition techniques, most recent research directions are deeply investigated, i.e., deep learning, sparse models and fuzzy set theory. Additionally, basic methodologies are briefly discussed, while contemporary research contributions are examined in broader details. Finally, this research presents future aspects of face recognition technologies and its potential significance in the upcoming digital society.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2d and 3d face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906

    Google Scholar 

  2. Abbe E, Sandon C (2018) Provable limitations of deep learning coRR. arXiv:1812.06369

  3. Adini Y, Moses Y, Ullman S (1997) Face recognition: The problem of compensating for changes in illumination direction. IEEE Trans Pattern Anal Mach Intell 19(7):721–732

    Google Scholar 

  4. Afifi M, Abdelhamed A (2019) Afif4: Deep gender classification based on adaboost-based fusion of isolated facial features and foggy faces. J Vis Commun Image Represent 62:77–86

    Google Scholar 

  5. Aghamaleki JA, Chenarlogh VA (2019) Multi-stream CNN for facial expression recognition in limited training data. Multimed Tools Appl 78 (16):22861–22882

    Google Scholar 

  6. Ahonen T, Hadid A, Pietikȧinen M (2004) Face recognition with local binary patterns. In: Proceedings of 8th European Conference on Computer Vision-ECCV, Prague, Czech Republic, Part I, pp 469–481

  7. Akram MU, Awan HM, Khan AA (2014) Dorsal hand veins based person identification. In: 4Th international conference on image processing theory, tools and applications, IPTA 2014, Paris, pp 289–294

  8. Al-Shannaq AS, Elrefaei LA (2019) Comprehensive analysis of the literature for age estimation from facial images. IEEE Access 7:93229–93249

    Google Scholar 

  9. Al-wajih E, Ahmed M (2020) A new application for gabor filters in face-based gender classification. Int Arab J Inf Technol 17(2):178–187

    Google Scholar 

  10. Ali W, Jie S, Aman KA, Saifullah T (2019) Context-aware recommender systems: Challenges and opportunities 48(5):655

  11. Almudhahka NY, Nixon MS, Hare JS (2018) Comparative Face Soft Biometrics for Human Identification. Springer International Publishing, Cham, pp 25–50

    Google Scholar 

  12. An L, Chen X, Liu S, Lei Y, Yang S (2017) Integrating appearance features and soft biometrics for person re-identification. Multimed Tools Appl 76(9):12117–12131

    Google Scholar 

  13. Andreopoulos A, Tsotsos JK (2013) 50 years of object recognition: Directions forward. Comput Vis Image Underst 117(8):827–891

    Google Scholar 

  14. Annamalai P, Raju K, Ranganayakulu D (2018) Soft biometrics traits for continuous authentication in online exam using ICA based facial recognition. I J Netw Secur 20(3):423–432

    Google Scholar 

  15. Arashloo SR (2016) A comparison of deep multilayer networks and markov random field matching models for face recognition in the wild. IET Comput Vis 10(6):466–474

    Google Scholar 

  16. Arigbabu OA, Ahmad SMS, Adnan WAW, Yussof S (2015) Recent advances in facial soft biometrics. Vis Comput 31(5):513–525

    Google Scholar 

  17. Azeem A, Sharif M, Raza M, Murtaza M (2014) A survey: face recognition techniques under partial occlusion. Int Arab J Inf Technol 11(1):1–10

    Google Scholar 

  18. Bailly-Bailliére E, Bengio S, Bimbot F, Hamouz M, Kittler J, Mariéthoz J, Matas J, Messer K, Popovici V, Porée F et al (2003) The banca database and evaluation protocol. In: International conference on audio-and video-based biometric person authentication. Springer, pp 625–638

  19. Bair S, DelVecchio M, Flowers B, Michaels AJ, Headley WC (2019) On the limitations of targeted adversarial evasion attacks against deep learning enabled modulation recognition. In: Proceedings of the ACM Workshop on Wireless Security and Machine Learning, WiseML@WiSec 2019, Miami, pp 25–30

  20. Baocai Y, Yanfeng S, Chengzhang W, Yun G (2009) Bjut-3d large scale 3d face database and information processing. J Comput Res Dev 6:020

    Google Scholar 

  21. Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464

    Google Scholar 

  22. Bashbaghi S, Granger E, Sabourin R, Parchami M (2018) Deep learning architectures for face recognition in video surveillance coRR. arXiv:1802.09990

  23. Becerra-Riera F, Morales-Gonzȧlez A, Mėndez-Vȧzquez H (2019) A survey on facial soft biometrics for video surveillance and forensic applications. Artif Intell Rev 52(2):1155–1187

    Google Scholar 

  24. Belhumeur P, Hespanha JP, Kriegman D (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Google Scholar 

  25. Benamara NK, Zigh E, Stambouli TB, Keche M (2018) Combined and weighted features for robust multispectral face recognition. In: Proceedings of 6th IFIP TC 5 International Conference on Computational Intelligence and Its Applications - CIIA, Oran, Algeria, pp 549–560

  26. Beveridge JR, Phillips PJ, Bolme DS, Draper BA, Givens GH, Lui YM, Teli MN, Zhang H, Scruggs WT, Bowyer KW et al (2013) The challenge of face recognition from digital point-and-shoot cameras. In: IEEE Sixth international conference on biometrics: theory, Applications and Systems (BTAS), pp 1–8

  27. Beveridge JR, Zhang H, Flynn PJ, Lee Y, Liong VE, Lu J, de Assis Angeloni M, de Freitas Pereira T, Li H, Hua G et al (2014) The ijcb 2014 pasc video face and person recognition competition. In: IEEE International joint conference on biometrics (IJCB), pp 1–8

  28. Brunelli R, Poggio T (1993) Face recognition: Features versus templates. IEEE Trans. Pattern Anal Mach Intell 15(10):1042–1052

    Google Scholar 

  29. Calo SB, Ko BJ, Lee K, Salonidis T, Verma DC (2018) Controlling privacy in a face recognition application. In: US Patent app 15/876,307. Google patents

  30. Campomanes-Alvarez C, Ȧlvarez BRC, Guadarrama S, Ibȧṅez Ȯ, Cordȯn O (2017) An experimental study on fuzzy distances for skull-face overlay in craniofacial superimposition. Fuzzy Sets Syst 318:100–119

    MathSciNet  Google Scholar 

  31. Chatzis V, Bors AG, Pitas I (1999) Multimodal decision-level fusion for person authentication. IEEE Trans Syst Man Cybern Part A 29(6):674–680

    Google Scholar 

  32. Chen Y, Patel VM, Phillips PJ, Chellappa R (2012) Dictionary-based face recognition from video. In: Proceedings of 12th European Conference on Computer Vision ECCV, Florence, Part VI, pp 766–779

  33. Chen BC, Chen C, Hsu WH (2014) Cross-age reference coding for age-invariant face recognition and retrieval. In: European conference on computer vision. Springer, pp 768–783

  34. Chen J, Liu S, Chen Z (2017) Gender classification in live videos. In: 2017 IEEE International conference on image processing, ICIP 2017, Beijing, pp 1602–1606

  35. Chen J, Ranjan R, Sankaranarayanan S, Kumar A, Chen C, Patel VM, Castillo CD, Chellappa R (2018) Unconstrained still/video-based face verification with deep convolutional neural networks. Int J Comput Vis 126(2-4):272–291

    MathSciNet  Google Scholar 

  36. Chen G (2019) An experimental study for the effects of noise on face recognition algorithms under varying illumination. Multim Tools Appl 78(18):26615–26631

    Google Scholar 

  37. Cheng H (2015) Sparse representation, modeling and learning in visual recognition - theory, algorithms and applications. Advances in computer vision and pattern recognition. Springer, Berlin

  38. Chihaoui M, Elkefi A, Bellil W, Amar CB (2016) A survey of 2d face recognition techniques. Computers 5(4):21

    Google Scholar 

  39. Choi S, Choi C, Jeong G, Kwak N (2012) Pixel selection based on discriminant features with application to face recognition. Pattern Recognit Lett 33(9):1083–1092

    Google Scholar 

  40. Chugh T, Singh M, Nagpal S, Singh R, Vatsa M (2017) Transfer learning based evolutionary algorithm for composite face sketch recognition. In: IEEE Conference on computer vision and pattern recognition workshops, CVPR workshops, Honolulu, pp 619–627

  41. Conde C, Serrano Ȧ, Cabello E (2006) Multimodal 2d, 2.5d & 3d face verification. In: Proceedings of the International Conference on Image Processing, ICIP 2006, Atlanta, pp 2061–2064

  42. Cox IJ, Ghosn J, Yianilos PN (1996) Feature-based face recognition using mixture-distance. In: Conference on computer vision and pattern recognition (CVPR ), San Francisco, pp 209–216

  43. Cunningham JP, Ghahramani Z (2015) Linear dimensionality reduction: survey, insights, and generalizations. J Mach Learn Res 16:2859–2900

    MathSciNet  Google Scholar 

  44. Dagnes N, Vezzetti E, Marcolin F, Tornincasa S (2018) Occlusion detection and restoration techniques for 3d face recognition: a literature review. Mach Vis Appl 29(5):789–813

    Google Scholar 

  45. Danelakis A, Theoharis T, Pratikakis I (2015) A survey on facial expression recognition in 3d video sequences. Multimed Tools Appl 74(15):5577–5615

    Google Scholar 

  46. Dantcheva A, Velardo C, D’Angelo A, Dugelay J (2011) Bag of soft biometrics for person identification - new trends and challenges. Multimed Tools Appl 51(2):739–777

    Google Scholar 

  47. Dantcheva A, Elia P, Ross A (2016) What else does your biometric data reveal? A survey on soft biometrics. IEEE Trans Inf Forensic Secur 11 (3):441–467

    Google Scholar 

  48. De Carrera PF, Marques I (2010) Face recognition algorithms. Master’s thesis in Computer Science. Universidad Euskal Herriko

  49. de Souza GB, Santos DFS, Pires RG, Marana AN, Papa JP (2017) Efficient transfer learning for robust face spoofing detection. In: Proceedings of 22nd Iberoamerican Congress on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, CIARP, Valparaíso, pp 643–651

  50. Deng J, Guo J, Xue N, Zafeiriou S (2019) Arcface: Additive angular margin loss for deep face recognition. In: IEEE Conference on computer vision and pattern recognition, CVPR 2019, Long beach, pp 4690–4699

  51. Diarra M, Gouton P, Jerome AK (2016) A comparative study of descriptors and detectors in multispectral face recognition. In: 12Th international conference on signal-image technology & internet-based systems, SITIS, Naples, pp 209–214

  52. Ding C, Tao D (2016) A comprehensive survey on pose-invariant face recognition. ACM Trans Intell Syst Technol 7:37:1–37:42

    Google Scholar 

  53. Du Y, Lu X, Zeng W, Hu C (2018) A novel fuzzy linear discriminant analysis for face recognition. Intell Data Anal 22(3):675–696

    Google Scholar 

  54. Edwards GJ, Cootes TF, Taylor CJ (1998) Face recognition using active appearance models. In: Proceedings of 5th European Conference on Computer Vision Computer Vision - ECCV, Freiburg, vol II, pp 581–595

  55. Efremova N, Patkin M, Sokolov D (2019) Face and emotion recognition with neural networks on mobile devices: Practical implementation on different platforms. In: 14Th IEEE international conference on automatic face & gesture recognition, FG 2019, Lille, pp 1–5

  56. Elad M (2012) Sparse and redundant representation modeling - what next?. IEEE Signal Process Lett 19(12):922–928

    Google Scholar 

  57. Elag M, Kumar P, Marini L, Myers JD, Hedstrom M, Plale BA (2017) Identification and characterization of information-networks in long-tail data collections. Environ Modell Softw 94:100–111

    Google Scholar 

  58. Etemad K, Chellappa R (1997) Discriminant analysis for recognition of human face images. In: International conference on audio- and video-based biometric person authentication, pp 125–142

  59. Feltwell T, Wood G, Linehan C, Lawson S (2017) An augmented reality game using face recognition technology. In: Proceedings of the ACM Conference Companion Publication on Designing Interactive Systems, pp 44–49

  60. Fianyi I, Zia T (2016) Biometric technology solutions to countering today’s terrorism. Int J Cyber Warf Terror 6(4):28–40

    Google Scholar 

  61. Fu Y, Guo G, Huang TS (2010) Age synthesis and estimation via faces: a survey. IEEE Trans Pattern Anal Mach Intell 32(11):1955–1976

    Google Scholar 

  62. Galea C, Farrugia RA (2018) Matching software-generated sketches to face photographs with a very deep cnn, morphed faces, and transfer learning. IEEE Trans Inf Forensic Secur 13(6):1421–1431

    Google Scholar 

  63. Galiani S, Gȧlvez RH (2019) An empirical approach based on quantile regression for estimating citation ageing. J. Informetrics 13(2):738–750

    Google Scholar 

  64. Gao W, Cao B, Shan S, Chen X, Zhou D, Zhang X, Zhao D (2008) The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans Syst Man Cybern Part A, 38(1):149–161

    Google Scholar 

  65. Garain J, Kumar RK, Kisku DR, Sanyal G (2019) Addressing facial dynamics using k-medoids cohort selection algorithm for face recognition. Multimed Tools Appl 78(13):18443–18474

    Google Scholar 

  66. Gautam G, Mukhopadhyay S (2019) An adaptive localization of pupil degraded by eyelash occlusion and poor contrast. Multimed Tools Appl 78(6):6655–6677

    Google Scholar 

  67. Geetha A, Sundaram M, Vijayakumari B (2019) Gender classification from face images by mixing the classifier outcome of prime, distinct descriptors. Soft Comput 23(8):2525–2535

    Google Scholar 

  68. Geng X, Zhou Z, Smith-miles K (2007) Automatic age estimation based on facial aging patterns. IEEE Trans Pattern Anal Mach Intell 29(12):2234–2240

    Google Scholar 

  69. Geng X, Yin C, Zhou Z (2013) Facial age estimation by learning from label distributions. IEEE Trans Pattern Anal Mach Intell 35(10):2401–2412

    Google Scholar 

  70. Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6): 643–660

    Google Scholar 

  71. Gilbert A, Illingworth J, Bowden R (2008) Scale invariant action recognition using compound features mined from dense spatio-temporal corners. In: Proceedings of 10th European Conference on Computer Vision, Marseille, Part I, pp 222–233

  72. Global opportunity analysis and industry forecast, 2015-2022. Available online: https://www.alliedmarketresearch.com/press-release/facial-recognition-market.html. Accessed: 2019-07-23

  73. Gong D, Li Z, Huang W, Li X, Tao D (2017) Heterogeneous face recognition: A common encoding feature discriminant approach. IEEE Trans Image Process 26(5):2079–2089

    MathSciNet  Google Scholar 

  74. Gonzalez-Sosa E, Fiėrrez J, Vera-Rodríguez R, Alonso-Fernandez F (2018) Facial soft biometrics for recognition in the wild: Recent works, annotation, and COTS evaluation. IEEE Trans Inf Forensic Secur 13(8):2001–2014

    Google Scholar 

  75. Gonzalez-Sosa E, Fiėrrez J, Vera-Rodríguez R, Alonso-Fernandez F (2018) Facial soft biometrics for recognition in the wild: Recent works, annotation, and COTS evaluation. IEEE Trans Inf Forensic Secur 13(8):2001–2014

    Google Scholar 

  76. Goswami G, Ratha NK, Agarwal A, Singh R, Vatsa M (2018) Unravelling robustness of deep learning based face recognition against adversarial attacks. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans

  77. Grgic M, Delac K, Grgic S (2011) Scface — surveillance cameras face database. Multimed Tools Appl 51(3):863–879

    Google Scholar 

  78. Grm K, Struc V, Artiges A, Caron M, Ekenel HK (2018) Strengths and weaknesses of deep learning models for face recognition against image degradations. IET Biometr 7(1):81–89

    Google Scholar 

  79. Gu̇nther M, Shafey LE, Marcel S (2016) Face recognition in challenging environments: an experimental and reproducible research survey. In: Face recognition across the imaging spectrum, pp 247–280

  80. Guo G, Li S, Chan KL (2000) Face recognition by support vector machines. In: 4Th IEEE international conference on automatic face and gesture recognition (FG 2000), Grenoble, pp 196–201

  81. Guo G, Fu Y, Dyer CR, Huang TS (2008) Image-based human age estimation by manifold learning and locally adjusted robust regression. IEEE Trans Image Process 17(7):1178–1188

    MathSciNet  Google Scholar 

  82. Guo Y, Zhang L, Hu Y, He X, Gao J (2016) Ms-celeb-1m: a dataset and benchmark for large-scale face recognition. In: European conference on computer vision. Springer, pp 87–102

  83. Guo S, Tan G, Pan H, Chen L, Gao C (2017) Face alignment under occlusion based on local and global feature regression. Multimed Tools Appl 76(6):8677–8694

    Google Scholar 

  84. Guo BH, Nixon MS, Carter JN (2018) Fusion analysis of soft biometrics for recognition at a distance. In: IEEE 4Th international conference on identity, security, and behavior analysis, ISBA 2018, Singapore, pp 1–8

  85. Gutta S, Wechsler H (1997) Face recognition using hybrid classifiers. Pattern Recogn 30(4):539–553

    Google Scholar 

  86. https://patents.google.com. Accessed: 2019-07-23

  87. https://techcrunch.com/2017/12/13/china-cctv-bbc-reporter/?guccounter=1. Accessed: 2019-07-23

  88. Haghiri S, Rabiee HR, Soltani-farani A, Hosseini SA, Shadloo M (2014) Locality preserving discriminative dictionary learning. In: IEEE International conference on image processing, ICIP, Paris, pp 5242–5246

  89. Han X, Yang H, Xing G, Liu Y (2020) Asymmetric joint gans for normalizing face illumination from a single image. IEEE Trans Multimed 22(6):1619–1633

    Google Scholar 

  90. HasanPour SH, Rouhani M, Fayyaz M, Sabokrou M, Adeli E (2018) Towards principled design of deep convolutional networks: Introducing simpnet. CoRR arXiv:1802.06205

  91. Hashemi VH, Gharahbagh AA (2015) Article:a novel hybrid method for face recognition based on 2d wavelet and singular value decomposition. Amer J Netw Commun 4(4):90–94

    Google Scholar 

  92. He X, Yan S, Hu Y, Niyogi P, Zhang H (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340

    Google Scholar 

  93. He L, Li H, Zhang Q, Sun Z (2019) Dynamic feature matching for partial face recognition. IEEE Trans Image Process 28(2):791–802

    MathSciNet  Google Scholar 

  94. He Q, He B, Zhang Y, Fang H (2019) Multimedia based fast face recognition algorithm of speed up robust features. Multimed Tools Appl 78(17):24035–24045

    Google Scholar 

  95. Heisele B, Ho P, Wu J, Poggio T (2003) Face recognition: component-based versus global approaches. Comput Vis Image Underst 91(1-2):6–21

    Google Scholar 

  96. Heng W, Jiang T, Gao W (2019) How to assess the quality of compressed surveillance videos using face recognition. . IEEE Trans Circ Syst Video Techn 29(8):2229–2243

    Google Scholar 

  97. Hinton GE, Osindero S, Teh YW (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554

    MathSciNet  Google Scholar 

  98. Hu P, Ning H, Qiu T, Zhang Y, Luo X (2017) Fog computing based face identification and resolution scheme in internet of things. IEEE Trans Ind Inf 13(4):1910–1920

    Google Scholar 

  99. Hu C, Lu X, Liu P, Jing X, Yue D (2019) Single sample face recognition under varying illumination via QRCP decomposition. IEEE Trans Image Process 28(5):2624–2638

    MathSciNet  Google Scholar 

  100. Hu C, Wu F, Yu J, Jing X, Lu X, Liu P (2020) Diagonal symmetric pattern-based illumination invariant measure for severe illumination variation face recognition. IEEE Access 8:63202–63213

  101. Huan E, Wen G (2020) Transfer learning with deep convolutional neural network for constitution classification with face image. Multim Tools Appl 79 (17-18):11905–11919

    Google Scholar 

  102. Huang R, Metaxas DN, Pavlovic V (2004) A hybrid face recognition method using markov random fields. In: 17Th international conference on pattern recognition, ICPR, Cambridge, pp 157–160

  103. Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database forstudying face recognition in unconstrained environments. In: Workshop on faces in ‘real-life’ images: detection, alignment, and recognition

  104. Huang K, Dai D, Ren C, Lai Z (2017) Learning kernel extended dictionary for face recognition. IEEE Trans Neural Netw Learn Syst 28(5):1082–1094

    Google Scholar 

  105. Huang P, Gao G, Qian C, Yang G, Yang Z (2017) Fuzzy linear regression discriminant projection for face recognition. IEEE Access 5:4340–4349

  106. Iliadis M, Wang H, Molina R, Katsaggelos AK (2017) Robust and low-rank representation for fast face identification with occlusions. IEEE Trans Image Process 26(5):2203–2218

    MathSciNet  Google Scholar 

  107. Iranmanesh SM, Dabouei A, Kazemi H, Nasrabadi NM (2018) Deep cross polarimetric thermal-to-visible face recognition. In: International conference on biometrics, ICB, Gold Coast, pp 166–173

  108. Jaha ES, Nixon MS (2016) From clothing to identity: Manual and automatic soft biometrics. IEEE Trans Inf Forensic Secur 11(10):2377–2390

    Google Scholar 

  109. Jain AK, Park U (2009) Facial marks: Soft biometric for face recognition. In: Proceedings of the International Conference on Image Processing, ICIP, Cairo, pp 37–40

  110. Jha D, Ward L, Yang Z, Wolverton C, Foster I, Liao W.k, Choudhary A, Agrawal A (2019) Irnet: A general purpose deep residual regression framework for materials discovery. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, pp 2385–2393

  111. Jiang B, Zhang J, Deng B, Guo Y, Liu L (2017) Deep face feature for face alignment and reconstruction. CoRR arXiv:1708.02721

  112. Jing L, Ng MK, Zeng T (2013) Dictionary learning-based subspace structure identification in spectral clustering. IEEE Trans Neural Netw Learn Syst 24(8):1188–1199

    Google Scholar 

  113. Jing X, Wu F, Zhu X, Dong X, Ma F, Li Z (2016) Multi-spectral low-rank structured dictionary learning for face recognition. Pattern Recogn 59:14–25

    Google Scholar 

  114. Jiu M, Sahbi H (2019) Deep representation design from deep kernel networks. Pattern Recogn 88:447–457

    Google Scholar 

  115. Kanade T (1973) Picture processing system by computer complex and recognition of human faces. Ph.D. thesis, Kyoto University, Japan

  116. Kang W, Lu Y, Li D, Jia W (2019) From noise to feature: Exploiting intensity distribution as a novel soft biometric trait for finger vein recognition. IEEE Trans Inf Forensic Secur 14(4):858–869

    Google Scholar 

  117. Kasapakis V, Gavalas D (2017) Occlusion handling in outdoors augmented reality games. Multimed Tools Appl 76(7):9829–9854

    Google Scholar 

  118. Kasturi R, Goldgof DB, Soundararajan P, Manohar V, Garofolo JS, Bowers R, Boonstra M, Korzhova VN, Zhang J (2009) Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol. IEEE Trans Pattern Anal Mach Intell 31(2): 319–336

    Google Scholar 

  119. Kawulok M, Wu J, Hancock ER (2011) Supervised relevance maps for increasing the distinctiveness of facial images. Pattern Recognit 44(4):929–939

    Google Scholar 

  120. Keinert F, Lazzaro D, Morigi S (2019) A robust group-sparse representation variational method with applications to face recognition. IEEE Trans Image Process 28(6):2785–2798

    MathSciNet  Google Scholar 

  121. Kemelmacher-Shlizerman I, Basri B (2011) 3d face reconstruction from a single image using a single reference face shape. IEEE Trans Pattern Anal Mach Intell 33(2):394–405

    Google Scholar 

  122. Kepenekci B (2001) Face recognition using gabor wavelet transform. PhD thesis, The Middle East Technical University

  123. Khan K, Attique M, Syed I, Sarwar G, Irfan MA, Khan R (2019) A unified framework for head pose, age and gender classification through end-to-end face segmentation. Entropy 21(7):647

    MathSciNet  Google Scholar 

  124. Khan AA, Shao J, Ali W, Tumrani S (2020) Content-Aware summarization of broadcast sports Videos:An Audio–Visual feature extraction approach. Neural Process Lett:1–24

  125. Khan S, Chen L, Yan H (2020) Co-clustering to reveal salient facial features for expression recognition. IEEE Trans Affect Comput 11(2):348–360

    Google Scholar 

  126. Kim K (2005) Intelligent immigration control system by using passport recognition and face verification. In: International symposium on neural networks. Springer, pp 147–156

  127. Kim D, Hernandez M, Choi J, Medioni G (2017) Deep 3d face identification. In: IEEE International joint conference on biometrics (IJCB), pp 133–142

  128. Kreutz-Delgado K, Murray JF, Rao BD, Engan K, Lee T, Sejnowski TJ (2003) Dictionary learning algorithms for sparse representation. Neural Comput 15(2):349–396

    Google Scholar 

  129. Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90

    Google Scholar 

  130. Kumar BKS, Swamy MNS, Ahmad MO (2019) Visual tracking using structural local DCT sparse appearance model with occlusion detection. Multimed Tools Appl 78(6):7243–7266

    Google Scholar 

  131. Kwak KC, Pedrycz W (2005) Face recognition using a fuzzy fisherface classifier. Pattern Recogn 38(10):1717–1732

    Google Scholar 

  132. Kwon B, Lee K (2018) An introduction to face-recognition methods and its implementation in software applications. Int J Inf Technol Manag 17 (1/2):33–43

    Google Scholar 

  133. Lades M, Vorbru̇ggen JC, Buhmann JM, Lange J, von der Malsburg C, Wu̇rtz RP, Konen W (1993) Distortion invariant object recognition in the dynamic link architecture. IEEE Trans Comput 42(3):300–311

    Google Scholar 

  134. Lahasan BM, Lutfi SL, Segundo RS (2019) A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression. Artif Intell Rev 52(2):949–979

    Google Scholar 

  135. Lanitis A, Taylor CJ, Cootes TF (2002) Toward automatic simulation of aging effects on face images. IEEE Trans Pattern Anal Mach Intell 24 (4):442–455

    Google Scholar 

  136. Lanitis A, Draganova C, Christodoulou C (2004) Comparing different classifiers for automatic age estimation. IEEE Trans Syst Man Cybern Part B 34(1):621–628

    Google Scholar 

  137. Lavanya B, Inbarani HH (2018) A novel hybrid approach based on principal component analysis and tolerance rough similarity for face identification. Neural Comput Appl 29(8):289–299

    Google Scholar 

  138. Lee W, Kim J (2018) Social relationship development between human and robot through real-time face identification and emotional interaction. In: ACM/IEEE International conference on human-robot interaction, HRI, Chicago, pp 379

  139. Li D, Prasad M, Hsu S, Hong C, Lin C (2012) Face recognition using nonparametric-weighted fisherfaces. EURASIP J Adv Signal Process 2012:92

    Google Scholar 

  140. Li X, Dai DQ, Zhang X, Ren CX (2013) Structured sparse error coding for face recognition with occlusion. IEEE Trans Image Process 22 (5):1889–1900

    MathSciNet  Google Scholar 

  141. Li H, Hua G, Shen X, Lin Z, Brandt J (2014) Eigen-pep for video face recognition. In: Asian conference on computer vision. Springer, pp 17–33

  142. Li Y, Wang G, Lin L, Chang H (2015) A deep joint learning approach for age invariant face verification. In: CCF Chinese conference on computer vision. Springer, pp 296–305

  143. Li X (2014) Face recognition method based on fuzzy 2dpca. J Electr Comput Eng 2014:919041:1–919041:7

    Google Scholar 

  144. Li Q, Li T, Xia B, Ni M, Liu X, Zhou Q, Qi Y (2016) FIRST: face identity recognition in smart bank. Int J Seman Comput 10(4):569

    Google Scholar 

  145. Li Z, Lai Z, Xu Y, Yang J, Zhang D (2017) A locality-constrained and label embedding dictionary learning algorithm for image classification. IEEE Trans Neural Netw Learn Syst 28(2):278–293

    MathSciNet  Google Scholar 

  146. Li X, Makihara Y, Xu C, Yagi Y, Ren M (2018) Gait-based human age estimation using age group-dependent manifold learning and regression. Multim Tools Appl 77(21):28333–28354

    Google Scholar 

  147. Li X, Song A (2013) Fuzzy MSD based feature extraction method for face recognition. Neurocomputing 122:266–271

    Google Scholar 

  148. Li Y, Wang G, Nie L, Wang Q, Tan W (2018) Distance metric optimization driven convolutional neural network for age invariant face recognition. Pattern Recogn 75:51–62

    Google Scholar 

  149. Liao H (2019) Facial age feature extraction based on deep sparse representation. Multimed Tools Appl 78(2):2181–2197

    Google Scholar 

  150. Liao M, Gu X (2019) Face recognition based on dictionary learning and subspace learning. Digital Signal Process 90:110–124

    MathSciNet  Google Scholar 

  151. Lin S, Zhao Z, Su F (2017) Clustering lightened deep representation for large scale face identification. In: Proceedings of the Second International Conference on Internet of things and Cloud Computing, ICC, Cambridge, pp 101:1–101:5

  152. Lin S, Liu F, Liu Y, Shen L (2019) Local feature tensor based deep learning for 3d face recognition. In: 2019 14Th IEEE international conference on automatic face gesture recognition (FG 2019), pp 1–5

  153. Liu C, Wechsler H (2000) Evolutionary pursuit and its application to face recognition. IEEE Trans Pattern Anal Mach Intell 22(6):570–582

    Google Scholar 

  154. Liu C, Wechsler H (2002) Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476

    Google Scholar 

  155. Liu K, Yan S, Kuo CJ (2015) Age estimation via grouping and decision fusion. IEEE Trans Inf Forensic Secur 10(11):2408–2423

    Google Scholar 

  156. Liu B, Gui L, Wang Y, Wang Y, Shen B, Li X, Wang Y (2017) Class specific centralized dictionary learning for face recognition. Multimed Tools Appl 76(3):4159–4177

    Google Scholar 

  157. Liu W, Wen Y, Yu Z, Li M, Raj B, Song L (2017) Sphereface: Deep hypersphere embedding for face recognition. In: 2017 IEEE Conference on computer vision and pattern recognition, CVPR 2017, Honolulu, pp 6738–6746

  158. Liu X, Lu L, Shen Z, Lu K (2018) A novel face recognition algorithm via weighted kernel sparse representation. Fut Gener Comput Syst 80:653–663

    Google Scholar 

  159. Liu H, Lu J, Feng J, Zhou J (2018) Label-sensitive deep metric learning for facial age estimation. IEEE Trans Inf Forensic Secur 13(2):292–305

    Google Scholar 

  160. Liu J, Liu W, Ma S, Wang M, Li L, Chen G (2019) Image-set based face recognition using k-svd dictionary learning. Int J Mach Learn Cybern 10(5):1051–1064

    Google Scholar 

  161. Liu J, Qiao R, Li Y, Li S (2019) Witness detection in multi-instance regression and its application for age estimation. Multim Tools Appl 78 (23):33703–33722

    Google Scholar 

  162. Liu N, Zhang F, Duan F (2020) Facial age estimation using a multi-task network combining classification and regression. IEEE Access 8:92441–92451

  163. Lu C, Min H, Gui J, Zhu L, Lei Y (2013) Face recognition via weighted sparse representation. J Vis Commun Image Represent 24(2):111–116

    Google Scholar 

  164. Lu C, Tang X (2015) Surpassing human-level face verification performance on LFW with gaussianface. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, pp 3811–3819

  165. Lu X, Wang Y, Jain AK (2003) Combining classifiers for face recognition. In: Proceedings of the IEEE International Conference on Multimedia and Expo, ICME, Baltimore, pp 13–16

  166. Luo J, Ma Y, Takikawa E, Lao S, Kawade M, Lu B (2007) Person-specific SIFT features for face recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP, Honolulu, pp 593–596

  167. Luu K, Zhu C, Bhagavatula C, Le THN, Savvides M (2016) A Deep Learning Approach to Joint Face Detection and Segmentation, pp 1–12

  168. Mahmood A, Uzair M, Al-mȧadeed S (2018) Multi-order statistical descriptors for real-time face recognition and object classification. IEEE Access 6:12993–13004

    Google Scholar 

  169. Malioutov DM, Ċetin M., Willsky AS (2004) Optimal sparse representations in general overcomplete bases. In: IEEE International conference on acoustics, speech, and signal processing, ICASSP, Montreal, pp 793–796

  170. Mandavkar AA, Agawane RV (2015) Mobile based facial recognition using otp verification for voting system. In: 2015 IEEE International advance computing conference (IACC), pp 644–649

  171. Marszalec EA, Martinkauppi JB, Soriano MN, Pietikaeinen M (2000) Physics-based face database for color research. J Electron Imaging 9 (1):32–39

    Google Scholar 

  172. Martinez AM (1998) The ar face database. CVC Technical Report24

  173. Meng F, Tang Z, Wang Z (2017) An improved redundant dictionary based on sparse representation for face recognition. Multimed Tools Appl 76 (1):895–912

    Google Scholar 

  174. Miikkulainen R, Liang J, Meyerson E, Rawal A, Fink D, Francon O, Raju B, Shahrzad H, Navruzyan A, Duffy N et al (2019) Evolving deep neural networks. In: Artificial intelligence in the age of neural networks and brain computing Elsevier, pp 293–312.

  175. Moghaddam B, Jebara T, Pentland A (2000) Bayesian face recognition. Pattern Recogn 33(11):1771–1782

    Google Scholar 

  176. Mohammadi A, Bhattacharjee S, Marcel S (2018) Deeply vulnerable: a study of the robustness of face recognition to presentation attacks. IET Biometr 7(1):15–26

    Google Scholar 

  177. Nakano R, Kobashi S, Alam SB, Morimoto M, Wakata Y, Ando K, Ishikura R, Hirota S, Aikawa S (2015) Neonatal brain age estimation using manifold learning regression analysis. In: 2015 IEEE International conference on systems, man, and cybernetics, Kowloon Tong, pp 2273–2276

  178. Nguyen V, Do T, Nguyen V, Ngo TD, Duong DA (2018) How to choose deep face models for surveillance system?. In: 10Th asian conference on modern approaches for intelligent information and database systems, ACIIDS, Dong Hoi City, Extended Posters, pp 367–376

  179. Nixon MS, Correia P, Nasrollahi K, Moeslund T, Hadid A, Tistarelli M (2015) On soft biometrics. Pattern Recogn Lett 68(2):218–230

    Google Scholar 

  180. Nojavanasghari B, Hughes CE, Baltrusaitis T, Morency LP (2017) Hand2face: Automatic synthesis and recognition of hand over face occlusions. Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), pp 209–215

  181. Osuna E, Freund R, Girosit F (1997) Training support vector machines: an application to face detection. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 130–136

  182. Oulefki A, Mustapha A, Boutellaa E, Bengherabi M, Tifarine AA (2018) Fuzzy reasoning model to improve face illumination invariance. SIViP 12 (3):421–428

    Google Scholar 

  183. Ouyang D, Zhang Y, Shao J (2019) Video-based person re-identification via spatio-temporal attentional and two-stream fusion convolutional networks. Pattern Recogn Lett 117:153–160

    Google Scholar 

  184. Papernot N, McDaniel PD, Jha S, Fredrikson M, Celik ZB, Swami A (2016) The limitations of deep learning in adversarial settings. In: IEEE European symposium on security and privacy, euros&p, Saarbru̇cken, pp 372–387

  185. Parchami M, Bashbaghi S, Granger E, Sayed S (2017) Using deep autoencoders to learn robust domain-invariant representations for still-to-video face recognition. In: 14Th IEEE international conference on advanced video and signal based surveillance, AVSS, Lecce, pp 1–6

  186. Park U, Jain AK (2010) Face matching and retrieval using soft biometrics. IEEE Trans Inf Forensic Secur 5(3):406–415

    Google Scholar 

  187. Pei W, Dibeklioglu H, Baltrusaitis T, Tax DMJ (2020) Attended end-to-end architecture for age estimation from facial expression videos. IEEE Trans Image Process 29:1972–1984

    MathSciNet  Google Scholar 

  188. Peng Y, Li L, Liu S, Lei T (2018) Space-frequency domain based joint dictionary learning and collaborative representation for face recognition. Signal Process 147:101–109

    Google Scholar 

  189. Peng C, Wang N, Li J, Gao X (2019) Re-ranking high-dimensional deep local representation for nir-vis face recognition. IEEE Trans Image Process 28(9):4553–4565

    MathSciNet  Google Scholar 

  190. Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Worek W (2006) Preliminary face recognition grand challenge results. In: 2006. FGR 2006. 7th international conference on Automatic face and gesture recognition. IEEE, pp 15–24

  191. Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The feret database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306

    Google Scholar 

  192. Phillips PJ, Beveridge JR, Draper BA, Givens GH, O’Toole AJ, Bolme DS, Dunlop JP, Lui YM, Sahibzada H, Weimer S (2011) An introduction to the good, the bad, & the ugly face recognition challenge problem. In: Ninth IEEE international conference on automatic face and gesture recognition, Santa Barbara, pp 346–353

  193. Pitas K, Loukas A, Davies M, Vandergheynst P (2019) Some limitations of norm based generalization bounds in deep neural networks. CoRR arXiv:1905.09677

  194. Plenge E, Klein SS, Niessen WJ, Meijering E (2015) Multiple sparse representations classification. PLOS ONE 10(7):1–23

    Google Scholar 

  195. Poder E (2017) Capacity limitations of visual search in deep convolutional neural network. CoRR arXiv:1707.09775

  196. Poon G, Kwan KC, Pang W (2019) Occlusion-robust bimanual gesture recognition by fusing multi-views. Multimed Tools Appl 78 (16):23469–23488

    Google Scholar 

  197. Pujol FA, Pujol M, Jimeno-morenilla A, Pujol MJ (2017) Face detection based on skin color segmentation using fuzzy entropy. Entropy 19(1):26

    Google Scholar 

  198. Punyani P, Gupta R, Kumar A (2020) Neural networks for facial age estimation: a survey on recent advances. Artif Intell Rev 53(5):3299–3347

    Google Scholar 

  199. Qian J, Yang J, Zhang F, Lin Z (2014) Robust low-rank regularized regression for face recognition with occlusion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp 21–26

  200. Qian J (2018) A survey on sentiment classification in face recognition. J Phys Conf Ser 960:012030

  201. Queirolo CC, Silva L, Bellon ORP, Segundo MP (2010) 3d face recognition using simulated annealing and the surface interpenetration measure. IEEE Trans Pattern Anal Mach Intell 32(2): 206–219

    Google Scholar 

  202. Rejeesh MR (2019) Interest point based face recognition using adaptive neuro fuzzy inference system. Multimed Tools Appl 78(16):22691–22710

    Google Scholar 

  203. Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: 4Th international conference on learning representations, ICLR 2016, San Juan, Conference Track Proceedings

  204. Raghavendra R, Raja KB, Venkatesh S, Cheikh FA, Busch C (2017) On the vulnerability of extended multispectral face recognition systems towards presentation attacks. In: IEEE International conference on identity, security and behavior analysis, ISBA, New Delhi, pp 1–8

  205. Rajan S, Chenniappan P, Devaraj S, Madian N (2019) Facial expression recognition techniques: a comprehensive survey. IET Image Process 13 (7):1031–1040

    Google Scholar 

  206. Rakshit RD, Nath SC, Kisku DR (2018) Face identification using some novel local descriptors under the influence of facial complexities. Expert Syst Appl 92:82–94

    Google Scholar 

  207. Ramalingam S (2018) Fuzzy interval-valued multi criteria based decision making for ranking features in multi-modal 3d face recognition. Fuzzy Sets Syst 337:25–51

    MathSciNet  Google Scholar 

  208. Ranjan R, Sankaranarayanan S, Bansal A, Bodla N, Chen J, Patel VM, Castillo CD, Chellappa R (2018) Deep learning for understanding faces: Machines may be just as good, or better, than humans. IEEE Signal Process Mag 35(1):66–83

    Google Scholar 

  209. Rassadin A, Gruzdev A, Savchenko A (2017) Group-level emotion recognition using transfer learning from face identification. In: Proceedings of the 19th ACM International Conference on Multimodal Interaction, ICMI, pp 544–548

  210. Roberts LG (1963) Machine perception of three-dimensional solids. Ph.D. thesis Massachusetts Institute of Technology

  211. Rubinstein R, Bruckstein AM, Elad M (2010) Dictionaries for sparse representation modeling. Proc IEEE 98(6):1045–1057

    Google Scholar 

  212. Saeed U, Khan MM (2018) Combining ear-based traditional and soft biometrics for unconstrained ear recognition. J Electron Imaging 27(05):051220

  213. Sajjad M, Nasir M, Ullah FUM, Muhammad K, Sangaiah AK, Baik SW (2019) Raspberry pi assisted facial expression recognition framework for smart security in law-enforcement services. Inf Sci 479:416–431

    Google Scholar 

  214. Salici A, Ciampini C (2017) Automatic face recognition and identification tools in the forensic science domain. In: International tyrrhenian workshop on digital communication. Springer, pp 8–17

  215. Sargano AB, Wang X, Angelov P, Habib Z (2017) Human action recognition using transfer learning with deep representations. In: International joint conference on neural networks, IJCNN, Anchorage, pp 463–469

  216. Savran A, Alyüz N., Dibeklioġlu H, Ċeliktutan O, Gökberk B, Sankur B, Akarun L (2008) Bosphorus database for 3d face analysis. In: European workshop on biometrics and identity management. Springer, pp 47–56

  217. Sawant MM, Bhurchandi KM (2019) Age invariant face recognition: a survey on facial aging databases, techniques and effect of aging. Artif Intell Rev 52(2):981–1008

    Google Scholar 

  218. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 815–823

  219. Sepas-Moghaddam A, Pereira F, Correia PL (2019) Face recognition: A novel multi-level taxonomy based survey. CoRR arXiv:1901.00713

  220. Serre T, Wolf L, Poggio T (2005) Object recognition with features inspired by visual cortex. In: IEEE Computer society conference on computer vision and pattern recognition (CVPR), vol 2, pp 994–1000

  221. Shang K, Huang Z, Liu W, Li Z (2018) A single gallery-based face recognition using extended joint sparse representation. Appl Math Comput 320:99–115

    Google Scholar 

  222. Shao C, Song X, Feng Z, Wu X, Zheng Y (2017) Dynamic dictionary optimization for sparse-representation-based face classification using local difference images. Inf Sci 393:1–14

    Google Scholar 

  223. Shi B, Bai X, Liu W, Wang J (2018) Face alignment with deep regression. IEEE Trans Neural Netw Learn Syst 29(1):183–194

    MathSciNet  Google Scholar 

  224. Sim T, Baker S, Bsat M (2001) The cmu pose, illumination, and expression (pie) database of human faces. Tech. Rep. CMU-RI-TR-01-02, Carnegie Mellon University, Pittsburgh

  225. Sim T, Baker S, Bsat M (2002) The cmu pose, illumination, and expression (pie) database. In: Proceedings of Fifth IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, pp 53–58

  226. Sing JK, Dey A, Ghosh M (2019) Confidence factor weighted gaussian function induced parallel fuzzy rank-level fusion for inference and its application to face recognition. Inf Fus 47:60–71

    Google Scholar 

  227. Sirovich L, Kirby M (1987) Low-dimensional procedure for the characterization of human faces. J Opt Soc Am A 4(3):519–524

    Google Scholar 

  228. Skocaj D, Leonardis A, Bischof H (2007) Weighted and robust learning of subspace representations. Pattern Recognit 40(5):1556–1569

    Google Scholar 

  229. Soltanpour S, Boufama B, Wu QMJ (2017) A survey of local feature methods for 3d face recognition. Pattern Recogn 72:391–406

    Google Scholar 

  230. Stonham TJ (1986) Practical Face Recognition and Verification with Wisard. Springer, Netherlands, pp 426–441

    Google Scholar 

  231. Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: IEEE Conference on computer vision and pattern recognition, Portland, pp 3476–3483

  232. Sun Y, Wang X, Tang X (2013) Hybrid deep learning for face verification. In: IEEE International conference on computer vision, ICCV, Sydney, pp 1489–1496

  233. Sun Y, Wang X, Tang X (2014) Deep learning face representation from predicting 10, 000 classes. In: IEEE Conference on computer vision and pattern recognition, CVPR, Columbus, pp 1891–1898

  234. Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2, NIPS, pp 1988–1996

  235. Sun Y, Liang D, Wang X, Tang X (2015) Deepid3: Face recognition with very deep neural networks. CoRR arXiv:1502.00873

  236. Su Y, Yang Y, Guo Z, Yang W (2015) Face recognition with occlusion. In: 3Rd IAPR asian conference on pattern recognition (ACPR), pp 670–674

  237. Sun Y, Zhang M, Sun Z, Tan T (2018) Demographic analysis from biometric data: achievements, challenges, and new frontiers. IEEE Trans Pattern Anal Mach Intell 40(2):332–351

    Google Scholar 

  238. Sun P, Liu H, Wang X, Yu Z, Suping W (2019) Similarity-aware deep adversarial learning for facial age estimation. In: IEEE International conference on multimedia and expo, ICME 2019, Shanghai, pp 260–265

  239. Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650

    MathSciNet  Google Scholar 

  240. Tang J, Li Z, Zhu X (2018) Supervised deep hashing for scalable face image retrieval. Pattern Recogn 75:25–32

    Google Scholar 

  241. Tang Z, Wu X, Fu B, Chen W, Feng H (2018) Fast face recognition based on fractal theory. Appl Math Comput 321:721–730

    MathSciNet  Google Scholar 

  242. The fei face image database available online:. https://fei.edu.br/~cet/facedatabase.html. Accessed: 2019-07-23

  243. The texas 3d face database, available online:. http://live.ece.utexas.edu/research/texas3dfr/. Accessed: 2019-07-23

  244. The university of stirling face database, available online. http://pics.stir.ac.uk/. Accessed: 2019-06-23

  245. The university of york 3d face database, available online:. https://www-users.cs.york.ac.uk/nep/research/3Dface/tomh/3DFaceDatabase.html. Accessed: 2019-07-23

  246. Tolba AS (2000) A parameter-based combined classifier for invariant face recognition. Cybern Syst 31(8):837–849

    MathSciNet  Google Scholar 

  247. Tome-Gonzalez P, Fiėrrez J, Vera-Rodríguez R, Nixon MS (2014) Soft biometrics and their application in person recognition at a distance. IEEE Trans Inf Forensic Secur 9(3):464–475

    Google Scholar 

  248. Tosic I, Frossard P (2011) Dictionary learning. IEEE Signal Proc Mag 28(2):27–38

    Google Scholar 

  249. Tsai C, Shih K (2019) Mining a new biometrics to improve the accuracy of keystroke dynamics-based authentication system on free-text. Appl Soft Comput 80:125–137

    Google Scholar 

  250. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Google Scholar 

  251. Vezzetti E, Marcolin F, Tornincasa S, Ulrich L, Dagnes N (2018) 3d geometry-based automatic landmark localization in presence of facial occlusions. Multimed Tools Appl 77(11):14177–14205

    Google Scholar 

  252. Viola PA, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Google Scholar 

  253. Vishwakarma VP, Goel T (2019) An efficient hybrid dwt-fuzzy filter in DCT domain based illumination normalization for face recognition. Multimed Tools Appl 78(11):15213–15233

    Google Scholar 

  254. Vishwakarma VP, Dalal S (2020) A novel non-linear modifier for adaptive illumination normalization for robust face recognition. Multim Tools Appl 79(17-18):11503–11529

    Google Scholar 

  255. Wagner A, Wright J, Ganesh A, Zhou Z, Ma Y (2009) Towards a practical face recognition system: Robust registration and illumination by sparse representation. In: IEEE Computer society conference on computer vision and pattern recognition (CVPR ), Miami, pp 597–604

  256. Wang Y, Anderson PG, Gaborski RS (2009) Face recognition using a hybrid model. In: IEEE Applied imagery pattern recognition workshop, Washington, pp 1–8

  257. Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, pp 1225–1234

  258. Wang H, Hu J, Deng W (2018) Face feature extraction: A complete review. IEEE Access 6:6001–6039

  259. Wang L, Wang Y, Liu B (2018) Laplace graph embedding class specific dictionary learning for face recognition. J Electr Comput Eng 2018:2179049:1–2179049:11

    MathSciNet  Google Scholar 

  260. Wang K, Peng X, Yang J, Meng D, Qiao Y (2020) Region attention networks for pose and occlusion robust facial expression recognition. IEEE Trans Image Process 29:4057–4069

    Google Scholar 

  261. Wen Y, Li Z, Qiao Y (2016) Latent factor guided convolutional neural networks for age-invariant face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4893–4901

  262. Wen Y, Zhang K, Li Z, Qiao Y (2016) A discriminative feature learning approach for deep face recognition. In: Computer vision - ECCV 2016 - 14th european conference, Amsterdam, Proceedings, Part VII, pp 499–515

  263. Wiskott L, Krüger N, Kuiger N, von der Malsburg C (1997) Face recognition by elastic bunch graph matching. IEEE Trans Pattern Anal Mach Intell 19(7):775–779

    Google Scholar 

  264. Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: IEEE Biometrics workshop, computer vision and pattern recognition (CVPR) workshops. IEEE, pp 81–88

  265. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Google Scholar 

  266. Wright J, Ma Y, Mairal J, Sapiro G, Huang TS, Yan S (2010) Sparse representation for computer vision and pattern recognition. Proc IEEE 98(6):1031–1044

    Google Scholar 

  267. Wu H, Shao J, Xu X, Ji Y, Shen F, Shen HT (2018) Recognition and detection of two-person interactive actions using automatically selected skeleton features. IEEE Trans Hum-Mach Syst 48(3):304–310

    Google Scholar 

  268. Wu F, Jing X, Dong X, Hu R, Yue D, Wang L, Ji Y, Wang R, Chen G (2020) Intraspectrum discrimination and interspectrum correlation analysis deep network for multispectral face recognition. IEEE Trans Cybern 50 (3):1009–1022

    Google Scholar 

  269. Xie J, Pun C (2019) Chronological age estimation under the guidance of age-related facial attributes. IEEE Trans Inf Forensic Secur 14 (9):2500–2511

    Google Scholar 

  270. Xie J, Pun C (2020) Deep and ordinal ensemble learning for human age estimation from facial images. IEEE Trans Inf Forensic Secur 15:2361–2374

    Google Scholar 

  271. Xu J, Ma S, Zhang Y, Wei B, Cai X, Sun X (2017) Transfer deep learning for low-resource chinese word segmentation with a novel neural network. In: Natural language processing and chinese computing - 6th CCF international conference, NLPCC 2017, Dalian, Proceedings, pp 721–730

  272. Xu Y, Zhong Z, Yang J, You J, Zhang D (2017) A new discriminative sparse representation method for robust face recognition via l2 regularization. IEEE Trans Neural Netw Learn Syst 28(10): 2233–2242

    MathSciNet  Google Scholar 

  273. Xue Y Non-negative matrix factorization for face recognition. Ph.D. thesis (2007). AAI3302378

  274. Yang M (2002) Kernel eigenfaces vs. kernel fisherfaces: Face recognition using kernel methods. In: 5Th IEEE international conference on automatic face and gesture recognition (FGR), Washington, pp 215–220

  275. Yang W, Yan H, Wang J, Yang J (2008) Face recognition using complete fuzzy LDA. In: 19Th international conference on pattern recognition (ICPR), Tampa, pp 1–4

  276. Yang M, Zhang L, Yang J, Zhang D (2011) Robust sparse coding for face recognition. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 625–632

  277. Yang M, Zhang L, Yang J, Zhang D (2013) Regularized robust coding for face recognition. IEEE Trans Image Process 22(5):1753–1766

    MathSciNet  Google Scholar 

  278. Yin X, Yu X, Sohn K, Liu X, Chandraker M (2018) Feature transfer learning for deep face recognition with long-tail data. CoRR arXiv:1803.09014

  279. Ying Han P, Jin ATB, Heng Siong L (2011) Eigenvector weighting function in face recognition. Discrete Dynamics in Nature and Society

  280. Yoo B, Kwak Y, Kim Y, Choi C, Kim J (2018) Deep facial age estimation using conditional multitask learning with weak label expansion. IEEE Signal Process Lett 25(6):808–812

    Google Scholar 

  281. Yu D, Wu X (2018) 2dpcanet: a deep leaning network for face recognition. Multimed Tools Appl 77(10):12919–12934

    Google Scholar 

  282. Yuille AL, Hallinan PW, Cohen DS (1992) Feature extraction from faces using deformable templates. Int J Comput Vis 8(2):99–111

    Google Scholar 

  283. Zadeh LA (1965) Fuzzy sets. Inf Control 8(3):338–353

    Google Scholar 

  284. Zafar U, Ghafoor M, Zia T, Ahmed G, Latif A, Malik KR, Sharif AM (2019) Face recognition with bayesian convolutional networks for robust surveillance systems. EURASIP J Image Video Process 2019:10

    Google Scholar 

  285. Zhang X, Gao Y (2009) Face recognition across pose: A review. Pattern Recogn 42(11):2876–2896

    Google Scholar 

  286. Zhang X, Gao Y (2009) Face recognition across pose: A review. Pattern Recogn 42(11):2876–2896

    Google Scholar 

  287. Zhang Q, Li B (2010) Discriminative k-SVD for dictionary learning in face recognition. In: The twenty-third IEEE conference on computer vision and pattern recognition, CVPR, San Francisco, pp 2691–2698

  288. Zhang L, Zhou W, Chang P, Liu J, Yan Z, Wang T, Li F (2012) Kernel sparse representation-based classifier. IEEE Trans Signal Process 60(4):1684–1695

    MathSciNet  Google Scholar 

  289. Zhang H, Zhang Y, Huang TS (2013) Pose-robust face recognition via sparse representation. Pattern Recognit 46(5):1511–1521

    Google Scholar 

  290. Zhang Z, Xu Y, Yang J, Li X, Zhang D (2015) A survey of sparse representation: Algorithms and applications. IEEE Access 3:490–530

    Google Scholar 

  291. Zhang S, Li X, He H, Miao Y (2018) A next best view method based on self-occlusion information in depth images for moving object. Multimed Tools Appl 77(8):9753–9777

    Google Scholar 

  292. Zhang Y, Shao J, Ouyang D, Shen HT (2018) Person re-identification using two-stage convolutional neural network. In: 24Th international conference on pattern recognition, ICPR 2018, Beijing, pp 3341–3346

  293. Zhang Y, Hu C, Lu X (2019) IL-GAN: illumination-invariant representation learning for single sample face recognition. J Vis Commun Image Represent 59:501–513

  294. Zhang W, Zhao X, Morvan J, Chen L (2019) Improving shadow suppression for illumination robust face recognition. IEEE Trans Pattern Anal Mach Intell 41(3):611–624

    Google Scholar 

  295. Zhang F, Zhang T, Mao Q, Xu C (2020) Geometry guided pose-invariant facial expression recognition. IEEE Trans Image Process 29:4445–4460

    Google Scholar 

  296. Zhang L, Luo F (2020) Review on graph learning for dimensionality reduction of hyperspectral image. Geo spatial Inf Sci 23(1):98–106

    Google Scholar 

  297. Zhang M, Li Y, Wang N, Chi Y, Gao X (2020) Cascaded face sketch synthesis under various illuminations. IEEE Trans Image Process 29:1507–1521

    MathSciNet  Google Scholar 

  298. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458

    Google Scholar 

  299. Zhao W, Chellappa R (1999) Robust face recognition using symmetric shape-from-shading. Computer Vision Laboratory, Center for Automation Research. University of Maryland Maryland, Md

  300. Zhao W, Chellappa R, Phillips PJ (1999) Subspace linear discriminant analysis for face recognition. Citeseer

  301. Zheng Y, Yang J, Wang W, Wang Q, Yang J, Wu X (2006) Fuzzy kernel fisher discriminant algorithm with application to face recognition. 6th World Congress Intell Control Autom 2:9669–9672

  302. Zheng Y, Elmaghraby A (2011) A brief survey on multispectral face recognition and multimodal score fusion. In: IEEE International symposium on signal processing and information technology, ISSPIT, pp 543–550

  303. Zhi R, Liu M, Zhang D (2020) A comprehensive survey on automatic facial action unit analysis. Vis Comput 36(5):1067–1093

    Google Scholar 

  304. Zhong Y, Den W (2019) Exploring features and attributes in deep face recognition using visualization techniques. In: 2019 14Th IEEE international conference on automatic face gesture recognition (FG 2019), pp 1–8

  305. Zhu C, Zheng Y, Luu K, Savvides M (2017) CMS-RCNN: Contextual Multi-Scale Region-Based CNN For Unconstrained Face Detection. Springer International Publishing, Cham, pp 57–79

    Google Scholar 

  306. Zhu S, Yu K (2018) Concept transfer learning for adaptive language understanding. In: Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, Melbourne, pp 391–399

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China

    Waqar Ali & Abdullah Aman Khan

  2. Faculty of Information Technology, The University of Lahore, Lahore, 54000, Pakistan

    Waqar Ali

  3. School of Information and Software Engineerng, University of Electronic Science and Technology of China, Chengdu, 611731, China

    Wenhong Tian

  4. Data Mining Lab, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China

    Salah Ud Din

  5. School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China

    Desire Iradukunda

Authors
  1. Waqar Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenhong Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Salah Ud Din
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Desire Iradukunda
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Abdullah Aman Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Waqar Ali.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, W., Tian, W., Din, S.U. et al. Classical and modern face recognition approaches: a complete review. Multimed Tools Appl 80, 4825–4880 (2021). https://doi.org/10.1007/s11042-020-09850-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09850-1

Keywords

Search

Navigation