A Comprehensive Review on Face Recognition Methods and Factors Affecting Facial Recognition Accuracy

  • Shahina AnwarulEmail author
  • Susheela Dahiya
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 597)


As of late, the need for biometric security framework is elevated for giving safety and security against frauds, theft, and so on. Face recognition has gained a significant position among all biometric-based systems. It can be used for authentication and surveillance to prove the identity of a person and detect individuals, respectively. In this paper, a point-by-point outline of some imperative existing strategies which are accustomed to managing the issues of face recognition has been introduced along with their face recognition accuracy and the factors responsible to degrade the performance of the study. In the first section of this paper, different factors that degrade the facial recognition accuracy have been investigated like aging, pose variation, partial occlusion, illumination, facial expressions, and so on. While in the second section, different techniques have been discussed that worked to mitigate the effect of discussed factors.


Face detection Face recognition Biometric security framework Authentication Surveillance 


  1. 1.
    Yu, S., Lu, Y., Zhou, J.: A survey of face detection, extraction and recognition. J. Comput. Inf. 22, 163–195 (2003)Google Scholar
  2. 2.
    Sharif, M., Naz, F., Yasmin, M., Shahid, M.A., Rehman, A.: Face recognition: a survey. J. Eng. Sci. Technol. Rev. 10(2), 166–177 (2017)CrossRefGoogle Scholar
  3. 3.
    Patel, R., Rathod, N., Shah, A.: Comparative analysis of face recognition approaches: a survey. Int. J. Comput. Appl. 57(17), 50–61 (2012)Google Scholar
  4. 4.
    Khade, B.S., Gaikwad, H.M., Aher, A.S., Patil, K.K.: Face recognition techniques: a survey. Int. J. Comput. Sci. Mob. Comput. 5(11), 65–72 (2016)Google Scholar
  5. 5.
    Fu, T., Chiu, W., Wang, Y.F.: Learning guided convolutional neural networks for cross-resolution face recognition. In: 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP) (2017)Google Scholar
  6. 6.
    Zhang, W., Shan, S., Chen, X., Gao, W.: Local Gabor binary patterns based on Kullback–Leibler divergence for partially occluded face recognition. IEEE Sig. Process. Lett. 14(11), 875–878 (2007)CrossRefGoogle Scholar
  7. 7.
    Zou, W.W.W., Yuen, P.C.: Very low resolution face recognition problem. IEEE Trans. Image Process. 21(1), 327–340 (2012)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Tin, H.H.K.: Removal of noise by median filtering in image processing. In: 6th Parallel and Soft Computing (PSC 2011) Removal (2011)Google Scholar
  9. 9.
    Luo, Z., Hu, J., Deng, W., Shen, H.: Deep unsupervised domain adaptation for face recognition. In: 13th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 453–457 (2018)Google Scholar
  10. 10.
    Abdullah, N.A., et al.: Face recognition for criminal identification: an implementation of principal component analysis for face recognition. In: The 2nd International Conference on Applied Science and Technology 2017 (ICAST’17) (2017)Google Scholar
  11. 11.
    Ding, C., Member, S., Xu, C., Tao, D.: Multi-task pose-invariant face recognition. IEEE Trans. Image Process. 24(3), 980–993 (2015)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Wang, P., Lin, W., Chao, K.-M., Lo, C.-C.: A face-recognition approach using deep reinforcement learning approach for user authentication. In: Fourteenth IEEE International Conference on e-Business Engineering, pp. 183–188 (2017)Google Scholar
  13. 13.
    Ahonen, T., Hadid, A., Pietika, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefGoogle Scholar
  14. 14.
    Li, S.Z., Member, S., Chu, R., Liao, S., Zhang, L.: Using near-infrared images. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 627–639 (2007)CrossRefGoogle Scholar
  15. 15.
    Kavitha, J., Mirnalinee, T.T.: Automatic frontal face reconstruction approach for pose invariant face recognition. In: Proceedings of the 4th International Conference on Recent Trends in Computer Science & Engineering, Elsevier, vol. 87, pp. 300–305 (2016)Google Scholar
  16. 16.
    Banerjee, S., et al.: To frontalize or not to frontalize: do we really need elaborate pre-processing to improve face recognition ? In: IEEE Winter Conference on Applications of Computer Vision, pp. 20–29 (2018)Google Scholar
  17. 17.
    Gao, Y., Jong, H.: Cross-pose face recognition based on multiple virtual views and alignment error. Pattern Recognit. Lett. 65, 170–176 (2015)CrossRefGoogle Scholar
  18. 18.
    Singh, R., Vatsa, M.: A mosaicing scheme for pose-invariant face recognition. IEEE Trans. Syst. Man Cybern. B Cybern. 37(5), 1212–1225 (2007)Google Scholar
  19. 19.
    Zhou, H., Lam, K.: Age-invariant face recognition based on identity inference from appearance age. J. Pattern Recognit. 76, 191–202 (2018)CrossRefGoogle Scholar
  20. 20.
    Li, Z., Park, U., Jain, A.K.: A discriminative model for age invariant face recognition. IEEE Trans. Inf. Forensics Secur. 6(3), 1028–1037 (2011)CrossRefGoogle Scholar
  21. 21.
    Mun, M., Deorankar, P.A.: Implementation of plastic surgery face recognition using multimodal biometric features. Int. J. Comput. Sci. Inf. Technol. 5(3), 3711–3715 (2014)Google Scholar
  22. 22.
    Dass, R., Rani, R., Kumar, D.: Face recognition techniques: a review. Int. J. Eng. Res. Dev. 4(7), 70–78 (2012)Google Scholar
  23. 23.
    Khan, A., et al.: Forensic video analysis: passive tracking system for automated Person of Interest (POI) localization. IEEE Access 6, 43392–43403 (2018)CrossRefGoogle Scholar
  24. 24.
    Chawla, D., Trivedi, M.C.: A comparative study on face detection techniques for security surveillance. In: Advances in Computer and Computational Sciences, pp. 531–541 (2018)Google Scholar
  25. 25.
    Dhamija, J., Choudhary, T., Kumar, P., Rathore, Y.S.: An advancement towards efficient face recognition using live video feed. In: International Conference on Computational Intelligence and Networks (CINE), pp. 53–56 (2017)Google Scholar
  26. 26.
    Baykara, M., Daş, R.: Real time face recognition and tracking system. In: International Conference on Electronics, Computer and Computation, pp. 159–163 (2013)Google Scholar
  27. 27.
    Gosavi, V.R., Sable, G.S., Deshmane, A.K.: Evaluation of feature extraction techniques using neural network as a classifier: a comparative review for face recognition. Int. J. Sci. Res. Sci. Technol. 4(2), 1082–1091 (2018)Google Scholar
  28. 28.
    Bhavani, K., et al.: Real time face detection and recognition in video surveillance. Int. Res. J. Eng. Technol. 4(6), 1562–1565 (2017)Google Scholar
  29. 29.
    Kakkar, P., Sharma, V.: Criminal identification system using face detection and recognition. Int. J. Adv. Res. Comput. Commun. Eng. 7(3), 238–243 (2018)Google Scholar
  30. 30.
    Harsing, A., Talbar, S.N., Amarsing, H.: Recognition of plastic surgery faces and the surgery types: an approach with entropy based scale invariant features. J. King Saud Univ. Comput. Inf. Sci. 1–7 (2017)Google Scholar
  31. 31.
    Sameem, M.S.I., Qasim, T., Bakhat, K.: Real time recognition of human faces. In: International Conference on Open Source Systems & Technologies, pp. 62–65 (2016)Google Scholar
  32. 32.
    Hong, Y., Li, Q., Jiang, J., Tu, Z.: Learning a mixture of sparse distance metrics for classification and dimensionality reduction. In: IEEE International Conference on Computer Vision, pp. 906–913 (2011)Google Scholar
  33. 33.
    Gaikawad, P.A.D., Sonawane, P.P.D.: An efficient video surveillance system using video based face recognition on real world data. Int. J. Sci. Eng. Technol. Res. 5(4), 1245–1250 (2016)Google Scholar
  34. 34.
    Ding, C., Tao, D.: Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 1002–1014 (2018)CrossRefGoogle Scholar
  35. 35.
    Hu, G., et al.: When face recognition meets with deep learning: an evaluation of convolutional neural networks for face recognition. In: IEEE International Conference on Computer Vision Workshops, pp. 384–392 (2015)Google Scholar
  36. 36.
    Huang, Z., et al.: A benchmark and comparative study of video-based face recognition on COX face database. IEEE Trans. Image Process. 24(12), 5967–5981 (2015)MathSciNetCrossRefGoogle Scholar
  37. 37.
    Hassner, T., Enbar, R.: Effective face frontalization in unconstrained images. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295–4304 (2015)Google Scholar
  38. 38.
    Fathima, A.A., Ajitha, S., Vaidehi, V., Hemalatha, M., Karthigaiveni, R., Kumar, R.: Hybrid approach for face recognition combining gabor wavelet and linear discriminant analysis. In: IEEE International Conference on Computer Graphics, Vision and Information Security, pp. 220–225 (2015)Google Scholar
  39. 39.
    Lei, Z., Wang, C., Wang, Q., Huang, Y.: Real-time face detection and recognition for video surveillance applications. In: 2009 World Congress on Computer Science and Information Engineering Real-time, pp. 168–172 (2009)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.University of Petroleum and Energy StudiesDehradunIndia

Personalised recommendations