Skip to main content
SpringerLink
Log in

A Discriminative Face Geometric Feature-Based Face Recognition

  • Research Article - Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Numerous feature descriptors have been proposed for holistic facial analysis with satisfactory performances. However, few studies have been conducted on how to model the concept of facial beauty for face-related tasks. In addition, existing learning-based face recognition methods suffer from efficiency problems and rely heavily on a sufficient database. In this paper, we develop an efficient method which leverages the perception of human facial beauty for face recognition. Our work is notably different from previous face recognition works in several aspects: (1) we derive a set of facial features based on the fruits of facial attractiveness and beauty analysis research; (2) compared with traditional optimization-based learning methods, we propose simple yet effective C4.5 decision tree as classification model; (3) proposed method is invariant to both gesture variations and facial occlusions, which achieves good performance compared with a series of state-of-the-art methods. More importantly, we propose visualization experiments to verify the discriminative attributes of extracted features. In this paper, we start by preprocessing images in order to enhance image quality. Then, inspired by the facial beauty research, we design a set of new feature descriptors defined as natural feature. The extracted natural feature is embedded into C4.5 decision tree for supervised learning and classification. Extensive experiments are conducted on the AR database, FRGC database and Extended Yale B database. Comprehensive experiments and in-depth analysis verify the effectiveness and competitiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kong, S.G.; Heo, J.; Abidi, B.R.; Paik, J.; Abidi, M.A.: Recent advances in visual and infrared face recognition a review. Comput. Vis. Image Underst. 97(1), 103–135 (2005)

    Article  Google Scholar 

  2. Galbally, J.; Marcel, S.; Fierrez, J.: Image quality assessment for fake biometric detection: application to iris, fingerprint, and face recognition. IEEE Trans. Image Process. 23(2), 710–724 (2014)

    Article  MathSciNet  Google Scholar 

  3. Wright, J.; Yang, A.Y.; Ganesh, A.; Sastry, S.S.; Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)

    Article  Google Scholar 

  4. Wagner, A.; Wright, J.; Ganesh, A.; Zhou, Z.; Mobahi, H.; Ma, Y.: Toward a practical face recognition system: robust alignment and illumination by sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 34(2), 372–386 (2012)

    Article  Google Scholar 

  5. Viola, P.; Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001. CVPR 2001, vol. 1, pp. I–I. IEEE (2001)

  6. Déniz, O.; Bueno, G.; Salido, J.; De la Torre, F.: Face recognition using histograms of oriented gradients. Pattern Recognit. Lett. 32(12), 1598–1603 (2011)

    Article  Google Scholar 

  7. Geng, C.; Jiang, X.: Face recognition using sift features. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 3313–3316. IEEE (2009)

  8. Ojala, T.; Pietikainen, M.; Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  9. Wu, X.; Sun, J.: Joint-scale LBP: a new feature descriptor for texture classification. Vis. Comput. 33(3), 317–329 (2017)

    Article  Google Scholar 

  10. Huang, D.; Ardabilian, M.; Wang, Y.; Chen, L.: A novel geometric facial representation based on multi-scale extended local binary patterns. In: 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops (FG 2011), pp. 1–7. IEEE (2011)

  11. Tan, X.; Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  12. Karczmarek, P.; Kiersztyn, A.; Pedrycz, W.; Dolecki, M.: An application of chain code-based local descriptor and its extension to face recognition. Pattern Recognit. 65, 26–34 (2017)

    Article  Google Scholar 

  13. Pearson, K.: LIII. On lines and planes of closest fit to systems of points in space. Lond. Edinb. Dublin Philos. Mag. J. Sci. 2(11), 559–572 (1901)

    Article  Google Scholar 

  14. Liu, Q.; Zhang, C.; Guo, Q.; Hui, X.; Zhou, Y.: Adaptive sparse coding on PCA dictionary for image denoising. Vis. Comput. 32(4), 535–549 (2016)

    Article  Google Scholar 

  15. Bhardwaj, A.; Raman, S.: Robust PCA-based solution to image composition using augmented Lagrange multiplier (ALM). Vis. Comput. 32(5), 591–600 (2016)

    Article  Google Scholar 

  16. Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Hum. Genet. 7(2), 179–188 (1936)

    Google Scholar 

  17. Comon, P.: Independent component analysis, a new concept? Signal Process. 36(3), 287–314 (1994)

    Article  Google Scholar 

  18. Cao, Z.; Yin, Q.; Tang, X.; Sun, J.: Face recognition with learning-based descriptor. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2707–2714. IEEE (2010)

  19. Mohammed, A.A.; Minhas, R.; Wu, Q.M.J.; Sid-Ahmed, M.A.: Human face recognition based on multidimensional PCA and extreme learning machine. Pattern Recognit. 44(10), 2588–2597 (2011)

    Article  Google Scholar 

  20. Lu, G.-F.; Zou, J.; Wang, Y.: Incremental complete LDA for face recognition. Pattern Recognit. 45(7), 2510–2521 (2012)

    Article  Google Scholar 

  21. Jing, X.-Y.; Wong, H.-S.; Zhang, D.: Face recognition based on 2D fisherface approach. Pattern Recognit. 39(4), 707–710 (2006)

    Article  Google Scholar 

  22. Zhang, L.; Yang, M.; Feng, X.: Sparse representation or collaborative representation: which helps face recognition? In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 471–478. IEEE (2011)

  23. Liu, M.; Shan, S.; Wang, R.; Chen, X.: Learning expressionlets on spatio-temporal manifold for dynamic facial expression recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1749–1756 (2014)

  24. Liu, M.; Wang, R.; Li, S.; Shan, S.; Huang, Z.; Chen, X.: Combining multiple kernel methods on riemannian manifold for emotion recognition in the wild. In: Proceedings of the 16th International Conference on Multimodal Interaction, pp. 494–501. ACM, New York (2014)

  25. Sun, Y.; Wang, X.; Tang, X.: Deep learning face representation from predicting 10,000 classes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1891–1898 (2014)

  26. Taigman, Y.; Yang, M.; Ranzato, M.A.; Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1701–1708 (2014)

  27. Schroff, F.; Kalenichenko, D.; Philbin, J.: Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)

  28. Parkhi, O.M.; Vedaldi, A.; Zisserman, A.; et al.: Deep face recognition. BMVC 1, 6 (2015)

    Google Scholar 

  29. Wen, Y.; Zhang, K.; Li, Z.; Qiao, Y.: A discriminative feature learning approach for deep face recognition. In: European Conference on Computer Vision, pp. 499–515. Springer, Berlin (2016)

    Google Scholar 

  30. Zhang, D.; Chen, F.; Xu, Y.: Computer Models for Facial Beauty Analysis. Springer, Berlin (2016)

    Book  Google Scholar 

  31. Zhang, D.; Zhao, Q.; Chen, F.: Quantitative analysis of human facial beauty using geometric features. Pattern Recognit. 44(4), 940–950 (2011)

    Article  Google Scholar 

  32. Schmid, K.; Marx, D.; Samal, A.: Computation of a face attractiveness index based on neoclassical canons, symmetry, and golden ratios. Pattern Recognit. 41(8), 2710–2717 (2008)

    Article  Google Scholar 

  33. Luo, L.; Hu, S.; Cai, J.; Tang, F.; Qiu, Z.; Hu, X.: Face classification based on natural features and decision tree. In: 2016 International Conference on Virtual Reality and Visualization (ICVRV), pp. 1–7. IEEE (2016)

  34. Pallett, P.M.; Link, S.; Lee, K.: New golden ratios for facial beauty. Vis. Res. 50(2), 149–154 (2010)

    Article  Google Scholar 

  35. Laurentini, A.; Bottino, A.: Computer analysis of face beauty: a survey. Comput. Vis. Image Underst. 125, 184–199 (2014)

    Article  Google Scholar 

  36. Martinez, A.M.: The AR face database. CVC technical report (1998)

  37. Phillips, P.J.; Flynn, P.J.; Scruggs, T.; Bowyer, K.W.; Chang, J.; Hoffman, K.; Marques, J.; Min, J.; Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 947–954. IEEE (2005)

  38. Georghiades, A.S.; Belhumeur, P.N.; Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)

    Article  Google Scholar 

  39. Rohrich, R.J.; Ghavami, A.; Crosby, M.A.: The role of hyaluronic acid fillers (restylane) in facial cosmetic surgery: review and technical considerations. Plast. Reconstr. Surg. 120(6S), 41S–54S (2007)

    Article  Google Scholar 

  40. Fan, J.; Chau, K.P.; Wan, X.; Zhai, L.; Lau, E.: Prediction of facial attractiveness from facial proportions. Pattern Recognit. 45(6), 2326–2334 (2012)

    Article  Google Scholar 

  41. Kagian, A.; Dror, G.; Leyvand, T.; Cohen-Or, D.; Ruppin, E.: A humanlike predictor of facial attractiveness. In: Advances in Neural Information Processing Systems, pp. 649–656 (2007)

  42. Majumder, A.; Behera, L.; Subramanian, V.K.: Emotion recognition from geometric facial features using self-organizing map. Pattern Recognit. 47(3), 1282–1293 (2014)

    Article  Google Scholar 

  43. Chang, C.-C.; Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27 (2011)

    Article  Google Scholar 

  44. Zhou, D.; Bousquet, O.; Lal, T.N.; Weston, J.; Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Information Processing Systems, pp. 321–328 (2004)

  45. Luo, L.; Wang, X.; Hu, S.; Hu, X.; Chen, L.: Interactive image segmentation based on samples reconstruction and FLDA. J. Vis. Commun. Image Represent. 43, 138–151 (2017)

    Article  Google Scholar 

  46. Naseem, I.; Togneri, R.; Bennamoun, M.: Linear regression for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 2106–2112 (2010)

    Article  Google Scholar 

  47. Yang, M.; Zhang, L.; Feng, X.; Zhang, D.: Sparse representation based fisher discrimination dictionary learning for image classification. Int. J. Comput. Vis. 109(3), 209–232 (2014)

    Article  MathSciNet  Google Scholar 

  48. Wang, J.; Lu, C.; Wang, M.; Li, P.; Yan, S.; Hu, X.: Robust face recognition via adaptive sparse representation. IEEE Trans. Cybern. 44(12), 2368–2378 (2014)

    Article  Google Scholar 

  49. Candès, E.J.; Li, X.; Ma, Y.; Wright, J.: Robust principal component analysis? J. ACM 58(3), 11 (2011)

    Article  MathSciNet  Google Scholar 

  50. Lu, C.-Y.; Min, H.; Gui, J.; Zhu, L.; Lei, Y.-K.: Face recognition via weighted sparse representation. J. Vis. Commun. Image Represent. 24(2), 111–116 (2013)

    Article  Google Scholar 

  51. Zhao, L.; Zhang, Y.; Yin, B.; Sun, Y.; Hu, Y.; Piao, X.; Wu, Q.: Fisher discrimination-based \({l\_}\{2, 1\}\)-norm sparse representation for face recognition. Vis. Comput. 32(9), 1165–1178 (2016)

    Article  Google Scholar 

  52. Deng, W.; Hu, J.; Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)

    Article  Google Scholar 

  53. Deng, W.; Hu, J.; Guo, J.: In defense of sparsity based face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 399–406 (2013)

  54. Chen, C.-F.; Wei, C.-P.; Wang, Y.-C.F.: Low-rank matrix recovery with structural incoherence for robust face recognition. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2618–2625. IEEE (2012)

  55. Jiang, X.; Lai, J.: Sparse and dense hybrid representation via dictionary decomposition for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(5), 1067–1079 (2015)

    Article  Google Scholar 

  56. Yang, J.; Luo, L.; Qian, J.; Tai, Y.; Zhang, F.; Yong, X.: Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans. Pattern Anal. Mach. Intell. 39(1), 156–171 (2017)

    Article  Google Scholar 

  57. Jia, K.; Chan, T.-H.; Ma, Y.: Robust and practical face recognition via structured sparsity. Comput. Vis. ECCV 2012, 331–344 (2012)

    Google Scholar 

  58. Naseem, I.; Togneri, R.; Bennamoun, M.: Robust regression for face recognition. Pattern Recognit. 45(1), 104–118 (2012)

    Article  Google Scholar 

  59. He, R.; Zheng, W.-S.; Hu, B.-G.: Maximum correntropy criterion for robust face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1561–1576 (2011)

    Article  Google Scholar 

  60. Yang, M.; Zhang, L.; Yang, J.; Zhang, D.: Robust sparse coding for face recognition. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 625–632. IEEE (2011)

  61. Li, X.-X.; Dai, D.-Q.; Zhang, X.-F.; Ren, C.-X.: Structured sparse error coding for face recognition with occlusion. IEEE Trans. Image Process. 22(5), 1889–1900 (2013)

    Article  MathSciNet  Google Scholar 

  62. He, R.; Zheng, W.-S.; Tan, T.; Sun, Z.: Half-quadratic-based iterative minimization for robust sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 261–275 (2014)

    Article  Google Scholar 

  63. Zhang, Q.; Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2691–2698. IEEE (2010)

  64. Jiang, Z.; Lin, Z.; Davis, L.S.: Label consistent K-SVD: learning a discriminative dictionary for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2651–2664 (2013)

    Article  Google Scholar 

  65. Kong, S.; Wang, D.: A dictionary learning approach for classification: separating the particularity and the commonality. Comput. Vis. ECCV 2012, 186–199 (2012)

    Google Scholar 

  66. van der Maaten, L.; Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Dong Chuan RD.800, Shanghai, China

    Lingkun Luo, Xing Hu, Shiqiang Hu & Huanlong Zhang

  2. LIRIS, CNRS UMR 5205, École Centrale de Lyon, 36 avenue Guy de Collongue, 69134, Écully, France

    Wuming Zhang

Authors
  1. Lingkun Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xing Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiqiang Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wuming Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Huanlong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiqiang Hu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, L., Hu, X., Hu, S. et al. A Discriminative Face Geometric Feature-Based Face Recognition. Arab J Sci Eng 43, 7679–7693 (2018). https://doi.org/10.1007/s13369-018-3132-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-018-3132-3

Keywords

Search

Navigation