Skip to main content
SpringerLink
Log in

Novel descriptors for geometrical 3D face analysis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

3D face was recently investigated for various applications, including biometrics and diagnosis. Describing facial surface, i.e. how it bends and which kinds of patches is composed by, is the aim of studies of Face Analysis, whose ultimate goal is to identify which features could be extracted from three-dimensional faces depending on the application. In this study, we propose 105 novel geometrical descriptors for Face Analysis. They are generated by composing primary geometrical descriptors such as mean, Gaussian, principal curvatures, shape index, curvedness, and the coefficients of the fundamental forms, and by applying standard functions such as sine, cosine, and logarithm to them. The new descriptors were mapped on 217 facial depth maps and analysed in terms of descriptiveness of facial shape and exploitability for localizing landmark points. Automatic landmark extraction stands as the final aim of this analysis. Results showed that some newly generated descriptors were sounder than the primary ones, meaning that their local behaviours in correspondence to a landmark position is thoroughly specific and can be registered with high similarity on every face of our dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2D and 3D face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906

    Article  Google Scholar 

  2. Abbas H, Hicks Y, Marshall D (2015) Automatic classification of facial morphology for medical applications. Procedia Computer Science 60:1649–1658

  3. Bagchi P, Bhattacharjee D, Nasipuri M, Basu DK (2012) A novel approach to nose-tip and eye corners detection using HK curvature analysis in case of 3D images. Third International Conference on Emerging Applications of Information Technology (EAIT), 30 Nov–1 Dec 2012, pp 311–315

  4. Bennamoun, M., Guo, Y., & Sohel, F. (2015) Feature selection for 2D and 3D face recognition. Wiley Encyclopedia of Electrical and Electronics Engineering

  5. Canavan S, Liu P, Zhang X, Yin L (2015) Landmark localization on 3D/4D range data using a shape index-based statistical shape model with global and local constraints. Comput Vis Image Underst 139:136–148

    Article  Google Scholar 

  6. Creusot C, Pears N, Austin J (2011) Automatic keypoint detection on 3D faces using a dictionary of local shapes. International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 16–19 May 2011, pp 204–211

  7. Creusot C, Pears N, Austin J (2012) 3D landmark model discovery from a registered set of organic shapes. IEEE Compute Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 16–21 June 2012, pp 57–64

  8. Daoudi M, Srivastava A, Veltkamp R (2013) 3D face modeling, analysis and recognition. Wiley, Chichester

    Book  Google Scholar 

  9. Di Martino JM, Fernandez A, Ferrari J (2014) 3D curvature analysis with a novel one-shot technique. IEEE International Conference on Image Processing, pp 3818–3822

  10. Do Carmo M (1976) Differential geometry of curves and surfaces. Prentice-Hall Inc., Englewood Cliffs

    MATH  Google Scholar 

  11. Dorai C, Jain AK (1997) COSMOS-A representation scheme for 3D free-form objects. IEEE Trans Pattern Anal Mach Intell 19(10):1115–1130

    Article  Google Scholar 

  12. Fanelli G, Dantone M, Gall J, Fossati A, Van Gool L (2013) Random forests for real time 3d face analysis. Int J Comput Vis 101(3):437–458

    Article  Google Scholar 

  13. Gray A, Abbena E, Salamon S (2006) Modern differential geometry of curves and surfaces with Mathematica. CRC Press, Boca Raton

    MATH  Google Scholar 

  14. Hadid A, Zhao G, Ahonen T, Pietikäinen M (2008) Face analysis using local binary patterns. In: Mirmehdi M, Xie X, Suri J (eds) Handbook of Texture Analysis, pp. 347–373

    Chapter  Google Scholar 

  15. Hiremath PS, Manjunatha H (2013) 3D face recognition based on depth and intensity Gabor features using symbolic PCA and AdaBoost. International Journal of Signal Processing, Image Processing and Pattern Recognition 6(5):1–12

    Article  Google Scholar 

  16. Huang D, Shan C, Ardabilian M, Wang Y, Chen L (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 41(6):765–781

    Article  Google Scholar 

  17. Inan T, Halici U (2012) 3-D face recognition with local shape descriptors. IEEE Transactions on Information Forensics and Security 7(2):577–587

    Article  Google Scholar 

  18. Kakadiaris, I. (2012). A third dimension in face recognition. doi: 10.1117/2.1201205.004214.

  19. Koenderink JJ, van Doorn AJ (1992) Surface shape and curvature scales. Image Vis Comput 10(8):557–564

    Article  Google Scholar 

  20. Lanz, C., Olgay, B. S., Denzler, J., & Gross, H. M. (2013) Automated Classification of Therapeutic Face Exercises using the Kinect. VISAPP, 556–565

  21. Le V, Tang H, Huang TS (2011) Expression recognition from 3D dynamic faces using robust spatio-temporal shape features. IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, 21–25 March 2011, pp 414–421

  22. Li Y, Liu Y, Wang Y, Wu Z, Yang Y (2011a) 3D facial mesh detection using geometric saliency of surface. IEEE International Conference on Multimedia and Expo (ICME), 11–15 July 2011, pp 1–4

  23. Li H, Morvan JM, Chen L (2011b) 3d facial expression recognition based on histograms of surface differential quantities. Advanced Concepts for Intelligent Vision Systems 6915:483–494

  24. Li H, Ding H, Huang D, Wang Y, Zhao X, Morvan JM, et al. (2015) An efficient multimodal 2D+ 3D feature-based approach to automatic facial expression recognition. Comput Vis Image Underst 140:83–92

    Article  Google Scholar 

  25. Liu Y, Li C, Su B, Wang H (2013) Evaluation of feature extraction methods for face recognition. IEEE Sixth International Symposium on Computational Intelligence and Design (ISCID) 2:313–316

    Article  Google Scholar 

  26. Meethongjan, K., & Mohamad, D. (2007) A Summary of literature review: Face Recognition

  27. Mirmehdi M, Xie X, Suri J (2008) Handbook of texture analysis. World Scientific Publishing, Singapore

    Book  Google Scholar 

  28. Moos S, Marcolin F, Tornincasa S, Vezzetti E, Violante MG, Fracastoro G, et al (2014) Cleft lip pathology diagnosis and foetal landmark extraction via 3D geometrical analysis. Int J Interact Des Manuf:1–18. doi:10.1007/s12008-014-0244-1

  29. Nerendra Kumar, K. (2016) Handbook of research on emerging perspectives in intelligent pattern recognition, analysis, and image processing. IGI

  30. Pears N, Heseltine T, Romero M (2010) From 3D point clouds to pose-normalised depth maps. Int J Comput Vis 89(2–3):152–176

    Article  Google Scholar 

  31. Perakis P, Theoharis T, Kakadiaris IA (2014) Feature fusion for facial landmark detection. Pattern Recogn 47(9):2783–2793

    Article  Google Scholar 

  32. Rabiu H, Saripan MI, Marhaban MH, Mashohor S (2013) 3d-based face segmentation using adaptive radius. IEEE International Conference on Signal and Image Processing Applications (ICSIPA), 8–10 Oct 2013, pp 237–240

  33. Samir C, Srivastava A, Daoudi M (2006) Three-dimensional face recognition using shapes of facial curves. IEEE Trans Pattern Anal Mach Intell 28(11):1858–1863

    Article  Google Scholar 

  34. Samir C, Srivastava A, Daoudi M, Klassen E (2009) An intrinsic framework for analysis of facial surfaces. Int J Comput Vis 82(1):80–95

    Article  Google Scholar 

  35. Shen L, Bai L (2006) A review on Gabor wavelets for face recognition. Pattern Anal Applic 9(2–3):273–292

    Article  MathSciNet  Google Scholar 

  36. Swennen, G. R., Schutyser, F. A., & Hausamen, J. E. (2005). Three-dimensional cephalometry: a color atlas and manual. Springer Science & Business Media.

  37. Szeptycki, P., Ardabilian, M., & Chen, L. (2012, September). Nose tip localization on 2.5 D facial models using differential geometry based point signatures and SVM classifier. BIOSIG-Proceedings of the International Conference of the Biometrics Special Interest Group, 1–12.

  38. Tang H, Yin B, Sun Y, Hu Y (2013) 3D face recognition using local binary patterns. Signal Process 93(8):2190–2198

    Article  Google Scholar 

  39. Vezzetti E (2009a) Adaptive sampling plan design methodology for reverse engineering acquisition. Int J Adv Manuf Technol 42(7–8):780–792

    Article  Google Scholar 

  40. Vezzetti E (2009b) Computer aided inspection: design of customer-oriented benchmark for noncontact 3D scanner evaluation. Int J Adv Manuf Technol 41(11–12):1140–1151

    Article  Google Scholar 

  41. Vezzetti E, Marcolin F (2012a) 3D human face description: landmarks measures and geometrical features. Image Vis Comput 30(10):698–712

    Article  Google Scholar 

  42. Vezzetti E, Marcolin F (2012b) Geometrical descriptors for human face morphological analysis and recognition. Robot Auton Syst 60(6):928–939

    Article  Google Scholar 

  43. Vezzetti E, Marcolin F (2012c) Geometry-based 3D face morphology analysis: soft-tissue landmark formalization. Multimedia Tools and Applications 68(3):1–35

  44. Vezzetti E, Marcolin F (2014) 3D landmarking in Multiexpression face analysis: a preliminary study on eyebrows and mouth. Aesthet Plast Surg 38:796–811

    Article  Google Scholar 

  45. Vezzetti E, Calignano F, Moos S (2010) Computer-aided morphological analysis for maxillo-facial diagnostic: a preliminary study. J Plast Reconstr Aesthet Surg 63(2):218–226

    Article  Google Scholar 

  46. Vezzetti, E., Moos, S., & Marcolin, F. (2011) Three-dimensional human face analysis: soft tissue morphometry. Proceedings of the InterSymp 2011. Baden-Baden, Germany

  47. Vezzetti E, Moos S, Marcolin F, Stola V (2012) A pose-independent method for 3D face landmark formalization. Comput Methods Prog Biomed 198(3):1078–1096

    Article  Google Scholar 

  48. Vezzetti E, Marcolin F, Stola V (2013) 3D human face soft tissues landmarking method: an advanced approach. Comput Ind 64(9):1326–1354

    Article  Google Scholar 

  49. Vezzetti E, Marcolin F, Fracastoro G (2014a) 3D face recognition: an automatic strategy based on geometrical descriptors and landmarks. Robot Auton Syst 62(12):1768–1776

    Article  Google Scholar 

  50. Vezzetti E, Speranza D, Marcolin F, Fracastoro G (2014b) Exploiting 3D ultrasound for fetal diagnosis purpose through facial landmarking. Image Analysis & Stereology 33(3):167–188

    Article  Google Scholar 

  51. Yang X, Huang D, Wang Y, Chen L (2015) Automatic 3d facial expression recognition using geometric scattering representation. 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) 1:1–6

    Google Scholar 

  52. Zeng, W., Li, H., Chen, L., Morvan, J. M., & Gu, X. D. (2013, April) An automatic 3D expression recognition framework based on sparse representation of conformal images. 10th IEEE international conference and workshops on automatic face and gesture recognition, 1–8

  53. Zhang G, Wang Y (2011) Robust 3D face recognition based on resolution invariant features. Pattern Recogn Lett 32(7):1009–1019

    Article  Google Scholar 

  54. Zhao X (2011) 3D face analysis: landmarking, expression recognition and beyond. Ecole Centrale de Lyon. Doctoral dissertation, Lyon

    Google Scholar 

  55. Zhen Q, Huang D, Wang Y, Chen L (2015) Muscular movement model based automatic 3D facial expression recognition. MultiMedia Modeling 8935:522–533

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Management and Production Engineering, Politecnico di Torino, Corso Duca degli Abruzzi, 24, 10129, Torino, Italy

    Federica Marcolin & Enrico Vezzetti

Authors
  1. Federica Marcolin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Enrico Vezzetti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Federica Marcolin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Marcolin, F., Vezzetti, E. Novel descriptors for geometrical 3D face analysis. Multimed Tools Appl 76, 13805–13834 (2017). https://doi.org/10.1007/s11042-016-3741-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3741-3

Keywords

Search

Navigation