Abstract
3D face was recently investigated for various applications, including biometrics and diagnosis. Describing facial surface, i.e. how it bends and which kinds of patches is composed by, is the aim of studies of Face Analysis, whose ultimate goal is to identify which features could be extracted from three-dimensional faces depending on the application. In this study, we propose 105 novel geometrical descriptors for Face Analysis. They are generated by composing primary geometrical descriptors such as mean, Gaussian, principal curvatures, shape index, curvedness, and the coefficients of the fundamental forms, and by applying standard functions such as sine, cosine, and logarithm to them. The new descriptors were mapped on 217 facial depth maps and analysed in terms of descriptiveness of facial shape and exploitability for localizing landmark points. Automatic landmark extraction stands as the final aim of this analysis. Results showed that some newly generated descriptors were sounder than the primary ones, meaning that their local behaviours in correspondence to a landmark position is thoroughly specific and can be registered with high similarity on every face of our dataset.
Similar content being viewed by others
References
Abate AF, Nappi M, Riccio D, Sabatino G (2007) 2D and 3D face recognition: a survey. Pattern Recogn Lett 28(14):1885–1906
Abbas H, Hicks Y, Marshall D (2015) Automatic classification of facial morphology for medical applications. Procedia Computer Science 60:1649–1658
Bagchi P, Bhattacharjee D, Nasipuri M, Basu DK (2012) A novel approach to nose-tip and eye corners detection using HK curvature analysis in case of 3D images. Third International Conference on Emerging Applications of Information Technology (EAIT), 30 Nov–1 Dec 2012, pp 311–315
Bennamoun, M., Guo, Y., & Sohel, F. (2015) Feature selection for 2D and 3D face recognition. Wiley Encyclopedia of Electrical and Electronics Engineering
Canavan S, Liu P, Zhang X, Yin L (2015) Landmark localization on 3D/4D range data using a shape index-based statistical shape model with global and local constraints. Comput Vis Image Underst 139:136–148
Creusot C, Pears N, Austin J (2011) Automatic keypoint detection on 3D faces using a dictionary of local shapes. International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 16–19 May 2011, pp 204–211
Creusot C, Pears N, Austin J (2012) 3D landmark model discovery from a registered set of organic shapes. IEEE Compute Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 16–21 June 2012, pp 57–64
Daoudi M, Srivastava A, Veltkamp R (2013) 3D face modeling, analysis and recognition. Wiley, Chichester
Di Martino JM, Fernandez A, Ferrari J (2014) 3D curvature analysis with a novel one-shot technique. IEEE International Conference on Image Processing, pp 3818–3822
Do Carmo M (1976) Differential geometry of curves and surfaces. Prentice-Hall Inc., Englewood Cliffs
Dorai C, Jain AK (1997) COSMOS-A representation scheme for 3D free-form objects. IEEE Trans Pattern Anal Mach Intell 19(10):1115–1130
Fanelli G, Dantone M, Gall J, Fossati A, Van Gool L (2013) Random forests for real time 3d face analysis. Int J Comput Vis 101(3):437–458
Gray A, Abbena E, Salamon S (2006) Modern differential geometry of curves and surfaces with Mathematica. CRC Press, Boca Raton
Hadid A, Zhao G, Ahonen T, Pietikäinen M (2008) Face analysis using local binary patterns. In: Mirmehdi M, Xie X, Suri J (eds) Handbook of Texture Analysis, pp. 347–373
Hiremath PS, Manjunatha H (2013) 3D face recognition based on depth and intensity Gabor features using symbolic PCA and AdaBoost. International Journal of Signal Processing, Image Processing and Pattern Recognition 6(5):1–12
Huang D, Shan C, Ardabilian M, Wang Y, Chen L (2011) Local binary patterns and its application to facial image analysis: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 41(6):765–781
Inan T, Halici U (2012) 3-D face recognition with local shape descriptors. IEEE Transactions on Information Forensics and Security 7(2):577–587
Kakadiaris, I. (2012). A third dimension in face recognition. doi: 10.1117/2.1201205.004214.
Koenderink JJ, van Doorn AJ (1992) Surface shape and curvature scales. Image Vis Comput 10(8):557–564
Lanz, C., Olgay, B. S., Denzler, J., & Gross, H. M. (2013) Automated Classification of Therapeutic Face Exercises using the Kinect. VISAPP, 556–565
Le V, Tang H, Huang TS (2011) Expression recognition from 3D dynamic faces using robust spatio-temporal shape features. IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, 21–25 March 2011, pp 414–421
Li Y, Liu Y, Wang Y, Wu Z, Yang Y (2011a) 3D facial mesh detection using geometric saliency of surface. IEEE International Conference on Multimedia and Expo (ICME), 11–15 July 2011, pp 1–4
Li H, Morvan JM, Chen L (2011b) 3d facial expression recognition based on histograms of surface differential quantities. Advanced Concepts for Intelligent Vision Systems 6915:483–494
Li H, Ding H, Huang D, Wang Y, Zhao X, Morvan JM, et al. (2015) An efficient multimodal 2D+ 3D feature-based approach to automatic facial expression recognition. Comput Vis Image Underst 140:83–92
Liu Y, Li C, Su B, Wang H (2013) Evaluation of feature extraction methods for face recognition. IEEE Sixth International Symposium on Computational Intelligence and Design (ISCID) 2:313–316
Meethongjan, K., & Mohamad, D. (2007) A Summary of literature review: Face Recognition
Mirmehdi M, Xie X, Suri J (2008) Handbook of texture analysis. World Scientific Publishing, Singapore
Moos S, Marcolin F, Tornincasa S, Vezzetti E, Violante MG, Fracastoro G, et al (2014) Cleft lip pathology diagnosis and foetal landmark extraction via 3D geometrical analysis. Int J Interact Des Manuf:1–18. doi:10.1007/s12008-014-0244-1
Nerendra Kumar, K. (2016) Handbook of research on emerging perspectives in intelligent pattern recognition, analysis, and image processing. IGI
Pears N, Heseltine T, Romero M (2010) From 3D point clouds to pose-normalised depth maps. Int J Comput Vis 89(2–3):152–176
Perakis P, Theoharis T, Kakadiaris IA (2014) Feature fusion for facial landmark detection. Pattern Recogn 47(9):2783–2793
Rabiu H, Saripan MI, Marhaban MH, Mashohor S (2013) 3d-based face segmentation using adaptive radius. IEEE International Conference on Signal and Image Processing Applications (ICSIPA), 8–10 Oct 2013, pp 237–240
Samir C, Srivastava A, Daoudi M (2006) Three-dimensional face recognition using shapes of facial curves. IEEE Trans Pattern Anal Mach Intell 28(11):1858–1863
Samir C, Srivastava A, Daoudi M, Klassen E (2009) An intrinsic framework for analysis of facial surfaces. Int J Comput Vis 82(1):80–95
Shen L, Bai L (2006) A review on Gabor wavelets for face recognition. Pattern Anal Applic 9(2–3):273–292
Swennen, G. R., Schutyser, F. A., & Hausamen, J. E. (2005). Three-dimensional cephalometry: a color atlas and manual. Springer Science & Business Media.
Szeptycki, P., Ardabilian, M., & Chen, L. (2012, September). Nose tip localization on 2.5 D facial models using differential geometry based point signatures and SVM classifier. BIOSIG-Proceedings of the International Conference of the Biometrics Special Interest Group, 1–12.
Tang H, Yin B, Sun Y, Hu Y (2013) 3D face recognition using local binary patterns. Signal Process 93(8):2190–2198
Vezzetti E (2009a) Adaptive sampling plan design methodology for reverse engineering acquisition. Int J Adv Manuf Technol 42(7–8):780–792
Vezzetti E (2009b) Computer aided inspection: design of customer-oriented benchmark for noncontact 3D scanner evaluation. Int J Adv Manuf Technol 41(11–12):1140–1151
Vezzetti E, Marcolin F (2012a) 3D human face description: landmarks measures and geometrical features. Image Vis Comput 30(10):698–712
Vezzetti E, Marcolin F (2012b) Geometrical descriptors for human face morphological analysis and recognition. Robot Auton Syst 60(6):928–939
Vezzetti E, Marcolin F (2012c) Geometry-based 3D face morphology analysis: soft-tissue landmark formalization. Multimedia Tools and Applications 68(3):1–35
Vezzetti E, Marcolin F (2014) 3D landmarking in Multiexpression face analysis: a preliminary study on eyebrows and mouth. Aesthet Plast Surg 38:796–811
Vezzetti E, Calignano F, Moos S (2010) Computer-aided morphological analysis for maxillo-facial diagnostic: a preliminary study. J Plast Reconstr Aesthet Surg 63(2):218–226
Vezzetti, E., Moos, S., & Marcolin, F. (2011) Three-dimensional human face analysis: soft tissue morphometry. Proceedings of the InterSymp 2011. Baden-Baden, Germany
Vezzetti E, Moos S, Marcolin F, Stola V (2012) A pose-independent method for 3D face landmark formalization. Comput Methods Prog Biomed 198(3):1078–1096
Vezzetti E, Marcolin F, Stola V (2013) 3D human face soft tissues landmarking method: an advanced approach. Comput Ind 64(9):1326–1354
Vezzetti E, Marcolin F, Fracastoro G (2014a) 3D face recognition: an automatic strategy based on geometrical descriptors and landmarks. Robot Auton Syst 62(12):1768–1776
Vezzetti E, Speranza D, Marcolin F, Fracastoro G (2014b) Exploiting 3D ultrasound for fetal diagnosis purpose through facial landmarking. Image Analysis & Stereology 33(3):167–188
Yang X, Huang D, Wang Y, Chen L (2015) Automatic 3d facial expression recognition using geometric scattering representation. 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) 1:1–6
Zeng, W., Li, H., Chen, L., Morvan, J. M., & Gu, X. D. (2013, April) An automatic 3D expression recognition framework based on sparse representation of conformal images. 10th IEEE international conference and workshops on automatic face and gesture recognition, 1–8
Zhang G, Wang Y (2011) Robust 3D face recognition based on resolution invariant features. Pattern Recogn Lett 32(7):1009–1019
Zhao X (2011) 3D face analysis: landmarking, expression recognition and beyond. Ecole Centrale de Lyon. Doctoral dissertation, Lyon
Zhen Q, Huang D, Wang Y, Chen L (2015) Muscular movement model based automatic 3D facial expression recognition. MultiMedia Modeling 8935:522–533
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Marcolin, F., Vezzetti, E. Novel descriptors for geometrical 3D face analysis. Multimed Tools Appl 76, 13805–13834 (2017). https://doi.org/10.1007/s11042-016-3741-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-3741-3