Abstract
Facial attractiveness is an important research direction of genetic psychology and cognitive psychology, and its results are significant for the study of face evolution and human evolution. However, previous studies have not put forward a comprehensive evaluation system of facial attractiveness. Traditionally, the establishment of facial attractiveness evaluation system was based on facial geometric features, without facial skin features. In this paper, combined with big data analysis, evaluation of face in real society and literature research, we found that skin also have a significant impact on facial attractiveness, because skin could reflect age, wrinkles and healthful qualities, thus affected the human perception of facial attractiveness. Therefore, we propose a comprehensive and novel facial attractiveness evaluation system based on face shape structural features, facial structure features and skin texture feature. In order to apply face shape structural features to the evaluation of facial attractiveness, the classification of face shape is the first step. Face image dataset is divided according to face shape, and then facial structure features and skin texture features that represent facial attractiveness are extracted and fused. The machine learning algorithm with the best prediction performance is selected in the face shape structural subsets to predict facial attractiveness. Experimental results show that the facial attractiveness evaluation performance can be improved by the method based on classification of face shape and multi-features fusion, the facial attractiveness scores obtained by the proposed system correlates better with human ratings. Our evaluation system can help people project their cognition of facial attractiveness into artificial agents they interact with.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anbarjafari G (2013) Face recognition using color local binary pattern from mutually independent color channels. EURASIP J Image Video Process 2013:6. https://doi.org/10.1186/1687-5281-2013-6
Atiyeh BS, Hayek SN (2008) Numeric expression of aesthetics and beauty. Aesthet Plast Surg 32:209–216. https://doi.org/10.1007/s00266-007-9074-x
Balas B, Tupa L, Pacella J (2018) Measuring social variables in real and artificial faces. Comput Human Behav 88:236–243. https://doi.org/10.1016/j.chb.2018.07.013
Bansode NK, Sinha PK (2016) Face shape classification based on region similarity, correlation and fractal dimensions. Int J Comput Sci Issues 13:24–31. https://doi.org/10.20943/ijcsi-201602-2431
Bashour M (2006) An objective system for measuring facial attractiveness. Plast Reconstr Surg 118:757–774. https://doi.org/10.1097/01.prs.0000207382.60636.1c
Baudouin JY, Tiberghien G (2004) Symmetry, averageness, and feature size in the facial attractiveness of women. Acta Psychol (Amst) 117:313–332. https://doi.org/10.1016/j.actpsy.2004.07.002
Carrito M, Santos IM, Lefevre CE et al (2016) The role of sexually dimorphic skin colour and shape in attractiveness of male faces. Evol Hum Behav 37:125–133. https://doi.org/10.1016/j.evolhumbehav.2015.09.006
Chen F, Xu Y, Zhang D, Chen K (2015) 2D facial landmark model design by combining key points and inserted points. Expert Syst Appl 42:7858–7868. https://doi.org/10.1016/j.eswa.2015.06.015
Cula OG, Dan KJ, Murphy FP, Rao BK (2005) Skin texture modeling. Int J Comput Vis 62:97–119. https://doi.org/10.1023/B:VISI.0000046591.79973.6f
Dasdemir Y, Yildirim E, Yildirim S (2017) Analysis of functional brain connections for positive–negative emotions using phase locking value. Cogn Neurodyn 11:487–500. https://doi.org/10.1007/s11571-017-9447-z
DeBruine LM, Jones BC, Unger L et al (2007) Dissociating averageness and attractiveness: attractive faces are not always average. J Exp Psychol Hum Percept Perform 33:1420–1430. https://doi.org/10.1037/0096-1523.33.6.1420
Eisenthal Y (2006) Facial attractiveness: beauty and the machine. Neural Comput 18:119–142
Fan J, Chau KP, Wan X et al (2012) Prediction of facial attractiveness from facial proportions. Pattern Recognit 45:2326–2334. https://doi.org/10.1016/j.patcog.2011.11.024
Fink B, Grammer K, Thornhill R (2001) Human (homo sapiens) facial attractiveness in relation to skin texture and color. J Comp Psychol 115:92–99. https://doi.org/10.1037/0735-7036.115.1.92
Fink B, Grammer K, Matts PJ (2006) Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evol Hum Behav. https://doi.org/10.1016/j.evolhumbehav.2006.08.007
Fink B, Matts PJ, D’Emiliano D et al (2012) Colour homogeneity and visual perception of age, health and attractiveness of male facial skin. J Eur Acad Dermatol Venereol 26:1486–1492. https://doi.org/10.1111/j.1468-3083.2011.04316.x
Foo YZ, Simmons LW, Rhodes G (2017) Predictors of facial attractiveness and health in humans. Sci Rep. https://doi.org/10.1038/srep39731
Gan J, Li L, Zhai Y, Liu Y (2014) Deep self-taught learning for facial beauty prediction. Neurocomputing 144:295–303. https://doi.org/10.1016/j.neucom.2014.05.028
Green RD, MacDorman KF, Ho CC, Vasudevan S (2008) Sensitivity to the proportions of faces that vary in human likeness. Comput Human Behav 24:2456–2474. https://doi.org/10.1016/j.chb.2008.02.019
Gründl M, Knoll S, Eisenmann-Klein M, Prantl L (2012) The blue-eyes stereotype: do eye color, pupil diameter, and scleral color affect attractiveness? Aesthet Plast Surg 36:234–240. https://doi.org/10.1007/s00266-011-9793-x
Gunes H, Piccardi M (2006) Assessing facial beauty through proportion analysis by image processing and supervised learning. Int J Hum Comput Stud. https://doi.org/10.1016/j.ijhcs.2006.07.004
Hong YJ, Nam GP, Choi H et al (2017) A novel framework for assessing facial attractiveness based on facial proportions. Symmetry (Basel) 9:1–12. https://doi.org/10.3390/sym9120294
Ibáñez-Berganza M, Amico A, Loreto V (2019) Subjectivity and complexity of facial attractiveness. Sci Rep. https://doi.org/10.1038/s41598-019-44655-9
Jones AL, Jaeger B (2019) Biological bases of beauty revisited: the effect of symmetry, averageness, and sexual dimorphism on female facial attractiveness. Symmetry (Basel) 11:279. https://doi.org/10.3390/SYM11020279
Jones BC, Little AC, Burt DM, Perrett DI (2004) When facial attractiveness is only skin deep. Perception 33:569–576. https://doi.org/10.1068/p3463
Jun Z, Jizhao H, Zhenglan T, Feng W (2018) Face detection based on LBP. In: ICEMI 2017—Proceedings of IEEE 13th international conference on electronic measurement and instruments
Kagian A, Dror G, Leyvand T et al (2007) A humanlike predictor of facial attractiveness. Adv Neural Inf Process Syst. https://doi.org/10.7551/mitpress/7503.003.0086
Köstinger M, Wohlhart P, Roth PM, Bischof H (2011) Annotated facial landmarks in the wild: a large-scale, real-world database for facial landmark localization. In: Proceedings of the IEEE international conference on computer vision
Kumar RK, Garain J, Kisku DR, Sanyal G (2019) Guiding attention of faces through graph based visual saliency (GBVS). Cogn Neurodyn 13:125–149. https://doi.org/10.1007/s11571-018-9515-z
Langlois JH, Roggman LA (1990) Attractive faces are only average. Psychol Sci 1:115–121
Leite TS, De Martino JM (2015) Improving the attractiveness of faces in images. In: Brazilian symposium of computer graphic and image processing
Li L, So J, Shin H, Han Y (2013) An AAM-based face shape classification method used for facial expression recognition. Int J Res Eng Technol 2:164–168
Liang L, Jin L (2013) Facial skin beautification using region-aware mask. In: Proceedings—2013 IEEE International conference on systems, man, and cybernetics SMC 2013 (pp. 2922–2926). https://doi.org/10.1109/SMC.2013.498
Liang L, Lin L, Jin L, et al. (2018) SCUT-FBP5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction. In: Proceedings—international conference on pattern recognition
Little AC, Jones BC, DeBruine LM (2011) Facial attractiveness: evolutionary based research. Philos Trans R Soc B Biol Sci 366:1638–1659. https://doi.org/10.1098/rstb.2010.0404
McArthur LZ, Baron RM (1983) Toward an ecological theory of social perception. Psychol Rev. https://doi.org/10.1037/0033-295X.90.3.215
Milutinovic J, Zelic K, Nedeljkovic N (2014) Evaluation of facial beauty using anthropometric proportions. Sci World J. https://doi.org/10.1155/2014/428250
Mu Y (2013) Computational facial attractiveness prediction by aesthetics-aware features. Neurocomputing. https://doi.org/10.1016/j.neucom.2012.06.020
Pasupa K, Sunhem W, Loo CK (2019) A hybrid approach to building face shape classifier for hairstyle recommender system. Expert Syst Appl 120:14–32. https://doi.org/10.1016/j.eswa.2018.11.011
Penna V, Fricke A, Iblher N et al (2015) The attractive lip: a photomorphometric analysis. J Plast Reconstr Aesthetic Surg. https://doi.org/10.1016/j.bjps.2015.03.013
Popenko NA, Tripathi PB, Devcic Z et al (2017) A quantitative approach to determining the ideal female lip aesthetic and its effect on facial attractiveness. JAMA Facial Plast Surg 19:261–267. https://doi.org/10.1001/jamafacial.2016.2049
Przylipiak M, Przylipiak J, Terlikowski R et al (2018) Impact of face proportions on face attractiveness. J Cosmet Dermatol 17:954–959. https://doi.org/10.1111/jocd.12783
Schmid K, Marx D, Samal A (2008) Computation of a face attractiveness index based on neoclassical canons, symmetry, and golden ratios. Pattern Recognit 41:2710–2717. https://doi.org/10.1016/j.patcog.2007.11.022
Selim M, Raheja S, Stricker D (2015) Real-time human age estimation based on facial images using uniform local binary patterns. In: VISAPP 2015—10th international conference on computer vision theory and applications; VISIGRAPP, proceedings
Singh R, Shah P, Bagade J (2016) Skin texture analysis using machine learning. In: Conference on advances in signal processing, CASP 2016
Stephen ID, Scott IML, Coetzee V et al (2012) Cross-cultural effects of color, but not morphological masculinity, on perceived attractiveness of men’s faces. Evol Hum Behav. https://doi.org/10.1016/j.evolhumbehav.2011.10.003
Sunhem W, Pasupa K (2016) An approach to face shape classification for hairstyle recommendation. In: Proc 8th international conference on advanced computational intelligence ICACI 2016 (pp. 390–394). https://doi.org/10.1109/ICACI.2016.7449857
Szegedy C, Vanhoucke V, Ioffe S, et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognit (pp. 2818–2826). https://doi.org/10.1109/CVPR.2016.308
Tan KW, Tiddeman B, Stephen ID (2018) Skin texture and colour predict perceived health in Asian faces. Evol Hum Behav 39:320–335. https://doi.org/10.1016/j.evolhumbehav.2018.02.003
Wang P, Hu J (2019) A hybrid model for EEG-based gender recognition. Cogn Neurodyn 13:541–554. https://doi.org/10.1007/s11571-019-09543-y
Zhang D, Chen F, Xu Y (2016) Computer models for facial beauty analysis. Springer, Switzerland
Zhang L, Zhang D, Sun MM, Chen FM (2017a) Facial beauty analysis based on geometric feature: toward attractiveness assessment application. Expert Syst Appl 82:252–265. https://doi.org/10.1016/j.eswa.2017.04.021
Zhang Y, Wang X, Wang J et al (2017b) Patterns of eye movements when observers judge female facial attractiveness. Front Psychol 8:1–7. https://doi.org/10.3389/fpsyg.2017.01909
Zhao J, Cao M, Xie X et al (2019a) Data-driven facial attractiveness of Chinese male with epoch characteristics. IEEE Access 7:10956–10966. https://doi.org/10.1109/ACCESS.2019.2892137
Zhao J, Deng F, Jia J et al (2019b) A new face feature point matrix based on geometric features and illumination models for facial attraction analysis. Discret Contin Dyn Syst S 12:1065–1072. https://doi.org/10.3934/dcdss.2019073
Zhao J, Xie X, Wang L et al (2019c) Generating photographic faces from the sketch guided by attribute using GAN. IEEE Access. https://doi.org/10.1109/ACCESS.2019.2899466
Zhao J, Zhang M, He C, Zuo K (2019d) Data-driven research on the matching degree of eyes, eyebrows and face shapes. Front Psychol 10:1–11. https://doi.org/10.3389/fpsyg.2019.01466
Acknowledgements
This work was supported by National Natural Science Foundation of China (Grant No. 61701401) and Natural Science Foundation of Shaanxi Province (Grant No. 2019KJXX-061).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhao, J., Zhang, M., He, C. et al. A novel facial attractiveness evaluation system based on face shape, facial structure features and skin. Cogn Neurodyn 14, 643–656 (2020). https://doi.org/10.1007/s11571-020-09591-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11571-020-09591-9