Towards Continuous Health Diagnosis from Faces with Deep Learning

  • Victor MartinEmail author
  • Renaud Séguier
  • Aurélie Porcheron
  • Frédérique Morizot
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11121)


Recent studies show that health perception from faces by humans is a good predictor of good health and healthy behaviors. We aimed to automatize human health perception by training a Convolutional Neural Network on a related task (age estimation) combined with a Ridge Regression to rate faces. Indeed, contrary to health ratings, large datasets with labels of biological age exist. The results show that our system outperforms average human judgments for health. The system could be used on a daily basis to detect early signs of sickness or a declining state. We are convinced that such a system will contribute to more extensively explore the use of holistic, fast, and non-invasive measures to improve the speed of diagnosis.


Health estimation Non-invasive diagnosis Convolutional Neural Network Facial features 


  1. 1.
    Efran, M.G.: The effect of physical appearance on the judgment of guilt, interpersonal attraction, and severity of recommended punishment in a simulated jury task. J. Res. Pers. 8(1), 45–54 (1974)CrossRefGoogle Scholar
  2. 2.
    Marlowe, C.M., Schneider, S.L., Nelson, C.E.: Gender and attractiveness biases in hiring decisions: Are more experienced managers less biased? J. Appl. Psychol. 81(1), 11–21 (1996)CrossRefGoogle Scholar
  3. 3.
    Ritts, V., Patterson, M.L., Tubbs, M.E.: Expectations, impressions, and judgments of physically attractive students: a review. Rev. Educ. Res. 62(4), 413–426 (1992)CrossRefGoogle Scholar
  4. 4.
    Spisak, B.R., Blaker, N.M., Lefevre, C.E., Moore, F.R., Krebbers, K.F.B.: A face for all seasons: Searching for context-specific leadership traits and discovering a general preference for perceived health. Front. Hum. Neurosci. 8, 792 (2014)CrossRefGoogle Scholar
  5. 5.
    Feingold, A.: Good-looking people are not what we think. Psychol. Bull. 111(2), 304 (1992)CrossRefGoogle Scholar
  6. 6.
    Henderson, A.J., Holzleitner, I.J., Talamas, S.N., Perrett, D.I.: Perception of health from facial cues. Philos. Trans. R. Soc. B: Biol. Sci. 371(1693), 20150380 (2016)CrossRefGoogle Scholar
  7. 7.
    Whitehead, R.D., Re, D., Xiao, D., Ozakinci, G., Perrett, D.I.: You are what you eat: within-subject increases in fruit and vegetable consumption confer beneficial skin-color changes. PLOS ONE 7(3), e32988 (2012)CrossRefGoogle Scholar
  8. 8.
    Zebrowitz, L.A., et al.: Older and younger adults’ accuracy in discerning health and competence in older and younger faces. Psychol. Aging 29(3), 454 (2014)Google Scholar
  9. 9.
    Stephen, I.D., Coetzee, V., Smith, L.M., Perrett, D.I.: Skin blood perfusion and oxygenation colour affect perceived human health. PLoS ONE 4(4), e5083 (2009)CrossRefGoogle Scholar
  10. 10.
    Re, D.E., Whitehead, R.D., Xiao, D., Perrett, D.I.: Oxygenated-blood colour change thresholds for perceived facial redness, health, and attractiveness. PLoS ONE 6(3), e17859 (2011)CrossRefGoogle Scholar
  11. 11.
    Axelsson, J., Sundelin, T., Ingre, M., Someren, E.J.W.V., Olsson, A., Lekander, M.: Beauty sleep: experimental study on the perceived health and attractiveness of sleep deprived people. BMJ 341, c6614 (2010)CrossRefGoogle Scholar
  12. 12.
    Axelsson, J., Sundelin, T., Axelsson, C., Lasselin, J., Lekander, M.: Identification of acutely sick people and facial cues of sickness. Brain Behav. Immun. 66, e38 (2017)CrossRefGoogle Scholar
  13. 13.
    Fink, B., Matts, P., D’Emiliano, D., Bunse, L., Weege, B., Röder, S.: Colour homogeneity and visual perception of age, health and attractiveness of male facial skin: perception of male skin colour. J. Eur. Acad. Dermatol. Venereol. 26(12), 1486–1492 (2011)Google Scholar
  14. 14.
    Lanitis, A., Taylor, C.J., Cootes, T.F.: Toward automatic simulation of aging effects on face images. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 442–455 (2002)CrossRefGoogle Scholar
  15. 15.
    Lanitis, A., Draganova, C., Christodoulou, C.: Comparing different classifiers for automatic age estimation. IEEE Trans. Syst., Man, Cybern. Part B Cybern. 34, 621–628 (2004)CrossRefGoogle Scholar
  16. 16.
    Guo, G., Mu, G., Fu, Y., Huang, T.S.: Human age estimation using bio-inspired features. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 112–119. IEEE (2009)Google Scholar
  17. 17.
    Rothe, R., Timofte, R., Van Gool, L.: DEX: deep expectation of apparent age from a single image. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 10–15 (2015)Google Scholar
  18. 18.
    Qin, R., Gao, W., Xu, H., Hu, Z.: Modern physiognomy: an investigation on predicting personality traits and intelligence from the human face. arXiv:1604.07499 [cs], April 2016
  19. 19.
    Fan, Y.Y., Liu, S., Li, B., Guo, Z., Samal, A., Wan, J., Li, S.Z.: Label distribution-based facial attractiveness computation by deep residual learning. IEEE Trans. Multimed. PP(99), 1 (2017)Google Scholar
  20. 20.
    Chen, F., Zhang, D.: Combining a causal effect criterion for evaluation of facial attractiveness models. Neurocomputing 177, 98–109 (2016)CrossRefGoogle Scholar
  21. 21.
    Liu, S., Fan, Y.Y., Samal, A., Guo, Z.: Advances in computational facial attractiveness methods. Multimed. Tools Appl. 75(23), 16633–16663 (2016)CrossRefGoogle Scholar
  22. 22.
    Chen, F., Xiao, X., Zhang, D.: Data-driven facial beauty analysis: prediction, retrieval and manipulation. IEEE Trans. Affect. Comput. PP(99), 1 (2017)Google Scholar
  23. 23.
    Zhang, Z., Luo, P., Loy, C.C., Tang, X.: Learning social relation traits from face images. arXiv:1509.03936 [cs], September 2015
  24. 24.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.CentraleSupelecCesson-SévignéFrance
  2. 2.CHANEL Parfums BeautéPantinFrance

Personalised recommendations