Facial Expression Recognition in Ageing Adults: A Comparative Study

  • Andrea CaroppoEmail author
  • Alessandro Leone
  • Pietro Siciliano
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 544)


Facial Expression Recognition is one of the most active areas of research in computer vision. However, existing approaches lack generalizability and almost all studies ignore the effects of facial attributes, such as age, on expression recognition even though research indicates that facial expression manifestation varies with ages. Recently, a lot of progress has been made in this topic and great improvements in classification task were achieved with the emergence of Deep Learning methods. Such approaches allow to avoid classical hand designed feature extraction methods that generally rely on manual operations with labelled data. In the present work a deep learning approach that utilizes Convolutional Neural Networks (CNNs) to automatically extract features from facial images is evaluated on a benchmark dataset (FACES), the only one present in literature that contains also labelled facial expressions performed by ageing adults. As baselines, with the aim of making a comparison, two traditional machine learning approaches using handcrafted features are evaluated on the same dataset. Our experiments show that the CNN-based approach is very effective in expression recognition performed by ageing adults, significantly improving the baseline approaches, at least with a 8% margin.


Facial expression recognition Deep learning Machine learning 


  1. 1.
    Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Kudlur M et al (2016) Tensor-flow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX symposium on operating systems design and implementation (OSDI), Savannah, Georgia, USAGoogle Scholar
  2. 2.
    Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, pp 177–186. Physica Verlag HDGoogle Scholar
  3. 3.
    Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models-their training and application. Comput Vis Image Underst 61(1):38–59CrossRefGoogle Scholar
  4. 4.
    Ebner NC, Riediger M, Lindenberger U (2010) FACES—a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav Res Methods 42(1):351–362CrossRefGoogle Scholar
  5. 5.
    Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recogn 36(1):259–275CrossRefGoogle Scholar
  6. 6.
    Goodfellow IJ, Erhan D, Carrier PL, Courville A, Mirza M, Hamner B, Zhou Y et al (2013) Challenges in representation learning: a report on three machine learning contests. In: International conference on neural information processing, pp 117–124. Springer, Berlin, HeidelbergGoogle Scholar
  7. 7.
    Guo G, Guo R, Li X (2013) Facial expression recognition influenced by human aging. IEEE Trans Affect Comput 4(3):291–298CrossRefGoogle Scholar
  8. 8.
    Kahou SE, Pal C, Bouthillier X, Froumenty P, Gülçehre Ç, Memisevic R, Mirza M et al (2013) Combining modality specific deep neural networks for emotion recognition in video. In: Proceedings of the 15th ACM on international conference on multimodal interaction, pp 543–550. ACMGoogle Scholar
  9. 9.
    LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRefGoogle Scholar
  10. 10.
    LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRefGoogle Scholar
  11. 11.
    Liu M, Wang R, Li S, Shan S, Huang Z, Chen, X (2014) Combining multiple kernel methods on riemannian manifold for emotion recognition in the wild. In: Proceedings of the 16th international conference on multimodal interaction, pp 494–501. ACMGoogle Scholar
  12. 12.
    Lowe DG (1999) Object recognition from local scale-invariant features. In: The proceedings of the seventh IEEE international conference on computer vision, 1999, vol 2, pp 1150–1157. IEEEGoogle Scholar
  13. 13.
    Milborrow S, Nicolls F (2014) Active shape models with SIFT descriptors and MARS. In: Proceedings of the 9th international conference on computer vision theory and applications, Lisbon, Portugal, 5–8 Jan 2014Google Scholar
  14. 14.
    Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814Google Scholar
  15. 15.
    Pantic M, Rothkrantz LJM (2000) Automatic analysis of facial expressions: the state of the art. IEEE Trans Pattern Anal Mach Intell 22(12):1424–1445CrossRefGoogle Scholar
  16. 16.
    Shan C, Gong S, McOwan PW (2009) Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis Comput 27(6):803–816CrossRefGoogle Scholar
  17. 17.
    United Nations Programme on Ageing, The Ageing of the World’s Population, Dec 2013. Accessed April 2018
  18. 18.
    Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154CrossRefGoogle Scholar
  19. 19.
    Wang S, Wu S, Gao Z, Ji Q (2016) Facial expression recognition through modeling age-related spatial patterns. Multimed Tools Appl 75(7):3937–3954CrossRefGoogle Scholar
  20. 20.
    Zeng Z, Pantic M, Roisman GI, Huang TS (2009) A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31(1):39–58CrossRefGoogle Scholar
  21. 21.
    Zuiderveld K (1994) Contrast limited adaptive histogram equalization. Graph Gems 474–485Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Andrea Caroppo
    • 1
    Email author
  • Alessandro Leone
    • 1
  • Pietro Siciliano
    • 1
  1. 1.National Research Council of Italy, Institute for Microelectronics and MicrosystemsLecceItaly

Personalised recommendations