Automatic Facial Expression Recognition Using Statistical-Like Moments

  • Roberto D’Ambrosio
  • Giulio Iannello
  • Paolo Soda
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6978)


Research in automatic facial expression recognition has permitted the development of systems discriminating between the six prototypical expressions, i.e. anger, disgust, fear, happiness, sadness and surprise, in frontal video sequences. Achieving high recognition rate often implies high computational costs that are not compatible with real time applications on limited-resource platforms. In order to have high recognition rate as well as computational efficiency, we propose an automatic facial expression recognition system using a set of novel features inspired by statistical moments. Such descriptors, named as statistical-like moments extract high order statistic from texture descriptors such as local binary patterns. The approach has been successfully tested on the second edition of Cohn-Kanade database, showing a computational advantage and achieving a performance recognition rate comparable than methods based on different descriptors.


  1. 1.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36(1), 259–275 (2003)CrossRefzbMATHGoogle Scholar
  2. 2.
    Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expression: the state of art. IEEE Trans. on Pattern Analysis and Machine Intelligence (2000)Google Scholar
  3. 3.
    Liu, S.S., Tian, Y.T., Li, D.: New research advances of facial expression recognition. In: Proc. of the Eighth Int. Conf. on Machine Learning and Cybernetics (2009)Google Scholar
  4. 4.
    Bartlett, M.S., Littlewort, G.C., Frank, M.G., Lainscsek, C., Fasel, I.R., Movelland, R.: Automatic recognition of facial actions in spontaneous expressions. Journal of Multimedia (2006)Google Scholar
  5. 5.
    Whitehill, J., Littlewort, G., Fasel, I., Bartlett, M., Movellan, J.: Toward practical smile detection. IEEE Trans. on Pattern Analysis and Machine Intelligence 31, 2106–2111 (2009)CrossRefGoogle Scholar
  6. 6.
    Yang, P., Liu, Q., Metaxas, D.N.: Boosting encoded dynamic features for facial expression recognition. Pattern Recognition Letters 30(2), 132–139 (2009), Video-based Object and Event Analysis CrossRefGoogle Scholar
  7. 7.
    Uddin, M. Z., Lee, J.J., Kim, T.S.: An enhanced indipendent component-based human facial expression recognition from video. IEEE Trans. on Consumer Electronics (2009)Google Scholar
  8. 8.
    Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing 27(6), 803–816 (2009)CrossRefGoogle Scholar
  9. 9.
    Zhao, G., Pietikinen, M.: Boosted multi-resolution spatiotemporal descriptors for facial expression recognition. Pattern Recognition Letters 30(12), 1117–1127 (2009), Image/video-based Pattern Analysis and HCI Applications CrossRefGoogle Scholar
  10. 10.
    Lin, D.-T., Pan, D.-C.: Integrating a mixed-feature model and multiclass support vector machine for facial expression recognition. Integr. Comput.-Aided Eng. 16, 61–74 (2009)Google Scholar
  11. 11.
    Ojala, T., Pietikäinen, M.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 971–987 (2002)CrossRefGoogle Scholar
  12. 12.
    Hu, Y., Zeng, Z., Yin, L., Wei, X., Zhou, X., Huang, T.S.: Multi-View Facial Expression Recognition. In: 8th Int. Conf. on Automatic Face and Gesture Recognition (2008)Google Scholar
  13. 13.
    Moore, S., Bowden, R.: Local binary patterns for multi-view facial expression recognition. Computer Vision and Image Understanding 115(4), 541–558 (2011)CrossRefGoogle Scholar
  14. 14.
    Gonazalez, C., Woods, E.: Digital Image Processing. Prentice-Hall, Englewood Cliffs (2001)Google Scholar
  15. 15.
    Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proc. of the Fourth IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 46–53 (2000)Google Scholar
  16. 16.
    Hall, M., Frank, E.: The WEKA data mining software: An update. SIGKDD Explorations 11(1) (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Roberto D’Ambrosio
    • 1
  • Giulio Iannello
    • 1
  • Paolo Soda
    • 1
  1. 1.Integrated Research CenterUniversità Campus Bio-Medico di RomaRomaItaly

Personalised recommendations