Facial Expression Recognition by Sparse Reconstruction with Robust Features

  • André Mourão
  • Pedro Borges
  • Nuno Correia
  • João Magalhães
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7950)


Facial expression analysis relies on the accurate detection of a few subtle face traces. According to specialists [3], facial expressions can be decomposed into a set of small Action Units (AU) corresponding to different face regions. In this paper, we propose to detect facial expressions with sparse reconstruction methods. Inspired by sparse regularization and sparse over-complete dictionaries, we aim at finding the minimal set of face atoms that can represent a given expression. l 1 based reconstruction computes the deviation from the average face as an additive model of facial expression atoms and classify unknown expressions accordingly. We compared the proposed approach to existing methods on the well-known Cohn-Kanade (CK+) dataset [6]. Results indicate that sparse reconstruction with l 1 penalty outperforms SVM and k-NN baselines with the tested features. The best accuracy (97%) was obtained using sparse reconstruction in an unsupervised setting.


Support Vector Machine Facial Expression Face Recognition Face Image Local Binary Pattern 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Asthana, A., et al.: Evaluating AAM fitting methods for facial expression recognition. In: 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pp. 1–8. IEEE (2009)Google Scholar
  2. 2.
    Dahmane, M., Meunier, J.: Continuous emotion recognition using Gabor energy filters. In: Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction, pp. 351–358 (2011)Google Scholar
  3. 3.
    Ekman, P., et al.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)Google Scholar
  4. 4.
    Ekman, P.: Facial expression and emotion. The American Psychologist 48(4), 384–392 (1993)CrossRefGoogle Scholar
  5. 5.
    Littlewort, G., Fasel, I.: Fully automatic coding of basic expressions from video. INC MPLab Technical Report 6 (2002)Google Scholar
  6. 6.
    Lucey, P., et al.: The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, pp. 94–101. IEEE (2010)Google Scholar
  7. 7.
    Lyons, M., et al.: Coding facial expressions with Gabor wavelets. In: Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE Comput. Soc. (1998)Google Scholar
  8. 8.
    Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(8), 837–842 (1996)CrossRefGoogle Scholar
  9. 9.
    Nagesh, P.: A compressive sensing approach for expression-invariant face recognition. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1518–1525. IEEE (2009)Google Scholar
  10. 10.
    Shan, C., et al.: Robust facial expression recognition using local binary patterns. In: IEEE International Conference on Image Processing 2005, pp. II–370. IEEE (2005)Google Scholar
  11. 11.
    Valstar, M.F., et al.: Meta-Analysis of the First Facial Expression Recognition Challenge. IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics: a publication of the IEEE Systems, Man, and Cybernetics Society 42 (2012)Google Scholar
  12. 12.
    Viola, P., Jones, M.J.: Robust Real-Time Face Detection. International Journal of Computer Vision 57(2), 137–154 (2004)CrossRefGoogle Scholar
  13. 13.
    Wright, J., et al.: Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2), 210–227 (2009)CrossRefGoogle Scholar
  14. 14.
    Yeasin, M., et al.: Recognition of facial expressions and measurement of levels of interest from video. IEEE Transactions on Multimedia 8(3), 500–508 (2006)CrossRefGoogle Scholar
  15. 15.
    Zhang, S., et al.: Robust facial expression recognition via compressive sensing. Sensors (Basel, Switzerland) 12(3), 3747–3761 (2012)CrossRefGoogle Scholar
  16. 16.
    Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 915–928 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • André Mourão
    • 1
  • Pedro Borges
    • 1
  • Nuno Correia
    • 1
  • João Magalhães
    • 1
  1. 1.Departamento de Informática, Faculdade de Ciências e TecnologiaUniversidade Nova de LisboaCaparicaPortugal

Personalised recommendations