Skip to main content

Facial Expression Recognition by Sparse Reconstruction with Robust Features

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 7950)

Abstract

Facial expression analysis relies on the accurate detection of a few subtle face traces. According to specialists [3], facial expressions can be decomposed into a set of small Action Units (AU) corresponding to different face regions. In this paper, we propose to detect facial expressions with sparse reconstruction methods. Inspired by sparse regularization and sparse over-complete dictionaries, we aim at finding the minimal set of face atoms that can represent a given expression. l 1 based reconstruction computes the deviation from the average face as an additive model of facial expression atoms and classify unknown expressions accordingly. We compared the proposed approach to existing methods on the well-known Cohn-Kanade (CK+) dataset [6]. Results indicate that sparse reconstruction with l 1 penalty outperforms SVM and k-NN baselines with the tested features. The best accuracy (97%) was obtained using sparse reconstruction in an unsupervised setting.

Keywords

  • Support Vector Machine
  • Facial Expression
  • Face Recognition
  • Face Image
  • Local Binary Pattern

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-39094-4_13
  • Chapter length: 9 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   89.00
Price excludes VAT (USA)
  • ISBN: 978-3-642-39094-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   119.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Asthana, A., et al.: Evaluating AAM fitting methods for facial expression recognition. In: 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pp. 1–8. IEEE (2009)

    Google Scholar 

  2. Dahmane, M., Meunier, J.: Continuous emotion recognition using Gabor energy filters. In: Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction, pp. 351–358 (2011)

    Google Scholar 

  3. Ekman, P., et al.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  4. Ekman, P.: Facial expression and emotion. The American Psychologist 48(4), 384–392 (1993)

    CrossRef  Google Scholar 

  5. Littlewort, G., Fasel, I.: Fully automatic coding of basic expressions from video. INC MPLab Technical Report 6 (2002)

    Google Scholar 

  6. Lucey, P., et al.: The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, pp. 94–101. IEEE (2010)

    Google Scholar 

  7. Lyons, M., et al.: Coding facial expressions with Gabor wavelets. In: Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE Comput. Soc. (1998)

    Google Scholar 

  8. Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(8), 837–842 (1996)

    CrossRef  Google Scholar 

  9. Nagesh, P.: A compressive sensing approach for expression-invariant face recognition. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1518–1525. IEEE (2009)

    Google Scholar 

  10. Shan, C., et al.: Robust facial expression recognition using local binary patterns. In: IEEE International Conference on Image Processing 2005, pp. II–370. IEEE (2005)

    Google Scholar 

  11. Valstar, M.F., et al.: Meta-Analysis of the First Facial Expression Recognition Challenge. IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics: a publication of the IEEE Systems, Man, and Cybernetics Society 42 (2012)

    Google Scholar 

  12. Viola, P., Jones, M.J.: Robust Real-Time Face Detection. International Journal of Computer Vision 57(2), 137–154 (2004)

    CrossRef  Google Scholar 

  13. Wright, J., et al.: Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2), 210–227 (2009)

    CrossRef  Google Scholar 

  14. Yeasin, M., et al.: Recognition of facial expressions and measurement of levels of interest from video. IEEE Transactions on Multimedia 8(3), 500–508 (2006)

    CrossRef  Google Scholar 

  15. Zhang, S., et al.: Robust facial expression recognition via compressive sensing. Sensors (Basel, Switzerland) 12(3), 3747–3761 (2012)

    CrossRef  Google Scholar 

  16. Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 915–928 (2007)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mourão, A., Borges, P., Correia, N., Magalhães, J. (2013). Facial Expression Recognition by Sparse Reconstruction with Robust Features. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2013. Lecture Notes in Computer Science, vol 7950. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39094-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-39094-4_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-39093-7

  • Online ISBN: 978-3-642-39094-4

  • eBook Packages: Computer ScienceComputer Science (R0)