Skip to main content
SpringerLink
Log in

Facial Expression Recognition

  • Living reference work entry
  • First Online:
Encyclopedia of Biometrics

Synonyms

Facial expression analysis; Facial action coding

Definition

Facial expression recognition is a process performed by humans or computers, which consists of:

  1. 1.

    Locating faces in the scene (e.g., in an image; this step is also referred to asface detection)

  2. 2.

    Extracting facial features from the detected face region (e.g., detecting the shape of facial components or describing the texture of the skin in a facial area; this step is referred to asfacial feature extraction)

  3. 3.

    Analyzing the motion of facial features and/or the changes in the appearance of facial features and classifying this information into some facial expression-interpretative categories such as facial muscle activations like smile or frown, emotion (affect) categories like happiness or anger, attitude categories like (dis)liking or ambivalence, etc. (this step is also referred to asfacial expression interpretation)

Introduction

A widely accepted prediction is that computing will move to the background, weaving...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • M. Pantic, A. Pentland, A. Nijholt, T.S. Huang, Human computing and machine understanding of human behavior: a survey, inArtifical Intelligence for Human Computing. Lecture Notes in Computer Science, vol. 4451 (Springer, Berlin/Heidelberg, 2007) pp. 47–71

    Google Scholar 

  • M. Pantic, L.J.M. Rothkrantz, Toward an affect-sensitive multimodal HCI. Proc. IEEE91(9), 1370–1390 (2003)

    Article  Google Scholar 

  • Y.L. Tian, T. Kanade, J.F. Cohn, Facial expression analysis, inHandbook of Face Recognition, ed. by S.Z. Li, A.K. Jain (Springer, New York, 2005), pp. 247–276

    Chapter  Google Scholar 

  • M. Pantic, M.S. Bartlett, Machine analysis of facial expressions, inFace Recognition, ed. by K. Delac, M. Grgic (I-Tech Education and Publishing, Vienna, 2007), pp. 377–416

    Google Scholar 

  • Z. Zeng, M. Pantic, G.I. Roisman, T.S. Huang, A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell.31(1), 39–58 (2009)

    Article  Google Scholar 

  • N. Ambady, R. Rosenthal, Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychol. Bull.111(2), 256–274 (1992)

    Article  Google Scholar 

  • P. Ekman, E.L. Rosenberg (eds.),What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (Oxford University Press, Oxford, 2005)

    Google Scholar 

  • M.H. Yang, D.J. Kriegman, N. Ahuja, Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell.24(1), 34–58 (2002)

    Article  Google Scholar 

  • S.Z. Li, A.K. Jain (eds.),Handbook of Face Recognition (Springer, New York, 2005)

    MATH  Google Scholar 

  • P. Viola, M. Jones, Robust real-time face detection. Int. J. Comput. Vis.57(2), 137–154 (2004)

    Article  Google Scholar 

  • M. Pantic, I. Patras, Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. Syst. Man Cybern. B Cybern.36(2), 433–449 (2006)

    Article  Google Scholar 

  • J.F. Cohn, P. Ekman, Measuring facial actions, inThe New Handbook of Methods in Nonverbal Behavior Research, ed. by J.A. Harrigan, R. Rosenthal, K. Scherer (Oxford University Press, New York, 2005), pp. 9–64

    Google Scholar 

  • D. Keltner, P. Ekman, Facial expression of emotion, inHandbook of Emotions, ed. by M. Lewis, J.M. Haviland-Jones (Guilford Press, New York, 2000), pp. 236–249

    Google Scholar 

  • P. Ekman, W.V. Friesen, J.C. Hager,Facial Action Coding System (A Human Face, Salt Lake City, 2002)

    Google Scholar 

  • M. Pantic, M.F. Valstar, R. Rademaker, L. Maat, Web-based database for facial expression analysis, inProceedings of the IEEE International Conference on Multimedia & Expo (ICME), Amsterdam, 2005, pp. 317–321

    Google Scholar 

  • P. Ekman, T.S. Huang, T.J. Sejnowski, J.C. Hager (eds.),NSF Understanding the Face (A Human Face eStore, Salt Lake City, 1992). (see Library)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing, Imperial College London, London, UK

    Maja Pantic

Authors
  1. Maja Pantic
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maja Pantic .

Editor information

Editors and Affiliations

  1. Center Biometrics Research & Security Nat'l. Lab of Pattern Recognition, Chinese Academy of Sciences, Beijing, China

    Stan Z. Li

  2. Department of Computer Science & Engineering, Michigan State University, East Lansing, Michigan, USA

    Anil K. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this entry

Cite this entry

Pantic, M. (2014). Facial Expression Recognition. In: Li, S., Jain, A. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-3-642-27733-7_98-3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27733-7_98-3

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Online ISBN: 978-3-642-27733-7

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation