Skip to main content

Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures

  • Chapter

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
EUR   29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR   117.69
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR   158.24
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
EUR   158.24
Price includes VAT (France)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S Baron-Cohen. How to build a baby that can read minds: Cognitive mechanisms in mindreading. Current Psychology of Cognition, pp 513–552, 1994.

    Google Scholar 

  2. S Baron-Cohen. Mindblindness: An Essay on Autism and Theory of Mind. MIT Press, 1995.

    Google Scholar 

  3. S Baron-Cohen. The Essential Difference: The Truth about the Male and Female Brain. Perseus Publishing, 2003.

    Google Scholar 

  4. S Baron-Cohen et al. A New Taxonomy of Human Emotions. 2004.

    Google Scholar 

  5. S Baron-Cohen et al. Mind Reading: The Interactive Guide to Emotions. Jessica Kingsley Publishers, 2004.

    Google Scholar 

  6. S Baron-Cohen et al. Reading the mind in the face: A cross-cultural and developmental Study. Visual Cognition, pp 39–59, 1996.

    Google Scholar 

  7. M Batty and M J Taylor. Early processing of the six basic facial emotional expressions. Cognitive Brain Research, pp 613–620, 2003.

    Google Scholar 

  8. A Bechara et al. Emotion, decision making, and the orbitofrontal cortex. Cereb Cortex, pp 295–307, 2000.

    Google Scholar 

  9. R Birdwhistell. Kinesics and Context. University of Pennsylvania Press, 1970.

    Google Scholar 

  10. M La Cascia et al. Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models. IEEE Trans PAMI, pp 322–336, 2000.

    Google Scholar 

  11. I Cohen et al. Learning Bayesian network classifiers for facial expression recognition with both labeled and unlabeled data. Proc CVPR, 2003.

    Google Scholar 

  12. J F Cohn et al. Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology, pp 35–43, 1999.

    Google Scholar 

  13. A R Damasio. Descartes Error: Emotion, Reason, and the Human Brain. Putnam Sons, 1994.

    Google Scholar 

  14. G Donato et al. Classifying facial actions. IEEE Trans PAMI, pp 974–989, 1999.

    Google Scholar 

  15. P Ekman. About brows: Emotional and conversational signals. In: M von Cranach (Editor). Human Ethology. Cambridge University Press, 1979.

    Google Scholar 

  16. P Ekman and W V Friesen. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, 1978.

    Google Scholar 

  17. M Erdem and S Sclaroff. Automatic detection of relevant head gestures in American Sign Language communication. Proc ICPR, 2002.

    Google Scholar 

  18. FaceTracker. Facial Feature Tracking SDK. Neven Vision, 2002.

    Google Scholar 

  19. A Garg et al. Bayesian networks as ensemble of classifiers. Proc ICPR, 2002.

    Google Scholar 

  20. H Gu and Q Ji. Facial event classification with task oriented Dynamic Bayesian Network. Proc CVPR, 2004.

    Google Scholar 

  21. H Guo and W H Hsu. A Survey of algorithms for real-time Bayesian network inference. Proc Joint Workshop on Real-Time Decision Support and Diagnosis Systems, 2002.

    Google Scholar 

  22. J Hoey and J J Little. Bayesian clustering of optical flow fields. Proc ICCV, 2003.

    Google Scholar 

  23. A M Isen. Positive affect and decision making. In: M Lewis and J M Haviland-Jones (Editors). Handbook of Emotions. Guilford Press, 2000.

    Google Scholar 

  24. R el Kaliouby and P Robinson. Real-time inference of complex mental states from facial expressions and head gestures. Proc IEEE Workshop on Real-Time Vision for Human-Computer Interaction, 2004.

    Google Scholar 

  25. R el Kaliouby et al. Temporal context and the recognition of emotion from facial expression. Proc of HCI Int Conf, 2003.

    Google Scholar 

  26. T Kanade et al. Comprehensive database for facial expression analysis. Proc Int Conf on Automatic Face and Gesture Recognition, 2000.

    Google Scholar 

  27. A Kapoor and R W Picard. A real-time head nod and shake detector. Proc Workshop on Perceptive User Interfaces, 2001.

    Google Scholar 

  28. S Kawato and J Ohya. Real-time detection of nodding and head-shaking by directly detecting and tracking the “Between-Eyes.” Proc Int Conf on Automatic Face and Gesture Recognition, 2000.

    Google Scholar 

  29. J J Lien et al. Automated facial expression recognition. Proc Int Conf on Automatic Face and Gesture Recognition, 1998.

    Google Scholar 

  30. G Littlewort et al. Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In: S Thrun and B Schoelkopf (Editors). Advances in Neural Information Processing Systems. MIT Press, 2004.

    Google Scholar 

  31. T Marill and D M Green. On the effectiveness of receptors recognition systems. IEEE Trans IT-9, pp 11–27, 1963.

    Google Scholar 

  32. P Michel and R el Kaliouby. Real-time facial expression recognition in video using Support Vector Machines. Proc IEEE Int Conf on Multimodal Interfaces, 2003.

    Google Scholar 

  33. C Morimoto et al. Recognition of head gestures using Hidden Markov Models. Proc ICPR, 1996.

    Google Scholar 

  34. C Padgett and G Cottrell. Identifying emotion in static images. Proc Joint Symp of Neural Computation, 1995.

    Google Scholar 

  35. M Pantic and L J M Rothkrantz. Automatic analysis of facial expressions: The state of the art. IEEE Trans PAMI, pp 1424–1445, 2000.

    Google Scholar 

  36. M Pantic and L J M Rothkrantz. Expert system for automatic analysis of facial expressions. Image and Vision Computing, pp 881–905, 2000.

    Google Scholar 

  37. S Park and J K Aggarwal. Semantic-level understanding of human actions and interactions using event hierarchy. Proc IEEE Workshop on Articulated and Non-Rigid Motion, 2004.

    Google Scholar 

  38. P Rozin and A B Cohen. High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans. Emotion, pp 68–75, 2003.

    Google Scholar 

  39. Y-L Tian et al. Recognizing action units for facial expression analysis. IEEE Trans PAMI, pp 97–115, 2001.

    Google Scholar 

  40. M Turk and M Kölsch. Perceptual interfaces. In: G Medioni and S B Kang (Editors). Emerging Topics in Computer Vision. Prentice Hall, 2004.

    Google Scholar 

  41. J Xiao et al. Robust full motion recovery of head by dynamic templates and re-registration techniques. Proc Int Conf on Automatic Face and Gesture Recognition, 2002.

    Google Scholar 

  42. Y Zhang and Q Ji. Facial expression understanding in image sequences using dynamic and active visual information fusion. Proc ICCV, 2003.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

el Kaliouby, R., Robinson, P. (2005). Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures. In: Kisačanin, B., Pavlović, V., Huang, T.S. (eds) Real-Time Vision for Human-Computer Interaction. Springer, Boston, MA. https://doi.org/10.1007/0-387-27890-7_11

Download citation

  • DOI: https://doi.org/10.1007/0-387-27890-7_11

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-27697-7

  • Online ISBN: 978-0-387-27890-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics