Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures

  • Rana el Kaliouby
  • Peter Robinson


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    S Baron-Cohen. How to build a baby that can read minds: Cognitive mechanisms in mindreading. Current Psychology of Cognition, pp 513–552, 1994.Google Scholar
  2. 2.
    S Baron-Cohen. Mindblindness: An Essay on Autism and Theory of Mind. MIT Press, 1995.Google Scholar
  3. 3.
    S Baron-Cohen. The Essential Difference: The Truth about the Male and Female Brain. Perseus Publishing, 2003.Google Scholar
  4. 4.
    S Baron-Cohen et al. A New Taxonomy of Human Emotions. 2004.Google Scholar
  5. 5.
    S Baron-Cohen et al. Mind Reading: The Interactive Guide to Emotions. Jessica Kingsley Publishers, 2004.Google Scholar
  6. 6.
    S Baron-Cohen et al. Reading the mind in the face: A cross-cultural and developmental Study. Visual Cognition, pp 39–59, 1996.Google Scholar
  7. 7.
    M Batty and M J Taylor. Early processing of the six basic facial emotional expressions. Cognitive Brain Research, pp 613–620, 2003.Google Scholar
  8. 8.
    A Bechara et al. Emotion, decision making, and the orbitofrontal cortex. Cereb Cortex, pp 295–307, 2000.Google Scholar
  9. 9.
    R Birdwhistell. Kinesics and Context. University of Pennsylvania Press, 1970.Google Scholar
  10. 10.
    M La Cascia et al. Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models. IEEE Trans PAMI, pp 322–336, 2000.Google Scholar
  11. 11.
    I Cohen et al. Learning Bayesian network classifiers for facial expression recognition with both labeled and unlabeled data. Proc CVPR, 2003.Google Scholar
  12. 12.
    J F Cohn et al. Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology, pp 35–43, 1999.Google Scholar
  13. 13.
    A R Damasio. Descartes Error: Emotion, Reason, and the Human Brain. Putnam Sons, 1994.Google Scholar
  14. 14.
    G Donato et al. Classifying facial actions. IEEE Trans PAMI, pp 974–989, 1999.Google Scholar
  15. 15.
    P Ekman. About brows: Emotional and conversational signals. In: M von Cranach (Editor). Human Ethology. Cambridge University Press, 1979.Google Scholar
  16. 16.
    P Ekman and W V Friesen. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, 1978.Google Scholar
  17. 17.
    M Erdem and S Sclaroff. Automatic detection of relevant head gestures in American Sign Language communication. Proc ICPR, 2002.Google Scholar
  18. 18.
    FaceTracker. Facial Feature Tracking SDK. Neven Vision, 2002.Google Scholar
  19. 19.
    A Garg et al. Bayesian networks as ensemble of classifiers. Proc ICPR, 2002.Google Scholar
  20. 20.
    H Gu and Q Ji. Facial event classification with task oriented Dynamic Bayesian Network. Proc CVPR, 2004.Google Scholar
  21. 21.
    H Guo and W H Hsu. A Survey of algorithms for real-time Bayesian network inference. Proc Joint Workshop on Real-Time Decision Support and Diagnosis Systems, 2002.Google Scholar
  22. 22.
    J Hoey and J J Little. Bayesian clustering of optical flow fields. Proc ICCV, 2003.Google Scholar
  23. 23.
    A M Isen. Positive affect and decision making. In: M Lewis and J M Haviland-Jones (Editors). Handbook of Emotions. Guilford Press, 2000.Google Scholar
  24. 24.
    R el Kaliouby and P Robinson. Real-time inference of complex mental states from facial expressions and head gestures. Proc IEEE Workshop on Real-Time Vision for Human-Computer Interaction, 2004.Google Scholar
  25. 25.
    R el Kaliouby et al. Temporal context and the recognition of emotion from facial expression. Proc of HCI Int Conf, 2003.Google Scholar
  26. 26.
    T Kanade et al. Comprehensive database for facial expression analysis. Proc Int Conf on Automatic Face and Gesture Recognition, 2000.Google Scholar
  27. 27.
    A Kapoor and R W Picard. A real-time head nod and shake detector. Proc Workshop on Perceptive User Interfaces, 2001.Google Scholar
  28. 28.
    S Kawato and J Ohya. Real-time detection of nodding and head-shaking by directly detecting and tracking the “Between-Eyes.” Proc Int Conf on Automatic Face and Gesture Recognition, 2000.Google Scholar
  29. 29.
    J J Lien et al. Automated facial expression recognition. Proc Int Conf on Automatic Face and Gesture Recognition, 1998.Google Scholar
  30. 30.
    G Littlewort et al. Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In: S Thrun and B Schoelkopf (Editors). Advances in Neural Information Processing Systems. MIT Press, 2004.Google Scholar
  31. 31.
    T Marill and D M Green. On the effectiveness of receptors recognition systems. IEEE Trans IT-9, pp 11–27, 1963.Google Scholar
  32. 32.
    P Michel and R el Kaliouby. Real-time facial expression recognition in video using Support Vector Machines. Proc IEEE Int Conf on Multimodal Interfaces, 2003.Google Scholar
  33. 33.
    C Morimoto et al. Recognition of head gestures using Hidden Markov Models. Proc ICPR, 1996.Google Scholar
  34. 34.
    C Padgett and G Cottrell. Identifying emotion in static images. Proc Joint Symp of Neural Computation, 1995.Google Scholar
  35. 35.
    M Pantic and L J M Rothkrantz. Automatic analysis of facial expressions: The state of the art. IEEE Trans PAMI, pp 1424–1445, 2000.Google Scholar
  36. 36.
    M Pantic and L J M Rothkrantz. Expert system for automatic analysis of facial expressions. Image and Vision Computing, pp 881–905, 2000.Google Scholar
  37. 37.
    S Park and J K Aggarwal. Semantic-level understanding of human actions and interactions using event hierarchy. Proc IEEE Workshop on Articulated and Non-Rigid Motion, 2004.Google Scholar
  38. 38.
    P Rozin and A B Cohen. High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans. Emotion, pp 68–75, 2003.Google Scholar
  39. 39.
    Y-L Tian et al. Recognizing action units for facial expression analysis. IEEE Trans PAMI, pp 97–115, 2001.Google Scholar
  40. 40.
    M Turk and M Kölsch. Perceptual interfaces. In: G Medioni and S B Kang (Editors). Emerging Topics in Computer Vision. Prentice Hall, 2004.Google Scholar
  41. 41.
    J Xiao et al. Robust full motion recovery of head by dynamic templates and re-registration techniques. Proc Int Conf on Automatic Face and Gesture Recognition, 2002.Google Scholar
  42. 42.
    Y Zhang and Q Ji. Facial expression understanding in image sequences using dynamic and active visual information fusion. Proc ICCV, 2003.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2005

Authors and Affiliations

  • Rana el Kaliouby
    • 1
  • Peter Robinson
    • 1
  1. 1.Computer LaboratoryUniversity of CambridgeUK

Personalised recommendations