Expression Animation of Interactive Virtual Humans Based on HMM Emotion Model

  • Guojiang Wang
  • Zhiliang Wang
  • Xiuyan Meng
  • Shaodong Teng
  • Yinggang Xie
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3942)


Emotion plays an essential role in adaptation and social communication in organism. Similarly, appropriately timed and clearly expressed emotion is a central required for believable interactive virtual humans. Presently, incorporating emotion into virtual humans is gain increasing attention in academia and industry. This strong interest is driven by a wide spectrum of promising applications in many areas such as virtual reality, e-learning, entertainment, etc.This paper discusses a system that allows the design of emotion for interactive virtual human. We introduce an emotion model of artificial psychology, in which the transition of emotion can be viewed as a Morkov process and the relation of between emotion and mood can be describes by Hidden Morkov Model (HMM). In order to demonstrate the approach, we integrate the emotion model into a system composed of voice recognition and a realistic facial model. Thus, the model can be used for generating a variety of emotional expression of autonomous, interactive virtual humans.


Facial Expression Hide State Observation Sequence Voice Recognition Virtual Human 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Haskell, S., Hosmer, A., Leu, E., Stepniewicz, P., Zayat, S., Zhu, J., Patel, S., Harger, B.: An Extensible Platform for Interactive, Entertaining Social Experiences with an Animatronic Character. In: Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACE 2005, pp. 141–148 (June 2005)Google Scholar
  2. 2.
    Damasio, A.: Descartes Error: Emotion, Reason, and the Human Brain. G.P. Putnam, New York (1994)Google Scholar
  3. 3.
    Sloman, A., Croucher, M.: Why robots will have emotions. In: Proceedings of IJCAI7, pp. 197–202 (1987)Google Scholar
  4. 4.
    Picard, R.: Affective computing: challenges. Int. J. Human-Computer Studies 59, 55–64 (2003)CrossRefGoogle Scholar
  5. 5.
    Ball, G., Breese, J.: Emotion and personality ina conversational character. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents. MIT Press, Cambridge (2000)Google Scholar
  6. 6.
    Kshirsagar, S.: A Multilayer Personality Model. In: SMARTGRAPH 2002: Proceedings of the 2nd international symposium on Smart graphics, pp. 107–115. ACM Press, New York (2002)CrossRefGoogle Scholar
  7. 7.
    Popovici Vlad, O., Vachkov, G., fukuda, T.: fuzzy emotion interpolation system for emotional autonomous agents. In: SICE 2002. Proceedings of the 41st SICE Annual Conference, vol. 5, pp. 3157–3162 (2002)Google Scholar
  8. 8.
    Takanishi, A., Sato, K., Segawa, K., Takanobu, H., Miwa, H.: An Antropomorphic Head-Eye Robot expressing Emotions based on Equations of Emotions. In: Proceedings Of the 2000 IEEE International Conference on Robotics and Automation, pp. 2243–2249 (2000)Google Scholar
  9. 9.
    El Jed, M., Pallamin, N., Dugdale, J., Pavard, B.: Modelling character emotion in an interactive virtual environment. In: proceedings of AISB 2004 Symposium: Motion, Emotion and Cognition, March 29- April 1 (2004)Google Scholar
  10. 10.
    Wang, Z., Xie, L.: Artificial Psychology-an Attainable Scientific Research on the Human Brain. In: IPMM 1999 honolulu, USA, July 10-15 (1999)Google Scholar
  11. 11.
  12. 12.
    Ekman, P.: Moods, emotions, and traits. In: Ekman, P., Davidson, R.J. (eds.) The nature of emotions, pp. 56–58. Oxford University Press, New YorkGoogle Scholar
  13. 13.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2) (1989)Google Scholar
  14. 14.
    kman, E., Friesen, W.: Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1977)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Guojiang Wang
    • 1
  • Zhiliang Wang
    • 1
  • Xiuyan Meng
    • 1
  • Shaodong Teng
    • 1
  • Yinggang Xie
    • 1
  1. 1.School of Information and EngineeringUniversity of Science and TechnologyBeijingChina

Personalised recommendations