Skip to main content

Simulating the Emotion Dynamics of a Multimodal Conversational Agent

  • Conference paper
Affective Dialogue Systems (ADS 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3068))

Included in the following conference series:

Abstract

We describe an implemented system for the simulation and visualisation of the emotional state of a multimodal conversational agent called Max. The focus of the presented work lies on modeling a coherent course of emotions over time. The basic idea of the underlying emotion system is the linkage of two interrelated psychological concepts: an emotion axis – representing short-time system states – and an orthogonal mood axis that stands for an undirected, longer lasting system state. A third axis was added to realize a dimension of boredom. To enhance the believability and lifelikeness of Max, the emotion system has been integrated in the agent’s architecture. In result, Max’s facial expression, gesture, speech, and secondary behaviors as well as his cognitive functions are modulated by the emotional system that, in turn, is affected by information arising at various levels within the agent’s architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. André, E., Klesen, M., Gebhard, P., Allen, S., Rist, T.: Integrating models of personality and emotions into lifelike characters. In: Paiva, A., Martinho, C. (eds.) Proceedings of the workshop on Affect in Interactions, pp. 136–149. Siena (1999)

    Google Scholar 

  2. Breazeal, C.: Kismet Homepage (2003), http://www.ai.nit.edu/projects/humanoid-roboticsgroup/kismet/kismet.html

  3. Churchill, E.F., Cook, L., Hodgson, P., Prevost, S., Sullivan, J.W.: May I Help You?: Designing Embodied Conversational Agent Allies. In: Cassell, et al. (eds.) Embodied Conversational Agents, pp. 64–94. MIT Press, Cambridge (2000)

    Google Scholar 

  4. Egges, A., Zhang, X., Kshirsagar, S., Magnenat-Thalmann, N.: Emotional communication with virtual humans. In: Proceedings of the 9th International Conference on Multi-Media Modeling, Taiwan (2003)

    Google Scholar 

  5. Ekman, P., Friesen, W.V., Ancoli, S.: Facial Sings of emotional experience. Journal of Personality and Social Psychology 29, 1125–1134 (1980)

    Article  Google Scholar 

  6. Elliot, C.: The Affective Reasoner: A Process Model of Emotions in a Multiagent System. Ph.D. Thesis. Northwestern University (1992)

    Google Scholar 

  7. Kopp, S., Jung, B., Lessmann, N., Wachsmuth, I.: Max – A Multimodal Assistant in Virtual Reality Construction. KI-Künstliche Intelligenz 4/03, 11-17 (2003)

    Google Scholar 

  8. Kruse, O.: Emotionsdynamik und Psychotherapie (1985)

    Google Scholar 

  9. Lerner, J.S., Keltner, D.: Beyond valence: Toward a model of emotion-specific influences on judgement and choice. Cognition and Emotion 14, 473–493 (2000)

    Article  Google Scholar 

  10. Mehrabian, A.: Framework for a Comprehensive Description and Measurement of Emotional States. Genetic, Social, and General Psychology Monographs 121, 339–361 (1995)

    Google Scholar 

  11. Mikulas, W.L., Vodanovich, S.J.: The essence of boredom. The Psychological Record 43, 3–12 (1993)

    Google Scholar 

  12. Oatley, K.: Towards a Cognitive Theory of Emotions. Cognition & Emotion 1(1), 29–50 (1987)

    Article  Google Scholar 

  13. Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions, Cambridge (1988)

    Google Scholar 

  14. Reilly, W.S.N.: Believable Social and Emotional Agents. Ph.D. Thesis. Carnegie Mellon University. Pittsburg (1996)

    Google Scholar 

  15. de Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From Greta’s mind to her face: modelling the dynamics of affective states in a conversational embodied agent. International Journal of Human-Computer Studies 59, 81–118 (2003)

    Article  Google Scholar 

  16. Staller, A., Petta, P.: Towards a Tractable Appraisal-Based Architecture for Situated Cognizers. In: Cañamero, D., Numaoka, C., Petta, P. (eds.) Workshop: Grounding Emotions in Adaptive Systems, Vienna, pp. 56–61 (1998)

    Google Scholar 

  17. Velásquez, J.D.: Modeling Emotion-Based Decision Making. In: Cañamero, D. (ed.) Emotional and Intelligent: The Tangled Knot of Cognition, pp. 164–169 (1998)

    Google Scholar 

  18. Wundt, W.: Vorlesung über die Menschen und Tierseele. Siebente und Achte Auflage (1922)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Becker, C., Kopp, S., Wachsmuth, I. (2004). Simulating the Emotion Dynamics of a Multimodal Conversational Agent. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24842-2_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22143-2

  • Online ISBN: 978-3-540-24842-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics