Abstract
In this paper we describe how to generate affective dialogs for multiple virtual characters based on a combination of both automatically generated and pre-scripted scenes. This is done by using the same technique for emotion elicitation and computation that takes either input from the human author in the form of appraisal and dialog act tags or from a dialog planner in the form inferred emotion eliciting conditions. In either case, the system computes the resulting emotions and their intensities. Emotions are used to inform the selection of pre-scripted scenes and dialog strategies, and their surface realization. The approach has been integrated in two fully operable systems, the CrossTalk II installation and the NECA eShowroom.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
André E., Rist T., van Mulken S., Klesen M., and Baldes S.: The automated design of believable dialogues for animated presentation teams. In: [32], pp. 220–255
Rist, T., André, E., Baldes, S.: In: Proc of IUI 2003, A Flexible Platform for Building Applications with Life-Like Characters, pp. 158–165. ACM Press, New York (2003)
Klesen, M., Kipp, M., Gebhard, P., Rist, T.: Staging Exhibitions: Methods and tools for modelling narrative structure to produce interactive performances with virtual actors. Journal of Virtual Reality – Special issue on Storytelling in Virtual Environments (2003)
Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Authoring Scenes for Adaptive, Interactive Performances. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2003 (2003)
Laurel, B.: Computers as theatre. Addison-Wesley, Reading (1993)
Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiébaux, M., Tuch, L., Whitney, R., Douglas, J.: Towards the Holodeck: Integrating Graphics, Sound, Character and Story. In: Proc. of Autonomous Agents 2001, pp. 409–416 (2001)
Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., Krüger, A.: The Museum Visit: Generating Seamless Personalized Presentations on Multiple Devices. In: Proc. of Intelligent User Interfaces (2004)
Murray, J.H.: Hamlet on the Holodeck: The Future of Narrative in Cyberspace. The MIT Press, Cambridge (2000)
Ryokai, K., Vaucelle, C., Cassell, J.: Virtual peers as partners in storytelling and literacy learning. Journal of Computer Assisted Learning 19(2), 195–208 (2003)
McBreen, H., Jack, M.: Evaluating Humanoid Synthetic Agents in E-Retail Applications. IEEE Trans. On Systems, Man, and Cybernetics-Part A: Systems and Humans 31(5), 394–405 (2001)
Diederiks, E.: Buddies in a Box Animated Characters in Consumer Electronics. In: Proc. of IUI 2003, pp. 34–38 (2003)
Lester, J., Voerman, J.L., Towns, S.G., Callaway, C.B.: Cosmo: A life-like animated pedagogical agent with deictic believability. In: Proc. of the IJCAI 1997 Workshop on Animated Interface Agents: Making them Intelligent, Nagoya (1997)
Émile, G.J.: Marshalling Passions in Training and Education. In: Proc. of Autonomous Agents 2000, pp. 325–332 (2000)
Ball, G., Breese, J.: Emotion and personality in a conversational agent. In: [32], pp. 189–219
de Carolis, B., Pelachaud, C., Poggi, I., Steedman, M.: APML, a Markup Language for Believable Behavior Generation. In: [31], pp. 65–85
Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)
Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., Stone, M.: Animated Conversation: Rule-Based Generation of Facial Expression, Gesture and Spoken Intonation for Multiple Conversational Agents. In: Proc. of SIGGRAPH 1994, pp. 413–420 (1994)
Nitta, K., Hasegawa, O., Akiba, T., Kamishima, T., Kurita, T., Hayamizu, S., Itoh, K., Ishizuka, M., Dohi, H., Okamura, M.: An experimental multimodal disputation system. In: Proc. of the IJCAI 1997 Workshop on Intelligent Multimodal Systems (1997)
Rickel, J., Johnson, W.L.: Virtual Humans for Team Training in Virtual Reality. In: Proc of the Ninth International Conference on Artificial Intelligence in Education, pp. 578–585. IOS Press, Amsterdam (1999)
Traum, D.R., Rickel, J.: Embodied agents for multi-party dialogue in immersive virtual worlds. In: Proc. of the First International Joint conference on Autonomous Agents and Multiagent systems (2002)
Prendinger, H., Saeyor, S., Ishizuka, M.: MPML and SCREAM: Scripting the Bodies and Minds of Life-Like Characters. In: [31], pp. 213–242
Guye-Vuillieme, A., Thalmann, D.: A High Level Architecture For Believable Social Agents. VR Journal 5, 95–106 (2001)
Rist, T., Schmitt, M.: Applying Socio-Psychological Concepts of Cognitive Consistency to Negotiation Dialog Scenarios with Embodied Conversational Characters. In: Proc. of AISB 2002 Symposium on Animated Expressive Characters for Social Interactions, pp. 79–84 (2002)
Walker, M., Cahn, J., Whittaker, S.J.: Improving linguistic style: Social and affective bases for agent personality. In: Proc. of the First International Conference on Autonomous Agents, pp. 96–105 (1997)
McCrae, R.R., John, O.P.: An introduction to the five-factor model and its implications. Journal of Personality 60, 171–215 (1992)
Krenn, B., Pirker, H., Grice, M., Piwek, P., van Deemter, K., Schröder, M., Klesen, M.: Generation of multimodal dialogue for net environments. In: Proc. der 6. Konferenz zur Verarbeitung natürlicher Sprache (2002)
Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Adding the Emotional Dimension to Scripting Character Dialogues. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 48–56. Springer, Heidelberg (2003)
Kendon, A.: Nonverbal Communication, Interaction, and Gesture.Mouton, The Hague (1980)
Russel, J.A.: How shall an emotion be called. In: Plutchik, R., Conte, H.R. (eds.) Circumplex models of personality and emotions, American Psychological Association (1997)
Schröder, M.: Speech and Emotion Research: An overview of research frameworks and a dimensional approach to emotional speech synthesis. PhD thesis, Institute of Phonetics, Saarland University (2003)
Prendinger, H., Ishizuka, M.: Life-Like Characters – Tools, Affective Functions, and Applications. Springer, Heidelberg (2004)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. The MIT Press, Cambridge (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gebhard, P., Klesen, M., Rist, T. (2004). Coloring Multi-character Conversations through the Expression of Emotions. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-24842-2_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22143-2
Online ISBN: 978-3-540-24842-2
eBook Packages: Springer Book Archive