Endowing Spoken Language Dialogue Systems with Emotional Intelligence

  • Elisabeth André
  • Matthias Rehm
  • Wolfgang Minker
  • Dirk Bühler
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3068)


While most dialogue systems restrict themselves to the adjustment of the propositional contents, our work concentrates on the generation of stylistic variations in order to improve the user’s perception of the interaction. To accomplish this goal, our approach integrates a social theory of politeness with a cognitive theory of emotions. We propose a hierarchical selection process for politeness behaviors in order to enable the refinement of decisions in case additional context information becomes available.


Emotional State Multiagent System Emotional Intelligence Social Distance Dialogue System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Reeves, B., Nass, C.: The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, Cambridge (1996)Google Scholar
  2. 2.
    Martinovski, B., Traum, D.: Breakdown in human-machine interaction: the error is the clue. In: Proceedings of the ISCA tutorial and research workshop on Error handling in dialogue systems, pp. 11–16 (2003)Google Scholar
  3. 3.
    Prendinger, H., Mayer, S., Mori, J., Ishizuka, M.: Persona effect revisited. using bio-signals to measure and reflect the impact of character-based interfaces. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 283–291. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  4. 4.
    Litman, D.J., Pan, S.: Designing and Evaluating an Adaptive Spoken Dialogue System. User Modeling and User-Adapted Interaction 12, 111–137 (2002)zbMATHCrossRefGoogle Scholar
  5. 5.
    Polzin, T.S., Waibel, A.: Emotion-sensitive human-computer interfaces. In: ITRW on Speech and Emotion, pp. 201–206. ISCA (2000)Google Scholar
  6. 6.
    Walker, M.A., Cahn, J.E., Whittaker, S.J.: Improvising linguistic style: Social and affective bases of agent personality. In: Johnson, W.L., Hayes-Roth, B. (eds.) Proceedings of the First International Conference on Autonomous Agents (Agents 1997), Marina del Rey, CA, USA, pp. 96–105. ACM Press, New York (1997)CrossRefGoogle Scholar
  7. 7.
    Marsella, S.C., Johnson, W.L., Labore, C.: Interactive pedagogical drama. In: Sierra, C., Gini, M., Rosenschein, J.S. (eds.) Proceedings of the Fourth International Conference on Autonomous Agents, Barcelona, Catalonia, Spain, pp. 301–308. ACM Press, New York (2000)CrossRefGoogle Scholar
  8. 8.
    Gratch, J., Marsella, S.: Tears and fears: modeling emotions and emotional behaviors in synthetic agents. In: Müller, J.P., Andre, E., Sen, S., Frasson, C. (eds.) Proceedings of the Fifth International Conference on Autonomous Agents, Montreal, Canada, pp. 278–285. ACM Press, New York (2001)CrossRefGoogle Scholar
  9. 9.
    Paiva, A., Chaves, R., Piedade, M., Bullock, A., Andersson, G., Höök, K.: Sentoy: a tangible interface to control the emotions of a synthetic character. In: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 1088–1089. ACM Press, New York (2003)CrossRefGoogle Scholar
  10. 10.
    Lester, J.C., Towns, S.G., Callaway, C.B., Voerman, J.L., FitzGerald, P.J.: Deictic and emotive communication in animated pedagogical agents. In: Cassell, J., Prevost, S., Sullivan, J., Churchill, E. (eds.) Embodied Conversational Agents, pp. 123–154. The MIT Press, Cambridge (2000)Google Scholar
  11. 11.
    Pelachaud, C., Carofiglio, V., De Carolis, B., de Rosis, F., Poggi, I.: Embodied contextual agent in information delivering application. In: Proceedings of the first international joint conference on Autonomous agents and multiagent systems, pp. 758–765. ACM Press, New York (2002)CrossRefGoogle Scholar
  12. 12.
    Prendinger, H., Ishizuka, M.: Social role awareness in animated agents. In: Proceedings of the fifth international conference on Autonomous agents, pp. 270–277. ACM Press, New York (2001)CrossRefGoogle Scholar
  13. 13.
    Brown, P., Levinson, S.C.: Politeness - Some universals in language use. Cambridge University Press, Cambridge (1987)Google Scholar
  14. 14.
    Lang, P.J.: The emotion probe: Studies of motivation and attention. American Psychologist 50, 372–385 (2002)CrossRefGoogle Scholar
  15. 15.
    Bosma, W., André, E.: Exploiting emotions to disambiguate dialogue acts. In: Proceedings of the 9th International Conference on Intelligent User Interface, pp. 85–92. ACM Press, New York (2004)CrossRefGoogle Scholar
  16. 16.
    Bühler, D., Minker, W.: An architecture for logic-based human-machine dialogue. In: ISCA ITRW Workshop on Spoken Multimodal Human-Computer Dialogue in Mobile Environments, Kluwer, Dordrecht (2002)Google Scholar
  17. 17.
    Knapp, M.L., Daly, J.A.: Handbook of Interpersonal Communication. Sage Publications, Thousand Oaks (2003)Google Scholar
  18. 18.
    Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1988)Google Scholar
  19. 19.
    Johnson, L., Rizzo, P., Bosma, W., Kole, S., Ghijesen, M., van Welbergen, H.: Generating socially appropriate tutorial dialog. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 254–264. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Elisabeth André
    • 1
  • Matthias Rehm
    • 1
  • Wolfgang Minker
    • 2
  • Dirk Bühler
    • 2
  1. 1.Multimedia Concepts and ApplicationsUniversity of AugsburgGermany
  2. 2.Information TechnologyUniversity of UlmGermany

Personalised recommendations