, Volume 26, Issue 3, pp 275–289 | Cite as

Toward incorporating emotions with rationality into a communicative virtual agent

  • Andrey KiselevEmail author
  • Benjamin Alexander Hacker
  • Thomas Wankerl
  • Niyaz Abdikeev
  • Toyoaki Nishida
Open Forum


This paper addresses the problem of human–computer interactions when the computer can interpret and express a kind of human-like behavior, offering natural communication. A conceptual framework for incorporating emotions with rationality is proposed. A model of affective social interactions is described. The model utilizes the SAIBA framework, which distinguishes among several stages of processing of information. The SAIBA framework is extended, and a model is realized in human behavior detection, human behavior interpretation, intention planning, attention tracking behavior planning, and behavior realization components. Two models of incorporating emotions with rationality into a virtual artifact are presented. The first one uses an implicit implementation of emotions. The second one has an explicit realization of a three-layered model of emotions, which is highly interconnected with other components of the system. Details of the model with implicit implementation of emotional behavior are shown as well as evaluation methodology and results. Discussions about the extended model of an agent are given in the final part of the paper.


Virtual agent Human-agent interactions Emotional intelligence Embodied conversation agent Belief-desire-intention agent 



This work has been made possible by the 2009 Global COE Program and the Nishida-Sumi Laboratory, Graduate School of Informatics, Kyoto University. Our sincere thanks to Loïc Merkel, and Divesh Lala for advising and giving constructive criticism for this work.


  1. Becker C, Kopp S, Wachsmuth I (2007) Why emotions should be integrated into conversational agents. In: Conversational informatics: an engineering approach, pp 49–68Google Scholar
  2. Bratman ME (1999) [1987] Intention, plans, and practical reason. CSLI Publications. ISBN 1-57586-192-5Google Scholar
  3. Cassell J (2000) Embodied conversational agents. MIT Press, CambridgeGoogle Scholar
  4. Damasio AR, Tranel D, Damasio H (1991) Somatic markers and the guidance of behaviour: theory and preliminary testing. In: Levin HM, Eisenberg AL, Benton HS (eds) Frontal lobe function and dysfunction. Oxford University Press, New YorkGoogle Scholar
  5. Greenwald AG, McGhee DE, Schwartz JKL (1998) Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol 74:1464–1480CrossRefGoogle Scholar
  6. Heylen D, Kopp S, Marsella S, Pelachaud C, Vilhjálmsson HH (2008) The next step towards a function markup language. Helmut Prendinger. In: James CL, Mitsuru Ishizuka (eds) Intelligent virtual agents, 8th international conference, IVA 2008, Tokyo, Japan, September 1–3, 2008. Proceedings. Lecture Notes in Computer Science 5208 Springer 2008, ISBN 978-3-540-85482-1, pp 270–280Google Scholar
  7. Huang H, Cerekovic A, Pandzic I, Nakano Y, Nishida T (2008) The design of a generic framework for integrating ECA components. In: Proceedings of 7th international conference of autonomous agents and multiagent systems (AAMAS2008), Estoril, Portugal, May, 2008, pp 128–135Google Scholar
  8. Kopp S, Krenn B, Marsella S, Marshall A, Pelachaud C, Pirker H, Thórisson K, Vilhjálmsson H (2006) Towards a common framework for multimodal generation: the behavior markup language. Intelligent Virtual Agents, pp 205–217Google Scholar
  9. Mehrabian A (1971) Silent messages, 1st edn. Wadsworth, BelmontGoogle Scholar
  10. Mehrabian A (1995) Framework for a comprehensive description and measurement of emotional states. Genet Soc Gen Psychol Monogr 121:339–361Google Scholar
  11. Mills KL (2003a) Computer-supported cooperative work. Encycl Lib Inform Sci. doi: 10.1081/E-ELIS120008706
  12. Mills KL (2003b) Computer-supported cooperative work challenges. Encycl Lib Inform Sci. doi: 10.1081/E-ELIS120009055
  13. Nishida T (2001) Social intelligence design: an overview. exploring new frontiers in artificial intelligence. In: Terano T et al (eds) Lecture notes in artificial intelligence (LNAI 2253). Springer, HeidelbergGoogle Scholar
  14. Ortony A, Clore GL, Collins A (1988) The cognitive structure of emotions. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  15. Picard RW (1997) Affective computing. MIT Press, CambridgeGoogle Scholar
  16. Plutchik R, Hope RC (1997) Circumplex models of personality and emotions. American Psychological Association, Washington, DCCrossRefGoogle Scholar
  17. Pokahr A, Braubach L, Lamersdorf W (2005) Jadex: a BDI reasoning engine. In: Bordini R, Dastani M, Dix J, Fallah Seghrouchni AEl (eds) Programing multi-agent systems. Kluwer, Berlin, pp 149–174Google Scholar
  18. Reeves B, Nass C (2003) The media equation: how people treat computers, television, and new media like real people and places. CSLI Lecture Notes. Center for the Study of Language and InfGoogle Scholar
  19. Schachter S, Singer JE (1962) Cognitive, social, and physiological determinants of emotional state. Psychol Rev 69Google Scholar
  20. Scherer KR, Shorr A, Johnstone T (eds) (2001) Appraisal processes in emotion: theory, methods, research. Oxford University Press, CanaryGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2010

Authors and Affiliations

  • Andrey Kiselev
    • 1
    Email author
  • Benjamin Alexander Hacker
    • 2
  • Thomas Wankerl
    • 2
  • Niyaz Abdikeev
    • 3
  • Toyoaki Nishida
    • 1
  1. 1.Department of Intelligence Science and Technology, Graduate School of InformaticsKyoto UniversityKyotoJapan
  2. 2.Department of InformaticsMunich University of TechnologyMunichGermany
  3. 3.Plekhanov Russian Academy of EconomicsMoscowRussia

Personalised recommendations