Requirements and Building Blocks for Sociable Embodied Agents

  • Stefan Kopp
  • Kirsten Bergmann
  • Hendrik Buschmeier
  • Amir Sadeghipour
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5803)


To be sociable, embodied interactive agents like virtual characters or humanoid robots need to be able to engage in mutual coordination of behaviors, beliefs, and relationships with their human interlocutors. We argue that this requires them to be capable of flexible multimodal expressiveness, incremental perception of other’s behaviors, and the integration and interaction of these models in unified sensorimotor structures. We present work on probabilistic models for these three requirements with a focus on gestural behavior.


Humanoid Robot Conversational Agent Iconic Gesture Chance Node Sensorimotor Representation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. The MIT Press, Cambridge (2000)Google Scholar
  2. 2.
    Grosz, B.: Collaborative systems. A.I. Magazine 17(2), 67–85 (1994)Google Scholar
  3. 3.
    Wallbott, H.G.: Congruence, contagion, and motor mimicry: mutualities in nonverbal exchange. In: Markova, C.F.I., Graumann, K.F. (eds.) Mutualities in Dialogue, pp. 82–98. Cambridge University Press, Cambridge (1995)Google Scholar
  4. 4.
    Kopp, S.: From communicators to resonators – coordination through social resonance in face-to-face communication with embodied agents. In: Speech Communication (accepted)Google Scholar
  5. 5.
    Clark, H.H.: Using Language. Cambridge University Press, Cambridge (1996)CrossRefGoogle Scholar
  6. 6.
    Krämer, N.C.: Social effects of virtual assistants. a review of empirical results with regard to communication. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 507–508. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Bickmore, T.: Relational Agents: Effecting Change through Human-Computer Relationships. PhD thesis, Massachusetts Institute of Technology (2003)Google Scholar
  8. 8.
    Becker, C., Kopp, S., Pfeiffer-Lessmann, N., Wachsmuth, I.: Virtual humans growing up: From primary toward secondary emotions. Künstliche Intelligenz 1, 23–27 (2008)Google Scholar
  9. 9.
    Ochs, M., Pelachaud, C., Sadek, D.: An empathic virtual dialog agent to improve human-machine interaction. In: Seventh International Joint Conference on Autonomous Agents and Multi-Agent Systems, AAMAS 2008 (2008)Google Scholar
  10. 10.
    Bailenson, J.N., Yee, N.: Digital chameleons - automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16(10), 814–819 (2005)CrossRefGoogle Scholar
  11. 11.
    Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R., Morency, L.P.: Virtual rapport. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 14–27. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Breazeal, C., Buchsbaum, D., Gray, J., Gatenby, D., Blumberg, B.: Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots. In: Artificial Life (2004)Google Scholar
  13. 13.
    Wachsmuth, I., Lenzen, M., Knoblich, G. (eds.): Embodied communication in humans and machines. Oxford University Press, Oxford (2008)Google Scholar
  14. 14.
    Gallese, V., Keysers, C., Rizzolatti, G.: A unifying view of the basis of social cognition. Trends in Cognitive Science 8, 396–403 (2004)CrossRefGoogle Scholar
  15. 15.
    Bergmann, K., Kopp, S.: Increasing expressiveness for virtual agents–Autonomous generation of speech and gesture. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (2009)Google Scholar
  16. 16.
    Sowa, T., Wachsmuth, I.: A model for the representation and processing of shape in coverbal iconic gestures. In: Proc. KogWi 2005, pp. 183–188 (2005)Google Scholar
  17. 17.
    Bergmann, K., Kopp, S.: Gnetic–Using bayesian decision networks for iconic gesture generation. In: Proceedings of the 9th Conference on Intelligent Virtual Agents (2009)Google Scholar
  18. 18.
    Sadeghipour, A., Kopp, S.: A probabilistic model of motor resonance for embodied gesture perception. In: Proceedings of the 9th Conference on Intelligent Virtual Agents (2009)Google Scholar
  19. 19.
    Dijksterhuis, A., Bargh, J.: The perception-behavior expressway: Automatic effects of social perception on social behavior. Advances in Experimental Social Psychology 33, 1–40 (2001)CrossRefGoogle Scholar
  20. 20.
    Kimbara, I.: On gestural mimicry. Gesture 6(1), 39–61 (2006)CrossRefGoogle Scholar
  21. 21.
    Schutz-Bosbach, S., Prinz, W.: Perceptual resonance: action-induced modulation of perception. Journal of Trends in Cognitive Sciences 11(8), 349–355 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Stefan Kopp
    • 1
  • Kirsten Bergmann
    • 1
  • Hendrik Buschmeier
    • 1
  • Amir Sadeghipour
    • 1
  1. 1.Sociable Agents Group, Cognitive Interaction Technology (CITEC)Bielefeld UniversityBielefeldGermany

Personalised recommendations