Using Real Objects to Communicate with Virtual Characters

  • Patrick Gebhard
  • Martin Klesen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3661)


We present an interactive installation with life-size virtual agents that inform, entertain, encourage, and assist visitors during the process of building a car. It will be installed as an exhibit in an automobile theme park. Visitors can take car elements from a shelf and put them on a workbench. The virtual agents continually comment the visitor’s actions and the current state of the construction. We use Radio Frequency Identification (RFID) devices to monitor the location of the car elements. This tsechnology allows us to design a natural, unobtrusive and robust interaction by letting the visitors using real objects to communicate with our virtual characters. We show how such an interactive presentation can be created with our SceneMaker authoring tool. We address the problem of authoring content for a large number of combinations and we explain how to design the interaction for an installation where visitors can do anything at anytime.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    André, E., Rist, T.: Presenting through performing: On the use of multiple lifelike characters in knowledge-based presentation systems. In: Proc. of the 5th International Conference on Intelligent User Interfaces (IUI 2000), pp. 1–8. ACM Press, New York (2000)CrossRefGoogle Scholar
  2. 2.
    Klesen, M., Kipp, M., Gebhard, P., Rist, T.: Staging exhibitions: methods and tools for modelling narrative structure to produce interactive performances with virtual actors. Virtual Reality 7(1), 17–29 (2003)CrossRefGoogle Scholar
  3. 3.
    Rist, T., Baldes, S., Gebhard, P., Kipp, M., Klesen, M., Rist, P., Schmitt, M.: Crosstalk: An interactive installation with animated presentation agents. In: Proc. of the Second Conference on Computational Semiotics for Games and New Media (COSIGN 2002), Augsburg (2002)Google Scholar
  4. 4.
    Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Authoring scenes for adaptive, interactive performances. In: Proc. of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, Melbourne, Australia. ACM Press, New York (2003)Google Scholar
  5. 5.
    Blumberg, B.: Swamped! Using plush toys to direct autonomous animated characters. In: Visual Proceedings of SIGGRAPH 1998. ACM Press, New York (1998)Google Scholar
  6. 6.
    Downie, M., Benbasat, A., Wahl, J., Stiehl, D., Blumberg, B.: Sand:stone. Leonardo 32(5), 462–463 (1999)CrossRefGoogle Scholar
  7. 7.
    Blumberg, B. (void*): A Cast of Characters. In: Visual Proceedings of SIGGRAPH 1999. ACM Press, New York (1999)Google Scholar
  8. 8.
    Blumberg, B., Tomlinson, B., Downie, M.: Multiple conceptions of character-based interactive installations. Computer Graphics International, 5–11 (2001)Google Scholar
  9. 9.
    Prendinger, H., Ishizuka, M. (eds.): Life-Like Characters: Tools, Affective Functions, and Applications. Cognitive Technologies. Springer, Heidelberg (2004)Google Scholar
  10. 10.
    Ryokai, K., Vaucelle, C., Cassell, J.: Literacy Learning by Storytelling with a Virtual Peer. In: Proc. of Computer Support for Collaborative Learning (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Patrick Gebhard
    • 1
  • Martin Klesen
    • 1
  1. 1.German Research Center for Artificial IntelligenceDFKI GmbHSaarbrücken

Personalised recommendations