Visual SceneMaker—a tool for authoring interactive virtual characters

  • Patrick GebhardEmail author
  • Gregor Mehlmann
  • Michael Kipp
Original Paper


Creating interactive applications with multiple virtual characters comes along with many challenges that are related to different areas of expertise. The definition of context-sensitive interactive behavior requires expert programmers and often results in hard-to-maintain code. To tackle these challenges, we suggest a visual authoring approach for virtual character applications and present a revised version of our SceneMaker tool. In SceneMaker a separation of content and logic is enforced. In the revised version, the Visual SceneMaker, we introduce concurrency and specific history structures as key concepts to facilitate (1) clearly structured interactive behavior definition, (2) multiple character modeling, and (3) extensions to existing applications. The new integrated developer environment allows sceneflow visualization and runtime modifications to support the development of interactive character applications in a rapid prototyping style. Finally, we present the result of a user study, which evaluates usability and the key concepts of the authoring tool.


Embodied conversational agents Authoring tools Modelling of interactive behavior 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    ALICE. Homepage of the alice artificial intelligence foundation. Online:
  2. 2.
    Bangor A, Kortum P, Miller J (2009) Determining what individual sus scores mean: Adding an adjective rating scale. J Usability Stud 4:114–123 Google Scholar
  3. 3.
    Beeck Mvd (1994) A comparison of statecharts variants. In: Proceedings of the third international symposium organized jointly with the working group provably correct systems on formal techniques in real-time and fault-tolerant systems, London, UK. Springer, Berlin, pp 128–148 Google Scholar
  4. 4.
    Brooke J (1996) SUS: A quick and dirty usability scale. In: Jordan PW, Weerdmeester B, Thomas A, Mclelland IL (eds) Usability evaluation in industry. Taylor and Francis, London Google Scholar
  5. 5.
    Brusk J, Lager T, Wik AHaP (2007) Deal dialogue management in scxml for believable game characters. In: Proceedings of ACM future play, New York, NY, USA. ACM, New York, pp 137–144 CrossRefGoogle Scholar
  6. 6.
    Endrass B, Wissner M, Mehlmann G, Buehling R, Haering M, André E (2010) Teenage girls as authors for digital storytelling—a practical experience report. In: Workshop on education in interactive digital storytelling on ICIDS, Edinburgh, UK Google Scholar
  7. 7.
    Engel R (2005) Robust and efficient semantic parsing of freeword order languages in spoken dialogue systems. In: Interspeech 2005 Google Scholar
  8. 8.
    Gebhard P, Kipp M, Klesen M, Rist T (2003) Authoring scenes for adaptive, interactive performances. In: Rosenschein JS, Wooldridge M (eds) Proc of the second international joint conference on autonomous agents and multi-agent systems. ACM, New York, pp 725–732 CrossRefGoogle Scholar
  9. 9.
    Gratch J, Rickel J, André E, Cassell J, Petajan E, Badler NI (2002) Creating interactive virtual humans: some assembly required. IEEE Intell Syst 17(4):54–63 CrossRefGoogle Scholar
  10. 10.
    Gratch J, Marsella S, Wang N, Stankovic B (2009) Assessing the validity of appraisal-based models of emotion. In: International conference on affective computing and intelligent interaction, Amsterdam. IEEE, New York Google Scholar
  11. 11.
    Harel D (1987) Statecharts: a visual formalism for complex systems. In: Science of computer programming, vol 8. Elsevier, Amsterdam, pp 231–274 Google Scholar
  12. 12.
    Heidig S, Clarebout G (2011) Do pedagogical agents make a difference to student motivation and learning? Educ Res Rev 6(1):27–54. doi: 10.1016/j.physletb.2003.10.071 CrossRefGoogle Scholar
  13. 13.
    Iurgel IA, da Silva RE, Ribeiro PR, Soares AB, dos Santos MF (2009) CREACTOR—an authoring framework for virtual actors. In: Proceedings of the 9th international conference of intelligent virtual agents. LNAI, vol 5773. Springer, Berlin, pp 562–563 Google Scholar
  14. 14.
    Kipp M, Neff M, Kipp KH, Albrecht I (2007) Toward natural gesture synthesis: evaluating gesture units in a data-driven approach. In: Proceedings of the 7th international conference on intelligent virtual agents. LNAI, vol 4722, pp 15–28 Google Scholar
  15. 15.
    Kipp M, Heloir A, Gebhard P, Schröder M (2010) Realizing multimodal behavior: closing the gap between behavior planning and embodied agent presentation. In: Proceedings of the 10th international conference on intelligent virtual agents (IVA-10). Springer, Berlin Google Scholar
  16. 16.
    Kopp S, Krenn B, Marsella S, Marshall AN, Pelachaud C, Pirker H, Thórisson KR, Vilhjálmsson H (2006) Towards a common framework for multimodal generation: the behavior markup language. In: Proc of IVA-06 Google Scholar
  17. 17.
    Mctear MF (1999) Using the cslu toolkit for practicals in spoken dialogue technology. In: University College London, pp 1–7 Google Scholar
  18. 18.
    Miksatko J, Kipp KH, Kipp M (2010) The persona zero-effect: evaluating virtual character benefits on a learning task. In: Proceedings of the 10th international conference on intelligent virtual agents (IVA-10). Springer, Berlin Google Scholar
  19. 19.
    Perlin K, Goldberg A (1996) Improv: a system for scripting interactive actors in virtual worlds. In: Computer graphics proceedings, ACM SIGGRAPH, New York, pp 205–216 Google Scholar
  20. 20.
    Prendinger H, Saeyor S, Ishizuk M (2004) Mpml and scream: scripting the bodies and minds of life-like characters. In: Life-like characters—tools, affective functions, and applications. Springer, Berlin, pp 213–242 Google Scholar
  21. 21.
    Schröder M (2008) Approaches to emotional expressivity in synthetic speech. In: Emotions in the human voice, culture and perception, vol 3. Pural, San Diego, pp 307–321 Google Scholar
  22. 22.
    Spierling U, Mueller SWaW (2006) Towards accessible authoring tools for interactive storytelling. In: Proceedings of technologies for interactive digital storytelling and entertainment. LNCS. Springer, Heidelberg Google Scholar
  23. 23.
    Vilhjalmsson H, Cantelmo N, Cassell J, Chafai NE, Kipp M, Kopp S, Mancini M, Marsella S, Marshall AN, Pelachaud C, Ruttkay Z, Thórisson KR, van Welbergen H, van der Werf RJ (2007) The behavior markup language: recent developments and challenges. In: Proc of IVA-07 Google Scholar

Copyright information

© OpenInterface Association 2011

Authors and Affiliations

  • Patrick Gebhard
    • 1
    Email author
  • Gregor Mehlmann
    • 1
  • Michael Kipp
    • 1
  1. 1.DFKI GmbHSaarbrückenGermany

Personalised recommendations