Skip to main content

Visual SceneMaker—a tool for authoring interactive virtual characters


Creating interactive applications with multiple virtual characters comes along with many challenges that are related to different areas of expertise. The definition of context-sensitive interactive behavior requires expert programmers and often results in hard-to-maintain code. To tackle these challenges, we suggest a visual authoring approach for virtual character applications and present a revised version of our SceneMaker tool. In SceneMaker a separation of content and logic is enforced. In the revised version, the Visual SceneMaker, we introduce concurrency and specific history structures as key concepts to facilitate (1) clearly structured interactive behavior definition, (2) multiple character modeling, and (3) extensions to existing applications. The new integrated developer environment allows sceneflow visualization and runtime modifications to support the development of interactive character applications in a rapid prototyping style. Finally, we present the result of a user study, which evaluates usability and the key concepts of the authoring tool.

This is a preview of subscription content, access via your institution.


  1. 1.

    ALICE. Homepage of the alice artificial intelligence foundation. Online:

  2. 2.

    Bangor A, Kortum P, Miller J (2009) Determining what individual sus scores mean: Adding an adjective rating scale. J Usability Stud 4:114–123

    Google Scholar 

  3. 3.

    Beeck Mvd (1994) A comparison of statecharts variants. In: Proceedings of the third international symposium organized jointly with the working group provably correct systems on formal techniques in real-time and fault-tolerant systems, London, UK. Springer, Berlin, pp 128–148

    Google Scholar 

  4. 4.

    Brooke J (1996) SUS: A quick and dirty usability scale. In: Jordan PW, Weerdmeester B, Thomas A, Mclelland IL (eds) Usability evaluation in industry. Taylor and Francis, London

    Google Scholar 

  5. 5.

    Brusk J, Lager T, Wik AHaP (2007) Deal dialogue management in scxml for believable game characters. In: Proceedings of ACM future play, New York, NY, USA. ACM, New York, pp 137–144

    Chapter  Google Scholar 

  6. 6.

    Endrass B, Wissner M, Mehlmann G, Buehling R, Haering M, André E (2010) Teenage girls as authors for digital storytelling—a practical experience report. In: Workshop on education in interactive digital storytelling on ICIDS, Edinburgh, UK

    Google Scholar 

  7. 7.

    Engel R (2005) Robust and efficient semantic parsing of freeword order languages in spoken dialogue systems. In: Interspeech 2005

    Google Scholar 

  8. 8.

    Gebhard P, Kipp M, Klesen M, Rist T (2003) Authoring scenes for adaptive, interactive performances. In: Rosenschein JS, Wooldridge M (eds) Proc of the second international joint conference on autonomous agents and multi-agent systems. ACM, New York, pp 725–732

    Chapter  Google Scholar 

  9. 9.

    Gratch J, Rickel J, André E, Cassell J, Petajan E, Badler NI (2002) Creating interactive virtual humans: some assembly required. IEEE Intell Syst 17(4):54–63

    Article  Google Scholar 

  10. 10.

    Gratch J, Marsella S, Wang N, Stankovic B (2009) Assessing the validity of appraisal-based models of emotion. In: International conference on affective computing and intelligent interaction, Amsterdam. IEEE, New York

    Google Scholar 

  11. 11.

    Harel D (1987) Statecharts: a visual formalism for complex systems. In: Science of computer programming, vol 8. Elsevier, Amsterdam, pp 231–274

    Google Scholar 

  12. 12.

    Heidig S, Clarebout G (2011) Do pedagogical agents make a difference to student motivation and learning? Educ Res Rev 6(1):27–54. doi:10.1016/j.physletb.2003.10.071

    Article  Google Scholar 

  13. 13.

    Iurgel IA, da Silva RE, Ribeiro PR, Soares AB, dos Santos MF (2009) CREACTOR—an authoring framework for virtual actors. In: Proceedings of the 9th international conference of intelligent virtual agents. LNAI, vol 5773. Springer, Berlin, pp 562–563

    Google Scholar 

  14. 14.

    Kipp M, Neff M, Kipp KH, Albrecht I (2007) Toward natural gesture synthesis: evaluating gesture units in a data-driven approach. In: Proceedings of the 7th international conference on intelligent virtual agents. LNAI, vol 4722, pp 15–28

    Google Scholar 

  15. 15.

    Kipp M, Heloir A, Gebhard P, Schröder M (2010) Realizing multimodal behavior: closing the gap between behavior planning and embodied agent presentation. In: Proceedings of the 10th international conference on intelligent virtual agents (IVA-10). Springer, Berlin

    Google Scholar 

  16. 16.

    Kopp S, Krenn B, Marsella S, Marshall AN, Pelachaud C, Pirker H, Thórisson KR, Vilhjálmsson H (2006) Towards a common framework for multimodal generation: the behavior markup language. In: Proc of IVA-06

    Google Scholar 

  17. 17.

    Mctear MF (1999) Using the cslu toolkit for practicals in spoken dialogue technology. In: University College London, pp 1–7

    Google Scholar 

  18. 18.

    Miksatko J, Kipp KH, Kipp M (2010) The persona zero-effect: evaluating virtual character benefits on a learning task. In: Proceedings of the 10th international conference on intelligent virtual agents (IVA-10). Springer, Berlin

    Google Scholar 

  19. 19.

    Perlin K, Goldberg A (1996) Improv: a system for scripting interactive actors in virtual worlds. In: Computer graphics proceedings, ACM SIGGRAPH, New York, pp 205–216

    Google Scholar 

  20. 20.

    Prendinger H, Saeyor S, Ishizuk M (2004) Mpml and scream: scripting the bodies and minds of life-like characters. In: Life-like characters—tools, affective functions, and applications. Springer, Berlin, pp 213–242

    Google Scholar 

  21. 21.

    Schröder M (2008) Approaches to emotional expressivity in synthetic speech. In: Emotions in the human voice, culture and perception, vol 3. Pural, San Diego, pp 307–321

    Google Scholar 

  22. 22.

    Spierling U, Mueller SWaW (2006) Towards accessible authoring tools for interactive storytelling. In: Proceedings of technologies for interactive digital storytelling and entertainment. LNCS. Springer, Heidelberg

    Google Scholar 

  23. 23.

    Vilhjalmsson H, Cantelmo N, Cassell J, Chafai NE, Kipp M, Kopp S, Mancini M, Marsella S, Marshall AN, Pelachaud C, Ruttkay Z, Thórisson KR, van Welbergen H, van der Werf RJ (2007) The behavior markup language: recent developments and challenges. In: Proc of IVA-07

    Google Scholar 

Download references

Author information



Corresponding author

Correspondence to Patrick Gebhard.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Gebhard, P., Mehlmann, G. & Kipp, M. Visual SceneMaker—a tool for authoring interactive virtual characters. J Multimodal User Interfaces 6, 3–11 (2012).

Download citation


  • Embodied conversational agents
  • Authoring tools
  • Modelling of interactive behavior