Full Body Interaction with Virtual Characters in an Interactive Storytelling Scenario

  • Felix Kistler
  • Birgit Endrass
  • Elisabeth André
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8637)


This paper presents a full body interaction approach developed for Traveller, an intercultural training game for young adults based on an interactive storytelling scenario. Traveller involves virtual characters interacting with the users on a large display screen. The users interact with a Kinect, performing full body gestures and controlling a freehand swipe menu to trigger navigation and dialogue actions in the game. A first evaluation proved the recognition capabilities of our system and the comparison with a mouse interface in terms of usability and user experience showed higher positive affect with the Kinect, but a tendency for higher usability and flow with the mouse.


full body interaction intercultural training freehand Kinect 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aylett, R., Vannini, N., Andre, E., Paiva, A., Enz, S., Hall, L.: But that was in another country: Agents and intercultural empathy. In: Proc. AAMAS 2009, pp. 329–336. IFAAMAS (2009)Google Scholar
  2. 2.
    Dias, J., Mascarenhas, S., Paiva, A.: Fatima modular: Towards an agent architecture with a generic appraisal framework. In: Proc. Workshop on Standards for Emotion Modeling (2011)Google Scholar
  3. 3.
    Dow, S., Mehta, M., Harmon, E., MacIntyre, B., Mateas, M.: Presence and engagement in an interactive drama. In: Proc. CHI 2007, pp. 1475–1484. ACM, New York (2007)Google Scholar
  4. 4.
    Hofstede, G.J.: Role playing with synthetic cultures: the evasive rules of the game. Experimental Interactive Learning in Industrial Management: New approaches to Learning, Studying and Teaching p. 49 (2005)Google Scholar
  5. 5.
    Janowski, K., Kistler, F., André, E.: Gestures or speech? comparing modality selection for different interaction tasks in a virtual environment. In: Proc. Tilburg Gesture Research Meeting 2013 (2013),
  6. 6.
    Kadobayashi, R., Nishimoto, K., Mase, K.: Design and evaluation of gesture interface of an immersive walk-through application for exploring cyberspace. In: Proc. Automatic Face and Gesture Recognition, pp. 534–539 (1998)Google Scholar
  7. 7.
    Kistler, F., André, E.: User-defined body gestures for an interactive storytelling scenario. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part II. LNCS, vol. 8118, pp. 264–281. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  8. 8.
    Kistler, F., Endrass, B., Damian, I., Dang, C., André, E.: Natural interaction with culturally adaptive virtual characters. Journal on Multimodal User Interfaces 6, 39–47 (2012); 10.1007/s12193-011-0087-zGoogle Scholar
  9. 9.
    Raybourn, E.M., Deagle, M.E., Mendini, K., Heneghan, J.: Adaptive thinking & leadership simulation game training for special forces officers. In: Proc. I/ITSEC 2005. NTSA (2005)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Felix Kistler
    • 1
  • Birgit Endrass
    • 1
  • Elisabeth André
    • 1
  1. 1.Human Centered MultimediaAugsburg UniversityAugsburgGermany

Personalised recommendations