Full Body Gestures Enhancing a Game Book for Interactive Story Telling

  • Felix Kistler
  • Dominik Sollfrank
  • Nikolaus Bee
  • Elisabeth André
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7069)


Game Books can offer a well-written, but non-linear story, as readers always have to decide, how to continue after reading a text passage. It seems very logical to adopt such a book to investigate interaction paradigms for an interactive storytelling scenario. Nevertheless, it is not easy to keep the player motivated during a long-winded narrated story until the next point of intervention is reached. In this paper we tested different methods of implementing the decision process in such a scenario using speech input and tested it with 26 participants during a two player scenario. This revealed that with an omitted on-screen prompt the application was less easy to use, but caused considerably more user interaction. We further added additional interactivity with so-called Quick Time Events (QTEs). In these events, the player has a limited amount of time to perform a specific action after a corresponding prompt appeares on screen. Different versions of QTEs were implemented using Full Body Tracking with Microsoft Kinect, and were tested with another 18 participants during a two player scenario. We found that Full Body Gestures were easier to perform and, in general, preferred to controlling a cursor with one hand and hitting buttons with it.


Interactive Storytelling Full Body Tracking Quick Time Event User Experience Game Book Kinect Gesture Recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Borges, J.L.: An Examination of the Work of Herbert Quain. In: Kerrigan, A. (ed.) Ficciones, pp. 73–78. Grove Press, 841 Broadway, New York (1962)Google Scholar
  2. 2.
    Braun, N.: Storytelling in Collaborative Augmented Reality Environments. In: Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, WSCG (2003)Google Scholar
  3. 3.
    Cavazza, M., Charles, F., Mead, S.J.: Interacting with Virtual Characters in Interactive Storytelling. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems. ACM, New York (2002)Google Scholar
  4. 4.
    Dow, S., Mehta, M., Harmon, E., MacIntyre, B., Mateas, M.: Presence and Engagement in an Interactive Drama. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1475–1484. ACM, New York (2007)CrossRefGoogle Scholar
  5. 5.
    Full Body Interaction Framework,
  6. 6.
  7. 7.
    Kipp, M.: ANVIL - A Generic Annotation Tool for Multimodal Dialogue. In: 7th European Conference on Speech Communication and Technology (Eurospeech), pp. 1367–1370. ISCA (2001)Google Scholar
  8. 8.
    Mateas, M., Stern, A.: Façade: An Experiment in Building a Fully-Realized Interactive Drama. In: Game Developers Conference: Game Design Track (2003)Google Scholar
  9. 9.
    Mehlmann, G., Gebhard, P., Endrass, B., André, E.: SceneMaker: Visual Authoring of Dialogue Processes. In: 7th Workshop on Knowledge and Reasoning in Practical Dialogue Systems (2011)Google Scholar
  10. 10.
    Packard, E.: Die Insel der 1000 Gefahren. Ravensburger Buchverlag, Ravensburg (2007)Google Scholar
  11. 11.
    PrimeSense Ltd: US Patent Application Publication No. US2010/0118123 (2010),
  12. 12.
  13. 13.
    The IRIS project,
  14. 14.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Felix Kistler
    • 1
  • Dominik Sollfrank
    • 1
  • Nikolaus Bee
    • 1
  • Elisabeth André
    • 1
  1. 1.Human Centered MultimediaAugsburg UniversityAugsburgGermany

Personalised recommendations