Story Immersion in a Gesture-Based Audio-Only Game

  • Wenjie Wu
  • Stefan Rank
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9445)


We report on the results of a study on immersion in an audio-only game with touch-less gesture interaction. A structured design approach to audio feedback that considers the story-context leads to different design approaches: explicit instructions on the one hand and diegetic environmental feedback on the other. Further, we distinguish audio feedback before, during, and after gestures as part of the approach. Two corresponding versions of a gesture-based audio-only story have been implemented and evaluated regarding immersion using a questionnaire study. The findings indicate that replacing explicit audio instructions for hand positions and movements with responsive audio feedback for suggesting interaction methods using environmental story-related audio cues leads to measurably higher story immersion.


Immersion audio-only Gesture interaction Touchless motion control Responsive feedback 


  1. 1.
    Brockmyer, J., Fox, C., Curtiss, K., McBroom, E., Burkhart, K.M., Pidruzny, J.N.: The development of the game engagement questionnaire: a measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45, 624–634 (2009)CrossRefGoogle Scholar
  2. 2.
    Brown, E., Cairns, P.: A grounded investigation of game immersion. In: Proceedings of CHI ’04 Extended Abstracts on Human Factors in Computing Systems, pp. 1297–1300. ACM, New York, NY, USA (2004)Google Scholar
  3. 3.
    Hartson, R., Pardha, P.: The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann Publishers Inc., San Francisco (2012)Google Scholar
  4. 4.
    Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A.: Measuring and defining the experience of immersion in games. Int. J. Human-Comput. Stud. 66, 641–661 (2008)CrossRefGoogle Scholar
  5. 5.
    Liljedahl, M., Papworth, N., Lindberg, S.: Beowulf - an audio mostly game. In: Proceedings of the International Conference on Advances in Computer Entertainment Technology, New York, NY, USA, pp. 200–203 (2007)Google Scholar
  6. 6.
    Murray, J.H.: Hamlet on the Holodeck, 3rd edn. Free press, New York (1997)Google Scholar
  7. 7.
    Norman, D.: Natural user interfaces are not natural. Interactions 17, 6–10 (2010)CrossRefGoogle Scholar
  8. 8.
    O’Hara, K., Harper, R., Mentis, H., Sellen, A., Taylor, A.: On the naturalness of touchless: putting the ’interaction’ back into NUI. ACM Trans. Comput.-Hum. Interact 20 (2013)Google Scholar
  9. 9.
    Papworth, N.: iSpooks: an audio focused game design. In: Proceedings of the 5th Audio Mostly Conference, Pitea, Sweden, pp. 1–8 (2010)Google Scholar
  10. 10.
    Patrick, E., Cosgrove, D., Slavkovic, A., Rode, J.A., Verratti, T., Chiselko, G.: Using a large projection screen as an alternative to head-mounted displays for virtual environments. CHI Lett. 2, 478–485 (2000)Google Scholar
  11. 11.
    Radford, A.: Games and learning about form in architecture. Autom. Constr. 9, 379–385 (2000)CrossRefGoogle Scholar
  12. 12.
    Roden, T.E., Parberry, I., Ducrest, D.: Toward mobile entertainment: a paradigm for narrative-based audio only games. Sci. Comput. Program. 67, 76–90 (2007)CrossRefMathSciNetGoogle Scholar
  13. 13.
    Winograd, T., Flores, F.: Understanding Computers and Cognition. Ablex, Norwood (1986)zbMATHGoogle Scholar
  14. 14.
    Witmer, B., Singer, M.: Measuring presence in virtual environments: a presence questionnaire. Teleoperators Virtual Environ. 7, 225–240 (1998)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Drexel UniversityPhiladelphiaUSA

Personalised recommendations