Interactive Storytelling in a Mixed Reality Environment: How Does Sound Design and Users’ Preknowledge of the Background Story Influence the User Experience?

  • Marija Nakevska
  • Mathias Funk
  • Jun Hu
  • Berry Eggen
  • Matthias Rauterberg
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8832)


Interactive storytelling in a mixed reality environment merges real and virtual worlds, and physically immerses the participant in a narrative. The participant is engaged to participate in an exploratory experience, which is influenced by personal and situational factors. We used three stages from the ALICE installation to investigate the effects of sound design and participants’ preknowledge of the background story. The study was carried out with 60 participants and the results show that immersiveness (presence) is influenced by both factors. Furthermore we discuss the user experience through observations and information gathered in interview sessions.


interactive storytelling user experience mixed reality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bartneck, C., Hu, J., Salem, B., Cristescu, R., Rauterberg, M.: Applying virtual and augmented reality in cultural computing. IJVR 7(2), 11–18 (2008)Google Scholar
  2. 2.
    Berndt, A., Hartmann, K.: The functions of music in interactive media. In: Interactive Storytelling, pp. 126–131. Springer (2008)Google Scholar
  3. 3.
    Carroll, L.: Alice’s adventures in wonderland. Broadview Press (2011)Google Scholar
  4. 4.
    Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., Hart, J.C.: The cave: audio visual experience automatic virtual environment. Communications of the ACM 35(6), 64–72 (1992)CrossRefGoogle Scholar
  5. 5.
    Dow, S.P.: Understanding user engagement in immersive and interactive stories. ProQuest (2008)Google Scholar
  6. 6.
    Ekman, I., Ermi, L., Lahti, J., Nummela, J., Lankoski, P., Mäyrä, F.: Designing sound for a pervasive mobile game. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 110–116. ACM (2005)Google Scholar
  7. 7.
    Leonardo, A., Brisson, A., Paiva, A.: Influence of music and sounds in an agent-based storytelling environment. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 523–524. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  8. 8.
    Liljedahl, M.: Sound for fantasy and freedom (2011)Google Scholar
  9. 9.
    McCall, R., Wetzel, R., Löschner, J., Braun, A.K.: Using presence to evaluate an augmented reality location aware game. Personal and Ubiquitous Computing 15(1), 25–35 (2011)CrossRefGoogle Scholar
  10. 10.
    Park, N., Lee, K.M., Jin, S.-A.A., Kang, S.: Effects of pre-game stories on feelings of presence and evaluation of computer games. International Journal of Human-Computer Studies 68(11), 822–833 (2010)CrossRefGoogle Scholar
  11. 11.
    Sanders, T., Cairns, P.: Time perception, immersion and music in videogames. In: Proceedings of the 24th BCS Interaction Specialist Group Conference, pp. 160–167. British Computer Society (2010)Google Scholar
  12. 12.
    Schneider, E.F.: Death with a story. Human Communication Research 30(3), 361–375 (2004)Google Scholar
  13. 13.
    Vorderer, P., Wirth, W., Gouveia, F.R., Biocca, F., Saari, T., Jäncke, L., Böcking, S., Schramm, H., Gysbers, A., Hartmann, T., et al.: Mec spatial presence questionnaire (2004)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Marija Nakevska
    • 1
  • Mathias Funk
    • 1
  • Jun Hu
    • 1
  • Berry Eggen
    • 1
  • Matthias Rauterberg
    • 1
  1. 1.Department of Industrial DesignEindhoven University of TechnologyEindhovenThe Netherlands

Personalised recommendations