Designed to Thrill: Exploring the Effects of Multimodal Feedback on Virtual World Immersion

  • Dimitrios Darzentas
  • Michael Brown
  • Noirin Curran
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9171)


The following paper presents research into the effects of multi- and uni- modal output on virtual immersion. It describes the implementation of a balanced experimental study designed to measure participant immersion in a variety of conditions and presents the resulting findings. These demonstrate the potential of primary and secondary modalities on the perception of the participants. The findings of the study can form part of the basis for a set of HCI guidelines for the creation of highly immersive digital experiences.


Virtual worlds Games Immersion Interaction Modalities 



We gratefully acknowledge the support of the Horizon Centre for Doctoral Training (EPSRC Grant No. EP/G037574/1) and the RCUK Horizon Digital Economy Research Hub grant, EP/G065802/1.


  1. 1.
    Adams, E.: Fundamentals of Game Design. New Riders, Thousand Oaks (2010)Google Scholar
  2. 2.
    Björk, S., Holopainen, J.A.: Patterns In Game Design. Cengage Learning, Boston (2005)Google Scholar
  3. 3.
    Boas, Y.A.G.V. (n.d.): Overview of Virtual Reality Technologies.
  4. 4.
    Brown, E., Cairns, P.: A grounded investigation of game immersion. In: Extended Abstracts on Human Factors in Computing Systems, CHI EA 2004, pp. 1297–1300 (2004)Google Scholar
  5. 5.
    Carr, D.: Computer Games: Text, Narrative and Play. Polity, Cambridge, UK (2006)Google Scholar
  6. 6.
    de Castell, S., Jenson, J.: Worlds in Play: International Perspectives on Digital Games Research. Peter Lang, New York (2007)Google Scholar
  7. 7.
    Curran, N.: The psychology of immersion and development of a quantitative measure of immersive response in games. CORA Open Research Archive (2013)Google Scholar
  8. 8.
    Dede, C.: Immersive interfaces for engagement and learning. Science 323(5910), 66–69 (2009)CrossRefGoogle Scholar
  9. 9.
    Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining ‘gamification’. In: Proceedings of the MindTrek 2011, pp. 9–15. ACM (2011)Google Scholar
  10. 10.
    Dickey, M.D.: Engaging by design: how engagement strategies in popular computer and video games can inform instructional design. Educ. Tech. Res. Dev. 53(2), 67–83 (2005)CrossRefGoogle Scholar
  11. 11.
    Ermi, L., Mäyrä, F.: Fundamental components of the gameplay experience: analysing immersion. In: DIGRA (2005)Google Scholar
  12. 12.
    Ernst, M.O., Bülthoff, H.H.: Merging the senses into a robust percept. Trends Cogn. Sci. 8(4), 162–169 (2004)CrossRefGoogle Scholar
  13. 13.
    Flanagan, J.C.: The critical incident technique. Psychol. Bull. 51(4), 327–358 (1954)CrossRefGoogle Scholar
  14. 14.
    Gee, F.C., Browne, W.N., Kawamura, K.: Uncanny valley revisited. In: IEEE International Workshop on Robot and Human Interactive Communication, RO-MAN 2005 (2005)Google Scholar
  15. 15.
    Geller, T.: Overcoming the Uncanny Valley. IEEE Comput. Graphics Appl. 28(4), 11–17 (2008)CrossRefGoogle Scholar
  16. 16.
    Radu, Vasile: Application. In: Radu, Vasile (ed.) Stochastic Modeling of Thermal Fatigue Crack Growth. ACM, vol. 1, pp. 63–70. Springer, Heidelberg (2015)Google Scholar
  17. 17.
    IJsselsteijn, W., de Kort, Y., Poels, K., Jurgelionis, A., Bellotti, F.: Characterising and measuring user experiences in digital games. Proc. ACE 2, 27 (2007)Google Scholar
  18. 18.
    Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A.: Measuring and defining the experience of immersion in games. Int. J. Hum. Comput. Stud. 66(9), 641–661 (2008)CrossRefGoogle Scholar
  19. 19.
    Kucklich, J.: Literary Theory and computer games. In: Proceedings of the COSIGN, pp. 51–58 (2001)Google Scholar
  20. 20.
    Larsson, P., Vastfjall, D., Kleiner, M.: Better presence and performance in virtual environments by improved binaural sound rendering. Proc. AES 22, 2002 (2002)Google Scholar
  21. 21.
    Lebedev, M.A., Nicolelis, M.A.L.: Brain–machine interfaces: past, present and future. Trends Neurosci. 29(9), 536–546 (2006)CrossRefGoogle Scholar
  22. 22.
    Lombard, M., Ditton, T.B., Crane, D., Davis, B., Gil-Egui, G., Horvath, K., Rossman, J.: Measuring presence: a literature-based approach to the development of a standardized paper-and-pencil instrument (2000)Google Scholar
  23. 23.
    McMahan, A.: Immersion, engagement, and presence - a Method for analyzing 3-D video games. In: Wolf, M.J.P., Perron, B. (eds.) The Video Game Theory Reader, vol. 1. Routledge Chapman & amp, New York (2003)Google Scholar
  24. 24.
    Mori, M.: The uncanny valley. Energy 7(4), 33–35 (1970)Google Scholar
  25. 25.
    Mount, N.J., Chambers, C., Weaver, D., Priestnall, G.: Learner immersion engagement in the 3D virtual world: principles emerging from the DELVE project. ITALICS 8, 40–56 (2009)CrossRefGoogle Scholar
  26. 26.
    Nacke, L., Lindley, C.A.: Flow and immersion in first-person shooters: measuring the player’s gameplay experience. In: Proceedings of the 2008 Conference on Future Play: Research, Play, Share, Future Play 2008, pp. 81–88. ACM, New York (2008)Google Scholar
  27. 27.
    Reaney, M.: Virtual reality and the theatre: immersion in virtual worlds. Digit. Creativity 10(3), 183–188 (1999)CrossRefGoogle Scholar
  28. 28.
    Ryan, M.-L.: Immersion vs. interactivity: virtual reality and literary theory. SubStance 28(2), 110–137 (1999)CrossRefGoogle Scholar
  29. 29.
    Salen, K., Zimmerman, E.: Rules of Play: Game Design Fundamentals. MIT, Cambridge (2004)Google Scholar
  30. 30.
    Sherman, W.R., Craig, A.B.: Understanding Virtual Reality Interface, Application, and Design. Morgan Kaufmann, San Francisco (2003)Google Scholar
  31. 31.
    Shimojo, S., Shams, L.: Sensory modalities are not separate modalities: plasticity and interactions. Curr. Opin. Neurobiol. 11(4), 505–509 (2001)CrossRefGoogle Scholar
  32. 32.
    Stapleton, C.B., Hughes, C.E.: Mixed reality and experiential movie trailers: combining emotions and immersion to innovate entertainment marketing. In: Proceedings of the SIMCHI (2005)Google Scholar
  33. 33.
    Taylor, L.N., Acknowledgments, T.P.: Video Games: Perspective, Point-of-view, and Immersion. University of Florida (2002)Google Scholar
  34. 34.
    Visch, V.T., Tan, E.S., Molenaar, D.: The emotional and cognitive effect of immersion in film viewing. Cogn. Emot. 24(8), 1439–1445 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Dimitrios Darzentas
    • 1
  • Michael Brown
    • 2
  • Noirin Curran
    • 3
  1. 1.Mixed Reality LabUniversity of NottinghamNottinghamUK
  2. 2.Horizon Research InstituteUniversity of NottinghamNottinghamUK
  3. 3.LogitechCorkIreland

Personalised recommendations