Step by Step: Evaluating Navigation Styles in Mixed Reality Entertainment Experience

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10714)


The availability of depth sensing technology in smartphones and tablets adds spatial awareness as an interaction modality to mobile entertainment experiences and showcases the potential of Mixed Reality (MR) for creating immersive and engaging experiences in real world contexts. However, the lack of design knowledge about interactions within MR represents a barrier to creating effective entertainment experiences. Faced with this challenge, we contribute a study of three navigation styles (NS) for MR experiences shown on a handheld device. The navigation styles range from fully virtual, through a mixed style that involves both on-screen and in-world activity, to fully real navigation. Our findings suggest that when designing an MR experience, the navigation style deployed should reflect the context, content and required interactions. For our MR experience, “The Old Pharmacy”, with its specific content, context and required interactions, results show that navigation styles relying on in-world activity leads to higher levels of Presence, Immersion and Flow.


Mixed reality Mobiles devices Depth perception  Navigation style User experience User study 



We wish to acknowledge our fellow researchers Rui Trindade, Sandra Câmara, Dina Dionísio and the support of LARSyS (Projeto Estratégico LA 9 - UID/EEA/50009/2013), MITIExcell (M1420-01-0145-FEDER-000002) and the Ph.D. Grants: PD/BD/114142/2015 and PD/BD/128330/2017.


  1. 1.
  2. 2.
  3. 3.
    Sing, K.H., Xie, W.: Garden: a mixed reality experience combining virtual reality and 3D reconstruction. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 180–183. ACM, New York (2016)Google Scholar
  4. 4.
    Zhang, J., Ogan, A., Liu, T.C., Sung, Y.T., Chang, K.E.: The influence of using augmented reality on textbook support for learners of different learning styles. In: 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 107–114 (2016) Google Scholar
  5. 5.
    Möller, A., Kranz, M., Huitl, R., Diewald, S., Roalter, L.: A mobile indoor navigation system interface adapted to vision-based localization. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, pp. 4:1–4:10. ACM, New York (2012)Google Scholar
  6. 6.
    Rao, Q., Tropper, T., Grünler, C., Hammori, M., Chakraborty, S.: AR-IVI — implementation of in-vehicle augmented reality. In: 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 3–8 (2014)Google Scholar
  7. 7.
    Grubert, J., Langlotz, T., Zollmann, S., Regenbrecht, H.: Towards pervasive augmented reality: context-awareness in augmented reality. IEEE Trans. Vis. Comput. Graph. 23, 1706–1724 (2016)CrossRefGoogle Scholar
  8. 8.
    Waterworth, J.: Human-Experiential Design of Presence in Everyday Blended Reality. Springer, Heidelberg (2016). CrossRefGoogle Scholar
  9. 9.
    Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. In: Telemanipulator and Telepresence Technologies, pp. 282–293. International Society for Optics and Photonics (1995)Google Scholar
  10. 10.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77, 1321–1329 (1994)Google Scholar
  11. 11.
    Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)Google Scholar
  12. 12.
    Cheok, A.D., Fong, S.W., Goh, K.H., Yang, X., Liu, W., Farzbiz, F.: Human Pacman: a sensing-based mobile entertainment system with ubiquitous computing and tangible interaction. In: Proceedings of the 2nd Workshop on Network and System Support for Games, pp. 106–117. ACM (2003)Google Scholar
  13. 13.
    Cheok, A.D., Yang, X., Ying, Z.Z., Billinghurst, M., Kato, H.: Touch-space: mixed reality game space based on ubiquitous, tangible, and social computing. Pers. Ubiquitous Comput. 6, 430–442 (2002)CrossRefGoogle Scholar
  14. 14.
    Farbiz, F., Cheok, A.D., Wei, L., ZhiYing, Z., Ke, X., Prince, S., Billinghurst, M., Kato, H.: Live three-dimensional content for augmented reality. IEEE Trans. Multimed. 7, 514–523 (2005)CrossRefGoogle Scholar
  15. 15.
    Bowlby, J.: Attachment and Loss. Basic Books, New York (1983)Google Scholar
  16. 16.
    Ijsselsteijn, W., de Kort, Y., Poels, K.: The game experience questionnaire: development of a self-report measure to assess the psychological impact of digital games. Manuscript in PreparationGoogle Scholar
  17. 17.
    Ermi, L., Mäyrä, F.: Fundamental components of the gameplay experience: analysing immersion. Worlds Play Int. Perspect. Digit. Games Res. 37, 37–53 (2005) Google Scholar
  18. 18.
    Slater, M., Usoh, M.: Body centred interaction in immersive virtual environments. In: Artificial Life and Virtual Reality, pp. 125–148. Wiley (1994)Google Scholar
  19. 19.
    Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence Teleoperators Virtual Environ. 7, 225–240 (1998)CrossRefGoogle Scholar
  20. 20.
    Templeman, J.N., Denbrook, P.S., Sibert, L.E.: Virtual locomotion: walking in place through virtual environments. Presence Teleoperators Virtual Environ. 8, 598–617 (1999)CrossRefGoogle Scholar
  21. 21.
    Brooks Jr., F.P., Airey, J., Alspaugh, J., Bell, A., Brown, R., Hill, C., Nimscheck, U., Rheingans, P., Rohlf, J., Smith, D., et al.: Six generations of building walkthrough: final technical report to the National Science Foundation (1992)Google Scholar
  22. 22.
    Chung, J.C.: A comparison of head-tracked and non-head-tracked steering modes in the targeting of radiotherapy treatment beams. In: Proceedings of the 1992 Symposium on Interactive 3D Graphics, pp. 193–196. ACM, Cambridge (1992)Google Scholar
  23. 23.
    Fairchild, K.M., Lee, B.H., Loo, J., Ng, H., Serra, L.: The heaven and earth virtual reality: designing applications for novice users. In: 1993 IEEE Virtual Reality Annual International Symposium, pp. 47–53 (1993)Google Scholar
  24. 24.
    Slater, M., Usoh, M., Steed, A.: Taking steps: the influence of a walking technique on presence in virtual reality. ACM Trans. Comput. Hum. Interact. 2, 201–219 (1995)CrossRefGoogle Scholar
  25. 25.
    Usoh, M., Arthur, K., Whitton, M.C., Bastos, R., Steed, A., Slater, M., Brooks, F.P.: Walking > Walking-in-place > Flying, in virtual environments. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 359–364. ACM Press/Addison-Wesley Publishing Co., New York (1999)Google Scholar
  26. 26.
    Hwang, J., Jung, J., Kim, G.J.: Hand-held virtual reality: a feasibility study. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 356–363. ACM (2006)Google Scholar
  27. 27.
    Lopes, P., Ion, A., Kovacs, R.: Using your own muscles: realistic physical experiences in VR. XRDS 22, 30–35 (2015)CrossRefGoogle Scholar
  28. 28.
    Lopes, P., Ion, A., Baudisch, P.: Impacto: simulating physical impact by combining tactile stimulation with electrical muscle stimulation. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 11–19. ACM (2015)Google Scholar
  29. 29.
    Tregillus, S.: VR-Drop: exploring the use of walking-in-place to create immersive VR games. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 176–179. ACM, New York (2016) Google Scholar
  30. 30.
    Tregillus, S., Folmer, E.: VR-STEP: walking-in-place using inertial sensing for hands free navigation in mobile VR environments. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 1250–1255. ACM, New York (2016)Google Scholar
  31. 31.
    McGill, M., Boland, D., Murray-Smith, R., Brewster, S.: A dose of reality: overcoming usability challenges in VR head-mounted displays. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 2143–2152. ACM, New York, NY, USA (2015)Google Scholar
  32. 32.
    Rabbx Inc.: Ghostly Mansion (2015)Google Scholar
  33. 33.
    NVYVE Inc.: Car VisualizerGoogle Scholar
  34. 34.
    Elementals Studio: Home AR DesignerGoogle Scholar
  35. 35.
    Defective Studios: WorldBuilderGoogle Scholar
  36. 36.
    Lee, J.: Tango MinitownGoogle Scholar
  37. 37.
    Project Tango: Project TangosaursGoogle Scholar
  38. 38.
    Angstrom Tech: Solar SimulatorGoogle Scholar
  39. 39.
    Bracken, C.C., Skalski, P.: Immersed in Media: Telepresence in Everyday Life. Routledge, New York (2010)Google Scholar
  40. 40.
    Unity - Game Engine.
  41. 41.
    Heeter, C.: Being there: the subjective experience of presence. Presence Teleoperators Virtual Environ. 1, 262–271 (1992)CrossRefGoogle Scholar
  42. 42.
    Schubert, T.W.: The sense of presence in virtual environments: a three-component scale measuring spatial presence, involvement, and realness. Z. Für Medien. 15, 69–71 (2003)CrossRefGoogle Scholar
  43. 43.
    Turner, P.: The intentional basis of presence. In: Proceedings of the 10th International Workshop on Presence, pp. 127–134. Citeseer (2007)Google Scholar
  44. 44.
    Perneger, T.V.: What’s wrong with Bonferroni adjustments. BMJ 316, 1236–1238 (1998)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Madeira-ITIUniversity of MadeiraFunchalPortugal
  2. 2.Ulsan National Institute of Science and TechnologyUlsanRepublic of Korea

Personalised recommendations