The phenomenon of immersing oneself into virtual environments has been established widely. Yet to date (to our best knowledge) the physical dimension has been neglected in studies investigating immersion in Human-Computer Interaction (HCI). In movement-based interaction the user controls the interface via body movements, e.g. direct manipulation of screen objects via gestures or using a handheld controller as a virtual tennis racket. It has been shown that physical activity affects arousal and that movement-based controllers can facilitate engagement in the context of video games. This paper aims at identifying movement features that influence immersion. We first give a brief survey on immersion and movement-based interfaces. Then, we report results from an interview study that investigates how users experience their body movements when interacting with movement-based interfaces. Based on the interviews, we identify four movement-specific features. We recommend them as candidates for further investigation.


Movement-based interaction exertion immersion engagement flow games entertainment 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bailenson, J.N., Yee, N.: Digital Chameleons. Automatic Assimilation of Nonverbal Gestures in Immersive Virtual Environments. Psychological Science 16(10), 814–819 (2005)Google Scholar
  2. 2.
    Bianchi-Berthouze, N., Kim, W.W., Darshak, P.: Does Body Movement Engage You More in Digital Game Play? and Why? In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 102–113. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Bonis, J.: Acute wiitis. New England Journal of Medicine 356(23), 2431–2432 (2007)CrossRefGoogle Scholar
  4. 4.
    Brown, E., Cairns, P.: A grounded investigation of game immersion. In: Proceedings CHI 2004, pp. 1297–1300 (2004)Google Scholar
  5. 5.
    Cairns, P., Cox, A., Berthouze, N., Dhoparee, S., Jennett, C.: Quantifying the experience of immersion in games. Cognitive Science, Vancouver (2006)Google Scholar
  6. 6.
    Chen, J.: Flow in games (and everything else). Communications of the ACM 50(4), 31–34 (2007)CrossRefGoogle Scholar
  7. 7.
    Cheng, K., Cairns, P.A.: Behaviour, realism and immersion in games. In: Proceedings CHI 2005, pp. 1272–1275 (2005)Google Scholar
  8. 8.
    Cowley, A.D., Minnaar, G.: Watch out for wii shoulder. British Medical Journal 336, 110 (2008)CrossRefGoogle Scholar
  9. 9.
    Csikszentmihalyi, M.: Flow: the psychology of optimal experience. Harper and Row, New York (1990)Google Scholar
  10. 10.
    Epstein, L.H., Roemmich, J.N., Robinson, J.L., Paluch, R.A., Winiewicz, D.D., Fuerch, J.H., et al.: A Randomized Trial of the Effects of Reducing Television Viewing and Computer Use on Body Mass Index in Young Children. Archives of Pediatrics and Adolescent Medicine 162(3), 239–245 (2008)CrossRefGoogle Scholar
  11. 11.
    Ermi, L., Mäyrä, F.: Fundamental components of the gameplay experience: analysing immersion. In: de Castell, S., Jenson, J. (eds.) Changing views: worlds in play, Selected Papers DiGRA conference, pp. 15–27 (2005)Google Scholar
  12. 12.
    Fairclough, S.H.: Fundamentals of physiological computing. Interacting with Computers (pre-print online version) (2008), doi:10.1016/j.intcom.2008.10.011Google Scholar
  13. 13.
    Fox, K.R.: The influence of physical activity on mental well-being. Public Health Nutrition 2(3a), 411–418 (1999)CrossRefGoogle Scholar
  14. 14.
    Glaser, B., Strauss, A.: The discovery of grounded theory: Strategies for qualitative research. Aldine, New York (1967)Google Scholar
  15. 15.
    Goulding, C.: Grounded Theory: A Practical Guide for Management, Business and Market Researchers. SAGE, London (2002)CrossRefGoogle Scholar
  16. 16.
    Graves, L.E., Ridgers, N.D., Stratton, G.: The contribution of upper limb and total body movement to adolescents‘ energy expenditure whilst playing Nintendo Wii. Eur. J. Appl. Physiol. (online version) (2008)Google Scholar
  17. 17.
    Hillier, A.: Childhood overweight and the built environment: making technology part of the solution rather than part of the problem. The ANNALS of the American Academy of Political and Social Science 615(1), 56–82 (2008)CrossRefGoogle Scholar
  18. 18.
    Höysniemi, J., Aula, A., Auvinen, P., Hännikäinen, J., Hämäläinen, P.: Shadow boxer: a physically interactive fitness game. In: Third Nordic Conference on Human-Computer Interaction (NordiCHI 2004), vol. 82, pp. 389–392. ACM Press, New York (2004)CrossRefGoogle Scholar
  19. 19.
    Ijsselsteijn, W., Riva, G.: Being there: the experience of presence in mediated environments. In: Riva, G., Davide, F., Ijsselsteijn, W. (eds.) Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments, pp. 3–16. IOS Press, Amsterdam (2003)Google Scholar
  20. 20.
    Jacob, R.K.J.: What you look at is what you get: Eye movement-based interaction techniques. In: Proceedings CHI 1990, pp. 11–18 (1990)Google Scholar
  21. 21.
    Lanningham-Foster, L., Jensen, T.B., Foster, R.C., Redmond, A.B., Walker, B.A., Heinz, D., et al.: Energy expenditure of sedentary screen time compared with active screen time for children. Pediatrics 118(6), 1831–1835 (2006)CrossRefGoogle Scholar
  22. 22.
    Loke, L., Larssen, A.T., Robertson, T., Edwards, J.: Understanding movement for interaction design: frameworks and approaches. Personal and Ubiquitous Computing 11(8), 691–701 (2007)CrossRefGoogle Scholar
  23. 23.
    McMahan, A.: Immersion, engagement and presence. The Video Game Theory Reader, pp. 67–86 (2003)Google Scholar
  24. 24.
    Mueller, F., Agamanolis, S., Picard, R.: Exertion Interfaces: Sports over a Distance for Social Bonding and Fun. In: Proceedings CHI 2003, pp. 561–568 (2003)Google Scholar
  25. 25.
    Murray, J.: Hamlet on the Holodeck: The Future of Narrative in Cyberspace. MIT Press, Cambridge (1997)Google Scholar
  26. 26.
    Nijholt, A., van Dijk, B., Reidsma, D.: Design of Experience and Flow in Movement-based Interaction. In: Proceedings Motion in Games. LNCS, vol. 5277, pp. 166–175. Springer, Berlin (2008)CrossRefGoogle Scholar
  27. 27.
    Park, J.Y., Yi, J.H.: Gesture Recognition Based Interactive Boxing Game. International Journal of Information Technology 12(7), 36–44 (2006)Google Scholar
  28. 28.
    Pasch, M.: Bye-bye Couch Potato: Body Movement in the Gaming Experience. MSc Thesis, University of Twente, the Netherlands (2008)Google Scholar
  29. 29.
    Sacks, O.: The Man Who Mistook His Wife for a Hat, and Other Clinical Tales. Touchstone, New York (1998)Google Scholar
  30. 30.
    Sweetser, P., Wyeth, P.: Gameflow: a model for evaluating player enjoyment in games. Computers in Entertainment 3(3), 1–24 (2005)CrossRefGoogle Scholar

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2009

Authors and Affiliations

  • Marco Pasch
    • 1
    • 3
  • Nadia Bianchi-Berthouze
    • 2
  • Betsy van Dijk
    • 3
  • Anton Nijholt
    • 3
  1. 1.Faculty of InformaticsUniversity of LuganoLugano
  2. 2.UCL Interaction CentreUniversity College LondonLondonUK
  3. 3.Human Media InteractionUniversity of TwenteEnschede

Personalised recommendations