Abstract
In this work, we examine the effect of mid-air gesture rhythm on user experience in Virtual Reality. In particular, we investigate gesture regularity, speed and highlighting with a sound guide. We measure the effect of these components on the perceived fatigue, presence, difficulty, success and helpfulness. Our findings indicate that an irregular and slow rhythm leads to a lower arm fatigue. We also find that such an irregular rhythm could increase the user perceived difficulty of the task and the absence of a sound guide could decrease the sense of presence.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Borg, G.: Borg’s Perceived Exertion and Pain Scales. Borg’s Perceived Exertion and Pain Scales, p. viii, 104. Human Kinetics, Champaign (1998)
Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, pp. 161–168 (2009)
Carter, M., Velloso, E., Downs, J., Sellen, A., O’Hara, K., Vetere, F.: PathSync: multi-user gestural interaction with touchless rhythmic path mimicry. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3415–3427 (2016)
Cockburn, A., Quinn, P., Gutwin, C., Ramos, G., Looser, J.: Air pointing: design and evaluation of spatial target acquisition with and without visual feedback. Int. J. Hum. Comput. Stud. 69(6), 401–414 (2011)
Freeman, E., Griffiths, G., Brewster, S.A.: Rhythmic micro-gestures: discreet interaction on-the-go. In: Proceedings of the 19th ACM International Conference on Multimodal Interaction, pp. 115–119 (2017)
Fuller, J.R., Lomond, K.V., Fung, J., Côté, J.N.: Posture-movement changes following repetitive motion-induced shoulder muscle fatigue. J. Electromyogr. Kinesiol. 19(6), 1043–1052 (2009)
Ghomi, E., Faure, G., Huot, S., Chapuis, O., Beaudouin-Lafon, M.: Using rhythmic patterns as an input method. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1253–1262 (2012)
Harrison, C., Ramamurthy, S., Hudson, S.E.: On-body interaction: armed and dangerous. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp. 69–76 (2012)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Advances in Psychology, vol. 52, pp. 139–183. Elsevier (1988)
Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P.: Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 1063–1072. ACM (2014)
Kay, M., Wobbrock, J.O.: Package ‘artool’ (2020)
Mary Costello, B.: Paying attention to rhythm in HCI: some thoughts on methods. In: 32nd Australian Conference on Human-Computer Interaction, pp. 471–480 (2020)
Mereu, S.W., Kazman, R.: Audio enhanced 3D interfaces for visually impaired users. ACM SIGCAPH Comput. Phys. Handicap. 57, 10–15 (1997)
Mueller, F., Isbister, K.: Movement-based game guidelines. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2191–2200 (2014)
Sánchez, J., Sáenz, M.: 3D sound interactive environments for problem solving. In: Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 173–179 (2005)
Schneider, D.K.: Presence Questionnaire (PQ) - EduTech Wiki, July 2019. http://edutechwiki.unige.ch/en/Presence/Presence_Questionnaire_(PQ)
Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591–611 (1965)
Szmedra, L., Bacharach, D.: Effect of music on perceived exertion, plasma lactate, norepinephrine and cardiovascular hemodynamics during treadmill running. Int. J. Sports Med. 19(1), 32–37 (1998)
Velloso, E., Carter, M., Newn, J., Esteves, A., Clarke, C., Gellersen, H.: Motion correlation: selecting objects by matching their movement. ACM Trans. Comput. Hum. Interact. (TOCHI) 24(3), 1–35 (2017)
Wang, H.: How will different control/display ratios influence muscle fatigue and game experience in virtual reality games? (2016)
Williams, D.A., Fazenda, B., Williamson, V.J., Fazekas, G.: Biophysiologically synchronous computer generated music improves performance and reduces perceived effort in trail runners. In: Michon, R., Schroeder, F. (eds.) Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 531–536. Birmingham City University, Birmingham, July 2020. https://www.nime.org/proceedings/2020/nime2020_paper102.pdf
Wobbrock, J., Findlater, L., Gergle, D., Higgins, J.: The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Reynaert, V., Berthaut, F., Rekik, Y., Grisoni, L. (2021). The Effect of Rhythm in Mid-air Gestures on the User Experience in Virtual Reality. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12934. Springer, Cham. https://doi.org/10.1007/978-3-030-85613-7_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-85613-7_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85612-0
Online ISBN: 978-3-030-85613-7
eBook Packages: Computer ScienceComputer Science (R0)
