Abstract
New ways to interact with VR environments come with both opportunities and challenges for accessibility. In this work, we summarize different possible hands-free input methods to play a VR game and investigate their applicability. Using a serious game as a Proof of Concept we implemented five focus methods (head-tracking, scanning, head-movement, eye-tracking and voice control) and three activation methods (button, dwelling and blink) exemplary using the Oculus Go standalone VR headset and the Unity game engine. We analyzed the suitability of these methods in a pre-study that excluded head movements for controlling the game based on user feedback. The remaining input methods were evaluated in an explorative user study in terms of operability and ease of use.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apple Support: Use Switch Control to navigate your iPhone, iPad, or iPod touch (2019). https://support.apple.com/en-us/HT201370
Cattan, G., Mendoza, C., Andreev, A., Congedo, M.: Recommendations for integrating a P300-based brain computer interface in virtual reality environments for gaming 7(2), 34 (2018). https://doi.org/10.3390/computers7020034
Coogan, C.G., He, B.: Brain-computer interface control in a virtual reality environment and applications for the Internet of Things 6, 10840–10849 (2018). https://doi.org/10.1109/ACCESS.2018.2809453
Hamilton, I.: A practitioner reflection on accessibility in virtual reality environments. Comput. Games J. 7(2), 63–74 (2018). https://doi.org/10.1007/s40869-018-0061-z
Heidelberg University: Institute of Pharmacy and Molecular Biotechnology (2021). https://www.ipmb.uni-heidelberg.de/index_en.html
Heilemann, F.: Accessible hands-free input methods for a serious VR game: Development and evaluation (2021). https://hdms.bsz-bw.de/frontdoor/index/index/start/0/rows/10/sortfield/score/sortorder/desc/searchtype/simple/query/heilemann/docId/6641
Holderied, H.: Evaluation of Interaction Concepts in Virtual Reality Applications (2017). https://doi.org/10.18420/IN2017_254
Kim, M., Lee, J., Jeon, C., Kim, J.: A study on interaction of gaze pointer-based user interface in mobile virtual reality environment 9(9), 189 (2017). https://doi.org/10.3390/sym9090189
Oculus: Oculus Integration (2017). https://assetstore.unity.com/packages/tools/integration/oculus-integration-82022
Pupil Labs GmbH: GitHub | Release HMD-Eyes v1.3 pupil-labs/hmd-eyes (2020). https://github.com/pupil-labs/hmd-eyes/releases
Sarker, S., Mazumder, M., Rahman, S., Rabbi, M.A.: An assistive HCI system based on block scanning objects using eye blinks (2019)
Schrepp, M., Hindersks, A., Thomaschewaki, J.: User Experience Questionnaire (UEQ) (2018). https://www.ueq-online.org/
Singh, H., Singh, J.: Object acquisition and selection using automatic scanning and eye blinks in an HCI system. J. Multimodal User Interfaces 13(4), 405–417 (2019). https://doi.org/10.1007/s12193-019-00303-0
Sra, M., Xu, X., Maes, P.: BreathVR: leveraging breathing as a directly controlled interface for virtual reality games. In: Mandryk, R., Hancock, M., Perry, M., Cox, A. (eds.) Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI 2018. pp. 1–12. ACM Press (2018). https://doi.org/10.1145/3173574.3173914
Stendal Syndrome Studio: Game Voice Control [Offline speech recognition] (2020). https://assetstore.unity.com/packages/tools/audio/game-voice-control-offline-speech-recognition-178047
Tobii Gaming: PC Games with Eye Tracking gameplay (2021). https://gaming.tobii.com/games/
Vogl, A., Louveton, N., McCall, R., Billinghurst, M., Haller, M.: Understanding the everyday use of head-worn computers. In: 2015 8th International Conference on Human System Interaction (HSI), pp. 213–219. IEEE (2015). https://doi.org/10.1109/HSI.2015.7170668
Yan, Y., Yu, C., Yi, X., Shi, Y.: HeadGesture 2(4), 1–23 (2018). https://doi.org/10.1145/3287076
Yu, J., Park, J.: Real-time facial tracking in virtual reality. In: Liu, E., de Joya, J.M. (eds.) SIGGRAPH ASIA 2016 VR Showcase. p. 1. Association for Computing Machinery-Digital Library and ACM Special Interest Group on Computer Graphics and Interactive Techniques. ACM (2016). https://doi.org/10.1145/2996376.2996390
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Heilemann, F., Zimmermann, G., Münster, P. (2022). Accessible Hands-Free Input Methods for VR Games. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_43
Download citation
DOI: https://doi.org/10.1007/978-3-031-08648-9_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08647-2
Online ISBN: 978-3-031-08648-9
eBook Packages: Computer ScienceComputer Science (R0)