Abstract
Virtual Reality has been successfully used to implement highly motivating learning environments where learners interact with the represented environment using hand gestures. However, little has been done in order to study which are the most convenient gestures for implementing this interaction in order to discover good practices for HCI. This investigation proposes a guideline for gesture evaluation based on user experience, in the scenario of small children learning words of a foreign language. Particularly, it provides a starting point by contrasting two gestures per action for selecting, moving and inspecting objects in a virtual environment. This study found out that these gestures were not indistinguishable. Instead, children have a clear preference for each action according to several indicators, which enabled us to establish a ranking of gesture preference for each action. Further research may expand the experiment by including additional gestures and actions.
Keywords
- Virtual reality
- Gestures-based interaction
- Computer supported learning
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Orlosky, J., Kiyokawa, K., Takemura, H.: Virtual and augmented reality on the 5G highway. J. Inf. Process. 25, 133–141 (2017)
O’Connor, E.A., Domingo, J.: A practical guide, with theoretical underpinnings, for creating effective virtual reality learning environments. J. Educ. Technol. Syst. 45(3), 343–364 (2017)
Home, M.W.: Virtual reality at the British Museum: What is the value of virtual reality environments for learning by children and young people, schools, and families. In: Proceedings of the Annual Conference of Museums and the Web, Los Angeles, CA, USA, pp. 6–9, April 2016
Johnson-Glenberg, M.C.: Immersive VR and education: embodied design principles that include gesture and hand controls. Front. Robot. A I, 5 (2018)
Jahani, H., Kavakli, M.: Exploring a user-defined gesture vocabulary for descriptive mid-air interactions. Cogn. Technol. Work 20(1), 11–22 (2017)
Cabral, M.C., Morimoto, C.H., Zuffo, M.K.: On the usability of gesture interfaces in virtual reality environments. In: Proceedings of the 2005 Latin American Conference on Human-Computer Interaction - CLIHC 2005 (2005)
LaViola, J.J., Jr., Kruijff, E., McMahan, R.P., Bowman, D., Poupyrev, I.P.: 3D User Interfaces: Theory and Practice. Addison-Wesley Professional, Boston (2017)
Baloian, N., Pino, J.A., Hoppe, H.U.: Dealing with the students’ attention problem in computer supported face-to-face lecturing. J. Educ. Technol. Soc. 11(2), 192–205 (2008)
Hourcade, J.P., Iversen, O.S., Woodgate, D., Parés, N., Fails, J.A., Read, J.: Research philosophies in interaction design and children. Panel at the 6th International Conference on Interaction Design and Children 2007, Aalborg, Denmark, 6 June 2007. In Interaction Design and Children (2007)
Papert, S., Harel, I.: Situating constructionism. Constructionism 36(2), 1–11 (1991)
Papanastasiou, G., Drigas, A., Skianis, C., Lytras, M., Papanastasiou, E.: Virtual and augmented reality effects on K-12, higher and tertiary education students’ twenty-first century skills. Virtual Reality 23(4), 425–436 (2018)
Graham, S., Courtney, L., Tonkyn, A., Marinis, T.: Motivational trajectories for early language learning across the primary-secondary school transition. Br. Edu. Res. J. 42(4), 682–702 (2016)
Dalim, C.S.C., Sunar, M.S., Dey, A., Billinghurst, M.: Using augmented reality with speech input for non-native children’s language learning. Int. J. Hum Comput Stud. 134, 44–64 (2020)
Hartshorne, J.K., Tenenbaum, J.B., Pinker, S.: A critical period for second language acquisition: evidence from 2/3 million English speakers. Cognition 177, 263–277 (2018)
Nielsen, J.: Heuristic evaluation. In: Usability Inspection Methods, pp. 25–62. Wiley, Hoboken (1994)
Erazo, O., Rekik, Y., Grisoni, L., Pino, J.A.: Understanding gesture articulations variability. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10514, pp. 293–314. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67684-5_18
Li, Y., Huang, J., Tian, F., Wang, H.-A., Dai, G.-Z.: Gesture interaction in virtual reality. Virtual Reality Intell. Hardware 1(1), 84–112 (2019)
Erazo, O., Pino, J.A.: Predicting user performance time for hand gesture interfaces. Int. J. Ind. Ergon. 65, 122–138 (2018)
Wu, H., et al.: Understanding freehand gestures: a study of freehand gestural interaction for immersive VR shopping applications. Human-Centric Comput. Inf. Sci. 9(1), 1–26 (2019)
Altarteer, S., Charissis, V., Harrison, D., Chan, W.: Development and heuristic evaluation of semi-immersive hand-gestural virtual reality interface for luxury brands online stores. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017. LNCS, vol. 10325, pp. 464–477. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60928-7_39
Cheng, A., Yang, L., Andersen, E.: Teaching language and culture with a virtual reality game. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (2017)
Vazquez, C., Xia, L., Aikawa, T., Maes, P.: Words in motion: kinesthetic language learning in virtual reality. In: 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT) (2018)
Inglés (Propuesta) 2\(^{\circ }\) básico (2018). https://www.curriculumnacional.cl/portal/Educacion-General/Ingles-Propuesta-curricular-/Ingles-Propuesta-2-basico/. (in Spanish)
Scarry, R.: Richard Scarry’s best word book ever. HarperCollins Children’s Books (2013)
Zhang, Q., Zhu, W., Zhu, Q.: Real world hand gesture interaction in virtual reality. J. Phys. Conf. Ser. 1229, 012027 (2019)
Chang, Y.S., Nuernberger, B., Luan, B., Hollerer, T.: Evaluating gesture-based augmented reality annotation. In: 2017 IEEE Symposium on 3D User Interfaces (3DUI) (2017)
Baloian, N., Pino, J.A., Vargas, R.: Tablet gestures as a motivating factor for learning. In: Proceedings of the 2013 Chilean Conference on Human-Computer Interaction, pp. 98–103 (2013)
Simor, F.W., Brum, M.R., Schmidt, J.D.E., Rieder, R., Marchi, A.C.B.D.: Usability evaluation methods for gesture-based games: a systematic review. JMIR Serious Games 4(2), e5860 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Edwards, M., Baloian, N., Pino, J.A. (2023). Hand Gesture Preferences Analysis for a Virtual Reality Scenario. In: Bravo, J., Ochoa, S., Favela, J. (eds) Proceedings of the International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2022). UCAmI 2022. Lecture Notes in Networks and Systems, vol 594. Springer, Cham. https://doi.org/10.1007/978-3-031-21333-5_89
Download citation
DOI: https://doi.org/10.1007/978-3-031-21333-5_89
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21332-8
Online ISBN: 978-3-031-21333-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)