The Effectiveness of Multimodal Sensory Feedback on VR Users’ Behavior in an L-Collision Problem
Virtual Reality (VR) is highly dependent on visual information, although it offers multimodal channels for sensory feedback. In this study, we compared the effectiveness of different sensory modalities in the context of collision avoidance in the industrial manufacturing process. Participants performed a pick-and-place task with L-shaped objects on a virtual workstation. In a between-subject design each person performed one of four conditions: Baseline, Auditory, Haptic, and Visual condition. We measured the timing and accuracy of the performed actions. Statistical testing by an ANOVA showed a significant main effect, i.e. a difference between the conditions. We observed the lowest number of collisions in the auditory condition followed by the haptic, baseline and visual conditions. Post hoc tests revealed a significant difference between the auditory condition, the most accurate, and the visual condition, the least accurate. This implies that giving additional feedback by the visual modality is not optimal and utilizing a fully multimodal interface has increased effectivity.
KeywordsVR Multisensory feedback Collision Simulation
We gratefully acknowledge the support by the project ErgoVR (BMBF, KMU Innovativ V5KMU17/221) and the SALT AND PEPPER Software GbmH & Co.KG.
- 4.Burke, J.L., Prewett, M.S., Gray, A.A., Yang, L., Stilson, F.R., Coovert, M.D., Elliot, L.R., Redden, E.: Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 108–117. ACM (2006)Google Scholar
- 6.Burdea, G.C.: Keynote address: haptics feedback for virtual reality. In: Proceedings of International Workshop on Virtual Prototyping, Laval, France, pp. 87–96 (1999)Google Scholar
- 9.Jacko, J.A., Scott, I.U., Sainfort, F., Barnard, L., Edwards, P.J., Emery, V.K., Kongnakorn, T., Moloney, K.P., Zorich, B.S.: Older adults and visual impairment: what do exposure times and accuracy tell us about performance gains associated with multimodal feedback? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 33–40. ACM (2003)Google Scholar
- 14.Lee, J.H., Spence, C.: Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. In: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction-Volume 1. British Computer Society, pp. 185–192 (2008)Google Scholar