Modeling Reduced User Experience Caused by Visual Latency
Two experiments were conducted to investigate the influence of delayed visual feedback on users’ motor performance and subject experience. In a Fitt’s-law target acquisition task, participants moved a cursor from a home location to a spherical target with delayed visual feedback. The experimental trials were blocked by latency (Experiment 1) to allow participants to get adapted to a constant delay or tested in random order (Experiment 2). Both experiments found significant impact of delay on motor performance, and the larger the Index of Difficulty of movement, the greater the performance detriment. A modified Fitts’-law model described the results very well with an additional multiplicative component of latency. Participants’ ratings of subjective experience with different latencies could be well-predicted from their motor performance. Between-experiments comparisons further revealed the effects of sensorimotor adaptation to constant delays. The results provide guidance to the design of VR/AR/tele-operative applications.
KeywordsHuman performance modeling Feedback delay Latency Fitts’ law Pointing
The work was supported in part by NIH grants 5R00EB008710 & 9R44OD018334.
- 1.Ng, A., Lepinski, J., Wigdor, D., Sanders, S. Dietz., P.: Designing for low-latency direct-touch input. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST ’12). ACM, New York, NY, USA, pp. 453–464 (2012)Google Scholar
- 2.MacKenzie, S., Ware, C.: Lag as a determinant of human performance in interactive systems. In: Proceedings of the ACM Conference on Human Factors in Computing Systems—INTERCHI, pp. 488–493 (1993)Google Scholar
- 5.Day, P.N., Holt, P.O., Russell, G.T.: Modeling the effects of delayed visual feedback in real-time operator control loops: a cognitive perspective. In: Alty, J.L. (ed.) Proceedings of the XVIII European Annual Conference on Human Decision Making and Manual Control, pp. 70–79. Group D Publications Ltd., Loughborough (1999)Google Scholar
- 7.Ware, C., Balakrishnan, R,: Target acquisition in fish tank VR: the effects of lag and frame rate. In: Davis, W.A., Joe, B. (eds.) Proceedings of Graphics Interface ‘94, pp. 1–7 (1994)Google Scholar
- 8.Wu, B., Sim, S., Enquobahrie, A., Ortiz, R.: Effects of visual latency on visual-haptic experience of stiffness. In: Proceedings of the 7th International Workshop on Quality of Multimedia Experience (QoMEX 2015), IEEE, Paper#84 (2015)Google Scholar
- 10.Shi, Z., Hirche, S., Schneider, W., Muller, H.J.: Influence of visuomotor action on visual-haptic simultaneous perception: a psychophysical study. In: Proceedings of 16th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems, pp. 65–70 (2008)Google Scholar
- 11.Steinicke, F., Bruder, G.A.: Self-experimentation report about long-term use of fully-immersive technology. In: Proceedings of the 2nd ACM Symposium on Spatial User Interaction, pp. 66–69 (2014)Google Scholar