Adaptation to visual feedback delays on touchscreens with hand vision
- 90 Downloads
Direct touch finger interaction on a smartphone or a tablet is now ubiquitous. However, the latency inherent in digital computation produces an average feedback delay of ~ 75 ms between the action of the hand and its visible effect on digital content. This delay has been shown to affect users’ performance, but it is unclear whether users adapt to this delay and whether it influences skill learning. Previous work studied adaptation to feedback delays but only for longer delays, with hidden hand or indirect devices. This paper addresses adaptation to touchscreen delay in two empirical studies involving the tracking of a target moving along an elliptical path. Participants were trained for the task either at the minimal delay the system allows (~ 9 ms) or at a longer delay equivalent to commercialized touch devices latencies (75 ms). After 10 training sessions over a minimum of 2 weeks (Experiment 1), participants adapt to the delay. They also display long-term retention 7 weeks after the last training session. This adaptation generalizes to a similar tracking path (e.g., infinity symbol). We also observed generalization of learning from the longer delay to the minimal-delay condition (Experiment 2). The delay thus does not prevent the learning of tracking skill, which suggests that delay adaptation and tracking skill could be two separate components of learning.
KeywordsMotor adaptation Motor learning Visual feedback delay Tracking Direct touch interaction
This work has been partially supported by the LabEx PERSYVAL-Lab (ANR-11-LABX-0025-01). This work is based on an earlier work: “Does Practice Make Perfect? Learning to Deal with Latency in Direct-Touch Interaction”, in CHI 2017© ACM, https://doi.org/10.1145/3025453.3025585. The authors also thank Linda Sherwood for her careful proofreading of the manuscript.
- Bérard F, Blanch R (2013) Two touch system latency estimators: high accuracy and low overhead. In: Proceedings of the 2013 ACM international conference on interactive tabletops and surfaces, ACM, New York, NY, USA, pp 241–250Google Scholar
- Bérard F, Rochet-Capellan A (2015) The transfer of learning as HCI similarity: towards an objective assessment of the sensory-motor basis of naturalness. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, ACM, New York, NY, USA, pp 1315–1324Google Scholar
- Cattan E, Rochet-Capellan A, Perrier P, Bérard F (2015) Reducing latency with a continuous prediction: effects on users’ performance in direct-touch target acquisitions. In: Proceedings of the 2015 international conference on interactive tabletops & surfaces, ACM, New York, NY, USA, pp 205–214Google Scholar
- Cattan E, Rochet-Capellan A, Perrier P, Bérard F (2017) Does practice make perfect? In: Proceedings of the 2017 CHI conference on human factors in computing systems (pp 5619–5629), ACM, New York, NY, USAGoogle Scholar
- Jota R, Ng A, Dietz P, Wigdor D (2013) How fast is fast enough?: a study of the effects of latency in direct-touch pointing tasks. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, New York, NY, USA, pp 2291–2300Google Scholar
- Ng A, Lepinski J, Wigdor D, Sanders S, Dietz P (2012) Designing for low-latency direct-touch input. In: Proceedings of the 25th annual ACM symposium on user interface software and technology, ACM, New York, NY, USA, pp 453–464Google Scholar
- Pinheiro J, Bates D, DebRoy S, Sarkar D (2007) Linear and nonlinear mixed effects models. R package version. 3: 57. R Foundation for Statistical Computing, ViennaGoogle Scholar
- R Development Core Team (2016) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna (ISBN 3-900051-07-0) Google Scholar
- Von Helmholtz H (1867) Handbuch der physiologischen Optik. In: Gustav Karsten (ed) Allgemeine Encyklopädie der Physik, vol 9. Leopold Voss, LeipzigGoogle Scholar
- Wigdor D, Wixon D (2011) Brave NUI world: designing natural user interfaces for touch and gesture. Morgan Kaufmann Publishers, BurlingtonGoogle Scholar