Evaluation of Matching Degree Between Touch Gestures and User Mental Model Based on Event-Related Potential
Designing gestures in multi-touch devices that are congruent with User Mental Model (UMM) is vital to remove the cognitive gulf, and reduce learning cost for users. In this study, a neurophysiological evaluation method-Event-Related Potential was used to evaluate matching degree between touch gestures and UMM. Prime-probe paradigm was employed and two experimental conditions were compared-congruence and incongruence. Results show that negative component was elicited within the time window of 300 ms to 500 ms after the onset of probe stimuli in frontal, central and parietal lobe. With time went by, more negative components were found in the incongruence condition. Hereby, the former negative component is interpreted as a representation of the decoding process, and the later one interpreted as semantic matching with UMM. Results in this study may provide guidance for those assessing the usability of multi-touch gestures.
KeywordsMatching degree Touch gesture User mental model Event-related potential Evaluation
Author 1 gratefully acknowledge the grant from the Fundamental Research Funds for the Central Universities & Postgraduate Research & Practice Innovation Program of Jiangsu Province (No. KYCX17_0056). As well, all the authors want to acknowledge the grant from Natural Science Foundation of China (No. 71271053).
- 1.Kim, Y.H., Lee, J.H.: Game interface enhancement under smartphone platform focused on touchscreen interaction, pp. 45–61. Pergamon Press, Inc. (2015)Google Scholar
- 2.Kukimoto, N., Onoue, Y., Aoki, K., Fujita, K., Koyamada, K.: HyperInfo: interactive large display for informal visual communication. In: International Conference on Network-Based Information Systems, pp. 399–404 (2014)Google Scholar
- 3.Valdes, C., et al.: Exploring the design space of gestural interaction with active tokens through user-defined gestures. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 4107–4116 (2014)Google Scholar
- 4.Craik, K.J.W.: The nature of explanation. Stud. Q. J. 14(55), 44 (1967)Google Scholar
- 7.Johnsonlaird, P.N.: Mental models: towards a cognitive science of language. Inference Conscious. 47(1/2), 438–445 (1983)Google Scholar
- 9.Luck, S.J., Kappenman, E.S.: ERP components: the ups and downs of brainwave recordings. In: The Oxford Handbook of Event-Related Potential Components, pp. 3–30. Oxford University Press (2012)Google Scholar
- 14.Amoruso, L., et al.: N400 ERPs for actions: building meaning in context. Front. Hum. Neurosci. 7(57), 57 (2013)Google Scholar