Spatiotemporal Visuotactile Interaction

  • Ju-Hwan Lee
  • Charles Spence
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5024)


Over the last few years, a growing number of IT devices have started to incorporate touch-screen technology in order to create more effective multimodal user interfaces. The use of such technology has opened up the possibility of presenting different kinds of tactile feedback (i.e., active vs. passive) to users. Here, we report 2 experiments designed to investigate the spatiotemporal constraints on the multisensory interaction between vision and touch as they relate to a user’s active vs. passive interaction with a touch screen device. Our results demonstrate that when touch is active, tactile perception is less influenced by irrelevant visual stimulation than when passively touching the screen. Our results also show that vision has to lead touch by approximately 40ms in order for optimal simultaneity to be perceived, no matter whether touch is active or passive. These findings provide constraints for the future design of enhanced multimodal interfaces.


Multimodal User Interface Visuotactile interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brewster, S., Chohan, F., Brown, L.: Tactile feedback for mobile interaction. In: Proc. CHI 2007, pp. 159–162. ACM Press, New York (2007)Google Scholar
  2. 2.
    Brown, L., Brewster, S., Purchase, H.: A first investigation into the effectiveness of tactons. In: Proc. World Haptics 2005, pp. 167–176. IEEE Press, Los Alamitos (2005)Google Scholar
  3. 3.
    Hoggan, E., Brewster, S.: Crossmodal icons for information display. In: Proc. CHI 2006, pp. 857–862. ACM Press, New York (2006)Google Scholar
  4. 4.
    Tan, H., Pentland, A.: Tactual displays for wearable computing. In: Proc. ISWC 1997, pp. 225–230. IEEE Press, Los Alamitos (1997)Google Scholar
  5. 5.
    Gallace, A., Tan, H., Spence, C.: The failure to detect tactile change: A tactile analogue of visual change blindness. Psychon. Bull. Rev. 13, 300–303 (2006)Google Scholar
  6. 6.
    Spence, C., Pavani, F., Maravita, A., Holmes, N.: Multisensory contributions to the representation of peripersonal space in humans. In: Lin, M. (ed.): Haptic rendering: Foundations, algorithms, and applications. Wellesley, MA: AK Peters (in press)Google Scholar
  7. 7.
    Spence, C., Shore, D.I., Klein, R.M.: Multisensory prior entry. J. Exp. Psychol. Gen. 130, 799–832 (2001)CrossRefGoogle Scholar
  8. 8.
    Zampini, M., Shore, D.I., Spence, C.: Audiovisual temporal order judgments. Exp. Brain Res. 152, 198–210 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Ju-Hwan Lee
    • 1
  • Charles Spence
    • 1
  1. 1.Crossmodal Research LaboratoryUniversity of OxfordUK

Personalised recommendations