Setup Consistent Visual Textures for Haptic Surfaces in a Virtual Reality World

  • Wanhua Hu
  • Tao Lin
  • Kazuo Sakai
  • Atsumi Imamiya
  • Masaki Omata
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4397)


In the real world, interactions with objects are typically multimodal, involving two or more sensory modalities. To simulate the real world in virtual environments, it is thus important to provide multisensory input. Haptics are increasingly being employed as an input channel. However, different modal interfaces are artificially created in a virtual reality world. Does the visual information we provide about surfaces need to be consistent with their haptic representation? In this paper, we present the results of a haptic texture cognition experiment in which subjects judged the haptic size of regular dots. We found that visual texture information that was consistent with haptic information lead to a higher percentage of correct answers and shorter judging times. Furthermore, we found that participants relied on visual information as judgments became more difficult, even though they were asked to make decisions using haptic stimuli only.


multimodal human-computer interfaces virtual reality haptics  textured surfaces 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Basdogan, C., De, S., Kim, J., Muniyandi, M., Kim, H., Srinivasan, M.A.: Haptics in minimally invasive surgical simulation and training. IEEE Computer Graphics and Applications 24(2), 56–64 (2004)CrossRefGoogle Scholar
  2. 2.
    Campbell, C., Zhai, S., May, K., Maglio, K.: What you feel must be what you see: adding tactile feedback to the TrackPoint. In: Proc. INTERACT ’99 of Human-Computer Interaction, Edinburgh, UK, pp. 383–390 (1999)Google Scholar
  3. 3.
    Durlach, N.I., Mavor, A.S.: Virtual Reality: scientific and technological challenges. National Academy Press, Washington (1994)Google Scholar
  4. 4.
    Hu, W., Lin, T., Sakai, K., Imamiya, A., Omata, M.: Visual and Haptic Interaction on Virtual Haptic Roughness Perception with Different Lightness. In: Proc. IASTED-HCI 2005, Phoenix, USA, pp. 126–131 (2005)Google Scholar
  5. 5.
    Hu, W., Sakai, K., Imamiya, A., Omata, M., Lin, T.: Lightness Influence on Virtual Haptic Roughness Perception. Information Technology Letters 4, 249–252 (2005)Google Scholar
  6. 6.
    Katz, D.: The world of touch (Translated by Krueger, L.E.). Erlbaum, Hillsdale (1989)Google Scholar
  7. 7.
    Lederman, S.J., Klatzky, R.L., Hamilton, C., Morgan, T.: Integrating Multimodal Information about Surface Texture via a Probe: Relative contributions of haptic and touch produced sound sources. In: Proc. 10th Annual meeting of Haptic Interfaces for Teleoperator and Virtual Environment Systems, Satellite meeting of the Annual IEEE VR ’02 meeting, pp. 97–104. IEEE Computer Society Press, Los Alamitos (2002)Google Scholar
  8. 8.
    Lederman, S.J., Martin, A., Tong, C., Klatzky, R.: Relative performance using haptic and/or touch-produced auditory cues in a remote texture identification task. In: Proc. IEEE Haptics Symposium, pp. 151–158. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  9. 9.
    Luo, Z., Imamiya, A.: Color presentation mode affects human haptic memory for rough surfaces. In: Proc. the 2003 IEEE International Conference on Information Reuse and Integration (IRI2003), Las Vegas, Nevada, USA, pp. 345–353. IEEE, Los Alamitos (2003)Google Scholar
  10. 10.
    Luo, Z., Imamiya, A.: Do colors affect our recognition memory for haptic rough surfaces? In: Proc. The International Workshop on Interactive Visualization and Interaction Technologies, Krokow, Poland, pp. 897–904 (2004)Google Scholar
  11. 11.
    Luo, Z., Imamiya, A.: How do colors influence the haptic perception of textured surfaces? Universal Access in the Information Society (UAIS), Special Issue “Multimodality: a Step towards Universal Access” 2(2), 160–172 (2003)Google Scholar
  12. 12.
    McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264, 746–748 (1976)CrossRefGoogle Scholar
  13. 13.
    Murayama, J., Luo, Y., Akahane, K., Hasegawa, S., Sato, M.: A haptic interface for two-handed 6DOF manipulation-SPIDAR-G&G system. IEICE Trans. on Information and Systems E87- D(6), 1415–1421 (2004)Google Scholar
  14. 14.
    Nam, C.S., Di, J., Borsodi, L.W., Mackay, W.: A Haptic Thermal Interface: Towards Effective Multimodal User Interface Systems. In: Proc. IASTED-HCI 2005, Phoenix, AZ, USA, pp. 13–18 (2005)Google Scholar
  15. 15.
    Poling, G.L., Weisenberger, J.M., Kerwin, T.: The Role of Multisensory Feedback in Haptic Surface Perception. In: haptics of 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS’03), pp. 187–194 (2003)Google Scholar
  16. 16.
    Reachin API 3.0 programmer’s guide. Reachin Technologies AB, Sweden (1998-2001) Google Scholar
  17. 17.
    Rock, I., Victor, J.: Vision and touch: An experimentally created conflict between the two senses. Science 143, 594–596 (1964)CrossRefGoogle Scholar
  18. 18.
    Spence, C., Baddeley, R., Zampini, M., James, R., Shore, D.I.: Multisensory temporal order judgments: when two locations better than one. Percept Psychophys. 65, 318–328 (2003)Google Scholar
  19. 19.
    Stephanidis, C. (ed.): User Interfaces for All-Concepts, Methods and Tools. Lawrence Erlbaum Associates, Mahwah (2001)Google Scholar
  20. 20.
    Stephanidis, C.: IS4ALL: promoting universal design in healthcare telematics. In: Stephanidis, C. (ed.) Universal Access in HCI: Towards an Information Society for All, vol 3, pp. 50–54. Lawrence Erlbaum Association, London (2001)Google Scholar
  21. 21.
    Wang, Y., MacKenzie, C.L.: The role of contextual haptic and visual constraints on object manipulation in virtual environments. In: Proc. CHI 2000, The Hague, The Netherlands, pp. 532–539 (2000)Google Scholar
  22. 22.
    Weisenberger, J.M., Poling, G.L.: Multisensory Roughness Perception of Virtual Surfaces: Effects of Correlated Cues. In: haptics of 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS’04), pp. 161–168 (2004)Google Scholar

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Wanhua Hu
    • 1
  • Tao Lin
    • 1
  • Kazuo Sakai
    • 1
  • Atsumi Imamiya
    • 1
  • Masaki Omata
    • 1
  1. 1.Graduate School, University of Yamanashi, Takeda 4-3-11, Kofu, Yamanashi Prefecture, 400-8511Japan

Personalised recommendations