Abstract
In the real world, interactions with objects are typically multimodal, involving two or more sensory modalities. To simulate the real world in virtual environments, it is thus important to provide multisensory input. Haptics are increasingly being employed as an input channel. However, different modal interfaces are artificially created in a virtual reality world. Does the visual information we provide about surfaces need to be consistent with their haptic representation? In this paper, we present the results of a haptic texture cognition experiment in which subjects judged the haptic size of regular dots. We found that visual texture information that was consistent with haptic information lead to a higher percentage of correct answers and shorter judging times. Furthermore, we found that participants relied on visual information as judgments became more difficult, even though they were asked to make decisions using haptic stimuli only.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Basdogan, C., De, S., Kim, J., Muniyandi, M., Kim, H., Srinivasan, M.A.: Haptics in minimally invasive surgical simulation and training. IEEE Computer Graphics and Applications 24(2), 56–64 (2004)
Campbell, C., Zhai, S., May, K., Maglio, K.: What you feel must be what you see: adding tactile feedback to the TrackPoint. In: Proc. INTERACT ’99 of Human-Computer Interaction, Edinburgh, UK, pp. 383–390 (1999)
Durlach, N.I., Mavor, A.S.: Virtual Reality: scientific and technological challenges. National Academy Press, Washington (1994)
Hu, W., Lin, T., Sakai, K., Imamiya, A., Omata, M.: Visual and Haptic Interaction on Virtual Haptic Roughness Perception with Different Lightness. In: Proc. IASTED-HCI 2005, Phoenix, USA, pp. 126–131 (2005)
Hu, W., Sakai, K., Imamiya, A., Omata, M., Lin, T.: Lightness Influence on Virtual Haptic Roughness Perception. Information Technology Letters 4, 249–252 (2005)
Katz, D.: The world of touch (Translated by Krueger, L.E.). Erlbaum, Hillsdale (1989)
Lederman, S.J., Klatzky, R.L., Hamilton, C., Morgan, T.: Integrating Multimodal Information about Surface Texture via a Probe: Relative contributions of haptic and touch produced sound sources. In: Proc. 10th Annual meeting of Haptic Interfaces for Teleoperator and Virtual Environment Systems, Satellite meeting of the Annual IEEE VR ’02 meeting, pp. 97–104. IEEE Computer Society Press, Los Alamitos (2002)
Lederman, S.J., Martin, A., Tong, C., Klatzky, R.: Relative performance using haptic and/or touch-produced auditory cues in a remote texture identification task. In: Proc. IEEE Haptics Symposium, pp. 151–158. IEEE Computer Society Press, Los Alamitos (2003)
Luo, Z., Imamiya, A.: Color presentation mode affects human haptic memory for rough surfaces. In: Proc. the 2003 IEEE International Conference on Information Reuse and Integration (IRI2003), Las Vegas, Nevada, USA, pp. 345–353. IEEE, Los Alamitos (2003)
Luo, Z., Imamiya, A.: Do colors affect our recognition memory for haptic rough surfaces? In: Proc. The International Workshop on Interactive Visualization and Interaction Technologies, Krokow, Poland, pp. 897–904 (2004)
Luo, Z., Imamiya, A.: How do colors influence the haptic perception of textured surfaces? Universal Access in the Information Society (UAIS), Special Issue “Multimodality: a Step towards Universal Access” 2(2), 160–172 (2003)
McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264, 746–748 (1976)
Murayama, J., Luo, Y., Akahane, K., Hasegawa, S., Sato, M.: A haptic interface for two-handed 6DOF manipulation-SPIDAR-G&G system. IEICE Trans. on Information and Systems E87- D(6), 1415–1421 (2004)
Nam, C.S., Di, J., Borsodi, L.W., Mackay, W.: A Haptic Thermal Interface: Towards Effective Multimodal User Interface Systems. In: Proc. IASTED-HCI 2005, Phoenix, AZ, USA, pp. 13–18 (2005)
Poling, G.L., Weisenberger, J.M., Kerwin, T.: The Role of Multisensory Feedback in Haptic Surface Perception. In: haptics of 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS’03), pp. 187–194 (2003)
Reachin API 3.0 programmer’s guide. Reachin Technologies AB, Sweden (1998-2001)
Rock, I., Victor, J.: Vision and touch: An experimentally created conflict between the two senses. Science 143, 594–596 (1964)
Spence, C., Baddeley, R., Zampini, M., James, R., Shore, D.I.: Multisensory temporal order judgments: when two locations better than one. Percept Psychophys. 65, 318–328 (2003)
Stephanidis, C. (ed.): User Interfaces for All-Concepts, Methods and Tools. Lawrence Erlbaum Associates, Mahwah (2001)
Stephanidis, C.: IS4ALL: promoting universal design in healthcare telematics. In: Stephanidis, C. (ed.) Universal Access in HCI: Towards an Information Society for All, vol 3, pp. 50–54. Lawrence Erlbaum Association, London (2001)
Wang, Y., MacKenzie, C.L.: The role of contextual haptic and visual constraints on object manipulation in virtual environments. In: Proc. CHI 2000, The Hague, The Netherlands, pp. 532–539 (2000)
Weisenberger, J.M., Poling, G.L.: Multisensory Roughness Perception of Virtual Surfaces: Effects of Correlated Cues. In: haptics of 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS’04), pp. 161–168 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Hu, W., Lin, T., Sakai, K., Imamiya, A., Omata, M. (2007). Setup Consistent Visual Textures for Haptic Surfaces in a Virtual Reality World. In: Stephanidis, C., Pieper, M. (eds) Universal Access in Ambient Intelligence Environments. Lecture Notes in Computer Science, vol 4397. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71025-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-71025-7_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71024-0
Online ISBN: 978-3-540-71025-7
eBook Packages: Computer ScienceComputer Science (R0)