Skip to main content

Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 7468)

Abstract

In this paper we describe two experiments whose goal is to investigate the role of physics-based auditory and haptic feedback provided at feet level to enhance realism in a virtual environment. To achieve this goal, we designed a multimodal virtual environment where subjects could walk on a platform overlooking a canyon. Subjects were asked to visit the environment wearing an head-mounted display and a custom made pair of sandals enhanced with sensors and actuators. A 12-channels surround sound system delivered a soundscape which was consistent with the visual environment. In the first experiment, passive haptics was provided by having a physical wooden platform present in the laboratory. In the second experiment, no passive haptics was present. In both experiments, subjects reported of having a more realistic experience while auditory and haptic feedback are present. However, measured physiological data and post-experimental presence questionnaire do not show significant differences when audio-haptic feedback is provided.

Keywords

  • Virtual Environment
  • Skin Temperature
  • Visual Feedback
  • Feedback Condition
  • Skin Conductance

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   72.00
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Benbasat, A., Morris, S., Paradiso, J.: A wireless modular sensor architecture and its application in on-shoe gait analysis. In: Proceedings of IEEE Sensors 2003, vol. 2 (2003)

    Google Scholar 

  2. Bruder, G., Steinicke, F., Rothaus, K., Hinrichs, K.: Enhancing presence in head-mounted display environments by visual body feedback using head-mounted cameras. In: 2009 International Conference on CyberWorlds, pp. 43–50. IEEE (2009)

    Google Scholar 

  3. Insko, B.: Passive haptics significantly enhances virtual environments. PhD thesis, Citeseer (2001)

    Google Scholar 

  4. Kohli, L., Burns, E., Miller, D., Fuchs, H.: Combining passive haptics with redirected walking. In: Proceedings of the 2005 International Conference on Augmented Tele-Existence, pp. 253–254. ACM (2005)

    Google Scholar 

  5. Meehan, M., Insko, B., Whitton, M., Brooks Jr., F.: Physiological measures of presence in stressful virtual environments. ACM Transactions on Graphics (TOG) 21, 645–652 (2002)

    CrossRef  Google Scholar 

  6. Nordahl, R., Berrezag, A., Dimitrov, S., Turchet, L., Hayward, V., Serafin, S.: Preliminary experiment combining virtual reality haptic shoes and audio synthesis. Haptics: Generating and Perceiving Tangible Sensations, 123–129 (2010)

    Google Scholar 

  7. Paradiso, J., Hsiao, K., Hu, E.: Interactive music for instrumented dancing shoes. In: Proc. of the 1999 International Computer Music Conference, pp. 453–456 (1999)

    Google Scholar 

  8. Pelah, A., Koenderink, J.J.: Editorial: Walking in real and virtual environments. ACM Transactions on Applied Perception (TAP) 4(1), 1 (2007)

    CrossRef  Google Scholar 

  9. Slater, M., Lotto, B., Arnold, M.M., Sanchez-Vives, M.V.: How we experience immersive virtual environments: the concept of presence and its measurement. Anuario de Psicologia 40(2), 193–210 (2009)

    Google Scholar 

  10. Slater, M., Usoh, M., Steed, A.: Depth of presence in immersive virtual environments. Presence: Teleoperators and Virtual Environments 3(2), 130–144 (1994)

    Google Scholar 

  11. Turchet, L., Nordahl, R., Berrezag, A., Dimitrov, S., Hayward, V., Serafin, S.: Audio-haptic physically based simulation of walking on different grounds. In: Proceedings of IEEE International Workshop on Multimedia Signal Processing, pp. 269–273. IEEE Press (2010)

    Google Scholar 

  12. Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Physically based sound synthesis and control of footsteps sounds. In: Proceedings of Digital Audio Effects Conference, pp. 161–168 (2010)

    Google Scholar 

  13. Usoh, M., Catena, E., Arman, S., Slater, M.: Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments 9(5), 497–503 (2000)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nilsson, N.C., Nordahl, R., Turchet, L., Serafin, S. (2012). Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism. In: Magnusson, C., Szymczak, D., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2012. Lecture Notes in Computer Science, vol 7468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32796-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32796-4_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32795-7

  • Online ISBN: 978-3-642-32796-4

  • eBook Packages: Computer ScienceComputer Science (R0)