An Investigation on Temporal Aspects in the Audio-Haptic Simulation of Footsteps

  • Luca Turchet
  • Stefania Serafin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6789)


In this paper, we present an experiment whose goal is to assess the role of temporal aspects in sonically and haptically simulating the act of walking on a bump or a hole. In particular, we investigated whether the timing between heel and toe and the timing between footsteps affected perception of walking on unflat surfaces. Results show that it is possible to sonically and haptically simulate a bump or a hole only by varying temporal information.


Footstep sounds physical models auditory feedback haptic feedback 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cook, P.: Physically Informed Sonic Modeling (PhISM): Synthesis of Percussive Sounds. Computer Music Journal 21(3), 38–49 (1997)CrossRefGoogle Scholar
  2. 2.
    Cook, P.: Modeling Bill’s Gait: Analysis and Parametric Synthesis of Walking Sounds. In: Proceedings of the AES 22nd International Conference on Virtual, Synthetic, and Entertainment Audio, pp. 73–78 (2002)Google Scholar
  3. 3.
    Farnell, A.: Marching onwards: procedural synthetic footsteps for video games and animation. In: Proceedings of the Pure Data Convention (2007)Google Scholar
  4. 4.
    Fontana, F., Bresin, R.: Physics-based sound synthesis and control: crushing, walking and running by crumpling sounds. In: Proc. Colloquium on Musical Informatics, pp. 109–114 (2003)Google Scholar
  5. 5.
    Hollerbach, J., Checcacci, D., Noma, H., Yanagida, Y., Tetsutani, N.: Simulating side slopes on locomotion interfaces using torso forces. In: Haptic Symposium, Citeseer, pp. 91–98 (2003)Google Scholar
  6. 6.
    Hollerbach, J., Mills, R., Tristano, D., Christensen, R., Thompson, W., Xu, Y.: Torso force feedback realistically simulates slope on treadmill-style locomotion interfaces. The International Journal of Robotics Research 20(12), 939 (2001)CrossRefGoogle Scholar
  7. 7.
    Hunt, K.H., Crossley, F.R.E.: Coefficient of restitution interpreted as damping in vibroimpact. ASME Journal of Applied Mechanics 42(2), 440–445 (1975)CrossRefGoogle Scholar
  8. 8.
    Iwata, H., Yano, H., Nakaizumi, F.: Gait master: A versatile locomotion interface for uneven virtual terrain. vr, page 131(2001)Google Scholar
  9. 9.
    Lécuyer, A., Burkhardt, J., Etienne, L.: Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, page 246. ACM, New York (2004)Google Scholar
  10. 10.
    Marchal, M., Lecuyer, A., Cirio, G., Bonnet, L., Emily, M.: Walking Up and Down in Immersive Virtual Worlds: Novel Interactive Techniques Based on Visual Feedback. In: Proceedings of IEEE Symposium on 3D User Interface (2010)Google Scholar
  11. 11.
    Miner, N., Caudell, T.: Using wavelets to synthesize stochastic-based sounds for immersive virtual environments. ACM Transactions on Applied Perception 2(4), 521–528 (2005)CrossRefGoogle Scholar
  12. 12.
    Nordahl, R., Serafin, S., Turchet, L.: Sound synthesis and evaluation of interactive footsteps for virtual reality applications. In: Proc. IEEE VR (2010)Google Scholar
  13. 13.
    Serafin, S., Turchet, L., Nordahl, R., Dimitrov, S., Berrezag, A., Hayward, V.: Identification of virtual grounds using virtual reality haptic shoes and sound synthesis. In: Proc. Eurohaptics Symposium on Haptics and Audio-visual Environments (2010)Google Scholar
  14. 14.
    Serafin, S., Turchet, L., Nordahl, R.: Extraction of ground reaction forces for real-time synthesis of walking sounds. In: Proc. Audiomostly (2009)Google Scholar
  15. 15.
    Serafin, S., Turchet, L., Nordahl, R.: Do You Hear A Bump Or A Hole? An Experiment on Temporal Aspects in the Recognition of Footsteps Sounds (2010)Google Scholar
  16. 16.
    Turchet, L., Marchal, M., Lécuyer, A., Nordahl, R., Serafin, S.: Influence of auditory and visual feedback for perceiving walking over bumps and holes in desktop VR. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, pp. 139–142. ACM, New York (2010)CrossRefGoogle Scholar
  17. 17.
    Turchet, L., Nordahl, R., Berrezag, A., Dimitrov, S., Hayward, V., Serafin, S.: Audio-haptic physically based simulation of walking sounds. In: Proc. of IEEE International Workshop on Multimedia Signal Processing (2010)Google Scholar
  18. 18.
    Turchet, L., Nordahl, R., Serafin, S.: Examining the role of context in the recognition of walking sound. In: Proc. of Sound and Music Computing Conference (2010)Google Scholar
  19. 19.
    Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Conflictual audio-haptic feedback in physically based simulation of walking sounds. In: Proc. of Haptic Audio Interaction Design Conference (2010)Google Scholar
  20. 20.
    Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Physically based sound synthesis and control of footsteps sounds. In: Proceedings of Digital Audio Effects Conference (2010)Google Scholar
  21. 21.
    Welch, R., Warren, D.: Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88(3), 638 (1980)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Luca Turchet
    • 1
  • Stefania Serafin
    • 1
  1. 1.Department of Architecture, Design and Media TechnologyAalborg University CopenhagenDenmark

Personalised recommendations