Skip to main content

Plucked String Stiffness Affects Loudness Perception

  • Conference paper
Haptic and Audio Interaction Design (HAID 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7989))

Included in the following conference series:

Abstract

A great variety of interactions between senses, and between motor production and senses, have been reported in previous research. In the present study, we tested whether the mechanics of a plucked string affected how the sound it produced was perceived. To test this hypothesis, we simulated the feel of a plucked string using a high fidelity haptic force-feedback device and simultaneously simulated its acoustic emission. This way, we could independently manipulate the two sensory inputs — how it felt and how it sounded — together with physical correct haptic interaction and with accurate synchronization. This arrangement makes it very plausible that the two sensory inputs came from a common source. We used a two-interval forced-choice discrimination procedure to determine the point of subjective equality of the loudness between a stiff and a soft plucked string. When the stiffness of the string was low, the sound was perceived to be softer. Interestingly, this effect was found only when the first string was less stiff than the second string plucked during a comparison. The results are consistent with the inverse effectiveness principle of multisensory integration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Repp, B.H.: Effects of auditory feedback deprivation on expressive piano performance. Music Perception 16, 409–438 (1999)

    Article  Google Scholar 

  2. Pfordresher, P.Q., Palmer, C.: Effects of hearing the past, present, or future during music performance. Perception and Psychophysics 68, 362–376 (2006)

    Article  Google Scholar 

  3. Drake, C., Penel, A., Bigand, E.: Tapping in time with mechanically and expressively performed music. Music Perception 18, 1–23 (2000)

    Article  Google Scholar 

  4. Goebl, W., Palmer, C.: Tactile feedback and timing accuracy in piano performance. Experimental Brain Research 186, 471–479 (2008)

    Article  Google Scholar 

  5. Palmer, C., Koopmans, E., Loehr, J.D., Carter, C.: Movement-related feedback and temporal accuracy in clarinet performance. Music Perception 26, 439–449 (2009)

    Article  Google Scholar 

  6. Avanzini, F., Crosato, P.: Haptic-auditory rendering and perception of contact stiffness. In: McGookin, D., Brewster, S. (eds.) HAID 2006. LNCS, vol. 4129, pp. 24–35. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Soto-Faraco, S., Deco, G.: Multisensory contributions to the perception of vibrotactile events. Behavioural Brain Research 196, 145–154 (2009)

    Article  Google Scholar 

  8. Guest, S., Catmur, C., Lloyd, D., Spence, C.: Audiotactile interactions in roughness perception. Experimental Brain Research 146(2), 161–171 (2002)

    Article  Google Scholar 

  9. Fletcher, H., Blackham, E.D., Stratton, R.: Quality of piano tones. J. Acoust. Soc. Am. 34(6), 749–761 (1962)

    Article  Google Scholar 

  10. Järvelälinen, H., Välimäki, V., Karjalainen, M.: Audibility of inharmonicity in string instrument sounds, and implications to digital sound synthesis. In: Proc. Int. Computer Music Conf., Beijing, China, pp. 359–362 (1999)

    Google Scholar 

  11. Marshall, M., Wanderley, M.: Vibrotactile feedback in digital musical instruments, Internat. In: Conference on New Interfaces for Musical Expression (NIME 2006), pp. 226–229 (2006)

    Google Scholar 

  12. Kinoshita, H., Furuya, S., Aoki, T., Altenmüller, E.: Loudness control in pianists as exemplified in keystroke force measurements on different touches. Journal of Acoustical Society of America 121, 2959–2969 (2007)

    Article  Google Scholar 

  13. Okazaki, R., Kajimoto, H., Hayward, V.: Vibrotactile Stimulation Can Affect Auditory Loudness: A Pilot Study. In: Isokoski, P., Springare, J. (eds.) EuroHaptics 2012, Part II. LNCS, vol. 7283, pp. 103–108. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  14. Merchel, S., Leppin, A., Altinsoy, E.: Hearing with your body: the influence of whole-body vibrations on loudness perception. In: Proceedings of the Sixteenth International Congress on Sound and Vibration (ICSV16), Kraków, Poland, July 5-9 (2009)

    Google Scholar 

  15. Gillmeister, H., Eimer, M.: Tactile enhancement of auditory detection and perceived loudness. Brain Research 1160, 58–68 (2007)

    Article  Google Scholar 

  16. Schürmann, M., Caetano, G., Jousmäki, V., Hari, R.: Hands help hearing: facilitatory audiotactile interaction at low sound-intensity levels. J. Acoust. Soc. Am. 115(2), 830–832 (2004)

    Article  Google Scholar 

  17. Frissen, I., Ziat, M., Campion, G., Hayward, V., Guastavino, C.: The effects of voluntary movements on auditory-haptic and haptic-haptic temporal order judgments. Acta Psychologica 141, 140–148 (2012)

    Article  Google Scholar 

  18. Vitello, M.P., Ernst, M.O., Fritschi, M.: An instance of tactile suppression: Active exploration impairs tactile sensitivity for the direction of lateral movement. In: Proceeding of Eurohaptics, Paris, July 3-6, pp. 351–355 (2006)

    Google Scholar 

  19. Kitagawa, N., Kato, M., Kashino, M.: Assessing the effect of voluntary action on sensitivity to temporal asynchrony between auditory and somatosensory events. In: 10th International Multisensory Research Forum (IMRF), New York, June 29 - July 2 (2009)

    Google Scholar 

  20. Campion, G., Wang, Q., Hayward, V.: The Pantograph mk-II: A haptic instrument. In: Proceedings of the Internat. Conf. on Intelligent Robots and Systems 2005, pp. 723–728 (2005)

    Google Scholar 

  21. Karplus, K., Strong, A.: Digital Synthesis of Plucked String and Drum Timbres. Computer Music Journal 7(2), 43–55 (1983)

    Article  Google Scholar 

  22. Wichmann, F.A., Hill, N.J.: The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & Psychophysics 63, 1293–1313 (2001)

    Article  Google Scholar 

  23. Fox, J., Weisberg, S., An, R.: An R companion to applied regression, 2nd edn. Sage Publications, Thousand Oaks (2011)

    Google Scholar 

  24. Stein, B.E., Meredith, M.A.: The merging of the senses. MIT Press, Cambridge (1993)

    Google Scholar 

  25. Coren, S., Ward, L.M., Enns, J.T.: Sensation and perception. Harcourt Brace, Fort Worth (1999)

    Google Scholar 

  26. Odgaard, E.C., Arieh, Y., Marks, L.E.: Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias. Perception & Psychophysics 65(1), 123–132 (2003)

    Article  Google Scholar 

  27. Hairston, I.S., Nagarajan, S.S.: Neural mechanisms of the time-order error: An MEG study. Journal of Cognitive Neuroscience 19, 1163–1174 (2007)

    Article  Google Scholar 

  28. Zatorre, R.J., Chen, J.L., Penhune, V.B.: When the brain plays music: auditory-motor interactions in music perception and production. Nat. Rev. Neuroscience, 547–558 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ziat, M., Frissen, I., Campion, G., Hayward, V., Guastavino, C. (2013). Plucked String Stiffness Affects Loudness Perception. In: Oakley, I., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2013. Lecture Notes in Computer Science, vol 7989. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41068-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-41068-0_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-41067-3

  • Online ISBN: 978-3-642-41068-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics