Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Computer Music Multidisciplinary Research

CMMR 2017: Music Technology with Swing pp 387–401Cite as

Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable Friction

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11265))

Abstract

In the recent years, a great interest has emerged to utilize tactile interfaces for musical interactions. These interfaces can be enhanced with tactile feedback on the user’s fingertip through various technologies, including programmable friction techniques. In this study, we use a qualitative approach to investigate the potential influence of these tactile feedback interfaces on user’s musical interaction. We have experimented three different mappings between the sound parameters and the tactile feedback in order to study the users’ experiences of a given task. Our preliminary findings suggest that friction-based tactile feedback is a useful tool to enrich musical interactions and learning.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Amberg, M., Giraud, F., Semail, B., Olivo, P., Casiez, G., Roussel, N.: STIMTAC: a tactile input device with programmable friction. In: UIST 2011 Adjunct Proceedings of the 24th Annual ACM Symposium Adjunct on User Interface Software and Technology, pp. 7–8. ACM (2011)

    Google Scholar 

  2. Baillie, L., Beattie, D., Morton, L.: Feel what you hear: haptic feedback as an accompaniment to mobile music playback. In: Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications, IwS 2011, pp. 1–6. ACM (2011)

    Google Scholar 

  3. Barbosa, J., Malloch, J., Wanderley, M.M., Huot, S.: What does “Evaluation” mean for the NIME community? In: 15th International Conference on New Interfaces for Musical Expression, NIME 2015, pp. 156–161. Louisiana State University, Baton Rouge, United States, May 2015

    Google Scholar 

  4. Bau, O., Poupyrev, I., Israr, A., Harrison, C.: TeslaTouch: electrovibration for touch surfaces. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 283–292. ACM (2010)

    Google Scholar 

  5. Birnbaum, D.M., Wanderley, M.M.: A systematic approach to musical vibrotactile feedback. In: Proceedings of International Computer Music Conference (ICMC 2007), pp. 397–404 (2007)

    Google Scholar 

  6. Buxton, W., Hill, R., Rowley, P.: Issues and techniques in touch sensitive tablet input. In: Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1985, pp. 215–224. ACM (1985)

    Google Scholar 

  7. Casiez, G., Roussel, N., Vanbelleghem, R., Giraud, F.: Surfpad: riding towards targets on a squeeze film effect. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 2491–2500. ACM (2011)

    Google Scholar 

  8. Chafe, C.: Tactile audio feedback. In: Proceedings of International Computer Music Conference (ICMC 1993), pp. 76–79 (1993)

    Google Scholar 

  9. Chang, A., O’Sullivan, C.: Audio-haptic feedback in mobile phones. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2005, pp. 1264–1267. ACM (2005)

    Google Scholar 

  10. Choi, S., Kuchenbecker, K.J.: Vibrotactile display: perception, technology, and applications. Proc. IEEE 101(9), 2093–2104 (2013)

    Article  Google Scholar 

  11. Chowning, J., Bristow, D.: Fm Theory and Applications: By Musicians for Musicians. Hal Leonard Corp, New York (1987)

    Google Scholar 

  12. Chu, L.L.: Haptic feedback in computer music performance. In: Proceedings of International Computer Music Conference (ICMC 1996), pp. 57–58 (1996)

    Google Scholar 

  13. Doornbusch, P.: A brief survey of mapping in algorithmic composition. In: Proceedings of International Computer Music Conference (ICMC 2002) (2002)

    Google Scholar 

  14. Ghamsari, M., Pras, A., Wanderley, M.: Combining musical tasks and improvisation in evaluating novel digital musical instruments. In: Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research, CMMR 2013. Springer (2013)

    Google Scholar 

  15. Giraud, F., Amberg, M., Lemaire-Semail, B., Casiez, G.: Design of a transparent tactile stimulator. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 485–489, March 2012

    Google Scholar 

  16. Huang, J., Gamble, D., Sarnlertsophon, K., Wang, X., Hsiao, S.: Feeling music: integration of auditory and tactile inputs in musical meter perception. PLOS ONE 7(10), 1–11 (2012)

    Article  Google Scholar 

  17. Beamish, T., van de Doel, K., MacLean, K., Fels, S.: D’groove: a haptic turntable for digital audio control. In: Proceedings of the International Conference on Auditory Display (ICAD 2003), July 2003

    Google Scholar 

  18. Kalantari, F., Grisoni, L., Giraud, F., Rekik, Y.: Finding the minimum perceivable size of a tactile element on an ultrasonic based haptic tablet. In: Proceedings of the 2016 ACM on Interactive Surfaces and Spaces, pp. 379–384. ISS 2016. ACM (2016)

    Google Scholar 

  19. Levesque, V., et al.: Enhancing physicality in touch interaction with programmable friction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 2481–2490. ACM (2011)

    Google Scholar 

  20. Lim, J.M., Lee, J.U., Kyung, K.U., Ryou, J.C.: An audio-haptic feedbacks for enhancing user experience in mobile devices. In: 2013 IEEE International Conference on Consumer Electronics (ICCE 2013), pp. 49–50, January 2013

    Google Scholar 

  21. Linjama, J., Makinen, V.: E-sense screen: novel haptic display with capacitive electrosensory interface. In: International Workshop on Haptic and Audio Interaction Design (HAID 2009). Springer (2009)

    Google Scholar 

  22. MacLean, K.E.: Haptic interaction design for everyday interfaces. Rev. Hum. Factors Ergon. 4(1), 149–194 (2008)

    Article  Google Scholar 

  23. Menelas, B., Picinalli, L., Katz, B.F.G., Bourdot, P.: Audio haptic feedbacks for an acquisition task in a multi-target context. In: 2010 IEEE Symposium on 3D User Interfaces (3DUI), pp. 51–54, March 2010

    Google Scholar 

  24. Metatla, O., Martin, F., Parkinson, A., Bryan-Kinns, N., Stockman, T., Tanaka, A.: Audio-haptic interfaces for digital audio workstations. J. Multimodal User Interfaces 10(3), 247–258 (2016)

    Article  Google Scholar 

  25. O’Modhrain, S., Essl, G.: PebbleBox and CrumbleBag: tactile interfaces for granular synthesis. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2004, pp. 74–79. National University of Singapore (2004)

    Google Scholar 

  26. Papetti, S., Schiesser, S., Fröhlich, M.: Multi-point vibrotactile feedback for an expressive musical interface. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME (2015)

    Google Scholar 

  27. Sanganeria, M., Werner, K.: GrainProc: a real-time granular synthesis interface for live performance. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2013, pp. 223–226 (2013)

    Google Scholar 

  28. Serafin, S., Young, D.: Toward a generalized friction controller: from the bowed string to unusual musical instruments. In: Proceedings of International Conference on New Interfaces for Musical Expression (NIME 2004), pp. 181–191. Springer (2004)

    Google Scholar 

  29. Shultz, C.D., Peshkin, M.A., Colgate, J.E.: Surface haptics via electroadhesion: expanding electrovibration with Johnsen and Rahbek. In: 2015 IEEE World Haptics Conference (WHC), pp. 57–62, June 2015

    Google Scholar 

  30. Tanaka, A., Parkinson, A.: Haptic wave: a cross-modal interface for visually impaired audio producers. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 2150–2161. ACM (2016)

    Google Scholar 

  31. Vezzoli, E., Sednaoui, T., Amberg, M., Giraud, F., Lemaire-Semail, B.: Texture rendering strategies with a high fidelity - capacitive visual-haptic friction control device. In: Bello, F., Kajimoto, H., Visell, Y. (eds.) EuroHaptics 2016. LNCS, vol. 9774, pp. 251–260. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42321-0_23

    Chapter  Google Scholar 

  32. Winfield, L., Glassmire, J., Colgate, J.E., Peshkin, M.: T-PaD: tactile pattern display through variable friction reduction. In: Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC 2007), pp. 421–426, March 2007

    Google Scholar 

  33. Zhang, Y., Harrison, C.: Quantifying the targeting performance benefit of electrostatic haptic feedback on touchscreens. In: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, ITS 2015, pp. 43–46. ACM (2015)

    Google Scholar 

Download references

Acknowledgments

The authors would like to appreciate Babak Rabbanipour for his useful help in our study. This work is partially funded by European ERDF grants (IRCICA, CPER MAUVE) and ANR funding agency (equipex IRDIVE).

Author information

Authors and Affiliations

  1. University of Lille - Science and Technology, CNRS, Lille, France

    Farzan Kalantari, Florent Berthaut & Laurent Grisoni

Authors
  1. Farzan Kalantari
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Florent Berthaut
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Laurent Grisoni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Farzan Kalantari .

Editor information

Editors and Affiliations

  1. Laboratoire PRISM, AMU-CNRS, Marseille, France

    Mitsuko Aramaki

  2. INESC TEC, Porto, Portugal

    Matthew E. P. Davies

  3. Laboratoire PRISM, AMU-CNRS, Marseille, France

    Richard Kronland-Martinet

  4. Laboratoire PRISM, AMU-CNRS, Marseille, France

    Sølvi Ystad

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kalantari, F., Berthaut, F., Grisoni, L. (2018). Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable Friction. In: Aramaki, M., Davies , M., Kronland-Martinet, R., Ystad, S. (eds) Music Technology with Swing. CMMR 2017. Lecture Notes in Computer Science(), vol 11265. Springer, Cham. https://doi.org/10.1007/978-3-030-01692-0_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-01692-0_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-01691-3

  • Online ISBN: 978-3-030-01692-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation