Abstract
This paper introduces WAM-Studio, an online Digital Audio Workstation (DAW) for recording, mixing, producing, and playing multitrack music. WAM-Studio advances music development by proposing a web-based environment based on a visual programming paradigm of end-user programming (EUP). In this paper, we describe how users can associate individual tracks with real-time audio processing plugins that can then be customized to produce a desired audio effect. Moreover, we describe how users can visually create macros to control multiple plugin parameters at once. While programming macro controls and customizing track parameters might have many applications in the music industry, they also present an opportunity to afford Hard-of-Hearing users greater control over their music listening. To illustrate the potential of WAM-Studio, we present a case study illustrating how this tool could be used by Hard-of-Hearing users to modify individual musical elements in a multi-track listening context to create a more enjoyable listening experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
See at [3] details about why gear setup is required for every new hardware connected and security constraints prevent hardware discovery.
- 4.
DHH is an expansive term for people with hearing loss or are otherwise aurally diverse, including those who identify as culturally Deaf and may use a signed language as their primary language.
References
NIDCD fact sheet: Cochlear implants. National Institute of Deafness and Other Communication Disorders, March 2021
Buffa, M., Kouyoumdjian, P., Beauchet, Q., Forner, Y., Marynowic, M.: Making a guitar rack plugin -WebAudio Modules 2.0. In: Web Audio Conference 2022, Cannes, France, July 2022. https://hal.inria.fr/hal-03812948
Buffa, M., Vidal-Mazuy, A.: WAM-studio, a digital audio workstation (DAW) for the web. In: The Web Conference 2023 - DevTrack, Austin, Texas, USA (2023)
Burlet, G., Hindle, A.: An empirical study of end-user programmers in the computer music community. In: 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, pp. 292–302 (2015). https://doi.org/10.1109/MSR.2015.34
Hartmann, R., Kral, A.: Central responses to electrical stimulation. In: Zeng, F.G., Popper, A.N., Fay, R.R. (eds.) Cochlear Implants: Auditory Prostheses and Electric Hearing, vol. 20, pp. 213–285. Springer, New York (2004). https://doi.org/10.1007/978-0-387-22585-2_6
Hillerson, T.: In: Programming Sound with Pure Data, p. 196. The Pragmatic Bookshelf (2014)
Hwa, T.P., et al.: Novel web-based music re-engineering software for enhancement of music enjoyment among cochlear implantees. Otol. Neurotol. 42(9), 1347–1354 (2021)
Ko, A.J., et al.: The state of the art in end-user software engineering. ACM Comput. Surv. 43(3) (2011). https://doi.org/10.1145/1922649.1922658
Limb, C.J., Roy, A.T.: Technological, biological, and acoustical constraints to music perception in cochlear implant users. Hear. Res. 308, 13–26 (2014)
Maarefvand, M., Marozeau, J., Blamey, P.J.: A cochlear implant user with exceptional musical hearing ability. Int. J. Audiol. 52(6), 424–432 (2013)
Nash, C.: Manhattan: end-user programming for music. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 221–226. Zenodo, June 2014. https://doi.org/10.5281/zenodo.1178891
Nishino, H.: Cognitive issues in computer music programming. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 499–502. Zenodo, June 2011. https://doi.org/10.5281/zenodo.1178123
Nogueira, W., Nagathil, A., Martin, R.: Making music more accessible for cochlear implant listeners: recent developments. IEEE Signal Process. Mag. 36(1), 115–127 (2018)
Paternò, F., Wulf, V. (eds.): New Perspectives in End-User Development. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60291-2
Sarkar, A.: In: Proceedings of the 27th Annual Conference of the Psychology of Programming Interest Group (PPIG 2016)
Spangmose, S., Hjortkjær, J., Marozeau, J.: Perception of musical tension in cochlear implant listeners. Front. Neurosci. 13, 987 (2019)
Stickland, S., Athauda, R., Scott, N.: A new audio mixing paradigm: evaluation from professional practitioners’ perspectives. Creat. Ind. J., 1–49 (2022)
WorldHealthOrganization: Deafness and hearing loss fact sheet, February 2023. https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss
Zeng, F.G., Tang, Q., Lu, T.: Abnormal pitch perception produced by cochlear implant stimulation. PLoS ONE 9(2), e88662 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Buffa, M., Vidal-Mazuy, A., May, L., Winckler, M. (2023). WAM-Studio: A Web-Based Digital Audio Workstation to Empower Cochlear Implant Users. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-42280-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42279-9
Online ISBN: 978-3-031-42280-5
eBook Packages: Computer ScienceComputer Science (R0)
