Advertisement

Scaffolding the Music Listening and Music Making Experience for the Deaf

Chapter
First Online:
Part of the Cognitive Science and Technology book series (CSAT)

Abstract

Music is an important part of our daily life. We listen to the radio, enjoy concerts or make music.

This is a preview of subscription content, log in to check access.

References

  1. 1.
    Birnbaum DM, Wanderley MM (2007) A systematic approach to musical vibrotactile feedback. In: Proceedings of the international computer music conference (ICMC), pp 397–404Google Scholar
  2. 2.
    Branje C, Fels DI (2014) Playing vibrotactile music: a comparison between the vibrochord and a piano keyboard. Int J Hum Comput Stud 72(4):431–439. http://doi.org/10.1016/j.ijhcs.2014.01.003
  3. 3.
    Branje C, Maksimouski M, Karam M, Fels DI, Russo F (2010) Vibrotactile display of music on the human back. In: Proceedings of the 2010 third international conference on advances in computer-human interactions. IEEE Computer Society, pp 154–159. http://doi.org/10.1109/ACHI.2010.40
  4. 4.
    Chasin M (2003) Music and hearing aids. Hear J 56(7):36. http://doi.org/10.1097/01.HJ.0000292553.60032.c2
  5. 5.
    Cholewiak RW, McGrath C (2006) Vibrotactile targeting in multimodal systems: accuracy and interaction. In: 2006 14th symposium on haptic interfaces for virtual environment and teleoperator systems. IEEE, pp 413–420Google Scholar
  6. 6.
    Cook AM, Polgar JM (2014) Assistive technologies: principles and practice. Elsevier Health SciencesGoogle Scholar
  7. 7.
    Csikszentmihalyi M (2000) Beyond boredom and anxiety. Jossey-Bass, San Francisco, CA, USGoogle Scholar
  8. 8.
    Darrow A-A (1993) The role of music in deaf culture: implications for music educators. J Res Music Educ 41(2):93–110. http://doi.org/10.2307/3345402
  9. 9.
    Drennan WR, Rubinstein JT (2008) Music perception in cochlear implant users and its relationship with psychophysical capabilities. J Rehabil Res Dev 45(5):779–789CrossRefGoogle Scholar
  10. 10.
    Ferguson S, Moere AV, Cabrera D (2005) Seeing sound: real-time sound visualisation in visual feedback loops used for training musicians. In: Ninth international conference on information visualisation, 2005. Proceedings, pp 97–102. http://doi.org/10.1109/IV.2005.114
  11. 11.
    Fourney D (2012) Can computer representations of music enhance enjoyment for individuals who are hard of hearing? In: Miesenberger K, Karshmer A, Penaz P, Zagler W (eds) Computers helping people with special needs. Springer, Berlin, pp 535–542. http://doi.org/10.1007/978-3-642-31522-0_80. Accessed 9 Feb 2015
  12. 12.
    Fourney DW, Fels DI (2009) Creating access to music through visualization. In: Science and technology for humanity (TIC-STH), 2009 IEEE Toronto international conference, pp 939–944. http://doi.org/10.1109/TIC-STH.2009.5444364
  13. 13.
    Galvin JJ, Q-J Fu, Shannon Robert V (2009) Melodic contour identification and music perception by cochlear implant users. Ann NY Acad Sci 1169(1):518–533. http://doi.org/10.1111/j.1749-6632.2009.04551.x
  14. 14.
    Gault RH (1926) Touch as a substitute for hearing in the interpretation and control of speech. Arch Otolaryngol Head Neck Surg 3(2):121Google Scholar
  15. 15.
    Glennie E (1993) Hearing essay. http://www.evelyn.co.uk/literature.html. Accessed 12 Oct 2014
  16. 16.
    Glennie E (2003) How to truly listen. http://www.ted.com/talks/evelyn_glennie_shows_how_to_listen?language=en. Accessed 4 Dec 2014
  17. 17.
    Goldstein E (2009) Sensation and perception. Cengage LearningGoogle Scholar
  18. 18.
    Hagedorn VS (1992) Musical learning for hearing impaired children. Research perspectives in music education. http://eric.ed.gov/?id=ED375031. Accessed 16 Feb 2015
  19. 19.
    Hash PM (2003) Teaching instrumental music to deaf and hard of hearing students. Res Issues Music Educ 1(1). http://eric.ed.gov/?id=EJ852403. Accessed 16 Feb 2015
  20. 20.
    Ho-Ching FWL, Mankoff J, Landay JA (2003) Can you see what i hear?: The design and evaluation of a peripheral sound display for the deaf. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 161–168. http://doi.org/10.1145/642611.642641
  21. 21.
    Huang K, Starner T, Do E, et al (2010) Mobile music touch: mobile tactile stimulation for passive learning. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 791–800. http://doi.org/10.1145/1753326.1753443
  22. 22.
    Isaacson EJ (2005) What you see is what you get: on visualizing music. In: ISMIR. Citeseer, pp 389–395Google Scholar
  23. 23.
    Jackson SA, Marsh HW, et al (1996) Development and validation of a scale to measure optimal experience: the flow state scale. J. Sport Exerc Psychol 18:17–35Google Scholar
  24. 24.
    Jain D, Findlater L, Gilkeson J, et al (2015) Head-mounted display visualizations to support sound awareness for the deaf and hard of hearing. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 241–250. http://doi.org/10.1145/2702123.2702393
  25. 25.
    Karam M, Branje C, Nespoli G, Thompson N, Russo FA, Fels DI (2010) The emoti-chair: an interactive tactile music exhibit. In: CHI ’10 extended abstracts on human factors in computing systems. ACM, pp 3069–3074. http://doi.org/10.1145/1753846.1753919
  26. 26.
    Karam M, Nespoli G, Russo F, Fels DI (2009) Modelling perceptual elements of music in a vibrotactile display for deaf users: a field study. In: Second international conferences on advances in computer-human interactions, 2009. ACHI ’09, pp 249–254. http://doi.org/10.1109/ACHI.2009.64
  27. 27.
    Karam M, Russo F, Branje C, Price E, Fels DI (2008) Towards a model human cochlea: sensory substitution for crossmodal audio-tactile displays. In: Proceedings of graphics interface 2008. Canadian Information Processing Society, pp 267–274. http://dl.acm.org/citation.cfm?id=1375714.1375759. Accessed 5 Feb 2015
  28. 28.
    Karam M, Russo FA, Fels DI (2009) Designing the model human cochlea: an ambient crossmodal audio-tactile display. IEEE Trans Haptics 2(3):160–169. http://doi.org/10.1109/TOH.2009.32
  29. 29.
    Kayser C, Petkov CI, Augath M, Logothetis NK (2005) Integration of touch and sound in auditory cortex. Neuron 48(2):373–384. http://doi.org/10.1016/j.neuron.2005.09.018
  30. 30.
    Kim J, Ananthanarayan S, Yeh T (2015) Seen music: ambient music data visualization for children with hearing impairments. In: Proceedings of the 14th international conference on interaction design and children. ACM, pp 426–429. http://doi.org/10.1145/2771839.2771870
  31. 31.
    La Versa B, Peruzzi I, Diamanti L, Zemolin M (2014) MUVIB: music and vibration. In: Proceedings of the 2014 ACM international symposium on wearable computers: adjunct program. ACM, pp 65–70. http://doi.org/10.1145/2641248.2641267
  32. 32.
    Levy-Tzedek S, Hanassy S, Abboud S, Maidenbaum S, Amedi A (2012) Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. Restorative Neurol Neurosci 30(4):313–323Google Scholar
  33. 33.
    Limb C (2011) Building the musical muscle. http://www.ted.com/talks/charles_limb_building_the_musical_muscle. Accessed 22 Nov 2014
  34. 34.
    Machover T (2008). Tod Machover + Dan Ellsey: Inventing instruments that unlock new music. http://www.ted.com/talks/tod_machover_and_dan_ellsey_play_new_music?language=en. Accessed 22 Nov 2014
  35. 35.
    Mahns DA, Perkins NM, Sahai V, Robinson L, Rowe MJ (2006) Vibrotactile frequency discrimination in human hairy skin. J Neurophysiol 95(3):1442–1450CrossRefGoogle Scholar
  36. 36.
    Marshall MT, Wanderley MM (2006) Vibrotactile feedback in digital musical instruments. In: Proceedings of the 2006 conference on new interfaces for musical expression. IRCAM—Centre Pompidou, pp 226–229. http://dl.acm.org/citation.cfm?id=1142215.1142272. Accessed 12 Aug 2015
  37. 37.
    Matthews T, Fong J, Mankoff J (2005) Visualizing non-speech sounds for the deaf. In: Proceedings of the 7th international ACM SIGACCESS conference on computers and accessibility. ACM, pp 52–59. http://doi.org/10.1145/1090785.1090797
  38. 38.
    May E (1961) Music for deaf children. Music Educ J 47(3):39–42. http://doi.org/10.2307/3389102
  39. 39.
    McCarthy Music’s Illuminating Piano (2015) McCarthy music’s illuminating piano: learn to play the piano with McCarthy music. https://www.mccarthypiano.com. Accessed 13 Sep 2015
  40. 40.
    McCord K, Fitzgerald M (2006) Children with disabilities playing musical instruments. Music Educ J 46–52Google Scholar
  41. 41.
    Mitroo JB, Herman N, Badler NI (1979) Movies from music: visualizing musical compositions. In: Proceedings of the 6th annual conference on computer graphics and interactive techniques. ACM, pp 218–225. http://doi.org/10.1145/800249.807447
  42. 42.
    Mori J, Fels DI (2009) Seeing the music can animated lyrics provide access to the emotional content in music for people who are deaf or hard of hearing? In: Science and technology for humanity (TIC-STH), 2009 IEEE Toronto international conference, pp 951–956. http://doi.org/10.1109/TIC-STH.2009.5444362
  43. 43.
    Music animation machine (2016) Music worth watching. http://www.musanim.com/. Accessed 19 March 2016
  44. 44.
    Music and the deaf (2015) Enriching lives through music. http://matd.org.uk/. Accessed 1 May 2015
  45. 45.
    Myles K, Binseel MS (2007) The tactile modality: a review of tactile sensitivity and human tactile interfaces. DTIC DocumentGoogle Scholar
  46. 46.
    Nanayakkara S, Taylor E, Wyse L, Ong SH (2009) An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 337–346. http://doi.org/10.1145/1518701.1518756
  47. 47.
    Novich SD, Eagleman DM (2015) Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput. Exp Brain Res 1–12. http://doi.org/10.1007/s00221-015-4346-1
  48. 48.
    Palmer R (1997). Feeling the music philosophy: a new approach in understanding how people with sensory impairment perceive and interpret music. http://www.russpalmer.com/feeling.html
  49. 49.
    Palmer R (2015) Music floors. http://www.russpalmer.com/music.html. Accessed 10 May 2015
  50. 50.
    Palmer R (2016) Tac-tile sound system. http://www.russpalmer.com/tactile.html. Accessed 20 March 2016
  51. 51.
    Petry B, Illandara T, Nanayakkara S (2016) MuSS-bits:sensor-display blocks for deaf people to explore musical sounds. In proceedings of the 28th Australian conference on computer-human interaction (OzCHI ’16), 72–80. https://doi.org/10.1145/3010915.3010939
  52. 52.
    Pouris M, Fels DI (2012) Creating an entertaining and informative music visualization. In: Miesenberger K, Karshmer A, Penaz P, Zagler W (eds) Computers helping people with special needs. Springer, Berlin, pp 451–458. http://doi.org/10.1007/978-3-642-31522-0_68. Accessed 26 Oct 2015
  53. 53.
    Rashid R, Aitken J, Fels DI (2006) Expressing emotions using animated text captions. In: Miesenberger K, Klaus J, Zagler WL, Karshmer AI (eds) Computers helping people with special needs. Springer, Berlin, pp 24–31. http://doi.org/10.1007/11788713_5. Accessed 15 March 2016
  54. 54.
    Reed CM, Doherty MJ, Braida LD, Durlach NI (1982) Analytic study of the tadoma method further experiments with inexperienced observers. J Speech Lang Hear Res 25(2):216–223CrossRefGoogle Scholar
  55. 55.
    Roebuck J (2007) I am a deaf opera singer. The Guardian. http://www.theguardian.com/theguardian/2007/sep/29/weekend7.weekend2. Accessed 26 Aug 2015
  56. 56.
    Schlaug G (2015) Musicians and music making as a model for the study of brain plasticity. In: Finger S, Boller F, Altenmüller E (eds) Progress in brain research. Elsevier, pp 37–55. http://www.sciencedirect.com/science/article/pii/S0079612314000211. Accessed 29 July 2015
  57. 57.
    Shibata D (2001) Brains of deaf people “hear” music. Int Arts-Med Assoc Newslett 16:4Google Scholar
  58. 58.
    Shinohara K, Tenenberg J (2009) A blind person’s interactions with technology. Commun ACM 52(8):58–66. http://doi.org/10.1145/1536616.1536636
  59. 59.
    Stumpf C (1883) Tonpsychologie. Leipzig: Hirzel 1Google Scholar
  60. 60.
    Tan HZ, Robert Gray J, Young J, Traylor Ryan (2003) A haptic back display for attentional and directional cueing. Haptics-e 3(1):1–20Google Scholar
  61. 61.
    Verillo RT (1991) Vibration sensing in humans. Music Percept 9(3):281–302Google Scholar
  62. 62.
    Vy QV, Mori JA, Fourney DW, Fels DI (2008) EnACT: a software tool for creating animated text captions. In: Miesenberger K, Klaus J, Zagler W, Karshmer A (eds) Computers helping people with special needs. Springer, Berlin, pp 609–616. http://doi.org/10.1007/978-3-540-70540-6_87. Accessed 15 March 2016
  63. 63.
    WHO (2015) Deafness and hearing loss. WHO. http://www.who.int/mediacentre/factsheets/fs300/en/. Accessed 6 Aug 2015
  64. 64.
    Wyse L, Nanayakkara S, Seekings P, Ong SH, Taylor E (2012) Perception of vibrotactile stimuli above 1 kHz by the hearingimpaired. In: NIME’12Google Scholar
  65. 65.
    Yang H-J, Lay Y-L, Liou Y-C, Tsao W-Y, Lin C-K (2007) Development and evaluation of computer-aided music-learning system for the hearing impaired. J Comput Assist Learn 23(6):466–476. http://doi.org/10.1111/j.1365-2729.2007.00229.x
  66. 66.
    Zatorre RJ, Chen JL, Penhune VB (2007) When the brain plays music: auditory–motor interactions in music perception and production. Nat Rev Neurosci 8(7):547–558. http://doi.org/10.1038/nrn2152
  67. 67.
    Zhou Y, Sim KC, Tan P, Wang Y (2012) MOGAT: mobile games with auditory training for children with cochlear implants. In: Proceedings of the 20th ACM international conference on multimedia. ACM, pp 429–438. http://doi.org/10.1145/2393347.2393409

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Augmented Human LabSingapore University of Technology and DesignSingaporeSingapore
  2. 2.SynapticsZugSwitzerland

Personalised recommendations

Cite chapter

Buy options