Abstract
At first glance, making electronic music seems to be a domain which is also well suited for people with limited eye-sight. However, a closer analysis reveals that standard software and hardware are both strongly dominated by graphical output. In order to close this gap for visually impaired musicians, we developed a MIDI (Musical Instrument Digital Interface) sequencer with audio-feedback and a new interaction paradigm which eliminates interaction with the PC’s keyboard and screen. The blind musician relies solely on input via the instrument itself. He can both, record and play music via the claviature’s black & white keys but at the same time control all functions of a multi-track MIDI sequencer without ever taking the hands off the instrument. We also use the MIDI-connection for coding different kinds of feedback to the user in an efficient way. The software which runs on a PC that is connected to an electronic instrument has been evaluated and improved extensively.
Similar content being viewed by others
Notes
Founder of SAP.
Schlossschule Ilvesheim, Germany.
References
Armaly A (2005) Making linux accessible for the visually impaired with speakup. Linux J 140:6ff
Boll S, Henze N, Heuten W (2006) Non-intrusive somatosensory navigation support for blind pedestrians. In: Eurohaptics (EH) 2006
Boll S, Heuten W, Wichmann D (2006) Interactive 3-d sonification for the exploration of city maps. In: NordiCHI ’06, Proceedings of the 4th nordic conference on human–computer interaction: changing roles
Boll S, Henze N, Heuten W (2007) Interactive exploration of city maps with auditory torches. In: Computer/human interaction (CHI) conference 2007
Bourbakis NG, Kavraki D (2001) An intelligent assistant for navigation of visually impaired people. In: Proceedings of the IEEE 2nd international symposium on bioinformatics and bioengineering
Brajnik G, Cancila D, Nicoli D, Pignatelli M (2005) Do text transcoders improve usability for disabled users? In: Proceedings of the 2005 international cross-disciplinary workshop on Web accessibility (W4A). ACM, New York, pp 9–17. doi:10.1145/1061811.1061814
Brewster SA, Wright PC, Edwards ADN (1992) A detailed investigation into the effectiveness of earcons. In: The proceedings of the first international conference on auditory display. Addison-Wesley, Reading, pp 471–498
Cunningham S (2004) Suitability of musicxml as a format for computer music notation and interchange. In: Proceedings of IADIS—international conference on applied computing
Dodd R, Green DS, Pearson DE (2008) The cisna model of accessible adaptive hypermedia. In: W4A ’08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A). ACM, New York, pp 27–36. doi:10.1145/1368044.1368052
Georgaki A, Raptis S, Bakamidis S (2000) A music interface for visually impaired people in the wedelmusic environment. In: International symposium on music information retrieval
Guerin R, Miller M (2009) Cubase 5 Power!: the comprehensive guide. Course Technology PTR
Hamburg H, Thij H, Ionescu A (2005) Improving the quality of life and work of elderly and disabled people by using distance learning and virtual applications. In: 11th international conference on human–computer-interaction
Heller MA (1985) Tactual perception of embossed morse code and braille: the alliance of vision and touch. Perception 14(5):563–570
Issing LJ, Klimsa P (2008) Online-Lernen. R. Oldenbourg, Munich
Limna T, Sae-tang C, Jantaraprim C, Tandayya P, Niyompol W (2007) Linux user interface and front-end operation for the visually impaired. In: Proceedings of the 1st international convention on rehabilitation engineering and assistive technology: in conjunction with 1st Tan Tock Seng Hospital neurorehabilitation meeting
McGookin DK, Brewster SA (2004) Empirically derived guidelines for the presentation of concurrent earcons. In: Proceedings of BCS HCI 2004, pp 65–68
Nelson M, Thom B (2004) A survey of real-time midi performance. In: Proceedings of the 2004 conference on new interfaces for musical expression
Nobels T, Desmet G, den Keybus JV, Belmans R (2006) Development of a portable braille display using a fast prototyping platform for power electronics. In: 3rd IET international conference on power electronics, machines and drives 2006, pp 321–325
Parente P, Clippingdale B (2006) Linux screen reader—extensible assistive technology. In: Proceedings of the 8th international ACM SIGACCESS conference on computers and accessibility
Roberts JW, Slattery OT, Kardos DW (2000) Rotating-wheel braille display for continuous refreshable braille. Journal of the Society for Information Display, vol 31, pp 1–4. ISSN 0000-0966X/00/3001-0000
Selfridge-Field E (1997) Beyond MIDI: the handbook of musical codes. MIT Press, Cambridge
Shepard RN (2006) Stimulus and response generalization: a stochastic model relating generalization to distance in psychological space. Psychometrika 22(4):325–345
Thom B, Nelson M (2004) An in-depth analysis of real-time midi performance. In: Proceedings of 2004 international computer music conference (ICMC 2004)
Velasco CA, Denev D, Stegemann D, Mohamad Y (2008) A Web compliance engineering framework to support the development of accessible rich internet applications. In: W4A ’08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A). ACM, New York, pp 45–49. doi:10.1145/1368044.1368054
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Haenselmann, T., Lemelson, H. & Effelsberg, W. A zero-vision music recording paradigm for visually impaired people. Multimed Tools Appl 60, 589–607 (2012). https://doi.org/10.1007/s11042-011-0832-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0832-z