Multimedia Tools and Applications

, Volume 60, Issue 3, pp 589–607 | Cite as

A zero-vision music recording paradigm for visually impaired people

  • Thomas HaenselmannEmail author
  • Hendrik Lemelson
  • Wolfgang Effelsberg


At first glance, making electronic music seems to be a domain which is also well suited for people with limited eye-sight. However, a closer analysis reveals that standard software and hardware are both strongly dominated by graphical output. In order to close this gap for visually impaired musicians, we developed a MIDI (Musical Instrument Digital Interface) sequencer with audio-feedback and a new interaction paradigm which eliminates interaction with the PC’s keyboard and screen. The blind musician relies solely on input via the instrument itself. He can both, record and play music via the claviature’s black & white keys but at the same time control all functions of a multi-track MIDI sequencer without ever taking the hands off the instrument. We also use the MIDI-connection for coding different kinds of feedback to the user in an efficient way. The software which runs on a PC that is connected to an electronic instrument has been evaluated and improved extensively.


Music production Visually impaired Musical interface MIDI 


  1. 1.
    Armaly A (2005) Making linux accessible for the visually impaired with speakup. Linux J 140:6ffGoogle Scholar
  2. 2.
    Boll S, Henze N, Heuten W (2006) Non-intrusive somatosensory navigation support for blind pedestrians. In: Eurohaptics (EH) 2006Google Scholar
  3. 3.
    Boll S, Heuten W, Wichmann D (2006) Interactive 3-d sonification for the exploration of city maps. In: NordiCHI ’06, Proceedings of the 4th nordic conference on human–computer interaction: changing rolesGoogle Scholar
  4. 4.
    Boll S, Henze N, Heuten W (2007) Interactive exploration of city maps with auditory torches. In: Computer/human interaction (CHI) conference 2007Google Scholar
  5. 5.
    Bourbakis NG, Kavraki D (2001) An intelligent assistant for navigation of visually impaired people. In: Proceedings of the IEEE 2nd international symposium on bioinformatics and bioengineeringGoogle Scholar
  6. 6.
    Brajnik G, Cancila D, Nicoli D, Pignatelli M (2005) Do text transcoders improve usability for disabled users? In: Proceedings of the 2005 international cross-disciplinary workshop on Web accessibility (W4A). ACM, New York, pp 9–17. doi:10.1145/1061811.1061814 CrossRefGoogle Scholar
  7. 7.
    Brewster SA, Wright PC, Edwards ADN (1992) A detailed investigation into the effectiveness of earcons. In: The proceedings of the first international conference on auditory display. Addison-Wesley, Reading, pp 471–498Google Scholar
  8. 8.
    Cunningham S (2004) Suitability of musicxml as a format for computer music notation and interchange. In: Proceedings of IADIS—international conference on applied computingGoogle Scholar
  9. 9.
    Dodd R, Green DS, Pearson DE (2008) The cisna model of accessible adaptive hypermedia. In: W4A ’08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A). ACM, New York, pp 27–36. doi:10.1145/1368044.1368052 CrossRefGoogle Scholar
  10. 10.
    Georgaki A, Raptis S, Bakamidis S (2000) A music interface for visually impaired people in the wedelmusic environment. In: International symposium on music information retrievalGoogle Scholar
  11. 11.
    Guerin R, Miller M (2009) Cubase 5 Power!: the comprehensive guide. Course Technology PTRGoogle Scholar
  12. 12.
    Hamburg H, Thij H, Ionescu A (2005) Improving the quality of life and work of elderly and disabled people by using distance learning and virtual applications. In: 11th international conference on human–computer-interactionGoogle Scholar
  13. 13.
    Heller MA (1985) Tactual perception of embossed morse code and braille: the alliance of vision and touch. Perception 14(5):563–570CrossRefGoogle Scholar
  14. 14.
    Issing LJ, Klimsa P (2008) Online-Lernen. R. Oldenbourg, MunichGoogle Scholar
  15. 15.
    Limna T, Sae-tang C, Jantaraprim C, Tandayya P, Niyompol W (2007) Linux user interface and front-end operation for the visually impaired. In: Proceedings of the 1st international convention on rehabilitation engineering and assistive technology: in conjunction with 1st Tan Tock Seng Hospital neurorehabilitation meetingGoogle Scholar
  16. 16.
    McGookin DK, Brewster SA (2004) Empirically derived guidelines for the presentation of concurrent earcons. In: Proceedings of BCS HCI 2004, pp 65–68Google Scholar
  17. 17.
    Nelson M, Thom B (2004) A survey of real-time midi performance. In: Proceedings of the 2004 conference on new interfaces for musical expressionGoogle Scholar
  18. 18.
    Nobels T, Desmet G, den Keybus JV, Belmans R (2006) Development of a portable braille display using a fast prototyping platform for power electronics. In: 3rd IET international conference on power electronics, machines and drives 2006, pp 321–325Google Scholar
  19. 19.
    Parente P, Clippingdale B (2006) Linux screen reader—extensible assistive technology. In: Proceedings of the 8th international ACM SIGACCESS conference on computers and accessibilityGoogle Scholar
  20. 20.
    Roberts JW, Slattery OT, Kardos DW (2000) Rotating-wheel braille display for continuous refreshable braille. Journal of the Society for Information Display, vol 31, pp 1–4. ISSN 0000-0966X/00/3001-0000Google Scholar
  21. 21.
    Selfridge-Field E (1997) Beyond MIDI: the handbook of musical codes. MIT Press, CambridgeGoogle Scholar
  22. 22.
    Shepard RN (2006) Stimulus and response generalization: a stochastic model relating generalization to distance in psychological space. Psychometrika 22(4):325–345MathSciNetCrossRefGoogle Scholar
  23. 23.
    Thom B, Nelson M (2004) An in-depth analysis of real-time midi performance. In: Proceedings of 2004 international computer music conference (ICMC 2004)Google Scholar
  24. 24.
    Velasco CA, Denev D, Stegemann D, Mohamad Y (2008) A Web compliance engineering framework to support the development of accessible rich internet applications. In: W4A ’08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A). ACM, New York, pp 45–49. doi:10.1145/1368044.1368054 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Thomas Haenselmann
    • 1
    Email author
  • Hendrik Lemelson
    • 1
  • Wolfgang Effelsberg
    • 1
  1. 1.University of MannheimMannheimGermany

Personalised recommendations