AI & SOCIETY

, Volume 27, Issue 2, pp 303–305

“Walk on the Sun”: an interactive image sonification exhibit

Open Forum
  • 136 Downloads

Abstract

“Walk on the Sun” is an interactive experience of image as music. As explorers move across images that are data projected onto the floor, their movements are visually tracked and used to select pixels in the images which they immediately hear as musical pitches played by various instruments. The sonification design maps color to one of 9 instruments, brightness to one of 50 pitches, and location in the image to panning position, creating 57,600 differentiable musical events. This high resolution and interactive auditory presentation of pixel data enables the blind to explore images of the Sun from the STEREO space mission, nebula and galactic images from Hubble, as well as art masterpieces. Specifically, the blind can hear when hot spots cross the center of the Sun or the solar winds and corona are changing by sonifying virtual geometric structures, such as lines and circles, to create chords of music reflecting the changing content of the selected pixels within that structure as images are played as movies. Originally funded by a NASA/STSCI Ideas grant, the exhibit has toured to more than 12 cities in the US, visiting blind and science centers in the process and receiving enthusiastic response throughout. Plans for additional work furthering NASA wide image sonification standards are in process.

Keywords

Image sonification Movement sonification NASA STEREO Interaction design Blind 

References

  1. Quinn M (2001) Research set to music: the climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. In: Proceedings of the 7th international conference on auditory display (ICAD2001), Espoo, Finland, pp 56–61Google Scholar
  2. Quinn M (2010) Solar songs and rock around the bow shock cluster sonification, http://espg.sr.unh.edu/index.html?tof/Outreach/music.html. Accessed 12 Nov 2010
  3. Quinn M, Keller JM, Prather EE, Boynton WV, Enos HL, Jones LV, Pompea SM, Slater TF (2003) Educational testing of an auditory display regarding seasonal variation of Martian polar ice caps. In: Proceedings of the 9th international conference on auditory display (ICAD2003), Boston, USA, pp 212–215Google Scholar
  4. Webbink E (2010) Evaluation of the NASA funded light runner program, http://www.inkweb.org/lightrunners.htm. New Jersey, USA, 2010
  5. Yeo WS, Berger J (2005) A framework for designing image sonification methods. In: Proceedings of the 11th international conference on auditory display, Limerick, Ireland, 6–9 JulyGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.Design Rhythmics Sonification Research LabLeeUSA

Personalised recommendations