Creating an Entertaining and Informative Music Visualization

  • Michael Pouris
  • Deborah I. Fels
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7382)


Auditory music is a universal art form that has spanned millennia. Music provides an insight into the collective culture of a society and acts as a vehicle to transmit shared knowledge that is common to all members of society. People who are deaf, deafened or hard of hearing tend to have a limited access to music and as a result can be excluded from this shared knowledge and cultural experience. A music visualization system, MusicViz, was developed based on a model of audio-visual sensory substitution. An evaluation of six different music genres showed that the visualizations were enjoyable and able to convey some information and emotions to the participants.


Classical Music Discrete Emotion Deaf Community Music Genre Music Player 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Fourney, D.W., Fels, D.I.: Creating Access to Music through Visualization. In: 2009 IEEE Toronto International Conference on Science and Technology for Humanity (TIC-STH), pp. 939–944 (2009)Google Scholar
  2. 2.
    Eldridge, M., Saltzman, E., Lahav, A.: Seeing what You Hear: Visual Feedback Improves Pitch Recognition. European Journal of Cognitive Psychology 22, 1078–1091 (2010)CrossRefGoogle Scholar
  3. 3.
    Hiraga, R., Watanabe, F., Fujishiro, I.: Music Learning through Visualization (2002)Google Scholar
  4. 4.
    Bertini, C., Leo, F., Alessio, A., Làdavas, E.: Independent Mechanisms for Ventriloquism and Multisensory Integration as Revealed by Theta-Burst Stimulation. Eur. J. Neurosci. 31, 1791–1799 (2010)CrossRefGoogle Scholar
  5. 5.
    Ortony, A., Turner, T.J.: What’s Basic about Basic Emotions? Psychol. Rev. 97, 315–331 (1990)CrossRefGoogle Scholar
  6. 6.
    Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 1161–1178 (1980)CrossRefGoogle Scholar
  7. 7.
    Ilie, G., Thompson, W.F.: A Comparison of Acoustic Cues in Music and Speech for Three Dimensions of Affect. Music Perception: An Interdisciplinary Journal 23, 319 (2006)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Marks, L.E.: On Cross-Modal Similarity: The Perceptual Structure of Pitch, Loudness, and Brightness. Journal of Experimental Psychology: Human Perception and Performance 15, 586–602 (1989)CrossRefGoogle Scholar
  9. 9.
    Schiff, W., Caviness, J.A., Gibson, J.J.: Persistent Fear Responses in Rhesus Monkeys to the Optical Stimulus of “Looming”. Science 136, 982–983 (1962)CrossRefGoogle Scholar
  10. 10.
    Schubert, E.: Modeling Perceived Emotion with Continuous Musical Features. Music Perception 21, 561–561 (2004)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Kunze, T., Taube, H.: See: A Structured Event Editor - Visualizaing Compositional Data in Common Music (1996)Google Scholar
  12. 12.
    Smith, S.M., Williams, G.N.: A Visualization of Music. In: Proceedings of Visualization 1997, pp. 499–503 (1997)Google Scholar
  13. 13.
    Bradley, M.M., Lang, P.J.: Measuring Emotion: The Self-Assessment Manikin and the Semantic Differential. J. Behav. Ther. Exp. Psychiatry 25, 49–59 (1994)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Michael Pouris
    • 1
  • Deborah I. Fels
    • 1
  1. 1.Ryerson UniversityTorontoCanada

Personalised recommendations