Visual Representations for Music Understanding Improvement

  • Leandro CruzEmail author
  • Vitor Rolla
  • Juliano Kestenberg
  • Luiz Velho
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11265)


Classical music appreciation is non trivial. Visual representation can aid music teaching and learning processes. In this sense, we propose a set of visual representations based on musical notes features, such as: note type, octave, velocity and timbre. In our system, the visual elements appear along with their corresponding musical elements, in order to improve the perception of musical structures. The visual representations we use to enhance the comprehension of a composition could be extended to performing arts scenarios. It could be adopted as motion graphics during live musical performances. We have developed several videos to illustrate our method. We have also developed an ear training quiz and a research questionnaire. This material is available at


Music visualization Geometric shapes Pedagogy and music education 



The authors would like to thank the following institutions for their support: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), and finally Instituto Nacional Casa da Moeda (Portugal).


  1. Bergstrom, T., Karahalios, K., Hart, J.: Isochords: visualizing structure in music. In: Proceedings of Graphics Interface 2007 (GI 2007), pp. 297–304. ACM, New York (2007).
  2. Brougher, K., Strick, J., Wiseman, A., Zilczer, J.: Visual Music: Synaesthesia in Art and Music Since 1900. Thames & Hudson, London (2005)Google Scholar
  3. Chan, W.Y., Qu, H., Mak, W.H.: Visualizing the semantic structure in classical music works. IEEE Trans. Vis. Comput. Graph 16, 161–173 (2010). Scholar
  4. Ciuha, P., Klemenc, B., Solina, F.: Visualization of concurrent tones in music with colors. In: Proceedings of the 18th ACM International Conference on Multimedia (MM 2010), pp. 1677–1680. ACM, New York (2010).
  5. Cohn, R.: Neo-Riemannian Operations, Parsimonious Trichords, and their Tonnetz Representations. J. Music. Theory 41(1), 1–66 (1997)CrossRefGoogle Scholar
  6. Collopy, F.: Color, form, and motion: dimensions of a musical art of light. J. Leonardo 33(5), 355–360 (2000)CrossRefGoogle Scholar
  7. Dannenberg, R.: A brief survey of music representation issues. Comput. Music J. 17, 20–30 (1993)CrossRefGoogle Scholar
  8. Fonteles, J.H., Rodrigues, M.A.F., Basso, V.E.D.: Creating and evaluating a particle system for music visualization. J. Vis. Lang. Comput. 24, 472–482 (2013). Scholar
  9. Gardner, R.: Music Notation: A Manual of Modern Practice. Allyn & Bacon, Boston (1964)Google Scholar
  10. Gareth, L.: Musicians make a standard: the MIDI phenomenon. Comput. Music J. 9, 8–26 (1985). Scholar
  11. Miyazaki, R., Fujishiro, I., Hiraga, R.: Exploring MIDI datasets. In: ACM SIGGRAPH 2003 Sketches & Applications (SIGGRAPH 2003), p. 1. ACM, New York (2003).
  12. Ohmi, K.: Music visualization in style and structure. J. Vis. 10(3), 257–258 (2007). Scholar
  13. Sapp, C.: Harmonic visualizations of tonal music. In: Proceedings of International Computer Music Conference, Havana, Cuba, pp. 423–430 (2003)Google Scholar
  14. Zhu, J., Wang, Y.: Complexity-scalable beat detection with MP3 audio bitstreams. Comput. Music. J. 32(1), 71–87 (2008). Spring 2008CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Leandro Cruz
    • 1
    Email author
  • Vitor Rolla
    • 2
  • Juliano Kestenberg
    • 3
  • Luiz Velho
    • 2
  1. 1.Institute of Systems and Robotics, Department of Electrical and Computer EngineeringUniversity of CoimbraCoimbraPortugal
  2. 2.Instituto Nacional de Matematica Pura e AplicadaRio de JaneiroBrazil
  3. 3.Universidade Federal do Rio de JaneiroRio de JaneiroBrazil

Personalised recommendations