Audio-Video Analysis of Musical Expressive Intentions

  • Ingrid Visentini
  • Antonio Rodà
  • Sergio Canazza
  • Lauro Snidaro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6979)


This paper presents a preliminary study on the relation between audio-video streams and high-level information related to expressive nuances. A violinist was asked to play three musical excerpts several times, each one inspired by one of nine different expressive intentions. Perceptual tests was carried out using both audio-only and audio-visual recordings of the performances. The results demonstrate that the visual component aids the subjects to better recognize the different expressive intentions of the musical performances, showing that the fusion of audio-visual information can significantly improve the degree of recognition given by single means.


  1. 1.
    Bigand, E., Vieillard, S., Madurell, F., Marozeau, J., Dacquet, A.: Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition and Emotion 19(8), 1113–1139 (2005)CrossRefGoogle Scholar
  2. 2.
    Camurri, A., De Poli, G., Leman, M., Volpe, G.: Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimedia 12(1), 43–53 (2005)CrossRefGoogle Scholar
  3. 3.
    Canazza, S., De Poli, G., Rodà, A.: Analysis of expressive intentions in piano performance. Journal of ITC Sangeet Research Academy 16, 23–62 (2002)Google Scholar
  4. 4.
    Castellano, G., Mortillaro, M., Camurri, A., Volpe, G., Scherer, K.: Automated analysis of body movement in emotionally expressive piano performances. Music Perception 26(2), 103–119 (2008)CrossRefGoogle Scholar
  5. 5.
    Dahl, S., Friberg, A.: Visual perception of expressiveness in musician’s body movements. Music Perception 24, 433–454 (2007)CrossRefGoogle Scholar
  6. 6.
    Downie, J.S.: Music information retrieval. Annual Review of Information Science and Technology 37, 295–340 (2003)CrossRefGoogle Scholar
  7. 7.
    Juslin, P.N., Sloboda, J.A.: Music and emotion. Theory and research. Oxford University Press, Oxford (2001)Google Scholar
  8. 8.
    Kirke, A., Miranda, E.R.: A survey of computer systems for expressive music performance. ACM Computing Surveys 42(1) (2009)Google Scholar
  9. 9.
    Mion, L., De Poli, G.: Score-independent audio features for description of music expression. IEEE Trans. Speech, Audio, and Language Process. 16(2), 458–466 (2008)CrossRefGoogle Scholar
  10. 10.
    Orio, N.: Music retrieval: A tutorial and review. Foundations and Trends in Information Retrieval 1(1), 1–90 (2006)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ingrid Visentini
    • 1
  • Antonio Rodà
    • 1
  • Sergio Canazza
    • 2
  • Lauro Snidaro
    • 1
  1. 1.Dept. of Mathematics and Computer ScienceUniversity of UdineUdineItaly
  2. 2.Dept. of Information EngineeringUniversity of PadovaPadovaItaly

Personalised recommendations