Performance Gestures of Musicians: What Structural and Emotional Information Do They Convey?

  • Bradley W. Vines
  • Marcelo M. Wanderley
  • Carol L. Krumhansl
  • Regina L. Nuzzo
  • Daniel J. Levitin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2915)


This paper investigates how expressive gestures of a professional clarinetist contribute to the perception of structure and affect in musical performance. The thirty musically trained subjects saw, heard, or both saw and heard the performance. All subjects made the same judgments including a real-time judgment of phrasing, which targeted the experience of structure, and a real-time judgment of tension, which targeted emotional experience.

In addition to standard statistical methods, techniques in the field of Functional Data Analysis were used to interpret the data. These new techniques model data drawn from continuous processes and explore the hidden structures of the data as they change over time.

Three main findings add to our knowledge of gesture and movement in music: 1) The visual component carries much of the same structural information as the audio. 2) Gestures elongate the sense of phrasing during a pause in the sound and certain gestures cue the beginning of a new phrase. 3) The importance of visual information to the experience of tension changes with certain structural features in the sound. When loudness, pitch height, and note density are relatively low, the effect of removing the visual component is to decrease the experience of tension.


Visual Component Musical Performance Functional Data Analysis Music Perception Pitch Height 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aiello, R.: Music and Language: Parallels and Contrasts. In: Aiello, R., Sloboda, J. (eds.) Music Perceptions, pp. 40–63. Oxford University Press, NewYork (1994)Google Scholar
  2. 2.
    Clarke, E.F., Krumhansl, C.L.: Perceiving Musical Time. Music Perception 7, 213–252 (1990)Google Scholar
  3. 3.
    Davidson, J.: Visual Perception of Performance Manner in the Movements of Solo Musicians. Psychology of Music 21, 103–113 (1993)CrossRefGoogle Scholar
  4. 4.
    Delalande, F.: La Gestique de Gould. Glen Gould Pluriel, pp. 85–111. Louse Courteau, editrice, inc. (1988)Google Scholar
  5. 5.
    Deliège, I., El Ahmade, A.: Mechanisms for Cue Extraction in Musical Groupings: A Study of Perception on Sequenza VI for Viola Solo by Luciano Berio. Psychology of Music 18, 18–44 (1990)CrossRefGoogle Scholar
  6. 6.
    Fredrickson, W.E.: A Comparison of Perceived Musical Tension and Aesthetic Response. Psychology of Music 23, 81–87 (1995)CrossRefGoogle Scholar
  7. 7.
    Fredrickson, W.E.: Elementary, Middle, and High School Student Perceptions of Tension in Music. Journal of Research in Music Education 45(4), 626–635 (1997)CrossRefGoogle Scholar
  8. 8.
    Fredrickson, W.E.: Effect of Musical Performance on Perception of Tension in Gustav Holst’s First Suite in E-flat. Journal of Research in Music Education 47(1), 44–52 (1999)CrossRefGoogle Scholar
  9. 9.
    Fredrickson, W.E.: Perception of Tension in Music: Musicians versus Nonmusicians. Journal of Music Therapy 37(1), 40–50 (2000)Google Scholar
  10. 10.
    Krumhansl, C.L.: A Perceptual Analysis of Mozart’s Piano Sonata K. 282: Segmentation, Tension, and Musical Ideas. Music Perception 13(3), 401–432 (1996)Google Scholar
  11. 11.
    Krumhansl, C.L.: An Exploratory Study of Musical Emotions and Psychophysiology. Canadian Journal of Experimental Psychology 51(4), 336–352 (1997)Google Scholar
  12. 12.
    Krumhansl, C.L., Schenck, D.L.: Can dance reflect the structural and expressive qualities of music? A perceptual experiment on Balanchine’s choreography of Mozart’s Divertimento. Musicae Scientiae 15, 63–85 (1997)Google Scholar
  13. 13.
    Levelt, W.J.M.: Speaking: From Intention to Articulation. MIT Press, Cambridge (1989)Google Scholar
  14. 14.
    Madsen, C.K., Fredrickson, W.E.: The Experience of Musical Tension: A Replication of Nielsen’s Research Using the Continuous Response Digital Interface. Journal of Music Therapy 30(1), 46–63 (1993)Google Scholar
  15. 15.
    McFarland, D.H.: Respiratory Markers of Conversational Interaction. Journal of Speech, Language, and Hearing Research 44(1), 128–143 (2001)CrossRefMathSciNetGoogle Scholar
  16. 16.
    Nielsen, F.V.: Oplevelse af misikalsk spending (The experience of musical tension). Akademisk Forlag, Copenhagen (1983)Google Scholar
  17. 17.
    Ramsay, J.O., Silverman, B.W.: Functional Data Analysis. Springer, New York (1997)zbMATHGoogle Scholar
  18. 18.
    Wanderley, M.M.: Non-Obvious Performer Gestures in Instrumental Music. In: Braffort, A., Gherbi, R., Gibet, S., Richardson, J., Teil, D. (eds.) Gesture-Based Communication in Human-Computer Interaction, pp. 37–48. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  19. 19.
    Wanderley, M.M., Depalle, P.: Gesturally Controlled Digital Audio Effects. In: Proceedings of the COST-6 Conference on Digital Audio Effects (DAFx-01). Limerick, Ireland, pp. 165–169 (2001)Google Scholar
  20. 20.
    Wanderley, M.M.: QuantitativeAnalysis of Non-Obvious Performer Gestures. In: Wachsmuth, I., Sowa, T. (eds.) Gesture and Sign Language in Human-Computer Interaction, pp. 241–253. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Bradley W. Vines
    • 1
  • Marcelo M. Wanderley
    • 2
  • Carol L. Krumhansl
    • 3
  • Regina L. Nuzzo
    • 1
  • Daniel J. Levitin
    • 1
    • 2
  1. 1.Department of PsychologyMcGill UniversityMontrealCanada
  2. 2.Faculty of MusicMcGill UniversityMontrealCanada
  3. 3.Department of PsychologyCornell UniversityIthacaUSA

Personalised recommendations