Abstract
In our engagement with music, not only the physical experience of sound is important. Also the interplay between body movements, musical gestures and the cognitive processes of performers and listeners is part of our experience. Yet, this multimodal aspect is not always fully considered when analyzing music performance. In this paper, we want to establish a framework for a multi-layered analysis of music performance, building on data retrieved from quantitative and qualitative procedures and involving the perspectives of composer, performer and musicologist. The performance of a classical guitarist was analyzed in detail, using both a ‘bottom-up’ approach (audio-analysis and motion-capture) and a ‘top-down’ perspective (annotations from video-footage, perceived phrasing and the composer’s, performer’s and researcher’s perspective). These different analytical layers were compared and evaluated, which pointed out that multiple perspectives can reinforce each other in understanding musical intentions and can help detecting mismatches between qualitative and quantitative data. The analytical framework developed could be an important step in the coupling of performer’s intentions with the expressive enactment of a musical score.
Notes
- 1.
‘Stimulated recall’ is the overarching term for introspective research procedures through which cognitive processes can be investigated by inviting subjects to recall their thinking during an event when prompted by a video sequence. Benjamin Bloom is considered the first to use the term in 1953, which he described as a method for retrieving memories: “The basic idea underlying the method of stimulated recall is that a subject may be enabled to relive an original situation with vividness and accuracy if he is presented with a large number of cues or stimuli which occurred during the original situation” [18].
- 2.
The filtering and smoothing process was based on the methods used in [12], where noise-measurements are used to obtain the most reliable smoothing result.
References
Godøy, R.I., Leman, M. (eds.): Musical Gestures: Sound, Movement, and Meaning. Routledge, New York (2010)
Windsor, W.L.: An ecological approach to semiotics. J. Theor. Soc. Behav. 34, 179–198 (2004)
Clarke, E.: Ways of Listening: An Ecological Approach to the Perception of Musical Meaning. Oxford University Press, Oxford (2005)
Leman, M.: Embodied Music Cognition and Mediation Technology. MIT Press, Cambridge (2007)
Maes, P.-J., Palmer, C., Leman, M., Wanderley, M.M.: Action-based effects on music perception. Front. Psychol. 4, 1008 (2014)
Davidson, J.W.: Qualitative insights into the use of expressive body movement in solo piano performance: a case study approach. Psychol. Music 35, 381–401 (2007)
Wanderley, M.M., Vines, B., Middleton, W.N., McKay, C., Hatch, W.: The musical significance of clarinetists’ ancillary gestures: an exploration of the field. J. New Music Res. 34, 97–113 (2005)
Gritten, A., King, E.: Music and Gesture. Ashgate, Hampshire (2006)
Davidson, J.W.: Bodily communication in musical performance. In: Miell, D., Macdonald, R., Hargreaves, D.J. (eds.) Musical Communication, pp. 215–228. Oxford University Press, New York (2005)
Godøy, R.I.: Reflections on chunking in music. In: Schneider, A. (ed.) Systematic and Comparative Musicology: Concepts, Methods, Findings, pp. 117–132. Peter Lang, Frankfurt am Main (2008)
Clarke, E., Doffman, M., Timmers, R.: Creativity, collaboration and development in Jeremy Thurlow’s Ouija for Peter Sheppard Skaerved. J. Roy. Music. Assoc. 141, 113–165 (2016)
Desmet, F., Nijs, L., Demey, M., Lesaffre, M., Martens, J.-P., Leman, M.: Assessing a clarinet player’s performer gestures in relation to locally intended musical targets. J. New Music Res. 41(1), 31–48 (2012)
Godøy, R.I., Jensenius, A., Voldsund, A., et al.: Classifying music-related actions. In: Proceedings of the ICMPC-ESCOM 2012 Joint Conference: 12th Biennial International Conference for Music Perception and Cognition, 8th Triennial Conference of the European Society for the Cognitive Sciences of Music, pp. 352–357 (2012)
Thompson, M.R., Luck, G.: Exploring relationships between pianists’ body movements, their expressive intentions, and structural elements of music. Music Sci. 16(1), 19–40 (2012)
Fabian, D., Timmers, R., Schubert, E. (eds.): Expressiveness in Music Performance: Empirical Approaches Across Styles and Cultures. Oxford University Press, Oxford (2014)
Cycling ‘74: Max/MSP [Computer program] (2005). https://cycling74.com/products/max/
Troillard, C.: OSCulator [Computer program] (2012). http://www.osculator.net
Boersma, P., Weenink, D.: Praat: Doing Phonetics by Computer [Computer program] (2013)
Bloom, B.S.: Thought-processes in lectures and discussions. J. Gen. Edu. 7, 161 (1953)
Jensenius, A.R., Wanderley, M.M., Godøy, R.I., Leman, M.: Musical gestures: concepts and methods in research. In: Godøy, R.I., Leman, M. (eds.) Musical Gestures: Sound, Movement, and Meaning, pp. 12–35. Routledge, New York (2010)
ResearchWare: HyperRESEARCH: Cross-Platform for Qualitative Analysis. [Computer program] (2015). http://www.researchware.com/products/hyperresearch.html
Burger, B., Toiviainen, P.: MoCap toolbox: a Matlab toolbox for computational analysis of movement data. In: Bresin, R. (ed.) Proceedings of the 10th Sound and Music Computing Conference Stockholm. KTH Royal Institute of Technology, Sweden (2013)
Dempster, W.T., Gaughran, G.R.L.: Properties of body segments based on size and weight. Am. J. Anat. 120(1), 33–54 (1967)
Visi, F., Coorevits, E., Miranda, E., Leman, M.: Effects of different bow stroke styles on body movements of a viola player: an exploratory study. In: Proceedings of The joint ICMC|SMC|2014 Conference, Athens, Greece (2014)
Acknowledgements
This study was partially realized under the FWO-project “Foundations of expressive timing control in music”. Special thanks to Ivan Schepers, who helped developing the pressures sensors and mo-cap markers and Frank Desmet, who assisted in the analysis of the pressure sensors.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Coorevits, E., Moelants, D., Östersjö, S., Gorton, D., Leman, M. (2016). Decomposing a Composition: On the Multi-layered Analysis of Expressive Music Performance. In: Kronland-Martinet, R., Aramaki, M., Ystad, S. (eds) Music, Mind, and Embodiment. CMMR 2015. Lecture Notes in Computer Science(), vol 9617. Springer, Cham. https://doi.org/10.1007/978-3-319-46282-0_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-46282-0_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46281-3
Online ISBN: 978-3-319-46282-0
eBook Packages: Computer ScienceComputer Science (R0)