International Gesture Workshop

GW 2003: Gesture-Based Communication in Human-Computer Interaction pp 20-39

Multimodal Analysis of Expressive Gesture in Music and Dance Performances

  • Antonio Camurri
  • Barbara Mazzarino
  • Matteo Ricchetti
  • Renee Timmers
  • Gualtiero Volpe
Conference paper

DOI: 10.1007/978-3-540-24598-8_3

Volume 2915 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Camurri A., Mazzarino B., Ricchetti M., Timmers R., Volpe G. (2004) Multimodal Analysis of Expressive Gesture in Music and Dance Performances. In: Camurri A., Volpe G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science, vol 2915. Springer, Berlin, Heidelberg

Abstract

This paper presents ongoing research on the modelling of expressive gesture in multimodal interaction and on the development of multimodal interactive systems explicitly taking into account the role of non-verbal expressive gesture in the communication process. In this perspective, a particular focus is on dance and music as first-class conveyors of expressive and emotional content. Research outputs include (i) computational models of expressive gesture, (ii) validation by means of continuous ratings on spectators exposed to real artistic stimuli, and (iii) novel hardware and software components for the EyesWeb open platform (www.eyesweb.org), such as the recently developed Expressive Gesture Processing Library. The paper starts with a definition of expressive gesture. A unifying framework for the analysis of expressive gesture is then proposed. Finally, two experiments on expressive gesture in dance and music are discussed. This research work has been supported by the EU IST project MEGA (Multisensory Expressive Gesture Applications, www.megaproject.org) and the EU MOSART TMR Network.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Antonio Camurri
    • 1
  • Barbara Mazzarino
    • 1
  • Matteo Ricchetti
    • 1
  • Renee Timmers
    • 1
  • Gualtiero Volpe
    • 1
  1. 1.InfoMus LabDIST – University of GenovaGenovaItaly