Non-verbal Full Body Emotional and Social Interaction: A Case Study on Multimedia Systems for Active Music Listening

  • Antonio Camurri
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 9)

Abstract

Research on HCI and multimedia systems for art and entertainment based on non-verbal, full-body, emotional and social interaction is the main topic of this paper. A short review of previous research projects in this area at our centre are presented, to introduce the main issues discussed in the paper. In particular, a case study based on novel paradigms of social active music listening is presented. Active music listening experience enables users to dynamically mould expressive performance of music and of audiovisual content. This research is partially supported by the 7FP EU-ICT Project SAME (Sound and Music for Everyone, Everyday, Everywhere, Every Way, www.sameproject.eu).

Keywords

non-verbal full-body multimodal interfaces emotion social signals sound and music computing active listening 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Camurri, A., Mazzarino, B., Volpe, G.: Expressive Interfaces. In: Marti, P. (ed.) Cognition Technology & Work, special issue on “Presence: design and technology challenges for cooperative activities in virtual or remote environments”, vol. 6, pp. 15–22. Springer, Heidelberg (2004)Google Scholar
  2. 2.
    Pentland, A.: Socially aware, Computation and Communication. Computer. IEEE CS Press, Los Alamitos (2005)Google Scholar
  3. 3.
    Camurri, A., Ferrentino, P.: Interactive Environments for Music and Multimedia. ACM Multimedia Systems, Special issue on Audio and Multimedia 7(1), 32–47 (1999)CrossRefGoogle Scholar
  4. 4.
    Camurri, A., De Poli, G., Leman, M., Volpe, G.: Toward Communicating Expressiveness and Affect in Multimodal Interactive Systems for Performing Art and Cultural Applications. IEEE Multimedia 12(1), 43–53 (2005)CrossRefGoogle Scholar
  5. 5.
    Camurri, A., Coglio, A.: An Architecture for Emotional Agents. IEEE Multimedia 5(4), 24–33 (1998)CrossRefGoogle Scholar
  6. 6.
    Camurri, A., Mazzarino, B., Volpe, G., Morasso, P., Priano, F., Re, C.: Application of multimedia techniques in the physical rehabilitation of Parkinson’s patients. Journal of Visualization and Computer Animation 14(5), 269–278 (2003)CrossRefGoogle Scholar
  7. 7.
    Camurri, A.: Interactive Dance/Music Systems. In: Proc. Intl. Computer Music Conference ICMC 1995, The Banff Centre for the arts, Canada, ICMA-Intl. Comp. Mus. Association, September 3-7, pp. 245–252 (1995)Google Scholar
  8. 8.
    Camurri, A., Canepa, C., Volpe, G.: Active listening to a virtual orchestra through an expressive gestural interface: The Orchestra Explorer. In: Proc. Intl Conf. NIME 2007 New Interfaces for Music Expression, New York University (2007)Google Scholar
  9. 9.
    Rowe, R.: Interactive music systems: Machine listening and composition. MIT Press, Cambridge (1993)Google Scholar
  10. 10.
    Lee, E., Karrer, T., Borchers, J.: Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams. Computer Music Journal 30(1), 21–36 (2006)CrossRefGoogle Scholar
  11. 11.
    Camurri, A., Canepa, C., Coletta, P., Mazzarino, B., Volpe, G.: Mappe per Affetti Erranti: a Multimodal System for Social Active Listening and Expressive Performance. In: Proc. Intl Conf. NIME 2008 – New Interfaces for Musical Expression, Casa Paganini, University of Genoa (2008), www.nime.org
  12. 12.
    Varni, G., Camurri, A., Coletta, P., Volpe, G.: Emotional Entrainment in Music Performance. In: Proc. 8th IEEE Intl Conf. on Automatic Face and Gesture Recognition, Amsterdam, September 17-19 (2008)Google Scholar
  13. 13.
    Camurri, A., Morasso, P., Tagliasco, V., Zaccaria, R.: Dance and Movement Notation. In: Morasso, P., Tagliasco, V. (eds.) Human Movement Understanding, pp. 85–124. North Holland, Amsterdam (1986)Google Scholar

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2009

Authors and Affiliations

  • Antonio Camurri
    • 1
  1. 1.InfoMus Lab – Casa Paganini Intl Research CentreDIST- University of GenovaGenovaItaly

Personalised recommendations