Skip to main content

Non-verbal Full Body Emotional and Social Interaction: A Case Study on Multimedia Systems for Active Music Listening

  • Conference paper
Intelligent Technologies for Interactive Entertainment (INTETAIN 2009)

Abstract

Research on HCI and multimedia systems for art and entertainment based on non-verbal, full-body, emotional and social interaction is the main topic of this paper. A short review of previous research projects in this area at our centre are presented, to introduce the main issues discussed in the paper. In particular, a case study based on novel paradigms of social active music listening is presented. Active music listening experience enables users to dynamically mould expressive performance of music and of audiovisual content. This research is partially supported by the 7FP EU-ICT Project SAME (Sound and Music for Everyone, Everyday, Everywhere, Every Way, www.sameproject.eu).

The original version of this chapter was revised: The copyright line was incorrect. This has been corrected. The Erratum to this chapter is available at DOI: 10.1007/978-3-642-02315-6_30

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Camurri, A., Mazzarino, B., Volpe, G.: Expressive Interfaces. In: Marti, P. (ed.) Cognition Technology & Work, special issue on “Presence: design and technology challenges for cooperative activities in virtual or remote environments”, vol. 6, pp. 15–22. Springer, Heidelberg (2004)

    Google Scholar 

  2. Pentland, A.: Socially aware, Computation and Communication. Computer. IEEE CS Press, Los Alamitos (2005)

    Google Scholar 

  3. Camurri, A., Ferrentino, P.: Interactive Environments for Music and Multimedia. ACM Multimedia Systems, Special issue on Audio and Multimedia 7(1), 32–47 (1999)

    Article  Google Scholar 

  4. Camurri, A., De Poli, G., Leman, M., Volpe, G.: Toward Communicating Expressiveness and Affect in Multimodal Interactive Systems for Performing Art and Cultural Applications. IEEE Multimedia 12(1), 43–53 (2005)

    Article  Google Scholar 

  5. Camurri, A., Coglio, A.: An Architecture for Emotional Agents. IEEE Multimedia 5(4), 24–33 (1998)

    Article  Google Scholar 

  6. Camurri, A., Mazzarino, B., Volpe, G., Morasso, P., Priano, F., Re, C.: Application of multimedia techniques in the physical rehabilitation of Parkinson’s patients. Journal of Visualization and Computer Animation 14(5), 269–278 (2003)

    Article  Google Scholar 

  7. Camurri, A.: Interactive Dance/Music Systems. In: Proc. Intl. Computer Music Conference ICMC 1995, The Banff Centre for the arts, Canada, ICMA-Intl. Comp. Mus. Association, September 3-7, pp. 245–252 (1995)

    Google Scholar 

  8. Camurri, A., Canepa, C., Volpe, G.: Active listening to a virtual orchestra through an expressive gestural interface: The Orchestra Explorer. In: Proc. Intl Conf. NIME 2007 New Interfaces for Music Expression, New York University (2007)

    Google Scholar 

  9. Rowe, R.: Interactive music systems: Machine listening and composition. MIT Press, Cambridge (1993)

    Google Scholar 

  10. Lee, E., Karrer, T., Borchers, J.: Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams. Computer Music Journal 30(1), 21–36 (2006)

    Article  Google Scholar 

  11. Camurri, A., Canepa, C., Coletta, P., Mazzarino, B., Volpe, G.: Mappe per Affetti Erranti: a Multimodal System for Social Active Listening and Expressive Performance. In: Proc. Intl Conf. NIME 2008 – New Interfaces for Musical Expression, Casa Paganini, University of Genoa (2008), www.nime.org

  12. Varni, G., Camurri, A., Coletta, P., Volpe, G.: Emotional Entrainment in Music Performance. In: Proc. 8th IEEE Intl Conf. on Automatic Face and Gesture Recognition, Amsterdam, September 17-19 (2008)

    Google Scholar 

  13. Camurri, A., Morasso, P., Tagliasco, V., Zaccaria, R.: Dance and Movement Notation. In: Morasso, P., Tagliasco, V. (eds.) Human Movement Understanding, pp. 85–124. North Holland, Amsterdam (1986)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Camurri, A. (2009). Non-verbal Full Body Emotional and Social Interaction: A Case Study on Multimedia Systems for Active Music Listening. In: Nijholt, A., Reidsma, D., Hondorp, H. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 9. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02315-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-02315-6_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-02314-9

  • Online ISBN: 978-3-642-02315-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics