Abstract
In this paper we present a survey of our research on analysis of expressive gesture and how it is evolving towards the analysis of expressive social interaction in groups of users. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is an extremely relevant component for analysis of expressive gesture, since it provides significant information on the context expressive gestures are performed in. However, most of the current systems analyze expressive gestures according to basic emotion categories or simple dimensional approaches. Moreover, almost all of them are intended for a single user, whereas social interaction is often neglected. After briefly recalling our pioneering studies on collaborative robot-human interaction, this paper presents two steps in the direction of novel computational models and techniques for measuring social interaction: (i) the interactive installation Mappe per Affetti Erranti for active listening to sound and music content, and (ii) the techniques we developed for explicitly measuring synchronization within a group of users. We conclude with the research challenges we will face in the near future.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bernhardt, D., Robinson, P.: Detecting Affect from Non-stylised Body Motions. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 59–70. Springer, Heidelberg (2007)
Boccaletti, S., Kurths, J., Osipov, G., Valladeres, D.L., Zhou, C.S.: The Synchronization of Cahotic Systems. Phys. Rep. 366(1-2), 1–101 (2002)
Boone, R.T., Cunningham, J.G.: Children’s decoding of emotion in expressive body movement: The development of cue attunement. Developmental Psychology 34, 1007–1016 (1998)
Camurri, A., Coglio, A.: An Architecture for Emotional Agents. In: IEEE Multimedia, October-December 1998, pp. 24–33. IEEE CS Press, Los Alamitos (1998)
Camurri, A., Ferrentino, P.: Interactive environments for music and multimedia. Multimedia Systems 7, 32–47 (1999)
Camurri, A., Coletta, P., Ricchetti, M., Volpe, G.: Expressiveness and Physicality in Interaction. Journal of New Music Research 29(3), 187–198 (2000)
Camurri, A., Lagerlöf, I., Volpe, G.: Recognizing emotion from dance movement: Comparison of spectator recognition and automated techniques. Intl. J. Human-Computer Studies 59, 213–225 (2003)
Camurri, A., De Poli, G., Leman, M., Volpe, G.: Toward Communicating Expressiveness and Affect in Multimodal Interactive Systems for Performing Art and Cultural Applications. IEEE Multimedia 12(1), 43–53 (2005)
Camurri, A., Canepa, C., Coletta, P., Ferrari, N., Mazzarino, B., Volpe, G.: The Interactive Piece The Bow is bent and drawn. In: Proc. 3rd ACM Intl. Conf. on Digital Interactive Media in Entertainment and Arts (DIMEA 2008), Athens, Greece, pp. 376–383 (2008)
De Meijer, M.: The contribution of general features of body movement to the attribution of emotions. J. of Nonverbal Behavior 13, 247–268 (1989)
De Rosis, F., Cavalluzzi, A., Mazzotta, I., Novielli, N.: Can embodied conversational agents induce empathy in users? In: Proceedings of AISB 2005, Virtual Social Character Symposium (2005)
Dong, W., Lepri, B., Cappelletti, A., Pentland, A., Pianesi, F., Zancanaro, M.: Using the influence model to recognize functional roles in meetings. In: Proc. 9th Intl. ACM Conf. on Multimodal Interfaces, pp. 271–278 (2007)
Eckmann, J.P., Kamphorst, S.O., Ruelle, D.: Recurrence plots of dynamical system. Eurpph. Lett. 5, 973–977 (1987)
Juslin, P.N.: Cue utilization in communication of emotion in music performance: relating performance to perception. Journal of Experimental Psychology: Human Perception and Performance 26(6), 1797–1813 (2000)
Kapur, A., Kapur, A., Virji-Babul, N., Tzanetakis, G., Driessen, P.F.: Gesture-Based Affective Computing on Motion Capture Data. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 1–7. Springer, Heidelberg (2005)
Laban, R., Lawrence, F.C.: Effort. Macdonald&Evans Ltd., London (1947)
Marwan, N., Romano, M.C., Thiel, M., Kurths, J.: Recurrence plots for the analysis of complex systems. Phsysics Reports 438, 237–329 (2007)
McQuiggan, S.W., Lester, J.C.: Modeling and evaluating empathy in embodied companion agents. Intl. J. Human-Computer Studies 65(4), 348–360 (2007)
Pentland, A.: Social signal processing. IEEE Signal Processing Magazine 24(4), 108–111 (2007)
Poincaré, H.: Sur la problèmedes trois corps et les equations de la dynamique. Acta Math 13, 1–271 (1890)
Russell, J.A.: A circumplex model of affect. J. of Personality and Social Psychology 39, 1161–1178 (1980)
Suzuki, K., Camurri, A., Hashimoto, S., Ferrentino, P.: Intelligent Agent System for Human-Robot Interaction through Artificial Emotion. In: Proc. IEEE Intl. Conf. on Systems Man and Cybernetics SMC 1998, San Diego, USA (1998)
Tellegen, A., Watson, D., Clark, L.A.: On the dimensional and hierarchical structure of affect. Psychological Science 10(4), 297–303 (1999)
Varni, G., Camurri, A., Coletta, P., Volpe, G.: Emotional entrainment in music performance. In: Proc. of 8th Intl. Conf. on Automatic Face and Gesture Recognition FG 2008 (2008)
Varni, G., Camurri, A., Coletta, P., Volpe, G.: Toward Real-time Automated Measure of Empathy and Dominance. In: Proc. 2009 IEEE Intl. Conf. on Social Computing SocialCom, Vancouver, Canada (2009a)
Varni, G., Mancini, M., Volpe, G., Camurri, A.: Sync’n’Move: social interaction based on music and gesture. In: Proc. 1st Intl. ICST Conference on User Centric Media, Venice, Italy, December 2009 (2009b)
Vines, B.W., Krumhansl, C.L., Wanderley, M.M., Ioana, M.D., Levitin, D.J.: Dimensions of Emotion in Expressive Musical Performance. Ann. N.Y. Acad. Sci. 1060, 462–466 (2005)
Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)
Zbilut, J., Webber Jr., C.L.: Embeddings and delays as derived from quantification of recurrence plots. Phys. Lett. A 5, 199–203 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Camurri, A., Varni, G., Volpe, G. (2010). Towards Analysis of Expressive Gesture in Groups of Users: Computational Models of Expressive Social Interaction. In: Kopp, S., Wachsmuth, I. (eds) Gesture in Embodied Communication and Human-Computer Interaction. GW 2009. Lecture Notes in Computer Science(), vol 5934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12553-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-12553-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12552-2
Online ISBN: 978-3-642-12553-9
eBook Packages: Computer ScienceComputer Science (R0)