Towards Analysis of Expressive Gesture in Groups of Users: Computational Models of Expressive Social Interaction
In this paper we present a survey of our research on analysis of expressive gesture and how it is evolving towards the analysis of expressive social interaction in groups of users. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is an extremely relevant component for analysis of expressive gesture, since it provides significant information on the context expressive gestures are performed in. However, most of the current systems analyze expressive gestures according to basic emotion categories or simple dimensional approaches. Moreover, almost all of them are intended for a single user, whereas social interaction is often neglected. After briefly recalling our pioneering studies on collaborative robot-human interaction, this paper presents two steps in the direction of novel computational models and techniques for measuring social interaction: (i) the interactive installation Mappe per Affetti Erranti for active listening to sound and music content, and (ii) the techniques we developed for explicitly measuring synchronization within a group of users. We conclude with the research challenges we will face in the near future.
Keywordsexpressive gesture analysis and processing analysis of social interaction in small groups multimodal interactive systems
Unable to display preview. Download preview PDF.
- Camurri, A., Coglio, A.: An Architecture for Emotional Agents. In: IEEE Multimedia, October-December 1998, pp. 24–33. IEEE CS Press, Los Alamitos (1998)Google Scholar
- Camurri, A., Canepa, C., Coletta, P., Ferrari, N., Mazzarino, B., Volpe, G.: The Interactive Piece The Bow is bent and drawn. In: Proc. 3rd ACM Intl. Conf. on Digital Interactive Media in Entertainment and Arts (DIMEA 2008), Athens, Greece, pp. 376–383 (2008)Google Scholar
- De Rosis, F., Cavalluzzi, A., Mazzotta, I., Novielli, N.: Can embodied conversational agents induce empathy in users? In: Proceedings of AISB 2005, Virtual Social Character Symposium (2005)Google Scholar
- Dong, W., Lepri, B., Cappelletti, A., Pentland, A., Pianesi, F., Zancanaro, M.: Using the influence model to recognize functional roles in meetings. In: Proc. 9th Intl. ACM Conf. on Multimodal Interfaces, pp. 271–278 (2007)Google Scholar
- Laban, R., Lawrence, F.C.: Effort. Macdonald&Evans Ltd., London (1947)Google Scholar
- Poincaré, H.: Sur la problèmedes trois corps et les equations de la dynamique. Acta Math 13, 1–271 (1890)Google Scholar
- Suzuki, K., Camurri, A., Hashimoto, S., Ferrentino, P.: Intelligent Agent System for Human-Robot Interaction through Artificial Emotion. In: Proc. IEEE Intl. Conf. on Systems Man and Cybernetics SMC 1998, San Diego, USA (1998)Google Scholar
- Varni, G., Camurri, A., Coletta, P., Volpe, G.: Emotional entrainment in music performance. In: Proc. of 8th Intl. Conf. on Automatic Face and Gesture Recognition FG 2008 (2008)Google Scholar
- Varni, G., Camurri, A., Coletta, P., Volpe, G.: Toward Real-time Automated Measure of Empathy and Dominance. In: Proc. 2009 IEEE Intl. Conf. on Social Computing SocialCom, Vancouver, Canada (2009a)Google Scholar
- Varni, G., Mancini, M., Volpe, G., Camurri, A.: Sync’n’Move: social interaction based on music and gesture. In: Proc. 1st Intl. ICST Conference on User Centric Media, Venice, Italy, December 2009 (2009b)Google Scholar