Searching for Prototypical Facial Feedback Signals
Embodied conversational agents should be able to provide feedback on what a human interlocutor is saying. We are compiling a list of facial feedback expressions that signal attention and interest, grounding and attitude. As expressions need to serve many functions at the same time and most of the component signals are ambiguous, it is important to get a better idea of the many to many mappings between displays and functions. We asked people to label several dynamic expressions as a probe into this semantic space. We compare simple signals and combined signals in order to find out whether a combination of signals can have a meaning on its own or not, i. e. the meaning of single signals is different from the meaning attached to the combination of these signals. Results show that in some cases a combination of signals alters the perceived meaning of the backchannel.
KeywordsFeedback Facial expressions Interpretation
Unable to display preview. Download preview PDF.
- Allwood, J., Cerrato, L.: A study of gestural feedback expressions. In: Paggio, P., Jokinen, K., Jonsson, A. (eds.) First Nordic Symposium on Multimodal Communication, Copenaghen, pp. 7–22 (September 23–24, 2003)Google Scholar
- Allwood, J., Nivre, J., Ahlsén, E.: On the semantics and pragmatics of linguistic feedback. semantics 9(1) (1993)Google Scholar
- Bevacqua, E., Heylen, D., Pelachaud, C., Tellier, M.: Facial feedback signals for ecas. In: Proceedings of AISB 2007. Artificial and Ambient Intelligence, Newcastle University, Newcastle upon Tyne, UK (April 2007)Google Scholar
- Heylen, D.: Multimodal backchannel generation for conversational agents. In: van der Sluis, I., Theune, M., Reiter, E., Krahmer, E. (eds.) Workshop on Multimodal Output Generation, Aberdeen, Scotland (2007)Google Scholar
- Pelachaud, C., Bilvi, M.: Computational model of believable conversational agents. In: Huget, M.-P. (ed.) Communication in Multiagent Systems. LNCS (LNAI), vol. 2650, pp. 300–317. Springer, Heidelberg (2003)Google Scholar
- Poggi, I.: Backchannel: from humans to embodied agents. In: Conversational Informatics for Supporting Social Intelligence and Interaction - Situational and Environmental Information Enforcing Involvement in Conversation workshop in AISB 2005. University of Hertfordshire, Hatfield, England (2005)Google Scholar
- Yngve, V.: On getting a word in edgewise. In: Papers from the Sixth Regional Meeting of the Chicago Linguistic Society, pp. 567–577 (1970)Google Scholar