Abstract
In this paper we will look into reactive models for embodied conversational agents for generating smiling behavior. One trigger for smiling behaviour is smiling of the human interlocutor which is used in reactive models based on mimicry. However, other features might be useful as well. In order to develop such models we look at the nonverbal context of smiles in human-human conversation. We make a distinction between three types of smiles - amused, polite and embarrassed - and highlighted differences in context where each type s in conversation. Using machine learning techniques we have build predictive models using the nonverbal contextual features analyzed. Results show that reactive models can offer an interesting contribution to the generation of smiling behaviors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ambadar, Z., Cohn, J.F., Reed, L.I.: All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous. Journal of Nonverbal Behavior 33(1), 17–34 (2009)
Aubergé, V., Cathiard, M.: Can we hear the prosody of smile? Speech Communication 40, 87–97 (2003)
Bevacqua, E., Hyniewska, S., Pelachaud, C.: Positive influence of smile backchannels in ECAs. In: Interacting with ECAs as Virtual Characters Workshop, the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems, AAMAS (2010)
Brunner, L.J.: Smiles can be back channels. Journal of Personality and Social Psychology 37(5), 728–734 (1979)
Cathcart, N., Carletta, J., Klein, E.: A shallow model of backchannel continuers in spoken dialogue. In: European ACL, pp. 51–58 (2003)
Gravano, A., Hirschberg, J.: Backchannel-Inviting Cues in Task-Oriented Dialogue. In: Interspeech 2009, Brighton, pp. 1019–1022 (2009)
Huijbregts, M.: Segmentation , Diarization and Speech Transcription: Surprise Data Unraveled. Phd thesis, University of Twente (2008)
de Kok, I., Heylen, D.: The MultiLis Corpus - Dealing with Individual Differences of Nonverbal Listening Behavior. In: Esposito, A., Esposito, A., Martone, R., Müller, V.C., Scarpetta, G. (eds.) COST 2010. LNCS, vol. 6456, pp. 362–375. Springer, Heidelberg (2011)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of International Conference on Machine Learning, pp. 282–289. Citeseer (2001)
Maatman, R.M., Gratch, J., Marsella, S.: Natural behavior of a listening agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 25–36. Springer, Heidelberg (2005)
Morency, L.P., de Kok, I., Gratch, J.: A probabilistic multimodal approach for predicting listener backchannels. Autonomous Agents and Multi-Agent Systems 20(1), 70–84 (2010)
Nijholt, A.: Embodied agents: A new impetus to humor research. In: TWLT20 - The Fools Day Workshop on Computation Humor, pp. 101–111. Citeseer, Trento, Italy (2002)
Traum, D.R.: A reactive-deliberative model of dialogue agency. In: Jennings, N.R., Wooldridge, M.J., Müller, J.P. (eds.) ECAI-WS 1996 and ATAL 1996. LNCS, vol. 1193, pp. 157–171. Springer, Heidelberg (1997)
Wooldridge, M.J.: An introduction to multiagent systems, 2nd edn. Wiley, New York (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
de Kok, I., Heylen, D. (2011). When Do We Smile? Analysis and Modeling of the Nonverbal Context of Listener Smiles in Conversation. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6974. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24600-5_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-24600-5_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24599-2
Online ISBN: 978-3-642-24600-5
eBook Packages: Computer ScienceComputer Science (R0)