Advertisement

Expressive Multimodal Conversational Acts for SAIBA Agents

  • Jeremy Riviere
  • Carole Adam
  • Sylvie Pesty
  • Catherine Pelachaud
  • Nadine Guiraud
  • Dominique Longin
  • Emiliano Lorini
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6895)

Abstract

We discuss here the need to define what we call an agent conversational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Expressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these acts. We have then implemented these EMCA for SAIBA-compliant ECA, and specifically for Greta. We were able to use Greta in experiments aimed at assessing the benefits of our language in terms of perceived sincerity and believability of an ECA using it to interact with a human user.

Keywords

ECA Emotions Interaction Dialogue 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bunt, H.: The dit++ taxonomy for functional dialogue markup. In: Proc. of AMAAS 2009 Workshop ”Towards a Standard Markup Language for Embodied Dialogue Acts” (2009)Google Scholar
  2. 2.
    Core, M.G., Allen, J.F.: Coding dialogs with the DAMSL annotation scheme. In: Proc. of the Working Notes of the AAAI Fall Symposium on Communicative Action in Humans and Machines, Cambridge, MA (1997)Google Scholar
  3. 3.
    Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Adding the emotional dimension to scripting character dialogues. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 48–56. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  4. 4.
    Gong, L.: How social is social responses to computers? the function of the degree of anthropomorphism in computer representations. Comput. Hum. Behav. 24, 1494–1509 (2008)CrossRefGoogle Scholar
  5. 5.
    Guiraud, N., Longin, D., Lorini, E., Pesty, S., Riviere, J.: The face of emotions: a logical formalization of expressive speech acts. In: Proc. of AAMAS 2011 (2011)Google Scholar
  6. 6.
    Lee, J., Marsella, S.: Nonverbal behavior generator for embodied conversational agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 243–255. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Lorini, E., Schwarzentruber, F.: A logic for reasoning about counterfactual emotions. Artificial Intelligence 175(3-4), 814–847 (2011)MathSciNetzbMATHCrossRefGoogle Scholar
  8. 8.
    Mancini, M., Pelachaud, C.: The fml-apml language. In: Proc. of the Workshop on FML at AAMAS 2008 (2008)Google Scholar
  9. 9.
    McRorie, M., Sneddon, I., de Sevin, E., Bevacqua, E., Pelachaud, C.: A model of personality and emotional traits. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 27–33. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  10. 10.
    Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., Carolis, B.D.: Greta: A believable embodied conversational agent. In: Multimodal Communication in Virtual Environments, pp. 27–45 (2005)Google Scholar
  11. 11.
    Searle, J.R.: Speech acts: an essay in the philosophy of language. Cambridge University Press, London (1969)Google Scholar
  12. 12.
    Vilhjálmsson, H.H., Cantelmo, N., Cassell, J., Chafai, N.E., Kipp, M., Kopp, S., Mancini, M., Marsella, S.C., Marshall, A.N., Pelachaud, C., Ruttkay, Z., Thórisson, K.R., van Welbergen, H., van der Werf, R.J.: The behavior markup language: Recent developments and challenges. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 99–111. Springer, Heidelberg (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jeremy Riviere
    • 1
  • Carole Adam
    • 1
  • Sylvie Pesty
    • 1
  • Catherine Pelachaud
    • 2
  • Nadine Guiraud
    • 3
  • Dominique Longin
    • 3
  • Emiliano Lorini
    • 3
  1. 1.Grenoble University - LIGGrenobleFrance
  2. 2.CNRS - Telecom ParisTechParisFrance
  3. 3.UPS - CNRS, IRITToulouseFrance

Personalised recommendations