Skip to main content
SpringerLink
Log in
Book cover

International Conference on Intelligent Virtual Agents

IVA 2016: Intelligent Virtual Agents pp 234–244Cite as

Facial Expressions of Appraisals Displayed by a Virtual Storyteller for Children

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10011))

Abstract

In this paper, we present a framework for an expressive virtual storyteller for children. Our virtual storyteller displays facial expressions of appraisals related to story events. The facial expressions are animated jointly with deictic gestures towards graphical elements representing story events. We describe a preliminary study that we conducted with 23 children. We discuss the impact of facial expressions of appraisals on children’s memorization of story events, their perception of characters’ appraisals, their subjective perception of the virtual storyteller and more generally how emotion combines with joint attention.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bartneck, C., Croft, E., Kulic, D.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)

    Article  Google Scholar 

  2. Beale, R., Creed, C.: Affective interaction: how emotional agents affect users. Int. J. Hum. Comput. Stud. 67(9), 755–776 (2009)

    Article  Google Scholar 

  3. Bernardini, S., Porayska-Pomsta, K., Smith, T.J.: ECHOES: an intelligent serious game for fostering social communication in children with autism. Inf. Sci. 264, 41–60 (2014)

    Article  Google Scholar 

  4. Bosse, T., Pontier, M., Siddiqui, G.F., Treur, J.: Incorporating emotion regulation into virtual stories. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 339–347. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74997-4_31

    Chapter  Google Scholar 

  5. Bruner, J.: The narrative construction of reality. Crit. Inquir. 18(1), 1–21 (1991)

    Article  Google Scholar 

  6. Buisine, S., Wang, Y., Grynszpan, O.: Empirical investigation of the temporal relations between speech and facial expressions of emotion. J. Multimodal User Interfaces 3(4), 263–270 (2009)

    Article  Google Scholar 

  7. Cassell, J., Bers, M.U.: Interactive storytelling systems for children: using technology to explore language and identity. J. Interact. Learn. Res. 9, 183–215 (1999)

    Google Scholar 

  8. Cavazza, M., Pizzi, D., Charles, F.: Emotional input for character-based interactive storytelling. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, pp. 313–320 (2009)

    Google Scholar 

  9. Courgeon, M., Clavel, C., Martin, J.C.: Modeling facial signs of appraisal during interaction: impact on users’ perception and behavior. AAMAS 59(1), 765–772 (2014)

    Google Scholar 

  10. Courgeon, M., Martin, J.C., Jacquemin, C.: Marc: a multimodal affective and reactive character. In: Proceedings of the 1st Workshop on Affective Interaction in Natural Environments (2008)

    Google Scholar 

  11. De Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From Greta’s mind to her face: modelling the dynamics of affective states in a conversational embodied agent. Int. J. Hum. Comput. Stud. 59(1), 81–118 (2003)

    Article  Google Scholar 

  12. Fridin, M.: Storytelling by a kindergarten social assistive robot: a tool for constructive learning in preschool education. Comput. Educ. 70, 53–64 (2014)

    Article  Google Scholar 

  13. Kiser, L.J., Baumgardner, B., Dorado, J.: Who are we, but for the stories we tell: family stories and healing. Psychol. Trauma Theory Res. Pract. Policy 2(3), 243–249 (2010)

    Article  Google Scholar 

  14. Krämer, N.C.: Social effects of virtual assistants. A review of empirical results with regard to communication. In: Prendinger, H., Lester, J., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 507–508. Springer, Heidelberg (2008). doi:10.1007/978-3-540-85483-8_63

    Chapter  Google Scholar 

  15. Le, Q.A., Hanoune, S., Pelachaud, C.: Design and implementation of an expressive gesture model for a humanoid robot. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots, pp. 134–140 (2011)

    Google Scholar 

  16. Marsella, S.C., Gratch, J.: EMA: a process model of appraisal dynamics. Cogn. Syst. Res. 10(1), 70–90 (2009)

    Article  Google Scholar 

  17. Marsella, S.C., Gratch, J., Petta, P.: Computational models of emotion. In: Scherer, K.R., Banziger, T., Roesch, E. (eds.) A Blueprint for Affective Computing: A Sourcebook and Manual, pp. 21–46. Oxford University Press, Oxford (2010)

    Google Scholar 

  18. Miller, S., Pennycuff, L.: The power of story: using storytelling to improve literacy learning. J. Cross Discip. Perspect. Educ. 1(1), 36–43 (2008)

    Google Scholar 

  19. Ochs, M.: Modélisation, formalisation et mise en oeuvre d’un agent rationnel dialoguant émotionnel empathique. Ph.D. thesis, Doctoral dissertation, Paris 8 (2007)

    Google Scholar 

  20. Ochs, M., Niewiadomski, R., Pelachaud, C.: How a virtual agent should smile? In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS (LNAI), vol. 6356, pp. 427–440. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15892-6_47

    Chapter  Google Scholar 

  21. Scaife, M., Bruner, J.: The capacity for joint visual attention in the infant. Nature 253(5489), 265–266 (1975)

    Article  Google Scholar 

  22. Scherer, K.R.: Appraisal considered as a process of multilevel sequential checking. In: Scherer, K.R., Schorr, A., Johnstone, T. (eds.) Appraisal processes in emotion: Theory, Methods, Research, pp. 92–120. Oxford University Press, New York (2001)

    Google Scholar 

  23. Silva, A., Vala, M., Paiva, A.: Papous: the virtual storyteller. In: Antonio, A., Aylett, R., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, pp. 171–180. Springer, Heidelberg (2001). doi:10.1007/3-540-44812-8_14

    Chapter  Google Scholar 

  24. Theune, M., Linssen, J., Alofs, T.: Acting, playing, or talking about the story: an annotation scheme for communication during interactive digital storytelling. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., C̨atak, G. (eds.) ICIDS 2013. LNCS, vol. 8230, pp. 132–143. Springer, Heidelberg (2013). doi:10.1007/978-3-319-02756-2_17

    Chapter  Google Scholar 

  25. Theune, M., Meijs, K., Heylen, D., Ordelman, R.: Generating expressive speech for storytelling applications. IEEE Trans. Audio Speech Lang. Process. 14(4), 1137–1144 (2006)

    Article  Google Scholar 

  26. Walker, J., Sproull, L., Subramani, R.: Using a human face in an interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Celebrating Interdependence, pp. 85–91 (1994)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Matthieu Courgeon for his help in the development of our virtual storyteller. A special thanks goes to the children, their parents and the director of the recreation center. Part of this work was funded by the Agence Nationale de la Recherche (ANR), project NARECA (ANR-13-CORD-0015).

Author information

Authors and Affiliations

  1. LIMSI, CNRS (UPR3251), Université Paris-Saclay, 91405, Orsay, France

    Nesrine Fourati, Sylvain Caillou, Nicolas Sabouret, Jean-Claude Martin & Celine Clavel

  2. PSY-NCA, Université de Rouen, 76000, Rouen, France

    Adeline Richard & Emilie Chanoni

Authors
  1. Nesrine Fourati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adeline Richard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sylvain Caillou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nicolas Sabouret
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jean-Claude Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Emilie Chanoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Celine Clavel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nesrine Fourati .

Editor information

Editors and Affiliations

  1. University of Southern California, Los Angeles, California, USA

    David Traum

  2. University of Southern California, Los Angeles, California, USA

    William Swartout

  3. US Army Research Laboratory, Los Angeles, California, USA

    Peter Khooshabeh

  4. Universität Bielefeld, Bielefeld, Nordrhein-Westfalen, Germany

    Stefan Kopp

  5. University of Southern California, Los Angeles, California, USA

    Stefan Scherer

  6. University of Southern California, Los Angeles, California, USA

    Anton Leuski

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Fourati, N. et al. (2016). Facial Expressions of Appraisals Displayed by a Virtual Storyteller for Children. In: Traum, D., Swartout, W., Khooshabeh, P., Kopp, S., Scherer, S., Leuski, A. (eds) Intelligent Virtual Agents. IVA 2016. Lecture Notes in Computer Science(), vol 10011. Springer, Cham. https://doi.org/10.1007/978-3-319-47665-0_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-47665-0_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-47664-3

  • Online ISBN: 978-3-319-47665-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation