Skip to main content
SpringerLink
Log in

Natural interaction with culturally adaptive virtual characters

  • Original Paper
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

Recently, the verbal and non-verbal behavior of virtual characters has become more and more sophisticated due to advances in behavior planning and rendering. Nevertheless, the appearance and behavior of these characters is in most cases based on the cultural background of their designers. Especially in combination with new natural interaction interfaces, there is the risk that characters developed for a particular culture might not find acceptance when being presented to another culture. A few attempts have been made to create characters that reflect a particular cultural background. However, interaction with these characters still remains an awkward experience in particular when it comes to non-verbal interaction. In many cases, human users either have to choose actions from a menu their avatar has to execute or they have to struggle with obtrusive interaction devices. In contrast, our paper combines an approach to the generation of culture-specific behaviors with full body avatar control based on the Kinect sensor. A first study revealed that users are able to easily control an avatar through their body movements and immediately adapt its behavior to the cultural background of the agents they interact with.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 4
Fig. 3
Fig. 5

Similar content being viewed by others

Notes

  1. http://www.openni.org.

  2. https://github.com/avin2/SensorKinect.

References

  1. Augsburg University (2011) Full Body Interaction Framework: http://hcm-lab.de/fubi.html

  2. Aylett R, Paiva A, Vannini N, Enz S, André E, Hall L (2009) But that was in another country: agents and intercultural empathy. In: Proceedings of AAMAS 2009

    Google Scholar 

  3. Bailenson JN, Blascovich J, Beall AC, Loomis JM (2001) Equilibrium theory revisited: Mutual gaze and personal space in virtual environments. Presence 10:538–598

    Google Scholar 

  4. Bleiweiss A, Eshar D, Kutliroff G, Lerner A, Oshrat Y, Yanai Y (2010) Enhanced interactive gaming by blending full-body tracking and gesture animation. In: ACM SIGGRAPH ASIA Sketches, SA ’10. ACM Press, New York

    Google Scholar 

  5. Damian I, Endrass B, Huber P, Bee N, André E (2011) Individualizing agent interactions. In: Proc of 4th int conf on motion in games (MIG 2001)

    Google Scholar 

  6. Endrass B, Nakano Y, Lipi A, Rehm M, André E (2011) Culture-related topic selection in SmallTalk conversations across Germany and Japan. In: Intelligent virtual agents 2011. Springer, Berlin

    Google Scholar 

  7. Endrass B, Rehm M, Lipi AA, Nakano Y, André E (2011) Culture-related differences in aspects of behavior for virtual characters across Germany and Japan. In: Yolum T, Stone S (eds) Proceedings of AAMAS 2011, pp 441–448

    Google Scholar 

  8. Ferraro GP (1998) The cultural dimension of international business. Prentice Hall, New York

    Google Scholar 

  9. Hall ET (1966) The hidden dimension. Doubleday, New York

    Google Scholar 

  10. Hofstede GJ, Pedersen PB, Hofstede G (2002) Exploring culture—exercises, stories and synthetic cultures. Intercultural Press, Yarmouth

    Google Scholar 

  11. Jan D, Herrera D, Martinovski B, Novick D, Traum D (2007) A computational model of culture-specific conversational behavior. In: Pelachaud C, et al. (eds) Intelligent virtual agents 2007. Springer, Berlin, pp 45–56

    Chapter  Google Scholar 

  12. Johnson WL, Valente A (2008) Tactical language and culture training systems: using artificial intelligence to teach foreign languages and cultures. In: Innovative applications of artificial intelligence (IAAI 2008). AAAI Press, Menlo Park, pp 1632–1639

    Google Scholar 

  13. Kendon A (1991) Conducting interaction: patterns of behavior in focused encounters. Cambridge University Press, Cambridge

    Google Scholar 

  14. Khan R, Angeli AD (2007) Mapping the demographics of virtual humans. In: Proceedings of the 21st British HCI group annual conference on people and computers: HCI…but not as we know it—Volume 2, BCS-HCI ’07. British Computer Society, London

    Google Scholar 

  15. Kistler F, Sollfrank D, Bee N, André E (2011) Full body gestures enhancing a game book for interactive story telling. In: Si M, Thue D, André E, Lester J, Tanenbaum J, Zammitto V (eds) Interactive storytelling. Lecture notes in computer science, vol 7069. Springer, Berlin/Heidelberg, pp 207–218

    Chapter  Google Scholar 

  16. Kratz S, Rohs M (2011) Protractor3d: a closed-form solution to rotation-invariant 3d gestures. In: Proceedings of the 16th international conference on Intelligent user interfaces, IUI ’11

    Google Scholar 

  17. Mascarenhas S, Dias J, Afonso N, Enz S, Paiva A (2009) Using rituals to express cultural differences in synthetic characters. In: Proceedings of AAMAS

    Google Scholar 

  18. Mashell’s Journal (2012) http://mashellsjournal.blogspot.com/2009/06/high-and-low-context-culture.html

  19. Nass C, Isbister K, Lee EJ (2000) Embodied conversational agents, chap. Truth is beauty: researching embodied conversational agents. MIT Press, Cambridge, pp 374–402

    Google Scholar 

  20. Pease A (1993) Body language: how to read other’s thoughts by their gestures. Sheldon Press, London

    Google Scholar 

  21. Pedica C, Vilhjálmsson H (2009) Spontaneous avatar behavior for human territoriality. In: Ruttkay Z, Kipp M, Nijholt A, Vilhjálmsson H (eds), Intelligent virtual agents. Lecture notes in computer science. Springer, Berlin/Heidelberg, pp 344–357

    Chapter  Google Scholar 

  22. Pelachaud C (2009) Studies on gesture expressivity for a virtual agent. Speech Commun 51:630–639. doi:10.1016/j.specom.2008.04.009. http://dl.acm.org/citation.cfm?id=1550956.1551018

    Article  Google Scholar 

  23. Rehm M, Bee N, André E (2008) Wave like an Egyptian—accelerometer based gesture recognition for culture specific interactions. In: HCI 2008 culture, creativity, interaction

    Google Scholar 

  24. Sussman NM, Rosenfeld HM (1982) Influence of culture language, and sex on conversational distance. J Pers Soc Psychol 42:66–74

    Article  Google Scholar 

  25. Watson O (1970) Proxemic behavior: a cross-cultural study. Mouton De Gruyter, Berlin

    Google Scholar 

  26. Wobbrock JO, Wilson AD, Li Y (2007) Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In: Proceedings of the 20th annual ACM symposium on User interface software and technology, UIST ’07, pp 159–168

    Chapter  Google Scholar 

  27. Wu P, Miller C (2010) Interactive phrasebook conveying culture through etiquette. In: CATS2010 held on ITS2010

    Google Scholar 

Download references

Acknowledgements

This work was funded by the European Commission within the 7th Framework Program under grant agreement eCute (education in cultural understanding, technologically enhanced).

Author information

Authors and Affiliations

  1. Human Centered Multimedia, Augsburg University, Universitätsstr. 6a, 86159, Augsburg, Germany

    Felix Kistler, Birgit Endrass, Ionut Damian, Chi Tai Dang & Elisabeth André

Authors
  1. Felix Kistler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Birgit Endrass
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ionut Damian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chi Tai Dang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Elisabeth André
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Felix Kistler.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kistler, F., Endrass, B., Damian, I. et al. Natural interaction with culturally adaptive virtual characters. J Multimodal User Interfaces 6, 39–47 (2012). https://doi.org/10.1007/s12193-011-0087-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-011-0087-z

Keywords

Search

Navigation