What Gestures to Perform a Collaborative Storytelling?

  • Laurence Perron
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4871)


The idea behind 3D multi-user worlds is to use virtual reality techniques to allow several people to “exist” and play in the same virtual environment. In this way, technologies around non verbal behavior: voice and body movement are essential to coordinate "speech acts", actions with other partners or objects, to share space (localization, displacement, proxemy) and to improve the awareness, telepresence... Our studies are mainly centered on the non verbal behavior in small groups and on command gestures. Our aim is to carry out some experiences and transfer the results in design of a Storytelling Collaborative Virtual Environment (SCVE) without intrusive devices. Briefly, this paper presents our approach to design digital storytelling game.


non verbal behavior command gesture collaborative storytelling multimodality avatar Collaborative Virtual Environment 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Le Mer, P., Perron, L., Chaillou, C., Degrande, S., Saugis, G.: Collaborating with virtuals humans. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds.) People and computers XV - Interactions without frontiers. Joint proceedings of HCI 2001 and IHM 2001, pp. 83–103. Springer, Lille (2001)Google Scholar
  2. 2.
    Tapie, J., Terrier, P., Perron, L., Cellier, J.-M.: Should remote collaborators be represented by avatars? a study of an application used for collective medical decision-making. In: Special Issue: Collaborative distance activities: From social cognition to electronic togeherness, AI & Society (2005)Google Scholar
  3. 3.
    Perron, L.: An avatar with your own gestures. In: INTERACT 2005 Workshop Appropriate Methodology for Empirical Studies of Privacy. Communicating Naturally through Computers, Rome, Italy, September 12-16, 2005, pp. 12–16 (2005)Google Scholar
  4. 4.
    Kendira, A., Perron, L.: VIRSTORY: a Collaborative Virtual Storytelling. In: Harper, R., Rauterberg, M., Combetto, M. (eds.) ICEC 2006. LNCS, vol. 4161, pp. 20–22. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Buisine, S., Martin, J.C., Bernsen, N.O.: Children’s gesture and speech in Conversation with 3D Characters. In: International Conference of Human Computer Interaction, Las Vegas, NV USA (2005)Google Scholar
  6. 6.
    Cavazza, M., Martin, O., Charles, F., Mead, S., Marechal, W.: Users acting in mixed reality storytelling. In: Balet, O., Subsol, G., Torguet, P. (eds.) ICVS 2003. LNCS, vol. 2897, pp. 189–197. Springer, Heidelberg (2003)Google Scholar
  7. 7.
    Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Holzman, T., Winograd, T., Landay, J., Larson, J., Ferro, D.: Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions. In: Human Computer Interaction, ch. 19, MA, vol. 15, pp. 421–456, 263-322. Addison-Wesley Press, Reading (2001)Google Scholar
  8. 8.
    Kraut, R.E., Fussell, S.R., Siegel, J.: Visual Information as a Conversational Resource in Collaborative Physical Tasks. Human-Computer Interaction 18, 13–49 (2003)CrossRefGoogle Scholar
  9. 9.
    Feyereisen, P., Van de Wiele, M., Dubois, F.: The meaning of gestures: what can be unterderstood without speech? Cahiers de psychologie cognitive - European bulletin of cognitive psychology 8(1), 3–25 (1988)Google Scholar
  10. 10.
    Ekman, P., Friesen, W.V.: The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica 1, 49–98 (1969)Google Scholar
  11. 11.
    Cassell, J., Bickmore, T., Campbell, L., Vilhjálmsson, H., Yan, H.: Human conversation as a system framework: designing embodied conversational agents. In: Press, M. (ed.) Embodied conversational agents, pp. 29–63. MIT Press, Cambridge, MA, USA (2001)Google Scholar
  12. 12.
    Prendinger, H., Ishizuka, M.: Life-Like Characters: Tools, Affective Functions, and Applications. Springer, Heidelberg (2004)Google Scholar
  13. 13.
    Goldin-Meadow, S.: The role of gesture in communication and thinking. Cognitive Sciences 3(11), 419–429 (1999)CrossRefGoogle Scholar
  14. 14.
    Pina, A., Cerezo, E., et Seron, F.J.: Computer animation: from avatars to unrestricted autonomous actors (A survey on replication and modelling mechanisms). Computer & Graphics 24, 297–311 (2000)CrossRefGoogle Scholar
  15. 15.
    Kaur-Deol, K., Sutcliffe, A., Maiden, N.: Modelling interaction to inform information requirements in virtual environments. Interactions in Virtual Worlds, Enschede, Netherlands (1999)Google Scholar
  16. 16.
    Riva, G., Galimberti, C.: Galimberti Computer-mediated communication: identity and social interaction in an electronic environment. Genetic, Social and General Psychology Monographs 124, 434–464 (1998)Google Scholar
  17. 17.
    Pelachaud, C., Poggi, I.: Talking faces that communicates by eyes, ORALITE ET GESTUALITE: communication multimodale et interaction, Aix, pp. 211–218 (1998)Google Scholar
  18. 18.
    Whittaker, S., Geelhoed, E., Robinson, E.: Shared workspaces: how do they work and when are they useful? International Journal of Man-Machine Studies (1993)Google Scholar
  19. 19.
    Perron, L.: Non verbal et univers virtuels: comment collaborer via des clones, 15ème Conférence Francophone sur l’Interaction Homme-Machine, Caen (Novembre 25-28, 2003)Google Scholar
  20. 20.
    Carbini, S., Delphin-Poulat, L., Perron, L., Viallet, J.E.: From a wizard of Oz experiment to a real time speech and gesture multimodal interface. Signal Processing, Special issue on Multimodal Human Computer Interfaces (2005)Google Scholar
  21. 21.
    Masse, Laurence: La communication verbale et non verbale en situation d’entretien psychothérapeutique Thèse de doctorat en Psychologie - St Denis Université Paris 8 (1999)Google Scholar
  22. 22.
    Bouguet, A., Pavy, D., Le Mer, P.: Virtual Humans Animation in Collaborative Virtual Environment. In: CollabTech 2005, Japon (July 2005)Google Scholar
  23. 23.
    Kendira, A., Perron, L., Viallet, J.E., Carbini, S., Delphin-Poulat, L.: VIRSTORY: Using Human Behavior Studies to Design a Multimodal Collaborative Virtual Environment. In: Collab Tech 2006, Tsukuba Japon, pp. 114–119 (2006)Google Scholar
  24. 24.
    Pauchet, A., Coldefy, F., et al.: Mutual awareness in co-localized and distant collaborative tasks using shared interfaces. In: Interact 2007, September 2007, Rio de Janeiro, Brazil (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Laurence Perron
    • 1
  1. 1.FT R&D 2 Avenue Pierre-Marzin F- 22300 Lannion 

Personalised recommendations