Skip to main content

Advertisement

SpringerLink
Log in

Design of an emotional and social interaction paradigm for the animation of 3D characters: the case of a therapy for brain injured people (the mirror neuron paradigm)

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

We propose an emotional and social interaction paradigm for the behavioural animation of virtual characters. Our research focuses on the production of verbal and paraverbal interactions between a human and a virtual character in the context of virtual therapy. The aim of this project is to assess virtual therapies for the rehabilitation of people with brain injuries caused by cerebral vascular accidents. The therapeutic paradigm is based on the neuroscience concept of “mirror neurones” which emphasise the perceptual side in the process of recovering neural damage. In our paradigm, the patient interacts with a virtual therapist (embodied autonomous agent) that guides and encourages him in order to fulfil the drills. Furthermore and following the “mirror neurone paradigm”, the patient can only see his virtual hands (which are handicapped). The virtual platform provides the patient with a vision of his hands undertaking a movement that he cannot perform. Doing so, we expect that the perception of this virtual movement may improve the recuperation (mirror neurone paradigm). In this paper, we also introduce the notion of an “intelligent emotional character” to produce a sense of social as well as emotional immersion in order to improve the interaction between the patient and the virtual therapist. We discuss the role of emotional interaction in the context of virtual social interaction and in particular its reflexive dimension. Finally, we present an architecture for the animation of virtual characters based on a multidisciplinary approach to model the emotional and social interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. French National Institute of Health and Medical Research

  2. www.Virtools.com

References

  1. Gratch J, Rickel J, André E, Badler N, Cassell J, Petajan E (2002) Creating interactive virtual humans: some assembly required. IEEE Intell Systems 17:54–63

    Article  Google Scholar 

  2. De Rosis F, Pelachaud C, Poggi I, Carofiglio V, De Carolis B (2003) From Greta’s mind to her face: modelling the dynamics of affective states in a conversational embodied agent. Int J Hum Comput Stud 59:81–118

    Article  Google Scholar 

  3. El Jed M, Pallamin N, Dugdale J, Pavard B (2004) Modelling character emotion in an interactive virtual environment. Presented at AISB’04 symposium: motion, emotion and cognition, Leeds, UK, pp 20–28

  4. El Jed M, Pallamin N, Pavard B (2006) Vers des communications situées. Presented at (Cite 2006) Coopération, Innovation et Technologie, Nantes, France, pp 11

  5. McCaffrey P (2003) CMSD 636 neuropathologies of language and cognition. California State University, Chico

    Google Scholar 

  6. Marque P (2005) Protocole de recherche clinique: evaluation par IRM fonctionnelle d’une séance de rééducation de l’extension du poignet par technique de réalité virtuelle chez des sujets cérébro-lésés. Hopitaux de Toulouse, Toulouse

    Google Scholar 

  7. Ramachandran VS (2000) Mirror neurons and imitation learning as the driving force behind “the great leap forward” in human evolution. Edge: no. 69. On line: http://www.edge.org/3rd_culture/ramachandran/ramachandran_p1.html

  8. Gallese V, Fadiga L, Foggassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brian 119:593–609

    Article  Google Scholar 

  9. Rizzolatti G, Craighero L (2004) The mirror-neuron system. Ann Rev Neurosci 27:169–192

    Article  Google Scholar 

  10. Iacoboni M, Molnar-Szakacs I, Gallese V, Buccino G, Mazziotta JC, Rizzolatti G (2005) Grasping the intentions of others with one’s own mirror neuron system. PLoS Biol 3:529–535

    Article  Google Scholar 

  11. Gallese V, Lakoff G (2005) The brain’s concepts: the role of the sensory-motor system in conceptual knowledge. Cognit Neuropsychol 22:455–479

    Article  Google Scholar 

  12. Sveistrup H (2004) Motor rehabilitation using virtual reality. J Neuroeng Rehabil 1:10. http://www.jneuroengrehab.com/content/pdf/1743-0003-1-10.pdf

  13. Holden MK (2005) Virtual environments for motor rehabilitation: review. Cyberpsychol Behav 8:187–211

    Article  Google Scholar 

  14. Keshner EA (2004) Virtual reality and physical rehabilitation: a new toy or a new research and rehabilitation tool? J Neuroeng Rehabil 1:8. On line: http://www.jneuroengrehab.com/content/pdf/1743-0003-1-8.pdf

  15. Riva G (1997) Virtual reality in neuro-psycho-physiology cognitive, clinical and methodological issues in assessment and treatment. In: Studies in health technology and informatics, vol 44. IOS Press, Amsterdam, pp 220

  16. Lewis CH, Griffin MJ (1997) Human factors consideration in clinical applications of virtual reality. In: Riva G (ed) Virtual reality in neuro-psycho-physiology cognitive, clinical and methodological issues in assessment and rehabilitation, vol 44. IOS Press, Amsterdam

    Google Scholar 

  17. Riva G (2003) Virtual reality as communication tool: a socio-cognitive analysis. In: Riva G, Davide F (eds) Communications through virtual technology: identity community and technology in the internet age. IOS Press, Amsterdam, pp 48–55

  18. Van der Straaten P (2000) Interaction affecting the sense of presence in virtual reality. Delft University of Technology, Faculty of Information Technology and System

  19. Riva G, Mantovani F, Gaggioli A (2004) Presence and rehabilitation: toward second-generation virtual reality applications in neuropsychology. J Neuroeng Rehabil 1:9. On line: http://www.jneuroengrehab.com/content/pdf/1743-0003-1-9.pdf

  20. Steuer J (1992) Defining virtual reality: dimensions determining telepresence. J Commun 42:73–93

    Article  Google Scholar 

  21. Lombard M, Ditton T (1997) At the heart of it all: the concept of presence 3:2. On line: http://www.jcmc.indiana.edu/vol3/issue2/lombard.html

  22. Riva G, Waterworth JA (2003) Presence and the self: a cognitive neuroscience approach. Presence Connect 3. On line: http://www.presence.cs.ucl.ac.uk/presenceconnect/articles/Apr2003/jwworthApr72003114532/jwworthApr72003114532.html

  23. Mantovani G, Riva G (1999) Real presence: how different ontologies generate different criteria for presence, telepresence, and virtual presence. Presence Teleoperators Virtual Environ 8:538–548

    Google Scholar 

  24. Adams E (2004) The designer’s notebook: postmodernism and the three types of immersion. http://www.Gamasutra.com

  25. Morales Rodriguez ML, Pavard B, Pallamin N (2005) Interactions sociales en univers virtuels vers une recherche d’immersion émotionnelle. Presented at Colloque scientifique: approches croisées de la création de logiciels et dispositifs numériques ludo-éducatif organisé dans le cadre du Forum du multimédia ludo-éducatif et pédagogique Ludovia, Saint-Lizier, France, pp 133–138

  26. Lelord F, André C (2003) La Force des émotions. Paris

  27. Cosnier J (2004) Les emotions et les sentiments. Beyrouth-Liban, pp 74

  28. Palmero F (1999) Emoción. Breve reseña del papel de la cognición y el estado afectivo. Rev Electrón Motivación y Emoción 2:2–3. On line: http://www.reme.uji.es/articulos/apalmf245161299/texto.html

  29. Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110:145–172

    Article  Google Scholar 

  30. Scherer KR, Schorr A, Johnstone T (2001) Appraisal processes in emotion theory, methods, research. In: Series in affective sciences. Oxford University Press, New York

  31. Russell JA (1991) Culture and the categorization of emotions. Psychol Bull 110:426–450

    Article  Google Scholar 

  32. Garcia-Prieto Sol Chevalier P (2003) The influence of social identity salience on appraisal and emotion. In: Section de psychologie. Université de Genève, Geneve, pp 270

  33. Pervin LA, John OP (1999) Handbook of personality—theory and Research, 2nd edn. The Guilford Press, New York, pp 738

  34. Popkins NC (1998) The five-factor model: emergence of a taxonomic model for personality psychology. In: Great ideas in personality. Northwestern University

  35. Mayer JD, Salovey P, Caruso D (2000) Models of emotional intelligence. In: Sternberg RJ (ed) Handbook of intelligence. Cambridge University Press, Cambridge, pp 396–420

    Google Scholar 

  36. Salovey P, Mayer JD (1990) Emotional intelligence. Imag Cognit Pers 9:185–211

    Google Scholar 

  37. Burkhardt A (1990) Speech acts, meaning and intentions:critical approaches to the philosophy of John R. Searle. Walter de Gruyter, New York

    Google Scholar 

  38. Bracops M (2005) Introduction à la pragmatique: les théories fondatrices: actes de langage, pragmatique. De Boeck Université

  39. Cohen RP, Morgan J, Pollack ME (1990) Intentions in communication. MIT Press, Cambridge, pp 520

    Google Scholar 

  40. Bouquet P, Ghidini C, Giunchiglia F, Blanzieri E (2003) Theories and uses of context in knowledge representation and reasoning. J Pragmatics Elsevier Sci 35:455–484

    Article  Google Scholar 

  41. Sperber D, Wilson D (1989) La Pertinence, communication et cognition. Les editions de minuit, Paris

    Google Scholar 

  42. Geis ML (1995) Speech acts and conversational interaction. Cambridge University Press New York

    Google Scholar 

  43. Goffman E (1974) Les rites d’interaction. Les editions de minuit, Paris

    Google Scholar 

  44. Philippot P, Feldman RS, Coats EJ (1999) The social context of nonverbal behavior. Cambridge University Press, Paris, p 446

    Google Scholar 

  45. Ting-Toomey S (1999) Communicating across cultures. Guilford Press, New York

    Google Scholar 

  46. Carlson LW (1985) Dialogue games: an approach to discourse analysis. D. Reidel Publishing Company, Boston

    Google Scholar 

  47. Feyereisen P, d. Lannoy JD (1991) Gestures and speech—psychological investigations. Cambridge University Press, Paris

    Google Scholar 

  48. Feldman RS, Rimé B (1991) Fundamentals of nonverbal behavior, vol xiv. Cambridge University Press, Cambridge, p 511

    Google Scholar 

  49. Siegman AW, Feldstein S (1985) Multichannel integrations of nonverbal behavior, vol xv. Lawrence Erlbaum Associates, New Jersey, p 285

    Google Scholar 

  50. Lecerf Y (1994) Le champ d’étude de l’ethnométhodologie. In: Textes & papers issus du courant radical de “l’ethnométhodologie et informatique” des universités de Paris VII et Paris VIII. On line: http://www.vadeker.club.fr/corpus/etude.htm

  51. Keel R (1999) Ethnomethodology and deviance. Sociol Deviant Behav. On line: http://www.umsl.edu/∼rkeel/200/ethdev.html

  52. Poor S (2000) An introduction to ethnomethodology. Sociology at Hewett. On line: http://www.hewett.norfolk.sch.uk/CURRIC/soc/ethno/intro.htm

  53. Garfinkel H, Sacks H (1970) On formal structures of practical actions. In: Mckinney JC, Tiryakian EA (eds) Theoretical sociology: perspectives and developments. Appleton Century Crofts, New York

  54. Lecerf Y (1985) Lexique ethnomethodologique. Pratiques de formation (analyses). Ethnométhodologies (Paris VIII)

  55. Palmero F (2003) La emocion desde el modelo cognitivista. Rev Electrón Motivación Emoción VI:14–15. On line: http://www.reme.uji.es/articulos/avillj3022401105/texto.html

Download references

Author information

Authors and Affiliations

  1. IRIT-GRIC, 118, route de Narbonne, 31062, Toulouse Cedex 4, France

    María Lucila Morales-Rodriguez & Bernard Pavard

Authors
  1. María Lucila Morales-Rodriguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernard Pavard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to María Lucila Morales-Rodriguez.

Additional information

This work is done in collaboration with the INSERM research center (French National Institute of Health and Medical Research) in the context of a joint PHRC (Hospital Clinical Research Program) dedicated to the improvement of therapeutic paradigms.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Morales-Rodriguez, M.L., Pavard, B. Design of an emotional and social interaction paradigm for the animation of 3D characters: the case of a therapy for brain injured people (the mirror neuron paradigm). Virtual Reality 11, 175–184 (2007). https://doi.org/10.1007/s10055-006-0063-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-006-0063-1

Keywords

Search

Navigation