Basics of Intersubjectivity Dynamics: Model of Synchrony Emergence When Dialogue Partners Understand Each Other

  • Ken Prepin
  • Catherine Pelachaud
Part of the Communications in Computer and Information Science book series (CCIS, volume 271)


Since Condon’s annotations of videotaped interactions in 1966, an increasing amount of studies points the crucial role of non-verbal behaviours in communication. Among others, synchrony between interactants is claimed to be an evidence of the interaction quality: to give to humans a feeling of natural dialogue, agents must be able to react on appropriate time. Recent dynamical models propose that synchrony emerges from the coupling between interactants. We propose here, and test in simulation, a model of verbal communication which links the mutual understanding of dialogue partners to the emergence of synchrony between their non-verbal behaviours: if interactants understand each other, synchrony emerges; if they do not understand, synchrony is disrupted. In addition to propose and test a model explaining the link between synchrony and interaction quality (synchrony accounts for mutual understanding and good interaction, di-synchrony accounts for misunderstanding) our tests point the fact that synchronisation and di-synchronisation emerging from mutual understanding are fast phenomenons: agents have a quick answer to whether they understand each other or not.


Internal State Shared Understanding Mutual Understanding Virtual Agent Interaction Quality 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Auvray, M., Lenay, C., Stewart, J.: Perceptual interactions in a minimalist virtual environment. New Ideas in Psychology 27, 32–47 (2009)CrossRefGoogle Scholar
  2. 2.
    Chammat, M., Foucher, A., Nadel, J., Dubal, S.: Reading sadness beyond human faces. Brain Research (2010) (in Press, accepted, manuscript)Google Scholar
  3. 3.
    Condon, W.S.: An analysis of behavioral organisation. Sign Language Studies 13, 285–318 (1976)Google Scholar
  4. 4.
    Condon, W.S., Ogston, W.D.: Sound film analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease 143, 338–347 (1966)CrossRefGoogle Scholar
  5. 5.
    Dubal, S., Jouvent, A.F.R., Nadel, J.: Human brain spots emotion in non humanoid robots. Social Cognitive and Affective Neuroscience (2010) (in press)Google Scholar
  6. 6.
    Ducan, S.: Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23(2), 283–292 (1972)CrossRefGoogle Scholar
  7. 7.
    Dumas, G., Nadel, J., Soussignan, R., Martinerie, J., Garnero, L.: Inter-brain synchonization during social interaction. PLoS One 5(8), e12166 (2010)CrossRefGoogle Scholar
  8. 8.
    Bernieri, F.J.: Coordinated movement and rapport in teacher-student interactions. Journal of Nonverbal Behavior 12(2), 120–138 (1988)CrossRefGoogle Scholar
  9. 9.
    Gaussier, P., Cocquerez, J.: Neural networks for complex scene recognition :simulation of a visual system with several cortical areas. In: IJCNN, Baltimore, pp. 233–259 (1992)Google Scholar
  10. 10.
    Gaussier, P., Zrehen, S.: Avoiding the world model trap: An acting robot does not need to be so smart. Journal of Robotics and Computer-Integrated Manufacturing 11(4), 279–286 (1994)CrossRefGoogle Scholar
  11. 11.
    Hatfield, E., Cacioppo, J.L., Rapson, R.L.: Emotional contagion. Current Directions in Psychological Sciences 2, 96–99 (1993)CrossRefGoogle Scholar
  12. 12.
    Kendon, A.: Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge University Press, Cambridge (1990)Google Scholar
  13. 13.
    LaFrance, M.: Nonverbal synchrony and rapport: Analysis by the cross-lag panel technique. Social Psychology Quarterly 42(1), 66–70 (1979)CrossRefGoogle Scholar
  14. 14.
    Matsumoto, D., Willingham, B.: Spontaneous facial expressions of emotion in congenitally and non-congenitally blind individuals. Journal of Personality and Social Psychology 96(1), 1–10 (2009)CrossRefGoogle Scholar
  15. 15.
    Mertan, B., Nadel, J., Leveau, H.: The effect of adult presence on communicative behaviour among toddlers. In: New Perspective in Early Communicative Development. Routledge, London (1993)Google Scholar
  16. 16.
    Murray, L., Trevarthen, C.: Emotional regulation of interactions vetween two-month-olds and their mothers. In: Social Perception in Infants, pp. 101–125 (1985)Google Scholar
  17. 17.
    Nadel, J.: Imitation and imitation recognition: their functional role in preverbal infants and nonverbal children with autism, pp. 42–62. Cambridge University Press, UK (2002)Google Scholar
  18. 18.
    Nadel, J., Tremblay-Leveau, H.: Early perception of social contingencies and interpersonal intentionality: dyadic and triadic paradigms. In: Early Social Cognition, pp. 189–212. Lawrence Erlbaum Associates (1999)Google Scholar
  19. 19.
    Paolo, E.A.D., Rohde, M., Iizuka, H.: Sensitivity to social contingency or stability of interaction? modelling the dynamics of perceptual crossing. New Ideas in Psychology 26, 278–294 (2008)CrossRefGoogle Scholar
  20. 20.
    Pelachaud, C.: Modelling multimodal expression of emotion in a virtual agent. Philosophical Transactions of Royal Society. Biological Science 364, 3539–3548 (2009)CrossRefGoogle Scholar
  21. 21.
    Pikovsky, A., Rosenblum, M., Kurths, J.: Synchronization: A Universal Concept in Nonlinear Sciences. Cambridge University Press, Cambridge (2001)zbMATHCrossRefGoogle Scholar
  22. 22.
    Poggi, I., Pelachaud, C.: Emotional Meaning and Expression in Animated Faces. In: Paiva, A.C.R. (ed.) IWAI 1999. LNCS, vol. 1814, pp. 182–195. Springer, Heidelberg (2000)Google Scholar
  23. 23.
    Prepin, K., Revel, A.: Human-machine interaction as a model of machine-machine interaction: how to make machines interact as humans do. Advanced Robotics 21(15), 1709–1723 (2007)CrossRefGoogle Scholar
  24. 24.
    Prepin, K., Gaussier, P.: How an Agent Can Detect and use Synchrony Parameter of its Own Interaction with a Human? In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds.) Second COST 2102. LNCS, vol. 5967, pp. 50–65. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  25. 25.
    Scherer, K., Delplanque, S.: Emotions, signal processing, and behaviour. Firmenich, Geneva (2009)Google Scholar
  26. 26.
    Tronick, E., Als, H., Adamson, L., Wise, S., Brazelton, T.: The infants’ response to entrapment between contradictory messages in face-to-face interactions. Journal of the American Academy of Child Psychiatry (Psychiatrics) 17, 1–13 (1978)CrossRefGoogle Scholar
  27. 27.
    Yngve, V.H.: On getting a word in edgewise, pp. 567–578 (April 1970)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ken Prepin
    • 1
  • Catherine Pelachaud
    • 1
  1. 1.LTCI/TSITelecom-ParisTech/CNRSParisFrance

Personalised recommendations