Time to Change: Deciding When to Switch Action Plans during a Social Interaction

  • Eris Chinellato
  • Dimitri Ognibene
  • Luisa Sartori
  • Yiannis Demiris
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8064)


Building on the extensive cognitive science literature on the subject, this paper introduces a model of the brain mechanisms underlying social interactions in humans and other primates. The fundamental components of the model are the “Action Observation” and “Action Planning” Systems, dedicated respectively to interpreting/recognizing the partner’s movements and to plan actions suited to achieve certain goals. We have implemented a version of the model including reaching and grasping actions, and tuned on real experimental data coming from human psychophysical studies. The system is able to automatically detect the switching point in which the Action Planning System takes control over the Action Observation System, overriding the automatic imitation behaviour with a complementary social response. With such computational implementation we aim at validating the model and also at endowing an artificial agent with the ability of performing meaningful complementary responses to observed actions in social scenarios.


Social interaction motor simulation action observation action planning motor primitives 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Becchio, C., Manera, V., Sartori, L., Cavallo, A., Castiello, U.: Grasping intentions: from thought experiments to empirical evidence. Front Hum. Neurosci. 6, 117 (2012)CrossRefGoogle Scholar
  2. 2.
    Blakemore, S.-J., Frith, C.: The role of motor contagion in the prediction of action. Neuropsychologia 43(2), 260–267 (2005)CrossRefGoogle Scholar
  3. 3.
    Buccino, G., Binkofski, F., Fink, G.R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R.J., Zilles, K., Rizzolatti, G., Freund, H.J.: Action observation activates premotor and parietal areas in a somatotopic manner: an fmri study. Eur. J. Neurosci. 13(2), 400–404 (2001)Google Scholar
  4. 4.
    Cattaneo, L., Barchiesi, G., Tabarelli, D., Arfeller, C., Sato, M., Glenberg, A.M.: One’s motor performance predictably modulates the understanding of others’ actions through adaptation of premotor visuo-motor neurons. Soc. Cogn. Affect Neurosci. 6(3), 301–310 (2011)CrossRefGoogle Scholar
  5. 5.
    Chinellato, E., Antonelli, M., Grzyb, B.J., del Pobil, A.P.: Implicit sensorimotor mapping of the peripersonal space by gazing and reaching. IEEE Transactions on Autonomous Mental Development (2011) (in press)Google Scholar
  6. 6.
    Chinellato, E., del Pobil, A.P.: Neural coding in the dorsal visual stream. In: Asada, M., Hallam, J.C.T., Meyer, J.-A., Tani, J. (eds.) SAB 2008. LNCS (LNAI), vol. 5040, pp. 230–239. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Chinellato, E., del Pobil, A.P.: The neuroscience of vision-based grasping: a functional review for computational modeling and bio-inspired robotics. Journal of Integrative Neuroscience 8(2), 223–254 (2009)CrossRefGoogle Scholar
  8. 8.
    Costantini, M., Committeri, G., Sinigaglia, C.: Ready both to your and to my hands: mapping the action space of others. PLoS One 6(4), e17923 (2011)Google Scholar
  9. 9.
    Culham, J.C., Valyear, K.F.: Human parietal cortex in action 16(2), 205–212 (2006)Google Scholar
  10. 10.
    Demiris, Y., Khadhouri, B.: Hierarchical attentive multiple models for execution and recognition of actions. Robotics and Autonomous Systems 54, 361–369 (2006)CrossRefGoogle Scholar
  11. 11.
    Fabbri-Destro, M., Rizzolatti, G.: Mirror neurons and mirror systems in monkeys and humans. Physiology (Bethesda) 23, 171–179 (2008)CrossRefGoogle Scholar
  12. 12.
    Fadiga, L., Craighero, L., Olivier, E.: Human motor cortex excitability during the perception of others’ action. 15(2), 213–218 (2005)Google Scholar
  13. 13.
    Heyes, C.: Automatic imitation. Psychol. Bull. 137(3), 463–483 (2011)CrossRefGoogle Scholar
  14. 14.
    Jackson, P.L., Meltzoff, A.N., Decety, J.: Neural circuits involved in imitation and perspective-taking. Neuroimage 31(1), 429–439 (2006)CrossRefGoogle Scholar
  15. 15.
    Jastorff, J., Begliomini, C., Fabbri-Destro, M., Rizzolatti, G., Orban, G.A.: Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. J. Neurophysiol. 104(1), 128–140 (2010)CrossRefGoogle Scholar
  16. 16.
    Mukamel, R., Ekstrom, A.D., Kaplan, J., Iacoboni, M., Fried, I.: Single-neuron responses in humans during execution and observation of actions. Curr. Biol. 20(8), 750–756 (2010)CrossRefGoogle Scholar
  17. 17.
    Ognibene, D., Chinellato, E., Sarabia, M., Demiris, Y.: Towards contextual action recognition and target localization with active allocation of attention. In: Prescott, T.J., Lepora, N.F., Mura, A., Verschure, P.F.M.J. (eds.) Living Machines 2012. LNCS, vol. 7375, pp. 192–203. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  18. 18.
    Sartori, L., Bucchioni, G., Castiello, U.: When emulation becomes reciprocity. Soc. Cogn. Affect Neurosci. (May 2012)Google Scholar
  19. 19.
    Sartori, L., Cavallo, A., Bucchioni, G., Castiello, U.: From simulation to reciprocity: the case of complementary actions. Soc. Neurosci. 7(2), 146–158 (2012)CrossRefGoogle Scholar
  20. 20.
    Spunt, R.P., Lieberman, M.D.: The busy social brain: evidence for automaticity and control in the neural systems supporting social cognition and action understanding. Psychol. Sci. 24(1), 80–86 (2013)CrossRefGoogle Scholar
  21. 21.
    Wilson, M., Knoblich, G.: The case for motor involvement in perceiving conspecifics. Psychol. Bull. 131(3), 460–473 (2005)CrossRefGoogle Scholar
  22. 22.
    Wolpert, D.M., Doya, K., Kawato, M.: A unifying computational framework for motor control and social interaction. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 358(1431), 593–602 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Eris Chinellato
    • 1
  • Dimitri Ognibene
    • 1
  • Luisa Sartori
    • 2
  • Yiannis Demiris
    • 1
  1. 1.Department of Electrical and Electronic EngineeringImperial College LondonUK
  2. 2.Department of General PsychologyUniversity of PadovaItaly

Personalised recommendations