Advertisement

Experimental Brain Research

, Volume 153, Issue 4, pp 628–636 | Cite as

Audiovisual mirror neurons and action recognition

  • C. KeysersEmail author
  • E. Kohler
  • M. A. Umiltà
  • L. Nanetti
  • L. Fogassi
  • V. GalleseEmail author
Review

Abstract

Many object-related actions can be recognized both by their sound and by their vision. Here we describe a population of neurons in the ventral premotor cortex of the monkey that discharge both when the animal performs a specific action and when it hears or sees the same action performed by another individual. These 'audiovisual mirror neurons' therefore represent actions independently of whether these actions are performed, heard or seen. The magnitude of auditory and visual responses did not differ significantly in half the neurons. A neurometric analysis revealed that based on the response of these neurons, two actions could be discriminated with 97% accuracy.

Keywords

Audiovisual mirror neurons Action recognition Object-related actions Ventral premotor cortex Monkey Neurometric analysis 

Notes

Acknowledgements

The research was funded by a MIURST and an ESF Grant. E.K. was supported by a Fonds fuer Medizinische Forschung der Universitaet Zuerich fellowship, C.K. by an EU Marie-Curie Fellowship. We thank G. Rizzolatti for help and advice on all aspects of the work, G. Pavan, M. Manghi and C. Fossati for their invaluable help in computing and acoustics, S. Rozzi, M. Matelli, and G. Luppino for their anatomical advice and F. Orzi and P. Rossi for caring for the monkeys.

References

  1. Bach M, Bouis D, Fischer B (1983) An accurate and linear infrared oculometer. J Neurosci Methods 9:9–14PubMedGoogle Scholar
  2. Bi G, Poo M (2001) Synaptic modification by correlated activity: Hebb's postulate revisited. Annu Rev Neurosci 24:139–166CrossRefPubMedGoogle Scholar
  3. Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, Seitz RJ, Zilles K, Rizzolatti G, Freund HJ (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci 13:400–404CrossRefPubMedGoogle Scholar
  4. Cantalupo C, Hopkins WD (2001) Asymmetric Broca's area in great apes. Nature 414:505CrossRefPubMedGoogle Scholar
  5. Decety J, Grezes J (1999) Neural mechanisms subserving the perception of human actions. Trends Cogn Sci 3:172–178CrossRefPubMedGoogle Scholar
  6. Fadiga L, Fogassi L, Pavesi G, Rizzolatti G (1995) Motor facilitation during action observation: a magnetic stimulation study. J Neurophysiol 73:2608–2611PubMedGoogle Scholar
  7. Fries W (1984) Cortical projections to the superior colliculus in the macaque monkey: a retrograde study using horseradish peroxidase. J Comp Neurol 230:55–76Google Scholar
  8. Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119:593–609PubMedGoogle Scholar
  9. Grafton ST, Arbib MA, Fadiga L, Rizzolatti G (1996) Localization of grasp representations in humans by positron emission tomography. 2. Observation compared with imagination. Exp Brain Res 112:103–111PubMedGoogle Scholar
  10. Graziano MS, Reiss LA, Gross CG (1999) A neuronal representation of the location of nearby sounds. Nature 397:428–430Google Scholar
  11. Hebb DO (1949) The organization of behavior. Wiley, New YorkGoogle Scholar
  12. Keysers C, Xiao DK, Foldiak P, Perrett DI (2001) The speed of sight. J Cogn Neurosci 13:90–101CrossRefPubMedGoogle Scholar
  13. Kohler E, Keysers C, Umiltà MA, Fogassi L, Gallese V, Rizzolatti G (2002) Hearing sounds, understanding actions: action representation in mirror neurons. Science 297:846–848CrossRefPubMedGoogle Scholar
  14. Newsome WT, Britten KH, Movshon JA (1989) Neuronal correlates of a perceptual decision. Nature 341:52–54Google Scholar
  15. Rizzolatti G, Arbib MA (1998) Language within our grasp. Trends Neurosci 21:188–194PubMedGoogle Scholar
  16. Rizzolatti G, Fadiga L, Gallese V, Fogassi L (1996) Premotor cortex and the recognition of motor actions. Brain Res Cogn Brain Res 3:131–141CrossRefPubMedGoogle Scholar
  17. Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP (1999) Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci 12:1131–1136CrossRefGoogle Scholar
  18. Umiltà MA, Kohler E, Gallese V, Fogassi L, Fadiga L, Keysers C, Rizzolatti G (2001) I know what you are doing. A neurophysiological study. Neuron 31:155–165PubMedGoogle Scholar
  19. Watanabe M (1992) Frontal units of the monkey coding the associative significance of visual and auditory stimuli. Exp Brain Res 89:233–247PubMedGoogle Scholar

Copyright information

© Springer-Verlag 2003

Authors and Affiliations

  1. 1.Department of NeuroscienceUniversità di ParmaParmaItaly
  2. 2.Department of MathematicsUniversità di FerraraFerraraItaly
  3. 3.Department of PsychologyUniversità di ParmaParmaItaly

Personalised recommendations