Skip to main content
Log in

Observing social gestures: an fMRI study

  • Research Article
  • Published:
Experimental Brain Research Aims and scope Submit manuscript

Abstract

We investigated the effects of social content of gestures on brain activation patterns. We used a 3 × 3 × 3 factorial design in an event-related functional magnetic resonance imaging experiment with participants observing gestures varied by type (fascist salute, wave, or arm lift), number of images shown at a time, and face frequency. We sought to determine whether increasing the social content of the gesture spreads activation from traditional sensorimotor regions engaged in mirror neuron activity to prefrontal regions concerned with social behavior. Results indicate that viewing a highly provocative gesture (fascist salute) compared to a less provocative but still socially meaningful gesture (wave) reveals activation in prefrontal and limbic areas. In addition, as expected there was more inferior frontal gyrus activation when participants observed a greater number of gesturing actors. Additionally, the psychological characteristics of shame and defeat affected activation in the inferior parietal lobe, which is part of the mirror neuron system, for the fascist salute compared to the wave contrast. We conclude that observing social gestures activates social- and emotion-processing areas of the brain, and the activation varies depending on the observer’s psychological characteristics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Allan S, Gilbert P (1995) A social comparison scale: psychometric properties and relationship to psychopathology. Pers Individ Dif 19:293–299

    Article  Google Scholar 

  • Allan S, Gilbert P (1997) Submissive behavior and psychopathology. Br J Clin Psychol 36(Pt.4):467–488

    PubMed  Google Scholar 

  • Bargh JA, Chen M, Burrows L (1996) Automaticity of social behavior: direct effects of trait construct and stereotype-activation on action. J Pers Soc Psychol 71:230–244

    Article  PubMed  CAS  Google Scholar 

  • Binkofski F, Amunts K, Stephan KM, Posse S, Schormann T, Freund HJ, Zilles K, Seitz RJ (2000) Broca’s region subserves imagery of motion: a combined cytoarchitectonic and fMRI study. Hum Brain Mapp 11:273–285

    Article  PubMed  CAS  Google Scholar 

  • Breiter HC, Etcoff NL, Whalen PJ, Kennedy WA, Rauch SL, Buckner RL, et al (1996) Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17:875–887

    Article  PubMed  CAS  Google Scholar 

  • Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, Seitz RJ, Zilles K, Rizzolatti G, Freund H-J (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci 13:400–404

    Article  PubMed  CAS  Google Scholar 

  • Buckner RL (1998) Event-related fMRI and the hemodynamic response. Hum Brain Mapp 6:373–377

    Article  PubMed  CAS  Google Scholar 

  • Buckner RL, Goodman J, Burock MA, Rotte M, Koutstaal W, Schacter DL, et al (1998) Functional-anatomic correlates of object priming in humans revealed by rapid presentation event-related fMRI. Neuron 20:285–296

    Article  PubMed  CAS  Google Scholar 

  • Calarge C, Andreasen NC, O’Leary DS (2003) Visualizing how one brain understands another: a PET study of theory of mind. Am J Psychiatry 160:1954–1964

    Article  PubMed  Google Scholar 

  • Canli T, Zhao Z, Desmond JE, Kang E, Gross J, Gabrieli JD (2001) An fMRI study of personality influences on brain reactivity to emotional stimuli. Behav Neurosci 115:33–42

    Article  PubMed  CAS  Google Scholar 

  • Chartrand TL, Bargh JA (1999) The chameleon effect: the perception-behavior link and social interaction. J Pers Soc Psychol 76:893–910

    Article  PubMed  CAS  Google Scholar 

  • Costafreda SG, Brammer MJ, David AS, Fu CH (2007) Predictors of amygdala activation during the processing of emotional stimuli: a meta-analysis of 385 PET and fMRI studies. Brain Res Rev doi:10.1016/j.brainresrev.2007.10.012

  • Dale AM (1999) Optimal design for event-related fMRI. Hum Brain Mapp 8:109–114

    Article  PubMed  CAS  Google Scholar 

  • Darby D (2004) MacStim 3.0 computer program, West Melbourne, WhiteAnt Occasional Publishing, Version 3.2 for Mac OS X

  • Damasio AR, Grabowski TJ, Bechara A, Damasio H, Ponto LLB, Parvizi J, Hichwa RD (2000) Subcortical and cortical brain activity during the feeling of self-generated emotions. Nat Neurosci 3:1049–1056

    Article  PubMed  CAS  Google Scholar 

  • Deutsch M, Gerard HB (1955) A study of normative and informational social influences upon individual judgment. J Abnorm Psychol 51:629–636

    Article  PubMed  CAS  Google Scholar 

  • di Pellegrino G, Fadiga L, Fogassi L, Gallese V, Rizzolatti G (1992) Understanding motor events: a neurophysiological study. Exp Brain Res 91:176–180

    Article  PubMed  CAS  Google Scholar 

  • Diener E, Fraser SC, Beaman AL, Kelem RT (1976) Effects of deindividuation variables on stealing among Halloween trick-or-treaters. J Pers Soc Psychol 33:178–183

    Article  Google Scholar 

  • Fletcher PC, Happe F, Frith U, Baker SC, Dolan RJ, Frackowiak RS, et al (1995) Other minds in the brain: a functional imaging study of ‘theory of mind’ in story comprehension. Cognition 57:109–128

    Article  PubMed  CAS  Google Scholar 

  • Friston K (2003) SPM2. Wellcome Department of Imaging Neuroscience, London

  • Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R (1998) Event-related fMRI: characterizing differential responses. Neuroimage 7:30–40

    Article  PubMed  CAS  Google Scholar 

  • Friston KJ, Holmes AP, Worsley KJ (1999) How many subjects constitute a study? Neuroimage 10:1–5

    Article  PubMed  CAS  Google Scholar 

  • Gallese V, Goldman A (1998) Mirror neurons and the simulation theory of mind-reading. Trends Cogn Sci 2:493–501

    Article  Google Scholar 

  • Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119:593–609

    Article  PubMed  Google Scholar 

  • Gallese V, Keysers C, Rizzolatti G (2004) A unifying view of the basis of social cognition. Trends Cogn Sci 8:396–403

    Article  PubMed  Google Scholar 

  • Gee A, Troop NA (2003) Shame, depressive symptoms and eating, weight and shape concerns in a non-clinical sample. Eat Weight Disord 8:72–75

    PubMed  CAS  Google Scholar 

  • Gilbert P, Allan S (1998) The role of defeat and entrapment (arrested flight) in depression: an exploration of an evolutionary view. Psychol Med 28:585–598

    Article  PubMed  CAS  Google Scholar 

  • Gitelman DR, Penny WD, Ashburner J, Friston K (2003) Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution. Neuroimage 19:200–207

    PubMed  Google Scholar 

  • Glover GH (1999) Deconvolution of impulse response in event-related BOLD fMRI. Neuroimage 9:416–429

    Article  PubMed  CAS  Google Scholar 

  • Goel V, Grafman J (1995) Are the frontal lobes implicated in “planning” functions? Interpreting data from the Tower of Hanoi. Neuropsychologia 33:623–642

    Article  PubMed  CAS  Google Scholar 

  • Gordon HL, Baird AA, End A (2004) Functional differences among those high and low on a trait measure of psychopathy. Biol Psychiatry 56:516–521

    Article  PubMed  Google Scholar 

  • Grezes J, Costes N, Decety J (1998) Top-down effect of strategy on the perception of human biological motion: a PET investigation. Cogn Neuropsychol 15:553–582

    Article  Google Scholar 

  • Grezes J, Armony JL, Rowe J, Passingham R (2003) Activations related to “mirror” and “canonical” neurones in the human brain: an fMRI study. Neuroimage 18:928–937

    Article  PubMed  CAS  Google Scholar 

  • Grezes J, Pichon S, de Gelder B (2006) Perceiving fear in dynamic body expressions. Neuroimage 35:959–967

    Article  Google Scholar 

  • Grosbras M-H, Paus T (2006) Brain networks involved in viewing angry hands or faces. Cereb Cortex 16:1087–1096

    Article  PubMed  Google Scholar 

  • Haxby JV, Horwitz B, Ungerleider LG, Maisog JM, Pietrini P, Grady CL (1994) The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J Neurosci 14:6336–6353

    PubMed  CAS  Google Scholar 

  • Hinrichs H, Scholz M, Tempelmann C, Woldorff MG, Dale AM, Heinze HJ (2000) Deconvolution of event-related fMRI responses in fast-rate experimental designs: tracking amplitude variations. J Cogn Neurosci 12(Suppl 2):76–89

    Article  PubMed  Google Scholar 

  • Iacoboni M, Woods R, Brass M, Bekkering H, Mazziotta JC, Rizzolatti G (1999) Cortical mechanisms of human imitation. Science 286:2526–2528

    Article  PubMed  CAS  Google Scholar 

  • Jarvelainen J, Schurmann M, Hari R (2004) Activation of the human primary motor cortex during observation of tool use. Neuroimage 23:187–192

    Article  PubMed  Google Scholar 

  • Jenkins IH, Brooks DJ, Nixon PD, Frackowiak R, Passingham RE (1994) Motor sequence learning: a study with positron emission tomography. J Neurosci 14:3775–3790

    PubMed  CAS  Google Scholar 

  • Johnston S, Leek EC, Atherton C, Thacker N, Jackson A (2004) Functional contribution of medial premotor cortex to visuo-spatial transformation in humans. Neurosci Lett 355:209–212

    Article  PubMed  CAS  Google Scholar 

  • Josephs O, Turner R, Friston K (1997) Event-related fMRI. Hum Brain Mapp 5:243–248

    Article  Google Scholar 

  • Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–4311

    PubMed  CAS  Google Scholar 

  • Knutson KM, Wood JN, Spampinato MV, Grafman J (2006) Politics on the brain: an fMRI investigation. Soc Neurosci 1:25–40

    Article  PubMed  Google Scholar 

  • Koechlin E, Basso G, Pietrini P, Panzer S, Grafman J (1999) The role of the anterior prefrontal cortex in human cognition. Nature 399:148–151

    Article  PubMed  CAS  Google Scholar 

  • Lakin JL, Chartrand TL (2003) Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol Sci 14:334–339

    Article  PubMed  Google Scholar 

  • Leslie KR, Johnson-Frey SH, Grafton ST (2004) Functional imaging of face and hand imitation: towards a motor theory of empathy. Neuroimage 21:601–607

    Article  PubMed  Google Scholar 

  • Levesque J, Eugene F, Joanette Y, Paquette V, Mensour B, Beaudoin G, Leroux J-M, Bourgouin P, Beauregard M (2003) Neural circuitry underlying voluntary suppression of sadness. Biol Psychiatry 53:502–510

    Article  PubMed  Google Scholar 

  • Lotze M, Heymans U, Birbaumer N, Veit R, Erb M, Flor H, Halsband U (2006) Differential cerebral activation during observation of expressive gestures and motor acts. Neuropsychologia 44:1787–1795

    Article  PubMed  CAS  Google Scholar 

  • Marin RS, Firinciogullari S, Biedrzycki RC (1993) The sources of convergence between measures of apathy and depression. J Affect Disord 28:117–124

    Article  PubMed  CAS  Google Scholar 

  • Moll J, Eslinger PJ, Oliveira-Souza R (2001) Frontopolar and anterior temporal cortex activation in a moral judgment task: preliminary functional MRI results in normal subjects. Arq Neuropsiquiatr 59:657–664

    PubMed  CAS  Google Scholar 

  • Morris JS, Frith CD, Perrett DI, Rowland D, Young AW, Calder AJ, Dolan RJ (1996) A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383:812–815

    Article  PubMed  CAS  Google Scholar 

  • Nelissen K, Luppino G, Vanduffel W, Rizzolatti G, Orban GA (2005) Observing others: multiple action representation in the frontal lobe. Science 310:332–336

    Article  PubMed  CAS  Google Scholar 

  • Nishitani N, Hari R (2000) Temporal dynamics of cortical representation for action. Proc Natl Acad Sci USA 97:913–918

    Article  PubMed  CAS  Google Scholar 

  • Overall JE, Zisook S (1980) Diagnosis and the phenomenology of depressive disorders. J Consult Clin Psychol 48:626–634

    Article  PubMed  CAS  Google Scholar 

  • Parsons LM, Fox PT, Downs JH, Glass T, Hirsch TB, Martin CC, Jerabek PA, Lancaster JL (1995) Use of implicit motor imagery for visual shape discrimination as revealed by PET. Nature 375:54–58

    Article  PubMed  CAS  Google Scholar 

  • Pelphrey KA, Singerman JD, Allison T, McCarthy G (2003) Brain activation evoked by perception of gaze shifts: the influence of context. Neuropsychologia 41:156–170

    Article  PubMed  Google Scholar 

  • Pelphrey KA, Morris JP, McCarthy G (2004a) Grasping the intentions of others: the perceived intentionality of an action influences activity in the superior temporal sulcus during social perception. J Cogn Neurosci 16:1706–1716

    Article  PubMed  Google Scholar 

  • Pelphrey KA, Viola RJ, McCarthy G (2004b) When strangers pass: processing of mutual and averted social gaze in the superior temporal sulcus. Psychol Sci 15:598–603

    Article  PubMed  Google Scholar 

  • Pfeifer JH, Iacoboni M, Mazziotta JC, Dapretto M (2008) Mirroring others’ emotions relates to empathy and interpersonal competence in children. Neuroimage 39:2076–2085

    Article  PubMed  Google Scholar 

  • Phillips ML, Young AW, Senior C, Brammer M, Andrew C, Calder AJ, Bullmore ET, Perrett DI, Rowland D, Williams SC, et al (1997) A specific neural substrate for perceiving facial expressions of disgust. Nature 389:495–498

    Article  PubMed  CAS  Google Scholar 

  • Postmes T, Spears R (1998) Deindividuation and antinormative behavior: a meta-analysis. Psychol Bull 123:238–259

    Article  Google Scholar 

  • Price JS (1972) Genetic and phylogenetic aspects of mood variations. Int J Ment Health 1:124–144

    Google Scholar 

  • Rizzolatti G, Craighero L (2004) The mirror-neuron system. Annu Rev Neurosci 27:169–192

    Article  PubMed  CAS  Google Scholar 

  • Rizzolatti G, Fogassi L, Gallese V (2001) Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci 2:661–670

    Article  PubMed  CAS  Google Scholar 

  • Rossion B, Caldara R, Seghier M, Schuller AM, Lazeyras F, Mayer E (2003a) A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain 126:2381–2395

    Article  PubMed  Google Scholar 

  • Rossion B, Schiltz C, Crommelinck M (2003b) The functionally defined right occipital and fusiform “face areas” discriminate novel from visually familiar faces. Neuroimage 19:877–883

    Article  PubMed  Google Scholar 

  • Rubia K, Smith AB, Brammer MJ, Taylor E (2003) Right interior prefrontal cortex mediates response inhibition while mesial prefrontal cortex is responsible for error detection. Neuroimage 20:351–358

    Article  PubMed  Google Scholar 

  • Saxe R, Kanwisher N (2003) People thinking about thinking people. The role of the temporo-parietal junction in “theory of mind”. Neuroimage 19:1835–1842

    Article  PubMed  CAS  Google Scholar 

  • Schwartz CE, Wright CI, Shin LM, Kagan J, Whalen PJ, McMullin KG, Rauch SL (2003) Differential amygdalar response to novel versus newly familiar neutral faces: a functional MRI probe developed for studying inhibited temperament. Biol Psychiatry 53:854–862

    Article  PubMed  Google Scholar 

  • Tai YF, Scherfler C, Brooks DJ, Sawamoto N, Castiello U (2004) The human premotor cortex is “Mirror” only for biological actions. Curr Biol 14:117–120

    Article  PubMed  CAS  Google Scholar 

  • Todorov A, Gobbini MI, Evans KK, Haxby JV (2007) Spontaneous retrieval of affective person knowledge in face perception. Neuropsychologia 45:163–173

    Article  PubMed  Google Scholar 

  • van Baaren RB, Maddux WW, Chartrand TL, de Bouter C, van Knippenberg A (2003) It takes two to mimic: behavioral consequences of self-construals. J Pers Soc Psychol 84:1093–1102

    Article  PubMed  Google Scholar 

  • von Gunten A, Duc R (2007) Subtle imitation behavior in convenience samples of normal, demented, and currently depressed elderly subjects. Int J Geriatr Psychiatry 22:568–573

    Article  Google Scholar 

  • Weyrauch B, Huang J, Heisele B, Blanz V (2004) Component-based face recognition with 3D morphable models. In: First IEEE Workshop on Face Processing in Video, Washington, D.C

  • Whalen PJ (1998) Fear, vigilance, and ambiguity: initial neuroimaging studies of the human amygdala. Psychol Sci 7:177–188

    Google Scholar 

  • Wright CI, Martis B, Schwartz CE, Shin LM, Fischer HH, McMullin K, Rauch SL (2003) Novelty responses and differential effects of order in the amygdala, substantia innominata, and inferior temporal cortex. Neuroimage 18:660–669

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

The Massachusetts Institute of Technology and the Center for Biological and Computational Learning provided the database of facial images. The authors have no conflict of interest. Funding: This research was supported by the Intramural Research Program of the National Institutes of Health, National Institute of Neurological Disorders and Stroke.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jordan Grafman.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Knutson, K.M., McClellan, E.M. & Grafman, J. Observing social gestures: an fMRI study. Exp Brain Res 188, 187–198 (2008). https://doi.org/10.1007/s00221-008-1352-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00221-008-1352-6

Keywords

Navigation