Advertisement

Attention, Perception, & Psychophysics

, Volume 81, Issue 7, pp 2354–2364 | Cite as

The role of motor context in the beneficial effects of hand gesture on memory

  • Kimberly M. HalvorsonEmail author
  • Alexa Bushinski
  • Caitlin Hilverman
Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition

Abstract

Viewing co-speech hand gestures with spoken phrases enhances memory for phrases, as compared to when the phrases are presented without gesture. Prior work investigating the mechanism underlying the effect of gesture on memory has implicated engagement of the motor system; when the hands are engaged in an unrelated motor task when viewing gesture, the beneficial effect of gesture is absent. However, one alternative interpretation of these findings is that the beneficial effect of gesture disappears due to mismatched contexts at encoding and retrieval: The hands are engaged during either encoding or retrieval, but not during both stages. Here we examined whether matching the motor context at encoding and retrieval plays a role in the beneficial effect of gesture on memory during a phrase recall task. Participants were presented with phrases that were viewed with and without gesture. Participants were assigned to one of four conditions that determined whether they would complete an unrelated motor task at (1) encoding only, (2) retrieval only, (3) both encoding and retrieval, or (4) neither. During stages in which they were not completing a motor task, participants’ hands were in their laps. We found that gesture enhanced memory for phrases both when participants engaged in an unrelated motor task at encoding and retrieval and when they did not complete the motor task during either stage. Furthermore, phrases observed with gesture were more likely to be paraphrased than to be recalled literally. Together, these findings demonstrate that gesture can enhance memory even when the motor system is engaged in another task, as long as that same task is performed at retrieval.

Keywords

Hand gesture Memory Motor system Gesture observation Perception and action Embodied cognition 

Notes

References

  1. Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68, 255–278.  https://doi.org/10.1016/j.jml.2012.11.001 CrossRefGoogle Scholar
  2. Beattie, G., & Shovelton, H. (1999). Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology, 18, 438–462.  https://doi.org/10.1177/0261927X99018004005 CrossRefGoogle Scholar
  3. Cohen, R. L. (1989). Memory for action events: The power of enactment. Educational Psychology Review, 1, 57–80.  https://doi.org/10.1007/BF01326550 CrossRefGoogle Scholar
  4. Cook, S. W., Duffy, R. G., & Fenn, K. M. (2013). Consolidation and transfer of learning after observing hand gesture. Child Development, 84, 1863–1871.  https://doi.org/10.1111/cdev.12097 CrossRefPubMedGoogle Scholar
  5. Cook, S. W., Mitchell, Z., & Goldin-Meadow, S. (2008). Gesturing makes learning last. Cognition, 106, 1047–1058.  https://doi.org/10.1016/j.cognition.2007.04.010 CrossRefPubMedGoogle Scholar
  6. Cook, S. W., Yip, T. K., & Goldin-Meadow, S. (2010). Gesturing makes memories that last. Journal of Memory and Language, 63, 465–475.  https://doi.org/10.1016/j.jml.2010.07.002 CrossRefPubMedPubMedCentralGoogle Scholar
  7. Cutica, I., & Bucciarelli, M. (2013). Cognitive change in learning from text: Gesturing enhances the construction of the text mental model. Journal of Cognitive Psychology, 25, 201–209.  https://doi.org/10.1080/20445911.2012.743987 CrossRefGoogle Scholar
  8. Cutica, I., Iani, F., & Bucciarelli, M. (2014). Learning from text benefits from enactment. Memory & Cognition, 42, 1026–1037.  https://doi.org/10.3758/s13421-014-0417-y CrossRefGoogle Scholar
  9. Engelkamp, J., & Krumnacker, H. (1980). Image- and motor-processes in the retention of verbal materials. Zeitschrift für Experimentelle und Angewandte Psychologie, 27, 511–533. Google Scholar
  10. Engelkamp, J., Zimmer, H. D., Mohr, G., & Sellen, O. (1994). Memory of self-performed tasks: Self-performing during recognition. Memory & Cognition, 22, 34–39.  https://doi.org/10.3758/BF03202759 CrossRefGoogle Scholar
  11. Feyereisen, P. (2006). Further investigation on the mnemonic effect of gestures: Their meaning matters. European Journal of Cognitive Psychology, 18, 185–205.  https://doi.org/10.1080/09541440540000158 CrossRefGoogle Scholar
  12. Godden, D. R., & Baddeley, A. D. (1975). Context-dependent memory in two natural environments: on land and underwater. British Journal of Psychology, 66, 325–331.CrossRefGoogle Scholar
  13. Hilverman, C., Clough, S. A., Duff, M. C., & Cook, S. W. (2018). Patients with hippocampal amnesia successfully integrate gesture and speech. Neuropsychologia, 117, 332–338.  https://doi.org/10.1016/j.neuropsychologia.2018.06.012 CrossRefPubMedPubMedCentralGoogle Scholar
  14. Hilverman, C., Cook, S. W., & Duff, M. C. (2018). Hand gestures support word learning in patients with hippocampal amnesia. Hippocampus, 28, 406–415.  https://doi.org/10.1002/hipo.22840 CrossRefPubMedPubMedCentralGoogle Scholar
  15. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15, 495–514.  https://doi.org/10.3758/PBR.15.3.495 CrossRefGoogle Scholar
  16. Hostetter, A. B., & Alibali, M. W. (2018). Gesture as simulated action: Revisiting the framework. Psychonomic Bulletin & Review, 1–32.  https://doi.org/10.3758/s13423-018-1548-0.CrossRefGoogle Scholar
  17. Huff, M., Maurer, A. E., & Merkt, M. (2018). Producing gestures establishes a motor context for procedural learning tasks. Learning and Instruction, 58, 245–254.  https://doi.org/10.1016/j.learninstruc.2018.07.008 CrossRefGoogle Scholar
  18. Ianì, F., & Bucciarelli, M. (2017). Mechanisms underlying the beneficial effect of a speaker’s gestures on the listener. Journal of Memory and Language, 96, 110–121.  https://doi.org/10.1016/j.jml.2017.05.004 CrossRefGoogle Scholar
  19. Ianì, F., & Bucciarelli, M. (2018). Relevance of the listener’s motor system in recalling phrases enacted by the speaker. Memory, 26, 1084–1092.  https://doi.org/10.1080/09658211.2018.1433214 CrossRefPubMedGoogle Scholar
  20. Ianì, F., Burin, D., Salatino, A., Pia, L., Ricci, R., & Bucciarelli, M. (2018). The beneficial effect of a speaker’s gestures on the listener’s memory for action phrases: The pivotal role of the listener’s premotor cortex. Brain and Language, 180–182, 8–13.  https://doi.org/10.1016/j.bandl.2018.03.001 CrossRefPubMedGoogle Scholar
  21. Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577–592.  https://doi.org/10.1006/jmla.1999.2634 CrossRefGoogle Scholar
  22. Kelly, S. D., McDevitt, T., & Esch, M. (2009). Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language & Cognitive Processes, 24, 313–334.  https://doi.org/10.1080/01690960802365567 CrossRefGoogle Scholar
  23. Kroenke, K.-M., Mueller, K., Friederici, A. D., & Obrig, H. (2013). Learning by doing? The effect of gestures on implicit retrieval of newly acquired words. Cortex, 49, 2553–2568.  https://doi.org/10.1016/j.cortex.2012.11.016 CrossRefGoogle Scholar
  24. Macedonia, M. (2014). Bringing back the body into the mind: gestures enhance word learning in foreign language. Frontiers in Psychology, 5, 1467:1–6.  https://doi.org/10.3389/fpsyg.2014.01467 CrossRefPubMedPubMedCentralGoogle Scholar
  25. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.Google Scholar
  26. McNeill, D., Cassell, J., & McCullough, K.-E. (1994). Communicative effects of speech-mismatched gestures. Research on Language and Social Interaction, 27, 223–237.  https://doi.org/10.1207/s15327973rlsi2703_4 CrossRefGoogle Scholar
  27. Ping, R. M., Goldin-Meadow, S., & Beilock, S. L. (2013). Understanding gesture: Is the listener’s motor system involved? Journal of Experimental Psychology: General, 143, 195–204.  https://doi.org/10.1037/a0032246.Understanding CrossRefGoogle Scholar
  28. Quandt, L. C., Marshall, P. J., Shipley, T. F., Beilock, S. L., & Goldin-Meadow, S. (2012). Sensitivity of alpha and beta oscillations to sensorimotor characteristics of action: An EEG study of action production and gesture observation. Neuropsychologia, 50, 2745–2751.  https://doi.org/10.1016/j.neuropsychologia.2012.08.005 CrossRefPubMedPubMedCentralGoogle Scholar
  29. Stevanoni, E., & Salmon, K. (2005). Giving memory a hand: Instructing children to gesture enhances their event recall. Journal of Nonverbal Behavior, 29, 217–233.  https://doi.org/10.1007/s10919-005-7721-y CrossRefGoogle Scholar
  30. Tulving, E., & Thomson, D. M. (1973). Encoding specificity and retrieval processes in episodic memory. Psychological Review, 80, 352–373.  https://doi.org/10.1037/h0020071 CrossRefGoogle Scholar
  31. Wakefield, E. M., James, T. W., & James, K. H. (2013). Neural correlates of gesture processing across human development. Cognitive Neuropsychology, 30, 58–76.  https://doi.org/10.1080/02643294.2013.794777 CrossRefPubMedGoogle Scholar
  32. Zimmer, H. D., & Engelkamp, J. (1984). Planungs- und Ausführungsanteile motorischer Gedächtniskomponenten und ihre Wirkung auf das Behalten ihrer verbalen Bezeichnungen [Planning and execution elements of motor memory components and their effect on the retention of their verbal descriptions]. Zeitschrift für Psychologie mit Zeitschrift für Angewandte Psychologie, 192, 379–402.Google Scholar

Copyright information

© The Psychonomic Society, Inc. 2019

Authors and Affiliations

  1. 1.Department of PsychologyMetropolitan State UniversitySt. PaulUSA
  2. 2.Department of Hearing and Speech SciencesVanderbilt University Medical CenterNashvilleUSA

Personalised recommendations