Advertisement

Journal of Nonverbal Behavior

, Volume 42, Issue 3, pp 327–345 | Cite as

Not All Gestures are Created Equal: The Effects of Typical and Atypical Iconic Gestures on Narrative Comprehension

  • Nicole Dargue
  • Naomi Sweller
Original Paper

Abstract

Observing hand gestures during learning consistently benefits learners across a variety of tasks. How observation of gestures benefits learning, however, is yet unanswered, and cannot be answered without further understanding which types of gestures aid learning. Specifically, the effects of observing varying types of iconic gestures are yet to be established. Across two studies we examined the role that observing different types of iconic hand gestures has in assisting adult narrative comprehension. Some iconic hand gestures (typical gestures) were produced more frequently than others (atypical gestures). Crucially, observing these different types of gestures during a narrative comprehension task did not provide equal benefit for comprehension. Rather, observing typical gestures significantly enhanced narrative comprehension beyond observing atypical gestures or no gestures. We argue that iconic gestures may be split into separate categories of typical and atypical gestures, which in turn have differential effects on narrative comprehension.

Keywords

Narrative comprehension Iconic gesture Learning Communication 

Notes

Acknowledgements

Warmest thanks to Laura Eason for narration of the task, and to Alessandra Teunisse and Elizabeth Austin for double-coding the data. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Authors’ Contribution

Nicole Dargue and Naomi Sweller were jointly involved in conceptualising the design of the abovementioned studies. Nicole carried out all data collection and analysis. Both authors approve of the final manuscript.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Human and Animal Rights

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Furthermore, informed consent was obtained from all individual participants included in the study.

References

  1. Alibali, M. W., & DiRusso, A. (1999). The function of gesture in learning to count: More than keeping track. Cognitive Development, 14, 37–56.  https://doi.org/10.1016/S0885-2014(99)80017-3.CrossRefGoogle Scholar
  2. Arbib, M. A., Liebal, K., & Pika, S. (2008). Primate vocalization, gesture, and the evolution of human language. Current Anthropology, 49, 1053–1076.  https://doi.org/10.1086/593015.CrossRefPubMedGoogle Scholar
  3. Austin, E. E., & Sweller, N. (2018). Gesturing along the way: Adults’ and preschoolers’ communication of route direction information. Journal of Nonverbal Behavior, 42, 199–220.  https://doi.org/10.1007/s10919-017-0271-2.CrossRefGoogle Scholar
  4. Beattie, G., & Shovelton, H. (1999). Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology, 18, 438–462.  https://doi.org/10.1177/0261927X99018004005.CrossRefGoogle Scholar
  5. Cassell, J., McNeill, D., & Mccullough, K. (1999). Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics and Cognition, 7, 1–34.  https://doi.org/10.1075/pc.7.1.03cas.CrossRefGoogle Scholar
  6. Castro-Alonso, J. C., Ayres, P., & Paas, F. (2014). Learning from observing hands in static and animated versions of non-manipulative tasks. Learning and Instruction, 34, 11–21.  https://doi.org/10.1016/j.learninstruc.2014.07.005.CrossRefGoogle Scholar
  7. Chu, M., & Kita, S. (2011). The nature of gestures’ beneficial role in spatial problem-solving. Journal of Experimental Psychology: General, 140, 102–116.  https://doi.org/10.1037/a0021790.CrossRefGoogle Scholar
  8. Craik, F. I., & Lockhart, R. S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671–684.  https://doi.org/10.1016/S0022-5371(72)80001-X.CrossRefGoogle Scholar
  9. Craik, F. I., & Tulving, E. (1975). Depth of processing and the retention of words in episodic memory. Journal of Experimental Psychology: General, 104, 268–294.  https://doi.org/10.1037//0096-3445.104.3.268.CrossRefGoogle Scholar
  10. Cutica, I., & Bucciarelli, M. (2008). The deep versus the shallow: Effects of co-speech gestures in learning from discourse. Cognitive Science: A Multidisciplinary Journal, 32, 921–935.  https://doi.org/10.1080/03640210802222039.CrossRefGoogle Scholar
  11. Driskell, J. E., & Radtke, P. H. (2003). The effect of gesture on speech production and comprehension. Human Factors, 45, 445–454.  https://doi.org/10.1518/hfes.45.3.445.27258.CrossRefPubMedGoogle Scholar
  12. Dunn, L. M., & Dunn, D. M. (2007). Peabody picture vocabulary test (4th ed.). Minneapolis, MN: NCS Pearson, Inc.Google Scholar
  13. Galati, A., & Samuel, A. G. (2011). The role of speech-gesture congruency and delay in remembering action events. Language and Cognitive Processes, 26, 406–436.  https://doi.org/10.1080/01690965.2010.494846.CrossRefGoogle Scholar
  14. Holle, H., Gunter, T. C., Rüschemeyer, S., Hennenlotter, A., & Iacoboni, M. (2008). Neural correlates of the processing of co-speech gestures. NeuroImage, 39, 2010–2024.  https://doi.org/10.1016/j.neuroimage.2007.10.055.CrossRefPubMedGoogle Scholar
  15. Hough, M. S. (1990). Narrative comprehension in adults with right and left hemisphere brain-damage: Theme organisation. Brain and Language, 38, 253–277.  https://doi.org/10.1016/0093-934X(90)90114-V.CrossRefPubMedGoogle Scholar
  16. Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M. (2009). Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human Brain Mapping, 30, 1028–1037.  https://doi.org/10.1002/hbm.20565.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Joshi, R. M. (2005). Vocabulary: A critical component of comprehension. Reading and Writing Quarterly, 21, 209–219.  https://doi.org/10.1080/10573560590949278.CrossRefGoogle Scholar
  18. Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577–592.  https://doi.org/10.1006/jmla.1999.2634.CrossRefGoogle Scholar
  19. Kelly, S. D., & Church, R. B. (1998). A comparison between children’s and adults’ ability to detect conceptual information conveyed through representational gestures. Child Development, 69, 85–93.  https://doi.org/10.1111/j.1467-8624.1998.tb06135.x.CrossRefPubMedGoogle Scholar
  20. Kelly, S. D., Creigh, P., & Bartolotti, J. (2010). Integrating speech and iconic gestures in a stroop-like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 22, 683–694.  https://doi.org/10.1162/jocn.2009.21254.CrossRefPubMedGoogle Scholar
  21. Littlejohn, S. W., & Foss, K. A. (2010). Theories of human communication (10th ed.). Long Grove: Waveland Press Inc.Google Scholar
  22. Lyle, S. (2000). Narrative understanding: Developing a theoretical context for understanding how children make meaning in classroom settings. Journal of Curriculum Studies, 32(1), 45–63. Retrieved from http://web.a.ebscohost.com/ehost/pdfviewer/pdfviewer?sid = 82648f15-d783-4bac-b0dc-1828b792a9d5%40sessionmgr4003&vid = 1&hid = 4214.
  23. Macoun, A., & Sweller, N. (2016). Listening and watching: The effects of observing gesture on narrative comprehension. Cognitive Development, 40, 68–81.  https://doi.org/10.1016/j.cogdev.2016.08.005.CrossRefGoogle Scholar
  24. Marcus, N., Cleary, B., Wong, A., & Ayres, P. (2013). Should hand actions be observed when learning hand motor skills from instructional animations? Computers in Human Behavior, 29, 2172–2178.  https://doi.org/10.1016/j.chb.2013.04.035.CrossRefGoogle Scholar
  25. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: The University of Chicago Press.Google Scholar
  26. McNeil, N. M., Alibali, A. W., & Evans, J. L. (2000). The role of gesture in children’s comprehension of spoken language: Now they need it, now they don’t. Journal of Nonverbal Behaviour, 24, 131–150.  https://doi.org/10.1023/A:1006657929803.CrossRefGoogle Scholar
  27. Paris, A. H., & Paris, S. G. (2003). Assessing narrative comprehension in young children. International Reading Association, 38, 36–76.  https://doi.org/10.1598/RRQ.38.1.3.Google Scholar
  28. Schmithorst, V. J., Holland, S. K., & Plante, E. (2006). Cognitive modules utilized for narrative comprehension in children: A functional magnetic resonance imaging study. NeuroImage, 29, 254–266.  https://doi.org/10.1016/j.neuroimage.2005,07.020.CrossRefPubMedGoogle Scholar
  29. Stevanoni, E., & Salmon, K. (2005). Giving memory a hand: Instructing children to gesture enhances their event recall. Journal of Nonverbal Behaviour, 29, 217–233.  https://doi.org/10.1007/s10919-005-7721-y.CrossRefGoogle Scholar
  30. Sweller, J., van Merrienboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–296.  https://doi.org/10.1023/A:1022193728205.CrossRefGoogle Scholar
  31. Willems, R. M., Özyürek, A., & Hagoort, P. (2006). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17, 2322–2333.  https://doi.org/10.1093/cercor/bhl141.CrossRefPubMedGoogle Scholar
  32. Woodall, W. G., & Folger, J. P. (1981). Encoding specificity and nonverbal cue context: An expansion of episodic memory research. Communication Monographs, 48, 39–53.  https://doi.org/10.1080/03637758109376046.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Macquarie UniversitySydneyAustralia

Personalised recommendations