Advertisement

Cognitive Processing

, Volume 17, Issue 3, pp 269–277 | Cite as

Gesturing during mental problem solving reduces eye movements, especially for individuals with lower visual working memory capacity

  • Wim T. J. L. Pouw
  • Myrto-Foteini Mavilidi
  • Tamara van Gog
  • Fred Paas
Research Report

Abstract

Non-communicative hand gestures have been found to benefit problem-solving performance. These gestures seem to compensate for limited internal cognitive capacities, such as visual working memory capacity. Yet, it is not clear how gestures might perform this cognitive function. One hypothesis is that gesturing is a means to spatially index mental simulations, thereby reducing the need for visually projecting the mental simulation onto the visual presentation of the task. If that hypothesis is correct, less eye movements should be made when participants gesture during problem solving than when they do not gesture. We therefore used mobile eye tracking to investigate the effect of co-thought gesturing and visual working memory capacity on eye movements during mental solving of the Tower of Hanoi problem. Results revealed that gesturing indeed reduced the number of eye movements (lower saccade counts), especially for participants with a relatively lower visual working memory capacity. Subsequent problem-solving performance was not affected by having (not) gestured during the mental solving phase. The current findings suggest that our understanding of gestures in problem solving could be improved by taking into account eye movements during gesturing.

Keywords

Gesture Problem solving Eye tracking Embodied cognition Tower of Hanoi 

Notes

Acknowledgments

This research was funded by the Netherlands Organisation for Scientific Research (NWO-PROO, project number: 411-10-908) and supported by Vereniging Trustfonds Erasmus Universiteit Rotterdam (97010.11/14.0798). The authors would like to express their gratitude to Charly Eielts for programming the working memory task and Rolf Zwaan for his comments on earlier versions of the manuscript. We would also like to thank two anonymous reviewers for their valuable comments on the original manuscript.

References

  1. Brandt SA, Stark LW (1997) Spontaneous eye movements during visual imagery reflect the content of the visual scene. J Cogn Neurosci 9(1):27–38. doi: 10.1162/jocn.1997.9.1.27 CrossRefPubMedGoogle Scholar
  2. Bremner AJ, Cowie D (2013) Developmental origins of the hand in the mind, and the role of the hand in the development of the mind. In: Radman Z (ed) The hand, an organ of the mind: What the manual tells the mental. MIT Press, Cambridge, pp 255–268Google Scholar
  3. Cappuccio ML, Chu M, Kita S (2013) Pointing as an instrumental gesture: Gaze representation through indication. Humana. Mente: Journal of Philosophical Studies 24:125–149Google Scholar
  4. Chu M, Kita S (2011) The nature of gestures’ beneficial role in spatial problem solving. J Exp Psychol Gen 140(1):102–115. doi: 10.1037/a0021790 CrossRefPubMedGoogle Scholar
  5. Chu M, Meyer A, Foulkes L, Kita S (2013) Individual differences in frequency and salience of speech-accompanying gestures: the role of cognitive abilities and empathy. J Exp Psychol Gen 143:694–709. doi: 10.1037/a0033861 CrossRefPubMedPubMedCentralGoogle Scholar
  6. Clark A (2013) Gesture as thought. In: Radman Z (ed) The hand, an organ of the mind: What the manual tells the mental. MIT Press, Cambridge, pp 255–268Google Scholar
  7. Cook SW, Tanenhaus MK (2009) Embodied communication: speakers’ gestures affect listeners’ actions. Cognition 113(1):98–104. doi: 10.1016/j.cognition.2009.06.006 CrossRefPubMedPubMedCentralGoogle Scholar
  8. Cooperrider, K., Wakefield, E., & Goldin-Meadow, S (2015). More than Meets the Eye: Gesture Changes Thought, even without Visual Feedback. Proceedings of the 37th Annual Meeting of the Cognitive Science Society. Austin, TX: Cognitive Science SocietyGoogle Scholar
  9. Delgado B, Gómez JC, Sarriá E (2011) Pointing gestures as a cognitive tool in young children: experimental evidence. J Exp Child Psychol 110:299–312. doi: 10.1016/j.jecp.2011.04.010 CrossRefPubMedGoogle Scholar
  10. Della Sala S, Gray C, Baddeley A, Wilson L (1997) The visual patterns test: A new test of short-term visual recall. Bury St. Edmunds, Thames Valley TestGoogle Scholar
  11. Garber P, Goldin-Meadow S (2002) Gesture offers insight into problem-solving in adults and children. Cognitive Science 26(6):817–831. doi: 10.1016/S0364-0213(02)00087-3 CrossRefGoogle Scholar
  12. Johansson R, Holsanova J, Holmqvist K (2006) Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cognitive Science 30(6):1053–1079. doi: 10.1207/s15516709cog0000_86 CrossRefPubMedGoogle Scholar
  13. Kirsh D (2009) Projection, problem space and anchoring. Proceedings of the 31st annual conference of the cognitive science society. Lawrence Erlbaum Associates, Hillsdale, pp 2310–2315Google Scholar
  14. Laeng B, Teodorescu DS (2002) Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science 26(2):207–231. doi: 10.1016/S0364-0213(01)00065-9 CrossRefGoogle Scholar
  15. Lee IA, Preacher KJ (2013) Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from http://quantpsy.org. Accessed 17 Mar 2016
  16. Logan T, Lowrie T, Diezmann CM (2014) Co-thought gestures: supporting students to successfully navigate map tasks. Educational Studies in Mathematics 87:87–102. doi: 10.1007/s10649-014-9546-2 CrossRefGoogle Scholar
  17. Marstaller L, Burianová H (2013) Individual differences in the gesture effect on working memory. Psychon Bull Rev 20:496–500. doi: 10.3758/s13423-012-0365-0 CrossRefPubMedGoogle Scholar
  18. Patsenko EG, Altmann EM (2010) How planful is routine behavior? A selective-attention model of performance in the Tower of Hanoi. J Exp Psychol Gen 139(1):95. doi: 10.1037/a0018268 CrossRefPubMedGoogle Scholar
  19. Pouw WTJL, Hostetter AB (2016) Gesture as predictive action (under review) Google Scholar
  20. Pouw WTJL, De Nooijer JA, Van Gog T, Zwaan RA, Paas F (2014) Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology 5:359. doi: 10.3389/fpsyg.2014.00359 CrossRefPubMedPubMedCentralGoogle Scholar
  21. Pouw, W. T. J. L., Eielts, C., van Gog, T., Zwaan, R. A., & Paas, F. (under review). When gestures are put into thought: The role of co-thought gestures, visual working memory, and task complexity in problem-solvingGoogle Scholar
  22. Smithson L, Nicoladis E (2014) Lending a hand to imagery? The impact of visuospatial working memory interference upon iconic gesture production in a narrative task. J Nonverbal Behav 38(2):247–258CrossRefGoogle Scholar
  23. Spivey MJ, Dale R (2011) Eye movements both reveal and influence problem solving. In: Liversedge SP, Gilchrist ID, Everling S (eds) The Oxford handbook on eye movements. Oxford University Press, Oxford, pp 551–562Google Scholar
  24. Thomas LE, Lleras A (2007) Moving eyes and moving thought: on the spatial compatibility between eye movements and cognition. Psychon Bull Rev 14(4):663–668. doi: 10.3758/BF03196818 CrossRefPubMedGoogle Scholar

Copyright information

© Marta Olivetti Belardinelli and Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.Department of Psychology, Education and Child StudiesErasmus University RotterdamRotterdamThe Netherlands
  2. 2.Early Start Research InstituteUniversity of WollongongWollongongAustralia
  3. 3.Department of EducationUtrecht UniversityUtrechtThe Netherlands

Personalised recommendations