Do Iconic Hand Gestures Really Contribute to the Communication of Semantic Information in a Face-to-Face Context?
Previous research has shown that iconic gestures are effective at communicating semantic information, particularly about the size and relative position of objects. However, the conclusions of these experiments have been somewhat limited by the fact that the methodology has typically involved presenting gesture–speech samples on video rather than in an actual face-to-face context. Because these different viewing conditions can impact on addressees’ behavior and perception, and therefore potentially impact on the amount of information they receive from gestures, the present study compares the communicative effectiveness of iconic gestures when viewed in a face-to-face context compared to when viewed on video. The results are quite striking in that gestures seemed at least as effective, and in some cases even more effective at communicating position and size information when they occurred in the face-to-face condition compared to video.
KeywordsIconic gesture Face-to-face communication Semantic features Size information Relative position information
We would like to thank two anonymous reviewers, as well as Prof. Judith Hall, for their invaluable comments on an earlier version of this manuscript. We would also like to thank Lucy Treanor for her assistance in collecting the data, William Newell for his invaluable acting performances, as well as the participants who took part in this investigation. The research was funded through a grant from the Faculty of Medical and Human Sciences at the University of Manchester awarded to Judith Holler. During the duration of this study, Geoffrey Beattie and Heather Shovelton were supported by a research grant from the Economic and Social Research Council (RES-000-22-1917).
- Argyle, M. (1975). Bodily communication. London: Routledge.Google Scholar
- Argyle, M., & Cook, M. (1976). Gaze and mutual gaze. Cambridge: Cambridge University Press.Google Scholar
- Argyle, M., & Ingham, R. (1972). Gaze, mutual gaze, and proximity. Semiotica, 1, 32–49.Google Scholar
- Beattie, G. (1983). Talk: An analysis of speech and non-verbal behaviour in conversation. Milton Keynes: Open University Press.Google Scholar
- Beattie, G. (2003). Visible thought: The new psychology of body language. London: Routledge.Google Scholar
- Beattie, G., & Shovelton, H. (in press). An exploration of the other side of semantic communication. How the spontaneous movements of the human hand add crucial meaning to narrative. Semiotica.Google Scholar
- Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. London: Belknap Press of Harvard University Press.Google Scholar
- Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. New York: Academic Press.Google Scholar
- Graham, J. A., & Argyle, M. (1975). A cross-cultural study of the communication of extra-verbal meaning by gestures. Journal of Human Movement Studies, 1, 33–39.Google Scholar
- Gullberg, M. (2003). Eye movements and gestures in human interaction. In J. Hyönä, R. Radach, & H. Deubel (Eds.), The mind’s eyes: Cognitive and applied aspects of eye movements (pp. 685–703). Oxford: Elsevier.Google Scholar
- Gullberg, M., & Holmqvist, K. (1998). Focus on gesture: Visual attention towards gestures in conversation. LUCS, Lund: Department of Cognitive Science.Google Scholar
- Holler, J. (2003). Semantic and pragmatic aspects of representational gestures: Towards a more unified model of communication. Unpublished doctoral thesis, University of Manchester, UK.Google Scholar
- Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In M. Ritchie Key (Ed.), The relationship of verbal and nonverbal communication (pp. 207–227). The Hague: Mouton.Google Scholar
- Kendon, A. (2000). Language and gesture: Unity or duality? In D. McNeill (Ed.), Language and gesture (pp. 47–63). Cambridge: Cambridge University Press.Google Scholar
- Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.Google Scholar
- McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar