Do Iconic Hand Gestures Really Contribute to the Communication of Semantic Information in a Face-to-Face Context?

Abstract

Previous research has shown that iconic gestures are effective at communicating semantic information, particularly about the size and relative position of objects. However, the conclusions of these experiments have been somewhat limited by the fact that the methodology has typically involved presenting gesture–speech samples on video rather than in an actual face-to-face context. Because these different viewing conditions can impact on addressees’ behavior and perception, and therefore potentially impact on the amount of information they receive from gestures, the present study compares the communicative effectiveness of iconic gestures when viewed in a face-to-face context compared to when viewed on video. The results are quite striking in that gestures seemed at least as effective, and in some cases even more effective at communicating position and size information when they occurred in the face-to-face condition compared to video.

Appendices

Appendix 1

Example cartoon script (for ‘Billy Whizz’) including speech and gestures (the gesture description is included in square brackets and transcribed in italics underneath and the part of speech that it accompanies. Images of the gestures are also included; the speaker’s face has been blurred in these images to provide anonymity). Insertions mark the parts of the narrative originally contributed by different speakers (here, speakers 1–4):

[SPEAKER 1:] It’s a family, with a woman, a husband and a little child. And the father’s saying ‘We’d like to buy a kitchen table and chair set.’ And the salesman in the furniture shop says ‘Certainly.’ And so then the salesman says ‘How about a bench set instead of a table and chair set’ and the father says that that’s not very safe, because he imagines them having breakfast and Billy is throwing the food all over the chairs. Then he says ‘It’s no use for our Billy’. So the salesman says ‘How about a table with single swivel chairs?’ And the Mother says ‘Oh no, we’ve had chairs like those before.’ And she remembers when Billy jumped onto the table instead of onto the chairs and the table went [spinning and all the food went all over the floor].

Right arm moves in two large clockwise circles, while the left hand moves away from the right arm

And she says ‘Yikes, he’s like a mad spinning top.’ So the salesman comes up with a solution, ‘I have the very table to suit you. It will be very safe.’ So the Mum says ‘Great.’ [SPEAKER 2:] And the guy has come up with a particular kitchen table set which is, it’s on a [pole which] moves up and down.

Hands apart, palms pointing towards each other, fingers curved, hands make two large rapid movements up and down

[SPEAKER 3:] So when Billy comes in he says ‘Where are the family?’ as the table can be [raised up towards the ceiling], so he can’t jump onto the table.

Hands are shoulder width apart, palms facing down, hands move upwards

And the Father says ‘Ha ha, the table lifts us out of harms way.’ [SPEAKER 4:] But then Billy’s laughing his head off ‘cos the table then moves to the very top of the ceiling and squashes the entire family.

Appendix 2