Abstract
One traditional view of how speech and gesture interact in talk is that gestures represent information, which is largely redundant with respect to the information contained in the speech that they accompany. Other researchers, however, have primarily stressed a complementary interaction of gesture and speech, and yet others have emphasised that gesture and speech interact in a very flexible manner. These discrepant views have crucially different implications with regard to the communicative role of gestures. The study reported here offers a systematic and detailed investigation of this issue to gain further insights into how the two modalities interact in the representation of meaning. The findings support the notion of gesture and speech interacting in a highly flexible manner.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Birdwhistell, R.L.: Kinesics and Context. Essays on Body-Motion Communication. Allen Lane The Penguin Press, London (1970)
Krauss, R.M., Morrel-Samuels, P., Colasante, C.: Do conversational hand gestures communicate? Journal of Personality and Social Psychology 61, 743–754 (1991)
McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago (1992)
Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behaviour: Categories, Origins, Usage and Coding. Semiotica 1, 49–98 (1969)
Argyle, M.: Bodily Communication. Methuen and Co Ltd., London (1975)
Kendon, A.: Gesticulation and speech: Two aspects of the process of utterance. In: Key, M.R. (ed.) The Relationship of Verbal and Nonverbal Communication, pp. 207–227. Mouton, The Hague (1980)
Kendon, A.: Some Uses of Gesture. In: Tannen, D., Saville-Troike, M. (eds.) Perspectives on Silence, pp. 215–234. Ablex Publishing Corporation, Norwood New Jersey (1985)
Beattie, G., Shovelton, H.: Do Iconic Hand Gestures Really Contribute Anything to the Semantic Information Conveyed by Speech? An Experimental Investigation. Semiotica 123, 1–30 (1999)
Beattie, G., Shovelton, H.: Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech. Journal of Language and Social Psychology 18, 438–462 (1999)
Beattie, G., Shovelton, H.: An experimental investigation of the role of different types of iconic gesture in communication: A semantic feature approach. Gesture 1, 129–149 (2001)
Beattie, G., Shovelton, H.: An Experimental Investigation of Some Properties of Individual Iconic Gestures that Mediate their Communicative Power. British Journal of Psychology 93, 179–192 (2002)
Holler, J., Beattie, G.: How Iconic Gestures and Speech Interact in the Representation of Meaning: Are Both Aspects Really Integral to the Process? Semiotica 146, 81–116 (2003)
Butterworth, B., Hadar, U.: Gesture, speech, and computational stages: A reply to McNeill. Psychological Review 96, 168–174 (1989)
Krauss, R.M., Chen, Y., Gottesman, R.F.: Lexical gestures and lexical retrieval: A process model. In: McNeill, D. (ed.) Language and Gesture, pp. 261–283. Cambridge University Press, Cambridge (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Holler, J., Beattie, G. (2004). The Interaction of Iconic Gesture and Speech in Talk. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-24598-8_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21072-6
Online ISBN: 978-3-540-24598-8
eBook Packages: Springer Book Archive