Pointing Gestures and Synchronous Communication Management

  • Kristiina Jokinen


The focus of this paper is on pointing gestures that do not function as deictic pointing to a concrete referent but rather as structuring the flow of information. Examples are given on their use in giving feedback and creating a common ground in natural conversations, and their meaning is described with the help of semantic themes of the Index Finger Extended gesture family. A communication model is also sketched together with an exploration of the simultaneous occurrence of gestures and speech signals, using a two-way approach that combines top-down linguistic-pragmatic and bottom-up signal analysis.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Clark, H.H., Schaefer, E.F.: Contributing to Discourse. Cog. Sci. 13, 259–294 (1989)CrossRefGoogle Scholar
  2. 2.
    Traum, D.: Computational models of grounding in collaborative systems. In: Working Papers of the AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems, pp. 124–131. AAAI, Menlo Park (1999)Google Scholar
  3. 3.
    Jokinen, K.: Constructive Dialogue Management: Speech Interaction and Rational Agency. John Wiley, Chichester (2009a)CrossRefGoogle Scholar
  4. 4.
    Pickering, M., Garrod, S.: Towards a mechanistic psychology of dialogue. Behavioral and Brain Sciences 27, 169–226 (2004)Google Scholar
  5. 5.
    Goodwin, C.: Gestures as a resource for the organization of mutual orientation. Semiotica 62(1/2), 29–49 (1986)Google Scholar
  6. 6.
    Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)Google Scholar
  7. 7.
    Jokinen, K., Vanhasalo, M.: Stand-up Gestures – Annotation for Communication Management. In: Proceedings of the Nodalida Workshop on Multimodal Annotation, Tartu. NEALT Series of Language Technology (2009)Google Scholar
  8. 8.
    Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge (2003)Google Scholar
  9. 9.
    McNeill, D.: Gesture and Thought. University of Chicago Press, Chicago (2005)CrossRefGoogle Scholar
  10. 10.
    Kendon, A.: Gesture: Visible action as utterance, Cambridge (2004)Google Scholar
  11. 11.
    Bavelas, J., Chovil, N.: Visible acts of meaning. An Integrated Message Model of Language in Face-to-Face Dialogue. J. Lang and Soc. Psy. 19(2), 163–194 (2000)Google Scholar
  12. 12.
    Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. In: Martin, J.C., Paggio, P., Kuenlein, P., Stiefelhagen, R., Pianesi, F. (eds.) Multimodal corpora for modelling human multimodal behaviour; Special issue of the International Journal of Language Resources and Evaluation 41(3–4), 273–287 (2007)Google Scholar
  13. 13.
    Douglas, C.E., Campbell, N., Cowie, R., Roach, P.: Emotional speech: Towards a new generation of databases. Speech Comm. 40, 33–60 (2003)CrossRefMATHGoogle Scholar
  14. 14.
    Jokinen, K., Campbell, N.: Non-verbal Information Sources for Constructive Dialogue Management. Tutorial at LREC-2008. Marrakech, Marocco (2008)Google Scholar
  15. 15.
    Jokinen, K.: Gesturing in Alignment and Conversational Activity. In: Proceedings of the Pacific Linguistic Conference, Sapporo, Japan (2009b)Google Scholar
  16. 16.
    Carletta, J.: Announcing the AMI Meeting Corpus. The ELRA Newsletter 11(1), 3–5 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Kristiina Jokinen
    • 1
  1. 1.Department of Speech Sciences, University of HelsinkiUniversity of HelsinkiFinland

Personalised recommendations