Language Resources and Evaluation

, Volume 41, Issue 3, pp 289–303

The importance of gaze and gesture in interactive multimodal explanation

Article

DOI: 10.1007/s10579-007-9058-0

Cite this article as:
Lund, K. Lang Resources & Evaluation (2007) 41: 289. doi:10.1007/s10579-007-9058-0

Abstract

The objective of this research is twofold. Firstly, we argue that gaze and gesture play an essential part in interactive explanation and that it is thus a multimodal phenomenon. Two corpora are analyzed: (1) a group of teacher novices and experts and (2) a student teacher dyad, both of whom construct explanations of students’ reasoning after viewing videos of student dyads who are solving physics problems. We illustrate roles of gaze in explanations constructed within a group and roles of gesture in explanation constructed within a dyad. Secondly, we show how the analysis of such knowledge-rich empirical data pinpoints particular difficulties in designing human–computer interfaces that can support explanation between humans, or a fortiori, that can support explanation between a human and a computer.

Keywords

Collaboration Computer-mediated human interaction Interactive explanation Gaze Gesture Multimodal communication 

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  1. 1.ICAR, CNRSUniversity of Lyon, École Normale Supérieure Lettres & Sciences HumainesLyon CedexFrance

Personalised recommendations