Advertisement

The Role of Discourse Structure and Response Time in Multimodal Communication

  • Patrick Jeuniaux
  • Max M. Louwerse
  • Xiangen Hu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4133)

Abstract

In an ongoing project on multimodal communication in humans and agents [1], we investigate the interaction between two linguistic modalities (prosody and dialog structure) and two non-linguistic modalities (eye gaze and facial expressions). The goal is to gain a better understanding of the use of communicative channels in discourse and can subsequently aid the development of more effective animated conversational agents. We studied conversations between humans involved in the Map Task scenario whereby an Instruction Giver (IG) navigates an Instruction Follower (IF) from a starting point to an end point on a map [2].

References

  1. 1.
    Louwerse, M., Jeuniaux, P., Hoque, M., Wu, J., Lewis, G.: Multimodal Communication in Computer-Mediated Map Task Scenarios. In: The 28th Annual Conference of the Cognitive Science Society, Vancouver, Canada (July 3, 2006)Google Scholar
  2. 2.
    Anderson, A., Bader, M., Bard, E., Boyle, E., Doherty, G.M., Garrod, S., Isard, S., Kowtko, J., McAllister, J., Miller, J., Sotillo, C., Thompson, H.S., Weinert, R.: The HCRC Map Task Corpus. Language and Speech 34, 351–366 (1991)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Patrick Jeuniaux
    • 1
  • Max M. Louwerse
    • 1
  • Xiangen Hu
    • 1
  1. 1.Department of Psychology / Institute for Intelligent SystemsMemphisUSA

Personalised recommendations