The Role of Discourse Structure and Response Time in Multimodal Communication
In an ongoing project on multimodal communication in humans and agents , we investigate the interaction between two linguistic modalities (prosody and dialog structure) and two non-linguistic modalities (eye gaze and facial expressions). The goal is to gain a better understanding of the use of communicative channels in discourse and can subsequently aid the development of more effective animated conversational agents. We studied conversations between humans involved in the Map Task scenario whereby an Instruction Giver (IG) navigates an Instruction Follower (IF) from a starting point to an end point on a map .
- 1.Louwerse, M., Jeuniaux, P., Hoque, M., Wu, J., Lewis, G.: Multimodal Communication in Computer-Mediated Map Task Scenarios. In: The 28th Annual Conference of the Cognitive Science Society, Vancouver, Canada (July 3, 2006)Google Scholar
- 2.Anderson, A., Bader, M., Bard, E., Boyle, E., Doherty, G.M., Garrod, S., Isard, S., Kowtko, J., McAllister, J., Miller, J., Sotillo, C., Thompson, H.S., Weinert, R.: The HCRC Map Task Corpus. Language and Speech 34, 351–366 (1991)Google Scholar