Audio-visual and multimodal speech-based systems

  • Dafydd Gibbon
  • Inge Mertins
  • Roger K. Moore
Part of the The Springer International Series in Engineering and Computer Science book series (SECS, volume 565)

Abstract

Communication between humans uses many modalities. We communicate not only via verbal language, but also through our use of intonation, gaze, hand gestures, body gestures, and facial expressions. Using these modalities, we can add, modify, and substitute information in spoken conversations. Complementary use of several modalities in human-to-human communication ensures high accuracy, and only few communication problems occur. When communication problems do occur, conversation partners can easily recover, using the redundancy and complementarity of modalities. The goal of research on multimodal systems is to investigate how human—computer interaction can benefit from multiple modalities in similar ways.

Keywords

Fatigue Coherence Stein Olate Tempo 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media New York 2000

Authors and Affiliations

  • Dafydd Gibbon
    • 1
  • Inge Mertins
    • 1
  • Roger K. Moore
    • 2
  1. 1.University of BielefeldGermany
  2. 2.DERA and 20/20 Speech LimitedUSA

Personalised recommendations