Advances in Natural Multimodal Dialogue Systems

  • Jan C. J. van Kuppevelt
  • Laila Dybkjær
  • Niels Ole Bernsen

Part of the Text, Speech and Language Technology book series (TLTB, volume 30)

Table of contents

  1. Front Matter
    Pages i-xii
  2. Natural and Multimodal Interactivity Engineering - Directions and Needs

  3. Making Dialogues More Natural: Empirical Work and Applied Theory

    1. Front Matter
      Pages 21-21
    2. Timothy Bickmore, Justine Cassell
      Pages 23-54
  4. Annotation and Analysis of Multimodal Data: Speech and Gesture

    1. Front Matter
      Pages 77-77
    2. Craig H. Martell
      Pages 79-95
    3. Patrick G. T. Healey, Marcus Colman, Mike Thirlwell
      Pages 113-129
    4. Noëlle Carbonell, Suzanne Kieffer
      Pages 131-157
    5. Trevor Darrell, John W. Fisher III, Kevin W. Wilson, Michael R. Siracusa
      Pages 159-180
  5. Animated Talking Heads and Evaluation

    1. Front Matter
      Pages 181-181
    2. Björn Granström, David House
      Pages 215-243
    3. Dirk Heylen, Ivo van Es, Anton Nijholt, Betsy van Dijk
      Pages 245-262
  6. Architectures and Technologies for Advanced and Adaptive Multimodal Dialogue Systems

    1. Front Matter
      Pages 263-263
    2. Joyce Y. Chai, Shimei Pan, Michelle X. Zhou
      Pages 265-285
    3. Brady Clark, Oliver Lemon, Alexander Gruenstein, Elizabeth Owen Bratt, John Fry, Stanley Peters et al.
      Pages 287-305
    4. Norbert Reithinger, Dirk Fedeler, Ashwani Kumar, Christoph Lauer, Elsa Pecourt, Laurent Romary
      Pages 307-332
    5. Sorin Dusan, James Flanagan
      Pages 333-354

About this book

Introduction

References 74 Part II Annotation and Analysis of Multimodal Data: Speech and Gesture 4 FORM 79 Craig H. Martell 1. Introduction 79 2. Structure of FORM 80 3. Annotation Graphs 85 4. Annotation Example 86 5. Preliminary Inter-Annotator Agreement Results 88 6. Conclusion: Applications to HLT and HCI? 90 Appendix: Other Tools, Schemes and Methods of Gesture Analysis 91 References 95 5 97 On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence Andrea Corradini and Philip R. Cohen 1. Introduction 97 2. Study 99 3. Data Analysis 101 4. Results 103 5. Discussion 106 6. Related Work 106 7. Future Work 108 8. Conclusions 108 Appendix: Questionnaire MYST III - EXILE 110 References 111 6 113 Analysing Multimodal Communication Patrick G. T. Healey, Marcus Colman and Mike Thirlwell 1. Introduction 113 2. Breakdown and Repair 117 3. Analysing Communicative Co-ordination 125 4. Discussion 126 References 127 7 131 Do Oral Messages Help Visual Search? Noëlle Carbonell and Suzanne Kieffer 1. Context and Motivation 131 2. Methodology and Experimental Set-Up 134 3. Results: Presentation and Discussion 141 4. Conclusion 153 References 154 Contents vii 8 159 Geometric and Statistical Approaches to Audiovisual Segmentation Trevor Darrell, John W. Fisher III, Kevin W. Wilson, and Michael R. Siracusa 1. Introduction 159 2. Related Work 160 3. Multimodal Multisensor Domain 162 4. Results 166 5. Single Multimodal Sensor Domain 167 6.

Keywords

Augmented Reality Experiment architecture communication computer-assisted surgery learning machine learning robot

Editors and affiliations

  • Jan C. J. van Kuppevelt
    • 1
  • Laila Dybkjær
    • 2
  • Niels Ole Bernsen
    • 2
  1. 1.WaalreThe Netherlands
  2. 2.University of Southern DenmarkOdenseDenmark

Bibliographic information

  • DOI https://doi.org/10.1007/1-4020-3933-6
  • Copyright Information Springer 2005
  • Publisher Name Springer, Dordrecht
  • eBook Packages Humanities, Social Sciences and Law
  • Print ISBN 978-1-4020-3932-4
  • Online ISBN 978-1-4020-3933-1
  • Series Print ISSN 1386-291X
  • About this book