Summary
We provide a discription of the robust and generic discourse module that is the central repository of contextual information in SmartKom. We tackle discourse modeling by using a three-tiered discourse structure enriched by partitions together with a local and global focus structure. For the manipulation of the discourse structures we use unification and a default unification operation enriched with a metric mirroring the similarity of competing structures called Overlay. We show how a wide variety of naturally occuring multimodal phenomena, in particular, short utterances including elliptical and referring expressions, can be processed in a generic and robust way. As all other modules of the SmartKom backbone, DiM relies on the a domain ontology for the representation of user intentions. Finally, we show that our approach is robust against phenomena caused by imperfect recognition and analysis of user actions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Alexandersson. Hybrid Discourse Modelling and Summarization for a Speech-to-Speech Translation System. PhD thesis, Universität des Saarlandes, 2003.
J. Alexandersson and T. Becker. Overlay as the Basic Operation for Discourse Processing in a Multimodal Dialogue System. In: Workshop Notes of the IJCAI-01 Workshop on “Knowledge and Reasoning in Practical Dialogue Systems”, Seattle, WA, August 2001.
J. Alexandersson and T. Becker. The Formal Foundations Underlying Overlay. In: Proc. 5th Int. Workshop on Computational Semantics (IWCS-5), pp. 22–36, Tilburg, The Netherlands, February 2003.
J. Alexandersson, T. Becker, and N. Pfleger. Overlay: The Basic Operation for Discourse Processing, 2006. In this volume.
B. Carpenter. Skeptical and Credulous Default Unification With Applications to Templates and Inheritance. In: T. Briscoe, V. de Paiva, and A. Copestake (eds.), Inheritance, Defaults, and the Lexicon, pp. 13–37, Cambridge, CA, 1993. Cambridge University Press.
D. Carter. Discourse Focus Tracking. In: H. Bunt and W. Black (eds.), Abduction, Belief and Context in Dialogue, vol. 1 of Studies in Computational Pragmatics, pp. 241–289, Amsterdam, The Netherlands, 2000. John Benjamins.
R. Engel. Natural Language Understanding, 2006. In this volume.
R. Engel and N. Pfleger. Modality Fusion, 2006. In this volume.
B.J. Grosz, A.K. Joshi, and S. Weinstein. Centering: A Framework for Modelling the Local Coherence of Discourse. Technical Report IRCS-95-01, The Institute For Research In Cognitive Science (IRCS), Pennsylvania, PA, 1995.
C. Grover, C. Brew, S. Manandhar, and M. Moens. Priority Union and Generalization in Discourse Grammars. In: Proc. 32nd Annual Meeting of the Association for Computational Linguistics, pp. 17–24, Las Cruces, NM, 1994. Association for Computational Linguistics.
I. Gurevych, R. Porzel, and R. Malaka. Modeling Domain Knowledge: Know-How and Know-What, 2006. In this volume.
A. Jönsson. Dialogue Management for Natural Language Interfaces — an Empirical Approach. PhD thesis, Linköping Studies in Science and Technology, 1993.
A. Jönsson. A Model for Habitable and Efficient Dialogue Management for Natural Language Interaction. Natural Language Engineering, 3(2/3):103–122, 1997.
S. Larsson. Issue-Based Dialogue Management. PhD thesis, Göteborg University, Sweden, 2002.
M. Löckelt. Plan-Based Dialogue Management for Multiple Cooperating Applications, 2006. In this volume.
M. Löckelt, T. Becker, N. Pfleger, and J. Alexandersson. Making Sense of Partial. In: C.M. Johan Bos, Mary Ellen Foster (ed.), Proc. 6th Workshop on the Semantics and Pragmatics of Dialogue (EDILOG 2002), pp. 101–107, Edinburgh, UK, September 2002.
S. LuperFoy. Discourse Pegs: A Computational Analysis of Context-Dependent Referring Expressions. PhD thesis, University of Texas at Austin, December 1991.
S. Luperfoy. The Representation of Multimodal User Interface Dialogues Using Discourse Pegs. In: Proc. 30th ACL, pp. 22–31, Newark, DE, 1992.
N. Pfleger. Discourse Processing for Multimodal Dialogues and Its Application in SmartKom. Master’s thesis, Universität des Saarlandes, 2002.
N. Pfleger, J. Alexandersson, and T. Becker. Scoring Functions for Overlay and Their Application in Discourse Processing. In: Proc. KONVENS 2002, pp. 139–146, Saarbruecken, Germany, September–October 2002.
N. Pfleger, J. Alexandersson, and T. Becker. A Robust and Generic Discourse Model for Multimodal Dialogue. In: Workshop Notes of the IJCAI-03 Workshop on “Knowledge and Reasoning in Practical Dialogue Systems”, Acapulco, Mexico, August 2003a.
N. Pfleger, R. Engel, and J. Alexandersson. Robust Multimodal Discourse Processing. In: Proc. Diabruck: 7th Workshop on the Semantics and Pragmatics of Dialogue, Wallerfangen, Germany, 4–6 September 2003b.
R. Porzel, I. Gurevych, and R. Malaka. In Context: Integrating Domain-and Situation-Specific Knowledge, 2006. In this volume.
S. Salmon-Alt. Interpreting Referring Expressions by Restructuring Context. In: Proc. ESSLLI 2000, Birmingham, UK, 2000. Student Session.
W. Wahlster (ed.). Verbmobil: Foundations of Speech-to-Speech Translation. Springer, Berlin Heidelberg New York, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Alexandersson, J., Pfleger, N. (2006). Discourse Modeling. In: Wahlster, W. (eds) SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-36678-4_16
Download citation
DOI: https://doi.org/10.1007/3-540-36678-4_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23732-7
Online ISBN: 978-3-540-36678-2
eBook Packages: Computer ScienceComputer Science (R0)