Abstract
In this chapter we present the DenK project, a long-term effort where the aim is to build a generic cooperative human-computer interface combining multiple input and output modalities. We discuss the view on human-computer interaction that underlies the project and the emerging DenK system. The project integrates results from fundamental research in knowledge representation, communication, natural language semantics and pragmatics, and object-oriented animation. Central stage in the project is occupied by the design of a cooperative and knowledge-able electronic assistant that communicates in natural language and that has internal access to an application domain which is presented visually to the user. The assistant, that we call the Cooperative Assistant, has an information state that is represented in a rich form of type theory, a formalism that enables us to model the inherent cognitive dynamics of a dialogue participant. This formalism is used both for modeling domain knowledge, for representing the current dialogue context, and for implementing a context-change theory of communication.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ahn, R. (1995a) Communicating Contexts, a Pragmatic Approach to Information Exchange. In: P. Dybjer, B. Nordström, & J. Smith (eds.) Types for Proofs and Programs: Selected Papers. Berlin: Springer, 1–13.
Ahn, R. (1995b) Logical Model of the Electron Microscope. DenK Report 95/15, Tilburg University.
Ahn, R. (1996) Monotonic description of dynamic worlds. In: Proc. NIAC'96 Conference (forthc.)
Ahn, R. & Kolb, H.P. (1990) Discourse Representation meets Constructive Mathematics. In: KĂ¡lmĂ¡n, L. & PĂ³los, L. (eds.) Papers from the Second Symposium on Logic and Language, Akademiai KiadĂ³, Budapest, 105–124.
Ahn, R., Kievit, L., Rentier, M. Verlinden, M. (1995) Two Levels of Semantic Representation in DenK. In: T. Andernach, M. Moll & A. Nijholt (eds.) Papers from the Fifth CLIN Meeting. Universiteit Twente, 35–58.
Ahn, R. & Borghuis, T. (1996) Chronicle. DenK Report 96/21, Tilburg University.
Allwood, J. (1976) Linguistic Communication as Action and Cooperation. Gothenburg Monographs in Linguistics 2, University of Göteborg.
Allwood, J. (1997) An Activity-Based Approach to Pragmatics. In: Black, W.J. & Bunt, H.C. (eds.) Abduction, Belief and Context, Studies in Computational Pragmatics, University College London Press (forthc.)
Alshawi, H. (1992) The Core Language Engine, Cambridge: Cambridge University press.
Austin, J.L. (1962) How to do things with words. Oxford: Oxford University Press.
Barendregt, H. (1991) Introduction to Generalized Type Systems. Journal of Functional Programming, 1(2). 125–154.
Barendregt, H. (1992) Lambda calculi with types. In: S. Abramsky, D. Gabbay and T. Maibaum (eds.) Handbook of Logic in Computer Science. Oxford: Oxford University Press.
Beun, R.J. (1989) The Recognition of Declarative Questions in Information Dialogues. PhD Dissertation, Tilburg University.
Beun, R.J. (1991) A Framework for Cooperative Dialogues. In: Taylor, M.M., NĂ©el, F. & Bouwhuis, D.G. (eds.) Proceedings of the Second Venaco Workshop on the Structure of Multimodal Dialogue. Maratea, Italy.
Beun, R.J. & Kievit, L.A. (1996) Resolving definite expressions in dialogue. In: Proc. Fifth Int. Conference on Pragmatics, Mexico City, July 1996.
Borghuis, T. (1993) Interpreting Modal Natural Deduction in type theory. In: de Rijke, M. (ed.) Diamonds and Defaults. Kluwer Academic Publishers. 67–102.
Borghuis, T. (1994) Coming to Terms with Modal Logic: On the Interpretation of Modalities in Typed λ-Calculus. Ph.D. Dissertation, Eindhoven University of Technology.
De Bruijn, N.G. (1980) A survey of the project Automath. In: Seldin & Hindley (eds.) To H.B. Curry: Essays on Combinatory Logic, Lambda Calculus and Formalisms. Academic Press. 579–606.
Bunt, H.C. (1989) Information dialogues as communicative action in relation to partner modeling and information processing. In: Taylor, M.M., Néel, F. & Bouwhuis, D.G. (eds.) The Structure of Multimodal Dialogue. North-Holland, Amsterdam.47–73.
Bunt, H.C. (1991) DIT — Dynamic Interpretation in Text and Dialogue. In: L. KĂ¡lm'an & L. PĂ³los (eds.) Papers from the Second Symposium on Logic and Language, Budapest: Akademiai KiadĂ³, 67–104.
Bunt, H.C. (1994) Context and Dialogue Control. THINK Quarterly 3(1), 19–31.
Bunt, H.C. (1995a) Dialogue Control Functions and Interaction Design. In R.J. Beun, M. Baker, and M. Reiner (eds.) Dialogue and Instruction: Modelling Interaction in Intelligent Tutoring Systems. Berlin: Springer, 197–214.
Bunt, H.C. (1995b) Dialogue Semantics and Pragmatics in the δELTA Project. In: L. Dybkjaer (ed.) Proc. of the Second on Spoken Dialogue and Discourse Workshop, Roskilde University, 1–27.
Bunt, H.C. (1997a) Dialogue Context Modeling. In: Proc. CONTEXT'97, International Interdisciplinary Conference on Modeling and Using Context, Rio de Janeiro, February 1997, 130–150.
Bunt, H.C. (1997b) Iterative Context Specification and Dialogue Theory. In: Black, W.J. & Bunt, H.C. (eds.) Abduction, Belief and Context, Studies in Computational Pragmatics, University College London Press (forthc.)
Burger, J.D. & Marshall, R.J. (1993) The application of natural language models to intelligent multimedia. In: Mayburry, M. (ed.) Intelligent Multimedia Interfaces. Massachusetts: MIT Press, 174–196.
Carpenter, R. (1982) The Logic of Typed Feature Structures. Cambridge: Cambridge University Press.
Coquand, T. (1985) Une théorie des constructions. Thèse de troisième cycle. Paris: Université de Paris VII.
Cremers, A.H.M. (1995) Reference to Objects: An Empirical Investigation of Taskoriented dialogues. PhD Dissertation, Eindhoven University of Technology.
Cremers, A.H.M. (1997) Object Reference in Task-oriented Keyboard Dialogues. This volume.
Curry, H.B. & Feys R. (1958) Combinatory Logic, Vol. 1, North Holland Publishing Company.
Geurts, B. & Rentier, G. (1993) The PLUS Grammar. Internal Report ESPRIT Project PLUS, Institute for Language Technology and Artificial Intelligence ITK, Tilburg.
Helmink, L. & Ahn, R. (1991) Goal-oriented proof construction in type theory. In: Huet, G. and Plotkin, G. (eds.) Logical Frameworks. Cambridge: Cambridge University Press, 120–148.
Hobbs, J.R. & Shieber, S.M. (1987) An algorithm for generating quantifier scopings. Computational Linguistics 13 (1–2), 47–63.
Hutchins, E. (1989) Metaphors for Interface Design. In: Taylor, M.M., Néel, F. & Bouwhuis, D.G. (eds.) The Structure of Multimodal Dialogue. Amsterdam: North-Holland,11–28.
Jaspars, J.O.M. (1993) Calculi for Constructive Communication. Ph.D. Dissertation, Institute for Language Technology and Artificial Intelligence ITK, Tilburg.
Kamp, J.A.W. & Reyle, U. (1993) From Discourse to Logic: Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Dordrecht: Kluwer Academic Publishers.
Kievit, L.A. (1996) ULF. DenK Report 96/27, Tilburg University.
Martin-Löf P. (1984) Intuitionistic Type Theory. Naples: Bibliopolis.
Neal, J.G. & Shapiro, S.C. (1991) Intelligent multimedia interface technology. In: Sullivan, J.W. & Taylor, S.W. (eds.) Intelligent User Interfaces. Reading, MA: Addison-Wesley,11–43.
Overveld, C.W.A.M. van (1991) The Generalized Display Processor as an approach to real time interactive 3-D computer animation. The Journal of Visualisation and Computer Animation, 2(1),16–21.
Peeters, E.A.J. (1994) Design of an object-oriented interactive animation system. PhD Dissertation, Eindhoven University of Technology.
Pollard, C. & Sag, I. (1994) Head-driven Phrase Structure Grammar. University of Chicago Press.
Rentier, G. (1993) ULF. δELTA Working Paper, May 1994, ITK, Tilburg University.
Searle, J.R. (1969) Speech Acts. Cambridge: Cambridge University Press.
de Souza, C.S. (1993) The semiotic engineering of user interface languages. International Journal of Man-Machine Studies, 39, 753–774.
Verlinden, M. (1996) Development of the cores syntax for DenK. DenK Report 96/22, Tilburg University.
Wahlster, W., André, E., Finkler, W., Profitlich, H.-J. & Rist, T. (1993) Plan-based integration of natural language and graphics generation. Artificial Intelligence, 63, 387–427.
Wilson, M.D., Sedlock, D., Binot, J-L. & Falzon, P. (1991) An architecture for multimodal dialogue. In: Taylor, M.M., NĂ©el, F. & Bouwhuis, D.G. (eds.) Proceedings of the Second Venaco Workshop on the Structure of Multimodal Dialogue. Maratea, Italy.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Bunt, H., Ahn, R., Beun, R.J., Borghuis, T., van Overveld, K. (1998). Multimodal cooperation with the DenK system. In: Bunt, H., Beun, RJ., Borghuis, T. (eds) Multimodal Human-Computer Communication. CMC 1995. Lecture Notes in Computer Science, vol 1374. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052312
Download citation
DOI: https://doi.org/10.1007/BFb0052312
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64380-7
Online ISBN: 978-3-540-69764-0
eBook Packages: Springer Book Archive