ESPRIT ’90 pp 412-433 | Cite as

Architecture of a Multimodal Dialogue Interface for Knowledge-Based Systems

  • J-L. Binot
  • P. Falzon
  • R. Perez
  • B. Peroche
  • N. Sheehy
  • J. Rouault
  • M. Wilson


This paper describes the architecture and the first implementation results of a multimodal dialogue interface for knowledge based systems developed in the context of Esprit II project MMI2. The paper reviews the basic principles of the architecture of the system and the approach taken by the project with respect to user modeling issues, then describes individually each communication mode


Noun Phrase Task Plan Graphical Object Discourse Referent Dialogue Management 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Allen J. (1983) Recognizing Intentions from Natural Language Utterances.. In M. Brady & R.C Berwick (Eds) “Computational Models of Discourse”. Cambridge MA: MIT Press.Google Scholar
  2. Beach, R.J. (1985), Setting tables and illustrations with style. PhD.thesis, Department of Computer Science, University of Waterloo, CanadaGoogle Scholar
  3. Binot J-L., Demoen B., Hanne K.H., Solomon L., Vassiliou Y., von Hahn W., Wachtel T., (1988), LOKI: A logic Oriented Approach to data and knowledge bases supporting Natural Language Interaction, Proceedings of the ESPRIT88 Conference, North-Holland.Google Scholar
  4. Cahour B. (1989) “Competence modelling in consultation dialogues”, Proceedings of the “Work With Display Units” Second Conference, Montreal, 11–14 Sept. 1989. Amsterdam: ElsevierGoogle Scholar
  5. Canberry, M.S. (1985) “Pragmatic Modelling in Information System Interfaces.” PhD. thesis, University of Delaware.Google Scholar
  6. Cleveland (1985), The elements of Graphing Data, Wadsworth Advanced Books and Software: Monterey, California.Google Scholar
  7. Finin T. and Drager D. (1986). “GUMS: A General User Modelling System.” Technical Report MS-CIS-86-35, Department of Computer and Information Science, U. of PennsylvaniaGoogle Scholar
  8. Gazdar G., Klein E., Pullum G. and Sag I., (1985), Generalised Phrase Structure Grammar, Blackwell.Google Scholar
  9. Genesereth, M.R., Nilsson, N.J. (1987), Logical Foundations of Artificial Intelligence(Morgan Kaufmann Pub., Los Altos, CA).zbMATHGoogle Scholar
  10. Grice, H.P. (1975) Logic and Coversation. In P. Cole and J.L. Morgan (eds.) “Suntax and Semantics”, volume 3, pages 64 – 75, Academic Press, New YorkGoogle Scholar
  11. Julien C. and Marti J-C. (1989),: Plan revision in person-machine-dialogue, Poceedings of the Fourth ACL European Chapter Conference, Manchester.Google Scholar
  12. Kaplan R. and Bresnan J. (1982), Lexical-functional grammar: A formal system for grammatical representation, in J. Bresnan (ed.) The Mental representation of Grammatical Relations. The Mit Press.Google Scholar
  13. Kaplan S.J. (1983) Cooperative Responses from a Portable Natural Language Database Query System. In Brady, M. and Berwick, R.C. (eds) “Computational Models of Discourse”. Cambridge MA: MIT Press.Google Scholar
  14. Kass, R.J. (1988) “Implicit Acquisition of User Models in Cooperative Advisory Systems” Technical Reports MS-CIS-878-05, Department of Computer and Information Science, U. of PennsylvaniaGoogle Scholar
  15. Kass, R.J. (1988) “Acquiring a Model of the User’s Beliefs from a Co-operative advisory Dialogue.” Technical Reports MS-CIS-88-104, Department of Computer and Information Science, U. of PennsylvaniaGoogle Scholar
  16. Kay M. (1985), Parsing in functional unification grammar, in D. Dowty, L.Google Scholar
  17. Karttunen and A.Zwicky (eds.) Natural Language Parsing. Cambridge U.Press, pp. 251–278.Google Scholar
  18. Mackinley, J. (1986), Automating the Design of Graphical Presentations of Relational Information, ACM Transaction on Graphics, 5 (2), 110 – 141CrossRefGoogle Scholar
  19. Pollack, M.E. (1986) “Inferring Domain Plans in Question-Answering”. Technical Report MS-SIC-86-40, Department of Computer and Information Science, Univ. of Pennsylvania.Google Scholar
  20. Sparck Jones K. (1987) “Realism about User Modelling”. Technical Report no. 111, University of Cambridge Computer Laboratory.Google Scholar
  21. Tukey (1977), Exploratory Data Analysis, Addison-Wesley: Reading, Mass.zbMATHGoogle Scholar

Copyright information

© ECSC, EEC, EAEC, Brussels and Luxembourg 1990

Authors and Affiliations

  • J-L. Binot
    • 1
  • P. Falzon
    • 2
  • R. Perez
    • 3
  • B. Peroche
    • 4
  • N. Sheehy
    • 5
  • J. Rouault
    • 6
  • M. Wilson
    • 7
  1. 1.BIMEverbergBelgium
  2. 2.INRIAVoluceau — RocuqencourtFrance
  3. 3.ISSBarcelonaSpain
  4. 4.Ecole des MinesSaint-EtienneFrance
  5. 5.University of LeedsUK
  6. 6.CRISSGrenobleFrance
  7. 7.Rutheford-Appleton LaboratoryChiltonUK

Personalised recommendations