Esprit ’89 pp 321-333 | Cite as

Knowledge-Based Graphical Dialogue: A Strategy and Architecture

  • John Lee
  • Bob Kemp
  • Traude Manz
Conference paper


The nature and role of graphical interaction in the project ESPRIT P393 (ACORD) are outlined. The objective of combining natural language and graphics as an interface to a knowledge-base system gives a particularly interesting slant to the treatment of semantics in relation to graphical depictions and interactions. An approach is introduced which takes semantic representation to be an integral feature of a graphics processor that operates by parsing a stream of interaction events according to a grammar. The semantic mapping function is determined by a visualisation system in a dialogue manager, and this leads to an idea of a very dynamic interaction which adapts naturally to the requirements of the individual user. Several correlative issues in dialogue managing are discussed and a prototype implementation is described.


Natural Language Graphical Presentation Graphic System Graphical Interaction Semantic Mapping 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bolt, R A, “’Put-That-There’: Voice and Gesture at the Graphics Interface”, Computer Graphics (ACM SIGGRAPH), Vol. 14, (3) pp. 262–270 (1980).CrossRefMathSciNetGoogle Scholar
  2. Gnanamgari, S, “Information Presentation through Automatic Graphic Displays”, pp. 433–445 in Computer Graphics 81, Online (1981).Google Scholar
  3. Hanne, K-H, K-P Faehnrich, and J Hoepelman, “Combined Graphics-Natural Language Interfaces to Knowledge Based Systems”, in Al-Europa Conference, TCM-Publications, Liphook (1986).Google Scholar
  4. Klein, Ewan, “Dialogues with Language, Graphics and Logic”, pp. 867–873 in ESPRIT ‖87: Achievements and Impact, ed. CEC - DG XIII, North-Holland, Amsterdam (1987).Google Scholar
  5. Mackinlay, Jock, “Automating the Design of Graphical Presentations of Relational Information”, ACM Transactions on Graphics, Vol. 5, (2) pp. 110–141 (1986).CrossRefGoogle Scholar
  6. Pineda, L A, E Klein, and J R Lee, “GRAFLOG: Understanding Drawings through Natural Language”, Computer Graphics Forum, Vol. 7, (2) (1988).Google Scholar
  7. Pineda, L A, “A Compositional Semantics for Graphics”, in Proc. Eurographics ’88, North-Holland (1988).Google Scholar

Copyright information

© ECSC, EEC, EAEC, Brussels and Luxembourg 1989

Authors and Affiliations

  • John Lee
    • 1
  • Bob Kemp
    • 1
  • Traude Manz
    • 2
  1. 1.Department of ArchitectureEdCAAD University of EdinburghEdinburghScotland, UK
  2. 2.Institut für Arbeitswirtschaft und Organisation (IAO/452)Fraunhofer GesellschaftStuttgart 1Germany

Personalised recommendations