Knowledge-Based Graphical Dialogue: A Strategy and Architecture
The nature and role of graphical interaction in the project ESPRIT P393 (ACORD) are outlined. The objective of combining natural language and graphics as an interface to a knowledge-base system gives a particularly interesting slant to the treatment of semantics in relation to graphical depictions and interactions. An approach is introduced which takes semantic representation to be an integral feature of a graphics processor that operates by parsing a stream of interaction events according to a grammar. The semantic mapping function is determined by a visualisation system in a dialogue manager, and this leads to an idea of a very dynamic interaction which adapts naturally to the requirements of the individual user. Several correlative issues in dialogue managing are discussed and a prototype implementation is described.
KeywordsNatural Language Graphical Presentation Graphic System Graphical Interaction Semantic Mapping
Unable to display preview. Download preview PDF.
- Gnanamgari, S, “Information Presentation through Automatic Graphic Displays”, pp. 433–445 in Computer Graphics 81, Online (1981).Google Scholar
- Hanne, K-H, K-P Faehnrich, and J Hoepelman, “Combined Graphics-Natural Language Interfaces to Knowledge Based Systems”, in Al-Europa Conference, TCM-Publications, Liphook (1986).Google Scholar
- Klein, Ewan, “Dialogues with Language, Graphics and Logic”, pp. 867–873 in ESPRIT ‖87: Achievements and Impact, ed. CEC - DG XIII, North-Holland, Amsterdam (1987).Google Scholar
- Pineda, L A, E Klein, and J R Lee, “GRAFLOG: Understanding Drawings through Natural Language”, Computer Graphics Forum, Vol. 7, (2) (1988).Google Scholar
- Pineda, L A, “A Compositional Semantics for Graphics”, in Proc. Eurographics ’88, North-Holland (1988).Google Scholar