Abstract
The combined use of language and analogue graphics for the expression of information probably is as old as language itself. The paper addresses the question why we need both the expressions of natural language and analogue graphics for the representation of information. It is argued that analogue graphics and natural language have the complementary expressive virtues of specificity and focus, respectively. Their corresponding lack of focus and specificity, respectively, explain why (a) both have developed a number of mechanisms for coping with these deficiencies and (b) why their combination may often have superior expressive power. Since specificity follows from the analogue character of analogue graphics rather than from their graphic character, analogue sound and touch representations are analysed to explore whether results from the analysis of analogue graphics and their complementarity with natural language can be transferred to other analogue modalities of expression. The paper exemplifies the comparatively new field of Modality Theory.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
N.O. Bernsen. Matching Information and Interface Modalities. An Example Study. Technical Report Deliverable 2.1.1, Esprit Basic Research project GRACE, 1993.
N.O. Bernsen. Modality Theory: Supporting multimodal interface design. In Proceedings from the ERCIM Workshop on Multimodal Human-Computer Interaction, Nancy, November 1993.
N.O. Bernsen. A research agenda for modality theory. In R. Cox, M. Petre, P. Brna, and J. Lee, editors, Proceedings of the Workshop on Graphical Representations, Reasoning and Communication, pages 43–46, Edinburgh, August 1993. World Conference on Artificial Intelligence in Education.
N.O. Bernsen. Foundations of multimodal representations. A taxonomy of representational modalities. Interacting with Computers, 6(4):347–371, 1994.
N.O. Bernsen and B. Svane. Communication failure and mental models. In Proceedings of the 13th Scandinavian Conference on Linguistics, 1992.
E. Hovy and Y. Arens. When is a picture worth a thousand words? Allocation of modalities in multimedia communication. In Paper presented at the AAAI Symposium on Human-Computer Interfaces, Stanford, 1990.
E. Klein and L.A. Pineda. Semantics and graphical information. In D. Diaper, editor, Human-Computer Interaction — INTERACT’90, Amsterdam, 1990. Elsevier.
J. Lee and H. Zeevat. Integrating natural language and graphics in dialogue. In D. Diaper, editor, Human-Computer Interaction — INTERACT’90, Amsterdam, 1990. Elsevier.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1995 EUROGRAPHICS The European Association for Computer Graphics
About this paper
Cite this paper
Bernsen, N.O. (1995). Why Are Analogue Graphics and Natural Language Both Needed in HCI?. In: Paternó, F. (eds) Interactive Systems: Design, Specification, and Verification. Focus on Computer Graphics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-87115-3_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-87115-3_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-87117-7
Online ISBN: 978-3-642-87115-3
eBook Packages: Springer Book Archive