Abstract
This paper is concerned with pictorial means of communicating instructions for the use of equipment. The problems differ from those involved in development of discrete symbols, in that instructions require representations of states, actions, and conditional relations comparable to those represented in natural language. Accordingly, our approach concentrates on analogues of linguistic factors and pictorial aspects of sequence and context.
Two tasks were used involving interpretation of sequences of pictorial instructions for an apparatus. In one task subjects gave a verbal interpretation of pictorial instructions; in the other task they used the same instructions to operate the device, which simulated the operation of an English pay-phone. Comprehension was affected by how much of the apparatus was depicted in each picture, segmentations of the picture sequence, and the use of insets. The effects of graphic variables and the error patterns implicate cognitive structures underlying comprehension of pictorial instructions (especially relations between actions and states). Amongst other comparisons with natural language, the inferential nature of interpretation is emphasised. Differences between the two tasks indicate people’s strategies in using instructions to operate equipment. Indeed, the effect of graphic variables can only be understood in the context of users’ strategies and their preconceptions about particular equipment.
There has been surprisingly little research on pictorial instructions for the operation of equipment. Obvious applications include international usage and user populations of limited literacy or with impaired language. Even literate native speakers of a language often find written instructions difficult to follow. Not only might pictorial instructions serve as an alternative to verbal texts, but they might also aid comprehension when the two are presented together.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arnheim, R. Art and visual perception. Revised edition. Berkeley: University of California Press, 1974.
Barnard, P.J., & Marcel, A.J. A preliminary investigation of factors influencing the interpretation of pictorial instructions for the use of apparatus. In D. Anderson (Ed.), Proceedings of the 8th International Symposium on Human Factors in Telecommunications. Harlow, Essex: Standard Telecommunications Laboratories, Ltd., 1977.
Bower, G.H. Experiments on story understanding and recall. Quarterly Journal of Experimental Psychology, 1976, 28, 511–534.
Broadbent, D.E. Language and ergonomics. Applied Ergonomics, 1977, 8, 15–18.
Cahill, M. Interpretability of graphic symbols as a function of context and experience factors. Journal of Applied Psychology, 1975, 60, 376–380.
Clark, H., & Clark, E. Semantic distinctions and memory for complex sentences. Quarterly Journal of Experimental Psychology, 1968, 20, 129–138.
Deregowski, J. Perception. In H.C. Triandis, W. Lonner, & A. Heron (Eds.), Handbook of cross-cultural psychology. Vol. II: Basic processes. Boston: Allyn and Bacon, 1977.
Design. Fve rediscovered hieroglyphics. Editorial article. Design, 1975, 323, November 1975, 48–51.
Easterby, R.S. Perception of symbols for machine displays. Ergonomics, 1970, 13, 149–158.
Ericsson, E.A. Use of pictograms in instructions. In, Proceedings of 6th International Symposium on Human Factors in Telecommunications. Paper VII.2. Swedish Telecommunications Administration, 1972.
Evans, T.G. A program for the solution of a class of geometric analogy intelligence-test questions. In M. Minsky (Ed.), Semantic information processing. Cambridge, MA: M.I.T. Press, 1968.
Frith, U., & Robson, J.E. Perceiving the language of films. Perception, 1975, 4, 97–103.
Gardner, H. The processing of norhlinguistic symbols by aphasics. In Proceedings of International Neuropsychology Society European Conference, Oxford, August, 1977.
Gombrich, E.H. The story of art. London: Phaidon, 1950.
Gombrich, E.H. Symbolic images. London: Phaidon, 1972.
Goodman, N. Languages of art: An approach to a theory of symbols. Indianapolis: Bobbs-Merrill, 1968.
Hadler, U. Instructions for use by means of symbols. In Proceedings of 6th International Symposium on Human Factors in Telecommunications. Paper VII. 1. Swedish Telecommunications Administration, 1972.
Hornby, P.A. Surface structure and presupposition. Journal of Verbal Learning and Verbal Behavior, 1974, 13, 530–538.
Johnson, R.E. Recall of prose as a function of the structural importance of linguistic units. Journal of Verbal Learning and Verbal Behavior, 1970, 9, 12–20.
Kolers, P.A. Some formal characteristics of pictograms. American Scientist, 1969, 57(3), 348–363.
Mascelli, J. The five C’s of cinematography. Hollywood: Cinegrafic Publications, 1965.
Michotte, A. The perception of causality. (Translated by T.R. Miles & E. Miles). London: Methuen, 1963.
Minsky, M. A framework for representing knowledge. In P. Winston (Ed.), The psychology of computer vision. New York: McGraw-Hill, 1975.
Olson, D.R. From utterance to text: The bias of language in speech and writing. Harvard Educational Review, 1977, 47(3), 257–281.
Premack, D. Language in chimpanzees? Science, 1971, 172, 808–822.
Wason, P.C., & Johnson-Laird, P.N. Psychology of reasoning: Structure and content. London: Batsford, 1972.
Winograd, T. Understanding natural language. Cognitive Pyschology, 1972 3, 1–191.
Wright, P. Presenting technical information: A survey of research findings. Instructional Science, 1977, 6, 93–134.
Wright, P., & Barnard, P.J. “Just fill in this form” - A review for designers. Applied Ergonomics, 1975, 6.4, 213–220.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1979 Plenum Press, New York
About this chapter
Cite this chapter
Marcel, T., Barnard, P. (1979). Paragraphs of Pictographs: The Use of Non-verbal Instructions for Equipment. In: Kolers, P.A., Wrolstad, M.E., Bouma, H. (eds) Processing of Visible Language. Nato Conference Series, vol 13. Springer, Boston, MA. https://doi.org/10.1007/978-1-4684-0994-9_32
Download citation
DOI: https://doi.org/10.1007/978-1-4684-0994-9_32
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4684-0996-3
Online ISBN: 978-1-4684-0994-9
eBook Packages: Springer Book Archive