Abstract
How is using diagrams related to things that happen inside our heads? The study of diagrammatic reasoning often focuses on computational models of diagram use rather than on studies of human performance. This chapter presents a survey of the empirical and theoretical research that has investigated these processes. It considers the origins, interpretation and manipulation of diagrams, treating diagrams as a notational system that can be used and studied in an experimental context. This is a review of the experimental psychology literature rather than a complete theoretical framework, and is particularly intended as an introduction to the field for those who are commencing research projects into diagrammatic reasoning, having come from a discipline other than cognitive psychology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, R.E. and Helstrup, T. (1993). Visual discovery in mind and on paper. Memory and Cognition 21:283-293.
Anooshian, L.J. and Seibert, P.S. (1996). Diversity within spatial cognition: Memory processes underlying place recognition. Applied Cognitive Psychology 10:281-300.
Arnheim, R. (1970). Visual thinking. London: Faber & Faber.
Baddeley, A.D. (1986). Working memory. Oxford: Oxford University Press.
Baker, S.C., Rogers, R.D., Owen, A.M., Frith, C.D., Dolan, R.J., Frackowiak, R.S.J. and Robbins, T.W. (1996). Neural systems engaged by planning: A PET study of the Tower of London task. Neuropsychologia 34:515-526.
Bertin, J. (1981). Graphics and graphic information processing. Berlin: Walter de Gruyter.
Beveridge, M. and Parkins, E. (1987). Visual representation in analogical problem solving. Memory and Cognition, 15:230-237.
Blackwell, A.F. (1998). Metaphor in diagrams. Unpublished PhD thesis, Cambridge University.
Blackwell, A.F. and Green, T.R.G. (1999). Does metaphor increase visual language usability? In Proceedings IEEE symposium on visual languages VL’99, Tokyo, September 1999, pp. 246-253.
Block, N. (1981). Imagery. Cambridge, MA: MIT Press.
Carroll, J.M. and Thomas, J.C. (1982). Metaphor and the cognitive representation of computing systems. IEEE Transactions on Systems, Man and Cybernetics 12:107-116.
Carroll, J.M., Thomas, J.C, Miller, L.A. and Friedman, H.P. (1980). Aspects of solution structure in design problem solving. American Journal of Psychology 93:269-284.
Chambers, D. (1993). Images are both depictive and descriptive. In B. RoskosEwoldsen, M. Intons-Peterson and R.E. Anderson (Eds), Imagery, creativity and discovery. Amsterdam: North Holland, pp. 77-97.
Chambers, D. and Reisberg, D. (1985). Can mental images be ambiguous? Journal of Experimental Psychology: Human Perception and Performance 11:317-328.
Chechile, R.A., Anderson, J.E., Krafczek, S.A. and Coley, S.L. (1996). A syntactic complexity effect with visual patterns: Evidence for the syntactic nature of the memory representation. Journal of Experimental Psychology: Learning, Memory and Cognition 22:654-669.
Cohen, D.J. and Bennett, S. (1997). Why can’t most people draw what they see? Journal of Experimental Psychology: Human Perception and Performance 23:609-621.
Davies, S.P. (1996). Display-based problem solving strategies in computer programming. In W.D. Gray and D.A. Boehm-Davis (Eds), Empirical studies of programmers: Sixth workshop. Norwood, NJ: Ablex, pp. 59-76.
DeLoache, J.S. and Marzolf, D.P. (1992). When a picture is not worth a thousand words: Young children’s understanding of pictures and models. Cognitive Development 7:317-329.
DeLoache, J.S., Pierroutsakos, S.L., Uttal, D.H., Rosengren, K.S. and Gottlieb, A. (1998). Grasping the nature of pictures. Psychological Science 9:205-210.
Delgado, A.R. and Prieto, G. (1996). Sex differences in visuospatial ability: Do performance factors play such an important role? Memory and Cognition 24:504-510.
Denis, M. (1991). Imagery and thinking. In C. Cornoldi and M.A. McDaniel (Eds), Imagery and cognition. New York: Springer-Verlag.
Egan, D.E. and Schwartz, B.J. (1979). Chunking in recall of symbolic drawings. Memory and Cognition 7:149-158.
Ericsson, K.A. and Simon, H.A. (1985). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
Farah, M.J., Hammond, K.M., Levine, D.N. and Calvanio, R. (1988). Visual and spatial mental imagery: Dissociable systems of representation. Cognitive Psychology 20:439-462.
Finke, R.A., Pinker, S. and Farah, M.J. (1989). Reinterpreting visual patterns in mental imagery. Cognitive Science 13:51-78.
Fish, J. and Scrivener, S. (1990). Amplifying the mind’s eye: Sketching and visual cognition. Leonardo 23:117-126.
Frandsen, A.N. and Holder, J.R. (1969). Spatial visualization in solving complex verbal problems. Journal of Psychology 73:229-233.
Gibbs, R.W. Jr (1996). Why many concepts are metaphorical. Cognition 61:195-324.
Glenberg, A.M. and Langston, W.E. (1992). Comprehension of illustrated text: Pictures help to build mental models. Journal of Memory and Language 31:129-151.
Goldschmidt, G. (1991). The dialectics of sketching. Creativity Research Journal 4:123-143.
Goodman, N. (1969). Languages of art: An approach to a theory of symbols. London: Oxford University Press.
Green, T.R.G., Bellamy R.K.E. and Parker, J.M. (1987). Parsing and Gnisrap: A model of device use. In Empirical studies of programmers: Second workshop. Norwood, NJ: Ablex, pp. 132-146.
Green T.R.G. and Petre M. (1996). Usability analysis of visual programming environments: A “Cognitive Dimensions” approach. Journal of Visual Languages and Computing 7:131-174.
Halpern, D.F. (1992). Sex differences in cognitive abilities. Hillsdale, NJ: Erlbaum.
Hayward, W.G. and Tarr, M.J. (1995). Spatial language and spatial representation. Cognition 55:39-84.
Hegarty, M. (1992). Mental animation: Inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory and Cognition 18:1084-1102.
Hishitani, S. (1990). Imagery experts: How do expert abacus operators process imagery? Applied Cognitive Psychology 4:33-46.
Huttenlocher, J. (1968). Constructing spatial images: A strategy in reasoning. Psychological Review 75:550-560.
Ittelson, W.H. (1996). Visual perception of markings. Psychonomic Bulletin and Review 3:171-187.
Karmiloff-Smith, A. (1990). Constraints on representational change: Evidence from children’s drawing. Cognition 34:57-83.
Kearins, J.M. (1981). Visual spatial memory in Australian Aboriginal children of desert regions. Cognitive Psychology 13:434-460.
Koedinger, K.R and Anderson, J.R. (1990). Abstract planning and perceptual chunks: Elements of expertise in geometry. Cognitive Science 14:511-550.
Kosslyn, S.M., Koenig, O., Barrett, A., Cave, C.B., Tang, J. and Gabrieli, J.D.E. (1989). Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. Journal of Experimental Psychology: Human Perception and Performance 15:723-735.
Lakoff, G. and Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.
Lakoff, G. (1993). The contemporary theory of metaphor. In A. Ortony (Ed.), Metaphor and thought (2nd ed). Cambridge, UK: Cambridge University Press, pp. 202-251.
Larkin, J.H. and Simon, H.A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 11:65-99.
Levelt, W.J.M. (1981). The speaker’s linearisation problem. Philosophical Transactions of the Royal Society B 295:305-315.
Lewis, C.M. (1991). Visualization and situations. In J. Barwise, J.M. Gawron, G. Plotkin and S. Tutiya (Eds), Situation theory and its applications. Stanford University: CSLI, pp. 553-580.
Linde, C. and Labov, W. (1975). Spatial structures as a site for the study of language and thought. Language 51:924-939.
Lindsay, R.K. (1988). Images and inference. Cognition 29:229-250.
Lowe, R.K. (1993). Diagrammatic information: Techniques for exploring its mental representation and processing. Information Design Journal 7:3-18.
MacLeod, C.M., Hunt, E.B. and Mathews, N.N. (1978). Individual differences in the verification of sentence-picture relationships. Journal of Verbal Learning and Verbal Behavior 17:493-507.
McDougal, T.F. and Hammond, K.J. (1995). Using diagrammatic features to index plans for geometry theorem-proving. In J. Glasgow, N.H. Narayanan and B. Chandrasekaran (Eds), Diagrammatic reasoning. Menlo Park, CA: AAAI Press, pp. 691-709.
McNamara, T.P. (1986). Mental representations of spatial relations. Cognitive Psychology 18:87-121.
McNamara, T.P., Halpin, J.A. and Hardy, J.K. (1992). The representation and integration in memory of spatial and nonspatial information. Memory and Cognition 20:519-532.
Mecklinger, A. and Müller, N. (1996). Dissociations in the processing of “what” and “where” information in working memory: An event-related potential analysis. Journal of Cognitive Neuroscience 8:453-473.
Mishkin, M., Ungerleider, L.G. and Macko, K.A. (1983). Object vision and spatial vision: Two cortical pathways. Trends in Neurosciences 6:414-417.
Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart & Winston.
Paivio, A. and Clark, J.M. (1991). Static versus dynamic imagery. In C. Cornoldi and M.A. McDaniel (Eds), Imagery and cognition. New York: Springer-Verlag, pp. 221-245.
Peirce, C.S. (1903/1932). Collected papers, Vol. II: Elements of logic. C. Hartshorne and P. Weiss (Eds). Cambridge, MA: Harvard University Press.
Petre, M. and Green, T.R.G. (1990). Where to draw the line with text: Some claims by logic designers about graphics in notation. In D. Diaper, D. Gilmore, G. Cockton and B. Shackel (Eds), Proceedings of Interact ’90. Amsterdam: Elsevier, pp. 463-468.
Presson, C.C. (1987). The development of spatial cognition: Secondary uses of spatial information. In N. Eisenberg (Ed.) Contemporary topics in developmental psychology. New York: Wiley, pp. 77-112.
Ratcliff, G. (1979). Spatial thought, mental rotation and the right cerebral hemisphere. Neuropsychologia 17:49-54.
Saariluoma, P. and Kalakoski, V. (1997). Skilled imagery and long-term working memory. American Journal of Psychology 110:177-202.
Santa, J.L. (1977). Spatial transformations of words and pictures. Journal of Experimental Psychology: Human Learning and Memory 3:418-427.
Scaife, M. and Rogers, Y. (1996). External cognition: How do graphical representations work? International Journal of Human Computer Studies 45:185-214.
Schooler, J.W., Ohlsson, S. and Brooks, K. (1993). Thoughts beyond words: When language overshadows insight. Journal of Experimental Psychology 122:166-183.
Schwartz, D.L. (1995). Reasoning about the referent of a picture versus reasoning about the picture as the referent: An effect of visual realism. Memory and Cognition 23:709-722.
Scott, F.J. and Baron-Cohen, S. (1996). Imagining real and unreal things: Evidence of a dissociation in autism. Journal of Cognitive Neuroscience 8:371-382.
Shah, P. and Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: An individual differences approach. Journal of Experimental Psychology: General 125:4-27.
Shneiderman, B. (1983). Direct manipulation: A step beyond programming languages. IEEE Computer (August):57-60.
Shu, N.C. (1988). Visual programming. New York: Van Nostrand Reinhold.
Silverman, I., Phillips, K. and Silverman, L.K. (1996). Homogeneity of effect sizes for sex across spatial tests and cultures: Implications for hormonal theories. Brain and Cognition 31:90-94.
Sims, V.K. and Hegarty, M. (1997). Mental animation in the visuospatial sketchpad: Evidence from dual-task studies. Memory and Cognition 25:321-332.
Smith, D.C. (1977). Pygmalion: A computer program to model and simulate creative thought. Boston, MA: Birkhauser.
Smyth, M.M. and Scholey, K.A. (1996). The relationship between articulation time and memory performance in verbal and visuospatial tasks. British Journal of Psychology 87:179-191.
Stenning, K. and Oberlander, J. (1995). A cognitive theory of graphical and linguistic reasoning: logic and implementation. Cognitive Science 19:97-140.
Tabachnek-Schijf, H.J.M., Leonardo, A.M. and Simon, H.A. (1997). CaMeRa: A computational model of multiple representations. Cognitive Science 21:305-350.
Taylor, H.A. and Tversky, B. (1996). Perspective in spatial descriptions. Journal of Memory and Language 35:371-391.
Thagard, P., Gochfeld, D. and Hardy, S. (1992). Visual analogical mapping. In Proceedings of the 14th Annual Meeting of the Cognitive Science Society, pp. 130-135.
Thomas, G.V. and Silk, A.M.J. (1990). An introduction to the psychology of children’s drawings. Hemel Hempstead: Harvester Wheatsheaf.
Tresch, M.C., Sinnamon, H.M. and Seamon, J.G. (1993). Double dissociation of spatial and object visual memory: Evidence from selective interference in intact human subjects. Neuropsychologia 31:211-219.
Tversky, B., Kugelmass, S. and Winter, A. (1991). Cross-cultural and developmental trends in graphic productions. Cognitive Psychology 23:515-557.
Ullman, S. (1984). Visual Routines. Cognition 18:97-159.
vanSommers, P. (1984). Drawing and cognition. Cambridge, UK: Cambridge University Press.
Zhang, J. (1997). The nature of external representations in problem solving. Cognitive Science 21:179-217.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag London
About this chapter
Cite this chapter
Blackwell, A.F. (2002). Psychological Perspectives on Diagrams and their Users. In: Anderson, M., Meyer, B., Olivier, P. (eds) Diagrammatic Representation and Reasoning. Springer, London. https://doi.org/10.1007/978-1-4471-0109-3_6
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0109-3_6
Publisher Name: Springer, London
Print ISBN: 978-1-85233-242-6
Online ISBN: 978-1-4471-0109-3
eBook Packages: Springer Book Archive