Psychological Perspectives on Diagrams and their Users

  • Alan F. Blackwell


How is using diagrams related to things that happen inside our heads? The study of diagrammatic reasoning often focuses on computational models of diagram use rather than on studies of human performance. This chapter presents a survey of the empirical and theoretical research that has investigated these processes. It considers the origins, interpretation and manipulation of diagrams, treating diagrams as a notational system that can be used and studied in an experimental context. This is a review of the experimental psychology literature rather than a complete theoretical framework, and is particularly intended as an introduction to the field for those who are commencing research projects into diagrammatic reasoning, having come from a discipline other than cognitive psychology.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Anderson, R.E. and Helstrup, T. (1993). Visual discovery in mind and on paper. Memory and Cognition 21:283-293.CrossRefGoogle Scholar
  2. 2.
    Anooshian, L.J. and Seibert, P.S. (1996). Diversity within spatial cognition: Memory processes underlying place recognition. Applied Cognitive Psychology 10:281-300.CrossRefGoogle Scholar
  3. 3.
    Arnheim, R. (1970). Visual thinking. London: Faber & Faber.Google Scholar
  4. 4.
    Baddeley, A.D. (1986). Working memory. Oxford: Oxford University Press.Google Scholar
  5. 5.
    Baker, S.C., Rogers, R.D., Owen, A.M., Frith, C.D., Dolan, R.J., Frackowiak, R.S.J. and Robbins, T.W. (1996). Neural systems engaged by planning: A PET study of the Tower of London task. Neuropsychologia 34:515-526.CrossRefGoogle Scholar
  6. 6.
    Bertin, J. (1981). Graphics and graphic information processing. Berlin: Walter de Gruyter.CrossRefGoogle Scholar
  7. 7.
    Beveridge, M. and Parkins, E. (1987). Visual representation in analogical problem solving. Memory and Cognition, 15:230-237.CrossRefGoogle Scholar
  8. 8.
    Blackwell, A.F. (1998). Metaphor in diagrams. Unpublished PhD thesis, Cambridge University.Google Scholar
  9. 9.
    Blackwell, A.F. and Green, T.R.G. (1999). Does metaphor increase visual language usability? In Proceedings IEEE symposium on visual languages VL’99, Tokyo, September 1999, pp. 246-253.CrossRefGoogle Scholar
  10. 10.
    Block, N. (1981). Imagery. Cambridge, MA: MIT Press.Google Scholar
  11. 11.
    Carroll, J.M. and Thomas, J.C. (1982). Metaphor and the cognitive representation of computing systems. IEEE Transactions on Systems, Man and Cybernetics 12:107-116.CrossRefGoogle Scholar
  12. 12.
    Carroll, J.M., Thomas, J.C, Miller, L.A. and Friedman, H.P. (1980). Aspects of solution structure in design problem solving. American Journal of Psychology 93:269-284.CrossRefGoogle Scholar
  13. 13.
    Chambers, D. (1993). Images are both depictive and descriptive. In B. RoskosEwoldsen, M. Intons-Peterson and R.E. Anderson (Eds), Imagery, creativity and discovery. Amsterdam: North Holland, pp. 77-97.CrossRefGoogle Scholar
  14. 14.
    Chambers, D. and Reisberg, D. (1985). Can mental images be ambiguous? Journal of Experimental Psychology: Human Perception and Performance 11:317-328.CrossRefGoogle Scholar
  15. 15.
    Chechile, R.A., Anderson, J.E., Krafczek, S.A. and Coley, S.L. (1996). A syntactic complexity effect with visual patterns: Evidence for the syntactic nature of the memory representation. Journal of Experimental Psychology: Learning, Memory and Cognition 22:654-669.CrossRefGoogle Scholar
  16. 16.
    Cohen, D.J. and Bennett, S. (1997). Why can’t most people draw what they see? Journal of Experimental Psychology: Human Perception and Performance 23:609-621.CrossRefGoogle Scholar
  17. 17.
    Davies, S.P. (1996). Display-based problem solving strategies in computer programming. In W.D. Gray and D.A. Boehm-Davis (Eds), Empirical studies of programmers: Sixth workshop. Norwood, NJ: Ablex, pp. 59-76.Google Scholar
  18. 18.
    DeLoache, J.S. and Marzolf, D.P. (1992). When a picture is not worth a thousand words: Young children’s understanding of pictures and models. Cognitive Development 7:317-329.CrossRefGoogle Scholar
  19. 19.
    DeLoache, J.S., Pierroutsakos, S.L., Uttal, D.H., Rosengren, K.S. and Gottlieb, A. (1998). Grasping the nature of pictures. Psychological Science 9:205-210.CrossRefGoogle Scholar
  20. 20.
    Delgado, A.R. and Prieto, G. (1996). Sex differences in visuospatial ability: Do performance factors play such an important role? Memory and Cognition 24:504-510.CrossRefGoogle Scholar
  21. 21.
    Denis, M. (1991). Imagery and thinking. In C. Cornoldi and M.A. McDaniel (Eds), Imagery and cognition. New York: Springer-Verlag.Google Scholar
  22. 22.
    Egan, D.E. and Schwartz, B.J. (1979). Chunking in recall of symbolic drawings. Memory and Cognition 7:149-158.CrossRefGoogle Scholar
  23. 23.
    Ericsson, K.A. and Simon, H.A. (1985). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.Google Scholar
  24. 24.
    Farah, M.J., Hammond, K.M., Levine, D.N. and Calvanio, R. (1988). Visual and spatial mental imagery: Dissociable systems of representation. Cognitive Psychology 20:439-462.CrossRefGoogle Scholar
  25. 25.
    Finke, R.A., Pinker, S. and Farah, M.J. (1989). Reinterpreting visual patterns in mental imagery. Cognitive Science 13:51-78.CrossRefGoogle Scholar
  26. 26.
    Fish, J. and Scrivener, S. (1990). Amplifying the mind’s eye: Sketching and visual cognition. Leonardo 23:117-126.CrossRefGoogle Scholar
  27. 27.
    Frandsen, A.N. and Holder, J.R. (1969). Spatial visualization in solving complex verbal problems. Journal of Psychology 73:229-233.Google Scholar
  28. 28.
    Gibbs, R.W. Jr (1996). Why many concepts are metaphorical. Cognition 61:195-324.CrossRefGoogle Scholar
  29. 29.
    Glenberg, A.M. and Langston, W.E. (1992). Comprehension of illustrated text: Pictures help to build mental models. Journal of Memory and Language 31:129-151.CrossRefGoogle Scholar
  30. 30.
    Goldschmidt, G. (1991). The dialectics of sketching. Creativity Research Journal 4:123-143.CrossRefGoogle Scholar
  31. 31.
    Goodman, N. (1969). Languages of art: An approach to a theory of symbols. London: Oxford University Press.Google Scholar
  32. 32.
    Green, T.R.G., Bellamy R.K.E. and Parker, J.M. (1987). Parsing and Gnisrap: A model of device use. In Empirical studies of programmers: Second workshop. Norwood, NJ: Ablex, pp. 132-146.Google Scholar
  33. 33.
    Green T.R.G. and Petre M. (1996). Usability analysis of visual programming environments: A “Cognitive Dimensions” approach. Journal of Visual Languages and Computing 7:131-174.CrossRefGoogle Scholar
  34. 34.
    Halpern, D.F. (1992). Sex differences in cognitive abilities. Hillsdale, NJ: Erlbaum.Google Scholar
  35. 35.
    Hayward, W.G. and Tarr, M.J. (1995). Spatial language and spatial representation. Cognition 55:39-84.CrossRefGoogle Scholar
  36. 36.
    Hegarty, M. (1992). Mental animation: Inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory and Cognition 18:1084-1102.CrossRefGoogle Scholar
  37. 37.
    Hishitani, S. (1990). Imagery experts: How do expert abacus operators process imagery? Applied Cognitive Psychology 4:33-46.CrossRefGoogle Scholar
  38. 38.
    Huttenlocher, J. (1968). Constructing spatial images: A strategy in reasoning. Psychological Review 75:550-560.CrossRefGoogle Scholar
  39. 39.
    Ittelson, W.H. (1996). Visual perception of markings. Psychonomic Bulletin and Review 3:171-187.CrossRefGoogle Scholar
  40. 40.
    Karmiloff-Smith, A. (1990). Constraints on representational change: Evidence from children’s drawing. Cognition 34:57-83.CrossRefGoogle Scholar
  41. 41.
    Kearins, J.M. (1981). Visual spatial memory in Australian Aboriginal children of desert regions. Cognitive Psychology 13:434-460.CrossRefGoogle Scholar
  42. 42.
    Koedinger, K.R and Anderson, J.R. (1990). Abstract planning and perceptual chunks: Elements of expertise in geometry. Cognitive Science 14:511-550.CrossRefGoogle Scholar
  43. 43.
    Kosslyn, S.M., Koenig, O., Barrett, A., Cave, C.B., Tang, J. and Gabrieli, J.D.E. (1989). Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. Journal of Experimental Psychology: Human Perception and Performance 15:723-735.CrossRefGoogle Scholar
  44. 44.
    Lakoff, G. and Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.Google Scholar
  45. 45.
    Lakoff, G. (1993). The contemporary theory of metaphor. In A. Ortony (Ed.), Metaphor and thought (2nd ed). Cambridge, UK: Cambridge University Press, pp. 202-251.CrossRefGoogle Scholar
  46. 46.
    Larkin, J.H. and Simon, H.A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 11:65-99.CrossRefGoogle Scholar
  47. 47.
    Levelt, W.J.M. (1981). The speaker’s linearisation problem. Philosophical Transactions of the Royal Society B 295:305-315.CrossRefGoogle Scholar
  48. 48.
    Lewis, C.M. (1991). Visualization and situations. In J. Barwise, J.M. Gawron, G. Plotkin and S. Tutiya (Eds), Situation theory and its applications. Stanford University: CSLI, pp. 553-580.Google Scholar
  49. 49.
    Linde, C. and Labov, W. (1975). Spatial structures as a site for the study of language and thought. Language 51:924-939.CrossRefGoogle Scholar
  50. 50.
    Lindsay, R.K. (1988). Images and inference. Cognition 29:229-250.CrossRefGoogle Scholar
  51. 51.
    Lowe, R.K. (1993). Diagrammatic information: Techniques for exploring its mental representation and processing. Information Design Journal 7:3-18.CrossRefGoogle Scholar
  52. 52.
    MacLeod, C.M., Hunt, E.B. and Mathews, N.N. (1978). Individual differences in the verification of sentence-picture relationships. Journal of Verbal Learning and Verbal Behavior 17:493-507.CrossRefGoogle Scholar
  53. 53.
    McDougal, T.F. and Hammond, K.J. (1995). Using diagrammatic features to index plans for geometry theorem-proving. In J. Glasgow, N.H. Narayanan and B. Chandrasekaran (Eds), Diagrammatic reasoning. Menlo Park, CA: AAAI Press, pp. 691-709.Google Scholar
  54. 54.
    McNamara, T.P. (1986). Mental representations of spatial relations. Cognitive Psychology 18:87-121.CrossRefGoogle Scholar
  55. 55.
    McNamara, T.P., Halpin, J.A. and Hardy, J.K. (1992). The representation and integration in memory of spatial and nonspatial information. Memory and Cognition 20:519-532.CrossRefGoogle Scholar
  56. 56.
    Mecklinger, A. and Müller, N. (1996). Dissociations in the processing of “what” and “where” information in working memory: An event-related potential analysis. Journal of Cognitive Neuroscience 8:453-473.CrossRefGoogle Scholar
  57. 57.
    Mishkin, M., Ungerleider, L.G. and Macko, K.A. (1983). Object vision and spatial vision: Two cortical pathways. Trends in Neurosciences 6:414-417.CrossRefGoogle Scholar
  58. 58.
    Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart & Winston.Google Scholar
  59. 59.
    Paivio, A. and Clark, J.M. (1991). Static versus dynamic imagery. In C. Cornoldi and M.A. McDaniel (Eds), Imagery and cognition. New York: Springer-Verlag, pp. 221-245.CrossRefGoogle Scholar
  60. 60.
    Peirce, C.S. (1903/1932). Collected papers, Vol. II: Elements of logic. C. Hartshorne and P. Weiss (Eds). Cambridge, MA: Harvard University Press.Google Scholar
  61. 61.
    Petre, M. and Green, T.R.G. (1990). Where to draw the line with text: Some claims by logic designers about graphics in notation. In D. Diaper, D. Gilmore, G. Cockton and B. Shackel (Eds), Proceedings of Interact ’90. Amsterdam: Elsevier, pp. 463-468.Google Scholar
  62. 62.
    Presson, C.C. (1987). The development of spatial cognition: Secondary uses of spatial information. In N. Eisenberg (Ed.) Contemporary topics in developmental psychology. New York: Wiley, pp. 77-112.Google Scholar
  63. 63.
    Ratcliff, G. (1979). Spatial thought, mental rotation and the right cerebral hemisphere. Neuropsychologia 17:49-54.CrossRefGoogle Scholar
  64. 64.
    Saariluoma, P. and Kalakoski, V. (1997). Skilled imagery and long-term working memory. American Journal of Psychology 110:177-202.CrossRefGoogle Scholar
  65. 65.
    Santa, J.L. (1977). Spatial transformations of words and pictures. Journal of Experimental Psychology: Human Learning and Memory 3:418-427.CrossRefGoogle Scholar
  66. 66.
    Scaife, M. and Rogers, Y. (1996). External cognition: How do graphical representations work? International Journal of Human Computer Studies 45:185-214.CrossRefGoogle Scholar
  67. 67.
    Schooler, J.W., Ohlsson, S. and Brooks, K. (1993). Thoughts beyond words: When language overshadows insight. Journal of Experimental Psychology 122:166-183.Google Scholar
  68. 68.
    Schwartz, D.L. (1995). Reasoning about the referent of a picture versus reasoning about the picture as the referent: An effect of visual realism. Memory and Cognition 23:709-722.CrossRefGoogle Scholar
  69. 69.
    Scott, F.J. and Baron-Cohen, S. (1996). Imagining real and unreal things: Evidence of a dissociation in autism. Journal of Cognitive Neuroscience 8:371-382.CrossRefGoogle Scholar
  70. 70.
    Shah, P. and Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: An individual differences approach. Journal of Experimental Psychology: General 125:4-27.CrossRefGoogle Scholar
  71. 71.
    Shneiderman, B. (1983). Direct manipulation: A step beyond programming languages. IEEE Computer (August):57-60.Google Scholar
  72. 72.
    Shu, N.C. (1988). Visual programming. New York: Van Nostrand Reinhold.Google Scholar
  73. 73.
    Silverman, I., Phillips, K. and Silverman, L.K. (1996). Homogeneity of effect sizes for sex across spatial tests and cultures: Implications for hormonal theories. Brain and Cognition 31:90-94.CrossRefGoogle Scholar
  74. 74.
    Sims, V.K. and Hegarty, M. (1997). Mental animation in the visuospatial sketchpad: Evidence from dual-task studies. Memory and Cognition 25:321-332.CrossRefGoogle Scholar
  75. 75.
    Smith, D.C. (1977). Pygmalion: A computer program to model and simulate creative thought. Boston, MA: Birkhauser.Google Scholar
  76. 76.
    Smyth, M.M. and Scholey, K.A. (1996). The relationship between articulation time and memory performance in verbal and visuospatial tasks. British Journal of Psychology 87:179-191.CrossRefGoogle Scholar
  77. 77.
    Stenning, K. and Oberlander, J. (1995). A cognitive theory of graphical and linguistic reasoning: logic and implementation. Cognitive Science 19:97-140.CrossRefGoogle Scholar
  78. 78.
    Tabachnek-Schijf, H.J.M., Leonardo, A.M. and Simon, H.A. (1997). CaMeRa: A computational model of multiple representations. Cognitive Science 21:305-350.CrossRefGoogle Scholar
  79. 79.
    Taylor, H.A. and Tversky, B. (1996). Perspective in spatial descriptions. Journal of Memory and Language 35:371-391.CrossRefGoogle Scholar
  80. 80.
    Thagard, P., Gochfeld, D. and Hardy, S. (1992). Visual analogical mapping. In Proceedings of the 14th Annual Meeting of the Cognitive Science Society, pp. 130-135.Google Scholar
  81. 81.
    Thomas, G.V. and Silk, A.M.J. (1990). An introduction to the psychology of children’s drawings. Hemel Hempstead: Harvester Wheatsheaf.Google Scholar
  82. 82.
    Tresch, M.C., Sinnamon, H.M. and Seamon, J.G. (1993). Double dissociation of spatial and object visual memory: Evidence from selective interference in intact human subjects. Neuropsychologia 31:211-219.CrossRefGoogle Scholar
  83. 83.
    Tversky, B., Kugelmass, S. and Winter, A. (1991). Cross-cultural and developmental trends in graphic productions. Cognitive Psychology 23:515-557.CrossRefGoogle Scholar
  84. 84.
    Ullman, S. (1984). Visual Routines. Cognition 18:97-159.CrossRefGoogle Scholar
  85. 85.
    vanSommers, P. (1984). Drawing and cognition. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
  86. 86.
    Zhang, J. (1997). The nature of external representations in problem solving. Cognitive Science 21:179-217.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2002

Authors and Affiliations

  • Alan F. Blackwell

There are no affiliations available

Personalised recommendations