Abstract
Whether information is stored and processed as images or propositions is of importance to instructional designers but may never be known for certain. Nevertheless, what is known about representation can still be useful. The author suggests that it is sometimes useful to consider information as being encoded as images, sometimes as language, and sometimes as propositions and describes research that provides evidence of processing in all these forms.
Similar content being viewed by others
References
Anderson, J. R. Arguments concerning representations for mental imagery.Psychological Review, 1978,85, 249–277.
Bennett, G. K., Seashore, H. G., & Wesman, A. G.Differential aptitude tests. New York: The Psychological Corporation, 1972.
Bobrow, D. G. & Collins, A.Representation and understanding: Studies in cognitive science. New York: Academic Press, 1975.
Chase, W. G. (Ed.).Visual information processing. New York: Academic Press, 1973.
Chase, W. G., & Simon, H. A. The mind’s eye in chess. In W. G. Chase (Ed.),Visual information processing. New York: Academic Press, 1973.
Clark, R. L. Media, mental imagery, and learning.Educational Communication and Technology Journal, 1978,26, 355–363.
Clark, H. H., Carpenter, P. A. & Just, M. A. On the meeting of semantics and perception. In W. G. Chase (Ed.),Visual information processing. New York: Academic Press, 1973.
Clark, H. H. & Chase, W. G. On the process of comparing sentences against pictures.Cognitive Psychology, 1972,3, 472–519.
Cooper, L. A. & Shepard, R. N. Mental transformation in the identification of left and right hands.Journal of Experimental Psychology: Human Perception and Learning, 1975,1, 48–56.
Das, J. P., Kirby, J. & Jarman, F. Simultaneous and successive syntheses: An alternative model for cognitive abilities.Psychological Bulletin, 1975,82, 87–103.
Deese, J. On the structure of associative meaning.Psychological Review, 1962,69, 161–175.
Deese, J.The structure of associations in language and thought. Baltimore: Johns Hopkins Press, 1965.
DeSoto, C., London, M. & Handel, S. Social reasoning and spatial paralogic.Journal of Personality and Social Psychology, 1965,2, 513–521.
Eisenstadt, M., & Kareev, Y. Aspects of human problem solving: The use of internal representations. In D. A. Norman & D. E. Rumelhart (Eds.),Explorations in cognition. San Francisco: Freeman, 1975.
Epstein, W., Rock, I., & Zuckerman, C. B. Meaning and familiarity in association learning.Psychological Monographs, 1960,74 (No. 491).
Fleming, M. L. The picture in your mind.AV Communication Review, 1977,25, 43–62.
French, J., Ekstrom, R. & Price, L.Kit of reference tests for cognitive factors. Princeton, N.J.: Educational Testing Service, 1963.
Galin, D. & Ornstein, R. Individual differences in cognitive style: I. Reflective eye movements.Neurophysiologia, 1974,12, 367.
Garskof, B. E., & Houston, J. P. Measurement of verbal relatedness: An ideographic approach.Psychological Review, 1963,70, 277–288.
Gropper, G. L. The design of stimulus materials in response-oriented programs.AV Communication Review, 1970,18, 129–159.
Holliday, W. G. Teaching verbal chains using flow diagrams and texts.AV Communication Review, 1976,24, 63–78.
Holliday, W. G., Brunner, L. L., & Donais, E. L. Differential cognitive and affective responses to flow diagrams in science.Journal of Research in Science Teaching, 1977,14, 129–138.
Horowitz, M. J.Image formation and cognition (2nd ed.). New York: Appleton-Century-Crofts, 1978.
Hubel, D. H., & Wiesel, T. N. Brain mechanisms of vision.Scientific American, 1979, 241(3), 150–162.
Ishibashi, T. Hallucinations produced by electrical stimulation of the temporal lobes in schizophrenic patients.Tohoku Journal of Experimental Medicine, 1964,82, 124.
Jacobs, R. A., & Rosenbaum, P. S.Grammar I. Boston: Ginn, 1967.
Just, M. A. & Carpenter, P. A. Eye fixations and cognitive processes.Cognitive Psychology, 1976,8, 441–480.
Kintsch, W.The representation of meaning in memory. Hillsdale, N.J.: Erlbaum, 1974.
Knowlton, J. Q. On the definition of “picture.”AV Communication Review, 1966,14, 157–183.
Kosslyn, S. M. Scanning visual images: Some structural implications.Perception and Psychophysics, 1973,14, 90–95.
Kosslyn, S. M.Constructing visual images. Unpublished doctoral dissertation, Stanford University, 1974.
Kosslyn, S. M. Information representation in visual images.Cognitive Psychology, 1975,7, 341–370.
Kosslyn, S. M., & Pomerantz, J. R. Imagery, propositions and the form of internal representations.Cognitive Psychology, 1977,9, 52–76.
Kosslyn, S. M. & Schwartz, S. P. A data-driven simulation of visual imagery.Cognitive Science, 1977,1, 265–296.
League, R.Psycholinguistic matrices. The Hague: Mouton, 1977.
Levie, W. H. & Levie, D. Pictorial memory processes.AV Communication Review, 1975,23, 81–97.
Neisser, U.Cognitive psychology. New York: Appleton-Century-Crofts, 1967.
Nelson, D. L., Reed, V. S., & McEvoy, C. L. Learning to order pictures and words: A model of sensory and semantic encoding.Journal of Experimental Psychology: Human Learning and Memory, 1977,3, 485–497.
Noble, C. E. Verbal learning and individual differences. In C. N. Cofer (Ed.),Verbal learning and verbal behavior. New York: McGraw-Hill, 1961.
Norman, D. A. & Rumelhart, D. E.Explorations in cognition. San Francisco: Freeman, 1975.
Ogden, C. K. & Richards, I. A.The meaning of meaning. New York: Harcourt Brace and World, 1946.
Osgood, C. E. The nature and measurement of meaning.Psychological Bulletin, 1952,49, 196–237.
Paivio, A.Imagery and verbal processes. New York: Holt, Rinehart & Winston, 1971.
Paivio, A. Language and knowledge of the world.Educational Researcher, 1974,3, 5–12.
Paivio, A. Perceptual comparisons through the mind’s eye.Memory and Cognition, 1975,3, 635–647.
Paivio, A. Images, propositions and knowledge. In J. M. Nicholas (Ed.),Images, perception and knowledge. Dordrecht, The Netherlands: Reidel, 1976.
Paivio, A., & Csapo, K. Concrete image and verbal memory codes.Journal of Experimental Psychology, 1969,80, 279–285.
Paivio, A. & Csapo, K. Picture superiority in free recall: Imagery or dual coding.Cognitive Psychology, 1973,5, 176–206.
Paivio, A. & Foth, D. Imaginal and verbal mediators and noun concreteness in paired-associate learning: The elusive interaction.Journal of Verbal Learning and Verbal Behavior, 1970,9, 384–390.
Paivio, A. & Yarmey, A. D. Pictures versus words as stimuli and responses in paired-associate learning.Psychonomic Science, 1966,5, 235–236.
Paivio, A., Yuille, C. & Smythe, P. C. Stimulus and response abstractness, imagery, and meaningfulness, and reported mediators in paired-associate learning.Canadian Journal of Psychology, 1966,20, 362–377.
Palmer, S. E. Visual perception and world knowledge: Notes on a model of sensory-cognitive interaction. In D. A. Norman & D. E. Rumelhart (Eds.),Explorations in cognition. San Francisco: Freeman, 1975.
Palmer, S. E. Hierarchical structure in perceptual representation.Cognitive Psychology, 1977,9, 441–474.
Penfield, W. Speech, perception and the cortex. In J. C. Eccles (Ed.),Brain and the conscious experience. New York: Springer-Verlag, 1966.
Posner, M. I. Coordination of internal codes. In W. G. Chase (Ed.),Visual information processing. New York: Academic Press, 1973.
Preece, P. F. W. The concepts of electromagnetism: A study of the internal representation of external codes.Journal of Research in Science Teaching, 1976,13, 517–524.
Pylyshyn, Z. What the mind’s eye tells the mind’s brain.Psychological Bulletin, 1973,80, 1–24.
Scragg, G. W. Answering questions about processes. In D. A. Norman & D. E. Rumelhart (Eds.),Explorations in cognition. San Francisco: Freeman, 1975.
Shavelson, R. J. Some aspects of the correspondence between content structure and cognitive structure in physics instruction.Journal of Educational Psychology, 1972,63, 225–234.
Sheehan, P.The function and nature of imagery. New York: Academic Press, 1972.
Shepard, R. N. The mental image.American Psychologist, February 1978,33, 125–137.
Shepard, R. N., & Podgorny, P. Cognitive processes that resemble perceptual processes. In W. K. Estes (Ed.),Handbook of learning and cognitive processes. Hillsdale, N.J.: Erlbaum, 1978.
Simon, H. A. What is visual imagery? An information processing interpretation. In L. W. Gregg (Ed.),Cognition in learning and memory. New York: Wiley, 1972.
Slatter, K. H. Alpha rhythms and mental imagery.Electroencephelographic Clinical Neurophysiology, 1961,12, 851.
Spangenberg, R. W. Structural coherence in pictorial and verbal displays.Journal of Educational Psychology, 1971,62, 514–520.
Sperry, R. W. Brain bisection and mechanisms of consciousness. In J. C. Eccles (Ed.),Brain and conscious experience. New York: Springer-Verlag, 1966.
Sperry, R. W. Lateral specialization of cerebral function in the surgically separated hemispheres. In F. J. McGuigan & R. A. Schoonover (Eds.),The psychophysiology of thinking. New York: Academic Press, 1973.
Tversky, B. Pictorial and verbal encoding in a short term memory task.Perceptual Psychophysics, 1969,6, 225.
Waern, Y. Structure in similarity matrices.Scandinavian Journal of Psychology, 1972,13, 5–16.
Wicker, F. W. On the locus of picture-word differences in paired-associate learning.Journal of Verbal Learning and Verbal Behavior, 1970,9, 52–57.
Winn, W. D. The structure of multiple free associations to words, black-and-white pictures, and color pictures.AV Communication Review, 1976,24, 273–293.
Winn, W. D. Imagery, words and information processing.Audiovisual Instruction, 1979, 24(6), 47.
Winn, W. D.The effect of attribute highlighting and spatial organization on the identification and classifying of science concepts as a function of verbal ability. Unpublished manuscript, 1980.
Winn, W. D. The effect of block-word diagrams on the structuring of science concepts as a function of general ability.Journal of Research in Science Teaching, in press.
Winn, W. D., & Schieman, E.The effects of the removal of common meaning on the structure of free associations to black-and-white and color pictures. Paper presented at the annual convention of the Association for Educational Communications and Technology, Miami Beach, April 1977.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Winn, W. Visual information processing: A pragmatic approach to the “imagery question”. ECTJ 28, 120–133 (1980). https://doi.org/10.1007/BF02766404
Issue Date:
DOI: https://doi.org/10.1007/BF02766404