Skip to main content
Log in

Time Course of Processes Underlying Picture and Word Evaluation: An Event-Related Potential Approach

  • Original Paper
  • Published:
Brain Topography Aims and scope Submit manuscript

Summary:

A substantial body of research suggests that the cognitive mechanisms for picture and word processes are functionally and anatomically distinct. In spite of significant advancements in the understanding of pictures and words, the electrophysiological activities mediating these processes are not well known. To address this issue, we examined event-related brain potentials (ERPs) to pictures and their printed names in a modified dual-target oddball task. ERPs were recorded while participants classified schematic pictures and their corresponding names into target and nontarget categories. Results showed that pictures and words were associated with electrophysiological responses that differed temporally and topographically. In comparison to words, P300s to pictures were characterized by shorter latency and larger amplitude at parietal electrodes. In contrast, words produced greater P200 amplitude at frontal areas. The results are consistent with the view that categorization of pictures is faster than words. Findings are discussed in relation to stimulus evaluation and the time course for picture and word classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alexander, J.E., Porjesz, B., Bauer, L.O., Kuperman, S., Morzorati, S., O'Connor, S.J., Rohrbaugh, J., Begleiter, H. and Polich, J. P300 hemispheric amplitude asymmetries from a visual oddball task. Psychophysiology, 1995, 32: 467–475.

    CAS  PubMed  Google Scholar 

  • Anderson, J. Arguments concerning representations for mental imagery. Psychological Review, 1989, 85: 249–277.

    Google Scholar 

  • Berman, S., Friedman, D. and Cramer, M. A developmental study of event-related potentials during explicit and implicit memory. International Journal of Psychophysiology, 1990, 10: 191–197.

    Article  CAS  PubMed  Google Scholar 

  • Boller, F. and De Reniz, E. Relationship between visual memory defects and hemispheric locus of lesion. Neurology, 1967, 17: 1052–1058.

    CAS  PubMed  Google Scholar 

  • Bright, P., Moss, H. and Tyler, L.K. Unitary vs multiple semantics: PET studies of word and picture processing. Brain Language, 2004, 89: 417–432.

    CAS  Google Scholar 

  • Budson, A.E., Droller, D.B., Dodson, C.S., Schacter, D.L., Rugg, M.D., Holcomb, P.J. and Daffner, K.R. Journal of Cognitive Neuroscience, 2005, 17: 1181–1193.

    Article  PubMed  Google Scholar 

  • Caramazza, A., Hillis, A.E., Rapp, B.C. and Romani, C. The multiple semantics hypothesis: Multiple Confusions? Cognitive Neuropsychology, 1990, 7: 161–189.

    Google Scholar 

  • Denckla, M.B. Performance on color tasks in kindergarten children. Cortex, 1972, 8: 117–190.

    Google Scholar 

  • De Renzi, E., Faglioni, P., Previdi, P., Sorgato, P. and Vescovini, E. The differential contribution of the verbal code in the course of visual learning: evidence from hemisphere-damaged patients. Cortex, 1981, 17: 447–452.

    CAS  PubMed  Google Scholar 

  • Duncan-Johnson, C.C. and Donchin, E. On quantifying surprise: the variation of event-related potentials with subjective probability. Psychophysiology, 1977, 14: 456–467.

    CAS  PubMed  Google Scholar 

  • Fabiani, M., Karis, D. and Donchin, E. P300 and recall in an incidental memory paradigm. Psychophysiology, 1986, 23: 298–308.

    CAS  PubMed  Google Scholar 

  • Fraisse, Paul. Motor and verbal reaction times to words and drawings. Psychonomic Science, 1968, 12: 235–236.

    Google Scholar 

  • Gainotti, G., Cappa, A., Perri, R. and Silveri, M.C. Disorders of verbal and pictorial memory in right and left brain-damaged patients. International Journal of Neuroscience, 1994, 78: 9–20.

    CAS  PubMed  Google Scholar 

  • Glanzer, M. and Clark, W.H. Accuracy of perceptual recall: An analysis of organization. Journal of Verbal Learning and Verbal Behavior, 1963, 1: 289–299.

    Article  Google Scholar 

  • Glaser, W.R. Picture naming. Cognition, 1992, 42: 61–105.

    Article  CAS  PubMed  Google Scholar 

  • Goldstein, B., Armstrong, C.L., Modestino, E., Ledakis, G., John, C. and Hunter, J.V. The impact of left and right intracranial tumors on picture and word recognition memory. Brain Cognition, 2004, 54: 1–6.

    Google Scholar 

  • Grady, C.L., McIntosh, A.R., Rajah, M.N. and Craik, F.I. Neural correlates of the episodic encoding of pictures and words. Proceedings National Academy Science, 1998, 95: 2703–2708.

    CAS  Google Scholar 

  • Greenham, S.L., Stelmack, R.M. and Campbell, K.B. Effects of attention and semantic relation on event-related potentials in a picture-word naming task. Biological Psychology, 2000, 55: 79–104.

    Article  CAS  PubMed  Google Scholar 

  • Greenhouse, W.W and Geisser, S. On methods in the analysis of profile data. Psychometrika, 1959, 24: 95–112.

    Article  Google Scholar 

  • Hillis, A.E. and Caramazza, A. Cognitive and neural mechanisms underlying visual and semantic processing: Implications from “optic aphasia”. Journal of Cognitive Neuropsychology, 1995, 7: 457–478.

    Google Scholar 

  • Kim, K.H., Yoon, H.W. and Park, H.W. Spatiotemporal brain activation pattern during word/picture perception by native Koreans. Cognitive Neuroscience and Neuropsychology, 2004, 15: 1099–1103.

    Google Scholar 

  • Johnson, C.J., Paivio, A. and Clark, J.M. Cognitive components of picture naming. Psychology Bulletin, 1996, 120: 113–139.

    CAS  Google Scholar 

  • Kirchhoff, B.A., Wagner, A.D., Maril, A. and Stern, C.E. Prefrontal-temporal circuitry for episodic encoding and subsequent memory. Journal of Neuroscience, 2000, 20: 6173–6180.

    CAS  PubMed  Google Scholar 

  • Köhler, S., Moscovitch, M., Winocur, G. and McIntosh, A.R. Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes. Acta. Psychologica., 2000, 105: 159–179.

    PubMed  Google Scholar 

  • Kok, A. On the utility of P3 amplitude as a measure of processing capacity. Psychophysiology, 2001, 38: 557–577.

    Article  CAS  PubMed  Google Scholar 

  • Kok, A. and Rooyakkers, J.A. ERPs to laterally presented pictures and words in a semantic categorization task. Psychophysiology, 1986, 23: 672–683.

    CAS  PubMed  Google Scholar 

  • Kutas, M., McCarthy, G. and Donchin E.Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science, 1977, 197: 792–795.

    CAS  PubMed  Google Scholar 

  • Martin, A., Wiggs, C.L. and Weisberg, J. Modulation of human medial temporal lobe activity by form, meaning, and experience. Hippocampus, 1997, 7: 587–593.

    Article  CAS  PubMed  Google Scholar 

  • McCarthy, G. and Donchin, E. A metric for thought: a comparison of P300 latency and reaction time. Science, 1981, 211: 77–80.

    CAS  PubMed  Google Scholar 

  • Nelson, T.O., Metzler, J. and Reed, D.A. Role of details in the long-term recognition of pictures and verbal descriptions. Journal of Experimental Psychology, 1974, 102: 184–186.

    CAS  PubMed  Google Scholar 

  • Noldy, N.E., Stelmack, R.M. and Campbell, K.B. Event-related potentials and recognition memory for pictures and words: the effects of intentional and incidental learning. Psychophysiology, 1990, 27: 417–428.

    CAS  PubMed  Google Scholar 

  • Paivio, A. Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 1991, 45: 255–287.

    Google Scholar 

  • Paivio, A. Imagery and Verbal Processes. New York: Holt, Rinehart and Winston, 1971.

    Google Scholar 

  • Paivio, A. Mental Representations. New York: Oxford University Press, 1986.

    Google Scholar 

  • Paivio, A. and Begg, I. Pictures and words in visual search. Memory and Cognition, 1974, 2: 515–521.

    Google Scholar 

  • Paivio, A. and Begg, I. Imagery and comprehension latencies as a function of sentence concreteness and structure. Perception and Psychophysics, 1971, 10: 408–412.

    Google Scholar 

  • Paivio, A. and Csapo, K. Concrete image and verbal memory codes. Journal of Experimental Psychology, 1969, 80: 279–283.

    Google Scholar 

  • Paivio, A., Rogers, T.B. and Smythe, P.C. Why are pictures easier to recall than words? Psychonomic Science, 1968, 11: 137–138.

    Google Scholar 

  • Polich, J. Attention, probability, and task demands as determinants of P300 latency from auditory stimuli. Electroencephalography and Clinical Neurophysiology, 1986, 63: 2551–2559.

    Google Scholar 

  • Postman, L. Picture-word differences in the acquisition and retention of paired associates. Journal of Experimental Psychology, 1978, 4: 146–157.

    CAS  Google Scholar 

  • Potter, M.C. and Faulconer, B.A. Time to understand pictures and words. Nature, 1975, 253: 437–438.

    Article  CAS  PubMed  Google Scholar 

  • Reinholz, J. and Pollmann, S. Differential activation of object-selective visual areas by passive viewing of pictures and words. Cognitive Brain Research, 2005, 24: 702–714.

    Article  PubMed  Google Scholar 

  • Saffran, E.M., Coslett, H.B., Martin, N. and Boronat, C.B. Access to knowledge from pictures but not words in a patient with progressive fluent aphasia. Language and Cognitive Processes, 2003, 18: 725–757.

    Article  Google Scholar 

  • Salmelin, R., Hari, R., Lounasmaa, O.V. and Sams, M. Dynamics of brain activation during picture naming. Nature, 1994, 31: 463–465.

    Google Scholar 

  • Seifert, L.S. Activating Representations in Permanent Memory: Different Benefits for Pictures and Words. Journal of Experimental Psychology: Learning, Memory, Cognition, 1997, 23: 1106–1121.

    CAS  Google Scholar 

  • Sevostianov, A., Horwitz B., Nechaev, V., Williams, R., Fromm, S. and Braun, A.R. fMRI study comparing names versus pictures of objects. Human Brain Mapping, 2002, 16: 168–175.

    Article  PubMed  Google Scholar 

  • Simos, P.G. and Molfese, D.L. Event-related potentials in a two-choice task involving within-form comparisons of pictures and words. International Journal of Neuroscience, 1997, 90: 233–253.

    CAS  PubMed  Google Scholar 

  • Shepard, R. Recognition memory for words, sentences, and pictures. Journal of Verbal Learning and Verbal Memory, 1967, 6: 156–163.

    Google Scholar 

  • Shiffrin, R.M. and Schneider, W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychology Review, 1977, 84: 127–190.

    Google Scholar 

  • Smith, M.L. Memory disorders associated with temporal-lobe lesions. In: F. Boller and J. Glafman (Eds.), Handbook of Neuropsychology, V3. Amsterdam: Elsevier, 1989: 91–106.

    Google Scholar 

  • Smith, M.C. and Magee, L.E. Tracing the time course of picture-word processing. Journal of Experimental Psychology, 1980, 109: 373–392.

    CAS  PubMed  Google Scholar 

  • Standing, L., Conezio, J. and Haber, R.N. Perception and memory for pictures: single-trial learning of 2500 visual stimuli. Psychonomic Science, 1970, 19: 73–74.

    Google Scholar 

  • Sutton, S., Braren, M., Zubin, J. and John, E.R. Evoked potential correlates of stimulus uncertainty. Science, 1965, 150: 1187–1188.

    CAS  PubMed  Google Scholar 

  • Theios, J. and Amrhein, P.C. Theoretical analysis of the cognitive processing of lexical and pictorial stimuli: Reading, naming, and visual and conceptual comparisons. Psychological Review, 1989, 96: 5–24.

    Article  CAS  PubMed  Google Scholar 

  • Warrington, E.K. The selective impairment of semantic memory. Quarterly Journal of Experimental Psychology, 1975, 27: 635–657.

    CAS  PubMed  Google Scholar 

  • Warrington, E.K. and Shallice, T. Category specific semantic impairments. Brain, 1984, 107: 829–854.

    PubMed  Google Scholar 

  • Watson, T.D., Azizian, A., Berry, S. and Squires, N.K. Event-related potentials as an index of similarity between words and pictures. Psychophysiology, 2005, 42: 361–368.

    Article  PubMed  Google Scholar 

  • Whitehouse, J.P. Imagery and verbal encoding in left and right hemisphere damaged patients. Brain and Language, 1981, 14: 315–332.

    Article  CAS  PubMed  Google Scholar 

  • Zhang, X.L., Begleiter, H., Porjesz, B. and Litke, A. Visual object priming differs from visual word priming: an ERP study. Electroencephalography Clinical Neurophysiology, 1997, 102(3): 200–215.

    CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Allen Azizian.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Azizian, A., Watson, T., Parvaz, M. et al. Time Course of Processes Underlying Picture and Word Evaluation: An Event-Related Potential Approach. Brain Topogr 18, 213–222 (2006). https://doi.org/10.1007/s10548-006-0270-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10548-006-0270-9

Key Words:

Navigation