Experimental Brain Research

, Volume 193, Issue 4, pp 603–614

The dog’s meow: asymmetrical interaction in cross-modal object recognition

Research Article

DOI: 10.1007/s00221-008-1664-6

Cite this article as:
Yuval-Greenberg, S. & Deouell, L.Y. Exp Brain Res (2009) 193: 603. doi:10.1007/s00221-008-1664-6

Abstract

Little is known on cross-modal interaction in complex object recognition. The factors influencing this interaction were investigated using simultaneous presentation of pictures and vocalizations of animals. In separate blocks, the task was to identify either the visual or the auditory stimulus, ignoring the other modality. The pictures and the sounds were congruent (same animal), incongruent (different animals) or neutral (animal with meaningless stimulus). Performance in congruent trials was better than in incongruent trials, regardless of whether subjects attended the visual or the auditory stimuli, but the effect was larger in the latter case. This asymmetry persisted with addition of a long delay after the stimulus and before the response. Thus, the asymmetry cannot be explained by a lack of processing time for the auditory stimulus. However, the asymmetry was eliminated when low-contrast visual stimuli were used. These findings suggest that when visual stimulation is highly informative, it affects auditory recognition more than auditory stimulation affects visual recognition. Nevertheless, this modality dominance is not rigid; it is highly influenced by the quality of the presented information.

Keywords

AuditoryVisualHumanMultisensoryObject recognitionConflict

Supplementary material

221_2008_1664_MOESM1_ESM.pdf (109 kb)
Supplemental Fig. 1: Facilitation and interference compared to neutral. For reaction time, the congruent (C, crossed bars) or incongruent (IC, dotted bars) RTs were subtracted from the neutral RT. For accuracy, the neutral hit rate was subtracted from the congruent or incongruent hit rate. Thus, facilitation is upwards, interference downwards for both measures. Dark bars attend-visual, light bars attend-auditory. Error bars reflect the standard error. a Performance on the short-delay condition of Experiment 1. b Performance on the long delay condition of Experiment 1. c Performance on Experiment 2 (PDF 108 kb)

Copyright information

© Springer-Verlag 2008

Authors and Affiliations

  1. 1.Department of PsychologyThe Hebrew University of JerusalemJerusalemIsrael
  2. 2.Interdisciplinary Center for Neural ComputationThe Hebrew University of JerusalemJerusalemIsrael