Abstract
We report that when a flash and audible click occur in temporal proximity to each other, the perceived time of occurrence of both events is shifted in such a way as to draw them toward temporal convergence. In one experiment, observers judged when a flash occurred by reporting the clock position of a rotating marker. The flash was seen significantly earlier when it was preceded by an audible click and significantly later when it was followed by an audible click, relative to a condition in which the flash and click occurred simultaneously. In a second experiment, observers judged where the marker was when the click was heard. When a flash preceded or followed the click, similar but smaller capture effects were observed. These capture effects may reveal how temporal discrepancies in the input from different sensory modalities are reconciled and could provide a probe for examining the neural stages at which evoked responses correspond to the contents of conscious perception.
Article PDF
Similar content being viewed by others
References
Benvento, L. A., Fallon, J., Davis, B. J., &Rezak, M. (1977). Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and orbital frontal cortex of the Macaque monkey.Experimental Neurology,57, 849–872.
Bermant, R. I., &Welch, R. B. (1976). The effect of degree of visualauditory stimulus separation and eye position upon the spatial interaction of vision and audition.Perceptual & Motor Skills,43, 487–493.
Canon, L. K. (1970). Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation.Journal of Experimental Psychology,84, 141–147.
Dixon, N. F., &Spitz, L. (1980). The detection of auditory visual desynchrony.Perception,9, 719–721.
Easton, R. D., &Moran, P. W. (1978). A quantitative confirmation of the visual capture of curvature.Journal of General Psychology,98, 105–112.
Gebhard, J. W., &Mowbray, G. H. (1959). On discriminating the rate of visual flicker and auditory flutter.American Journal of Psychology,72, 521–528.
Hay, J. C., Pick, H. L., Jr., &Ikeda, K. (1965). Visual capture produced by prism spectacles.Psychonomic Science,2, 215–216.
Howard, I. P., &Templeton, W. B. (1966).Human Spatial Orientation. New York: Wiley.
Kelso, J. A. S., Cook, E., Olson, M. E., &Epstein, W. (1975). Allocation of attention and the locus of adaptation to displaced vision.Journal of Experimental Psychology: Human Perception & Performance,1, 237–245.
Libet, B. (1985). Unconscious cerebral initiative and the role of conscious will in voluntary action.Behavioral & Brain Sciences,8, 529–566.
Libet, B., Wright, E. W., Feinstein, B., &Pearl, D. K. (1979). Subjective referral of the timing for a conscious sensory experience: A functional role for the somatosensory specif ic projection system in man.Brain,102, 193–224.
Nijhawan, R. (1994). Motion extrapolation in catching.Nature,370, 256–257.
Pick, H. L., Jr.,Warren, D. H., &Hay, J. C. (1969). Sensory conflicts in judgments of spatial direction.Perception & Psychophysics,6, 203–205.
Regan, D., &Spekreijse, H. (1977). Auditory-visual interactions and the correspondence between perceived auditory space and perceived visual space.Perception,6, 133–138.
Scheier, C. R., Nijhawan, R., &Shimojo, S. (1999). Sound alters visual temporal resolution [Abstract].Investigative Ophthalmology & Visual Science,40, S792.
Shipley, T. (1964). Auditory flutter-driving of visual flicker.Science,145, 1328–1330.
Welch, R. B., DuttonHurt, L. D., &Warren, D. H. (1986). Contributions of audition and vision to temporal rate perception.Perception & Psychophysics,39, 294–300.
Welch, R. B., &Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy.Psychological Bulletin,88, 638–667.
Whitney, D., &Murakami, I. (1998). Latency difference, not spatial extrapolation.Nature Neuroscience,1, 656–657.
Wollenberg, Z., &Sela, J. (1980). Frontal cortex of the awake squirrel monkey: Responses of single cells to visual and auditory stimuli.Brain Research,198, 216–220.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by NIH Grant NS17778 and by a grant from the McDonnell-Pew foundation.
Rights and permissions
About this article
Cite this article
Fendrich, R., Corballis, P.M. The temporal cross-capture of audition and vision. Perception & Psychophysics 63, 719–725 (2001). https://doi.org/10.3758/BF03194432
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03194432