Abstract
Manual reaction times to visual, auditory, and tactile stimuli presented simultaneously, or with a delay, were measured to test for multisensory interaction effects in a simple detection task with redundant signals. Responses to trimodal stimulus combinations were faster than those to bimodal combinations, which in turn were faster than reactions to unimodal stimuli. Response enhancement increased with decreasing auditory and tactile stimulus intensity and was a U-shaped function of stimulus onset asynchrony. Distribution inequality tests indicated that the multisensory interaction effects were larger than predicted by separate activation models, including the difference between bimodal and trimodal response facilitation. The results are discussed with respect to previous findings in a focused attention task and are compared with multisensory integration rules observed in bimodal and trimodal superior colliculus neurons in the cat and monkey.
Article PDF
Similar content being viewed by others
References
Amlôt, R., Walker, R., Driver, J., &Spence, C. (2003). Multimodal visual-somatosensory integration in saccade generation.Neuropsychologia,41, 1–15.
Anastasio, T. J., Patton, P. E., &Belkacem-Boussaid, K. (2000). Using Bayes’ rule to model multisensory enhancement in the superior colliculus.Neural Computation,12, 1165–1187.
Arndt, A., &Colonius, H. (2003). Two separate stages in crossmodal saccadic integration: Evidence from varying intensity of an auditory accessory stimulus.Experimental Brain Research,150, 417–426.
Bell, A. H., Corneil, B. D., Meredith, M. A., &Munoz, D. P. (2001). The influence of stimulus properties on multisensory processing in the awake primate superior colliculus.Canadian Journal of Experimental Psychology,55, 123–132.
Bernstein, I. H., Chu, P. K., &Briggs, P. (1973). Stimulus intensity and foreperiod effects in intersensory facilitation.Quarterly Journal of Experimental Psychology,25, 171–181.
Cavina-Pratesi, C., Bricolo, E., Prior, M., &Marzi, C. A. (2001). Redundancy gain in the stop-signal paradigm: Implications for the locus of coactivation in simple reaction time.Journal of Experimental Psychology: Human Perception & Performance,27, 932–941.
Colonius, H. (1986). Measuring channel dependence in separate activation models.Perception & Psychophysics,40, 251–255.
Colonius, H. (1990). Possibly dependent probability summation of reaction time.Journal of Mathematical Psychology,34, 253–275.
Colonius, H. (1999). A theorem on parallel processing models with a generalized stopping rule.Mathematical Social Sciences,38, 247–258.
Colonius, H., &Arndt, P. (2001). A two-stage model for visual-auditory interaction in saccadic latencies.Perception & Psychophysics,63, 126–147.
Colonius, H., &Diederich, A. (2002). A maximum-likelihood approach to modeling multisensory enhancement. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.),Advances in neural information processing systems 14 (pp. 181–187). Cambridge, MA: MIT Press.
Colonius, H., &Diederich, A. (2004). Multisensory interaction in saccadic reaction time: A time-window-of-integration model.Journal of Cognitive Neuroscience,16, 1000–1009.
Corballis, M. C. (1998). Interhemispheric neural summation in absence of the corpus callosum.Brain,121, 1795–1807.
Corneil, B. D., &Munoz, D. P. (1996). The influence of auditory and visual distractors on human orienting gaze shifts.Journal of Neuroscience,16, 8193–8207.
Corneil, B. D., Van Wanrooij, M., Munoz, D. P., &Van Opstal, A. J. (2002). Auditory-visual interactions subserving goal-directed saccades in a complex scene.Journal of Neurophysiology,88, 438–454.
Diederich, A. (1992). Probability inequalities for testing separate activation models of divided attention.Perception & Psychophysics,52, 714–716.
Diederich, A. (1995). Intersensory facilitation of reaction time: Evaluation of counter and diffusion coactivation models.Journal of Mathematical Psychology,39, 197–215.
Diederich, A., &Colonius, H. (1987). Intersensory facilitation in the motor component?Psychological Research,49, 23–29.
Diederich, A., &Colonius, H. (2004). Modeling the time course of multisensory interaction in manual and saccadic responses. In G. Calvert, C. Spence, & B. E. Stein (Eds.),Handbook of multisensory processes (pp. 395–408). Cambridge, MA: MIT Press.
Diederich, A., Colonius, H., Bockhorst, D., &Tabeling, S. (2003). Visual-tactile spatial interaction in saccade generation.Experimental Brain Research,148, 328–337.
Forster, B., Cavina-Pratesi, C., Aglioti, S. M., &Berlucchi, G. (2002). Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time.Experimental Brain Research,143, 480–487.
Frens, M. A., &Van Opstal, A. J. (1998). Visual-auditory interactions modulate saccade-related activity in monkey superior colliculus.Brain Research Bulletin,46, 211–224.
Frens, M. A., Van Opstal, A. J., &Van der Willigen, R. F. (1995). Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements.Perception & Psychophysics,57, 802–816.
Gielen, S. C. A. M., Schmidt, R. A., &Van den Heuvel, P. J. M. (1983). On the nature of intersensory facilitation of reaction time.Perception & Psychophysics,34, 161–168.
Giray, M., &Ulrich, R. (1993). Motor coactivation revealed by response force in divided and focused attention.Journal of Experimental Psychology: Human Perception & Performance,19, 1278–1291.
Grice, G. R., Canham, L., &Boroughs, J. M. (1984). Combination rule for redundant information in reaction time tasks with divided attention.Perception & Psychophysics,35, 451–463.
Harrington, L. K., &Peck, C. K. (1998). Spatial disparity affects visual-auditory interactions in human sensorimotor processing.Experimental Brain Research,122, 247–252.
Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation.Journal of Experimental Psychology,63, 289–293.
Hughes, H. C., Nelson, M. D., &Aronchick, D. M. (1998). Spatial characteristics of visual-auditory summation in human saccades.Vision Research,38, 3955–3963.
Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., &Fendrich, R. (1994). Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses.Journal of Experimental Psychology: Human Perception & Performance,20, 131–153.
Jiang, W., Jiang, H., &Stein, B. E. (2002). Two corticotectal areas facilitate orientation behavior.Journal of Cognitive Neuroscience,14, 1240–1255.
Jiang, W., Wallace, M. T., Jiang, H., Vaughan, J. W., &Stein, B. E. (2001). Two cortical areas mediate multisensory integration in superior colliculus neurons.Journal of Neurophysiology,85, 506–522.
Kadunce, D. C., Vaughan, J. W., Wallace, M. T., Benedek, G., &Stein, B. E. (1997). Mechanisms of within- and cross-modality suppression in the superior colliculus.Journal of Neurophysiology,78, 2834–2847.
Kadunce, D. C., Vaughan, J. W., Wallace, M. T., &Stein, B. E. (2001). The influence of visual and auditory receptive field organization on multisensory integration in the superior colliculus.Experimental Brain Research,139, 303–310.
Kohfeld, D. L. (1971). Simple reaction time as a function of stimulus intensity in decibels of light and sound.Journal of Experimental Psychology,88, 251–257.
Laurienti, P. J., Burdette, J. H., Wallace, M. T., Yen, Y., Field, A. S., &Stein, B. E. (2002). Deactivation of sensory-specific cortex by cross-modal stimuli.Journal of Cognitive Neuroscience,14, 420–429.
Macaluso, E., Frith, C. D., &Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention.Science,289, 1206–1208.
Marzi, C. A., Smania, N., Martini, M. C., Gambina, G., Tomelleri, G., Palamara, A., Alessandrini, F., &Prior, M. (1996). Implicit redundant-targets effect in visual extinction.Neuropsychologia,34, 9–22.
McDonald, J. J., Teder-Sälejärvi, W. A., Di Russo, F., &Hillyard, S. A. (2003). Neural substrates of perceptual enhancement by crossmodal spatial attention.Journal of Cognitive Neuroscience,15, 10–19.
Meredith, M. A. (2002). On the neural basis for multisensory convergence: A brief overview.Cognitive Brain Research,14, 31–40.
Meredith, M. A., Nemitz, J. W., & Stein, B. E. (1987). Determinants of multisensory integration in superior colliculus neurons: I. Temporal factors.Journal of Neuroscience,7, 3215–3229.
Meredith, M. A., &Stein, B. E. (1986a). Spatial factors determine the activity of multisensory neurons in cat superior colliculus.Brain Research,365, 350–354.
Meredith, M. A., &Stein, B. E. (1986b). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration.Journal of Neurophysiology,56, 640–662.
Miller, J. O. (1982). Divided attention: Evidence for coactivation with redundant signals.Cognitive Psychology,14, 247–279.
Miller, J. [O.] (1986). Timecourse of coactivation in bimodal divided attention.Perception & Psychophysics,40, 331–343.
Miller, J. O., &Ulrich, R. (2003). Simple reaction time and statistical facilitation: A parallel grains model.Cognitive Psychology,46, 101–151.
Miller, J. [O.], Ulrich, R., &Lamarre, Y. (2001). Locus of the redundant-signals effect in bimodal divided attention: A neurophysiological analysis.Perception & Psychophysics,63, 555–562.
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., &Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study.Cognitive Brain Research,14, 115–128.
Mordkoff, J. T., &Miller, J. O. (1993). Redundancy gains and coactivation with two different targets: The problem of target preferences and the effects of display frequency.Perception & Psychophysics,53, 527–535.
Mordkoff, J. T., Miller, J. O., &Roch, A. C. (1996). Absence of coactivation in the motor component: Evidence from psychophysiological measures of target detection.Journal of Experimental Psychology: Human Perception & Performance,22, 25–41.
Mordkoff, J. T., &Yantis, S. (1993). Dividing attention between color and shape: Evidence of coactivation.Perception & Psychophysics,53,357–3666.
Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., &Schroeder, C. E. (2001). Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: A high-density electrical mapping study.Neuropsychologia,39, 828–844.
Nickerson, R. S. (1973). Intersensory facilitation of reaction time: Energy summation or preparation enhancement.Psychological Review,80, 489–509.
Piéron, H. (1914). Recherches sur les lois de variation des temps de latence sensorielle en fonction des intensités excitatrices.L’Anneé Psychologique,20, 17–96.
Plat, F. M., Praamstra, P., &Horstink, M. W. (2000). Redundantsignals effects on reaction time, response force, and movementrelated potentials in Parkinson’s disease.Experimental Brain Research,130, 533–539.
Raab, D. H. (1962). Statistical facilitation of simple reaction times.Transactions of the New York Academy of Sciences,24, 574–590.
Schröger, E., &Widmann, A. (1998). Speeded responses to audiovisual signal changes result from bimodal integration.Psychophysiology,35, 755–759.
Schwarz, W. (1989). A new model to explain the redundant-signals effect.Perception & Psychophysics,46, 498–500.
Schwarz, W. (1994). Diffusion, superposition, and the redundanttargets effect.Journal of Mathematical Psychology,38, 504–520.
Schwarz W., &Ischebeck, A. (1994). Coactivation and statistical facilitation in the detection of lines.Perception,23, 157–168.
Spence, C. (2002). Multisensory attention and tactile informationprocessing.Behavioural Brain Research,135, 57–64.
Spence, C., &Driver, J. (1997a). Audiovisual links in exogenous covert spatial orienting.Perception & Psychophysics,59, 1–22.
Spence, C., &Driver, J. (1997b). On measuring selective attention to an expected sensory modality.Perception & Psychophysics,59, 389–403.
Spence, C., Nicholls, M. E. R., &Driver, J. (2001). The cost of expecting events in the wrong sensory modality.Perception & Psychophysics,63, 330–336.
Stein, B. E., Magalhães-Castro, B., &Kruger, L. (1976). Relationship between visual and tactile representations in cat superior colliculus.Journal of Neurophysiology,39, 401–419.
Stein, B. E., &Meredith, M. A. (1993).The merging of the senses. Cambridge, MA: MIT Press.
Stein, B. E., Meredith, M. A., Huneycutt, W. S., &McDade, L. (1989). Behavioral indices of multisensory integration: Orientation to visual cues is affected by auditory stimuli.Journal of Cognitive Neuroscience,1, 12–24.
Todd, J. W. (1912).Reaction to multiple stimuli (Archives of Psychology, No. 25). New York: Science Press.
Townsend, J. T., &Nozawa, G. (1995). Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories.Journal of Mathematical Psychology,39, 321–359.
Ulrich, R., &Giray, M. (1986). Separate-activation models with variable base times: Testability and checking of cross-channel dependency.Perception & Psychophysics,39, 248–254.
Wallace, M. T., Meredith, M. A., &Stein, B. E. (1998). Multisensory integration in the superior colliculus of the alert cat.Journal of Neurophysiology,80, 1006–1010.
Wallace, M. T., Wilkinson, L. K., &Stein, B. E. (1996). Representation and integration of multiple sensory inputs in primate superior colliculus.Journal of Neurophysiology,76, 1246–1266.
Worsley, K. J. (1982). An improved Bonferroni inequality and applications.Biometrika,69, 297–302.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by Deutsche Forschungsgemeinschaft (DFG) Grant Di 506/8-1.
Rights and permissions
About this article
Cite this article
Diederich, A., Colonius, H. Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time. Perception & Psychophysics 66, 1388–1404 (2004). https://doi.org/10.3758/BF03195006
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195006