On quantifying multisensory interaction effects in reaction time and detection rate
- 1.1k Downloads
Both mean reaction time (RT) and detection rate (DR) are important measures for assessing the amount of multisensory interaction occurring in crossmodal experiments, but they are often applied separately. Here we demonstrate that measuring multisensory performance using either RT or DR alone misses out on important information. We suggest an integration of RT and DR into a single measure of multisensory performance: the first index (MRE*) is based on an arithmetic combination of RT and DR, the second (MPE) is constructed from parameters derived from fitting a sequential sampling model to RT and DR data simultaneously. Our approach is illustrated by data from two audio–visual experiments. In the first, a redundant targets detection experiment using stimuli of different intensity, both measures yield similar pattern of results supporting the “principle of inverse effectiveness”. The second experiment, introducing stimulus onset asynchrony and differing instructions (focused attention vs. redundant targets task) further supports the usefulness of both indices. Statistical properties of both measures are investigated via bootstrapping procedures.
KeywordsAudio–visual interaction Redundant target paradigm Inverse effectiveness Sequential sampling model Inverse efficiency scores Multisensory performance enhancement
This research was supported by Deutsche Forschungsgemeinschaft (DFG) Grant No. Di 506/8-1 to A.D. and by SFB/TR31 “Active Hearing”, Teilprojekt B4 to H.C.
- Arndt, P. A., & Colonius, H. (2003). Two stages in crossmodal saccadic integration: Evidence from a visual–auditory focused attention task. Experimental Brain Research, 150, 417–426.Google Scholar
- Diederich, A. (1992). Intersensory facilitation: Race, superposition, and diffusion models for reaction time to multiple stimuli (Dissertation). Frankfurt: Verlag Peter Lang.Google Scholar
- Luce, R. D. (1986). Response times: Their role in inferring elementary mental organisation. Oxford Psychology Series; no. 8. New York: Oxford University Press.Google Scholar
- Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. London, Cambridge: The MIT Press.Google Scholar
- Townsend, J. T., & Ashby, F. G. (1983). Stochastic modelling of elementary psychological processes. New York: Cambridge Univ Press.Google Scholar
- Woodworth, R. S., & Schlosberg, H. (1956). Experimental psychology (rev. ed.). New York: Holt.Google Scholar