The coordination of intramodal perceptual grouping and crossmodal interactions plays a critical role in constructing coherent multisensory percepts. However, the basic principles underlying such coordinating mechanisms still remain unclear. By taking advantage of an illusion called temporal ventriloquism and its influences on perceived speed, we investigated how audiovisual interactions in time are modulated by the spatial grouping principles of vision. In our experiments, we manipulated the spatial grouping principles of proximity, uniform connectedness, and similarity/common fate in apparent motion displays. Observers compared the speed of apparent motions across different sound timing conditions. Our results revealed that the effects of sound timing (i.e., temporal ventriloquism effects) on perceived speed also existed in visual displays containing more than one object and were modulated by different spatial grouping principles. In particular, uniform connectedness was found to modulate these audiovisual interactions in time. The effect of sound timing on perceived speed was smaller when horizontal connecting bars were introduced along the path of apparent motion. When the objects in each apparent motion frame were not connected or connected with vertical bars, the sound timing was more influential compared to the horizontal bar conditions. Overall, our findings here suggest that the effects of sound timing on perceived speed exist in different spatial configurations and can be modulated by certain intramodal spatial grouping principles such as uniform connectedness.
This is a preview of subscription content, log in to check access
We thank Aaron Clarke and Jennifer Corbett for the discussions on this work and comments on the manuscript. This research was supported by the Scientific and Technological Research Council of Turkey (TUBITAK Grant 113K547).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Han S, Humphreys GW, Chen L (1999) Uniform connectedness and classical gestalt principles of perceptual grouping. Percept Psychophys 61:661–674CrossRefPubMedGoogle Scholar
Hidaka S, Teramoto W, Sugita Y (2015) Spatiotemporal processing in crossmodal interactions for perception of the external world: a review. Front Integr Neurosci 9:62CrossRefPubMedPubMedCentralGoogle Scholar
Ho C, Spence C (2008) The multisensory driver: implications for ergonomic car interface design. Ashgate Publishing Limited, AldershotGoogle Scholar
Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Brain Res Cogn Brain Res 17:154–163CrossRefPubMedGoogle Scholar
Olivers CNL, Awh E, Van der Burg E (2016) The capacity to detect synchronous audiovisual events is severely limited: evidence from mixture modeling. J Exp Psychol Hum Percept Perform 42:2115–2124CrossRefPubMedGoogle Scholar
Palmer S, Rock I (1994) Rethinking perceptual organization: the role of uniform connectedness. Psychon Bull Rev 1:29–55CrossRefPubMedGoogle Scholar
Pelli D (1997) The video toolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442CrossRefPubMedGoogle Scholar
Wichmann FA, Hill NJ (2001a) The psychometric function: I. Fitting, sampling and goodness-of-fit. Percept Psychophys 63:1293–1313CrossRefPubMedGoogle Scholar
Wichmann FA, Hill NJ (2001b) The psychometric function: II. Bootstrap-based confidence intervals and sampling. Percept Psychophys 63:1314–1329CrossRefPubMedGoogle Scholar
Wilbiks JMP, Dyson BJ (2016) The dynamics and neural correlates of audio–visual integration capacity as determined by temporal unpredictability, proactive interference, and SOA. PLoS One 11(12):e0168304CrossRefPubMedPubMedCentralGoogle Scholar