Visual motion aftereffects can occur contingent on arbitrary sounds. Two circles, placed side by side, were alternately presented, and the onsets were accompanied by tone bursts of high and low frequencies, respectively. After a few minutes of exposure to the visual apparent motion with the tones, a circle blinking at a fixed location was perceived as a lateral motion in the same direction as the previously exposed apparent motion (Teramoto et al. in PLoS One 5:e12255, 2010). In the present study, we attempted to reverse this contingency (pitch aftereffects contingent on visual information). Results showed that after prolonged exposure to the audio-visual stimuli, the apparent visual motion systematically affected the perceived pitch of the auditory stimuli. When the leftward apparent visual motion was paired with the high–low-frequency sequence during the adaptation phase, a test tone sequence was more frequently perceived as a high–low-pitch sequence when the leftward apparent visual motion was presented and vice versa. Furthermore, the effect was specific for the exposed visual field and did not transfer to the other side, thus ruling out an explanation in terms of simple response bias. These results suggest that new audiovisual associations can be established within a short time, and visual information processing and auditory processing can mutually influence each other.
Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429–433PubMedCrossRefGoogle Scholar
Favreau OE, Emerson VF, Corballis MC (1972) Motion perception: a color-contingent aftereffect. Science 176:78–79PubMedCrossRefGoogle Scholar
Haijiang Q, Saunders JA, Stone RW, Backus BT (2006) Demonstration of cue recruitment: change in visual appearance by means of Pavlovian conditioning. Proc Natl Acad Sci USA 103:483–488PubMedCrossRefGoogle Scholar
Held R, Shattuck SR (1971) Color- and edge-sensitive channels in the human visual system: tuning for orientation. Science 174:314–316PubMedCrossRefGoogle Scholar
Hidaka S, Teramoto W, Kobayashi M, Sugita Y (2011) Sound-contingent visual motion aftereffect. BMC Neurosci 12:44PubMedCrossRefGoogle Scholar
Jain A, Fuller S, Backus BT (2010) Absence of cue-recruitment for extrinsic signals: sounds, spots, and swirling dots fail to influence perceived 3D rotation direction after training. PLoS One 5:e13295PubMedCrossRefGoogle Scholar
Meyer GF, Wong LT, Timson E, Perfect P, White MD (2012) Objective fidelity evaluation in multisensory virtual environments: auditory cue fidelity in flight simulation. PLoS One 7:e44381PubMedCrossRefGoogle Scholar