Abstract
Integrating vision and hearing is an important way in which we process our rich sensory environment. Partial deprivation of the visual system from the loss of one eye early in life results in adaptive changes in the remaining senses (e.g., Hoover et al. in Exp Brain Res 216:565–74, 2012). The current study investigates whether losing one eye early in life impacts the temporal window in which audiovisual events are integrated and whether there is vulnerability to the sound-induced flash illusion. In Experiment 1, we measured the temporal binding window with a simultaneity judgement task where low-level auditory and visual stimuli were presented at different stimulus onset asynchronies. People with one eye did not differ in the width of their temporal binding window, but they took longer to make judgements compared to binocular viewing controls. In Experiment 2, we measured how many light flashes were perceived when a single flash was paired with multiple auditory beeps in close succession (sound induced flash illusion). Unlike controls, who perceived multiple light flashes with two, three or four beeps, people with one eye were not susceptible to the sound-induced flash illusion. In addition, they took no longer to respond compared to both binocular and monocular (eye-patched) viewing controls. Taken together, these results suggest that the lack of susceptibility to the sound-induced flash illusion in people with one eye cannot be accounted for by the width of the temporal binding window. These results provide evidence for adaptations in audiovisual integration due to the reduction of visual input from the loss of one eye early in life.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257–262
Alais D, Newell FN, Mamassian P (2010) Multisensory processing in review: from physiology to behaviour. Seeing Perceiving 23:3–38
Alsius A, Paré M, Munhall K (2017) Forty years after hearing lips and seeing voices: the McGurk effect revisited. Multisens Res. https://doi.org/10.1163/22134808-00002565
Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am 20:1391–1397
Bertelson P, Aschersleben G (1998) Automatic visual bias of perceived auditory location. Psychon B Rev 5:482–489
Chen Y-C, Spence C (2017) Assessing the role of the ‘unity assumption’ on multisensory integration: a review. Front Psychol 8:445
Colavita FB (1974) Human sensory dominance. Percept Psychophys 16:409–412
Colavita FB, Weisberg D (1979) A further investigation of visual dominance. Percept Psychophys 25:345–347
Daw NW (2006) Visual development, 2nd edn. Springer, New York
Egeth HE, Sager LC (1977) On the locus of visual dominance. Percept Psychophys 22:77–86
Elbert T, Sterr A, Rockstroh B, Pantev C, Müller MM, Taub E (2002) Expansion of the tonotopic area in the auditory cortex of the blind. J Neuro Sci 22:9941–9944
Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT (2010) An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res 203:381–389
Green KP, Kuhl PK (1991) Integral processing of visual place and auditory voicing information during phonetic perception. J Exp Psychol Human 17:278–288
Harris LR, Jenkin M (2001) Vision and Attention. In: Harris LR, Jenkin M (eds) Vision and attention. Springer, New York, pp 1–18
Hoover AEN, Harris L, Steeves JKE (2012) Sensory compensation in sound localization in people with one eye. Exp Brain Res 216:565–574
King AJ (2009) Visual influences on auditory spatial learning. Phil Trans R Soc B 364:331–339
Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci 4:129
Lessard N, Pare M, Lepore F, Lassonde M (1998) Early blind human subjects localize sound sources better than sighted subjects. Nature 395:278–280
Massaro DW, Cohen MM (1983) Evaluation and integration of visual and auditory information in speech perception. J Exp Psychol Human 9:753–771
Moro SS, Steeves JKE (2012) No Colavita effect: equal auditory and visual processing in people with one eye. Exp Brain Res 216:367–373
Moro SS, Steeves JKE (2013) No Colavita effect: Increasing temporal load maintains equal auditory and visual processing in people with one eye. Neurosci Lett 556:186–190
Moro SS, Harris LR, Steeves JKE (2014) Optimal audiovisual processing in people with one eye. Multisens Res 27:173–188
Navarra J, Vatakis A, Zampini M, Humphreys W, Soto-Faraco S, Spence C (2005) Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. Cogn Brain Res 25:499–507
Powers AR III Hevey MA, Wallace MT (2012) Neural correlates of multisensory perceptual learning. J Neurosci 32:6263–6274
Romero Y, Senkowski D, Keil J (2015) Early and late beta band power reflects audiovisual perception in the McGurk illusion. J Neurophys 113:2342–2350
Shams L. Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408:788
Sinnett S, Soto-Faraco S, Spence C (2008) The co-occurrence of multisensory competition and facilitation. Acta Physiol (Oxf) 128:153–161
Spence C (2009) Explaining the colavita visual dominance effect. Prog Brain Res 176:245–258
Spence C, Parise C, Chen Y-C (2011) The colavita visual dominance effect. In: Murray MM, Wallace M (eds) Frontiers in the neural bases of multisensory processes. CRC Press, Boca Raton, pp 523–550
Steeves JKE, González EG, Steinbach MJ (2008) Vision with one eye: a review of visual function following monocular enucleation. Spat Vis 21:509–529
Stevenson RA, Zemtsov RK, Wallace MT (2012a) Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. J Exp Psych 38:1517–1529
Stevenson RA, Krueger Fister J, Barnett ZP, Nidiffer AR, Wallace MT (2012b) Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performance. Exp Brain Res 219:121–137
Taylor N, Isaac C, Milne E (2010) A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. J Autism Dev Disord 40:1403–1411
Vroomen J, Keetels M (2010) Perception of intersensory synchrony: a tutorial review. Atten Percept Psycho 72:871–884
Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psycholl Bull 88:638–667
Wong NA, Rafique SA, Kelly KR, Moro SS, Gallie BL, Steeves JKE (2017) Altered white matter structure in the visual system following early monocular enucleation. Hum Brain Mapp. https://doi.org/10.1002/hbm.23831
Acknowledgements
We sincerely thank all of our participants for their participation in this study. This research was supported by grants from the Natural Sciences and Engineering Research Council of Canada, the Canada Foundation for Innovation and early funding from the Banting Research Foundation to JKES. SSM is supported by the Natural Sciences and Engineering Research Council of Canada, Toronto Rehabilitation’s TD Graduate Scholarship for People with Disabilities and York University. The authors declare no conflict of interest in this publication.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Moro, S.S., Steeves, J.K.E. Normal temporal binding window but no sound-induced flash illusion in people with one eye. Exp Brain Res 236, 1825–1834 (2018). https://doi.org/10.1007/s00221-018-5263-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-018-5263-x