Long-term music training modulates the recalibration of audiovisual simultaneity
To overcome differences in physical transmission time and neural processing, the brain adaptively recalibrates the point of simultaneity between auditory and visual signals by adapting to audiovisual asynchronies. Here, we examine whether the prolonged recalibration process of passively sensed visual and auditory signals is affected by naturally occurring multisensory training known to enhance audiovisual perceptual accuracy. Hence, we asked a group of drummers, of non-drummer musicians and of non-musicians to judge the audiovisual simultaneity of musical and non-musical audiovisual events, before and after adaptation with two fixed audiovisual asynchronies. We found that the recalibration for the musicians and drummers was in the opposite direction (sound leading vision) to that of non-musicians (vision leading sound), and change together with both increased music training and increased perceptual accuracy (i.e. ability to detect asynchrony). Our findings demonstrate that long-term musical training reshapes the way humans adaptively recalibrate simultaneity between auditory and visual signals.
KeywordsRecalibration Multisensory perception Simultaneity judgement
We would like to thank Dr Chris Bevan and Eliot Farmer for engaging and useful discussion on what it means to be a drummer.
KP designed the study, KP and FEP piloted the study, CJ conducted the experiment, KP and MJP supervised CJ during the experiment conduction, KP and CJ analyzed the data, KP, CJ, FEP and MJP wrote the manuscript.
Compliance with ethical standards
Conflict of interest
The authors declare no competing financial interests.
- De Niear MA, Noel JP, Wallace MT (2017) The impact of feedback on the different time courses of multisensory temporal recalibration. Neural PlasticityGoogle Scholar
- Flatischler R (1992) The forgotten power of rhythm. Life RhythmGoogle Scholar
- Fontana F, Avanzini F, Rocchesso D (2004) Computation of nonlinear filter networks containing delay-free paths. In: Proceedings of the 7th International Conference on Digital Audio Effects (DAFX-04), Naples, Italy, pp 113–118Google Scholar
- Foxe JJ, Molholm S, Bene D, Frey VA, Russo HP, Blanco D, Ross LA (2013) Severe multisensory speech integration deficits in high-functioning school-aged children with autism spectrum disorder (ASD) and their resolution during early adolescence. Cerebral Cortex, bht213Google Scholar
- Love SA, Petrini K, Cheng A, Pollick FE (2013) A psychophysical investigation of differences between synchrony and temporal order judgments. PloS One, 8(1), e54798Google Scholar
- Nichols J (2012) Music education in homeschooling: Jamie’s story. Narrative soundings: an anthology of narrative inquiry in music education. Springer Netherlands, pp 115–125Google Scholar
- Proverbio AM, Attardo L, Cozzi M, Zani A (2015) The effect of musical practice on gesture/sound pairing. Front Psychol 6Google Scholar
- Roach NW, Heron J, Whitaker D, McGraw PV (2010) Asynchrony adaptation reveals neural population code for audio-visual timing. Proc R Soc Lond B: Biol Sci rspb20101737Google Scholar
- Schroeder CE, Foxe JJ (2004) 18 multisensory convergence in early cortical processing. The handbook of multisensory processes, p 295Google Scholar
- Simon DM, Noel JP, Wallace MT (2017) Event related potentials index rapid recalibration to audiovisual temporal asynchrony. Front Integr Neurosci, 11Google Scholar
- Stein BE, Meredith MA, Wallace MT (1993) The visually responsive neuron and beyond: multisensory integration in cat and monkey. Progress in Brain Research, vol. 95. Elsevier, pp 79–90Google Scholar
- Stevenson RA, Segers M, Ferber S, Barense MD, Wallace MT (2015) The impact of multisensory integration deficits on speech perception in children with autism spectrum disorders. Multisensory Sensorimotor Interactions In Speech Perception, 249 Studia Musicologica Norvegica, 32:169–191Google Scholar
- Van der Burg E, Alais D, Cass J (2015a) Audiovisual temporal recalibration occurs independently at two different time scales. Sci Rep, 5Google Scholar