Abstract
Understanding how we synchronize our actions with stimuli from different sensory modalities plays a central role in helping to establish how we interact with our multisensory environment. Recent research has shown better performance with multisensory over unisensory stimuli; however, the type of stimuli used has mainly been auditory and tactile. The aim of this article was to expand our understanding of sensorimotor synchronization with multisensory audio-visual stimuli and compare these findings to their individual unisensory counterparts. This research also aims to assess the role of spatio-temporal structure for each sensory modality. The visual and/or auditory stimuli had either temporal or spatio-temporal information available and were presented to the participants in unimodal and bimodal conditions. Globally, the performance was significantly better for the bimodal compared to the unimodal conditions; however, this benefit was limited to only one of the bimodal conditions. In terms of the unimodal conditions, the level of synchronization with visual stimuli was better than auditory, and while there was an observed benefit with the spatio-temporal compared to temporal visual stimulus, this was not replicated with the auditory stimulus.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Armstrong A, Issartel J, Varlet M, Marin L (2013) The supplementation of spatial information improves coordination. Neurosci Lett 548:212–216. doi:10.1016/j.neulet.2013.05.013
Beek PJ (1989) Juggling dynamics. Free University Press, Amsterdam
Bingham GP (2004) A perceptually driven dynamical model of bimanual rhythmic movement (and phase perception). Ecol Psychol 16:45–53
Bingham G, Zaal F, Shull JA, Collins DR (2001) The effect of frequency on the visual perception of relative phase and phase variability of two oscillating objects. Exp Brain Res 136:543–552. doi:10.1007/s002210000610
Brainard DH (1997) The psychophysics toolbox. Spat Vis 10:433–436
Buekers MJ, Bogaerts H, Swinnen S, Helsen W (2000) The synchronization of human arm movements to external events. Neurosci Lett 290:181–184
Carson R, Kelso J (2004) Governing coordination: behavioural principles and neural correlates. Exp Brain Res 154:267–274. doi:10.1007/s00221-003-1726-8
de Cheveigné A (2000) A model of the perceptual asymmetry between peaks and troughs of frequency modulation. J Acoust Soc Am 107:2645–2656
Demany L, McAnally KI (1994) The perception of frequency peaks and troughs in wide frequency modulations. J Acoust Soc Am 96:706–715
Elliott M, Wing A, Welchman A (2010) Multisensory cues improve sensorimotor synchronisation. Eur J Neurosci 31:1828–1835. doi:10.1111/j.1460-9568.2010.07205.x
Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162–169. doi:10.1016/j.tics.2004.02.002
Hajnal A, Richardson MJ, Harrison SJ, Schmidt R (2009) Location but not amount of stimulus occlusion influences the stability of visuo-motor coordination. Exp Brain Res 199:89–93. doi:10.1007/s00221-009-1982-3
Hove MJ, Spivey MJ, Krumhansl CL (2010) Compatibility of motion facilitates visuomotor synchronization. J Exp Psychol Hum Percept Perform 36:1525–1534. doi:10.1037/a0019059
Kelso J a, Fink PW, DeLaplain CR, Carson RG (2001) Haptic information stabilizes and destabilizes coordination dynamics. Proc R Soc B Biol Sci 268:1207–1213. doi:10.1098/rspb.2001.1620
Kilner J, Hamilton AFC, Blakemore SJ (2007) Interference effect of observed human movement on action is due to velocity profile of biological motion. Soc Neurosci 2:158–166. doi:10.1080/17470910701428190
Kleiner M, Brainard DH, Pelli D (2007) What’s new in Psychtoolbox-3? Perception 36 ECVP Abstr Suppl
Lopresti-Goodman S, Richardson M, Silva PL, Schmidt RC (2008) Period basin of entrainment for unintentional visual coordination. J Mot Behav 40:3–10
McAnally KI (2002) Timing of finger tapping to frequency modulated acoustic stimuli. Acta Psychol (Amst) 109:331–338
McCartney J (2002) Rethinking the computer music language: supercollider. Computer Music J 26:61–68. doi:10.1162/014892602320991383
Pelli D (1997) The video toolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442
Pikovsky A, Rosenblum M, Kurths J (2003) Synchronization: a universal concept in nonlinear sciences. Cambridge University Press, New York
Repp B (2005) Sensorimotor synchronization: a review of the tapping literature. Psychon Bull Rev 12:969–992
Repp BH, Su Y (2013) Sensorimotor synchronization: a review of recent research (2006–2012). Psychon Bull Rev 20:403–452. doi:10.3758/s13423-012-0371-2
Richardson MJ, Lopresti-Goodman S, Mancini M et al (2008) Comparing the attractor strength of intra-and interpersonal interlimb coordination using cross-recurrence analysis. Neurosci Lett 438:340–345. doi:10.1016/j.neulet.2008.04.083
Rodger MWM, Craig CM (2011) Timing movements to interval durations specified by discrete or continuous sounds. Exp Brain Res 214:393–402. doi:10.1007/s00221-011-2837-2
Roerdink M, Ophoff ED, Peper C, Beek P (2008) Visual and musculoskeletal underpinnings of anchoring in rhythmic visuo-motor tracking. Exp Brain Res 184:143–156. doi:10.1007/s00221-007-1085-y
Schmidt RC, Richardson MJ, Arsenault C, Galantucci B (2007) Visual tracking and entrainment to an environmental rhythm. J Exp Psychol Hum Percept Perform 33:860–870. doi:10.1037/0096-1523.33.4.860
Spence C, Squire S (2003) Multisensory Integration: maintaining the Perception of Synchrony. Curr Biol 13:R519–R521. doi:10.1016/S0960-9822(03)00445-7
Stanley J, Gowen E, Miall R (2007) Effects of agency on movement interference during observation of a moving dot stimulus. J Exp Psychol Hum Percept Perform 33:915–926. doi:10.1037/0096-1523.33.4.915
Varlet M, Marin L, Issartel J et al (2012) Continuity of visual and auditory rhythms influences sensorimotor coordination. PLoS One 7:e44082. doi:10.1371/journal.pone.0044082
Wing AM, Doumas M, Welchman AE (2010) Combining multisensory temporal information for movement synchronisation. Exp Brain Res 200:277–282. doi:10.1007/s00221-009-2134-5
Zaal F, Bingham GP, Schmidt R (2000) Visual perception of mean relative phase and phase variability. J Exp Psychol Hum Percept Perform 26:1209–1220. doi:10.1037//0096-1523.26.3.1209
Zelic G, Mottet D, Lagarde J (2012) Behavioral impact of unisensory and multisensory audio-tactile events: pros and cons for interlimb coordination in juggling. PLoS One. doi:10.1371/journal.pone.0032308
Acknowledgments
This research was supported through a grant from the Irish Research Council (IRC).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Armstrong, A., Issartel, J. Sensorimotor synchronization with audio-visual stimuli: limited multisensory integration. Exp Brain Res 232, 3453–3463 (2014). https://doi.org/10.1007/s00221-014-4031-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-014-4031-9