Experimental Brain Research

, Volume 232, Issue 11, pp 3453–3463 | Cite as

Sensorimotor synchronization with audio-visual stimuli: limited multisensory integration

  • Alan ArmstrongEmail author
  • Johann Issartel
Research Article


Understanding how we synchronize our actions with stimuli from different sensory modalities plays a central role in helping to establish how we interact with our multisensory environment. Recent research has shown better performance with multisensory over unisensory stimuli; however, the type of stimuli used has mainly been auditory and tactile. The aim of this article was to expand our understanding of sensorimotor synchronization with multisensory audio-visual stimuli and compare these findings to their individual unisensory counterparts. This research also aims to assess the role of spatio-temporal structure for each sensory modality. The visual and/or auditory stimuli had either temporal or spatio-temporal information available and were presented to the participants in unimodal and bimodal conditions. Globally, the performance was significantly better for the bimodal compared to the unimodal conditions; however, this benefit was limited to only one of the bimodal conditions. In terms of the unimodal conditions, the level of synchronization with visual stimuli was better than auditory, and while there was an observed benefit with the spatio-temporal compared to temporal visual stimulus, this was not replicated with the auditory stimulus.


Sensorimotor synchronization Multisensory Audio-visual Spatio-temporal Anchoring 



This research was supported through a grant from the Irish Research Council (IRC).


  1. Armstrong A, Issartel J, Varlet M, Marin L (2013) The supplementation of spatial information improves coordination. Neurosci Lett 548:212–216. doi: 10.1016/j.neulet.2013.05.013 PubMedCrossRefGoogle Scholar
  2. Beek PJ (1989) Juggling dynamics. Free University Press, AmsterdamGoogle Scholar
  3. Bingham GP (2004) A perceptually driven dynamical model of bimanual rhythmic movement (and phase perception). Ecol Psychol 16:45–53CrossRefGoogle Scholar
  4. Bingham G, Zaal F, Shull JA, Collins DR (2001) The effect of frequency on the visual perception of relative phase and phase variability of two oscillating objects. Exp Brain Res 136:543–552. doi: 10.1007/s002210000610 PubMedCrossRefGoogle Scholar
  5. Brainard DH (1997) The psychophysics toolbox. Spat Vis 10:433–436PubMedCrossRefGoogle Scholar
  6. Buekers MJ, Bogaerts H, Swinnen S, Helsen W (2000) The synchronization of human arm movements to external events. Neurosci Lett 290:181–184PubMedCrossRefGoogle Scholar
  7. Carson R, Kelso J (2004) Governing coordination: behavioural principles and neural correlates. Exp Brain Res 154:267–274. doi: 10.1007/s00221-003-1726-8 PubMedCrossRefGoogle Scholar
  8. de Cheveigné A (2000) A model of the perceptual asymmetry between peaks and troughs of frequency modulation. J Acoust Soc Am 107:2645–2656PubMedCrossRefGoogle Scholar
  9. Demany L, McAnally KI (1994) The perception of frequency peaks and troughs in wide frequency modulations. J Acoust Soc Am 96:706–715PubMedCrossRefGoogle Scholar
  10. Elliott M, Wing A, Welchman A (2010) Multisensory cues improve sensorimotor synchronisation. Eur J Neurosci 31:1828–1835. doi: 10.1111/j.1460-9568.2010.07205.x PubMedCrossRefGoogle Scholar
  11. Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162–169. doi: 10.1016/j.tics.2004.02.002 PubMedCrossRefGoogle Scholar
  12. Hajnal A, Richardson MJ, Harrison SJ, Schmidt R (2009) Location but not amount of stimulus occlusion influences the stability of visuo-motor coordination. Exp Brain Res 199:89–93. doi: 10.1007/s00221-009-1982-3 PubMedCrossRefGoogle Scholar
  13. Hove MJ, Spivey MJ, Krumhansl CL (2010) Compatibility of motion facilitates visuomotor synchronization. J Exp Psychol Hum Percept Perform 36:1525–1534. doi: 10.1037/a0019059 PubMedCrossRefGoogle Scholar
  14. Kelso J a, Fink PW, DeLaplain CR, Carson RG (2001) Haptic information stabilizes and destabilizes coordination dynamics. Proc R Soc B Biol Sci 268:1207–1213. doi: 10.1098/rspb.2001.1620 CrossRefGoogle Scholar
  15. Kilner J, Hamilton AFC, Blakemore SJ (2007) Interference effect of observed human movement on action is due to velocity profile of biological motion. Soc Neurosci 2:158–166. doi: 10.1080/17470910701428190 PubMedCrossRefGoogle Scholar
  16. Kleiner M, Brainard DH, Pelli D (2007) What’s new in Psychtoolbox-3? Perception 36 ECVP Abstr SupplGoogle Scholar
  17. Lopresti-Goodman S, Richardson M, Silva PL, Schmidt RC (2008) Period basin of entrainment for unintentional visual coordination. J Mot Behav 40:3–10PubMedCrossRefGoogle Scholar
  18. McAnally KI (2002) Timing of finger tapping to frequency modulated acoustic stimuli. Acta Psychol (Amst) 109:331–338CrossRefGoogle Scholar
  19. McCartney J (2002) Rethinking the computer music language: supercollider. Computer Music J 26:61–68. doi: 10.1162/014892602320991383 CrossRefGoogle Scholar
  20. Pelli D (1997) The video toolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442PubMedCrossRefGoogle Scholar
  21. Pikovsky A, Rosenblum M, Kurths J (2003) Synchronization: a universal concept in nonlinear sciences. Cambridge University Press, New YorkGoogle Scholar
  22. Repp B (2005) Sensorimotor synchronization: a review of the tapping literature. Psychon Bull Rev 12:969–992PubMedCrossRefGoogle Scholar
  23. Repp BH, Su Y (2013) Sensorimotor synchronization: a review of recent research (2006–2012). Psychon Bull Rev 20:403–452. doi: 10.3758/s13423-012-0371-2 PubMedCrossRefGoogle Scholar
  24. Richardson MJ, Lopresti-Goodman S, Mancini M et al (2008) Comparing the attractor strength of intra-and interpersonal interlimb coordination using cross-recurrence analysis. Neurosci Lett 438:340–345. doi: 10.1016/j.neulet.2008.04.083 PubMedCrossRefGoogle Scholar
  25. Rodger MWM, Craig CM (2011) Timing movements to interval durations specified by discrete or continuous sounds. Exp Brain Res 214:393–402. doi: 10.1007/s00221-011-2837-2 PubMedCrossRefGoogle Scholar
  26. Roerdink M, Ophoff ED, Peper C, Beek P (2008) Visual and musculoskeletal underpinnings of anchoring in rhythmic visuo-motor tracking. Exp Brain Res 184:143–156. doi: 10.1007/s00221-007-1085-y PubMedCrossRefPubMedCentralGoogle Scholar
  27. Schmidt RC, Richardson MJ, Arsenault C, Galantucci B (2007) Visual tracking and entrainment to an environmental rhythm. J Exp Psychol Hum Percept Perform 33:860–870. doi: 10.1037/0096-1523.33.4.860 PubMedCrossRefGoogle Scholar
  28. Spence C, Squire S (2003) Multisensory Integration: maintaining the Perception of Synchrony. Curr Biol 13:R519–R521. doi: 10.1016/S0960-9822(03)00445-7 PubMedCrossRefGoogle Scholar
  29. Stanley J, Gowen E, Miall R (2007) Effects of agency on movement interference during observation of a moving dot stimulus. J Exp Psychol Hum Percept Perform 33:915–926. doi: 10.1037/0096-1523.33.4.915 PubMedCrossRefPubMedCentralGoogle Scholar
  30. Varlet M, Marin L, Issartel J et al (2012) Continuity of visual and auditory rhythms influences sensorimotor coordination. PLoS One 7:e44082. doi: 10.1371/journal.pone.0044082 PubMedCrossRefPubMedCentralGoogle Scholar
  31. Wing AM, Doumas M, Welchman AE (2010) Combining multisensory temporal information for movement synchronisation. Exp Brain Res 200:277–282. doi: 10.1007/s00221-009-2134-5 PubMedCrossRefGoogle Scholar
  32. Zaal F, Bingham GP, Schmidt R (2000) Visual perception of mean relative phase and phase variability. J Exp Psychol Hum Percept Perform 26:1209–1220. doi: 10.1037//0096-1523.26.3.1209 PubMedCrossRefGoogle Scholar
  33. Zelic G, Mottet D, Lagarde J (2012) Behavioral impact of unisensory and multisensory audio-tactile events: pros and cons for interlimb coordination in juggling. PLoS One. doi: 10.1371/journal.pone.0032308 PubMedPubMedCentralGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Multisensory Motor Learning Laboratory (M²L²), School of Health and Human PerformanceDublin City UniversityGlasnevin, Dublin 9Ireland

Personalised recommendations