Abstract
While it is well known that humans are highly responsive to rhythm, the factors that influence our ability to synchronize remain unclear. In the current study, we examined how stimulus modality and rhythmic deviation, along with the synchronizer’s level of musicality, impacted sensorimotor synchronization (SMS). Utilizing a finger-tapping task and three sensory modalities (visual, auditory, and tactile), we manipulated rhythmic deviation by varying the temporal position, intensity, and availability of cues across four deviation levels. Additionally, to determine our participants’ musical familiarity and aptitude, we administered the Goldsmiths Musical Sophistication Index (Gold-MSI) questionnaire. We found that SMS to external rhythmic stimuli was significantly more precise for auditory and tactile than for visual sequences. Further, we found SMS consistency significantly decreased in all modalities with increased rhythmic deviation, suggesting rhythmic deviation directly relates to SMS difficulty. Moreover, a significant correlation was found between Gold-MSI scores and SMS consistency in the most rhythmically deviant level, such that the higher one’s musical general sophistication score, the greater one’s SMS ability. This held for all three modalities. Combined, these findings suggest that rhythmic synchronization performance is affected not only by the modality and rhythmic deviation of the stimuli but also by the musical general sophistication of the synchronizer.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Ammirante, P., Patel, A. D., & Russo, F. A. (2016). Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23(6), 1882–1890. https://doi.org/10.3758/s13423-016-1067-9
Armstrong, A., & Issartel, J. (2014). Sensorimotor synchronization with audio-visual stimuli: limited multisensory integration. Experimental Brain Research, 232(11), 3453–3463. https://doi.org/10.1007/s00221-014-4031-9
Aschersleben, G. (2003). Effects of training on the timing of simple repetitive movements. Advances in psychology research (Vol. 23, pp. 15–30). New York: Nova Science Publishers.
Aschersleben, G. (2002). Temporal control of movements in sensorimotor synchronization. Brain and Cognition, 48(1), 66–79. https://doi.org/10.1006/brcg.2001.1304
Bartlett, N. R., & Bartlett, S. C. (1959). Synchronization of a motor response with an anticipated sensory event. Psychological Review, 66, 203–218. https://doi.org/10.1037/h0046490
Białuńska, A., & Dalla Bella, S. (2017). Music and speech distractors disrupt sensorimotor synchronization: effects of musical training. Experimental Brain Research, 235(12), 3619–3630. https://doi.org/10.1007/s00221-017-5080-7
Bouwer, F. L., Burgoyne, J. A., Odijk, D., Honing, H., & Grahn, J. A. (2018). What makes a rhythm complex? The influence of musical training and accent type on beat perception. PLoS ONE, 13(1), e0190322. https://doi.org/10.1371/journal.pone.0190322
Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (1994). Time series analysis; forecasting and control (3rd ed.). Englewood Cliffs, New Jersey: Prentice Hall
Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357
Brochard, R., Touzalin, P., Després, O., & Dufour, A. (2008). Evidence of beat perception via purely tactile stimulation. Brain Research, 1223, 59–64. https://doi.org/10.1016/j.brainres.2008.05.050
Chatzihidiroglou, P., Chatzopoulos, D., Lykesas, G., & Doganis, G. (2018). Dancing effects on preschoolers’ sensorimotor synchronization, balance, and movement reaction time. Perceptual and Motor Skills, 125(3), 3. https://doi.org/10.1177/0031512518765545.
Chen, Y., Repp, B. H., & Patel, A. D. (2002). Spectral decomposition of variability in synchronization and continuation tapping: Comparisons between auditory and visual pacing and feedback conditions. Human Movement Science, 21(4), 515–532. https://doi.org/10.1016/S0167-9457(02)00138-0
D’Andrea-Penna, G. M., Iversen, J. R., Chiba, A. A., Khalil, A. K., & Minces, V. H. (2020). One tap at a time: correlating sensorimotor synchronization with brain signatures of temporal processing. Cerebral Cortex Communications, 1(1), tgaa036. https://doi.org/10.1093/texcom/tgaa036
Delignières, D., & Torre, K. (2011). Event-based and emergent timing: dichotomy or continuum? A reply to Repp and Steinman (2010). Journal of Motor Behavior, 43(4), 311–318. https://doi.org/10.1080/00222895.2011.588274
Elliott, M. T., Wing, A. M., & Welchman, A. E. (2010). Multisensory cues improve sensorimotor synchronisation. European Journal of Neuroscience, 31(10), 1828–1835. https://doi.org/10.1111/j.1460-9568.2010.07205.x
Fisher, N. I. (1995). Statistical analysis of circular data. Cambridge: Cambridge University Press.
Gan, L., Huang, Y., Zhou, L., Qian, C., & Wu, X. (2015). Synchronization to a bouncing ball with a realistic motion trajectory. Scientific Reports, 5, 11974. https://doi.org/10.1038/srep11974
Grahn, J. A. (2012). See what I hear? Beat perception in auditory and visual rhythms. Experimental Brain Research, 220(1), 51–61. https://doi.org/10.1007/s00221-012-3114-8
Grahn, J. A., Henry, M. J., & McAuley, J. D. (2011). FMRI investigation of cross-modal interactions in beat perception: audition primes vision, but not vice versa. NeuroImage, 54(2), 1231–1243. https://doi.org/10.1016/j.neuroimage.2010.09.033
Guérin, S. M. R., Boitout, J., & Delevoye-Turrell, Y. N. (2021). Attention guides the motor-timing strategies in finger-tapping tasks when moving fast and slow. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2020.574396
Hawkins, J., Ahmad, S., & Cui, Y. (2017). A theory of how columns in the neocortex enable learning the structure of the world. Frontiers in Neural Circuits, 11, 81. https://doi.org/10.3389/fncir.2017.00081
Hinwar, R. P., & Lambert, A. J. (2021). Anauralia: the silent mind and its association with aphantasia. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2021.744213
Hove, M. J., & Keller, P. E. (2010). Spatiotemporal relations and movement trajectories in visuomotor synchronization. Music Perception, 28(1), 15–26. https://doi.org/10.1525/mp.2010.28.1.15
Hove, M. J., Spivey, M. J., & Krumhansl, C. L. (2010). Compatibility of motion facilitates visuomotor synchronization. Journal of Experimental Psychology, 36(6), 1525–1534. https://doi.org/10.1037/a0019059
Iversen, J. R., & Balasubramaniam, R. (2016). Synchronization and temporal processing. Current Opinion in Behavioral Sciences, 8, 175–180. https://doi.org/10.1016/j.cobeha.2016.02.027
Iversen, J. R., Patel, A. D., Nicodemus, B., & Emmorey, K. (2015). Synchronization to auditory and visual rhythms in hearing and deaf individuals. Cognition, 134, 232–244. https://doi.org/10.1016/j.cognition.2014.10.018
Ivry, R. B., Spencer, R. M., Zelaznik, H. N., & Diedrichsen, J. (2002). The cerebellum and event timing. Annals of the New York Academy of Sciences, 978(1), 302–317. https://doi.org/10.1111/j.1749-6632.2002.tb07576.x
Junkai, Y., Feiyi, O., Linus, H., Yingyu, H., Lingyu, G., Zhou, L., Huizhen, C., Mengye, W., Mengxue, H., Zhang, S., Yang, B., Junhao, P., & Wu, X. (2020). Tapping ahead of time: its association with timing variability. Psychological Research Psychologische Forschung, 84(2), 343–351. https://doi.org/10.1007/s00426-018-1043-2
Kapodistria, L., Chatzopoulos, D., Chomoriti, K., Lykesas, G., & Lola, A. (2021). Effects of a Greek traditional dance program on sensorimotor synchronization and response time of young children. International Electronic Journal of Elementary Education, 14, 1–8. https://doi.org/10.26822/iejee.2021.224
Kiparsky, P. (2018). Indo-European origins of the Greek hexameter (pp. 77–128). Leiden: Brill. https://doi.org/10.1163/9789004357778_006
Kung, S.-J., Chen, J. L., Zatorre, R. J., & Penhune, V. B. (2013). Interacting cortical and basal ganglia networks underlying finding and tapping to the musical beat. Journal of Cognitive Neuroscience, 25(3), 401–420. https://doi.org/10.1162/jocn_a_00325
Lagrois, M. -É., Palmer, C., & Peretz, I. (2019). Poor synchronization to musical beat generalizes to speech. Brain Sciences, 9(7), E157. https://doi.org/10.3390/brainsci9070157
London, J. (2012). Hearing in time: psychological aspects of musical meter. Oxford: Oxford University Press.
Lorås, H., Sigmundsson, H., Talcott, J. B., Öhberg, F., & Stensdotter, A. K. (2012). Timing continuous or discontinuous movements across effectors specified by different pacing modalities and intervals. Experimental Brain Research, 220(3), 335–347. https://doi.org/10.1007/s00221-012-3142-4
Maes, P.-J. (2016). Sensorimotor grounding of musical embodiment and the role of prediction: a review. Frontiers in Psychology, 7, 308. https://doi.org/10.3389/fpsyg.2016.00308
Manning, F. C., & Schutz, M. (2016). Trained to keep a beat: Movement-related enhancements to timing perception in percussionists and non-percussionists. Psychological Research Psychologische Forschung, 80(4), 532–542. https://doi.org/10.1007/s00426-015-0678-5
Matthews, T. E., Thibodeau, J. N. L., Gunther, B. P., & Penhune, V. B. (2016). The impact of instrument-specific musical training on rhythm perception and production. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2016.00069
McAuley, J. D., & Semple, P. (1999). The effect of tempo and musical experience on perceived beat. Australian Journal of Psychology, 51(3), 176–187. https://doi.org/10.1080/00049539908255355
Merchel, S., & Altinsoy, M. E. (2020). Psychophysical comparison of the auditory and tactile perception: a survey. Journal on Multimodal User Interfaces, 14(3), 271–283. https://doi.org/10.1007/s12193-020-00333-z
Müllensiefen, D., Gingras, B., Musil, J., & Stewart, L. (2014). The musicality of non-musicians: an index for assessing musical sophistication in the general population. PLoS ONE, 9(2), e89642. https://doi.org/10.1371/journal.pone.0089642
Navarro-Alarcon, D., Qi, J., Zhu, J., & Cherubini, A. (2020). A Lyapunov-stable adaptive method to approximate sensorimotor models for sensor-based control. Frontiers in Neurorobotics, 14, 59. https://doi.org/10.3389/fnbot.2020.00059
Nozaradan, S., Peretz, I., & Keller, P. E. (2016). Individual differences in rhythmic cortical entrainment correlate with predictive behavior in sensorimotor synchronization. Scientific Reports, 6(1), 20612. https://doi.org/10.1038/srep20612
Patel, A. D., Iversen, J. R., Chen, Y., & Repp, B. H. (2005). The influence of metricality and modality on synchronization with a beat. Experimental Brain Research, 163(2), 226–238. https://doi.org/10.1007/s00221-004-2159-8
Pecenka, N., & Keller, P. E. (2009). Auditory pitch imagery and its relationship to musical synchronization. Annals of the New York Academy of Sciences, 1169(1), 282–286. https://doi.org/10.1111/j.1749-6632.2009.04785.x
Pelli, D. G. (1997). The videotoolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision, 10(4), 437–442. https://doi.org/10.1163/156856897X00366
Pezzulo, G., Donnarumma, F., Dindo, H., D’Ausilio, A., Konvalinka, I., & Castelfranchi, C. (2019). The body talks: sensorimotor communication and its brain and kinematic signatures. Physics of Life Reviews, 28, 1–21. https://doi.org/10.1016/j.plrev.2018.06.014
Repp, B. H. (2003). Rate limits in sensorimotor synchronization with auditory and visual sequences: the synchronization threshold and the benefits and costs of interval subdivision. Journal of Motor Behavior, 35(4), 355–370. https://doi.org/10.1080/00222890309603156
Repp, B. H. (2005). Sensorimotor synchronization: a review of the tapping literature. Psychonomic Bulletin & Review, 12(6), 969–992. https://doi.org/10.3758/BF03206433
Repp, B. H., & Keller, P. E. (2004). Adaptation to tempo changes in sensorimotor synchronization: effects of intention, attention, and awareness. The Quarterly Journal of Experimental Psychology Section A, 57(3), 499–521. https://doi.org/10.1080/02724980343000369
Repp, B. H., London, J., & Keller, P. E. (2005). Production and synchronization of uneven rhythms at fast tempi. Music Perception, 23, 61–78. https://doi.org/10.1525/mp.2005.23.1.61
Repp, B. H., & Penel, A. (2002). Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. Journal of Experimental Psychology, 28(5), 1085–1099. https://doi.org/10.1037/0096-1523.28.5.1085
Repp, B. H., & Penel, A. (2004). Rhythmic movement is attracted more strongly to auditory than to visual rhythms. Psychological Research Psychologische Forschung, 68(4), 252–270. https://doi.org/10.1007/s00426-003-0143-8
Repp, B. H., & Su, Y.-H. (2013). Sensorimotor synchronization: a review of recent research (2006–2012). Psychonomic Bulletin & Review, 20(3), 403–452. https://doi.org/10.3758/s13423-012-0371-2
Ruxton, G. D. (2017). Testing for departure from uniformity and estimating mean direction for circular data. Biology Letters, 13(1), 20160756. https://doi.org/10.1098/rsbl.2016.0756
Schiavio, A., Menin, D., & Matyja, J. (2015). Music in the flesh: embodied simulation in musical understanding. Psychomusicology. https://doi.org/10.1037/pmu0000052
Sioros, G., Davies, M. E. P., & Guedes, C. (2018). A generative model for the characterization of musical rhythms. Journal of New Music Research, 47(2), 114–128. https://doi.org/10.1080/09298215.2017.1409769
Slater, J., Tierney, A., & Kraus, N. (2013). At-risk elementary school children with one year of classroom music instruction are better at keeping a beat. PLoS ONE, 8(10), e77250. https://doi.org/10.1371/journal.pone.0077250
Strait, D. L., Parbery-Clark, A., Hittner, E., & Kraus, N. (2012). Musical training during early childhood enhances the neural encoding of speech in noise. Brain and Language, 123(3), 191–201. https://doi.org/10.1016/j.bandl.2012.09.001
Stupacher, J. (2019). The experience of flow during sensorimotor synchronization to musical rhythms. Musicae Scientiae, 23(3), 348–361. https://doi.org/10.1177/1029864919836720
Su, Y.-H. (2016). Sensorimotor synchronization with different metrical levels of point-light dance movements. Frontiers in Human Neuroscience, 10, 186. https://doi.org/10.3389/fnhum.2016.00186
Team, R. C. (2013). R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org/. Accessed 18 May 2022
Van Der Steen, M., & Keller, P. (2013). The adaptation and anticipation model (ADAM) of sensorimotor synchronization. Frontiers in Human Neuroscience. https://doi.org/10.3389/fnhum.2013.00253
Varlet, M., Marin, L., Issartel, J., Schmidt, R. C., & Bardy, B. G. (2012). Continuity of visual and auditory rhythms influences sensorimotor coordination. PLoS ONE, 7(9), e44082. https://doi.org/10.1371/journal.pone.0044082
von Schnehen, A., Hobeika, L., Huvent-Grelle, D., & Samson, S. (2022). Sensorimotor synchronization in healthy aging and neurocognitive disorders. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.838511
Vorberg, D., & Hambuch, R. (1978). On the temporal control of rhythmic performance. Attention and performance VII (pp. 535–555). New York: Routledge.
Vorberg, D., & Wing, A. (1996). Modeling variability and dependence in timing. Handbook of perception and action (Vol. 2, pp. 181–262). Cambridge: Academic Press.
Wing, A. M. (2002). Voluntary timing and brain function: an information processing approach. Brain and Cognition, 48(1), 7–30. https://doi.org/10.1006/brcg.2001.1301
Zelaznik, H. N., Spencer, R. M. C., & Ivry, R. B. (2002). Dissociation of explicit and implicit timing in repetitive tapping and drawing movements. Journal of Experimental Psychology, 28(3), 575–588. https://doi.org/10.1037/0096-1523.28.3.575
Funding
National Institute of Health, P20GM103650, Fang Jiang
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Whitton, S.A., Jiang, F. Sensorimotor synchronization with visual, auditory, and tactile modalities. Psychological Research 87, 2204–2217 (2023). https://doi.org/10.1007/s00426-023-01801-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00426-023-01801-3