The role of executive control in rhythmic timing at different tempi
We investigated the role of attention and executive control in rhythmic timing, using a dual-task paradigm. The main task was a finger tapping task in which participants were asked to tap their index finger in time with metronome sequences. The tempo of the sequences ranged from 600 ms to 3000 ms between each beat. The distractor task, chosen so as to engage executive control processes, was a novel covert n-back task. When the tempo was slow, simultaneous performance of the tapping and n-back tasks resulted in significant performance degradation in both tasks. There was also some dual-task interference at the fast tempo levels, however, the magnitude of the interference was much smaller in comparison. The results suggests that, when the tempo is sufficiently slow, performing rhythmic timing demands attentional resources and executive control. This accords with models of time perception that assume that different timing mechanisms are recruited at different time scales. It also accords with models that assume a dedicated mechanism for rhythm perception and where rhythm perception is assumed to have a slower limit.
KeywordsExecutive function Tempo Rhythm perception Sensorimotor synchronization Finger tapping
Like visual perception can be divided into such subcategories as color perception, motion perception, and depth perception, so too can time perception. Some aspects of time perception are interval timing, temporal motor coordination, rhythm perception, and meter perception. It is possible to further subdivide time perception by modality and time scale. Much debated is whether all aspects of time perception share a common mechanism and, if not, what aspects of which mechanisms they do share (for a review see Ivry and Schlerf2008). One influential class of models assumes that timing is governed by a pacemaker-accumulator type mechanism (Ivry 1996), while more recent theoretical development are dynamical systems models that assume that timing and rhythm perception depend on oscillatory neural circuits (Large and Jones 1999; Large 2010). The former have been used successfully to model interval timing but has not proven a good model of responses to more complex stimuli such as musical rhythms, while the latter have been used to model rhythm and meter perception but have not been applied to interval timing (Grondin 2010). The two mechanisms – pacemaker-accumulator type and oscillatory based – need not stand in opposition; models exist that incorporate both (Teki et al. 2012).
Some have suggested that time perception relies on different mechanisms, depending on time scale. Lewis and Miall (2006) report evidence that different neural mechanism are responsible for timing intervals shorter versus longer than one second. The timing of sub-second intervals has been termed automatic timing and that of supra-second intervals has been termed cognitive timing. These terms reflect that automatic timing recruits circuits within the motor system and auditory cortex, while cognitive timing depends more on circuits within the prefrontal and parietal cortices (Lewis and Miall 2003). Interval timing is but one aspect of time perception, and a three second window has been suggested as the limit of temporal integration (Pöppel 2004; Mates et al. 1994). For rhythmic timing, for example, synchronizing finger taps to a metronome sequence, there is evidence supporting a shift in mechanisms between a one- and a two second interstimulus interval (ISI), i.e., the time interval between each beat in a rhythmic sequence, where a short ISI implies a fast tempo and vice versa. The Weber fraction – a measure of relative timing error – increases markedly from synchronizing to a one-second ISI to synchronizing to a two-second ISI (Grondin 2012) and so does the perceived difficulty of synchronizing (Bååth and Madison 2012). A related notion is the slower limit of rhythm perception, suggested to lie between a 1.5 second and a 3 second ISI (Repp 2006).
Brown (1997) hypothesizes that the mechanism responsible for rhythmic timing above a two second ISI requires more attentional and executive resources, support for which has been presented by Miyake et al. (2004). They showed that participants’ ability to synchronize to a metronome sequence while simultaneously performing a memory task is more impaired at ISIs above two seconds compared to shorter ISIs. However, a similar study by Holm et al. (2013) showed no evidence of any interaction effect between the ISIs of the sequences and whether participants performed an executive function distractor task or not. Both studies used a dual-task setup: a standard experimental paradigm that aims to discern whether two tasks depend on the same limited cognitive capacity, such as executive control or short term memory (Pashler 1994). One of the tasks – sometimes referred to as the main task – is the task under study; the second task – here called the distractor task – is assumed a priori to tax a certain cognitive capacity. Participants are either asked to perform the main task and the distractor task simultaneously or to perform solely the main task. Performance between the two conditions is then compared. If the distractor task interferes with performance in the main task, this is taken to indicate that both tasks rely – at least to some extent – on the same limited cognitive capacity.
Our study investigated whether rhythmic timing requires more attentional resources when the tempo is slow compared to when it is fast, where a fast tempo is loosely defined as an ISI shorter than 1500 ms and a slow tempo as an ISI longer than 1500 ms. In keeping with Miyake et al. (2004) and Holm et al. (2013), we used a dual-task paradigm, with a rhythmic timing task as the main task and a distractor task selected to require attentional resources and executive control.
More specifically, the main task was a sensorimotor synchronization task in where participants were asked to tap their index finger in time with metronome sequences. The tempo of the sequences included ISIs of 600 ms to 3000 ms. The distractor task was a novel variation on the n-back task. The n-back task was chosen because it is commonly used to assess executive function (Baddeley 2003) and because its design facilitates straightforward varying of attentional resource and executive control demands (Smith and Jonides 1999; Chatham et al. 2011). In line with the capacity sharing explanation of dual task interference (Pashler 1994), we hypothesize that simultaneously performing the timing task and the n-back task would require participants to share limited cognitive resources between these two task resulting in degraded performance in both tasks.
The difficulty with using the standard n-back task in a dual-task setup is that it requires participants to make responses throughout the task, either verbally or by key press. These motor responses might well interfere with the motor responses in the sensorimotor synchronization task, making it difficult to infer whether any task interference is due to attentional interference or motor interference. Therefore, a novel variant of the n-back task was used, here called the covert n-back task, where the participant makes no overt responses during the task.
If the distractor task should be found to impair rhythm timing more at slow tempi than at fast tempi then this would accord with models that assume different timing mechanisms being recruited depending on time scale (Lewis and Miall 2003). It would also accord with models that assume a dedicated rhythm-perception mechanism and a slower limit for rhythm perception, for example, Large’s (2008) proposed resonance model of rhythm perception.
Twenty-four participants were recruited via public advertising (11 women and 13 men, mean age: 27 years, SD: 6 years). Seventeen participants reported having experience playing a musical instrument and the mean reported number of years of regular practice was 13 (SD: 10).
The main task was a sensorimotor synchronization task. A covert response n-back task was used as distractor task.
Sensorimotor synchronization task
Participants were asked to synchronize finger taps to isochronous metronome sequences. They were to start as soon as a sequence started and continue until the sequence ended. They were requested not to subdivide the beat in any way, for example, by covert counting or by moving their body. While it is not possible to guarantee that participants completely refrain from subdividing the beat, this instruction was given with the objective to keep subdivision to a minimum. A custom-built tapping board consisting of a piezoelectric sensor mounted on 5 cm 2 corrugated fiberboard recorded the timing of the finger taps (see Bååth2011 for details). Participants tapped with their index finger, their hand resting on a plastic foam cushion. The stimuli consisted of isochronous sequences of 440 Hz square wave tones of 20 ms, where each sequence was 45 seconds long. Sequences were presented at five tempi with ISIs of 600, 897, 1342, 2006, and 3000 ms, selected so as to be equidistant on a log scale. An Arduino microcontroller generated the sounds and registered the taps.
Covert response N-back task
A given stimulus presentation constituted a target if the blue square’s current position was the same as two positions back. The square’s position was randomized so that, on average, half the presentations were targets. Instead of responding overtly to each target, participants were instructed to count the number of targets silently and report the total at the conclusion of each trial. This variation of the n-back task was used as the the responses during the 2-back task could otherwise interfere with the motor part of the sensorimotor synchronization task. The 2-back difficulty level of the n-back task was used, rather than a 1-back or 3-back level, as the 2-back level was found to be subjectively difficult, but still possible to carry out, for all persons it was tested on during the development of the task. Furthermore, the 2-back is a common difficulty level of the n-back task in, for example, neuroimaging studies of working memory (Owen et al. 2005).
Trials were 47 seconds long: slightly longer than the sensorimotor synchronization task trials. The distractor task was implemented in the Java programming language using the Processing framework (Reas and Fry 2007).
Participants were tested individually in a quiet room. Sessions began with a number of practice trials. First a sensorimotor synchronization trial at 600ms ISI, then an n-back only trial, and finally a trial where the two tasks were presented simultaneously. After this the participant was given four n-back-only-trials to establish baseline performance. For the sensorimotor-synchronization task, audio was delivered through a pair of closed headphones. The n-back distractor task used a 27” monitor positioned 50 cm from the participant.
The experiment proper consisted of four blocks of five sensorimotor synchronization trials, one for each of the five ISI levels. The order of the trials within each block was randomized. Either the first and third or the second and fourth blocks included the n-back distractor task and whether or not a participant started with a distractor block was also randomized. Each participant performed 20 trials, four at each ISI level, where two included the distractor task and two were without the distractor task.
The first three taps in every sensorimotor-synchronization trial were discarded to use only those taps where participants had time to synchronize to the sequence. For each tap, tone-to-tap asynchrony was calculated as the time difference between the tone and the tap, a negative asynchrony indicating that the tap preceded the tone and vice versa. Asynchrony SD was taken as a measure of timing variability and it was estimated for each participant and ISI level using the Bayesian hierarchical method described in Bååth (2015). Timing variability is here used as a measure of performance in the sensorimotor synchronization task with low variability taken to indicate high performance.
The Bayesian method was used, instead of the conventional sample SD, to mitigate the influence of taps that resulted from the participant reacting to the tones, rather than anticipating them. For ISIs shorter than 1500 ms participants tend to produce few reactive taps (Repp and Doggett 2007) and the Bayesian estimates will be highly similar to sample SD estimates. At longer ISIs participants tend to produce more reactive taps and the sample SD will underestimate the timing variability (Bååth 2015). The Bayesian method corrects for this by discarding the information from the reactive taps and produces an estimate of asynchrony SD using only the information from the anticipatory taps. If no correction was made for reactive taps then the estimated variability at slow ISIs would be a combination of timing variability and auditory reaction time variability, and the rational for doing the correction is that the focus here is solely on timing performance.
As a second measure of timing performance we used the coefficient of variation, calculated for each participant and condition as the asynchrony SD divided by the ISI. The coefficient of variation is a measure of timing performance relative to the ISI. As such it is useful when comparing performance between different ISI levels, while the asynchrony SD is useful as an absolute measure of performance.
Statistical analysis was performed using the statistical computing environment R (R Core Team 2012). Because timing variability was measured at five different ISIs for each participant, a linear mixed-effects model was used to asses how timing variability changed as a function of ISI and distractor condition. Mixed-effects model analyses were performed using the package lme4 (Bates et al. 2014).
Results of the mixed-effects model analysis of timing variability
Estimated coefficients for the mixed-effects model with ISI and distractor condition as predictors
95 % CI
ISI × distractor condition
. < .001
Many models of human timing and time perception have been proposed. One important way in which they differ is whether they posit a single, overreaching mechanism for timing or assume that timing recruits different mechanisms depending on the nature of the task. Regarding rhythmic timing, it has been proposed that different mechanisms are responsible depending on the tempo (Grondin 2012). Relevant here is the notion of a slower limit of rhythm perception, a proposed temporal boundary where perceiving and synchronizing to a rhythmic sequence goes from being effortless and automatic to requiring attention and executive control (Repp 2006). The present study used a dual-task setup to investigate whether rhythmic timing requires more attentional resources at slow tempi compared to comfortable tempi. The main task was a sensorimotor synchronization task where participants tapped their finger in time with metronome sequences and the distractor task was a covert response n-back task.
The results point towards rhythmic timing requiring more attentional resources at slow tempi. At the slowest tempo – at an interstimulus interval (ISI) of 3000 ms – performance of the tapping task and n-back task simultaneously resulted in a significant performance degradation in both tasks. It is difficult to identify a particular tempo at which dual-task interference becomes significant. Looking at the different performance measures, the largest increase in interference occurs between an ISI of 897 and 1342 ms for the log asynchrony SD, and between an ISI of 2006 and 3000 ms for the coefficient of variation, percentage of reactive responses, and number of errors in the n-back task. The results reflect the authors’ own experience when piloting the experiment and participants’ informal verbal reports: keeping the beat with a fast metronome while doing a 2-back task is easy; keeping the beat with a metronome that strikes every third second while doing a 2-back task is hard.
The fastest tempo – at an ISI of 600 ms – also saw dual-task interference, however, the magnitude of interference was much lower in comparison to the slower ISI levels. Therefore, while the result of this study show that rhythmic timing requires more attentional resources at slow tempi, it does not support the notion that executive function resources are not employed to some degree also at short ISIs. This accords with studies of non-rhythmic timing where timing performance has been shown to correlate with measures of working memory capacity and intelligence (Engle et al. 1999; Broadway and Engle 2011). Professional musicians have also been shown to make use of more attentional resources when involved in rhythmic timing compared to non-musicians (Fischinger 2011). It is, therefore, possible that the dual-task interference at the fast ISI levels would be more pronounced would this study have employed professional musicians as participants rather than non-musicians. However, if all trials where participant’s n-back performance was worse than their baseline performance are removed, the statistical result presented in Table 1 and Fig. 2 still remains. That is, the effect of ISI, distractor condition and their interaction on asynchrony SD is still statistically significant with p < 0.001.
The results of the present study are consistent with those from the study by Miyake et al. (2004), who asked participants to perform a word-memory task and rhythmic tapping task. While Miyake et al. did not analyze timing variability, they found that participants produced more reactive responses when both tasks were performed simultaneously. As with the present study, the difference was not found at shorter ISIs but became pronounced at 1800 ms ISI.
The results are not consistent with a recent study by Holm et al. (2013), who asked participants to perform a rhythmic timing task under either a low or high cognitive load condition. They did not find an effect of cognitive load on timing performance, nor did they find an interaction between cognitive load and sequence tempo. The results may be due to the distractor task used. Under the low cognitive load condition in Experiment 1 in Holm et al. participants were asked to tap the rhythm on two buttons using the sequence (1, 2, 1, 2, ...). In experiment 2, participants instead used four buttons and the sequence (1, 2, 3, 4, 1, 2, ...). Under the high cognitive load condition, participants were instead asked to tap the rhythm in a random sequence. A possible reason for why no task interference was observed when participants synchronized at a slow tempo is because the distractor task is easier to perform at a slower compared to a faster tempo, i.e., the distractor task is not invariant to the sequence tempo. At 1000 ms a participant must make twice as many random decisions as at an ISI of 2000 ms. The cognitive load resulting from the timing task might indeed have been heavier at the slower tempi, but no interference effect was manifest, because the cognitive load resulting from the distractor task was lighter at the slower tempi.
In conclusion, the present study shows that, when the tempo is sufficiently slow, performing rhythmic timing demands attentional resources and involvement of executive control. These results accord with neural models of timing that suggest a dedicated, automatic timing mechanism for short intervals and a general, cognitive timing mechanism for longer intervals (Lewis and Miall 2003). The results might also be explained though by a single timing mechanism that requires more cognitive resources at slower tempi. As shown in this study, rhythmic timing requires more cognitive resources the slower the tempo, and both attentional resources and executive control are presumably limited. Therefore, independent of whether rhythmic timing depends on one or several mechanisms, this study supports the view that rhythm perception and rhythmic timing have a slower limit.
- Bååth, R. (2011). Construction of a low latency tapping board. LUCS minor, 17. Retrieved from http://www.sumsar.net/papers/ICMPC_2012_rasmus_baath.pdf.
- Bååth, R. (2015). Estimating the distribution of sensorimotor synchronization data: A Bayesian hierarchical modeling approach. Behavior Research Methods. doi: 10.3758/s13428-015-0591-2.
- Bååth, R., & Madison, G. (2012). The subjective difficulty of tapping to a slow beat. In Proceedings of the 12th international conference on music perception and cognition. Retrieved from www.sumsar.net/papers/ICMPC_2012_rasmus_baath.pdf (pp. 82–85).
- Bates, D., Mächler, M., Bolker, B., & Walker, S. (2014). Fitting linear mixed-effects models using lme4. ArXiv e-prints. Retrieved from arXiv:1406.5823.
- Chatham, C.H., Herd, S.A., Brant, A.M., Hazy, T.E., Miyake, A., O’Reilly, R., & Friedman, N.P. (2011). From an executive network to executive control: a computational model of the n-back task. Journal of cognitive neuroscience, 23(11), 3598–3619. doi: 10.1162/jocn_a_00047.CrossRefPubMedPubMedCentralGoogle Scholar
- Grondin, S. (2012). Violation of the scalar property for time perception between 1 and 2 seconds: Evidence from interval discrimination, reproduction, and categorization. Journal of Experimental Psychology. Human Perception and Performance, 38(4), 880–890. doi: 10.1037/a0027188.CrossRefPubMedGoogle Scholar
- Large, E. (2008). Resonating to musical rhythm: Theory and experiment. In Grondin, S. (Ed.) The psychology of time (pp. 189–231): Emerald Group Publishing, doi: 10.1016/B978-0-08046-977-5.00006-5.
- Large, E. (2010). Neurodynamics of music. In Riess Jones, M., Fay, R.R., & Popper, A.N. (Eds.) Music perception (pp. 201–231): Springer, doi: 10.1007/978-1-4419-6114-3.
- Pöppel, E. (2004). Lost in time: A historical frame, elementary processing units and the 3-second window. In Acta neurobiologiae experimentalis. Retrieved from http://www.ane.pl/pdf/6428.pdf, (Vol. 64 pp. 295–301).
- R Core Team (2012). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.r-project.org.
- Reas, C., & Fry, B. (2007). Processing: a programming handbook for visual designers and artists: The MIT Press.Google Scholar