Facial Emotion Modulates the Neural Mechanisms Responsible for Short Interval Time Perception

Abstract

Emotionally arousing events can distort our sense of time. We used mixed block/event-related fMRI design to establish the neural basis for this effect. Nineteen participants were asked to judge whether angry, happy and neutral facial expressions that varied in duration (from 400 to 1,600 ms) were closer in duration to either a short or long duration they learnt previously. Time was overestimated for both angry and happy expressions compared to neutral expressions. For faces presented for 700 ms, facial emotion modulated activity in regions of the timing network Wiener et al. (NeuroImage 49(2):1728–1740, 2010) namely the right supplementary motor area (SMA) and the junction of the right inferior frontal gyrus and anterior insula (IFG/AI). Reaction times were slowest when faces were displayed for 700 ms indicating increased decision making difficulty. Taken together with existing electrophysiological evidence Ng et al. (Neuroscience, doi: 10.3389/fnint.2011.00077, 2011), the effects are consistent with the idea that facial emotion moderates temporal decision making and that the right SMA and right IFG/AI are key neural structures responsible for this effect.

Personal reflections of emotionally distressing events and positive events often include references to time (e.g., “It felt as if time had stood still”, “time just flew by”). For example, an altered sense of time is frequently referred to during accidents (Arstila 2012). Experimental research corroborates personal experience: time is reliably distorted for a variety of types of emotional arousing stimuli including affective images (Angrilli et al. 1997; Dirnberger et al. 2012; Grommet et al. 2011; Lui et al. 2011), sounds (Noulhiane et al. 2007), and fear-conditioned stimuli (Droit-Volet et al. 2010). In particular, overestimation of time has been recorded when individuals estimate the duration of facial expressions (e.g., Bar-Haim et al. 2010; Droit-Volet et al. 2004; Thayer and Schiff 1975; Tipples 2008). For example, in one study (Droit-Volet et al. 2004) participants were asked to indicate whether angry, happy, sad and neutral facial expressions were displayed for a duration that was more similar to either a standard short or a long duration that they had learnt earlier. Participants responded long more often for angry, happy and to a lesser extent sad facial expressions compared to neutral facial expressions. Furthermore, the bisection point—the comparison duration giving rise to 50 % of the long responses—was reached sooner for angry, happy and sad expressions compared to neutral expressions. In other words, emotional expressions were perceived as lasting longer; time was overestimated. Here, we attempted to establish the neural processes responsible for this effect.

Overestimation of time due to emotion can be interpreted in the context of information processing models of interval timing (Gibbon et al. 1984; Treisman 1963) that specify the operation of a dedicated internal clock. In brief, these models include a pacemaker that sends pulses (or units of elapsed time) to an accumulator. The pulses enter the accumulator via an attention-controlled switch that closes when timing starts at stimulus onset and opens again at stimulus offset when timing ends. The pacemaker is thought to operate at a variable speed and therefore, following the mathematical principles outlined in scalar expectancy theory (Gibbon et al. 1984) effects that are due to an increase in the rate of the pacemaker are predicted to multiply with increases in time. Key evidence for the existence of the pacemaker comes studies that have manipulated arousal (e.g. through the release of dopamine; Buhusi and Meck 2002) and subsequently reported a multiplicative effect on timing. Facial expressions are typically perceived as arousing (Calder et al. 2011) and also lead to an overestimation of time and therefore, are thought to speed the pacemaker in a similar manner to other types of arousal. Further evidence in keeping with pacemaker speeding due to arousal is the finding (Droit-Volet et al. 2004) that overestimation of time for facial expression is larger in magnitude for faces that appear more highly aroused (e.g., angry facial expressions) compared to expressions appearing less aroused (e.g., sad facial expressions). In summary, overestimation of time for emotional stimuli has been interpreted within the context of internal clock models of time perception as reflecting pacemaker speeding due to arousal.

Neuroimaging techniques with high spatial resolution such as fMRI are a further way of testing the idea that emotion affects the operation of an internal clock. If an internal clock exists then there should exist a dedicated neural mechanism for timing (Ivry and Schlerf 2008) and therefore, we should see modulation of this mechanism during the timing of facial expressions. If emotion modulates the operation of a dedicated internal clock, which neural areas are responsible for this effect? A recent review (Coull et al. 2011) and meta-analysis (Wiener et al. 2010) of neural activation studies have helped identify a network of structures which is typically more active during timing compared to a control. This network includes the supplementary motor area (SMA), basal ganglia (including the putamen and the caudate nucleus), the cerebellum and the ventral premotor cortex (in the region around the frontal operculum). The junction of the frontal operculum (of the inferior frontal gyrus) with the anterior insula (AI) is one region that is frequently active during time estimation tasks irrespective of task difficulty (Livesey et al. 2007). According to one model (Craig 2008, 2009) the AI is the neural substrate responsible for the effects of emotion on time and therefore, is of particular significance for the aims of the current research.

Although there are no datasets on how facial expressions specifically modulate activity within the timing network, recent studies have tested for the effects of emotionally arousing stimuli on activity within timing network (Dirnberger et al. 2012; Van Wassenhove et al. 2011). One study (Dirnberger et al. 2012) compared the effects of aversive and non-aversive pictures on neural activation during timing. On trials where participants incorrectly judged an aversive image as lasting longer than a non-aversive image, there was increased activation in the amygdala, putamen and insula. A separate study (van Wassenhove et al. 2011) compared neural activation and temporal estimation for looming stimuli that appear to approach the observer, with activation for receding visual stimuli that appear to move away from the observer. Looming stimuli are typically rated as more unpleasant and arousing than receding stimuli and therefore, are suitable for studying the neural mechanisms for temporal distortion due to emotion. For both looming and receding stimuli compared to static stimuli there was increased activation in the insular cortex, anterior cingulate cortex, basal ganglia and dorsolateral prefrontal cortex. Although time was overestimated for looming compared to receding stimuli, the contrast between these conditions did not lead to increased activation in the right anterior insular as predicted by the model proposed by Craig (2008, 2009). Nonetheless, the effects are generally consistent with such a role for the insula because, in addition to increased overall activity in the insular cortex, there was also left lateralized activation of the anterior insula for receding compared to looming stimuli. The latter effect is in keeping with the more specific proposal (Craig 2008) of forebrain emotional asymmetry for the effects of emotion on time. In summary, initial studies of the effects of emotion on the neural activity during timing have revealed activity in the network of structures typically engaged during timing. Further data is needed to clarify the role of insular as a key neural structure responsible for the effects of emotion on time.

Here, we chose the temporal bisection task to examine the effects of facial emotion on neural timing. The temporal bisection task was selected for several reasons. First, a recent study (Tipples et al. 2013) that used this task with face stimuli recorded robust activation in the core timing network structures (e.g., right inferior frontal gyrus, right SMA, right pre-SMA and basal ganglia) and therefore, the task is likely to be sensitive to the effects of facial emotion on activity within this network. Second, human performance on the temporal bisection task has been subjected to extensive empirical research into the operation of specific timing processes (for a review see; Kopec and Brody 2010). Of particular relevance is behavioral evidence (reviewed by; Kopec and Brody 2010) and electrophysiological evidence (Lindbergh and Kieffaber 2013; Ng et al. 2011; for a review see; Van Rijn et al. 2011) that supports the idea that temporal decision making processes during temporal bisection reach maximum activity prior to the mean duration. In light of these findings, we were interested in whether emotion might also affect temporal decision making by modulating neural activity that reaches a maximum prior to the mean duration. As a further index of temporal decision making difficulty we recorded reaction times. If temporal decision processes are maximally active prior to the mean duration as previous evidence indicates then reaction times should also be slower at this duration.

In summary, we tested for the effects of facial emotion on neural activation within the timing network using the temporal bisection procedure. Furthermore, we tested for modulation by emotion of activity in this network at a duration when temporal decision making processes are thought to operate.

Materials and Methods

Participants

All 19 participants (nine male) were right handed and had normal to corrected-to normal vision. The mean age of the male participants was 23 (SD = 1.88) and the mean age of the females was 24 (SD = 5.02). Written consent was obtained for all participants, and the study was approved by the York Neuroimaging Centre (YNiC) Ethics Committee.

Stimuli

Digitised photographs of eight individuals (four male and four female), each individual displaying an angry, happy and neutral expression were selected from the NimStim set of facial expressions (Tottenham et al. 2009). Stimulus presentation and data collection were controlled by E-Prime software (Schneider et al. 2002).

Image Acquisition

MRI images were acquired on a GE 3 Tesla HD Excite MRI scanner at the York Neuroimaging Center at the University of York. A Magnex head-dedicated gradient insert coil was used in conjunction with a birdcage, radio-frequency coil tuned to 127.4 MHz. A T2*-weighted gradient-echo EPI sequence was used to collect a series of 305 brain volumes (TR = 3 s, TE = 25 ms, FOV = 28 × 28 cm, matrix size = 128 × 128, 39 axial slices, slice thickness = 3 mm). After the functional scan, a high-resolution T1-weighted structural volume was acquired using 3D FSPGR (Sagittal Isotropic 3D Fast Spoiled Gradient-Recalled Echo) pulse sequence (TR = 8.03 s, TE = 3.07 s; Matrix = 256 × 256 × 176 mm3; FOV = 290 × 290 × 176 mm3, slice thickness = 1.13 × 1.13 × 1.0 mm3; Flip angle 20°) which was used to facilitate the spatial normalisation of the functional data.

Training Phase: Outside the MRI Scanner

Prior to entering the scanner, participants were trained to discriminate short (400 ms) from long (1,600 ms) stimulus durations. In the first block of eight trials, a pink oval appeared for either a short or long duration in a fixed sequence (e.g., long-short-long-short, etc.). Participants were informed of this sequence and were asked to indicate whether the stimulus appeared for either a short or long stimulus duration by pressing one of two labeled keys on a QWERTY keyboard (the “z” and “m” keys were used). Following a response, visual feedback was given for both correct (“yes”) and incorrect (“no”) decisions. The feedback appeared in the centre of the screen for 2 s and was followed by an inter-trial interval of 1,200 ms. In the second block, the pink oval was presented for a further 8 trials in a new random order for each participant. During this phase participants continued to indicate whether the oval appeared for either short or long stimulus durations. Participants continued to receive feedback in this phase. After the training phase participants completed the experimental blocks of trials in the MRI scanner.

fMRI Design and Procedure

Each scanning session consisted of 24 active blocks comprised of 8 blocks for each expression type (angry, happy, neutral). Active blocks were preceded and followed by passive rest blocks lasting 15 s. A mixed-model design was used: expression (angry, happy, neutral) and identity of face was varied between blocks, while the duration of the faces (400, 700, 1,000, 1,300, 1,600) and sex of face (male, female) were varied (on trial by trial basis) within each block. Specifically, on each trial the faces could vary in sex (either male or female) or duration, but (within blocks) the expression and identity remained constant. Within each block there were 10 trials, with the face of individual male and individual female models displayed for each duration (400, 700, 1,000, 1,300, 1,600). All face stimuli were presented in a separate pseudo-randomized order for each participant within each block. The type of expression was also randomised across blocks using a single, pseudo-randomized order. Participants were instructed to respond, using their dominant hand, via a button press, by pressing one button with their right index finger (for short) and another button with their middle finger (for long). Each face was separated by a fixed 1,200 ms interval during which the screen appeared blank and participants made their response.

fMRI Pre-Processing

The pre-processing and statistical analyses of MRI data were carried out using SPM 8 software (Wellcome Trust Centre for Neuroimaging, London, UK). The first 9 s of data (the first three volumes) from each scan session to allow for T1 equilibration effects. Standard pre-processing was applied including: slice-timing correction, normalization to a standard brain template in MNI space, smoothing with an 8 mm FWHM Gaussian kernel and removal of low frequency fluctuations using a high-pass filter with a cut-off at 128 s.

General Linear Modeling

At the first-level of analysis each participant’s data were subjected to a regression analyses containing terms reflecting the predicted BOLD signal to the three active expression conditions (Angry, Happy, Neutral) and the passive baseline convolved with a canonical hemodynamic response function. Six movement parameters from the realignment corrections were entered as additional regressors of no interest for each scanning run, in order to account for residual movement artifacts after realignment. Three sets of contrast images were created for level 2, random effects analyses. First, to test the comparison Emotion > Neutral we used the following weighted contrasts: Angry (+1), Happy (+1) and Neutral (−2). Second, to test for activity specifically associated with temporal decision making difficulty (see introduction for rationale), we created a weighted contrast to test for increased activity at the intermediate, 700 ms duration: −1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms). Third, we tested for modulation of the latter contrast by emotion in the form of an Emotion > Neutral × duration [−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)] contrast.

Regions of Interest (ROI) Analyses and Statistical Thresholding

The ROIs were selected based on recent reviews (Coull et al. 2011) and a meta-analysis (Wiener et al. 2010) of fMRI studies of time perception and included the bilateral basal ganglia (caudate, putamen, and pallidum), SMA, right frontal inferior frontal gyrus (pars triangularis) and intersection of the insula and inferior frontal gyrus (anterior insula). The anatomical ROIs for the basal ganglia, SMA and rIFG (pars triangularis) were created using the Wake Forest University Pickatlas Tool (Maldjian et al. 2003) for SPM8 with the Automated Anatomical Labeling Atlas (AAL; Tzourio-Mazoyer et al. 2002) used to define each region bilaterally.

The ROI mask for the right inferior frontal, anterior insula region was created by defining an 8 mm sphere centered on Talairach co-ordinates ([Right; x = 47, y = 13, z = 13]; [Left: x = −38, y = 19, z = −2]) reported in previous research (Wittmann et al. 2010). All contrasts within the predefined ROIs were evaluated as statistically significant activation if they survived the family-wise error (FWE) correction (P < 0.05) for multiple comparisons within small volumes (small-volume correction [SVC]) as implemented in SPM 8. To explore other possible regions of activation that were not predicted, the three sets of contrasts described above were analyzed using one-sample t-tests of signal change across the entire brain thresholded at P < 0.001 uncorrected at the voxel level and P < 0.05 FWE corrected at the cluster level.

Behavioral Data Analyses

Equipment failure led to the loss of the behavioral data from two participants and consequently, analyses of the behavioral data were carried out on the data of the remaining 17 participants. The median RTs, bisection points (BP) and Weber ratios (WR) were calculated for each participant and each expression condition separately. Median RTs were chosen as an index of decision making difficulty with slower median RTs at different durations or for different expressions) indexing more difficult decisions.

The BP and WR indices were calculated from the slope and intercept parameters from the regression of proportion of long responses onto time. The BP refers to the point of subjective equality (0.5 point on the psychometric function) and was calculated using the method of least squares from the intercept and slope parameters of regression of p(long) onto stimulus duration (Gescheider 1997).

The BP is an index of the perception of time that can be used to compare either relative under- or over-estimation of time across conditions (for examples see; Ortega and López 2008; Wearden 2008). A relatively low BP value (compared to other conditions or individuals) indicates that participants perceive more time as having passed; time is overestimated. The WR measures temporal sensitivity and is calculated by dividing half the difference between the upper difference limen (plong[0.75]) and the lower difference limen (plong[0.25]) by the BP. In short, the BP is an index of perceived duration and the WR is an index of temporal sensitivity or precision.

Bisection and Weber Indices of Timing

The mean BPs, WRs and median RTs are displayed in Fig. 1. The BP and WR values were analyzed using paired sample t tests for the effects of interest: Angry > Neutral, Angry > Happy, Happy > Neutral. As can be seen in Fig. 1a the psychophysical curve was moved to the leftward for angry and happy expressions compared to neutral expressions and the mean BP (Fig. 1b) was reached sooner for both angry (M = 859 ms) and happy (M = 875 ms) facial expressions compared to neutral (M = 918 ms) expressions [Angry > Neutral, t (16) = −3.02, P = 0.008; Happy > Neutral, t (16) = −2.75, P = 0.01]. Although the mean BP value was lower by 19 ms for angry expressions compared to happy expressions this difference was not significant, t (16) = −0.74, P = 0.47. With respect to the WR values, individuals demonstrated good temporal sensitivity: the mean WR values for each expression (angry faces, M = 0.21; happy faces, M = 0.21; neutral faces, M = 0.23) were lower than that reported previously (e.g., Tipples 2008) and did not differ between the expression conditions (all P’s > 0.1).

Fig. 1
figure1

Behavioral data of a mean proportion of long responses as a function of expression (angry, happy, neutral) and duration, b the mean bisection point (BP) in milliseconds for each expression and c the median RTs (ms) as a function of expression and duration

Reaction Time Analyses

The median RTs were analyzed in a 3 × 5 (Expression [angry, neutral] × Duration [400, 700, 1,000, 1,300, 1,600] repeated measures ANOVA. There was a main effect of duration, F(4, 60) = 69.42, P < 0.0001, η 2p  = 0.81; RTs were slowest at the 700 ms duration (M = 489 ms) compared to all other durations (Bonferroni corrected P < 0.016) and also, there was a linear decrease in RTs from 1,000 ms (M = 402 ms) to 1,300 ms (M = 319 ms) to 1,600 ms (M = 279 ms). As can be seen in Fig. 1c, RT slowing at 700 ms was particularly pronounced for angry facial expressions. In support, post hoc (Bonferroni corrected P < .016) t tests of the simple main expression at the700 ms duration (F (2,30) = 5.63, P = 0.008, η 2p  = 0.27) showed that responses were slower when participants judged the duration of angry (M = 524) compared to both happy (M = 454) and neutral expressions (M = 479). The simple main effect of expression was also significant when faces were displayed for both 400 ms, F (2,30) = 3.58, P = 0.04, η 2p  = 0.19. For the 400 ms duration, responses were faster when participants judged the duration of angry (M = 424) compared to happy (M = 452) expressions. All other simple main effects did not reach statistical significance.

fMRI Analyses

Whole Brain Analyses

The neural areas across the whole brain that showed significant activation (FWE-corrected statistical threshold of P < 0.05) for the Emotion > Neutral contrast are displayed (with MNI co-ordinates) in Table 1. A one-sample t test of the Emotion > Neutral contrast images showed significant modulation of BOLD activity within bilateral regions of the ventral occipito-temporal cortices including the right cerebellum and left fusiform gyrus.

Table 1 Whole brain activation for the contrast Emotion > Neutral. All activations survive the P < 0.001 threshold uncorrected at the voxel level and P < 0.05 family-wise error (FWE) corrected at the cluster level (x, y and z co-ordinates are reported in MNI space)

Region of Interest Analyses

Neural areas within the ROIs that showed significant activation for the duration contrast [−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)) and also Emotion > Neutral × duration [−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)] interaction contrast are displayed in Figs. 2 and 3, respectively. A one-sample t test for the duration contrast (−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)) revealed increased activation of the bilateral SMA, bilateral pallidum and the right caudate nucleus (see Table 2). A one-sample t test for the Emotion > Neutral × duration [−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)] interaction contrast identified increased activation of the right SMA and the right inferior frontal gyrus/anterior insula (see Table 3).

Fig. 2
figure2

Neural areas within the regions of interest (ROIs) (see text) that showed significant activation for the duration contrast [−1 (400 ms), +4 (700 ms), −1 (1000 ms), −1 (1300 ms), −1 (1600 ms)]. Left sagittal section showing activation of bilateral SMA and right caudate nucleus. Right coronal section showing activation of bilateral SMA, bilateral pallidum and right caudate nucleus. For illustration purposes only, all images are thresholded at P < 0.001 uncorrected with an extent threshold of 10 voxels. Activations are projected onto the MNI single subject T1 image

Fig. 3
figure3

Neural areas within the regions of interest (ROIs) (see text) that showed significant activation for the Emotion > Neutral × duration (−1, +4, −1, −1, −1) contrast showing increased activation in the Right SMA and Right IFG/AI. For illustration purposes only, activation has been thresholded at P < 0.001 uncorrected with an extent threshold of 10 voxels. Activations are projected onto the MNI single subject T1 image

Table 2 Neural areas within the regions of interest (ROIs) that showed significant for the duration contrast [−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)]
Table 3 Neural areas within the time and emotion regions of interest (ROIs) that showed significant activation for the Emotion > Neutral × duration (−1 (400 ms), +4 (700 ms), −1 (1,000 ms), −1 (1,300 ms), −1 (1,600 ms)) contrast

Discussion

Our key finding is that facial emotion modulates activity within two specific neural regions (the right SMA and right inferior frontal gyrus and anterior insula [IFG/AI]) identified in recent meta-analysis (Coull et al. 2011) and review (Wiener et al. 2010) and also, our own research (Tipples et al. 2013) as playing a central role in short interval time perception. More specifically, the main results are as follows. First, following previous research (Droit-Volet et al. 2004) participants responded long more frequently (time was overestimated) when judging the the duration of both angry and happy facial expressions compared to neutral expressions. Second, for the 700 ms stimulus duration compared to all other durations, reaction times were slowest and neural activity was increased in regions of the timing network (bilateral SMA, caudate nucleus, pallidum and the putamen). Third, emotion modulated activity in two regions of the timing network (the right SMA and right IFG/AI) when faces were presented for 700 ms.

Our interpretation of increased activity in the right SMA and IFG/AI at 700 ms specifically, is that emotional arousal modulated activity in the neural regions responsible for temporal decision making. This claim is based on several strands of evidence. First, reaction times were slowest at 700 ms indicating that decision making was most difficult for this duration. Therefore, increased activity at this duration most likely reflects the operation of temporal decision making processes. Second, further evidence that corroborates this conclusion comes from electrophysiological studies of timing that have used the temporal bisection task (Lindbergh and Kieffaber 2013; Ng et al. 2011). The focus of these studies has been a slow-negative of index of timing called the contingent negative variation (CNV)—an ERP component associated with activity in frontal-central areas including the SMA (Nagai et al. 2004). For example, in one study (Ng et al. 2011) the CNV increased in amplitude to the end of the short duration then remained constant until the geometric mean of the short and long durations before decreasing in amplitude. The interpretation of this effect was that CNV amplitude tracks temporal decision making rather than an accumulation of pulses in an accumulator mechanism (for a discussion see; van Rijn et al. 2011). We have shown that the effects of facial emotion on activity in the right SMA and IFG/AI are present at 700 ms duration before the mean duration. Therefore, in keeping with the explanation given for increased CNV amplitude before the mean duration, we attribute this activation to temporal decision making processes. In summary, the effect of facial emotion and on both reaction times and activity in the SMA and IFG/AI is consistent with the idea that (1) facial emotion modulates temporal decision making and (2) the SMA and IFG/AI are most likely responsible for this process.

An alternative explanation for the effect of facial emotion on SMA and IFG activity is that such activity reflects the operation of an accumulator mechanism. Indeed, this is the interpretation we offered in a recent study (Tipples et al. 2013) where we showed that leftward shifts in the BP (indicating overestimation) were correlated with increased activation in the SMA. Put differently, as time estimates lengthened (across individuals) SMA activity increased—a pattern of climbing activation that we attributed to accumulator activity. A problem with this account is that it does not explain why activity followed the non-linear pattern we have reported here (why does activity peak before the mean duration?) nor does it account for the reaction time slowing at 700 ms. Therefore, our tentative conclusion based on our reaction time results and assessment of our fMRI findings in relation to recent EEG findings, is that facial emotion modulates temporal decision making processes carried out in the right SMA and IFG/AI.

The effect of emotion on activity at the junction of the frontal operculum (of the inferior frontal gyrus) with the AI is consistent with the claim (Craig 2009) that this region is responsible for the effect of emotion on time. According to this model, the AI integrates visceral information (including bodily arousal due to emotion-eliciting events) emerging from a progression of activity that begins in posterior insula, to form a representation of the present moment (how a person feels ‘now’—a global emotional moment). Subjective estimates of elapsed time are based on the accumulation of these moments and consequently are affected by emotional arousal and other changes in body state. Our conclusion that the effects of emotion on neural activity for the 700 ms duration reflects temporal decision making is consistent with this idea because temporal decision making depends on a representation of the elapsed time. Nonetheless, emotion also modulated activity in the right SMA at 700 ms and therefore, this region is also a candidate for the representation of elapsed time. Our speculative hypothesis—based on separate evidence for the (pre-)SMA in response processing (e.g., Forstmann et al. 2008; Hartstra et al. 2012)—is that the right IFG/AI represents awareness of elapsed time whereas the SMA is responsible for preparing a response based on this information.

In summary, modulation of a non-linear pattern of activity across time in the SMA and IFG/AI and also reaction time differences indicate that facial emotion moderates temporal decision making and moreover the SMA and IFG/AI are key structures engaged during temporal decision making. A sensible goal for future research will be to establish whether this pattern of activity during timing is found for types of arousal and furthermore, whether such activity can be dissociated from activity due to other processes such as action readiness (Hagura et al. 2012) which might mediate the effects of emotion on time.

References

  1. Angrilli A, Cherubini P, Pavese A, Manfredini S (1997) The influence of affective factors on time perception. Percept Psychophys 59(6):972–982. doi:10.3758/BF03205512

    CAS  PubMed  Article  Google Scholar 

  2. Arstila V (2012) Time slows down during accidents. Front Theor Philos Psychol 3:196. doi:10.3389/fpsyg.2012.00196

    Google Scholar 

  3. Bar-Haim Y, Kerem A, Lamy D, Zakay D (2010) When time slows down: the influence of threat on time perception in anxiety. Cognit Emot 24(2):255–263. doi:10.1080/02699930903387603

    Article  Google Scholar 

  4. Buhusi CV, Meck WH (2002) Differential effects of methamphetamine and haloperidol on the control of an internal clock. Behav Neurosci 116(2):291–297

    CAS  PubMed  Article  Google Scholar 

  5. Calder AJ, Ewbank M, Passamonti L (2011) Personality influences the neural responses to viewing facial expressions of emotion. Philos Trans R Soc B Biol Sci 366(1571):1684–1701. doi:10.1098/rstb.2010.0362

    Article  Google Scholar 

  6. Coull JT, Cheng R-K, Meck WH (2011) Neuroanatomical and neurochemical substrates of timing. Neuropsychopharmacology 36(1):3–25. doi:10.1038/npp.2010.113

    PubMed Central  PubMed  Article  Google Scholar 

  7. Craig AD (2008) Interoception and emotion: a neuroanatomical perspective. In: Lewis M, Haviland-Jones JM, Barrett LF (eds) Handbook of emotions, 3rd edn. Guilford Press, New York, pp 272–292

    Google Scholar 

  8. Craig AD (2009) Emotional moments across time: a possible neural basis for time perception in the anterior insula. Philos Trans R Soc B Biol Sci 364(1525):1933–1942. doi:10.1098/rstb.2009.0008

    Google Scholar 

  9. Dirnberger G, Hesselmann G, Roiser JP, Preminger S, Jahanshahi M, Paz R (2012) Give it time: neural evidence for distorted time perception and enhanced memory encoding in emotional situations. NeuroImage 63(1):591–599. doi:10.1016/j.neuroimage.2012.06.041

    PubMed  Article  Google Scholar 

  10. Droit-Volet S, Brunot S, Niedenthal PM (2004) Perception of the duration of emotional events. Cogn Emot 18(6):849–858. doi:10.1080/02699930341000194

    Article  Google Scholar 

  11. Droit-Volet S, Mermillod M, Cocenas-Silva R, Gil S (2010) The effect of expectancy of a threatening event on time perception in human adults. Emotion 10(6):908–914. doi:10.1037/a0020258

    PubMed  Article  Google Scholar 

  12. Forstmann BU, Dutilh G, Brown S, Neumann J, von Cramon DY, Ridderinkhof KR, Wagenmakers E-J (2008) Striatum and pre-SMA facilitate decision-making under time pressure. Proc Natl Acad Sci USA 105(45):17538–17542. doi:10.1073/pnas.0805903105

    CAS  PubMed Central  PubMed  Article  Google Scholar 

  13. Gescheider GA (1997) Psychophysics: the fundamentals, vol X, 3rd edn. Lawrence Erlbaum Associates Publishers, Mahwah

    Google Scholar 

  14. Gibbon J, Church RM, Meck WH (1984) Scalar timing in memory. Ann NY Acad Sci 423(1):52–77

    CAS  PubMed  Article  Google Scholar 

  15. Grommet EK, Droit-Volet S, Gil S, Hemmes NS, Baker AH, Brown BL (2011) Time estimation of fear cues in human observers. Behav Process 86(1):88–93. doi:10.1016/j.beproc.2010.10.003

    Article  Google Scholar 

  16. Hagura N, Kanai R, Orgs G, Haggard P (2012) Ready steady slow: action preparation slows the subjective passage of time. Proc Biol Sci R Soc 279(1746):4399–4406. doi:10.1098/rspb.2012.1339

    Article  Google Scholar 

  17. Hartstra E, Waszak F, Brass M (2012) The implementation of verbal instructions: dissociating motor preparation from the formation of stimulus–response associations. NeuroImage 63(3):1143–1153. doi:10.1016/j.neuroimage.2012.08.003

    PubMed  Article  Google Scholar 

  18. Ivry RB, Schlerf JE (2008) Dedicated and intrinsic models of time perception. Trend Cogn Sci 12(7):273–280. doi:10.1016/j.tics.2008.04.002

    Article  Google Scholar 

  19. Kopec CD, Brody CD (2010) Human performance on the temporal bisection task. Brain Cogn 74(3):262–272. doi:10.1016/j.bandc.2010.08.006

    PubMed Central  PubMed  Article  Google Scholar 

  20. Lindbergh CA, Kieffaber PD (2013) The neural correlates of temporal judgments in the duration bisection task. Neuropsychologia 51(2):191–196. doi:10.1016/j.neuropsychologia.2012.09.001

    PubMed  Article  Google Scholar 

  21. Livesey AC, Wall MB, Smith AT (2007) Time perception: manipulation of task difficulty dissociates clock functions from other cognitive demands. Neuropsychologia 45(2):321–331. doi:10.1016/j.neuropsychologia.2006.06.033

    PubMed  Article  Google Scholar 

  22. Lui MA, Penney TB, Schirmer A (2011) Emotion effects on timing: attention versus pacemaker accounts. PLoS One 6(7):e21829. doi:10.1371/journal.pone.0021829

    CAS  PubMed Central  PubMed  Article  Google Scholar 

  23. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH (2003) An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. NeuroImage 19(3):1233–1239

    PubMed  Article  Google Scholar 

  24. Nagai Y, Critchley HD, Featherstone E, Fenwick PBC, Trimble MR, Dolan RJ (2004) Brain activity relating to the contingent negative variation: an fMRI investigation. NeuroImage 21(4):1232–1241. doi:10.1016/j.neuroimage.2003.10.036

    CAS  PubMed  Article  Google Scholar 

  25. Ng KK, Tobin S, Penney TB (2011) Temporal accumulation and decision processes in the duration bisection task revealed by contingent negative variation. Front Integr Neurosci 5. doi:10.3389/fnint.2011.00077

  26. Noulhiane M, Mella N, Samson S, Ragot R, Pouthas V (2007) How emotional auditory stimuli modulate time perception. Emotion 7(4):697–704. doi:10.1037/1528-3542.7.4.697

    PubMed  Article  Google Scholar 

  27. Ortega L, López F (2008) Effects of visual flicker on subjective time in a temporal bisection task. Behav Process 78(3):380–386. doi:10.1016/j.beproc.2008.02.004

    Google Scholar 

  28. Schneider W, Eschman A, Zuccolotto A (2002) E-prime (version 1.1). Psychology Software Tools, Pittsburgh

    Google Scholar 

  29. Thayer S, Schiff W (1975) Eye-contact, facial expression and the experience of time. J Soc Psychol 95(1):117–124

    CAS  PubMed  Article  Google Scholar 

  30. Tipples J (2008) Negative emotionality influences the effects of emotion on time perception. Emotion (Washington, DC) 8(1):127–131. doi:10.1037/1528-3542.8.1.127

    Article  Google Scholar 

  31. Tipples J, Brattan V, Johnston P (2013) Neural bases for individual differences in the subjective experience of short durations (less than 2 s). PLoS One 8(1):e54669. doi:10.1371/journal.pone.0054669

    CAS  PubMed Central  PubMed  Article  Google Scholar 

  32. Tottenham N, Tanaka JW, Leon AC, McCarry T, Nurse M, Hare TA, Nelson C (2009) The NimStim set of facial expressions: judgments from untrained research participants. Psychiatry Res 168(3):242–249. doi:10.1016/j.psychres.2008.05.006

    PubMed Central  PubMed  Article  Google Scholar 

  33. Treisman M (1963) Temporal discrimination and the indifference interval: implications for a model of the“internal clock”. Psychol Monogr 77(13):1

    CAS  PubMed  Article  Google Scholar 

  34. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15(1):273–289. doi:10.1006/nimg.2001.0978

    CAS  PubMed  Article  Google Scholar 

  35. Van Rijn H, Kononowicz TW, Meck WH, Ng KK, Penney TB (2011) Contingent negative variation and its relation to time estimation: a theoretical evaluation. Front Integr Neurosci. doi:10.3389/fnint.2011.00091

    Google Scholar 

  36. Van Wassenhove V, Wittmann M, Craig AD, Paulus MP (2011) Psychological and neural mechanisms of subjective time dilation. Front Neurosci 5. doi:10.3389/fnins.2011.00056

  37. Wearden JH (2008) Slowing down an internal clock: implications for accounts of performance on four timing tasks. Q J Exp Psychol 61(2):263–274. doi:10.1080/17470210601154610

    Google Scholar 

  38. Wiener M, Turkeltaub P, Coslett HB (2010) The image of time: a voxel-wise meta-analysis. NeuroImage 49(2):1728–1740. doi:10.1016/j.neuroimage.2009.09.064

    PubMed  Article  Google Scholar 

  39. Wittmann M, Simmons AN, Aron JL, Paulus MP (2010) Accumulation of neural activity in the posterior insula encodes the passage of time. Neuropsychologia 48(10):3110–3120. doi:10.1016/j.neuropsychologia.2010.06.023

    PubMed Central  PubMed  Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Jason Tipples.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Tipples, J., Brattan, V. & Johnston, P. Facial Emotion Modulates the Neural Mechanisms Responsible for Short Interval Time Perception. Brain Topogr 28, 104–112 (2015). https://doi.org/10.1007/s10548-013-0350-6

Download citation

Keywords

  • Time perception
  • Neural clock
  • Emotion