Distracted by danger: Temporal and spatial dynamics of visual selection in the presence of threat
- 768 Downloads
Threatening stimuli are known to influence attentional and visual processes in order to prioritize selection. For example, previous research showed faster detection of threatening relative to nonthreatening stimuli. This has led to the proposal that threatening stimuli are prioritized automatically via a rapid subcortical route. However, in most studies, the threatening stimulus is always to some extent task relevant. Therefore, it is still unclear if threatening stimuli are automatically prioritized by the visual system. We used the additional singleton paradigm with task-irrelevant fear-conditioned distractors (CS+ and CS-) and indexed the time course of eye movement behavior. The results demonstrate automatic prioritization of threat. First, mean latency of saccades directed to the neutral target was increased in the presence of a threatening (CS+) relative to a nonthreatening distractor (CS-), indicating exogenous attentional capture and delayed disengagement of covert attention. Second, more error saccades were directed to the threatening than to the nonthreatening distractor, indicating a modulation of automatically driven saccades. Nevertheless, cumulative distributions of the saccade latencies showed no modulation of threat for the fastest goal-driven saccades, and threat did not affect the latency of the error saccades to the distractors. Together these results suggest that threatening stimuli are automatically prioritized in attentional and visual selection but not via faster processing. Rather, we suggest that prioritization results from an enhanced representation of the threatening stimulus in the oculomotor system, which drives attentional and visual selection. The current findings are interpreted in terms of a neurobiological model of saccade programming.
KeywordsAttention Emotion Eye movement Oculomotor system Fear conditioning
Once you’re bitten by a dog, your perception of dogs may be biased forever: You will probably have the feeling that there are more dogs today than ever before and often you will note a dog before anyone else does. In other words, you prioritize information that is threatening to you. How the visual system prioritizes threatening information is still an ongoing debate. For example, “the direct route” theory suggests that visual threatening information is processed automatically via a specialized subcortical pathway (De Gelder, Van Honk, & Tamietto, 2011; LeDoux, 2000; Liddell et al., 2005; Öhman, Flykt, & Esteves, 2001). This pathway processes visual information directly from the retina to the superior colliculus and via the pulvinar on to the amygdala. According to this theory, threatening information is processed not only automatically but also faster than neutral or nonthreatening information. However, the “multiple waves model” suggested by Pessoa and Adolphs (2010) disputes the existence of a direct subcortical route via the pulvinar to the amygdala for visual processing. Their theory suggests that prioritization is accomplished by modulating interactions between subcortical and cortical connections that, in addition, do not process emotional visual information any faster than other salient visual information. Nevertheless, previous research on emotional covert attention indicates that threatening stimuli are detected faster and therefore possibly processed faster than nonthreatening stimuli (e.g., Hansen & Hansen, 1988; Öhman, Flykt, & Esteves, 2001; Öhman, Lundqvist, & Esteves, 2001). However, in these studies the emotional stimulus is always to some extent task relevant and therefore part of the top-down goal or task set of the participant. Consequently, these studies do not convey information about automatic or bottom-up driven prioritization of emotional stimuli in visual selection (see, for reviews on automatic emotional attention, Carretié, 2014; on bottom-up control, Theeuwes, 2010).
A recent study by Schmidt, Belopolsky, and Theeuwes (2014; see also Notebaert, Crombez, Van Damme, De Houwer, & Theeuwes, 2011) demonstrated emotional modulation of exogenous attention in a visual search task with fear-conditioned but task-irrelevant distractor stimuli. The results showed that a threatening distractor slowed search more than an equally visually salient but nonthreatening distractor. Although these results indicate a bottom-up driven modulation of attentional selection, they do not convey information about how the threatening stimulus is prioritized; for example, whether the threatening distractor captured attention faster or whether the threatening distractor held attention longer relative to the nonthreatening distractor.
The aim of the current study was to examine how threat modulates automatically driven processes in visual selection, such as attentional and oculomotor capture. For this, we modified the additional singleton paradigm (Godijn & Theeuwes, 2002; Theeuwes, Kramer, Hahn, & Irwin, 1998) and indexed the time course of eye-movement behavior. Eye movements are a direct and very sensitive measure of visual selection, as they can occur as early as 150 ms after stimulus onset, while manual responses typically vary between 300 and 2000 ms. Therefore, eye movements can reveal emotional modulation of visual selection not visible in manual behavior, such as manual reaction time or accuracy (e.g., Bannerman, Milders, de Gelder, & Sahraie, 2009; Bannerman, Milders, & Sahraie, 2009, 2010a).
A number of previous studies on emotional modulation of eye-movement behavior found evidence for faster detection of emotional stimuli (e.g., Bannerman, Milders, de Gelder, & Sahraie, 2009; Bannerman, Milders, & Sahraiem, 2009; Kissler & Keil, 2008; LoBue, Matthews, Harvey, & Stark, 2014). For example, Bannerman, Milders, de Gelder, & Sahraie(2009) and Bannerman, Milders, and Sahraie (2009) showed a decrease in saccade latency when a saccade is directed to the location of a threatening stimulus relative to a nonthreatening stimulus. Other studies found evidence for longer fixation durations on emotional relative to neutral stimuli in free-viewing paradigms (e.g., Calvo & Lang, 2004; Humphrey, Underwood, & Lambert, 2012; Lang, Greenwald, Bradley, & Hamm, 1993), suggesting delayed disengagement from an emotional stimulus (Fox, Russo, Bowles, & Dutton, 2001; Fox, Russo, & Dutton, 2002). However, similar to the covert attention studies discussed before, most eye movement studies presented emotional stimuli that were always to some extent task relevant. For example, observers were instructed to saccade toward or away from the emotional stimulus (e.g., Bannerman, Milders, de Gelder, & Sahraie, 2009; Bannerman, Milders, & Sahraie, 2009; Kissler & Keil, 2008; Nummenmaa, Hyönä, & Calvo, 2006) or to assess the valence, category or memory of presented pictures (Calvo & Lang, 2004; Humphrey et al., 2012; Lang et al., 1993; LoBue et al., 2014). Therefore, observers had to process and attend to the emotional stimulus in order to perform the task. In other words, the emotional stimulus was part of their top-down goal or task set. Task set has a major influence on search behavior and reaction times (Yantis, 1993). For example, a study by Hunt, Cooper, Hungr, and Kingstone (2007) demonstrated emotional modulation of eye-movement behavior only when subjects had to search for an emotional target stimulus, indicating that the emotional stimulus has to be part of a top-down goal or task set in order to affect visual selection.
In the current study, we investigated the influence of a task irrelevant threatening distractor on the oculomotor system with the additional singleton paradigm. With this paradigm it is possible to measure covert attention and overt attention processes because the visually salient distractor typically captures attention and sometimes the eyes. Note that the distractor in this paradigm is completely task irrelevant and therefore evokes involuntary or bottom-up driven capture (Theeuwes et al., 1998).
In the task, participants are presented with a search array consisting of several elements displayed on an imaginary circle. Participants are asked to make a speeded saccade to a target stimulus that is less visually salient than the additional singleton, the distractor. The distractor is a sudden onset and presented simultaneously with the target. Typically, saccades directed to the target are slower in the presence of the distractor. This increase in saccade latency is explained by an initial shift of covert attention (attentional capture) to the salient distractor before attention moves on to the less salient target, and, subsequently, a correct saccade can be programmed and executed. Note that this explanation assumes the tight coupling between a shift of covert attention and subsequent oculomotor programming as argued in the premotor theory (Rizzolatti, Riggio, Dascola, & Umilta, 1987; but see Belopolsky & Theeuwes, 2012). In addition, with this paradigm it is typically found that in a subset of the distractor-present trials, initial eye movements are first directed to the distractor instead of to the target. These error saccades, named oculomotor capture, are usually very fast and are assumed to be automatic because they are driven by stimulus properties and not by any top-down goals (Godijn & Theeuwes, 2002; Mulckhuyse et al., 2008).
In addition, we used distributions of saccadic latency to examine influences of threat on both fast and slower saccadic responses because previous research has shown that the latency of a saccade influences saccadic behavior (Godijn & Theeuwes, 2002; McSorley, Haggard, & Walker, 2006). For instance, a task-irrelevant distractor next to the saccadic path induces a deviation of the saccade path toward the distractor when a saccade is initiated shortly after target onset (short latency saccade), whereas the same distractor induces a deviation away from the distractor when a saccade is initiated after around 200 milliseconds or more (long latency saccade) after target onset (McSorley et al., 2006). Moreover it was shown that these saccade deviations (toward and away from a distractor) are both modulated by emotion (Mulckhuyse, Crombez, & Van der Stigchel, 2013; Schmidt, Belopolsky, & Theeuwes, 2012). Furthermore, previous research has also shown that saccade latency affects end point. Short latency saccades are more often driven by salient visual stimuli (oculomotor capture) than are long latency saccades (e.g., Godijn & Theeuwes, 2002; Mulckhuyse, Van Zoest, & Theeuwes, 2008). In general, it is assumed that stimulus-driven information, such as the visual saliency of a stimulus, affects short latency saccades, which, for example, can result in more oculomotor capture for short latency saccades relative to long latency saccades (Mulckhuyse et al., 2008). We were interested whether threat would affect saccadic behavior of short as well as long latency saccades.
Furthermore, we used a differential fear-conditioning procedure (Mackintosh, 1983) to present a threatening (CS+) and nonthreatening (CS-) distractor stimulus. Fear-conditioning has proven to be an extremely robust and precise experimental approach for studying fear in animals as well as in humans (e.g., Brown, Kalish, & Farber, 1951; Delgado, Olsson, & Phelps, 2006; LeDoux, 2003; Maren, 2001;
Pineles, Orr, & Orr, 2009; Sehlmeyer et al., 2009). In differential fear-conditioning, one biologically neutral stimulus (CS) is associated with a noxious or aversive unconditioned stimulus (US) by presenting it in close temporal proximity (LeDoux, 2014). Subsequently, the CS+ predicts the possible aversive event and hence becomes a threatening stimulus. The CS- (another biologically neutral stimulus) is not associated with the US and therefore becomes a nonthreatening stimulus (Lissek et al., 2008).
A fear-conditioned stimulus differs in several respects from a threatening picture. First, the CS+ serves as a cue for a possible aversive event to the participant, whereas a threatening picture of a snake, for example, is a symbolic representation of that threat. Second, the visual features between the CS+ and CS- distractor are more easily controlled for (colors are counterbalanced between subjects), whereas visual features between threatening and nonthreatening pictures are sometimes more difficult to control for (e.g., Calvo & Nummenmaa, 2008; Hunt et al., 2007; Tipples, Young, Quinlan, Broks, & Ellis, 2002).
We expected to find more oculomotor capture by the threatening distractor (CS+) than the nonthreatening distractor (CS-), and we expected to find a decrease in latency of saccades directed to the threatening distractor compared to the nonthreatening distractor. In addition, we expected to find an increase in latency of correct saccades in the presence of the threatening distractor relative to the nonthreatening distractor for fast as well as slow saccades.
Sixteen undergraduate students (11 female, ages between 19 and 33) participated to fulfill course requirements or they were paid 10 euro. All participants provided informed consent before participation and were free to terminate the experiment at any time. Participants had normal or corrected-to-normal vision. The medical ethical committee of the University Medical Center Utrecht approved the study.
Apparatus and design
Figure 1 shows the sequence of a trial in all conditions. Each trial began with a white plus sign. The gray circles with the black crosses were presented for at least 1,000 ms with an additional random jitter between 0 ms and 300 ms. In five of the six circles, the black cross disappeared. The cross that stayed on the screen indicated the target location. Simultaneously with the offsets of the black crosses, the fixation point disappeared, and in the distractor conditions, the additional filled circle was presented. The target appeared equally often at each of the four possible target locations: 1, 5, 7, or 11 o’clock. The distractor could appear at 2, 4, 8, or 10 o’clock, but always with an angular separation of 90° or 150° between distractor and target.
Before the experiment, a differential fear conditioning procedure was started in which participants viewed the distractors one by one while one of the colors (Conditioned Stimulus: CS+) was paired with an aversive noise (Unconditioned Stimulus: US) whereas the other color (CS-) was not (Mackintosh, 1983). Eight participants were presented with a red CS+ and a green CS- and eight participants vice versa. Due to this method, a comparison between the two conditions was not confounded by potential differences in visual features between stimuli (e.g., Calvo & Nummenmaa, 2008; Hunt et al., 2007). The US consisted of a 200 ms 100 dB white noise that ended with the offset of the CS+. If participants were able to correctly identify the color that predicted the noise, the experiment started. In the experiment, participants were required to make a speeded saccade to the target while ignoring the presence of a distractor. Each participant performed nine blocks of each 48 trials. In one block the distractor was absent; in the other eight blocks distractor presence was mixed (CS+ and CS- distractor). The order of blocks was randomly generated. In addition, between 5 % and 10 % reinforcement trials (in which the CS+ was presented together with the US) were added to each block to avoid habituation and extinction of fear (for a review, see Hofmann, 2008). The reinforcement trials were randomly mixed with the experimental trials and not further analyzed.
Participants rated their anxiety level three times on a visual analogue scale (VAS): before the experiment started, during the experiment (after four blocks), and when the experiment ended. Subsequently, ratings of fear of the CS+ and CS- and ratings of the intensity, unpleasantness, and expectancy of the US were obtained using Likert scales (1 = not at all to 9 = extremely).
Mean rating on the VAS (on a scale from 0 to 100) before the experiment started was 14.2 (SD = 19.0), during the experiment 36.3 (SD = 35.5), and when the experiment ended 26.6 (SD = 27.7). A repeated measures ANOVA on VAS rating showed a main effect, F(2, 30) = 9.75, p < .05, ηp 2 = 0.39, due to enhanced anxiety during the experiment relative to before (p < .01, d = 1.08) and relative to after the experiment (p < .05, d = 0.6 ).
All participants successfully learned the CS–US contingencies at the end of the acquisition phase. Mean ratings of intensity, unpleasantness, and fear of the US were 6.7 (SD = 1.7), 6.8 (SD = 2.3), and 5.1 (SD = 3.0), respectively. As the ratings were not normally distributed, nonparametric tests were employed. Participants rated fear of the CS+ (M = 4.2, SD = 2.9) higher than of the CS- (M = 1.6, SD = 1.0; Wilcoxon signed-rank test, Z = 2.94, N-ties = 5, p < .01). Furthermore, US expectancy ratings for the CS+ (M = 4.4, SD = 2.1) were higher than for the CS- (M = 1.9, SD = 1.8; Wilcoxon signed-rank test, Z = 2.6, N-ties = 1, p < .01). US expectancy rating has demonstrated to be a valuable measurement method in fear conditioning (Boddez et al., 2013). Therefore, these results suggest that our fear conditioning procedure was successful.
Eye movement behavior
The initial saccade was assigned to a target or a distractor if the start point of the saccade was within 3° of the fixation point and when the endpoint was within 3° of the center of the target or distractor position (maximum angular separation of 17.5° from the center of the target or distractor). This cutoff corresponds to roughly half the distance between target/distractor and the nearest placeholder. If the endpoint was beyond the assigned area of the target and distractor, it was assigned to one of the other placeholders in the display and defined as “elsewhere than the target or the distractor.” Trials for which initial saccade latencies were below 80 ms, above 600 ms, or for which no saccade was detected were excluded from analysis (5.5 % of all trials).
Saccades to the target
An ANOVA on mean latency for saccades correctly directed to the target showed that there was a significant main effect of distractor, F(2, 30) = 4.15, p < .05, ηp 2 = 2.2. Planned comparisons showed that the mean saccade latency in the CS+ distractor condition (271 ms, SE = 10 ms) was significantly longer than the mean saccade latency in the CS- distractor condition (263 ms, SE = 9 ms) t(15) = 2.17, p < .05, d = 0.54, and significantly longer than the mean saccade latency in the distractor absent condition (257 ms, SE = 10 ms) t(15) = 2.51, p < .05, d = 0.56. These results indicate that the CS+ distractor captured and held covert attention before a saccade was executed to the target. Furthermore, the mean saccade latency in the CS- distractor condition did not differ from the distractor absent condition (p = .26).
Time course of saccades to the target
An ANOVA on mean saccade latency with bin (1, 2, 3, and 4) and distractor (CS+, CS-, and absent) as factors revealed a main effect of bin, F(3, 45) = 188.02, p < .01, η2 = 0.93, with Greenhouse–Geisser correction, a main effect of distractor, F(2, 30) = 4.26, p < .05, ηp 2 = 0.22, and an interaction between bin and distractor, F(6, 90) = 3.15, p < .05, ηp 2 = 0.17, with Greenhouse–Geisser correction. Planned comparisons showed that saccade latency of correct saccades in the presence of a CS+ distractor was increased relative to no distractor in the second, the third, and the fourth bin (all ps < .05, one-tailed). Furthermore, saccade latency of correct saccades in the presence of a CS+ distractor was increased relative to a CS- distractor in the second, the third, and the fourth bin (all ps ≦ .05, one-tailed). The increase in saccade latency suggests attentional capture by the distractor. There was no significant difference in the first bin between the three conditions (p > .18), indicating that in these trials, covert attention was not first shifted to the distractor stimulus.
Error saccades to the distractor
In the CS- distractor condition, 12.5 % (SE = 2.9) of all initial saccades went to the distractor, and in the CS+ distractor condition, 20.6 % (SE = 3.74; see Fig. 2). A Wilcoxon signed-rank test showed a significant effect between the two conditions (Z = 3.26, N-ties = 0, p < .01, r = 0.81), indicating that the CS+ distracter captured the eyes more often than the CS- distractor.
Because some of the participants (n = 7) had very few observations (n < 15) of initial saccades directed to the distractor in one or both of the distractor conditions, they were excluded from the following parametric analysis. Of the remaining nine participants, a paired sample t test between the mean latency of error saccades directed to the CS+ distractor (193 ms, SE = 5 ms) and the CS- distractor (195 ms, SE = 5 ms) showed no significant differences (t < 1).
Time course of error saccades to the distractor
Mean saccade latency (and standard errors) for each distractor condition (CS+ and CS-) and for each bin (1, 2, and 3)
170 ms (2 ms)
173 ms (3 ms)
189 ms (5 ms)
188 ms (5 ms)
226 ms (9 ms)
218 ms (7 ms)
Error saccades directed elsewhere than the distractor
The following analyses were performed to control for any nonspecific effects induced by the threatening distracter. For example, an alternative explanation for our finding that there were more error saccades directed to the CS+ relative to the CS- distractor could be that these saccades are not driven by the threatening information at that specific location but rather are driven by a general enhanced state of anxiety. If the latter instance would be the case, we would also expect to find more error trials directed elsewhere than to the distractor when the CS+ distractor was presented relative to when the CS- distractor was presented. As can be seen in Fig. 2, this is not what the results show. In contrast, the results show that participants made more error saccades directed elsewhere when a CS- distractor was presented (34.5 %, SE = 3) than when a CS+ distractor was presented (31.6 %, SE = 3; Z = 2.27, N-ties = 1, p < .05, r = 0.93). This finding indicates that the higher percentage of error saccades directed to the CS+ distractor was caused by the information at that location and was not the result of a nonspecific effect induced by the threatening distractor.
Furthermore, to determine that the latency of the error saccades directed to the distractors were indeed affected by the information at that location and not by a “general state” induced by the distracters (either CS- or CS+), we performed related samples t tests on saccade latency between error saccades directed to the distractor and error saccades directed elsewhere. We performed this test for each distractor condition separately and for the same nine subjects that were included in the analyses described above (on latency error saccades to distractor). Both t tests showed that the mean latency of error saccades directed to the distractor was shorter than of error saccades directed elsewhere. When the CS- distractor was presented, mean latency of error saccades to the CS- distractor (195 ms, SE = 5 ms) was shorter than error saccades directed elsewhere (237 ms, SE = 7 ms), t(8) = 7.54, p < .01, d = 2.7, and when the CS+ distractor was presented mean latency of error saccades directed to the CS+ distractor (193 ms, SE = 5 ms) was shorter than error saccades directed elsewhere (239 ms, SE = 5 ms), t(8) = 6.2, p < .01, d = 2.5. The shorter latency of error saccades directed to the distractors relative to error saccades directed elsewhere indicates that the oculomotor capture saccades were indeed driven by the information at that location and were not driven by a nonspecific enhanced state anxiety induced by the distractors.
Results from the current study show that a threatening stimulus modulates attentional and visual selection in a bottom-up driven manner, indicating automatic prioritization of threatening stimuli in the visual system. Mean latency of saccades directed to a neutral target in the presence of a threatening distractor was increased relative to the nonthreatening distractor and to no distractor conditions, indicating exogenous attentional capture and delayed disengagement from the threatening distractor. Moreover, the threatening distractor captured the eyes more often than the nonthreatening distractor, indicating automatic modulation of oculomotor capture.
Attentional capture and disengagement
An increase in saccade latency to a target in the presence of a distractor is previously explained in the context of the premotor theory of attention (Rizzolatti et al., 1987). The premotor theory of attention argues that spatial attention and saccade programming are highly intertwined and suggests that a shift of spatial attention to a location automatically activates the oculomotor system to program a saccade to that location (but see Belopolsky & Theeuwes, 2012). Therefore, in the current study, the increase in saccade latency in the presence of a threatening distractor could have resulted from the extra time it took to reprogram a saccade from the distractor to the target (Godijn & Theeuwes, 2002). In this scenario, covert attention is first captured by the salient threatening distractor before attention is shifted to the target (as in Schmidt et al., 2014). This account is consistent with results from previous cueing studies. In these studies, an eye movement had to be made to one of two target locations that were previously cued with threatening or nonthreatening stimuli (Bannerman et al., 2010a, 2010b; Schmidt, Belopolsky, & Theeuwes, 2015). Both studies showed the tight coupling between a shift of spatial attention to a threatening stimulus and the direct influence on the oculomotor system. For example, Bannerman et al. (2010a, 2010b) showed that a briefly presented threatening peripheral cue decreased saccade latency relative to a nonthreatening cue when an eye movement had to be executed to a target presented at the same location (valid cue) and increased saccade latency when the target was presented at the opposite location (invalid cue). Likewise, Schmidt et al. (2015) showed that a peripherally presented threatening stimulus interfered with subsequent endogenously driven saccades; a decrease in saccade latency when a saccade had to be executed to the location previously cued with a threatening stimulus relative to a nonthreatening stimulus, and an increase in saccade latency when a saccade had to be executed away from that location.
Furthermore, simple prosaccade tasks demonstrated the influence of covert emotional attention on the oculomotor system by measuring the trajectory of a saccade. In a prosaccade task, participants are asked to make a saccade to a neutral target stimulus while simultaneously a sudden onset distractor is presented next to the saccadic path. Typically, fast saccades curve toward a distractor and slower saccades curve away from a distractor (Van der Stigchel, Meeter, & Theeuwes, 2006). Previous studies found that the deviations of the saccade trajectory—towards as well as away from the distractor—are increased in the presence of a threatening distractor relative to a nonthreatening distractor (e.g., McSorley & Van Reekum, 2013; Mulckhuyse et al., 2013; Nummenmaa, Hyönä, & Calvo, 2009; Schmidt et al., 2012; but see West, Al-Aidroos, Susskind, & Pratt, 2011). These modulations of saccade deviation indicate that the threatening distractor captured and held attention and thereby affected the trajectory of a saccade (Van der Stigchel et al., 2006).
The eye movement studies described above do not only evidence the strong link between spatial attention and saccade programming, they also demonstrate that threatening stimuli capture and hold attention, which is consistent with our findings. However, the cumulative distributions also showed that the fastest goal-driven saccades were not modulated by threat. In other words, the threatening distractor presumably did not capture attention in these trials. This implies that a threatening distractor may not always be automatically prioritized by the visual system and can be ignored, possibly by exerting goal-driven control (Leber, 2010).
The oculomotor capture trials indicate that in some trials the onset distractor captured not only covert attention but also the eyes. These error saccades are typically very fast eye movements and explained by faster bottom-up activation of the distractor location relative to slower top-down activation of the target location in a common saccade map (Godijn & Theeuwes, 2002). The common saccade map is sometimes referred to as a priority map (Fecteau & Munoz, 2006) that integrates stimulus-related with task-related or behavioral-relevant information. Our results show that more error saccades were directed toward the threatening distractor than to the nonthreatening distractor, indicating that threat modulates this automatically driven process. However, there was no latency difference between error saccades directed to the threatening and the nonthreatening distractors. This may suggest that threatening information did not reach the saccade map earlier than the nonthreatening information. In other words, this may suggest that threat is not processed faster. Instead, it may indicate that the distractor-related activity in the saccade map was strengthened by the threatening information, and therefore the threshold to make a saccade to that location was more often reached, resulting in more but not per se faster oculomotor capture.
Oculomotor capture has not been investigated before with task-irrelevant emotional distractor stimuli, although Mulckhuyse et al. (2013) found some evidence of oculomotor capture by task-irrelevant emotional distractors in a prosaccade task. However, that study did not measure latency of the error saccades. Other studies, using free viewing paradigms or forced choice tasks, measured proportion of first fixation as an index of oculomotor capture (e.g., Calvo & Lang, 2004; Calvo, Avero, & Lundqvist, 2006; Humphrey et al., 2012; Nummenmaa et al., 2006). Only a few studies reported faster saccades to threatening than to nonthreatening stimuli (Bannerman, Milders, de Gelder, & Sahraie, 2009; Bannerman, Milders, & Sahraie, 2009; LoBue et al., 2014; Reynolds, Eastwood, Partanen, Frischen, & Smilek, 2009; but see Calvo et al., 2006; Derakshan & Koster, 2010; Mogg, Millar, & Bradley, 2000), suggesting faster processing of threatening stimuli. However, in these studies the threatening stimulus was always task relevant. For example, in LoBue et al. (2014), participants had to judge whether a matrix of pictures were of the same category or if one of the pictures was of another category (as in Öhman, Flykt, & Esteves, 2001). Therefore, participants had to attend to the pictures in order to perform the task. Possibly, threat affects saccade latency only when the threatening stimulus is to some extent task relevant and thus part of the top-down goal or task set (as in Bannerman, Milders, de Gelder, & Sahraie, 2009; Bannerman, Milders, & Sahraie, 2009; Kissler & Keil, 2008; LoBue et al., 2014; Nummenmaa et al., 2006). Our results show that when a threatening stimulus captures the eyes in a bottom-up driven manner, saccade latency is unaffected. Further research is needed to disentangle the influence of threat on these top-down and bottom-up driven processes in visual selection.
Underlying neural mechanisms
What may be the underlying neural mechanisms of the influence of threat on the oculomotor system? The most important areas and structures involved in oculomotor behavior are the brainstem, the superior colliculus (SC), the pulvinar, and the parietal and frontal eye fields (PEF and FEF; e.g., Munoz, 2002; Schall, 1995; Shipp, 2004).The SC, a midbrain structure, is viewed as the neural locus of the common saccade map where bottom-up and top-down information converge (Godijn & Theeuwes, 2002; Trappenberg, Dorris, Munoz, & Klein, 2001). The SC receives visual information directly from the retina and indirectly from visual cortex and integrates incoming visual information with motor output (Robinson & McClurkin, 1989). In addition, the SC is also part of the so-called specialized subcortical pathway, as suggested by the direct route theory (e.g., De Gelder et al., 2011; LeDoux, 2000, 2003; Öhman, Flykt, & Esteves, 2001). It is supposed to transfer threatening visual information via the pulvinar to the amygdala, a structure involved in processing of emotional stimuli and in the expression of conditioned fear (Davidson & Irwin, 1999; Davis, 1992a, 1992b; Davis & Whalen, 2001; Vuilleumier, 2005). Moreover, the subcortical pathway is also believed to be involved in fear conditioning (Hamm et al., 2003; LeDoux, 2000). If prioritization of threatening visual information is accomplished via a direct route to the amygdala (LeDoux, 2000, 2003; Vuilleumier, 2005), reciprocal connections between the SC, pulvinar, and amygdala (Linke, De Lima, Schwegler, & Pape, 1999; Morris, Ohman, & Dolan, 1999; Tamietto & De Gelder, 2010) may have enhanced the representation of the threatening distractor location in SC, resulting in more attentional and oculomotor capture (Godijn & Theeuwes, 2002). However, the direct route theory also suggests that threatening stimuli are processed faster than nonthreatening stimuli. Consequently, this would result in faster eye movements to threatening than nonthreatening stimuli (but see West et al., 2011). Nonetheless, in our study, latencies of error saccades to the distractors were not affected by threat, indicating that the threatening distractor was not processed faster than the nonthreatening distractor.
The multiple-waves model suggests that prioritization of emotional visual information is accomplished not via one direct route but via modulating interactions between subcortical and cortical connections (Pessoa & Adolphs, 2010). In this model, the pulvinar plays a more substantial role in signifying emotional saliency than the amygdala. The pulvinar is associated with saccadic behavior (Robinson & McClurkin, 1989) and with processing of behavioral-salient relevant visual stimuli (Pessoa & Adolphs, 2010; Robinson & Petersen, 1992; Shipp, 2004). It has connections with parietal and frontal areas, which are involved in salience detection and activation of possible target locations (McPeek, 2006; Walker, Techawachirakul, & Haggard, 2009), in spatial attention (Shipp, 2004), and oculomotor behavior (Munoz, 2002). Together with the SC and the pulvinar, the FEF and PEF (the latter is also referred to as lateral intraparietal area; LIP) are thought to be involved in the construction of a so-called saliency map (Munoz, 2002; Thompson & Bichot, 2005) or priority map (Fecteau & Munoz, 2006). Modulating interactions from the pulvinar might have enhanced or strengthened the representation of the threatening distractor location in this priority map. As a result of the enhanced representation in the oculomotor system, the threatening distractor was selected more often than the nonthreatening distractor. In sum, our findings suggest that threatening stimuli are automatically prioritized in visual selection, albeit not, per se, faster processed.
This research was funded by a VENI grant from NWO (Netherlands Organization for Scientific Research) to M. M. E. S. D. was supported through a European Commission Marie Curie ITN grant (606901).
- Bannerman, R. L., Milders, M., de Gelder, B., & Sahraie, A. (2009). Orienting to threat: Faster localization of fearful facial expressions and body postures revealed by saccadic eye movements. Proceedings of the Royal Society B: Biological Sciences, 276, 1635–1641.CrossRefPubMedPubMedCentralGoogle Scholar
- Davis, M. (1992a). The role of the amygdala in conditioned fear. In J. P. Aggleton (Ed.), The amygdala (pp. 255–306). Wilmington, DE: Wiley-Liss.Google Scholar
- De Gelder, B., Van Honk, J., & Tamietto, M. (2011). Emotion in the brain: Of low roads, high roads and roads less travelled. Nature Reviews. Neuroscience, 11, 773–783.Google Scholar
- Humphrey, K., Underwood, G., & Lambert, T. (2012). Salience of the lambs: A test of the saliency map hypothesis with pictures of emotive objects. Journal of Vision, 12(1). doi: 10.1167/12.1.22
- Liddell, B. J, Brown, K. J., Kemp, A. H, Barton, M. J., Das, P., Peduto, A., . . . Williams, L. M. (2005). A direct brainstem–amygdala–cortical “alarm” system for subliminal signals of fear. NeuroImage, 24, 235–243.Google Scholar
- Linke, R., De Lima, A. D., Schwegler, H., & Pape, H. C. (1999). Direct synaptic connections of axons from the superior colliculus with identified thalamo-amygdaloid projection neurons in the rat: Possible substrates of a subcortical visual pathway to the amygdala. Journal of Comparative Neurology, 403, 158–170.CrossRefPubMedGoogle Scholar
- Lissek, S., Biggs, A. L., Rabin, S. J., Cornwell, B. R., Alvarez, R. P., Pine, D. S., & Grillon, C. (2008). Generalization of conditioned fear-potentiated startle in humans: Experimental validation and clinical relevance. Behaviour Research and Therapy, 46(5), 678–687.CrossRefPubMedPubMedCentralGoogle Scholar
- Mackintosh, N. J. (1983). Conditioning and associative learning. Oxford, England: Oxford University Press.Google Scholar
- Robinson, D. L., & McClurkin, J. W. (1989). The visual superior colliculus and pulvinar. In R. H. Wurtz & M. E. Goldberg (Eds.), The neurobiology of saccadic eye movements (pp. 337–360). Amsterdam, The Netherlands: Elsevier.Google Scholar
- Tamietto, M., & De Gelder, B. (2010). Neural basis of non-conscious perception of emotional signals. Nature Reviews Neuroscience, 11, 687–709.Google Scholar