Experience-guided attention: Uniform and implicit
- 342 Downloads
Frequently finding a visual search target in one region of space induces a spatial attentional bias toward that region. Past studies on this effect typically tested fewer than 20 participants. The small sample prevents an investigation of two properties of learning: visual field uniformity and role of explicit awareness. Pooling data from multiple studies, here we examined location probability learning from ~120,000 visual search trials across 420 participants. Participants performed a serial search task. Unbeknownst to them, the target was disproportionately likely to appear in one visual quadrant. Location probability learning (LPL) was measured as the difference in reaction time to targets in the high-probability “rich” quadrant and the low-probability “sparse” quadrants. Results showed a lack of visual field effect. LPL was equivalent for “rich” quadrant in the upper left, upper right, lower left, and lower right. Learning did not induce a hotspot diagonal to the “rich” quadrant. To the contrary, RT was the longest in the diagonal quadrant. Recognition rate of the “rich” quadrant was above chance. However, recognition accuracy was unrelated to the size of LPL. Implicit learning induces visual-field-independent changes in spatial attention.
KeywordsSpatial attention Location probability learning Implicit learning Visual field effects
In daily tasks, such as driving, people prioritize important visual locations. Consistent spatial distribution of important stimuli allows for learning of the probable locations of those stimuli. When the target appears in one visuospatial region disproportionately often, search reaction time (RT) is faster in that high-probability region than elsewhere (Jiang, 2018; Miller, 1988). Location probability learning (LPL) often reduces RT by 10–20%. It alleviates hemifield neglect and aids search in people with an Autism Spectrum Disorder or Parkinson’s Disease (Geng & Behrmann, 2002; Jiang, Capistrano, Esler, & Swallow, 2013; Sisk, Twedell, Koutstaal, Cooper, & Jiang, 2018). Because the target frequently appears in one region of space across all trials, LPL induces a general spatial preference. This differs from contextual cueing (Chun & Jiang, 1998), in which distinct spatial contexts are associated with different target locations.
Owing to its large effect size, studies of LPL have typically employed fewer than 20 participants. This sample size is inadequate for answering two questions: Is LPL uniform across the visual field? Is learning implicit? Addressing these questions entails comparison across participants and necessitates a large sample. We combined data across ~400 participants to examine the interaction of LPL with visual fields and its implicit/explicit nature.
Several types of visual field effects manifest in spatial attention. First, anisotropy across the visual field occurs in phenomena such as crowding, in which surrounding distractors reduce discriminability of a target. Crowding is more severe in the upper than the lower visual field (He, Cavanagh, & Intriligator, 1996), and the spatial resolution of attention is superior in the lower visual field (Intriligator & Cavanagh, 2001). Reading habits may also foster anisotropy (Rinaldi, Di Luca, Henik, & Girelli, 2014), resulting in an upper-left bias – a recent conference report uncovered higher change-detection accuracy in the upper-left than in other quadrants (Quirk, Adam, & Vogel, 2018). Second, attention behaves differently across bilateral compared to unilateral locations. In multiple object tracking, it is easier to track targets distributed across, rather than within, a hemifield, displaying a bilateral advantage (Alvarez & Cavanagh, 2005). Unilateral advantages manifest as easier detection of repeated stimuli when repetitions occur within, rather than across, hemifields (Butcher & Cavanagh, 2008). Third, the spread of attention is non-linear. Sometimes, locations near the target are enhanced, while farther locations are suppressed (Müller & Kleinschmidt, 2004). Other times, peripheral cues enhance processing of a spot in the quadrant diagonal to the target’s location (Tse, Sheinberg, & Logothetis, 2003).
The studies reviewed above tap into goal-driven or exogenous attention. We aim to determine whether implicitly-learned attention also exhibits visual field non-uniformity. As noted, LPL occurs rapidly, induces a large RT gain, and is unimpaired by working memory load. Its preservation in neglect patients suggests independence from the frontoparietal network. One theory of LPL characterizes it as a search habit (Jiang, 2018) – a habit of shifting attention in the direction of the high-probability locations. The habit, instantiated either overtly (by shaping saccadic directions) or covertly (by reinforcing a direction of attentional movement), is more akin to action than perception. As such, LPL may not exhibit visual field effects arising from inhomogeneity of receptive field properties of visual neurons. Alternatively, because LPL involves learning of statistical regularities, it may be sensitive to pre-existing spatial biases, such as reading direction.
We also aim to evaluate the role of explicit awareness in LPL. Although previous studies have demonstrated implicit guidance of attention, researchers have challenged the strength (Kunar, Flusberg, Horowitz, & Wolfe, 2007) and implicit nature (Colagiuri & Livesey, 2016; Smyth & Shanks, 2008; Vadillo, Konstantinidis, & Shanks, 2016) of that guidance. Participants classified as “aware” or “unaware” in individual experiments often number fewer than 10. Because many participants have been trained under similar conditions in our lab, we were able to analyze data from several hundred participants. This provides a powerful test of the role of explicit awareness in LPL.
We examined data obtained over the last 7 years. We tried to maximize sample size while preserving study consistency. Included studies exhibited the following characteristics.
In all but one study, participants searched for a letter T among letter Ls. In the remaining study, they searched for the number 2 among 5s. The 2-among-5 task yielded similar RT and search slope as the T-among-L task (Jiang, Swallow, Won, Cistera, & Rosenbaum, 2015).
Set size was 12 in most experiments. Some studies had an equal distribution of set sizes 8, 12, and 16. These studies were included because 12 was the average set size and LPL at set size 12 was similar to the average of LPL at set sizes 8 and 16.
The studies varied in training length. Only the first 288 trials were analyzed – the shortest existing study length.
Other inclusion criteria
In all studies, (1) training was conducted under incidental learning conditions; (2) participants were healthy young adults; (3) viewpoint did not vary; (4) participants had unlimited search time; (5) the target was present on all trials; and (6) participants were tested without a working memory load. Most studies were previously published (Jiang, Koutstaal, & Twedell, 2016; Jiang, Swallow, & Sun, 2014; Jiang & Swallow, 2013b, 2013a; Jiang, Swallow, & Rosenbaum, 2013; Jiang, Swallow, Rosenbaum, & Herzig, 2013; Jiang, Swallow, et al., 2015; Twedell, Koutstaal, & Jiang, 2016).
Data from 420 participants were included (273 females). Participants were college students (18–35 years; mean age 20.2 years) naïve to the purpose of the experiments. All had normal color vision and normal or corrected-to-normal visual acuity.
On each trial, participants first maintained central fixation. The search array appeared and remained until participants responded. Participants had to find the target and press a button to report its orientation or color. A tone provided accuracy feedback.
Upon task completion, participants were asked whether they thought the target appeared in some locations disproportionately often. Next, participants were informed that the target more often appeared in one quadrant and were asked to choose that quadrant. This procedure was administered to 336 participants. The remaining participants were excluded because in their study, recognition test was absent, it was performed using a different procedure, or it was conducted after a 1-week delay.
To adjust for RT differences across experiments, each participant’s average RT within a block was z-score transformed relative to that participant’s grand mean and standard deviation (Faust, Balota, Spieler, & Ferraro, 1999). Given the large sample, spurious significant effects could occur. We therefore reported effect size. In ANOVA, Cohen’s f2 of 0.02, 0.15, and 0.35 correspond to small, medium, and large effects. In t-tests, Cohen’s d of 0.2, 0.5, and 0.8 correspond to small, medium, and large effects.
Visual field relationship and spread of attention
If the two hemispheres have separate attentional resources (Cavanagh & Alvarez, 2005), there may be greater spread of attention from the “rich” quadrant to a sparse quadrant in the same, rather than a different, hemifield. However, we found that there was no difference in performance between the two sparse quadrants that flank the rich quadrant, one in the same and one in the opposite hemifield. An ANOVA on hemifield (sparse-same-HF vs. sparse-diff-HF) and block showed no effect of hemifield, F < 1, Cohen’s f2 = 0.002. Furthermore, LPL did not induce a hotspot in the diagonal quadrant. A comparison between the sparse-diagonal and the two sparse-adjacent quadrants showed significantly slower RT in the sparse-diagonal than in the adjacent quadrants, F(1, 419) = 133.68, p < .001, Cohen’s f2 = 0.32 for diagonal versus same-HF, F(1, 419) = 146.35, p < .001, Cohen’s f2 = 0.25 for diagonal versus diff-HF. Rather, the RT slowing in the sparse-diagonal quadrant (diagonal minus “rich” RT: 25.1% RT difference, z-score difference = 0.99) was about 1.4 times that calculated from adjacent quadrants (adjacent minus “rich” RT: 17.8% RT difference, z-score difference = 0.69). This is a remarkable coincidence considering that locations in the diagonal quadrant are about 1.4 times farther than locations in the adjacent quadrants.
The 336 participants fell into four groups depending on response accuracy on the recognition questions. At one extreme, 117 (34.8%) participants failed both questions (“unaware” group). They reported even target distribution and selected a low-probability quadrant as “rich.” At the other extreme, 70 (20.8%) participants passed both questions (“aware” group). They reported biased target distribution and correctly identified the “rich” quadrant. The remaining participants failed one recognition question: 72 (21.4%) reported even target distribution but correctly guessed the “rich” quadrant (“partially aware 1”); 77 (22.9%) reported biased target distribution but chose the wrong quadrant (“partially aware 2”).
Recognition rate for question 2 (42.2%) was higher than expected by chance, χ2(1) = 53.40, p < .001. But does this mean that explicit knowledge guided search? If so, LPL should be larger in those with higher awareness.
Consider the two extreme groups: LPL led to an RT saving of 19.2% (z-score gain of 0.85) in “unaware” participants, which was comparable to the RT saving of 20.5% (z-score gain of 0.88) in “aware” participants, t(185) = 0.42, p = .673, Cohen’s d = 0.06.
Because awareness may emerge gradually, we also analyzed data from the last four blocks, when the level of awareness further diverged between aware and unaware participants. Still, awareness did not affect LPL. RT saving was comparable between the aware group (25.3%) and the unaware group (24.3%), p = .714.
This study reports location probability learning across several hundred participants. Results demonstrate uniformity of LPL across the visual field. Although participants may habitually scan the display from left to right and top to bottom, this did not affect LPL. RT was not faster and LPL was not different in the upper-left quadrant, compared to the other quadrants. This contrasts a recent report of upper-left biases in change detection (Quirk et al., 2018). Task differences likely explain this disparity. Change detection tasks present the encoding display briefly, encouraging global processing. Reduced serial scanning opportunity may limit search habit formation. Location probability manipulations in change detection may instead impact strategies for memory-based comparison between the encoded display and the test display. Pre-existing biases, such as upper-left biases, may influence this comparison. This is speculative, but regardless, the spatial uniformity of LPL in visual search suggests that it is unconstrained by reading habits or neuronal receptive field properties.
Additionally, spatial attention spread evenly from the trained quadrant to unilateral and bilateral locations. LPL also did not induce an attentional hotspot in the diagonal quadrant – such hotspots were observed in peripheral cueing studies and variably attributed to inhibition of return for the cued location or attentional momentum from shifting attention from the cued location to the center (Tse et al., 2003). In our study, the diagonal quadrant had the slowest RT. Thus, in LPL, attention spreads gradually from trained to neighboring locations.
Analysis of several hundred participants shows that LPL often results in explicit knowledge of target’s location probability. The percentage of participants correctly identifying the high-probability quadrant exceeded chance. Nonetheless, participants did not intentionally use this information to prioritize the high-probability quadrant. If they had, LPL should have increased across participants as level of explicit awareness increased. Previous studies showed that the RT advantage in the “rich” quadrant was doubled under intentional learning conditions, compared to incidental LPL (Jiang, Sha, & Remington, 2015; Won & Jiang, 2015). In contrast, we found no increase in LPL in participants with greater awareness.
The co-existence of above-chance recognition and lack of modulation by awareness is reminiscent of a distinction Buchner and Wippich (1998) made between implicit learning and implicit memory. Implicit learning can produce explicit knowledge, and explicitly-learned information might sometimes only be accessible through implicit measures. LPL presents an example of implicit learning yielding explicit knowledge. It produces consciously accessible information about where the target most often occurred. Yet learning itself is not under deliberate control. Participants may be able to access the information when queried, but do not spontaneously realize this during search.
Although LPL is largely implicit, this does not imply that explicit awareness cannot modulate LPL. LPL is larger under intentional than incidental learning conditions (Jiang, Sha, et al., 2015; Jiang et al., 2014; Won & Jiang, 2015). Thus, with prolonged training, explicit guidance might eventually occur. Nonetheless, under incidental learning conditions, implicit learning is an important component of LPL. Claims to the contrary, such as those that equate LPL with goal-driven attention, are problematic. These claims cannot explain the lack of an effect of awareness across the 336 participants examined here. They also cannot explain dissociations between LPL and goal-driven attention: LPL is insensitive to working memory load, cognitive aging, and brain damage, factors that interfere with goal-driven attention.
The combination of data across multiple studies may raise validity questions. The similarity of tasks and identical statistical manipulations across these studies alleviate this concern. The assignment of high-probability quadrants was counterbalanced within each study, so no quadrant was disproportionately represented in the analysis. Studies with extended training might yield greater awareness, yet increases in awareness likely only influence later performance. Our analysis was restricted to the first 288 trials, in which LPL largely reflected implicit learning.
Alternative approaches exist. But accessibility of raw data makes our study superior to meta-analytical approaches because we directly addressed questions of homogeneity across studies. And though in ideal situations, a 400-person LPL study would be more desirable than pooling data across (similar) experiments, time and resource constraints render this unfeasible. The current approach presents a balance between large sample size and conservation of resources.
An evaluation of data from 420 participants shows that implicitly-learned attention is uniform across the visual field. Unlike crowding, LPL is not greater in the lower than the upper visual field. Unlike change detection, LPL in visual search is not influenced by pre-existing biases toward the upper left. The spread of attention from the trained location is graded, declining with increasing distance from the trained location. Although more participants than expected by chance can correctly identify the “rich” locations, awareness did not increase LPL. Implicit location probability learning induces a visual-field-independent change in spatial attention.
- Buchner, A., & Wippich, W. (1998). Differences and commonalities between implicit learning and implicit memory. In Handbook of implicit learning (pp. 3–46). Thousand Oaks, CA, US: Sage Publications, Inc.Google Scholar
- Jiang, Y. V., Swallow, K. M., & Sun, L. (2014). Egocentric coding of space for incidentally learned attention: Effects of scene context and task instructions. Journal of Experimental Psychology. Learning, Memory, and Cognition, 40(1), 233–250. https://doi.org/10.1037/a0033870 CrossRefPubMedGoogle Scholar
- Quirk, C., Adam, K., & Vogel, E. (2018). Preexisting spatial biases influence the encoding of information into visual working memory. Presented at the Vision Sciences Society, St. Pete, FL.Google Scholar
- Sisk, C. A., Twedell, E. L., Koutstaal, W., Cooper, S. E., & Jiang, Y. V. (2018). Implicitly learned spatial attention is unimpaired in patients with Parkinson’s Disease. Neuropsychologia, 119, 34–44. https://doi.org/10.1016/j.neuropsychologia.2018.07.030
- Twedell, E. L., Koutstaal, W., & Jiang, Y. V. (2016). Aging affects the balance between goal-guided and habitual spatial attention. Psychonomic Bulletin & Review. https://doi.org/10.3758/s13423-016-1214-3