In Experiment 1, participants studied sequentially or simultaneously presented items represented by positive and negative numerical values in a 5 × 5 grid. We were interested in how participants would approach studying these items of varying magnitude and how this might change with both increasing task experience (across multiple trials) and varying levels of attentional resources (by manipulating presentation format). After viewing the study grid, participants were given a memory test in which they were required to place items into their previously viewed locations and were immediately given detailed feedback on their performance, including which positive and negative items were correctly or incorrectly placed and their total score. Participants then repeated this procedure for a total of eight study-test cycles, with both positive and negative value-location pairs appearing in each grid. Prior research has revealed the importance of examining across multiple trials for assessing strategy optimization coupled with increasing task experience (Ariel & Dunlosky, 2013; Castel, 2008; Middlebrooks et al., 2017; Nelson & Narens, 1990; Siegel & Castel, 2018b; Wong et al., 2019). This motivated the utilization of eight study-test cycles in the current study as detailed feedback was provided at the end of each study-test cycle so that participants could incorporate it and modify their study strategies on this value-based, goal-directed task. We hypothesized, then, that with increased task experience and feedback, participants may engage in more effective encoding strategies and earn more points on each successive trial.
With regard to memory for positive and negative items, we hypothesized that participants would remember higher overall magnitudes (regardless of sign) better than lower magnitudes. Further, we expected that participants would remember positive and negative information equally, consistent with prior work demonstrating that both rewards and punishments may produce equivalent memory enhancement (Castel et al., 2016; Madan et al., 2014; Shigemune et al., 2013). However, this proposed equivalence between negative and positive items may only be the case when participants are able to effectively engage in strategic control processes during encoding (as in the simultaneous presentation format) with a more efficient, top-down-directed implementation of strategy. Yet, when resources are more strained during encoding (as in the sequential format), top-down strategic processes may be less effective, and the bottom-up influence of particular item characteristics may have a greater effect on memory performance. One potential hypothesis is that participants’ attention may be more captured by negative items, as the losses may loom larger than the gains, in line with prospect theory (Kahneman & Tversky, 1979; Tversky & Kahneman, 1992). On the other hand, as predicted by the regulatory fit theory (Higgins, 2005, 2006; Spiegel et al., 2004), participants in this demanding sequential format may adopt a points-gained approach consistent with the phrasing of task goals to maximize points earned, focusing on and remembering more positive item-locations.
Method
Participants
One-hundred and ten younger adults (84 females, Mage = 20.78 years, SDage = 1.50 years, age range: 18–27 years), randomly assigned into two experimental presentation conditions: sequential (n = 55, 45 females, Mage = 20.65 years, SDage = 1.68 years, age range: 18–27 years) and simultaneous (n = 55, 39 females, Mage = 20.91 years, SDage = 1.29 years, age range: 18–24 years), volunteered to participate in this study. All participants were University of California, Los Angeles (UCLA) undergraduate students who participated for course credit. All participants presented with normal or corrected-to-normal vision, no physical disability, and clinically normal cognitive function.
Materials and apparatus
The items used as stimuli in this study were designed in Adobe Photoshop and were ten simple numerical values ranging from -25 to +25, in increments of 5 with no 0 value (Fig. 1). On the computer screen, each item was 200 × 200 px in size, consisting of text typed in “Open Sans” bold-weight font, size 106.1 pt, colors: #b80001 (red, negative items) and #02a747 (green, positive items). Each of the presentation orders (sequential) and assigned locations (sequential, simultaneous) of the number-items was pseudorandomized and placed within a 5 × 5 grid with the constraint that no more than two items be present in any row or column (to avoid arbitrarily forming spatial patterns that may aid memory). On the computer screen, the size of each grid was 550 × 550 px (with each cell 110 × 110 px in size). Each item and its number displayed represented the locations’ value ranging from -25 (lowest value) to +25 (highest value). This process of adding the number-items to different spatial locations within each study grid was repeated to form eight unique grids each with a different arrangement of the ten number-items (e.g., the -20 item was in a different location on each of the eight trials). In order to prevent against testing effects, the locations of the positive and negative item values within each grid were completely randomized per trial and per participant. That is, while one participant may have been presented with a +25 number-item in the top left cell of the third grid, that same +25 number-item could have been located in the bottom right cell of the seventh grid for a different participant. Positive value items were always green and negative value items were always red. As such, each participant was presented with a different set of eight completely randomized study grids.
Procedure
The procedure used in this study was based upon methodologies used in prior experiments investigating VDR (e.g., Castel et al., 2002; Hayes, Kelly, & Smith, 2013; Robison & Unsworth, 2017) and visuospatial memory (e.g., Chalfonte & Johnson, 1996; Thomas et al., 2012; Siegel & Castel, 2018a, 2018b). Participants were instructed that they would be shown a grid with various numbers placed throughout the grid’s cells and to remember the locations of the values for a later test. They were then instructed that the numbers presented within the grid would differ in value, ranging from -25 (lowest value) to +25 (highest value), in increments of 5, excluding 0, indicated by the number of the item in the cell, and that their goal would be to maximize their score (a summation of the points associated with a correctly remembered item). Participants were also instructed that the penalty for misplacing negatively valued number-items would be losing that value from their overall score. For example, if the participant correctly placed a number that was worth +25 points, they would receive +25 points towards their total score. If they correctly placed a number that was worth -10 points, they would avoid losing 10 points from their total score. For the sequential presentation format, participants were shown each number-item for 3 s (totaling 30 s for the ten presented number-items). There was no inter-stimulus interval in between each stimulus presentation as sequentially presented items were shown with each preceding item disappearing directly before the appearance of the next item. For the simultaneous presentation format, participants were instructed that they would see all ten number-items within the grid at the same time, while studying the grid for a total of 30 s.
After viewing the grid, participants were shown a brief visual mask for 0.5 s and then a blank 5 × 5 grid with the previously presented number-items in a row underneath. Participants were instructed to replace the items in their previously viewed locations using the computer mouse. If unsure about a value’s location, participants were instructed to make a guess at its location. There was no time limit for participants during the testing phase. After participants placed all ten items, they were given immediate feedback both on their total score (out of 75 points per grid) and the number of points gained (by correctly placing positively valued number-items), lost (by incorrectly placing negatively valued number-items), failed-to-gain (by incorrectly placing positively valued number-items), and avoided-losing (by correctly placing negatively valued number-items). Participants were able to review their feedback for as long as they desired and were instructed to click a button to advance them to the next grid when they felt ready to do so. After choosing to advance, the subsequent trial would commence with participants immediately shown the new grid to study. Participants then repeated this procedure for all eight grids. After conclusion of the eight study-test cycles, the experiment was completed.
All materials and procedures used in the current study were approved by the UCLA Institutional Review Board.
Results
Scoring performance
Participants had the opportunity to score a minimum of -75 points and a maximum of +75 points in each study-test cycle. To examine their overall scoring performance with regard to grid number between the two presentation formats, we conducted a 2 (Presentation format: sequential, simultaneous) × 8 (Grid number: 1, 2, …, 8) mixed analysis of variance (ANOVA) on the overall points-scores. Grid number was included as a factor in this and later analyses as prior research has consistently demonstrated that participants may not optimally execute a value-based study strategy on the first trial, but increase their performance with continued task experience and feedback (Castel, 2008; Middlebrooks et al., 2017; Siegel & Castel, 2018a).
This analysis revealed a significant main effect of presentation format, F(1, 108) = 47.49, p < .001, η2 = .31, with participants in the simultaneous condition scoring relatively higher (M = -0.62, SD = 1.91) than participants in the sequential condition (M = -2.90, SD = 1.55), t(108) = 6.89. A significant main effect of grid number was revealed, F(7, 756) = 2.46, p = .02, η2 = .02, but follow-up post hoc independent samples t-tests with a Bonferroni correction revealed no significant differences (all adjusted ps > .24). Finally, there was no interaction between presentation format and grid number, F(7, 756) = 0.34, p = .94, η2 = .003.
To further examine the potential presence of a linear or quadratic trend between grid number and points-scores despite no significant differences in Bonferroni-corrected t-tests, we conducted a polynomial regression predicting points-scores from grid number averaged between presentation formats (given the lack of format × grid number interaction). The regression model took the following form: Points = β0 + β1 (Grid number) + β2 (Grid number)2. The continuous predictor grid number was entered into the model as a mean-centered variable. The quadratic term was entered into the model to account for the possibility of a U-shaped relationship between grid number and points score (i.e., potentially higher performance at the beginning and end of the task). The model was a significant predictor of points-scores, R2 = .01, F(2, 877) = 5.07, p = .01. Both the coefficients for the intercept, β0 = -1.73, p < .001, and the linear term, β1 = .17, p = .002, were significant predictors, while the quadratic term coefficient was not, β2 = -.01, p = .83. This finding indicates a positive linear relationship between grid number and points such that with each increase in grid number the amount of points earned also increased.
Memory performance
Overall memory performance was assessed by the ability of participants to correctly replace values into the exact target locations in which they were viewed in the prior study phase for each grid. Error magnitude (i.e., how many cells away an item was misplaced) was also examined as a function of grids and item value. These results were largely consistent with those examining correct recall performance described below and are included in the Online Supplementary Materials.
Recall across grids
To examine overall memory performance with increasing task-experience when number-items were presented either sequentially or simultaneously and regardless of item value, we conducted a 2 (Presentation format: sequential, simultaneous) × 8 (Grid number: 1, 2, …, 8) mixed ANOVA on the proportion of items correctly placed (out of 10 possible items; Fig. 2). This analysis revealed a significant main effect of presentation format, F(1, 108) = 55.29, p < .001, η2 = .34, such that participants in the simultaneous condition (M = .45, SD = .12) correctly replaced a greater proportion of items, as compared to participants in the sequential condition (M = .29, SD = .09). There was no main effect of grid number, F(7, 756) = 1.88, p = .07, η2 = .02, and no significant interaction between presentation format and grid number, F(7, 756) = 0.31, p = .95, η2 = .003.
Recall by item value
To examine overall memory performance as a function of item values between presentation formats, we conducted a 2 (Presentation format: sequential, simultaneous) × 10 (Item value: -25, -20, …, +25) mixed ANOVA on the proportion of items correctly placed (Fig. 3). Mauchly’s Test of Sphericity indicated that the assumption of sphericity had been violated, χ2(44) = 141.36, p < .001; therefore, a Greenhouse-Geisser (ε = .76) correction was used. The previously described main effect of presentation format was found again, F(1, 108) = 55.29, p < .001, η2 = .34. There was also a significant main effect of item value, F(6.81, 735.33) = 12.80, p < .001, η2 = .11, but no interaction between item value and presentation format, F(6.81, 735.33) = 1.09, p = .37, η2 = .01.
The significant main effect of item value suggests that item value differentially influenced recall accuracy. Assessing the relationship between recall accuracy and item value in an ANOVA framework would require many post hoc comparisons due to the number of item value pairs, thus reducing our ability to detect any significant differences. Instead, we conducted linear and quadratic model fits for memory performance as a function of item value in a regression framework to examine overall trends. As the previously described ANOVA indicated no significant difference between presentation formats in terms of the relationship between item value and recall, we collapsed across these conditions in the following regressions. Tested linear models were of the following form: Recall Accuracy = β0 + β1 (item value). Tested quadratic models were of the following form: Recall Accuracy = β0 + β1 (item value) + β2 (item value)2.
The quadratic model was significant, R2 = .81, F(2, 9) = 15.35, p = .003, with the following standardized coefficients, β1 = .66, p = .01, and β2 = .62, p = .01, indicating a U-shaped relationship between item value and recall accuracy. This result indicates that more extreme values (i.e., those closer to ±25) were better remembered than more median values (those closer to ±5) in both presentation formats.
Recall by sign
In addition to looking at the overall trends through regression analyses, we were also interested in examining the differences between positive and negative values of the same magnitude for each of our dependent measures (e.g., comparing recall between -25 and +25). While our regression analyses allowed us to determine overall trends, they did not reveal the individual differences between the positive and negative values of the same magnitude. Thus, to determine whether there was a bias for positive or negative values, we conducted paired-samples t-tests with a Bonferroni correction collapsed across grids. For each item magnitude, the positive value (e.g., +20) was recalled more accurately than the corresponding negative value (e.g., -20), adjusted ps < .03. Overall, there was higher recall accuracy for positive (M = .41, SD = .15) relative to negative (M = .33, SD = .15) items, t(109) = 5.65, p < .001.
Response order by item value
Another way of examining participants’ strategies was to examine the order in which they output items. If a participant’s strategy was to remember negative or positive items first, then this would likely be reflected in their recall order, with those items placed earlier in the recall phase (Middlebrooks & Castel, 2018). In the context of the current task, as participants were required to place all ten items before proceeding to the next trial, we were able to analyze the order in which information was outputted and whether this varied as a function of presentation format.
To examine the order in which they replaced each item into the test grid, we conducted a 2 (Presentation format: sequential, simultaneous) × 10 (Item value: -25, -20, …, +25) mixed ANOVA on response (output) order (Fig. 4). Output order ranged from 1 (the first item placed during the recall phase) to 10 (the last item placed during the recall phase), with lower scores indicating an earlier output and higher scores indicating a later output. Given that participants were able to move items around in the grid at their discretion (i.e., an item was not “locked in” after its first placement), we used the final output position for each item. For example, if participants placed all ten items and then shifted the item that they had placed fourth to a new location, that item would then become the last item placed and receive an output order score of 10. This output order variable was used as the outcome variable in the following analyses. Mauchly’s Test of Sphericity indicated that the assumption of sphericity had been violated, χ2(44) = 342.79, p < .001; therefore, a Greenhouse-Geisser (ε = .505) correction was used. There was a significant main effect of item value, F(4.55, 490.93) = 19.66, p < .001, η2 = .15, and a significant interaction between item value and presentation format, F(4.55, 490.93) = 2.91, p = .02, η2 = .02.
Given the significant interaction, the relationship between item value and response order was analyzed separately within each presentation format using the same linear and quadratic models described in the recall-by-item-value section. In both presentation formats, a significant quadratic relationship was found indicating an inverted U-shape relationship between item value and response order, R2 = .84, F(2, 9) = 18.48, p = .002, and R2 = .81, F(2, 9) = 15.55, p = .003, for the sequential and simultaneous formats, respectively. In each model, both the linear (βSeq = -.77, p = .001 and βSim = -.73, p = .003) and the quadratic (βSeq = -.50, p = .01 and βSim = -.53, p = .01) standardized coefficients were significant. As such, participants in both presentation formats placed items of higher magnitude (regardless of sign) earlier in the testing phase than items of lower magnitude.
To determine if response order varied as a function of sign (i.e., between negative and positive items), for items presented sequentially, response orders for items of all magnitudes were significantly different compared to their respective counterparts (adjusted ps < .001), with positively valued items placed before negatively valued items. For items presented simultaneously, items of value +15 were placed earlier than those valued -15 (p < .001), while the remaining items of magnitudes 5, 10, 20, and 25 did not differ in response order between positive and negative values (adjusted ps > .09). Further, a 2 (Presentation format: sequential, simultaneous) × 2 (Sign: positive, negative) mixed ANOVA on response order revealed a significant interaction, F(1, 108) = 5.61, p = .02, η2 = .04. Follow-up paired-samples t-tests to examine response order differences within each presentation format were conducted. For the sequential format, positive items (M = 4.86, SD = 0.81) were replaced earlier in the testing phase than negative items (M = 6.14, SD = 0.81), t(54) = 5.90, p < .001. This was also the case for the simultaneous format (MPos = 5.21, SDPos = 0.76, MNeg = 5.79, SDNeg = 0.76), t(54) = 2.84, p = .01. This indicates that while both presentation formats resulted in earlier placement of positive relative to negative items overall, this difference was larger in the sequential relative to the simultaneous format.
Discussion
Simultaneously presented information was more accurately recalled compared to information presented sequentially which led to higher point totals in the simultaneous presentation format. While there was better memory for extreme values (e.g., ±25) in both presentation formats, participants more accurately recalled positive items relative to negative items, suggesting a surprising positivity bias for recall accuracy. Examining response order as an indicator of participants’ strategy use indicated that all participants attempted to place positive items before negative items, although this preference appeared to be greater for sequentially presented items. This may have been due to participants attempting to recall as many positive items as they could, thus evidencing a positivity-first, points-gained approach for the more demanding sequential presentation format that reduces top-down influence relative to the simultaneous presentation format. Overall, these results demonstrate preferential treatment of positive items relative to negative items under varying degrees of attentional load during encoding despite their equivalent influence on participants’ total score. This evident points-gained approach was further explored in Experiment 2 in which participants had complete control over their study choices.