A common mechanism underlying choice’s influence on preference and memory

Abstract

Individual control over learning leads to better memory outcomes, yet it is still unclear which aspects of control matter. One’s sense of agency could be a key component, but it can be challenging to dissociate it from its consequences on the environment. Here we used a paradigm in which participants in one condition had the opportunity to choose between cues (choice condition) and in another were instructed which cue to select (fixed condition). Because the cues had no effect on the memoranda, we could isolate the effect of choice on memory. Participants also rated the cues for preference before and after encoding, allowing us to test how the number of times a cue was chosen affected its preference. By pooling multiple behavioral studies, we were able to use an individual differences approach to examine the relationship between choice effects on preference and memory. Replicating previous work, we found that immediate and delayed (24-h) recognition memory was higher for items encountered in the choice condition. We also found that cues that were selected more often increased their preference in the choice condition, but actually decreased their preference in the fixed condition, suggesting that choice engaged value-related processes. Critically, we found a positive across-subjects relationship between choice memory enhancements and choice-induced preference change for delayed but not for immediate memory. These data suggest that a shared value-based mechanism enhances preference for choice cues and memory consolidation of the choice outcomes. Thus, the value of choice may play an important role in learning enhancements.

Imbuing individuals with agency—providing them with the opportunity to actively engage with their experiences—enhances learning and memory. For example, when individuals make choices about what they are learning, they acquire information faster and show better episodic memory (Gureckis & Markant, 2012; Markant, DuBrow, Davachi, & Gureckis, 2014; Murty, DuBrow, & Davachi, 2015, 2019; Rotem-Turchinski, Ramaty, & Mendelsohn, 2019). Accordingly, there is growing interest in manipulating choice opportunities to enhance learning, particularly in academic contexts. However, in fully self-directed settings, it is unclear which of a number of processes could lead to various types of learning enhancements. Characterizing these processes at both behavioral and neurobiological levels will be necessary in order to tailor effective interventions.

Across a number of studies, multiple aspects of active learning, involving individuals directly in the learning process (e.g., through agency), have been proposed to drive choice-related learning enhancements (Kornell & Metcalfe, 2006; Kornell & Son, 2009; Markant et al., 2014; Voss, Gonsalves, Federmeier, Tranel, & Cohen, 2011a; Voss, Warren, et al., 2011b), including strategically deploying attention, adaptively controlling study time, and making restudy and self-testing decisions. Interestingly, subsequent studies have shown that giving individuals the opportunity to make choices, even inconsequential choices, is sufficient to enhance memory (Murty et al., 2015; Rotem-Turchinski et al., 2019). For example, we recently found that when given the opportunity to select an occluder screen in order to reveal a to-be-remembered object underneath, memory was greater for items that participants actively chose to reveal, despite there being no relationship between their choice of occluder and which items were revealed. Thus, choice can enhance memory even when it has no effect on the content of the learning experience. Although the majority of research in this domain has focused on which specific features of control are related to memory enhancements (Markant et al., 2014; Voss, Warren, et al., 2011b), how inconsequential choices can enhance memory remains unclear.

One mechanism by which choice may improve memory is by enhancing value-related processes when individuals have a sense of agency over their environment. A large body of literature has shown that episodic memory is enhanced for items associated with high value—for example, in the form of monetary rewards (Miendlarzewska, Bavelier, & Schwartz, 2016; Murty & Adcock, 2017), intrinsic curiosity (Gruber, Ritchey, Wang, Doss, & Ranganath, 2016; Kang et al., 2009; Marvin & Shohamy, 2016), and even survival (Nairne, Pandeirada, & Thompson, 2008; Nairne, Thompson, & Pandeirada, 2007). Critically, choice may also be inherently valuable—the choice-induced preference literature has shown that individuals prefer items that they actively chose over the items’ unselected counterparts (Ariely & Norton, 2008; Leotti, Iyengar, & Ochsner, 2010), and they will forgo monetary rewards in order to have more choices (Fujiwara et al., 2013). Research has also shown that individuals prefer neutral cues that indicate the opportunity to make their own choice over cues that indicate that someone else would make a choice for them (Leotti & Delgado, 2011, 2014). These findings suggest that learning might also be preferable when given the opportunity to choose. This increased value for learning environments associated with choice might, in turn, drive memory enhancements.

In the present study, we characterized how the opportunity to choose influences memory and value-related processes, respectively, as well as the relationship between them. Participants performed a choice memory task in which to-be-encoded object images were hidden behind occluder screens. We manipulated whether individuals were able to actively select which occluder screen to remove (choice trials) or whether the occluder screen had been preselected (fixed trials). Both conditions required the same motor action, and in neither case did the selection actually affect which object image was revealed. To characterize the effect of perceived choice on memory, we tested recognition for the object images immediately and at a 24-h delay. To characterize value-related processes, we administered a rating task in order to assess preference for the hiragana characters appearing on occluder screens before and after encoding, computed preference change (postencoding minus preencoding), and, for each screen, related its preference change to the number of times it was selected during encoding (selection-induced preference measure). Finally, we compared how these measures differed across the choice and fixed conditions and tested whether individual differences in memory and preference change were related. Given that value-related effects on memory have been shown to be more pronounced after a 24-h delay (Murayama & Kitagami, 2014; Murayama & Kuhbandner, 2011; Patil, Murty, Dunsmoor, Phelps, & Davachi, 2017), we hypothesized that the relationship between preference and memory would be stronger for the 24-h than for the immediate memory test.

Method

Participants

Participants were recruited from the New York University and New York City communities across three separate cohorts from separate studies. Informed consent was obtained from each participant in a manner approved by the University Committee on Activities Involving Human Subjects. The data for the present analyses were collapsed across the three studies, which used the same paradigm. Study 1 was purely behavioral, Study 2 was behavioral with eyetracking, and Study 3 used functional magnetic resonance imaging (fMRI). In Studies 1 and 2, a total of 36 healthy, right-handed participants were paid $25 to participate. Three of the participants from Study 1 were excluded due to failure to follow the task instructions (n = 1), familiarity with the stimuli (n = 1), and failure to complete the 24-h recognition memory test (n = 1), resulting in 17 participants in Study 1 and 16 participants in Study 2. In Study 3, 24 healthy, right-handed participants were paid $50 to participate. Three participants were excluded from the present analyses due to either failure to follow the task instructions (n = 1) or failure to complete the memory test (n = 2). Thus, the final sample size was 54 (35 females, 19 males; 18–35 years old, median age = 23). Given the secondary nature of the present work (i.e., a reanalysis of previously collected data), we opted to include all available data. A post-hoc power analysis for our main result is reported below.

General procedure

After informed consent was obtained, participants were given instructions for the task. They then performed, in order, the preencoding rating task, the encoding task, and the postencoding rating task (Fig. 1A). The delayed recognition test was conducted after approximately 24 h. The participants in Studies 1 and 2 (n = 33) also completed a recognition test after the encoding phase on Day 1. These 33 participants completed all tasks in a behavioral testing room. The participants in Study 3 (n = 21) completed the rating and encoding tasks in the MRI scanner and then returned the following day to complete the delayed memory test in a behavioral testing room.

Fig. 1
figure1

(A) The study design includes 80 trials each of pre- and postencoding ratings, 120 trials of the encoding task split across the choice and fixed conditions, and 240 trials of the recognition test. Participants in Studies 1 and 2 completed half of the trials immediately and half after a 24-h delay; participants in Study 3 completed all trials after the 24-h delay. (B) Calculation of selection-induced preference. High selection-induced preference results from greater ratings at the post- than at the pre-encoding ratings the more times a character was selected

Rating task

The goal of the rating task was to measure changes in preference from before to after the encoding task for the hiragana characters that were used as occluder screens during encoding. Hiragana characters from the Japanese writing system were chosen for being abstract, eliciting some amount of aesthetic preference, and being unfamiliar and unnamable to most of our participants. The pre-encoding ratings were used to get baseline preference ratings for 80 hiragana characters. On each trial, a character was presented for 4 s, during which participants indicated how much they liked the character on a scale from 1 to 5 (1 = lowest rating, 5 = highest rating). Each trial was followed by a fixation dot for 2–5 s. We selected the 40 most neutrally rated characters, creating 20 pairs matched for preference to use as occluder screens in the encoding task. Notably, pairs of occluder screens only appeared in either the choice or the fixed condition. The post-encoding rating task followed the same procedure and was used to quantify changes in preference for hiragana characters as a function of the number of times they had been selected during encoding (detailed below).

Encoding task

The goal of the choice-encoding task was to measure the effects of agency on episodic memory. Each trial started with the presentation of a cue for 1 s, followed by a fixation dot for 2–4 s. The cue indicated the current trial’s condition (i.e., choice or fixed). Next, the selection phase consisted of two occluder screens labeled with hiragana characters, presented with a button below each that would be selected, to reveal a to-be-remembered, trial-unique object image underneath. On choice trials, participants selected either of the two screens, and on fixed trials, they were instructed to select a given screen, indicated by red text on the button. In both cases, responses had to be made within 2 s in order to reveal an object image, which was presented for another 2 s. Participants were instructed to remember each object for a later memory test (note that participants were instructed that they only needed to remember the object images, not the hiragana characters). A fixation dot lasting 3–24 s (exponentially distributed, M = 6.3 s) followed each encoding trial. This range of intertrial intervals (ITIs) was selected to optimize fMRI data analysis and was consistent across all studies despite only one using fMRI. Each participant completed 120 trials in total, 60 of each in the choice and fixed conditions. Choice and fixed trials were pseudo-randomly interleaved such that were no more than three subsequent presentations of the same condition.

Pairs of hiragana characters were repeated six times in the same condition across the experiment, and the left/right position of each character was counterbalanced across trials. Repetition of hiragana pairs allowed us to track preference changes that might arise from selection during the task. Unbeknownst to participants, their choice of hiragana characters had no effect on which objects were revealed. If no selection was made within 2 s, or if the nonindicated screen was selected in the fixed condition, that trial was removed from the analysis [mean (range) of excluded trials: 2.4 (0–15)].

Recognition task

In the recognition task, participants were shown object images that were either old (i.e., presented during encoding) or new (i.e., novel foils). They were asked to indicate whether they had previously seen each image (yes/no) and then to rate their confidence (very sure, pretty sure, or just guessing). The test was self-paced with a 1-s ITI. Participants completed 240 trials in all: 60 objects from the choice condition, 60 from the fixed condition, and 120 novel foils. The participants in Studies 1 and 2 (n = 33) completed half the trials immediately after the post-encoding rating task on Day 1, and half when they returned on Day 2. The participants in Study 3 completed all recognition trials during the Day 2 memory test.

Analysis

For the rating task, we developed a behavioral marker to track how the number of times that an occluder screen was selected in either the choice or the fixed condition influences participants’ preference for the hiragana character appearing on that screen—that is, selection-induced preference (Fig. 1B). We calculated these scores separately for hiragana characters appearing in the choice and fixed conditions. For each participant, we calculated the difference in the pre- versus post-encoding preference ratings for each hiragana character (Δ-preference). Then we calculated how many times each character was selected during the encoding task (#-selected). Then, for all the hiragana characters within a given condition (choice, fixed), we calculated a simple regression between Δ-preference and #-selected. Positive beta values would reflect an increase in preference as a function of the number of times a hiragana character was selected.

To test for memory differences between the choice and fixed conditions, we performed paired t tests with corrected recognition (hit rate – false alarm rate) in each condition as a within-subjects factor. This measure of corrected recognition was used so as to avoid altering the data, which would be necessary for calculating d-prime for individuals with no false alarms on the immediate memory test. Separate t tests were run with memory performance at the 24-h delay (with all 54 participants) and the immediate test (with the 33 participants in Studies 1 and 2). Note that the results of these memory analyses have been reported previously (Murty et al., 2015, 2019). For the novel preference change analyses, we again performed paired t tests to investigate whether selection-induced preference differed between the choice and fixed conditions. We also performed post-hoc, one-sample t tests to compare each condition against a baseline (beta = 0) that represents no influence of selection on preference change.

Given prior research demonstrating choice-related enhancements in both value and memory, we hypothesized that choice-induced preference and choice memory enhancements would be positively associated. To investigate the relationship between the influence of choice on long-term memory and its influence on selection-induced preference, we first calculated difference scores (choice minus fixed) for each individual and behavioral measure separately. Then we ran an across-subjects correlation between memory difference scores and selection-induced preference difference scores. We also ran post-hoc tests to investigate the relationships between memory benefits and selection-induced preference in each condition separately. The same procedures were then implemented for immediate recognition memory in the subgroup that performed the immediate test. Comparisons between the correlations with immediate versus 24-h memory were calculated using an R-to-Z transform.

Finally, since data from three studies were combined in these analyses, we wanted to ensure that the observed relationships were not driven by differences between the studies. Therefore, we ran an across-subjects multiple regression on memory, with study number as an additional predictor variable. We tested for both a main effect of study number and an interaction with selection-induced preference. The statistical thresholds for all analyses were considered to be significant when p < .05, and trending when p < .10.

Results

Memory performance

All memory scores reported are for corrected recognition (i.e., hit rates minus false alarm rates). At the immediate memory test, we found greater memory performance for items in the choice than in the fixed condition [t(32) = 3.06, p < .01, d = 0.53]. A similar pattern of results was also observed at the 24-h memory test [t(53) = 5.44, p < .001, d = 0.74; Fig. 2]. A breakdown of all recognition memory data can be found in Table 1.

Fig. 2
figure2

Corrected recognition at the immediate (left) and 24-h delay (right) memory tests in the choice and fixed conditions. *p < .05

Table 1 Hit rates and false alarm rates in the choice and fixed conditions at the immediate and 24-hour tests across studies

Selection-induced preference

Next we wanted to investigate whether the opportunity to choose enhanced selection-induced preference, operationalized as whether more selections of an occluder screen during encoding increases participants’ preference for the hiragana character appearing on that specific occluder screen, relative to its pre-encoding rating. Selection-induced preference was indeed greater in the choice than in the fixed condition [t(53) = 5.72, p < .001, d = 0.78; Fig. 3]. Post-hoc tests revealed that selection-induced preference enhancement in the choice condition was also significantly greater than baseline [t(53) = 5.77, p < .001], indicating that the number of times an occluder screen was chosen during encoding did positively influence its preference rating. Conversely, selection-induced preference in the fixed condition was below baseline [t(53) = – 2.54, p < .05], indicating that more frequent instructed selections actually reduced preference ratings.

Fig. 3
figure3

Selection-induced preferences (i.e., change in preference ratings from pre- to post-encoding as a function of the number of times occluder screens were selected) in the choice and fixed conditions. *p < .05

Notably, the positive preference changes for hiragana characters could not be explained simply by their appearance in the choice condition, as there was no overall difference between the preference ratings for hiragana characters that were in the choice and fixed conditions [t(53) = 0.99, p = .33]. Instead this suggests that, rather than having a general increase in preference for any of the characters they were able to choose, there was a specific relationship between preference change and the number of times that characters were actively selected.

Relationships between choice’s influence on memory and preference

In the principal analysis, we tested for a relationship between choice’s influence on long-term memory and selection-induced preference using an individual differences approach. We found a significant positive relationship between choice memory benefits on the 24-h memory test, and choice-related increases in selection-induced preference [r2(53) = .09, p < .05; Fig. 4]. A post-hoc power analysis indicated power of .60 to detect this effect. Correlations for the choice and fixed conditions separately showed a significant positive relationship between 24-h memory and selection-induced preference in the choice condition [r2(53) = .12, p < .05], but not in the fixed condition [r2(53) = .01, p = .61]. This suggests that when given the opportunity to choose, people who show greater choice-induced preference for actively selected hiragana characters are also more likely to show choice-related enhancement of long-term memory. This effect was not present at the individual-trial level, as a within-subjects regression between the rating change for a particular character and memory for the associated items showed no significant relationship in either the choice [t(50) = – 0.76, p = .45] or the fixed [t(50) = – 1.23, p = .22] condition, or when comparing conditions [t(50) = – 0.008, p = .99].

Fig. 4
figure4

Relationship between choice memory enhancements (choice minus fixed corrected recognition) for Day 1 (left) and Day 2 (right), and selection-induced preference differences between conditions (choice minus fixed). The different shades represent data drawn from different studies. Solid line, p < .05. Dashed line, p > .05

Next, we asked whether this relationship between choice’s influence on memory and selection-induced preference was also evident at the immediate test, limiting our analysis to the subgroup of participants who completed both the immediate and 24-h memory tests (n = 33). Despite reducing the power to detect our main result to .39, this subgroup showed no change in effect size, with a statistical trend for the relationship between choice-related memory enhancements at the 24-h memory test and choice-related increases in selection-induced preference [r2(32) = .09, p = .08]. By contrast, choice-related enhancements in memory performance at the immediate test were not associated with choice-related increases in selection-induced preference [r2(32) = .003, p = .76; Fig. 4]. To test whether selection-induced preference influenced 24-h memory significantly more than Day 1 memory, we directly compared these relationships (Steiger, 1980), but found no significant difference [z(32) = 1.46, p = .14].

Finally, to consider the possibility that one of the three groups combined for the 24-h memory analyses was driving the relationship between choice memory benefits and choice-related increases in selection-induced preference, we ran a multiple regression with group as a between-subjects factor. The relationship between choice memory benefits and selection-induced preference remained significant when controlling for study [β(53) = 0.02, p < .05], suggesting that group differences in preference and/or memory were not artificially driving this across-subject relationship.

Discussion

In this study, we used an individual differences approach to investigate the relationship between choice-induced memory enhancements and choice-induced preference. We found a positive relationship between these measures across subjects, suggesting as association between the influence of the opportunity to choose on memory and preference. The results from this study are consistent with a value-based account in which the intrinsic value of choice increases preference for the chosen items (hiragana characters) and enhances long-term memory for the outcomes of those choices (object images). The finding that the relationship between preference change and memory benefits only emerges after a delay provides further evidence for a value-based mechanism, as monetary value has been shown to specifically enhance memory through consolidation-dependent processes (Murayama & Kitagami, 2014; Murayama & Kuhbandner, 2011; Patil et al., 2017). The lack of a relationship between preference and memory at the item level suggests that individual differences drive the observed relationship, whereby sensitivity to agency may induce a state that separately guides memory and preference changes.

It is important to note that neither differences in looking times nor motor demands could have driven the observed memory benefits. Eyetracking data collected for Study 2 (reported in Murty et al., 2015) revealed that individuals actually spent more time looking at the target objects in the fixed than in the choice condition. The motor demands were matched in the two conditions, and, importantly, were insufficient to enhance preference. Rather, only when individuals exerted agency over their choices did selections increase preference. This is in line with previous work that has shown that active relative to passive encoding, in terms of motor actions, does not benefit memory unless there is a volitional component (Voss, Gonsalves, et al., 2011a). Together, these data suggest that imbuing individuals with a sense of agency may be an important component of active learning that is sufficient to enhance memory.

In addition to the effects on memory, we replicated prior findings that giving individuals the opportunity to choose enhances preference. Interestingly, the present analyses show that screens that were selected more frequently in the fixed condition, per the instructions, actually decreased in preference from pre- to post-encoding. These results build upon a growing literature showing that withholding agency from individuals may result in devaluation (Leotti et al., 2010). Leotti and colleagues stated that because people value the opportunity to choose, it can be aversive when perceived control is taken away. In our paradigm, participants experienced interleaved choice and fixed trials such that fixed trials might have been perceived as the removal of control. Indeed, decreases in preference for the selected items on fixed trials relative to baseline suggest that the lack of choice may have been aversive. Open questions remain, however, as to the mechanism driving this negative selection-induced preference and whether this devaluation is related to the lower memory in the fixed condition. Because the fixed condition served as our baseline in the memory task, we cannot evaluate whether selecting items in the fixed condition would have decreased memory relative to passive encoding. However, it is unlikely that memory differences would be driven by impairments from the removal of control, as aversive states do not necessarily cause memory impairments, and in many instances can actually enhance memory (LaBar & Cabeza, 2006; Murty & Adcock, 2017).

Our present behavioral findings dovetail with an emerging neuroimaging literature investigating the neurocognitive mechanisms underlying choice. In particular, cues that signal the opportunity to choose have been shown to recruit reward-sensitive brain regions, including the midbrain and ventral striatum, during the anticipation of choice (Leotti & Delgado, 2011). Moreover, we have shown that a similar striatal signal at choice cues correlates with later memory for choice outcomes (Murty et al., 2015), and that this relationship is mediated by postencoding consolidation processes, specifically in the choice condition (Murty et al., 2019). We extended these prior neuroimaging findings by demonstrating that the opportunity to choose is also associated with behavioral measures of value (i.e., choice-induced preference) and found that this expression of choice value predicts choice enhancements in long-term memory across individuals. Thus, together these data are consistent with a model by which a sense of agency can enhance memory for choice outcomes by engaging anticipatory value-based processes.

Theories regarding how a sense of agency over one’s environment arises tend to focus on interpreting causal relationships between one’s actions and the subsequent observed outcomes (Haggard & Tsakiris, 2009). However, as we noted above, the action–outcome contingency involved in the selection and object revealed in the fixed condition was insufficient to drive positive selection-induced preference. An alternative account suggests that one’s sense of agency may be prospective, imbued by monitoring selection processes in anticipation of an action, independent of outcomes (Metcalfe & Greene, 2007). Findings that behavioral and neural signatures of agency are modulated by anticipatory processes support this account (Chambon, Sidarus, & Haggard, 2014; Wenke, Fleming, & Haggard, 2010). Thus, one possibility is that anticipatory processes related to agency induce a heightened encoding state, such that items encountered in that state will show better long-term memory. This parallels motivated memory research in which explicit monetary rewards and intrinsic curiosity have been shown to enhance memory through anticipatory processes (Gruber & Ranganath, 2019; Miendlarzewska et al., 2016; Murty & Adcock, 2017). Because agency has also been proposed to be inherently rewarding (Leotti & Delgado, 2011) and to enhance intrinsic motivation (Patall, Cooper, & Robinson, 2008), it is possible that agency enhances preference and memory through an anticipatory value state similar to monetary and curiosity-driven encoding.

Our findings also help provide a better understanding of how decision making more generally may influence learning and memory. Although a large body of research has investigated interactions between choice and learning, these interactions have predominantly been studied using classic decision-making tasks that are poorly suited to study episodic memory, because reward cues are usually repeated many times. Only a few studies have investigated how reinforcement learning and decision making influence single-shot memory encoding. In two such studies, outcome signals (e.g., prediction error), but not anticipatory cue value, influenced memory encoding (Rouhani, Norman, & Niv, 2018; Wimmer, Braun, Daw, & Shohamy, 2014). At first glance, this might seem at odds with our present results, which focus on the mnemonic benefits of increased value in the anticipation of making a choice rather than feedback-related effects. However, one possibility is that attention could be biased toward uncertain outcomes (Pearce & Hall, 1980) in tasks that require learning through feedback. By contrast, in the present study there was no reward feedback to learn from, and thus no competition for attentional resources. This might explain the clear effects of anticipatory value on memory here, as well as in other tasks that do not require value learning. Future work will be necessary in order to characterize how agency might influence memory in tasks that do require value learning or that actively manipulate uncertainty within choice-based paradigms.

In sum, the present data demonstrate a relationship between choice-induced preference and choice memory enhancements that emerges after a delay. This relationship suggests that this association affects memory through a consolidation-dependent process. Thus, we argue that anticipation of value at the cue engages reward circuitry that leads to enhanced long-term memory for outcomes. More work will be needed to test this account—for instance, by making choice aversive, characterizing the time course of the memory benefits, and investigating how individual differences in agency-induced stress influence memory. Regardless, the present data may have important implications for education, suggesting that simple interventions that enhance active learning without significantly altering content could lead to better long-term retention.

References

  1. Ariely, D., & Norton, M. I. (2008). How actions create—not just reveal—preferences. Trends in Cognitive Sciences, 12, 13–16. https://doi.org/10.1016/j.tics.2007.10.008

    Article  PubMed  Google Scholar 

  2. Chambon, V., Sidarus, N., & Haggard, P. (2014). From action intentions to action effects: how does the sense of agency come about? Frontiers in Human Neuroscience, 8, 320. https://doi.org/10.3389/fnhum.2014.00320

    Article  PubMed  PubMed Central  Google Scholar 

  3. Fujiwara, J., Usui, N., Park, S. Q., Williams, T., Iijima, T., Taira, M., … Tobler, P. N. (2013). Value of freedom to choose encoded by the human brain. Journal of Neurophysiology, 110, 1915–1929. https://doi.org/10.1152/jn.01057.2012

    Article  PubMed  PubMed Central  Google Scholar 

  4. Gruber, M. J., & Rangnath, C (2019). How curiosity enhances hippocampus-dependent memory. OSF preprints. https://doi.org/10.31219/osf.io/5v6nm

  5. Gruber, M. J., Ritchey, M., Wang, S.-F., Doss, M. K., & Ranganath, C. (2016). Post-learning hippocampal dynamics promote preferential retention of rewarding events. Neuron, 89, 1110–1120. https://doi.org/10.1016/j.neuron.2016.01.017

    Article  PubMed  PubMed Central  Google Scholar 

  6. Gureckis, T. M., & Markant, D. B. (2012). Self-directed learning: A cognitive and computational perspective. Perspectives on Psychological Science, 7, 464–481. https://doi.org/10.1177/1745691612454304

    Article  PubMed  Google Scholar 

  7. Haggard, P., & Tsakiris, M. (2009). The experience of agency: Feelings, judgments, and responsibility. Current Directions in Psychological Science, 18, 242–246. https://doi.org/10.1111/j.1467-8721.2009.01644.x

    Article  Google Scholar 

  8. Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T., & Camerer, C. F. (2009). The wick in the candle of learning: epistemic curiosity activates reward circuitry and enhances memory. Psychological Science, 20, 963–973. https://doi.org/10.1111/j.1467-9280.2009.02402.x

    Article  PubMed  Google Scholar 

  9. Kornell, N., & Metcalfe, J. (2006). Study efficacy and the region of proximal learning framework. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 609–622. https://doi.org/10.1037/0278-7393.32.3.609

    Article  PubMed  Google Scholar 

  10. Kornell, N., & Son, L. K. (2009). Learners’ choices and beliefs about self-testing. Memory, 17, 493–501. https://doi.org/10.1080/09658210902832915

    Article  PubMed  Google Scholar 

  11. LaBar, K. S., & Cabeza, R. (2006). Cognitive neuroscience of emotional memory. Nature Reviews Neuroscience, 7, 54–64. https://doi.org/10.1038/nrn1825

    Article  PubMed  Google Scholar 

  12. Leotti, L. A., & Delgado, M. R. (2011). The inherent reward of choice. Psychological Science, 22, 1310–1318. https://doi.org/10.1177/0956797611417005

    Article  PubMed  PubMed Central  Google Scholar 

  13. Leotti, L. A., & Delgado, M. R. (2014). The value of exercising control over monetary gains and losses. Psychological Science, 25, 596–604. https://doi.org/10.1177/0956797613514589

    Article  PubMed  PubMed Central  Google Scholar 

  14. Leotti, L. A., Iyengar, S. S., & Ochsner, K. N. (2010). Born to choose: The origins and value of the need for control. Trends in Cognitive Sciences, 14, 457–463. https://doi.org/10.1016/j.tics.2010.08.001

    Article  PubMed  PubMed Central  Google Scholar 

  15. Markant, D., DuBrow, S., Davachi, L., & Gureckis, T. M. (2014). Deconstructing the effect of self-directed study on episodic memory. Memory & Cognition, 42, 1211–1224. https://doi.org/10.3758/s13421-014-0435-9

    Article  Google Scholar 

  16. Marvin, C. B., & Shohamy, D. (2016). Curiosity and reward: Valence predicts choice and information prediction errors enhance learning. Journal of Experimental Psychology: General, 145, 266–272. https://doi.org/10.1037/xge0000140

    Article  Google Scholar 

  17. Metcalfe, J., & Greene, M. J. (2007). Metacognition of agency. Journal of Experimental Psychology: General, 136, 184–199. https://doi.org/10.1037/0096-3445.136.2.184

    Article  Google Scholar 

  18. Miendlarzewska, E. A., Bavelier, D., & Schwartz, S. (2016). Influence of reward motivation on human declarative memory. Neuroscience & Biobehavioral Reviews, 61, 156–176. https://doi.org/10.1016/j.neubiorev.2015.11.015

    Article  Google Scholar 

  19. Murayama, K., & Kitagami, S. (2014). Consolidation power of extrinsic rewards: Reward cues enhance long-term memory for irrelevant past events. Journal of Experimental Psychology: General, 143, 15–20. https://doi.org/10.1037/a0031992

    Article  Google Scholar 

  20. Murayama, K., & Kuhbandner, C. (2011). Money enhances memory consolidation—but only for boring material. Cognition, 119, 120–124. https://doi.org/10.1016/j.cognition.2011.01.001

    Article  PubMed  Google Scholar 

  21. Murty, V. P., & Adcock, R. A. (2017). Distinct medial temporal lobe network states as neural contexts for motivated memory formation. In D. E. Hannula & M. C. Duff (Eds.), The hippocampus from cells to systems: Structure, connectivity, and functional contributions to memory and flexible cognition (pp. 467–501). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-50406-3_15

    Google Scholar 

  22. Murty, V. P., DuBrow, S., & Davachi, L. (2015). The simple act of choosing influences declarative memory. Journal of Neuroscience, 35, 6255–6264. https://doi.org/10.1523/JNEUROSCI.4181-14.2015

    Article  PubMed  Google Scholar 

  23. Murty, V. P., DuBrow, S., & Davachi, L. (2019). Decision-making increases episodic memory via postencoding consolidation. Journal of Cognitive Neuroscience, 31, 1308–1317. https://doi.org/10.1162/jocn_a_01321

    Article  PubMed  Google Scholar 

  24. Nairne, J. S., Pandeirada, J. N. S., & Thompson, S. R. (2008). Adaptive memory: The comparative value of survival processing. Psychological Science, 19, 176–180. https://doi.org/10.1111/j.1467-9280.2008.02064.x

    Article  PubMed  Google Scholar 

  25. Nairne, J. S., Thompson, S. R., & Pandeirada, J. N. S. (2007). Adaptive memory: Survival processing enhances retention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 263–273. https://doi.org/10.1037/0278-7393.33.2.263

    Article  PubMed  Google Scholar 

  26. Patall, E. A., Cooper, H., & Robinson, J. C. (2008). The effects of choice on intrinsic motivation and related outcomes: A meta-analysis of research findings. Psychological Bulletin, 134, 270–300. https://doi.org/10.1037/0033-2909.134.2.270

    Article  PubMed  Google Scholar 

  27. Patil, A., Murty, V. P., Dunsmoor, J. E., Phelps, E. A., & Davachi, L. (2017). Reward retroactively enhances memory consolidation for related items. Learning and Memory, 24, 65–69. https://doi.org/10.1101/lm.042978.116

    Article  PubMed  Google Scholar 

  28. Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532–552. https://doi.org/10.1037/0033-295X.87.6.532

    Article  PubMed  Google Scholar 

  29. Rotem-Turchinski, N., Ramaty, A., & Mendelsohn, A. (2019). The opportunity to choose enhances long-term episodic memory. Memory, 27, 431–440. https://doi.org/10.1080/09658211.2018.1515317

    Article  PubMed  Google Scholar 

  30. Rouhani, N., Norman, K. A., & Niv, Y. (2018). Dissociable effects of surprising reward on learning and memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44, 1430–1443. https://doi.org/10.1037/xlm0000518

    Article  PubMed  Google Scholar 

  31. Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251. https://doi.org/10.1037/0033-2909.87.2.245

    Article  Google Scholar 

  32. Voss, J. L., Gonsalves, B. D., Federmeier, K. D., Tranel, D., & Cohen, N. J. (2011a). Hippocampal brain-network coordination during volitional exploratory behavior enhances learning. Nature Neuroscience, 14, 115–120. https://doi.org/10.1038/nn.2693

    Article  PubMed  Google Scholar 

  33. Voss, J. L., Warren, D. E., Gonsalves, B. D., Federmeier, K. D., Tranel, D., & Cohen, N. J. (2011b). Spontaneous revisitation during visual exploration as a link among strategic behavior, learning, and the hippocampus. Proceedings of the National Academy of Sciences, 108, E402–E409. https://doi.org/10.1073/pnas.1100225108

    Article  Google Scholar 

  34. Wenke, D., Fleming, S. M., & Haggard, P. (2010). Subliminal priming of actions influences sense of control over effects of action. Cognition, 115, 26–38. https://doi.org/10.1016/j.cognition.2009.10.016

    Article  PubMed  Google Scholar 

  35. Wimmer, G. E., Braun, E. K., Daw, N. D., & Shohamy, D. (2014). Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. Journal of Neuroscience, 34, 14901–14912. https://doi.org/10.1523/JNEUROSCI.0204-14.2014

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported by National Institutes of Health (NIH) grant R01 MH074682. V.P.M. is supported by NIH grant K01 MH111991. We also thank Lila Davachi for her support in experiment design and data collection.

Open practices statement

The data and materials for all experiments are available at https://osf.io/jmt4q/. None of the experiments were preregistered.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Vishnu P. Murty.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

DuBrow, S., Eberts, E.A. & Murty, V.P. A common mechanism underlying choice’s influence on preference and memory. Psychon Bull Rev 26, 1958–1966 (2019). https://doi.org/10.3758/s13423-019-01650-5

Download citation

Keywords

  • Choice
  • Consolidation
  • Decision making
  • Episodic memory