The domain specificity of intertemporal choice in pinyon jays
When choosing between a piece of cake now versus a slimmer waistline in the future, many of us have difficulty with self-control. Food-caching species, however, regularly hide food for later recovery, sometimes waiting months before retrieving their caches. It remains unclear whether these long-term choices generalize outside of the caching domain. We hypothesized that the ability to save for the future is a general tendency that cuts across different situations. To test this hypothesis, we measured and experimentally manipulated caching to evaluate its relationship with operant measures of self-control in pinyon jays (Gymnorhinus cyanocephalus). We found no correlation between caching and self-control at the individual level, and experimentally increasing caching did not influence self-control. The self-control required for caching food, therefore, does not carry over to other foraging tasks, suggesting that it is domain specific in pinyon jays.
KeywordsCaching Delay choice task Intertemporal choice Pinyon jay
People save current income for retirement, avoid fattening foods to maintain long-term health, and pay more to purchase fuel-efficient vehicles. These choices involve exhibiting self-control, or forgoing an immediate benefit to acquire a larger benefit later. Humans exhibit some degree of domain generality in self-control. For example, people who wait for monetary benefits also wait for environmental benefits (Hardisty and Weber 2009). Monetary and health domains, however, are not related (Chapman 2003), indicating a degree of domain specificity in human intertemporal choice.
We know little about whether intertemporal choices carry over across contexts in other species. In Addessi et al. (2013), brown capuchin monkeys (Sapajus spp.) participated in two intertemporal choice tasks. In the delay choice task, subjects chose between a smaller food reward available sooner and a larger reward available later. In the delay maintenance task, rewards accumulated over time, requiring subjects to resist consuming available rewards to maximize the number of rewards received. Though the two tasks correlated in one population of capuchins, they did not correlate in another population. Therefore, in nonhumans, the evidence for domain generality in self-control remains mixed.
Here, we aim to extend the study of the domain generality of intertemporal choice to food-caching behavior, an example of extreme self-control. Caching species hide food for later consumption and can wait months to retrieve the food (Vander Wall 1990). Caching provides an ethologically relevant example of intertemporal choice because animals choose between the immediate gratification of consuming food versus the long-term benefits of delaying consumption until food is scarce (Stevens 2010; Thom and Clayton 2014). Pinyon jays (Gymnorhinus cyanocephalus), for example, are a species of corvid (member of the crow family) that caches up to 25,000 pinyon pine nuts each fall and then retrieves them in the winter (Ligon 1978; Marzluff and Balda 1992). Because the jays forgo an instantaneous reward, each caching event represents an example of self-control. Given the high number of instances of self-control exhibited by pinyon jays, this species provides an ideal system to explore caching as an example of intertemporal choice.
To test the domain generality of intertemporal choice in pinyon jays, we conducted two experiments. The first experiment examined individual differences by assessing intertemporal choice in two tasks. We measured both caching rates and choices in an operant delay choice task in the same individuals. In the second experiment, we directly manipulated one form of intertemporal choice (caching) to test for concomitant effects on another form (operant delay choice). Combined, these two experiments allow us to determine whether the self-control required for caching carries over into other contexts.
Experiment 1: correlating caching and operant delay choice
The first experiment assessed whether caching behavior and operant delay choice correlated within individuals. We measured caching by offering pinyon jays the opportunity to cache a fixed number of food items. Subjects also completed an operant delay choice task in which they chose between one food reward available immediately and three food rewards available after a time delay. We then correlated individual measures in both tasks to test the domain generality of self-control, with the prediction that pinyon jays who cache more will wait longer in a operant delay choice task.
The experiment consisted of the operant delay choice task in the morning five times per week and the caching task in the afternoon two times per week from May to October 2013.
We housed 12 pinyon jays (four female) with previous operant experience in individual cages in a room with a 14:10 h light:dark cycle. They were maintained at 82-86 % of their free-feeding weights with daily controlled feedings of Lafeber’s Cockatiel and Parrot Pellets, turkey starter, and live mealworms.
Operant delay choice methods
We autoshaped subjects by presenting a centered white disk (diameter = 72 pixels) on the monitor, followed immediately by a food reward. Then, we trained the subjects to peck the disk in either of the left-right lateral positions. Next, jays learned to peck a central start disk then the lateral stimulus to receive an immediate reward. The required number of pecks to the lateral stimulus gradually increased from one to three to avoid accidental pecks.
On each forced trial, we presented either a red or blue disk in one of the lateral positions on the monitor. Six subjects immediately received three reward pellets for pecking the red disk and one for pecking blue. The other six experienced the opposite contingencies.
To start each trial, subjects had to peck the start disk once within a 15-s interval; otherwise, the monitor went blank, and the start disk reappeared after 5 s. After pecking the start disk, it disappeared and a red or blue disk appeared in one of the lateral positions. After three pecks to the one-reward disk, the monitor went blank, and a single reward pellet dispensed. After three pecks to the three-reward disk, the monitor went blank and three rewards dispensed serially, with a 1-s delay between each delivery. A food light illuminated the cup for 6 s, starting from the moment of delivery of the first reward. A 30 s intertrial interval ensued. If the bird did not peck the colored disk three times within 20 s after stimulus onset, the monitor went blank and the trial repeated after 30 s.
Each session consisted of fourteen trials, seven presentations of each colored disk. We presented stimuli pseudo-randomly, such that the same disk appeared on no more than three consecutive trials within a session. Presentation side was counterbalanced, such that the disk never occurred on the same side for more than three consecutive trials.
Each choice phase session included four forced trials and ten free-choice trials. The first two trials of each session were always forced, one trial for each colored disk. We interspersed two more forced trials throughout the rest of the session.
During the ten free-choice trials, we presented both colored disks simultaneously, and subjects had to choose between them. Subjects continued on this phase until they selected the three-reward disk seven out of ten trials within a session.
We used an adjusting-delay procedure (Mazur 1984) to titrate the indifference point between the one food pellet available immediately and three food pellets available after a time delay. We adjusted the delay to the larger reward between sessions based on individual performance in the immediately preceding session. Each bird started with a 1-s delay between pecking the three-reward disk and reward delivery. If the subject chose the three-reward disk seven or more trials within a session, the delay in the next session increased by one second. If the subject chose the three-reward disk four to six trials within a session, the delay did not change. If the subject chose the three-reward disk zero to three trials within a session, the delay decreased by one second. A bird must have completed at least nine out of ten choice trials to be eligible for delay titration. Reward delivery after choosing the one-reward disk was instantaneous throughout.
Titration sessions continued until subjects’ delay times stabilized across sessions. We determined stabilization by applying the following criteria to complete sessions (based on Mazur, 1984): (a) neither the largest nor the smallest single-session delay interval could occur in the last five sessions; (b) the mean delay interval across the last five sessions could not be the largest or smallest five-session mean; (c) the mean delay interval of the last five sessions could not differ from the mean of the preceding five sessions by more than 10 % or 1 s (whichever is larger). We, therefore, collected each individual’s specific “indifference point”, that is, the titration point at which an individual was equally likely to choose either the smaller, sooner or larger, later reward.
The caching task was conducted in a separate experimental room, using a cage identical to the subjects’ home cages. We placed a food cup containing 20 pine nuts and a sand-filled ice-cube tray in the cage (Fig. 1b). Ambient white noise masked external sounds.
Prior to caching sessions, the experimenter pre-fed each subject 20 pine nuts to increase its motivation to cache the pine nuts. The experimenter then placed the jay in the caching cage for 10 minutes. Throughout the session, the jay was free to eat or cache the pine nuts. The caching experiment was performed until jays reached criterion in the delay choice experiment. A video camera recorded sessions, and, from an adjacent room, the experimenter observed behavior.
Data collection and analysis
For the operant task, we collected the delay to large reward for each session. From these data, we estimated an indifference point by calculating the mean delay to large reward over the five sessions prior to reaching the stability criteria described above. For caching sessions, we used the final number of caches remaining in the ice-cube tray at the end of the caching session as our measure of caching. We only scored nuts buried more than half-way in the sand as cached. For each subject, we calculated the mean value of this variable across all sessions up until each subject reached stability in the operant task.
We processed and analyzed the data using R statistical software version 3.2.2 (Core Team 2015) and the epicalc (Chongsuvivatwong 2012), foreach (Revolution Analytics & Weston, 2014), lattice (Sarkar, 2008), and latticeExtra (Sarkar and Andrews 2013) packages. Data and R code are available in the Supplementary Materials and are available from the Dryad Digital Repository: http://datadryad.org. Subject means are presented in Tables S1–S4.
Results and discussion
Experiment 2: manipulating caching effects on operant delay choice
To complement Experiment 1’s strictly correlational approach, Experiment 2 tested a potential causal relationship between operant and caching intertemporal choice by attempting to manipulate caching behavior and measuring concomitant choices for delayed rewards in the operant task. Caching species, including pinyon jays (Stotz and Balda 1995), cache substantially more in the autumn and winter compared to other seasons. Changes in photoperiod likely govern this behavior, and experimentally shortening daylight hours increases caching in other bird species (Shettleworth et al. 1995; Clayton and Cristol 1996). We attempted to manipulate caching behavior by altering the photoperiod experienced by our pinyon jays. If intertemporal choice is domain general, we predict that, by making birds cache more, they will also wait longer in the operant delay choice task.
From November 2013 to March 2014, we tested the same 12 subjects from Experiment 1.
Operant delay choice task
Rather than titrate indifference points, we offered subjects repeated choices between one food pellet available immediately and three food pellets available after a time delay corresponding to each subject’s indifference point from Experiment 1. Sessions began with two forced trials, then included 10 free-choice trials with two more forced trials interspersed randomly. We conducted operant sessions five days per week until subjects completed 240 free-choice trials total (one subject completed only 239).
We conducted the same caching task as used in Experiment 1. Subjects received two caching sessions per week for the duration of the experiment.
For this experiment, we randomly assigned six subjects into each of two groups and separated the groups into two different housing rooms. We maintained one group’s photoperiod at 14:10 h (long-day condition) and reduced the amount of daylight in the other group by 15 minutes per day for 16 days, which resulted in a 10:14 h photoperiod (short-day condition). Based on previous work, the short-delay condition should result in more caching than the long-day condition. We then commenced the operant and caching tasks for both groups.
We used the percentage of choices for the larger, later option as our measure of operant choice and the mean number of caches remaining in the ice-cube tray at the end of the session as our measure of caching. We calculated operant choice values over the 240 operant trials and the caching sessions over the same span of days.
Follow-up caching tasks
Since caching and operant choices did not correlate in Experiment 1, we conducted a follow-up caching task from November 2014 to February 2015 to examine the reliability of caching across two different food types: pine nuts and precision pellets used in the operant task. To test whether individuals cache consistently across food types, we offered subjects five sessions to cache 20 pine nuts and five sessions to cache 20 pellets. Subjects were pre-fed 20 pine nuts or pellets prior to beginning this task.
In a second follow-up task conducted in August 2015, we varied whether subjects received food prior to the caching tasks to test whether pre-feeding influenced caching. Subjects received five sessions each of either 20 pine nuts or no food prior to caching pine nuts.
Results and discussion
In the operant delay choice task, subjects chose the larger, later option in 63.7 ± 37.5 % of trials with the long-day photoperiod and 58.2 ± 25.9 % of trials with the short-day photoperiod (Fig. 3b). These means do not reliably differ (difference of 5.5 ± 51.2 %, Glass’s Δ = 0.2), so the photoperiod manipulation did not influence operant delay choices.
In the pre-feeding experiment, subjects cached 1.6 ± 1.3 pine nuts when pre-fed and 3.0 ± 2.8 when not pre-fed. These means do not reliably differ (difference of 1.4 ± 1.8 pine nuts, Glass’s Δ = 0.3), suggesting that pre-feeding does not influence caching behavior.
Experiment 1 tested individual differences in caching and operant intertemporal choice, but these measures did not correlate. Experiment 2 successfully manipulated caching tendencies by altering the photoperiod for the subjects—individuals experiencing a more autumn-like short-day photoperiod cached more often than individuals experiencing a more summer-like long-day photoperiod. This change in caching, however, did not translate to a change in operant delay choices. The lack of a relationship in both experiments was likely not due to inconsistency in caching behavior, as within-subject caching rates correlated across experiments and reward types.
A key difference between the caching and operant tasks was that subjects received no food prior to the operant task but were fed before the caching task. This difference in pre-feeding could alter satiation levels, thereby influencing operant and caching behavior. However, in Experiment 1, subjects actually consumed more than they cached, suggesting that pre-feeding did not satiate the subjects. Further, in a follow-up experiment, subjects cached at comparable levels regardless of whether they were pre-fed. Though future studies should equate satiation levels across tasks, satiation differences do not appear to drive our results.
These results indicate that intertemporal choice is a domain-specific rather than domain-general phenomenon in pinyon jays. The self-control required for caching food does not carry over to other foraging tasks. This may occur because caching is a very specialized behavior. Pinyon jays rely heavily on cached pine nuts as a food source during winter (Marzluff and Balda 1992), with up to 95 % of their food coming from pine nuts (Ligon 1978). Surviving the winter requires recovering food cached during the autumn. The importance of scatter-hoard caching for survival may have selected for sophisticated spatial cognition, as illustrated by excellent performance on spatial memory tasks in a variety of caching species, including pinyon jays (Kamil et al. 1994; Bednekoff et al. 1997).
Given its ecological relevance, it also makes evolutionary sense for decision making to be specialized for caching. If the self-control required for caching carried over into other foraging situations, animals could cache all food instead of consuming some, thereby starving. Research on Western scrub jays (Aphelocoma californica), in fact, suggests that caching and consumption are rather independent motivational systems with complex interactions (Clayton and Dickinson 1999). Further, Thom and Clayton (2014) offered scrub jays choices between caching trays from which they could recover after different delays. Surprisingly, scrub jays neglected differences in time delays when caching. Hence, caching is a special behavior clearly differentiated from other food-based intertemporal choices.
An alternative explanation is that caching taps a different component of self-control than delay choice. Intertemporal choices across different tasks have yielded mixed results. For example, different populations of the same species of capuchin monkey varied in whether their responses in a delay choice task and accumulation task correlated (Addessi et al. 2013). The pinyon jay tasks are similar to the capuchin tasks: Both involve a delay choice task, and the capuchins’ accumulation task is a type of delay maintenance task in which the subject must sustain a choice for a delayed reward during the delay. The pinyon jays’ caching task also requires sustaining the inhibition of consuming the pine nuts during the session. Caching differs from the delay choice task in which subjects make a single choice per trial and are committed to that choice during the delay with no need to sustain their self-control. Like capuchins, choices in these two tasks do not correlate within pinyon jays.
Addessi et al. (2013) suggest that these two tasks tap different components of self-control. They argue that delay maintenance tasks involve rather low-level behavioral inhibition, whereas delay choice tasks involve “higher order processing” of delay length and reward magnitude. This maps on to the findings of Reynolds et al. (2006) in which a principal components analysis categorizes various human impulsivity tasks into “impulsive disinhibition” and “impulsive decision making”. They, too, failed to find correlations in human across delay choice (labeled “discounting”) tasks and inhibitory tasks such as go/no-go tasks or the balloon analogue risk task, which is analogous to a delay maintenance task. Duckworth and Kern (2011) found moderate correlations (r = 0.20−0.23) with different delay choice tasks but only small correlations (r = 0.07−0.14) with executive function (inhibition tasks). Thus, humans also show task-specific performance for self-control.
In summary, the self-control required for pinyon jay caching does not carry over to other food-based intertemporal choices. At least two, non-mutually exclusive explanations may account for this finding. First, caching may require such specialized cognitive and motivational underpinnings that specific decision strategies have evolved for caching situations. The complex interplay between caching and consumption supports this notion. Second, caching involves the constant maintenance of self-control, which differs from the commitment required for delay choice task. Thus, these two tasks may tap different components of self-control. Distinguishing between these two and potentially other explanations requires further work to isolate the cognitive and motivational factors shaping intertemporal choices in humans and other animals.
Standard deviations differed across conditions. Instead of using Cohen’s d to measure effect size, we used Glass’s Δ, which uses the control group’s standard deviation. In all cases, this was the larger standard deviation, thereby providing a more conservative effect size.
This research was funded by a University of Nebraska-Lincoln Faculty Seed Grant to JRS. We would like to thank Jesse Baumann, Shannon Guy, Kristina Lech, and Aotian Yang for assistance in caring for and testing the birds and Alan Bond, Juan Duque, Alan Kamil, and Amy Ort for valuable discussions regarding this work and/or comments on the manuscript. This research was approved by the University of Nebraska-Lincoln Institutional Animal Care and Use Committee (IACUC protocol # 828).
- Addessi, E., Paglieri, F., Beran, M. J., Evans, T. A., Macchitella, L, De Petrillo, F, & Focaroli, V (2013). Delay choice versus delay maintenance: different measures of delayed gratification in capuchin monkeys (Cebus apella). Journal of Comparative Psychology, 127(4), 392–398.Google Scholar
- Chapman, G B (2003). Time discounting of health outcomes. In Loewenstein, G, Read, D, & Baumeister, R F (Eds.) Time and decision: Economic and psychological perspectives on intertemporal choice (pp. 395–418). New York: Russell Sage Foundation.Google Scholar
- Chongsuvivatwong, V. (2012). epicalc: Epidemiological calculator. R package version 22.214.171.124.Google Scholar
- Clayton, N S, & Cristol, D A (1996). Effects of photoperiod on memory and food storing in captive marsh tits, Parus palustris. Animal Behaviour, 52(4), 715–726.Google Scholar
- Marzluff, J. M., & Balda, R. P. (1992). The pinyon jay: Behavioral ecology of a colonial and cooperative corvid. London: A&C Black.Google Scholar
- Mazur, J E (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10(4), 426–436.Google Scholar
- R Development Core Team. (2015). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.Google Scholar
- Revolution Analytics, & Weston, S (2014). foreach: Foreach looping construct for R. R package version 1.4.3.Google Scholar
- Sarkar, D, & Andrews, F (2013). latticeExtra: Extra graphical utilities based on lattice. R package version 0.6-26.Google Scholar
- Stevens, J. R. (2010). Intertemporal choice. In Breed,M. D. & Moore, J. (Eds.), Encyclopedia of animal behavior (Vol. 2, pp. 203–208). Oxford: Academic.Google Scholar
- Stotz, N G, & Balda, R P (1995). Cache and recovery behavior of wild pinyon jays in northern Arizona. Southwestern Naturalist, 40(2), 180–184.Google Scholar
- Vander Wall, S B. (1990). Food hoarding in animals. Chicago: University of Chicago Press.Google Scholar