Rats’ acquisition of the ephemeral reward task
- 274 Downloads
The ephemeral reward task provides a subject with a choice between two alternatives A and B. If it chooses alternative A, reinforcement follows and the trial is over. If it chooses alternative B, reinforcement follows but the subject can also respond to alternative A which is followed by a second reinforcement. Thus, it would be optimal to choose alternative B. Surprisingly, Salwiczek et al. (PLoS One 7:e49068, 2012. doi: 10.1371/journal.pone.00490682012) reported that adult fish (cleaner wrasse) mastered this task within 100 trials, whereas monkeys and apes had great difficulty with it. The authors attributed the species differences to ecological differences in the species foraging experiences. However, Pepperberg and Hartsfield (J Comp Psychol 128:298–306, 2014) found that parrots too learned this task easily. We have found that with a similar task pigeons are not able to learn to choose optimally within 400 trials (Zentall et al. in J Comp Psychol 130:138–144, 2016). In Experiment 1 of the present study, we found that rats did not learn to choose optimally in 840 trials; however, in Experiment 2 we added a prior commitment to the initial choice by increasing delay to reinforcement for the choice response from a single lever press to the first lever press after 20 s (FI20 s). In a comparable amount of training to Experiment 1, the rats learned to choose optimally. Although the use of a prior commitment increases the delay to reinforcement, it appears to reduce impulsive responding which in turn leads to optimal choice.
KeywordsEphemeral choice Ephemeral reward Delay of reinforcement Commitment Rats
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Human and animal rights statement
All procedures performed in studies involving animals were in accordance with the ethical standards of the Institutional Animal Care and Use Committee (IACUC) at the University of Kentucky. The procedures were consistent with the USA and State law.
- Doyle JR (2013) Survey of time preferences, delay discounting models. Judgm Decis Mak 8:116–135Google Scholar
- Salwiczek LH, Prétôt L, Demarta L, Proctor D, Essler J, Pinto AI, Wismer S, Stoinski T, Brosnan SF, Bshary R (2012) Adult cleaner wrasse outperform capuchin monkeys, chimpanzees, and orang-utans in a complex foraging task derived from cleaner-client reef fish cooperation. PLoS ONE 7:e49068. doi: 10.1371/journal.pone.0049068 CrossRefPubMedPubMedCentralGoogle Scholar
- Smith AP, Zentall TR (2016) Suboptimal choice in pigeons: choice is primarily based on the value of the conditioned reinforcer rather than overall reinforcement rate. J Exp Psychol Anim Behav Proc 42:212–220Google Scholar
- Zentall TR, Case JP, Berry JR (2016) Early commitment facilitates optimal choice by pigeons. Psychol Bull Rev. doi: 10.3758/s13423-016-1173-8