Abstract
Endogenous timing uncertainty results in variability in time-based judgments. In many timing tasks, animals need to incorporate their level of endogenous timing uncertainty into their decisions in order to maximize the reward rate. Although animals have been shown to adopt such optimal behavioral strategies in time-based decisions, whether they can optimize their behavior under exogenous noise is an open question. In this study, we tested mice and rats in a task that required them to space their responses for a minimum duration (DRL task) in different task conditions. In one condition, the minimum wait time was fixed, whereas in other conditions minimum wait time was a Gaussian random variable. Although reward maximization entailed waiting longer with added exogenous timing variability, results indicated that both mice and rats became more impulsive and deviated from optimality with increasing levels of exogenous noise. We introduce a reward-rate-dependent sampling function to SET to account for optimal performance in noiseless and suboptimal performance in noisy environments.
Similar content being viewed by others
References
Akdogan B, Balcı F (2016) Stimulus probability effects on temporal bisection performance of mice (Mus musculus). Anim Cogn 19:15–30. doi:10.1007/s10071-015-0909-6
Bach ME, Barad M, Son H, Zhuo M, Lu YF, Shih R, Mansuy I, Hawkins RD, Kandel ER (1999) Age-related defects in spatial memory are correlated with defects in the late phase of hippocampal long-term potentiation in vitro and are attenuated by drugs that enhance the cAMP signaling pathway. Proc Natl Acad Sci USA 96(9):5280–5285. doi:10.1073/pnas.96.9.5280
Balcı F, Simen P (2016) A decision model of timing. Curr Opin Behav Sci 8:94–101. doi:10.1016/j.cobeha.2016.02.002
Balcı F, Freestone D, Gallistel CR (2009) Risk assessment in man and mouse. Proc Natl Acad Sci USA 106:2459–2463. doi:10.1073/pnas.0812709106
Balcı F, Freestone D, Simen P, deSouza L, Cohen JD, Holmes P (2011) Optimal temporal risk assessment. Front Integr Neurosci 5:1–15. doi:10.3389/fnint.2011.00056
Bernabeu R, Bevilaqua L, Ardenghi P, Bromberg E, Schmitz P, Bianchin M, Izquierdo I, Medina JH (1997) Involvement of hippocampal cAMP/cAMP-dependent protein kinase signaling pathways in a late memory consolidation phase of aversively motivated learning in rats. Proc Natl Acad Sci USA 94:7041–7046. doi:10.1073/pnas.94.13.7041
Buhusi CV, Meck WH (2005) What makes us tick? Functional and neural mechanisms of interval timing. Nat Rev Neurosci 6(10):755–765. doi:10.1038/nrn1764
Çavdaroğlu B, Zeki M, Balcı F (2014) Time-based reward maximization. Philos Trans R Soc B Biol Sci 369:20120461. doi:10.1098/rstb.2012.0461
Cerutti DT, Staddon JER (2004) Immediacy versus anticipated delay in the time-left experiment: a test of the cognitive hypothesis. J Exp Psychol Anim Behav Process 30(1):45–57. doi:10.1037/0097-7403.30.1.45
Çoşkun F, Sayalı ZC, Gürbüz E, Balcı F (2015) Optimal time discrimination. Q J Exp Psychol 68(2):381–401. doi:10.1080/17470218.2014.944921
Donahoe JW, Palmer DC (1994) Selection in the experienced learner. In: Dorsel VP (ed) Learning and complex behavior. Allyn & Bacon, Boston, pp 112–113
Freestone DM, Church RM (2016) Optimal timing. Curr Opin Behav Sci 8:276–281
Freestone DM, Balcı F, Simen P, Church RM (2015) Optimal response rates in humans and rats. J Exp Psychol Anim Learn Cogn 41(1):39–51. doi:10.1037/xan0000049
Gallistel CR, Gibbon J (2000) Time, rate, and conditioning. Psychol Rev 107(2):289–344. doi:10.1037//0033-295X.107.2.289
Gasbarri A, Packard MG, Campana E, Pacitti C (1994) Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res Bull 33(4):445–452. doi:10.1016/0361-9230(94)90288-7
Gibbon J (1977) Scalar expectancy theory and Weber's law in animal timing. Psychol Rev 84(3):279–325. doi:10.1037/0033-295X.84.3.279
Gibbon J, Church RM (1981) Time left: linear versus logarithmic subjective time. J Exp Psychol Anim Behav Process 7(2):87–108. doi:10.1037//0097-7403.7.2.87
Gibbon J, Church RM (1992) Comparison of variance and covariance patterns in parallel and serial theories of timing. J Exp Anal Behav 57:393–406. doi:10.1901/jeab.1992.57-393
Gibbon J, Church RM, Meck WH (1984) Scalar timing in memory. Ann N Y Acad Sci 423:52–77
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6(2):65–70. doi:10.2307/4615733
Hudson TE, Maloney LT, Landy MS (2008) Optimal compensation for temporal uncertainty in movement planning. PLoS Comput Biol 4(7):e1000130. doi:10.1371/journal.pcbi.1000130
Jazayeri M, Shadlen MN (2010) Temporal context calibrates interval timing. Nat Neurosci 13(8):1020–1026. doi:10.1038/nn.2590
Killeen PR, Fetterman JG, Bizo LA (1997) Time's causes. Adv Psychol 120:79–132 (Amsterdam)
Kobayashi S, Schultz W (2008) Influence of reward delays on responses of dopamine neurons. J Neurosci 28(31):7837–7846
Lisman JE, Grace AA (2005) The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46(5):703–713. doi:10.1016/j.neuron.2005.05.002
Matell MS, Meck WH (2004) Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Brain Res Cogn Brain Res 21(2):139–170. doi:10.1016/j.cogbrainres.2004.06.012
Mita A, Mushiake H, Shima K, Matsuzaka Y, Tanji J (2009) Interval time coding by neurons in the presupplementary and supplementary motor areas. Nat Neurosci 12(4):502–507. doi:10.1038/nn.2272
Shohamy D, Adcock RA (2010) Dopamine and adaptive memory. Trends Cogn Sci 14(10):464–472. doi:10.1016/j.tics.2010.08.002
Simen P, Balcı F, Cohen JD, Holmes P (2011) A model of interval timing by neural integration. J Neurosci 31(25):9238–9253. doi:10.1523/JNEUROSCI.3121-10.2011
Simen P, Rivest F, Ludvig EA, Balcı F, Killeen P (2013) Timescale invariance in the pacemaker-accumulator family of timing models. Timing Time Percept 1(2):159–188. doi:10.1163/22134468-00002018
Tosun T, Gür E, Balcı F (2016) Mice plan decision strategies based on previously learned time intervals, locations, and probabilities. Proc Natl Acad Sci USA 113(3):787–792. doi:10.1073/pnas.1518316113
Acknowledgments
We would like to thank Filiz Çoşkun for her help in data collection.
Funding
The mouse experiment was supported by the Scientific and Technological Research Council of Turkey (TÜBİTAK 1001 Grant No 111K402).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All applicable international, national, and/or institutional guidelines for the care and use of animals were followed.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Berkay, D., Freestone, D. & Balcı, F. Mice and rats fail to integrate exogenous timing noise into their time-based decisions. Anim Cogn 19, 1215–1225 (2016). https://doi.org/10.1007/s10071-016-1033-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10071-016-1033-y