Psychopharmacology

, Volume 235, Issue 3, pp 607–626 | Cite as

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

Review
First Online:
Received:
Accepted:

Abstract

Rationale

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

Objectives

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

Results

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

Conclusions

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Keywords

Delay discounting Impulsive choice Sensitivity to delayed reinforcement Quantitative analyses 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

The author would like to thank Dr. Joshua Beckmann for providing valuable insights on some of the issues discussed in this paper, as well as for introducing him to nonlinear mixed effects modeling. The author would also like to thank Dr. Mark Bardgett for providing feedback on a draft of the manuscript.

Funding information

The current study was supported by NIGMS grant 8P20GM103436-14.

References

  1. Acheson A, Farrar AM, Patak M, Hausknecht KA, Kieres AK, Choi S, de Wit H, Richards JB (2006) Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement. Behav Brain Res 173(2):217–228.  https://doi.org/10.1016/j.bbr.2006.06.024 PubMedPubMedCentralCrossRefGoogle Scholar
  2. Adriani W, Rea M, Baviera M, Invernizzi W, Carli M, Ghirardi O, Caprioli A, Laviola G (2004) Acetyl-L-carnitine reduces impulsive behaviour in adolescent rats. Psychopharmacology 176(3-4):296–304.  https://doi.org/10.1007/s00213-004-1892-9 PubMedCrossRefGoogle Scholar
  3. Ahn WY, Rass O, Fridberg DJ, Bishara AJ, Forsyth JK, Breier A, Busemeyer JR, Hetrick WP, Bolbecker AR, O’Donnell BF (2011) Temporal discounting of rewards in patients with bipolar disorder and schizophrenia. J Abnorm Psychol 120(4):911–921.  https://doi.org/10.1037/a0023333 PubMedPubMedCentralCrossRefGoogle Scholar
  4. Ainslie GW (1974) Impulse control in pigeons. J Exp Anal Behav 21(3):485–489.  https://doi.org/10.1901/jeab.1974.21-485 PubMedPubMedCentralCrossRefGoogle Scholar
  5. Ainslie GW (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82(4):463–492.  https://doi.org/10.1037/h0076860 PubMedCrossRefGoogle Scholar
  6. Albein-Urios N, Martinez-González JM, Lozano O, Verdejo-Garcia A (2014) Monetary delay discounting in gambling and cocaine dependence with personality comorbidities. Addict Behav 39(11):1658–1662.  https://doi.org/10.1016/j.addbeh.2014.06.001 PubMedCrossRefGoogle Scholar
  7. Al-Khaled M, Heldmann M, Bolstorff I, Hagenah J, Münte TF (2015) Intertemporal choice in Parkinson’s disease and restless legs syndrome. Parkinsonism Relat Disord 21(11):1330–1335.  https://doi.org/10.1016/j.parkreldis.2015.09.026 PubMedCrossRefGoogle Scholar
  8. Anderson KG, Woolverton WL (2005) Effects of clomipramine on self-control choice in Lewis and Fischer 344 rats. Pharmacol Biochem Behav 80(3):387–393.  https://doi.org/10.1016/j.pbb.2004.11.015 PubMedPubMedCentralCrossRefGoogle Scholar
  9. Anker JJ, Perry JL, Gliddon LA, Carroll ME (2009) Impulsivity predicts the escalation of cocaine self-administration in rats. Pharmacol Biochem Behav 93(3):343–348.  https://doi.org/10.1016/j.pbb.2009.05.013 PubMedPubMedCentralCrossRefGoogle Scholar
  10. Antrop I, Stock P, Verte S, Wiersema JR, Baeyens D, Roeyers H (2006) ADHD and delay aversion: the influence of non-temporal stimulation on choice for delayed rewards. J Child Psychol Psychiatry 47(11):1152–1158.  https://doi.org/10.1111/j.1469-7610.2006.01619.x PubMedCrossRefGoogle Scholar
  11. Aparicio CF, Elcoro M, Alonso-Alvarez B (2015) A long-term study of the impulsive choices of Lewis and Fischer 344 rats. Learn Behav 43(3):251–271.  https://doi.org/10.3758/s13420-015-0177-y PubMedCrossRefGoogle Scholar
  12. AparicioCF, HenniganPJ, MulliganLJ, Alonso-AlvarezB (in press) Spontaneously hypertensive (SHR) rats choose more impulsively than Wistar-Kyoto (WKY) rats on a delay discounting task. Behav Brain ResGoogle Scholar
  13. Aparicio CF, Hughes CE, Pitts RC (2013) Impulsive choice in Lewis and Fischer 344 rats: effects of extended training. Conductual 1:22–46Google Scholar
  14. Baarendse PJJ, Vanderschuren LJMJ (2012) Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology 219(2):313–326.  https://doi.org/10.1007/s00213-011-2576-x PubMedCrossRefGoogle Scholar
  15. Barbelivien A, Billy E, Lazarus C, Kelche C, Majchrzak M (2008) Rats with different profiles of impulsive choice behavior exhibit differences in responses to caffeine and d-amphetamine and in medial prefrontal cortex 5-HT utilization. Behav Brain Res 187(2):273–283.  https://doi.org/10.1016/j.bbr.2007.09.020 PubMedCrossRefGoogle Scholar
  16. Baum WM (1974) On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav 22(1):231–242.  https://doi.org/10.1901/jeab.1974.22-231 PubMedPubMedCentralCrossRefGoogle Scholar
  17. Baum WM, Rachlin HC (1969) Choice as time allocation. J Exp Anal Behav 12(6):861–874.  https://doi.org/10.1901/jeab.1969.12-861 PubMedPubMedCentralCrossRefGoogle Scholar
  18. Beeby E, White KG (2013) Preference reversal between impulsive and self-control choice. J Exp Anal Behav 99(3):260–276.  https://doi.org/10.1002/jeab.23 PubMedCrossRefGoogle Scholar
  19. Bezzina G, Cheung THC, Asgari K, Hampson CL, Body S, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2007) Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis. Psychopharmacology 195(1):71–84.  https://doi.org/10.1007/s00213-007-0882-0 PubMedPubMedCentralCrossRefGoogle Scholar
  20. Bezzina G, Cheung THC, Body S, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2009) Quantitative analysis of the effect of lesions of the subthalamic nucleus on intertemporal choice: further evidence for enhancement of the incentive value of food reinforcers. Behav Pharmacol 20(5-6):437–446.  https://doi.org/10.1097/FBP.0b013e3283305e4d PubMedPubMedCentralCrossRefGoogle Scholar
  21. Bickel WK, Odum AL, Madden GJ (1999) Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology 146(4):447–454.  https://doi.org/10.1007/PL00005490 PubMedCrossRefGoogle Scholar
  22. Bitsakou P, Psychogiou L, Thompson M, Sonuga-Barke EJ (2009) Delay aversion in attention deficit/hyperactivity disorder: an empirical investigation of the broader phenotype. Neuropsychologia 47(2):446–456.  https://doi.org/10.1016/j.neuropsychologia.2008.09.015 PubMedCrossRefGoogle Scholar
  23. Bizot J, Le Bihan C, Puech AJ, Hamon M, Thiébot M (1999) Serotonin and tolerance to delay of reward in rats. Psychopharmacology 146(4):400–412.  https://doi.org/10.1007/PL00005485 PubMedCrossRefGoogle Scholar
  24. Blanchard TC, Pearson JM, Hayden BY (2013) Postreward delays and systematic biases in measures of animal temporal discounting. Proc Natl Acad Sci U S A 110(38):15491–15496.  https://doi.org/10.1073/pnas.1310446110 PubMedPubMedCentralCrossRefGoogle Scholar
  25. Blasio A, Narayan AR, Kaminski BJ, Steardo L, Sabino V, Cottone P (2012) A modified adjusting delay task to assess impulsive choice between isocaloric reinforcers in non-deprived male rats: effects of 5-HT2A/C and 5-HT1A receptor agonists. Psychopharmacology 219(2):377–386.  https://doi.org/10.1007/s00213-011-2517-8 PubMedCrossRefGoogle Scholar
  26. Body S, Bradshaw CM, Szabadi E (2017) Delay reinforcement: neuroscience. In: Stein J (ed) Reference module in neuroscience and biobehavioral psychology. Elsevier.  https://doi.org/10.1016/B978-0-12-809324-5.02713-9
  27. Boomhower SR, Rasmussen EB (2014) Haloperidol and rimonabant increase delay discounting in rats fed high-fat and standard-chow diets. Behav Pharmacol 25(8):705–716.  https://doi.org/10.1097/FBP.0000000000000058 PubMedPubMedCentralCrossRefGoogle Scholar
  28. Borges AM, Kuang J, Milhorn H, Yi R (2016) An alternative approach to calculating Area-Under-the-Curve (AUC) in delay discounting research. J Exp Anal Behav 106(2):145–155.  https://doi.org/10.1002/jeab.219 PubMedCrossRefGoogle Scholar
  29. Bradshaw CM (2015) Inter-temporal choice. In: Price LH, Stolerman IP (eds) Encyclopedia of psychopharmacology, 2nd edn. Springer-Verlag, Berlin Heidelberg, pp 829–834Google Scholar
  30. Broos N, Schmaal L, Wiskerke J, Kostelijk L, Lam T, Stoop N, Weierink L, Ham J, de Geus EJ, Schoffelmeer AN, van den Brink W, Veltman DJ, de Vries TJ, Pattij T, Goudriaan AE (2012) The relationship between impulsive choice and impulsive action: a cross-species translational study. PLoS One 7(5):e36781.  https://doi.org/10.1371/journal.pone.0036781 PubMedPubMedCentralCrossRefGoogle Scholar
  31. Calvert AL, Green L, Myerson J (2010) Delay discounting of qualitatively different reinforcers in rats. J Exp Anal Behav 93(2):171–184.  https://doi.org/10.1901/jeab.2010.93-171 PubMedPubMedCentralCrossRefGoogle Scholar
  32. Cardinal RN (2006) Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw 19(8):1277–1301.  https://doi.org/10.1016/j.neunet.2006.03.004 PubMedCrossRefGoogle Scholar
  33. Cardinal RN, Daw N, Robbins TW, Everitt BJ (2002) Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement. Neural Netw 15(4-6):617–634.  https://doi.org/10.1016/S0893-6080(02)00053-9 PubMedCrossRefGoogle Scholar
  34. Cardinal RN, Robbins TW, Everitt BJ (2000) The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology 152(4):362–375.  https://doi.org/10.1007/s002130000536 PubMedCrossRefGoogle Scholar
  35. Coffey SF, Gudleski GD, Saladin ME, Brady KT (2003) Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp Clin. Psychopharmacology 11:18–25Google Scholar
  36. Cosenza M, Nigro G (2015) Wagering the future: cognitive distortions, impulsivity, delay discounting, and time perspective in adolescent gambling. J Adolesc 45:56–66.  https://doi.org/10.1016/j.adolescence.2015.08.015 PubMedCrossRefGoogle Scholar
  37. Cottone P, Iemolo A, Narayan AR, Kwak J, Momaney D, Sabino V (2013) The uncompetitive NMDA receptor antagonists ketamine and memantine preferentially increase the choice for a small, immediate reward in low-impulsive rats. Psychopharmacology 226(1):127–138.  https://doi.org/10.1007/s00213-012-2898-3 PubMedCrossRefGoogle Scholar
  38. Craig AR, Maxfield AD, Stein JS, Renda CR, Madden GJ (2014) Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting? Behav Pharmacol 25(4):306–315.  https://doi.org/10.1097/FBP.0000000000000055 PubMedPubMedCentralCrossRefGoogle Scholar
  39. da Costa Araújo S, Body S, Hampson CL, Langley RW, Deakin JF, Anderson IM, Bradshaw CM, Szabadi E (2009) Effects of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting-delay procedure. Behav Brain Res 202(2):272–277.  https://doi.org/10.1016/j.bbr.2009.04.003 PubMedCrossRefGoogle Scholar
  40. Dalley JW, Mar AC, Economidou D, Robbins TW (2008) Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 90(2):250–260.  https://doi.org/10.1016/j.pbb.2007.12.021 PubMedCrossRefGoogle Scholar
  41. Darna M, Chow JJ, Yates JR, Charnigo RJ, Beckmann JS, Bardo MT, Dwoskin LP (2015) Role of serotonin transporter function in rat orbitofrontal cortex in impulsive choice. Behav Brain Res 293:134–142.  https://doi.org/10.1016/j.bbr.2015.07.025 PubMedPubMedCentralCrossRefGoogle Scholar
  42. Eppolito AK, France CP, Gerak LR (2011) Effects of acute and chronic flunitrazepam on delay discounting in pigeons. J Exp Anal Behav 95(2):163–174.  https://doi.org/10.1901/jeab.2011.95-163 PubMedPubMedCentralCrossRefGoogle Scholar
  43. Eubig PA, Noe TE, Floresco SB, Sable JJ, Schantz SL (2014) Sex differences in response to amphetamine in adult Long-Evans rats performing a delay-discounting task. Pharmacol Biochem Behav 118:1–9.  https://doi.org/10.1016/j.pbb.2013.12.021 PubMedCrossRefGoogle Scholar
  44. Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128(2):161–170.  https://doi.org/10.1007/s002130050121 PubMedCrossRefGoogle Scholar
  45. Evenden JL, Ryan CN (1999) The pharmacology of impulsive behaviour in rats VI: the effects of ethanol and selective serotonergic drugs on response choice with varying delays of reinforcement. Psychopharmacology 146(4):413–421.  https://doi.org/10.1007/PL00005486 PubMedCrossRefGoogle Scholar
  46. Evens R, Stankevich Y, Dshemuchadse M, Storch A, Wolz M, Reichmann H, Schlaepfer TE, Goschke T, Lueken U (2015) The impact of Parkinson’s disease and subthalamic deep brain stimulation on reward processing. Neuropsychologia 75:11–19.  https://doi.org/10.1016/j.neuropsychologia.2015.05.005 PubMedCrossRefGoogle Scholar
  47. Field M, Christiansen P, Cole J, Goudie A (2007) Delay discounting and the alcohol Stroop in heavy drinking adolescents. Addiction 102(4):579–586.  https://doi.org/10.1111/j.1360-0443.2007.01743.x PubMedCrossRefGoogle Scholar
  48. Floresco SB, Tse MT, Ghods-Sharifi S (2008) Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 33(8):1966–1979.  https://doi.org/10.1038/sj.npp.1301565 PubMedCrossRefGoogle Scholar
  49. Fox AT, Hand DJ, Reilly MP (2008) Impulsive choice in a rodent model of attention-deficit/hyperactivity disorder. Behav Brain Res 187(1):146–152.  https://doi.org/10.1016/j.bbr.2007.09.008 PubMedCrossRefGoogle Scholar
  50. Garciá-Lecumberri C, Torres I, Martín S, Crespo JA, Miguéns M, Nicanor C, Higuera-Matas A, Ambrosio E (2011) Strain differences in the dose-response relationship for morphine self-administration and impulsive choice between Lewis and Fischer 344 rats. J Psychopharmacol 25(6):783–791.  https://doi.org/10.1177/0269881110367444 PubMedCrossRefGoogle Scholar
  51. Gipson CD, Bardo MT (2009) Extended access to amphetamine self-administration increases impulsive choice in a delay discounting task in rats. Psychopharmacology 207(3):391–400.  https://doi.org/10.1007/s00213-009-1667-4 PubMedPubMedCentralCrossRefGoogle Scholar
  52. Grace RC (2002) Acquisition of preference in concurrent chains: comparing linear-operator and memory-representational models. J Exp Psychol Anim Behav Process 28(3):257–276.  https://doi.org/10.1037/0097-7403.28.3.257 PubMedCrossRefGoogle Scholar
  53. Green L, Fry AF, Myerson J (1994) Discounting of delayed rewards: a life-span comparison. Psychol. Science 5:33–36Google Scholar
  54. Green L, Myerson J (2004) A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130(5):769–792.  https://doi.org/10.1037/0033-2909.130.5.769 PubMedPubMedCentralCrossRefGoogle Scholar
  55. Green L, Myerson J, Shah AK, Estle SJ, Holt DD (2007) Do adjusting-amount and adjusting-delay procedures produce equivalent estimates of subjective value in pigeons? J Exp Anal Behav 87(3):337–347.  https://doi.org/10.1901/jeab.2007.37-06 PubMedPubMedCentralCrossRefGoogle Scholar
  56. Hand DJ, Fox AT, Reilly MP (2009) Differential effects of d-amphetamine on impulsive choice in spontaneously hypertensive and Wistar-Kyoto rats. Behav Pharmacol 20(5-6):549–553.  https://doi.org/10.1097/FBP.0b013e3283305ee1 PubMedCrossRefGoogle Scholar
  57. Heerey EA, Robinson BM, McMahon RP, Gold JM (2007) Delay discounting in schizophrenia. Cogn Neuropsychiatry 12(3):213–221.  https://doi.org/10.1080/13546800601005900 PubMedPubMedCentralCrossRefGoogle Scholar
  58. Heil SH, Johnson MW, Higgins ST, Bickel WK (2006) Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addict Behav 31(7):1290–1294.  https://doi.org/10.1016/j.addbeh.2005.09.005 PubMedCrossRefGoogle Scholar
  59. Hellemans KG, Nobrega JN, Olmstead MC (2005) Early environmental experience alters baseline and ethanol-induced cognitive impulsivity: relationship to forebrain 5-HT1A receptor binding. Behav Brain Res 159(2):207–220.  https://doi.org/10.1016/j.bbr.2004.10.018 PubMedCrossRefGoogle Scholar
  60. Helms CM, Reeves JM, Mitchell SH (2006) Impact of strain and D-amphetamine on impulsivity (delay discounting) in inbred mice. Psychopharmacology 188(2):144–151.  https://doi.org/10.1007/s00213-006-0478-0 PubMedCrossRefGoogle Scholar
  61. Hernandez G, Oleson EB, Gentry RN, Abbas Z, Bernstein DL, Arvanitogiannis A, Cheer JF (2014) Endocannabinoids promote cocaine-induced impulsivity and its rapid dopaminergic correlates. Biol Psychiatry 75(6):487–498.  https://doi.org/10.1016/j.biopsych.2013.09.005 PubMedCrossRefGoogle Scholar
  62. Herrnstein RJ (1961) Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4(3):267–272.  https://doi.org/10.1901/jeab.1961.4-267 PubMedPubMedCentralCrossRefGoogle Scholar
  63. Higgins GA, Silenieks LB, MacMillan C, Sevo J, Zeeb FD, Thevarkunnel S (2016) Enhanced attention and impulsive action following NMDA receptor GluN2B-selective antagonist pretreatment. Behav Brain Res 311:1–14.  https://doi.org/10.1016/j.bbr.2016.05.025 PubMedCrossRefGoogle Scholar
  64. Ho M-Y, Mobini S, Chiang T-J, Bradshaw CM, Szabadi E (1999) Theory and method in the quantitative analysis of “impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology 146(4):362–372.  https://doi.org/10.1007/PL00005482 PubMedCrossRefGoogle Scholar
  65. Hoffman WF, Moore M, Templin R, McFarland B, Hitzemann RJ, Mitchell SH (2006) Neuropsychological function and delay discounting in methamphetamine-dependent individuals. Psychopharmacology 188(2):162–170.  https://doi.org/10.1007/s00213-006-0494-0 PubMedCrossRefGoogle Scholar
  66. Holcomb ME, Gould TD, Grahame NJ (2013) Lithium, but not valproate, reduces impulsive choice in the delay-discounting task in mice. Neuropsychopharmacology 38(10):1937–1944.  https://doi.org/10.1038/npp.2013.89 CrossRefGoogle Scholar
  67. Huskinson SL, Anderson KG (2013) Effects of different fixed-ratio requirements on delay discounting in rats. Behav Process 100:18–22.  https://doi.org/10.1016/j.beproc.2013.07.013 CrossRefGoogle Scholar
  68. Huskinson SL, Krebs CA, Anderson KG (2012) Strain differences in delay discounting between Lewis and Fischer 344 rats at baseline and following acute and chronic administration of d-amphetamine. Pharmacol Biochem Behav 101(3):403–416.  https://doi.org/10.1016/j.pbb.2012.02.005 PubMedPubMedCentralCrossRefGoogle Scholar
  69. Isherwood SN, Pekcec A, Nicholson JR, Robbins TW, Dalley JW (2015) Dissociable effects of mGluR5 allosteric modulation on distinct forms of impulsivity in rats: interaction with NMDA receptor antagonism. Psychopharmacology 232(18):3327–3344.  https://doi.org/10.1007/s00213-015-3984-0 PubMedCrossRefGoogle Scholar
  70. Isherwood SN, Robbins TW, Nicholson JR, Dalley JW, Pekcec A (2017) Selective and interactive effects of D2 receptor antagonism and positive allosteric mGluR4 modulation on waiting impulsivity. Neuropharmacology 123:249–260.  https://doi.org/10.1016/j.neuropharm.2017.05.006 PubMedPubMedCentralCrossRefGoogle Scholar
  71. Johnson PS, Stein JS, Smits RR, Madden GJ (2013) Pramipexole-induced disruption of behavioral processes fundamental to intertemporal choice. J Exp Anal Behav 99(3):290–317.  https://doi.org/10.1002/jeab.21 PubMedPubMedCentralCrossRefGoogle Scholar
  72. Jonsson EN, Wade JR, Karlsson MO (2000) Nonlinearity detection: advantages of nonlinear mixed-effects modeling. AAPS PharmSci 2:E32PubMedCrossRefGoogle Scholar
  73. Kayir H, Semenova S, Markou A (2014) Baseline impulsive choice predicts the effects of nicotine and nicotine withdrawal on impulsivity in rats. Prog Neuropsychchopharmacol Biol Psychiatry 48:6–13CrossRefGoogle Scholar
  74. Kheramin S, Body S, Mobini S, Ho M-Y, Velázquez-Martinez BCM, Szabadi E, Deakin JFW, Anderson IM (2002) Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology 165(1):9–17.  https://doi.org/10.1007/s00213-002-1228-6 PubMedCrossRefGoogle Scholar
  75. Kieres AK, Hausknecht KA, Farrar AM, Acheson A, de Wit H, Richards JB (2004) Effects of morphine and naltrexone on impulsive decision making in rats. Psychopharmacology 173(1-2):167–174.  https://doi.org/10.1007/s00213-003-1697-2 PubMedCrossRefGoogle Scholar
  76. Killeen PR (2009) An additive-utility model of delay discounting. Psychol Rev 116(3):602–619.  https://doi.org/10.1037/a0016414 PubMedCrossRefGoogle Scholar
  77. Killeen PR (2011) Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid. Behav Process 87(1):57–63.  https://doi.org/10.1016/j.beproc.2010.12.016 CrossRefGoogle Scholar
  78. Kirby KN, Petry NM, Bickel WK (1999) Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. J Exp Psychol Gen 128(1):78–87.  https://doi.org/10.1037/0096-3445.128.1.78 PubMedCrossRefGoogle Scholar
  79. Koffarnus MN, Newman AH, Grundt P, Rice KC, Woods JH (2011) Effects of selective dopaminergic compounds on a delay-discounting task. Behav Pharmacol 22(4):300–311.  https://doi.org/10.1097/FBP.0b013e3283473bcb PubMedPubMedCentralCrossRefGoogle Scholar
  80. Kollins SH (2003) Delay discounting is associated with substance use in college students. Addict Behav 28(6):1167–1173.  https://doi.org/10.1016/S0306-4603(02)00220-4 PubMedCrossRefGoogle Scholar
  81. Korte SM, Prins J, van den Bergh FS, Oosting RS, Dupree R, Korte-Bouws GA, Westphal KG, Olivier B, Denys DA, Garland A, Güntürkün O (2017) The 5-HT1A/1B-receptor agonist eltoprazine increase both catecholamine release in the prefrontal cortex and dopamine release in the nucleus accumbens and decreases motivation for reward and “waiting” impulsivity, but increases “stopping” impulsivity. Eur J Pharmacol 794:257–269.  https://doi.org/10.1016/j.ejphar.2016.11.024 PubMedCrossRefGoogle Scholar
  82. Krebs CA, Anderson KG (2012) Preference reversals and effects of D-amphetamine on delay discounting in rats. Behav Pharmacol 23(3):228–240.  https://doi.org/10.1097/FBP.0b013e32835342ed PubMedCrossRefGoogle Scholar
  83. Krebs CA, Reilly WJ, Anderson KG (2016) Reinforcer magnitude affects delay discounting and influences effects of d-amphetamine in rats. Behav Process 130:39–45.  https://doi.org/10.1016/j.beproc.2016.07.004 CrossRefGoogle Scholar
  84. Kuntsi J, Oosterlaan J, Stevenson J (2001) Psychological mechanisms in hyperactivity: I. Response inhibition deficit, working memory impairment, delay aversion, or something else? J Child Psychol Psychiatry 42(2):199–210.  https://doi.org/10.1111/1469-7610.00711 PubMedCrossRefGoogle Scholar
  85. Liu YP, Wilkinson LS, Robbins TW (2004) Effects of acute and chronic buspirone on impulsive choice and efflux of 5-HT and dopamine in hippocampus, nucleus accumbens and prefrontal cortex. Psychopharmacology 173(1-2):175–185.  https://doi.org/10.1007/s00213-003-1726-1 PubMedCrossRefGoogle Scholar
  86. Liu YP, Wilkinson LS, Robbins TW (2017) Waiting impulsivity’ in isolation-reared and socially-reared rats: effects of amphetamine. Psychopharmacology 234(9-10):1587–1601.  https://doi.org/10.1007/s00213-017-4579-8 PubMedPubMedCentralCrossRefGoogle Scholar
  87. Loos M, Pattij T, Janssen MC, Counotte DS, Schoffelmeer AN, Smit AB, Spijker S, van Gaalen MM (2010) Dopamine receptor D1/D5 gene expression in the medial prefrontal cortex predicts impulsive choice in rats. Cereb Cortex 20(5):1064–1070.  https://doi.org/10.1093/cercor/bhp167 PubMedCrossRefGoogle Scholar
  88. Lowenstein G, Thaler RH (1989) Anomalies: intertemporal choice. J Econ Perspect 3(4):181–193.  https://doi.org/10.1257/jep.3.4.181 CrossRefGoogle Scholar
  89. Madden GJ, Johnson PS (2010) A delay-discounting primer. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, DC, pp 11–37.  https://doi.org/10.1037/12069-001 CrossRefGoogle Scholar
  90. Madden GJ, Johnson PS, Brewer AT, Pinkston JW, Fowler SC (2010) Effects of pramipexole on impulsive choice in male wistar rats. Exp Clin Psychopharmacol 18(3):267–276.  https://doi.org/10.1037/a0019244 PubMedPubMedCentralCrossRefGoogle Scholar
  91. Madden GJ, Petry NM, Badger GJ, Bickel WK (1997) Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Exp Clin Psychopharmacol 5(3):256–262.  https://doi.org/10.1037/1064-1297.5.3.256 PubMedCrossRefGoogle Scholar
  92. Maguire DR, Henson C, France CP (2014) Effects of amphetamine on delay discounting in rats depend on the manner in which delay is varied. Neuropharmacology 87:173–179.  https://doi.org/10.1016/j.neuropharm.2014.04.012 PubMedPubMedCentralCrossRefGoogle Scholar
  93. Marco R, Miranda A, Schlotz W, Melia A, Mulligan A, Müller U, Andreou P, Butler L, Christinasen H, Gabriels I, Medad S, Albrecht B, Uebel H, Asherson P, Banaschewski T, Gill M, Kuntsi J, Mulas F, Oades R, Roeyers H, Steinhausen HC, Rothenberger A, Faraone SV, Sonuga-Barke EJ (2009) Delay and reward choice in ADHD: an experimental test of the role of delay aversion. Neuropsychology 23(3):367–380.  https://doi.org/10.1037/a0014914 PubMedCrossRefGoogle Scholar
  94. Marusich JA, Bardo MT (2009) Differences in impulsivity on a delay-discounting task predict self-administration of a low unit dose of methylphenidate in rats. Behav Pharmacol 20(5-6):447–454.  https://doi.org/10.1097/FBP.0b013e328330ad6d PubMedPubMedCentralCrossRefGoogle Scholar
  95. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H (eds) Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value. Erlbaum, Hillsdale, pp 53–73Google Scholar
  96. Mazur JE (2007) Rats’ choices between one and two delayed reinforcers. Learn Behav 35(3):169–176.  https://doi.org/10.3758/BF03193052 PubMedPubMedCentralCrossRefGoogle Scholar
  97. Mazur JE, Biondi DR (2009) Delay-amount tradeoffs in choices by pigeons and rats: hyperbolic versus exponential discounting. J Exp Anal Behav 91(2):197–211.  https://doi.org/10.1901/jeab.2009.91-197 PubMedPubMedCentralCrossRefGoogle Scholar
  98. Mejia-Toiber K, Boutros N, Markou A, Semenova S (2014) Impulsive choice and anxiety-like behavior in adult rats exposed to chronic intermittent ethanol during adolescence and adulthood. Behav Brain Res 266:19–28.  https://doi.org/10.1016/j.bbr.2014.02.019 PubMedPubMedCentralCrossRefGoogle Scholar
  99. Mendez IA, Simon NW, Hart N, Mitchell MR, Nation JR, Wellman PJ, Setlow B (2010) Self-administered cocaine causes long-lasting increases in impulsive choice in a delay discounting task. Behav Neurosci 124(4):470–477.  https://doi.org/10.1037/a0020458 PubMedPubMedCentralCrossRefGoogle Scholar
  100. Mendez IA, Gilbert RJ, Bizon JL, Setlow B (2012) Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats. Psychopharmacology 224(4):489–499.  https://doi.org/10.1007/s00213-012-2777-y PubMedPubMedCentralCrossRefGoogle Scholar
  101. Mitchell MR, Weiss VG, Ouimet DJ, Fuchs RA, Morgan D, Setlow B (2014) Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task. Behav Neurosci 128(4):419–429.  https://doi.org/10.1037/a0036742 PubMedPubMedCentralCrossRefGoogle Scholar
  102. Mitchell SH (1999) Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology 146(4):455–464.  https://doi.org/10.1007/PL00005491 PubMedCrossRefGoogle Scholar
  103. Mitchell SH, Rosenthall AJ (2003) Effects of multiple delayed rewards on delay discounting in an adjusting amount procedure. Behav Process 64(3):273–286.  https://doi.org/10.1016/S0376-6357(03)00144-X CrossRefGoogle Scholar
  104. Mitchell SH, Wilson VB, Karalunas SL (2015) Comparing hyperbolic, delay-amount sensitivity and present-bias models of delay discounting. Behav Process 114:52–62.  https://doi.org/10.1016/j.beproc.2015.03.006 CrossRefGoogle Scholar
  105. Mobini S, Body S, Ho M-Y, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 160(3):290–298.  https://doi.org/10.1007/s00213-001-0983-0 PubMedCrossRefGoogle Scholar
  106. Mobini S, Chiang TJ, Al-Ruwaitea AS, Ho M-Y, Bradshaw CM, Szabadi E (2000) Effect of central 5-hydroxtryptamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmaoclogy 149(3):313–318.  https://doi.org/10.1007/s002130000385 CrossRefGoogle Scholar
  107. Moschak TM, Mitchell SH (2013) Sensitivity to reinforcer delay predicts ethanol’s suppressant effects, but itself is unaffected by ethanol. Drug Alcohol Depend 132(1-2):22–28.  https://doi.org/10.1016/j.drugalcdep.2013.07.009 PubMedCrossRefGoogle Scholar
  108. Myerson J, Green L, Warusawitharana M (2001) Area under the curve as a measure of discounting. J Exp Anal Behav 76(2):235–243.  https://doi.org/10.1901/jeab.2001.76-235 PubMedPubMedCentralCrossRefGoogle Scholar
  109. Ohmura Y, Takahashi T, Kitamura N (2005) Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology 182(4):508–515.  https://doi.org/10.1007/s00213-005-0110-8 PubMedCrossRefGoogle Scholar
  110. Oliveira L, Green L, Myerson J (2014) Pigeons’ delay discounting functions established using a concurrent-chains procedure. J Exp Anal Behav 102(2):151–161.  https://doi.org/10.1002/jeab.97 PubMedPubMedCentralCrossRefGoogle Scholar
  111. Ong EL, White KG (2004) Amount-dependent temporal discounting? Behav Process 66(3):201–212.  https://doi.org/10.1016/j.beproc.2004.03.005 CrossRefGoogle Scholar
  112. Orduña V (2015) Impulsivity and sensitivity to amount and delay of reinforcement in an animal model of ADHD. Behav Brain Res 294:62–71.  https://doi.org/10.1016/j.bbr.2015.07.046 PubMedCrossRefGoogle Scholar
  113. Orduña V, Mercado E 3rd (2017) Impulsivity in spontaneously hypertensive rats: within-subjects comparison of sensitivity to delay and to amount of reinforcement. Behav Brain Res 328:178–185.  https://doi.org/10.1016/j.bbr.2017.04.033 PubMedCrossRefGoogle Scholar
  114. Orduña V, Valencia-Torres L, Cruz G, Bouzas A (2013) Sensitivity to delay is affected by magnitude of reinforcement in rats. Behav Process 98:18–24.  https://doi.org/10.1016/j.beproc.2013.04.011 CrossRefGoogle Scholar
  115. Orsini CA, Mitchell MR, Heshmati SC, Shimp KG, Spurrell MS, Bizon JL, Setlow B (2017) Effects of nucleus accumbens amphetamine administration on performance in a delay discounting task. Behav Brain Res 321:130–136.  https://doi.org/10.1016/j.bbr.2017.01.001 PubMedCrossRefGoogle Scholar
  116. Ozga JE, Anderson KG (2018) Reduction in delay discounting due to nicotine and its attenuation by cholinergic antagonists in Lewis and Fischer 344 rats. Psychopharmacology 235:155–168.  https://doi.org/10.1007/s00213-017-4752-0
  117. Paine TA, Dringenberg HC, Olmstead MC (2003) Effects of chronic cocaine on impulsivity: relation to cortical serotonin mechanisms. Behav Brain Res 147(1-2):135–147.  https://doi.org/10.1016/S0166-4328(03)00156-6 PubMedCrossRefGoogle Scholar
  118. Pardey MC, Kumar NN, Goodchild AK, Cornish JL (2012) Catecholamine receptors differentially mediate impulsive choice in the medial prefrontal and orbitofrontal cortex. J Psychopharmacol 27:203–212PubMedCrossRefGoogle Scholar
  119. Paterson NE, Wetzler C, Hackett A, Hanania T (2012) Impulsive action and impulsive choice are mediated by distinct neuropharmacological substrates. Int J Neuropsychopharmacol 15(10):1473–1487.  https://doi.org/10.1017/S1461145711001635 PubMedCrossRefGoogle Scholar
  120. Perry JL, Larson EB, German JP, Madden GJ, Carroll ME (2005) Impulsivity (delay discounting) as a predictor of acquisition of IV cocaine self-administration in female rats. Psychopharmacology 178(2-3):193–201.  https://doi.org/10.1007/s00213-004-1994-4 PubMedCrossRefGoogle Scholar
  121. Perry JL, Nelson SE, Anderson MM, Morgan AD, Carroll ME (2007) Impulsivity (delay discounting) for food and cocaine in male and female rats selectively bred for high and low saccharin intake. Pharmacol Biochem Behav 86(4):822–837.  https://doi.org/10.1016/j.pbb.2007.03.012 PubMedPubMedCentralCrossRefGoogle Scholar
  122. Perry JL, Nelson SE, Carroll ME (2008a) Impulsive choice as a predictor of acquisition of IV cocaine self-administration and reinstatement of cocaine-seeking behavior in male and female rats. Exp Clin Psychopharmacology 16:165–177CrossRefGoogle Scholar
  123. Perry JL, Stairs DJ, Bardo MT (2008b) Impulsive choice and environmental enrichment: effects of d-amphetamine and methylphenidate. Behav Brain Res 193(1):48–54.  https://doi.org/10.1016/j.bbr.2008.04.019 PubMedPubMedCentralCrossRefGoogle Scholar
  124. Petry NM (2001a) Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology 154(3):243–250.  https://doi.org/10.1007/s002130000638 PubMedCrossRefGoogle Scholar
  125. Petry NM (2001b) Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. J Abnorm Psychol 110(3):482–487.  https://doi.org/10.1037/0021-843X.110.3.482 PubMedCrossRefGoogle Scholar
  126. Pinherio JC, Bates DM (2004) Mixed-effects models in S and S-PLUS. Springer, New YorkGoogle Scholar
  127. Pitts RC, Febbo SM (2004) Quantitative analyses of methamphetamine’s effects on self-control choices: implications for elucidating behavioral mechanisms of drug action. Behav Process 66(3):213–233.  https://doi.org/10.1016/j.beproc.2004.03.006 CrossRefGoogle Scholar
  128. Pitts RC, McKinney AP (2005) Effects of methylphenidate and morphine on delay-discount functions obtained within sessions. J Exp Anal Behav 83(3):297–314.  https://doi.org/10.1901/jeab.2005.47-04 PubMedPubMedCentralCrossRefGoogle Scholar
  129. Pope DA, Newland MC, Hutsell BA (2015) Delay-specific stimuli and genotype interact to determine temporal discounting in a rapid-acquisition procedure. J Exp Anal Behav 103(3):450–471.  https://doi.org/10.1002/jeab.148 PubMedCrossRefGoogle Scholar
  130. Poulos CX, Le AD, Parker JL (1995) Impulsivity predicts individual susceptibility to high levels of alcohol self-administration. Behav Pharmacol 6(8):810–814PubMedCrossRefGoogle Scholar
  131. Reynolds B, Richards JB, Horn K, Karraker K (2004) Delay discounting and probability discounting as related to cigarette smoking status in adults. Behav Process 65(1):35–42.  https://doi.org/10.1016/S0376-6357(03)00109-8 CrossRefGoogle Scholar
  132. Richards JB, Mitchell SH, de Wit H, Seiden LS (1997) Determination of discount functions in rats with an adjusting-amount procedure. J Exp Anal Behav 67(3):353–366.  https://doi.org/10.1901/jeab.1997.67-353 PubMedPubMedCentralCrossRefGoogle Scholar
  133. Richards JB, Sabol KE, de Wit H (1999a) Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats. Psychopharmacology 146(4):432–439.  https://doi.org/10.1007/PL00005488 PubMedCrossRefGoogle Scholar
  134. Richards JB, Zhang L, Mitchell SH, de Wit H (1999b) Delay or probability discounting in a model of impulsive behavior: effect of alcohol. J Exp Anal Behav 71(2):121–143.  https://doi.org/10.1901/jeab.1999.71-121 PubMedPubMedCentralCrossRefGoogle Scholar
  135. Robbins TW, Watson BA, Gaskin M, Ennis C (1983) Contrasting interactions of pipradol, d-amphetamine, cocaine, cocaine analogues, apomorphine and other drugs with conditioned reinforcement. Psychopharmacology 80(2):113–119.  https://doi.org/10.1007/BF00427952 PubMedCrossRefGoogle Scholar
  136. Robinson ES, Eagle DM, Mar AC, Bari A, Banerjee G, Jiang X, Dalley JW, Robbins TW (2008) Similar effects of the selective noradrenaline reuptake inhibitor atomoxetine on three distinct forms of impulsivity in the rat. Neuropsychopharmacology 33(5):1028–1037.  https://doi.org/10.1038/sj.npp.1301487 PubMedCrossRefGoogle Scholar
  137. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9(9):1161–1168.  https://doi.org/10.1038/nn1756 PubMedCrossRefGoogle Scholar
  138. Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 23:155–161CrossRefGoogle Scholar
  139. Scheres A, Tontsch C, Thoeny AL (2013) Steep temporal reward discounting in ADHD-combined type: acting upon feelings. Psychiatry Res 209(2):207–213.  https://doi.org/10.1016/j.psychres.2012.12.007 PubMedCrossRefGoogle Scholar
  140. Scheres A, Tontsch C, Thoeny AL, Kaczkurkin A (2010) Temporal reward discounting in attention-deficit/hyperactivity disorder: the contribution of symptom domains, reward magnitude, and session length. Biol Psychiatry 67(7):641–648.  https://doi.org/10.1016/j.biopsych.2009.10.033 PubMedCrossRefGoogle Scholar
  141. Schippers MC, Schetters D, De Vries TJ, Pattij T (2016) Differential effects of the pharmacological stressor yohimbine on impulsive decision making and response inhibition. Psychopharmacology 233(14):2775–2785.  https://doi.org/10.1007/s00213-016-4337-3 PubMedPubMedCentralCrossRefGoogle Scholar
  142. Schneider T, Ilott N, Brolese G, Bizarro L, Asherson PJ, Stolerman IP (2011) Prenatal exposure to nicotine impairs performance of the 5-choice serial reaction time task in adult rats. Neuropsychopharmacology 36(5):1114–1125.  https://doi.org/10.1038/npp.2010.249 PubMedPubMedCentralCrossRefGoogle Scholar
  143. Schweitzer JB, Sulzer-Azaroff B (1995) Self-control in boys with attention deficit hyperactivity disorder: effects of added stimulation and time. J Child Psychol Psychiatry 36(4):671–686.  https://doi.org/10.1111/j.1469-7610.1995.tb02321.x PubMedCrossRefGoogle Scholar
  144. Simon NW, LaSarge CL, Montgomery KS, Williams MT, Mendez IA, Setlow B, Bizon JL (2010) Good things come to those who wait: attenuated discounting of delayed rewards in aged Fischer 344 rats. Neurobiol Aging 31(5):853–862.  https://doi.org/10.1016/j.neurobiolaging.2008.06.004 PubMedCrossRefGoogle Scholar
  145. Simon NW, Mendez IA, Setlow B (2007) Cocaine exposure causes long-term increases in impulsive choice. Behav Neurosci 121(3):543–549.  https://doi.org/10.1037/0735-7044.121.3.543 PubMedPubMedCentralCrossRefGoogle Scholar
  146. Slezak JM, Anderson KG (2009) Effects of variable training, signaled and unsignaled delays, and d-amphetamine on delay-discounting functions. Behav Pharmacol 20(5-6):424–436.  https://doi.org/10.1097/FBP.0b013e3283305ef9 PubMedCrossRefGoogle Scholar
  147. Slezak JM, Anderson KG (2011) Effects of acute and chronic methylphenidate on delay discounting. Pharmacol Biochem Behav 99(4):545–551.  https://doi.org/10.1016/j.pbb.2011.05.027 PubMedCrossRefGoogle Scholar
  148. Slezak JM, Krebs CA, Anderson KG (2012) A within-subject analysis of d-amphetamine exposure on delay discounting in rats. Pharmacol Biochem Behav 102(4):502–506.  https://doi.org/10.1016/j.pbb.2012.06.019 PubMedCrossRefGoogle Scholar
  149. Slezak JM, Ricaurte GA, Tallarida RJ, Katz JL (2014) Methylphenidate and impulsivity: a comparison of effects of methylphenidate enantiomers on delay discounting in rats. Psychopharmacology 231(1):191–198.  https://doi.org/10.1007/s00213-013-3220-8 PubMedCrossRefGoogle Scholar
  150. Smethells JR, Carroll ME (2015) Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure. Psychopharmacology 232(14):2455–2462.  https://doi.org/10.1007/s00213-015-3874-5 PubMedPubMedCentralCrossRefGoogle Scholar
  151. Smethells JR, Swalve NL, Eberly LE, Carroll ME (2016) Sex differences in the reduction of impulsive choice (delay discounting) for cocaine in rats with atomoxetine and progesterone. Psychopharmacology 233(15-16):2999–3008.  https://doi.org/10.1007/s00213-016-4345-3 PubMedPubMedCentralCrossRefGoogle Scholar
  152. Solanto MV, Abikoff H, Sonuga-Barke E, Schachar R, Logan GD, Wigal T, Hechtman L, Hinshaw S, Turkel E (2001) The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. J Abnorm Child Psychol 29(3):215–228.  https://doi.org/10.1023/A:1010329714819 PubMedCrossRefGoogle Scholar
  153. Sonuga-Barke EJS, Taylor E, Sembi S, Smith J (1992) Hyperactivity and delay aversion-I. The effect of delay on choice. J Child Psychol Psychiatry 33(2):387–398.  https://doi.org/10.1111/j.1469-7610.1992.tb00874.x PubMedCrossRefGoogle Scholar
  154. Stein JS, Pinkston JW, Brewer AT, Francisco MT, Madden GJ (2012) Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid determination adjusting-amount procedures. J Exp Anal Behav 97(3):305–321.  https://doi.org/10.1901/jeab.2012.97-305 PubMedPubMedCentralCrossRefGoogle Scholar
  155. Strotz RH (1956) Myopia and inconsistency in dynamic utility maximization. Rev Econ Stud 23:166–180Google Scholar
  156. Sukhotina IA, Dravolina OA, Novitskaya Y, Zvartau EE, Danysz W, Bespalov AY (2008) Effects of mGlu1 receptor blockade on working memory, time estimation, and impulsivity in rats. Psychopharmacology 196(2):211–220.  https://doi.org/10.1007/s00213-007-0953-2 PubMedCrossRefGoogle Scholar
  157. Sun H, Cocker PJ, Zeeb FD, Winstanley CA (2012) Chronic atomoxetine treatment during adolescence decreases impulsive choice, but not impulsive action, in adult rats and alters markers of synaptic plasticity in the orbitofrontal cortex. Psychopharmacology 219(2):285–301.  https://doi.org/10.1007/s00213-011-2419-9 PubMedCrossRefGoogle Scholar
  158. Stanis JJ, Marquez Avila H, White MD, Gulley JM (2008) Dissociation between long-lasting behavioral sensitization to amphetamine and impulsive choice in rats performing a delay-discounting task. Psychopharmacology 199(4):539–548.  https://doi.org/10.1007/s00213-008-1182-z PubMedPubMedCentralCrossRefGoogle Scholar
  159. Talpos JC, Wilkinson LS, Robbins TW (2006) A comparison of multiple 5-HT receptors in two tasks measuring impulsivity. J Psychopharmacol 20(1):47–58.  https://doi.org/10.1177/0269881105056639 PubMedCrossRefGoogle Scholar
  160. Tanno T, Maguire DR, Hensen C, France CP (2014) Effects of amphetamine and methylphenidate on delay discounting in rats: interactions with order of delay presentation. Psychopharmacology 231(1):85–95.  https://doi.org/10.1007/s00213-013-3209-3 PubMedCrossRefGoogle Scholar
  161. Torres LV, Araújo Sda C, Sanchez CM, Body S, Bradshaw CM, Szabadi E (2011) Transitional and steady-state choice behavior under an adjusting-delay procedure. J Exp Anal Behav 95(1):57–74.  https://doi.org/10.1901/jeab.2011.95-57 PubMedPubMedCentralCrossRefGoogle Scholar
  162. Tripp G, Alsop B (2001) Sensitivity to reward delay in children with attention deficit hyperactivity disorder (ADHD). J Child Psychol Psychiatry 42(5):691–698.  https://doi.org/10.1111/1469-7610.00764 PubMedCrossRefGoogle Scholar
  163. Valencia-Torres L, Olarte-Sánchez CM, da Costa Araújo S, Body S, Bradshaw CM, Szabadi E (2012) Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice. Psychopharmacology 219(2):271–283.  https://doi.org/10.1007/s00213-011-2459-1 PubMedCrossRefGoogle Scholar
  164. van den Bergh FS, Bloemarts E, Groenink L, Olivier B, Oosting RS (2006) Delay aversion: effects of 7-OH-DPAT, 5-HT1A/1B-receptor stimulation and d-cycloserine. Pharmacol Biochem Behav 85(4):736–743.  https://doi.org/10.1016/j.pbb.2006.11.007 PubMedCrossRefGoogle Scholar
  165. van Gaalen MM, van Koten R, Schoffelmeer AN, Vanderschuren LJ (2006) Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiatry 60(1):66–73.  https://doi.org/10.1016/j.biopsych.2005.06.005 PubMedCrossRefGoogle Scholar
  166. Vloet TD, Marx I, Kahraman-Lanzerath B, Zepf FD, Herpertz-Dahlmann B, Konrad K (2010) Neurocognitive performance in children with ADHD and OCD. J Abnorm Child Psychol 38(7):961–969.  https://doi.org/10.1007/s10802-010-9422-1 PubMedCrossRefGoogle Scholar
  167. Voon V, Reynolds B, Brezing C, Gallea C, Skaljic M, Ekanayake V, Fernandez H, Potenza MN, Dolan RJ, Hallet M (2010) Impulsive choice and response in dopamine agonist-related impulse control behaviors. Psychopharmacology 207(4):645–659.  https://doi.org/10.1007/s00213-009-1697-y PubMedCrossRefGoogle Scholar
  168. Vuchinich RE, Simpson CA (1998) Hyperbolic temporal discounting in social drinkers and problem drinkers. Exp Clin Psychopharmacol 6(3):292–305.  https://doi.org/10.1037/1064-1297.6.3.292 PubMedCrossRefGoogle Scholar
  169. Wade TR, de Wit H, Richards JB (2000) Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology 150(1):90–101PubMedCrossRefGoogle Scholar
  170. Weller RE, Avsar KB, Cox JE, Reid MA, White DM, Lahti AC (2014) Delay discounting and task performance consistency in patients with schizophrenia. Psychiatry Res 215(2):286–293.  https://doi.org/10.1016/j.psychres.2013.11.013 PubMedCrossRefGoogle Scholar
  171. Wiehler A, Bromberg U, Peters J (2015) The role of prospection in steep temporal reward discounting in gambling addiction. Front Psychiatry 6:112PubMedPubMedCentralCrossRefGoogle Scholar
  172. Wilhelm CJ, Mitchell SH (2009) Strain differences in delay discounting using inbred rats. Genes Brain Behav 8(4):426–434.  https://doi.org/10.1111/j.1601-183X.2009.00484.x PubMedPubMedCentralCrossRefGoogle Scholar
  173. Wilhelm CJ, Mitchell SH (2010) Response bias is unaffected by delay length in a delay discounting paradigm. Behav Process 84(1):445–449.  https://doi.org/10.1016/j.beproc.2010.02.017 CrossRefGoogle Scholar
  174. Wilhelm CJ, Mitchell SH (2012) Acute ethanol does not always affect delay discounting in rats selected to prefer or avoid ethanol. Alcohol Alcohol 47(5):518–524.  https://doi.org/10.1093/alcalc/ags059 PubMedPubMedCentralCrossRefGoogle Scholar
  175. Winstanley CA (2011) The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders. Br J Pharmacol 164(4):1301–1321.  https://doi.org/10.1111/j.1476-5381.2011.01323.x PubMedPubMedCentralCrossRefGoogle Scholar
  176. Winstanley CA, Dalley JW, Theobald DE, Robbins TW (2003) Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology 170(3):320–331.  https://doi.org/10.1007/s00213-003-1546-3 PubMedCrossRefGoogle Scholar
  177. Winstanley CA, Dalley JW, Theobald DE, Robbins TW (2004) Fractioning impulsivity: contrasting effects of central 5-HT depletion on different measures of impulsive behavior. Neuropsychopharmacology 29(7):1331–1343.  https://doi.org/10.1038/sj.npp.1300434 PubMedCrossRefGoogle Scholar
  178. Winstanley CA, LaPlant Q, Theobald DE, Green TA, Bachtell RK, Perrotti LI, DiLeone RJ, Russo SJ, Garth WJ, Self DW, Nestler EJ (2007) DeltaFosB induction in orbitofrontal cortex mediates tolerance to cocaine-induced cognitive dysfunction. J Neurosci 27(39):10497–10507.  https://doi.org/10.1523/JNEUROSCI.2566-07.2007 PubMedCrossRefGoogle Scholar
  179. Winstanley CA, Theobald DEH, Dalley JW, Cardinal RN, Robbins TW (2006) Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb Cortex 16(1):106–114.  https://doi.org/10.1093/cercor/bhi088 PubMedCrossRefGoogle Scholar
  180. Winstanley CA, Theobald DE, Dalley JW, Robbins TW (2005) Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology 30(4):669–682.  https://doi.org/10.1038/sj.npp.1300610 PubMedCrossRefGoogle Scholar
  181. Wiskerke J, Stoop N, Schetters D, Schoffelmeer AN, Pattij T (2011) Cannabinoid CB1 receptor activation mediates the opposing effects of amphetamine on impulsive action and impulsive choice. PLoS One 6(10):e25856.  https://doi.org/10.1371/journal.pone.0025856 PubMedPubMedCentralCrossRefGoogle Scholar
  182. Wooters TE, Bardo MT (2011) Methylphenidate and fluphenazine, but not amphetamine, differentially affect impulsive choice in spontaneously hypertensive, Wistar-Kyoto and Sprague-Dawley rats. Brain Res 1396:45–53.  https://doi.org/10.1016/j.brainres.2011.04.040 PubMedCrossRefGoogle Scholar
  183. Yates JR, Marusich JA, Gipson CD, Beckmann JS, Bardo MT (2012) High impulsivity in rats predicts amphetamine conditioned place preference. Pharmacol Biochem Behav 100(3):370–376.  https://doi.org/10.1016/j.pbb.2011.07.012 PubMedCrossRefGoogle Scholar
  184. Yates JR, Perry JL, Meyer AC, Gipson CD, Charnigo R, Bardo MT (2014) Role of medial prefrontal and orbitofrtonal monoamine transporters and receptors in performance in an adjusting delay discounting procedure. Brain Res 1574:26–36.  https://doi.org/10.1016/j.brainres.2014.06.004 PubMedPubMedCentralCrossRefGoogle Scholar
  185. Yates JR, Batten SR, Bardo MT, Beckmann JS (2015) Role of ionotropic glutamate receptors in delay and probability discounting in the rat. Psychopharmacology 232(7):1187–1196.  https://doi.org/10.1007/s00213-014-3747-3 PubMedCrossRefGoogle Scholar
  186. Yates JR, Gunkel BT, Rogers KK, Hughes MN, Prior NA (2017a) Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure. Psychopharmacology 234(3):461–473.  https://doi.org/10.1007/s00213-016-4469-5 PubMedCrossRefGoogle Scholar
  187. Yates JR, Rogers KK, Gunkel BT, Prior NA, Hughes MN, Sharpe SM, Campbell HL, Johnson AB, Keller MG, Breitenstein KA, Shults HN (2017b) Effects of group I metabotropic glutamate receptor antagonists on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting task in rats: contribution of delay presentation order. Behav Brain Res 322(Pt A):29–33.  https://doi.org/10.1016/j.bbr.2017.01.015 PubMedCrossRefGoogle Scholar
  188. Yoon JH, De La Garza R 2nd, Newton TF, Suchting R, Weaver MT, Brown GS, Omar Y, Haiiwa I (2017) A comparison of Mazur’s k and areaunder the curve for describing steep discounting. Psychol Rec 67(3):355–363.  https://doi.org/10.1007/s40732-017-0220-9 PubMedCrossRefGoogle Scholar
  189. Young ME (2017) Discounting: a practical guide to multilevel analysis of indifference data. J Exp Anal Behav 108(1):97–112.  https://doi.org/10.1002/jeab.265 PubMedCrossRefGoogle Scholar
  190. Young ME, Clark MH, Goffus A, Hoane MR (2009) Mixed effects modeling of Morris water maze data: advantages and cautionary notes. Learn Motiv 40(2):160–177.  https://doi.org/10.1016/j.lmot.2008.10.004 CrossRefGoogle Scholar
  191. Zeeb FD, Floresco SB, Winstanley CA (2010) Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology 211(1):87–98.  https://doi.org/10.1007/s00213-010-1871-2 PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Psychological ScienceNorthern Kentucky UniversityHighland HeightsUSA

Personalised recommendations