Psychopharmacology

, Volume 211, Issue 1, pp 87–98 | Cite as

Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues

Original Investigation

Abstract

Rationale

Individual differences in impulsive decision-making may be critical determinants of vulnerability to impulse control disorders and substance abuse, yet little is known of their biological or behavioural basis. The orbitofrontal cortex (OFC) has been heavily implicated in the regulation of impulsive decision-making. However, lesions of the OFC in rats have both increased and decreased impulsivity in delay-discounting paradigms, where impulsive choice is defined as the selection of small immediate over larger delayed rewards.

Objectives

Reviewing the different methods used, we hypothesized that the effects of OFC inactivation on delay discounting may be critically affected by both subjects’ baseline level of impulsive choice and the presence or absence of a cue to bridge the delay between selection and delivery of the large reward.

Results

Here, we show that OFC inactivation increased impulsive choice in less impulsive rats when the delay was cued, but decreased impulsive choice in highly impulsive rats in an uncued condition.

Conclusions

Providing explicit environmental cues to signal the delay-to-reinforcement appears to change the way in which the OFC is recruited in the decision-making process in a baseline-dependent fashion. This change may reflect activation of the dopamine system, as intra-OFC infusions of dopamine receptor antagonists increased impulsive choice but only when the delay was cued.

Keywords

Delay discounting Dopamine Eticlopride Impulsivity Incentive salience SCH 23390 Antagonist Baclofen Muscimol Prefrontal cortex Behaviour Rat 

Supplementary material

213_2010_1871_MOESM1_ESM.gif (26 kb)
Fig. S1Effects of intra-OFC infusion of DA receptor antagonists on choice behaviour in the Cue group. Visual comparison of the data indicate that high impulsive (HI) animals were less affected by infusions of either eticlopride (a) or SCH 23390 (b), whereas both eticlopride (c) or SCH 23390 (d) infusions increased impulsive choice in low impulsive (LI) animals. However, overall, the effects of eticlopride and SCH 23390 in HI or LI rats did not differ significantly from each other as analysed by ANOVA. Data shown are mean ± SEM (GIF 25 kb)
213_2010_1871_Fig2_ESM.tif (8.8 mb)
High resolution image (TIFF 8963 kb)

References

  1. Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–496CrossRefPubMedGoogle Scholar
  2. Arnsten AF (2009) Toward a new understanding of attention-deficit hyperactivity disorder pathophysiology: an important role for prefrontal cortex dysfunction. CNS Drugs 23(Suppl 1):33–41CrossRefPubMedGoogle Scholar
  3. Barbelivien A, Billy E, Lazarus C, Kelche C, Majchrzak M (2008) Rats with different profiles of impulsive choice behavior exhibit differences in responses to caffeine and d-amphetamine and in medial prefrontal cortex 5-HT utilization. Behav Brain Res 187:273–283CrossRefPubMedGoogle Scholar
  4. Bechara A, Damasio H, Damasio AR, Lee GP (1999) Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J Neurosci 19:5473–5481PubMedGoogle Scholar
  5. Bechara A, Damasio H, Damasio AR (2000) Emotion, decision making and the orbitofrontal cortex. Cereb Cortex 10:295–307CrossRefPubMedGoogle Scholar
  6. Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28:309–369CrossRefPubMedGoogle Scholar
  7. Bolla KI, Eldreth DA, London ED, Kiehl KA, Mouratidis M, Contoreggi C, Matochik JA, Kurian V, Cadet JL, Kimes AS, Funderburk FR, Ernst M (2003) Orbitofrontal cortex dysfunction in abstinent cocaine abusers performing a decision-making task. Neuroimage 19:1085–1094CrossRefPubMedGoogle Scholar
  8. Bradley C (1937) The behavior of children receiving benzedrine. Am J Psychiat, In, pp 577–585Google Scholar
  9. Cardinal RN, Robbins TW, Everitt BJ (2000) The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152:362–375CrossRefGoogle Scholar
  10. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ (2001) Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292:2499–2501CrossRefPubMedGoogle Scholar
  11. Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26(3):321–352CrossRefPubMedGoogle Scholar
  12. Chudasama Y, Robbins TW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23:8771–8780PubMedGoogle Scholar
  13. Coffey SF, Gudleski GD, Saladin ME, Brady KT (2003) Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp Clin Psychopharm 11:18–25CrossRefGoogle Scholar
  14. Cormier E (2008) Attention deficit/hyperactivity disorder: a review and update. J Pediatr Nurs 23:345–357CrossRefPubMedGoogle Scholar
  15. Damasio AR (1994) Descartes’ error and the future of human life. Sci Am 271:144CrossRefPubMedGoogle Scholar
  16. de Wit H, Enggasser JL, Richards JB (2002) Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacol 27:813–825CrossRefGoogle Scholar
  17. Diergaarde L, Pattij T, Nawijn L, Schoffelmeer AN, De Vries TJ (2009) Trait impulsivity predicts escalation of sucrose seeking and hypersensitivity to sucrose-associated stimuli. Behav Neurosci 123:794–803CrossRefPubMedGoogle Scholar
  18. Dunnett SB, Robbins TW (1992) The functional role of mesotelencephalic dopamine systems. Biol Rev Camb Philos Soc 67:491–518CrossRefPubMedGoogle Scholar
  19. Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl) 128:161–170CrossRefGoogle Scholar
  20. Feldman DJ, Frank RA, Kehne JH, Flannery R, Brown D, Soni S, Byrd G, Shah S (1997) Mixed D2/5-HT2 antagonism differentially affects apomorphine- and amphetamine-induced stereotyped behavior. Pharmacol Biochem Behav 58:565–572CrossRefPubMedGoogle Scholar
  21. Flagel SB, Akil H, Robinson TE (2009) Individual differences in the attribution of incentive salience to reward-related cues: implications for addiction. Neuropharmacology 56(Suppl 1):139–148CrossRefPubMedGoogle Scholar
  22. Fleckenstein AE, Volz TJ, Riddle EL, Gibb JW, Hanson GR (2007) New insights into the mechanism of action of amphetamines. Annu Rev Pharmacol Toxicol 47:681–698CrossRefPubMedGoogle Scholar
  23. Floresco SB, St. Onge JR, Ghods-Sharifi S, Winstanley CA (2008a) Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn Affect Behav Neurosci 8:375–389CrossRefPubMedGoogle Scholar
  24. Floresco S, Tse M, Ghods-Sharifi S (2008b) Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacol 33:1966–1979CrossRefGoogle Scholar
  25. Goldstein RZ, Tomasi D, Alia-Klein N, Honorio Carrillo J, Maloney T, Woicik PA, Wang R, Telang F, Volkow ND (2009) Dopaminergic response to drug words in cocaine addiction. J Neurosci 29:6001–6006CrossRefPubMedGoogle Scholar
  26. Hill RT (ed) (1970) Facilitation of conditioned reinforcement as a mechanism of psychomotor stimulation. Raven, New YorkGoogle Scholar
  27. Ho MY, Mobini S, Chiang TJ, Bradshaw CM, Szabadi E (1999) Theory and method in the quantitative analysis of “impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology (Berl) 146(4):362–372CrossRefGoogle Scholar
  28. Jones B, Mishkin M (1972) Limbic lesions and the problem of stimulus–reinforcement associations. Exp Neurol 36:362–377CrossRefPubMedGoogle Scholar
  29. Kheramin S, Body S, Mobini S, Ho MY, Velázquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 165(1):9–17Google Scholar
  30. Kheramin S, Body S, Ho MY, Velázquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2004) Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 175:206–214CrossRefGoogle Scholar
  31. Kosten TR, Scanley BE, Tucker KA, Oliveto A, Prince C, Sinha R, Potenza MN, Skudlarski P, Wexler BE (2006) Cue-induced brain activity changes and relapse in cocaine-dependent patients. Neuropsychopharmacol 31:644–650CrossRefGoogle Scholar
  32. Loos M, Pattij T, Janssen MC, Counotte DS, Schoffelmeer AN, Smit AB, Spijker S, van Gaalen MM (2010) Dopamine receptor D1/D5 gene expression in the medial prefrontal cortex predicts impulsive choice in rats. Cereb Cortex 20(5):1064–1070. doi:10.1093/cercor/bhp167 CrossRefPubMedGoogle Scholar
  33. Mazur JE (1997) Choice, delay, probability, and conditioned reinforcement. Anim Learn Behav 25:131–147Google Scholar
  34. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160:290–298CrossRefGoogle Scholar
  35. Monterosso JR, Ainslie G, Xu J, Cordova X, Domier CP, London ED (2007) Frontoparietal cortical activity of methamphetamine-dependent and comparison subjects performing a delay discounting task. Hum Brain Mapp 28:383–393CrossRefPubMedGoogle Scholar
  36. Oades RD (2008) Dopamine-serotonin interactions in attention-deficit hyperactivity disorder (ADHD). Prog Brain Res 172:543–565CrossRefPubMedGoogle Scholar
  37. Oades RD, Halliday GM (1987) Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res 434:117–165PubMedGoogle Scholar
  38. Ostlund SB, Balleine BW (2007) The contribution of orbitofrontal cortex to action selection. Ann N Y Acad Sci 1121:174–192CrossRefPubMedGoogle Scholar
  39. Paxinos G, Watson C (1998) The rat brain in stereotaxic co-ordinates. Academic, SydneyGoogle Scholar
  40. Perry JL, Nelson SE, Carroll ME (2008) Impulsive choice as a predictor of acquisition of IV cocaine self-administration and reinstatement of cocaine-seeking behavior in male and female rats. Exp Clin Psychopharm 16:165–177CrossRefGoogle Scholar
  41. Phillips PEM, Stuber GD, Heien MLAV, Wightman RM, Carelli RM (2003) Subsecond dopamine release promotes cocaine seeking. Nature 422:614–618CrossRefPubMedGoogle Scholar
  42. Robbins TW (1976) Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs. Nature 264:57–59CrossRefPubMedGoogle Scholar
  43. Robinson TE, Flagel SB (2009) Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biol Psychiatry 65:869–873CrossRefPubMedGoogle Scholar
  44. Rogers RD, Everitt BJ, Baldacchino A, Blackshaw AJ, Swainson R, Wynne K, Baker NB, Hunter J, Carthy T, Booker E, London M, Deakin JF, Sahakian BJ, Robbins TW (1999) Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacol 20:322–339CrossRefGoogle Scholar
  45. Rolls ET, Hornak J, Wade D, McGrath J (1994) Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatry 57:1518–1524CrossRefPubMedGoogle Scholar
  46. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161–1168CrossRefPubMedGoogle Scholar
  47. Scheres A, Lee A, Sumiya M (2008) Temporal reward discounting and ADHD: task and symptom specific effects. J Neural Transm 115:221–226CrossRefPubMedGoogle Scholar
  48. Schoenbaum G, Setlow B, Ramus SJ (2003) A systems approach to orbitofrontal cortex function: recordings in rat orbitofrontal cortex reveal interactions with different learning systems. Behav Brain Res 146:19–29CrossRefPubMedGoogle Scholar
  49. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593–1599CrossRefPubMedGoogle Scholar
  50. Shaham Y, Shalev U, Lu L, de Wit H, Stewart J (2003) The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology (Berl) 168:3–20CrossRefGoogle Scholar
  51. Tait DS, Brown VJ (2007) Difficulty overcoming learned non-reward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann NY Acad Sci 1121:407–420CrossRefPubMedGoogle Scholar
  52. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62(2):269–280CrossRefPubMedGoogle Scholar
  53. Tomie A, Aguado AS, Pohorecky LA, Benjamin D (1998) Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping. Psychopharmacology (Berl) 139(4):376–382CrossRefGoogle Scholar
  54. Tripp G, Wickens JR (2009) Neurobiology of ADHD. Neuropharmacology 57(7–8):579–589CrossRefPubMedGoogle Scholar
  55. van Gaalen MM, van Koten R, Schoffelmeer AN, Vanderschuren LJ (2006) Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiat 60:66–73CrossRefPubMedGoogle Scholar
  56. Volkow ND, Fowler JS, Wang GJ, Swanson JM, Telang F (2007) Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Arch Neurol 64(11):1575–1579CrossRefPubMedGoogle Scholar
  57. Wade TR, de Wit H, Richards JB (2000) Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl) 150:90–101CrossRefGoogle Scholar
  58. Wallis JD (2007) Orbitofrontal cortex and its contribution to decision-making. Annu Rev Neurosci 30:31–56CrossRefPubMedGoogle Scholar
  59. Williams BA, Dunn R (1991) Preference for conditioned reinforcement. J Exp Anal Behav 55:37–46CrossRefPubMedGoogle Scholar
  60. Winstanley CA, Chudasama Y, Dalley JW, Theobald DE, Glennon JC, Robbins TW (2003a) Intra-prefrontal 8-OH-DPAT and M100907 improve visuospatial attention and decrease impulsivity on the five-choice serial reaction time task in rats. Psychopharmacology (Berl) 167:304–314Google Scholar
  61. Winstanley CA, Dalley JW, Theobald DE, Robbins TW (2003b) Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology (Berl) 170:320–331CrossRefGoogle Scholar
  62. Winstanley CA, Theobald DE, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718–4722CrossRefPubMedGoogle Scholar
  63. Winstanley CA, Theobald DE, Dalley JW, Robbins TW (2005) Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacol 30:669–682Google Scholar
  64. Winstanley CA, Theobald DE, Dalley JW, Cardinal RN, Robbins TW (2006) Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb Cortex 16:106–114CrossRefPubMedGoogle Scholar

Copyright information

© Springer-Verlag 2010

Authors and Affiliations

  1. 1.Department of PsychologyUniversity of British ColumbiaVancouverCanada

Personalised recommendations