Abstract
Rationale
The adverse consequences of human addictive drug use could be the result of either addictive drug consumption resulting in punishment (e.g., incarceration) or failure to engage in negative-reinforced behaviors that might compete with drug-maintained behaviors (e.g., contingency management strategies that reset payment amounts for drug free urines).
Objective
The goal of the present study was to establish a discrete-trial cocaine-vs-negative reinforcer (SNR) choice procedure where rats were presented with a simplified model of this conflict: choose negative reinforcement (i.e., escape or avoid foot shock) or choose an intravenous (IV) cocaine infusion followed by an inescapable shock.
Methods
Responding was maintained in male and female rats by IV cocaine infusions (0.32–1.8 mg/kg/inf) and a SNR (0.1–0.7 mA shock) under a discrete-trial concurrent “choice” schedule during daily sessions. Following parametric reinforcer magnitude and response requirement experiments, the effects of 12 h extended access cocaine self-administration and acute diazepam (0.32–10 mg/kg, IP) pretreatment were determined on cocaine-vs-SNR choice.
Results
Negative reinforcement was chosen over all cocaine doses. Lowering shock magnitude or increasing SNR response requirement failed to promote behavioral reallocation towards cocaine. Extended access cocaine self-administration sessions resulted in high daily cocaine intakes but failed to significantly increase cocaine choice in all (19) but one rat. Acute diazepam pretreatment also did not alter choice behavior up to doses that produced behavioral depression.
Conclusions
These results suggest that SNRs may be a source of reinforcement that effectively compete with and mitigate maladaptive addictive drug-maintained behaviors in the general population.
Similar content being viewed by others
References
Ahmed SH (2011) Animal models of drug addiction. In: Neuromethods, vol 53. Humana Press
Augier E, Vouillac C, Ahmed SH (2012) Diazepam promotes choice of abstinence in cocaine self-administering rats. Addict Biol 17:378–391. https://doi.org/10.1111/j.1369-1600.2011.00368.x
Babbini M, Gaiardi M, Bartoletti M (1979) Stimulus-response relationships in a quickly learned escape from shock: effects of morphine. Pharmacol Biochem Behav 11:155–158
Banks ML, Negus SS (2010) Effects of extended cocaine access and cocaine withdrawal on choice between cocaine and food in rhesus monkeys. Neuropsychopharmacology 35:493–504. https://doi.org/10.1038/npp.2009.154
Baron A, Galizio M (2005) Positive and negative reinforcement: should the distinction be preserved? Behav Anal 28:85–98
Barrett JE, Spealman RD (1978) Behavior simultaneously maintained by both presentation and termination of noxious stimuli. J Exp Anal Behav 3:375–383
Belin D, Balado E, Piazza PV, Deroche-Gamonet V (2009) Pattern of intake and drug craving predict the development of cocaine addiction-like behavior in rats. Biol Psychiatry 65:863–868. https://doi.org/10.1016/j.biopsych.2008.05.031
Berger DF, Robert Brush F (1975) Rapid acquisition of discrete-trial lever-press avoidance: effects of signal-shock interval. J Exp Anal Behav 24:227–239
Bergman J, Johanson CE, Bergman J, Johanson CE (1981) The effects of electric shock on responding maintained by cocaine in rhesus monkeys. Pharmacol Biochem Behav 14:423–426
Bickel WK, Johnson MW, Koffarnus MN et al (2014) The behavioral economics of substance use disorders: reinforcement pathologies and their repair. Annu Rev Clin Psychol 10:641–677
Bolles RC (1970) Species-specific defense reactions and avoidance learning. Psychol Rev 77:32–48
Chow JJ, Beacher NJ, Chabot JM et al (2022) Characterization of operant social interaction in rats: effects of access duration, effort, peer familiarity, housing conditions, and choice between social interaction vs. food or remifentanil. Psychopharmacology (Berl) 239:2093–2108. https://doi.org/10.1007/s00213-022-06064-1
Coyle JT, Wender P, Lipsky A (1973) Avoidance conditioning in different strains of rats: neurochemical correlates. Psychopharmacologia (Berl) 31:25–34
Deroche-Gamonet V, Belin D, Piazza PV (2004) Evidence for addiction-like behavior in the rat. Science 305:1014–1017
Durand A, Girardeau P, Freese L, Ahmed SH (2022) Increased responsiveness to punishment of cocaine self-administration after experience with high punishment. Neuropsychopharmacology 47:444–453. https://doi.org/10.1038/s41386-021-01159-3
Dworkin SI, Bimle C, Miyauchi T (1989) Differential effects of pentobarbital and cocaine on punished and nonpunished responding. J Exp Anal Behav 51:173–184
Fischer B, O’Keefe-Markman C, Lee A, Daldegan-Bueno D (2021) ‘Resurgent’, ‘twin’ or ‘silent’ epidemic? A select data overview and observations on increasing psycho-stimulant use and harms in North America. Subst Abuse Treat Prev Policy 16:1–11. https://doi.org/10.1186/s13011-021-00350-5
Fontes RM, Shahan TA (2022) Effects of repeated exposure to escalating versus constant punishment intensity on response allocation. J Exp Anal Behav 118(1):59–82. https://doi.org/10.1002/jeab.766
Fortney JC, Tripathi SP, Walton MA et al (2010) Patterns of substance abuse treatment seeking following cocaine-related emergency department visits. J Behav Health Serv Res 38:221–233
Grove RN, Schuster CR (1974) Suppression of cocaine self-administration by extinction and punishment. Pharmacol Biochem Behav 2:199–208
Howard JL (1990) Effects of drugs on punished behavior: pre-clinical test for anxiolytics. Pharmacol Ther 45:403–424
Hymowitz N, Abramson M (1983) Effects of diazepam on responding suppressed by response-dependent and independent electric-shock delivery. Pharmacol Biochem Behav 18:769–776
Iglauer C, Llewellyn ME, Woods JH (1976) Concurrent schedules of cocaine injection in rhesus monkeys: dose variations under independent and non-independent variable-interval procedures. Pharmacol Rev 27:367–383
Johanson CE (1977) The effects of electric shock on responding maintained by cocaine injections in a choice procedure in the rhesus monkey. Psychopharmacology (Berl) 53:277–282
Johnson AR, Banks ML, Blough BE et al (2016) Development of a translational model to screen medications for cocaine use disorder I: choice between cocaine and food in rhesus monkeys. Drug Alcohol Depend 165:103–110. https://doi.org/10.1016/j.drugalcdep.2016.05.021
Jones CMC, Baldwin GT, Compton WM (2017) Recent increases in cocaine-related overdose deaths and the role of opioids. Am J Public Health 107:430–432
Kawa AB, Allain F, Robinson TE, Samaha AN (2019) The transition to cocaine addiction: the importance of pharmacokinetics for preclinical models. Psychopharmacology (Berl) 236:1145–1157. https://doi.org/10.1007/s00213-019-5164-0
Koob GF (2015) The dark side of emotion: the addiction perspective. Eur J Pharmacol 753:73–87
Kuribara H, Tadokoro S (1984) Conditioned lever-press avoidance response in mice: acquisition processes and effects of diazepam. Psychopharmacology (Berl) 82:36–40
Lenoir M, Serre F, Cantin L, Ahmed SH (2007) Intense sweetness surpasses cocaine reward. PLoS One. 2(8):e698. https://doi.org/10.1371/journal.pone.0000698
Lile JA, Stoops WW, Rush CR et al (2016) Development of a translational model to screen medications for cocaine use disorder II: choice between intravenous cocaine and money in humans. Drug Alcohol Depend 165:111–119. https://doi.org/10.1016/j.drugalcdep.2016.05.022
Lipari RN, Park-Lee E (2020) Key substance use and mental health indicators in the United States: results from the 2019 National Survey on Drug Use and Health
Mckearney JW (1968) Maintenance of responding under a fixed-interval schedule of electric shock-presentation. Science 160:1249–1251
Michael J (1975) Positive and negative reinforcement, a distinction that is no longer necessary; or a better way to talk about bad things. Behaviorism 3:33–44
Nader MA, Woolverton WL (1991) Effects of increasing the magnitude of an alternative reinforcer on drug choice in a discrete-trials choice procedure. Psychopharmacology (Berl) 105:169–174. https://doi.org/10.1007/BF02244304
Nader MA, Woolverton WL (1992) Effects of increasing response requirement on choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) 108:295–300. https://doi.org/10.1007/BF02245115
Negus SS (2003) Rapid assessment of choice between cocaine and food in rhesus monkeys: effects of environmental manipulations and treatment with d-amphetamine and flupenthixol. Neuropsychopharmacology 28:919–931. https://doi.org/10.1038/sj.npp.1300096
Negus SS (2005) Effects of punishment on choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) 181:244–252. https://doi.org/10.1007/s00213-005-2266-7
Negus SS, Banks ML (2021) Confronting the challenge of failed translation in medications development for substance use disorders. Pharmacol Biochem Behav 210:173264. https://doi.org/10.1016/j.pbb.2021.173264
Nevin JA, Mandell C (2017) Comparing positive and negative reinforcement: a fantasy experiment. J Exp Anal Behav 107:34–38. https://doi.org/10.1002/jeab.237
Panlilio LV, Thorndike EB, Schindler CW (2005) Lorazepam reinstates punishment-suppressed remifentanil self-administration in rats. Psychopharmacology (Berl) 179:374–382. https://doi.org/10.1007/s00213-004-2040-2
Pelloux Y, Everitt BJ, Dickinson A (2007) Compulsive drug seeking by rats under punishment: effects of drug taking history. Psychopharmacology (Berl) 194:127–137. https://doi.org/10.1007/s00213-007-0805-0
Pelloux Y, Murray JE, Everitt BJ (2015) Differential vulnerability to the punishment of cocaine related behaviours: effects of locus of punishment, cocaine taking history and alternative reinforcer availability. Psychopharmacology (Berl) 232:125–134. https://doi.org/10.1007/s00213-014-3648-5
Perone M (2003) Negative effects of positive reinforcement. Behav Anal 26:1–14
Sidman M (1953) Avoidance conditioning with brief shock and no exteroceptive warning signal. Science 118:157–158
Skinner BF (1938) The behavior of organisms: an experimental analysis. Appleton-Century-Crofts, New York
Spealman RD (1979a) Behavior maintained by termination of a schedule of self-administered cocaine. Science 204:1231–1233
Spealman RD (1979b) Comparison of drug effects on responding punished by pressurized air or electric shock delivery in squirrel monkeys: pentobarbital, chlordiazepoxide, d-amphetamine and cocaine. J Pharmacol Exp Ther 209:309–315
Thomsen M, Barrett AC, Negus SS, Caine SB (2013) Cocaine versus food choice procedure in rats: environmental manipulations and effects of amphetamine. J Exp Anal Behav 99:211–233. https://doi.org/10.1002/jeab.15
Townsend SKL, Robinson HL et al (2021) A drug-vs-food “choice” self-administration procedure in rats to investigate pharmacological and environmental mechanisms of substance use disorders. J Neurosci Methods 354:109110. https://doi.org/10.1016/j.jneumeth.2021.109110
Vanderschuren LJMJ, Everitt BJ (2004) Drug seeking becomes compulsive after prolonged cocaine self-administration. Science 305:1017–1019. https://doi.org/10.1126/science.1098975
Venniro M, Panlilio LV, Epstein DH, Shaham Y (2021) The protective effect of operant social reward on cocaine self-administration, choice, and relapse is dependent on delay and effort for the social reward. Neuropsychopharmacology 46:2350–2357. https://doi.org/10.1038/s41386-021-01148-6
Wee S, Specio SE, Koob GF (2007) Effects of dose and session duration on cocaine self-administration in rats. J Pharmacol Exp Ther 320:1134–1143. https://doi.org/10.1124/jpet.106.113340
Woolverton WL, Freeman KB, Myerson J, Green L (2012) Suppression of cocaine self-administration in monkeys: effects of delayed punishment. Psychopharmacology (Berl) 220:509–517. https://doi.org/10.1007/s00213-011-2501-3
Acknowledgements
We appreciate the technical assistance of Michelle Arriaga during the training procedures.
Funding
Research reported in this publication was supported by the National Institute on Drug Abuse (NIDA) under award numbers T32DA007027 and R21DA053820. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIDA. The funding source had no role in the experimental design, interpretation, or decision to publish the results.
Author information
Authors and Affiliations
Contributions
Madison Marcus: writing—original draft, writing—review and editing, methodology, software, formal analysis, investigation, data curation, and data visualization. Matthew Banks: formal analysis, writing—review and editing, visualization, conceptualization, supervision, and funding acquisition.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
ESM 1
Supplemental materials include additional data tables and figures. (DOCX 464 kb)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Marcus, M.M., Banks, M.L. Effects of environmental and pharmacological manipulations on cocaine-vs-negative reinforcer choice in male and female rats. Psychopharmacology 240, 1677–1689 (2023). https://doi.org/10.1007/s00213-023-06404-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00213-023-06404-9