Skip to main content

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

Abstract

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

This is a preview of subscription content, access via your institution.

Fig. 1

References

  • Adams CD (1982) Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q J Exp Psychol 34B:77–98

    Article  Google Scholar 

  • Ahmed SH, Koob GF (1997) Cocaine-but not food-seeking behavior is reinstated by stress after extinction. Psychopharmacology 132:289–295

    CAS  PubMed  Article  Google Scholar 

  • Baker AG (1990) Contextual conditioning during free-operant extinction: unsignaled, signaled, and backward-signaled noncontingent food. Anim Learn Behav 18:59–70

    Article  Google Scholar 

  • Baker AG, Steinwald H, Bouton ME (1991) Contextual conditioning and reinstatement of extinguished instrumental responding. Q J Exp Psychol 43B:199–218

    Google Scholar 

  • Baker TB, Piper ME, McCarthy DE, Majeskie MR, Fiore MC (2004) Addiction motivation reformulated: an affective processing model of negative reinforcement. Psychol Rev 111:33–51

    PubMed  Article  Google Scholar 

  • Bernal-Gamboa R, Gámez AM, Nieto J (2017) Reducing spontaneous recovery and reinstatement of operant performance through extinction-cues. Behav Process 135(1–7):1–7

    Article  Google Scholar 

  • Bossert JM, Liu SY, Lu L, Shaham Y (2004) A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. J Neurosci 24:10726–10730

    CAS  PubMed  Article  Google Scholar 

  • Bouton ME (1991) Context and retrieval in extinction and in other examples of interference in simple associative learning. In: Dachowski L, Flaherty CF (eds) Current topics in animal learning: brain, emotion, and cognition. Lawrence Erlbaum, Hillsdale, NJ, pp 25–53

    Google Scholar 

  • Bouton ME (1993) Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychol Bull 114:80–99

    CAS  PubMed  Article  Google Scholar 

  • Bouton ME, García-Gutiérrez A (2006) Intertrial interval as a contextual stimulus. Behav Process 71:307–317

    Article  Google Scholar 

  • Bouton ME, Hendrix MC (2011) Intertrial interval as a contextual stimulus: further analysis of a novel asymmetry in temporal discrimination learning. J Exp Psychol Anim Behav Process 37:79–93

    PubMed  PubMed Central  Article  Google Scholar 

  • Bouton ME, Schepers ST (2014) Resurgence of instrumental behavior after an abstinence contingency. Learn Behav 42:131–143

    PubMed  PubMed Central  Article  Google Scholar 

  • Bouton ME, Schepers ST (2015) Renewal after the punishment of free operant behavior. J Exp Psychol: Anim Learn Cogn 41:81–90

    Google Scholar 

  • Bouton ME, Todd TP (2014) A fundamental role for context in instrumental learning and extinction. Behav Process 104:13–19

    Article  Google Scholar 

  • Bouton ME, Trask S (2016) Role of the discriminative properties of the reinforcer in resurgence. Learn Behav 44:137–150

    PubMed  PubMed Central  Article  Google Scholar 

  • Bouton ME, Kenney FA, Rosengard C (1990) State-dependent fear extinction with two benzodiazepine tranquilizers. Behav Neurosci 104:44–55

    CAS  PubMed  Article  Google Scholar 

  • Bouton ME, Rosengard C, Achenbach GG, Peck CA, Brooks DC (1993) Effects of contextual conditioning and unconditional stimulus presentation on performance in appetitive conditioning. Q J Exp Psychol 41B:63–95

    Google Scholar 

  • Bouton ME, Todd TP, Vurbic D, Winterbauer NE (2011) Renewal after the extinction of free operant behavior. Learn Behav 39:57–67

    PubMed  PubMed Central  Article  Google Scholar 

  • Bouton ME, Winterbauer NE, Vurbic D (2012) Context and extinction: mechanisms of relapse in drug self-administration. In M. Haselgrove & L. Hogarth (Eds.), Clinical applications of learning theory (pp. 103–133). East Sussex, UK: Psychology Press

  • Bouton ME, Todd TP, León SP (2014) Contextual control of discriminated operant behavior. J Exp Psychol: Anim Learn Cogn 40:92–105

    Google Scholar 

  • Bouton ME, Trask S, Carranza-Jasso R (2016) Learning to inhibit the response during instrumental (operant) extinction. J Exp Psychol: Anim Learn Cogn 42:246–258

    Google Scholar 

  • Brooks DC (2000) Recent and remote extinction cues reduce spontaneous recovery. Q J Exp Psychol Sect B: Comp Physiol Psychol 53:25–58

    CAS  Article  Google Scholar 

  • Brooks DC, Bouton ME (1993) A retrieval cue for extinction attenuates spontaneous recovery. J Exp Psychol Anim Behav Process 19:77–89

    CAS  PubMed  Article  Google Scholar 

  • Brooks DC, Bouton ME (1994) A retrieval cue attenuates response recovery (renewal) caused by a return to the conditioning context. J Exp Psychol Anim Behav Process 20:366–379

    Article  Google Scholar 

  • Brooks DC, Fava DA (2017) An extinction cue reduces appetitive Pavlovian reinstatement in rats. Learn Motiv 58:59–65

    Article  Google Scholar 

  • Buczek Y, Le AD, Wang A, Stewart J, Shaham Y (1999) Stress reinstates nicotine seeking but not sucrose solution seeking in rats. Psychopharmacology 144:183–188

    CAS  PubMed  Article  Google Scholar 

  • Chaudri N, Sahuque LL, Cone JJ, Janak PH (2008) Reinstated ethanol-seeking in rats is modulated by environmental context and requires the nucleus accumbens core. Eur J Neurosci 28:2288–2298

    Article  Google Scholar 

  • Cohenour JM, Volkert VM, Allen KD (2018) An experimental demonstration of AAB renewal in children with autism spectrum disorder. J Exp Anal Behav, in press 110:63–73

    PubMed  Article  Google Scholar 

  • Colwill RM (1991) Negative discriminative stimuli provide information about the identity of omitted response-contingent outcomes. Anim Learn Behav 19:326–336

    Article  Google Scholar 

  • Colwill RM, Rescorla RA (1990) Evidence for the hierarchical structure of instrumental learning. Anim Learn Behav 18:71–82

    Article  Google Scholar 

  • Corbit LH (2018) Understanding the balance between goal-directed and habitual behavioral control. Curr Opin Behav Sci 20:161–168

    Article  Google Scholar 

  • Craig AR, Browning KO, Shahan TA (2017) Stimuli previously associated with reinforcement mitigate resurgence. J Exp Anal Behav 108:139–150

    PubMed  Article  Google Scholar 

  • Crombag HS, Shaham Y (2002) Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav Neurosci 116:169–173

    CAS  PubMed  Article  Google Scholar 

  • Cunningham CL (1979) Alcohol as a cue for extinction: state dependency produced by conditioned inhibition. Anim Learn Behav 7:45–52

    Article  Google Scholar 

  • Davidson TL (1993) The nature and function of interoceptive signals to feed: toward integration of physiological and learning perspectives. Psychol Rev 100:640–657

    CAS  PubMed  Article  Google Scholar 

  • Davidson TL, Kanoski SE, Tracy AL, Walls EK, Clegg D, Benoit SC (2005) The interoceptive cue properties of ghrelin generalize to cues produced by food deprivation. Peptides 26:1602–1610

    CAS  PubMed  Article  Google Scholar 

  • Dickinson A (1985) Actions and habits: the development of behavioural autonomy. Philos Trans Royal Soc London B: Biol Sci 308:67–78

    Article  Google Scholar 

  • Estes WK (1944) An experimental study of punishment. Psychol Monogr: Gen App 57:i–40

    Article  Google Scholar 

  • Franks GJ, Lattal KA (1976) Antecedent reinforcement schedule training and operant response reinstatement in rats. Anim Learn Behav 4:374–378

    Article  Google Scholar 

  • Gordon WC, Spear NE (1973) Effect of reactivation of a previously acquired memory on the interaction between memories in the rat. J Exp Psychol 99:349–355

    CAS  PubMed  Article  Google Scholar 

  • Hamlin AS, Newby J, McNally GP (2007) The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking. Neuroscience 146:525–536

    CAS  PubMed  Article  Google Scholar 

  • Hamlin AS, Clemens KJ, McNally GP (2008) Renewal of extinguished cocaine-seeking. Neuroscience 151:659–670

    CAS  PubMed  Article  Google Scholar 

  • Hammack SE, Cheung J, Rhodes KM, Schutz KC, Falls WA, Braas KM, May V (2009) Chronic stress increases pituitary adenylate cyclase-activating peptide (PACAP) and brain-derived neurotrophic factor (BDNF) mRNA expression in the bed nucleus of the stria terminalis (BNST): roles for PACAP in anxiety-like behavior. Psychoneuroendocrinology 34:833–843

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Holland PC (1992) Occasion setting in Pavlovian conditioning. In D. L. Medin (ed.), The psychology of learning and motivation (Vol. 28, pp. 69–125). San Diego, CA: Academic Press

  • Holland PC, Coldwell SE (1993) Transfer of inhibitory stimulus control in operant feature-negative discriminations. Learn Motiv 24:345–375

    Article  Google Scholar 

  • Holmes NM, Marchand AR, Coutureau E (2010) Pavlovian to instrumental transfer: a neurobehavioural perspective. Neurosci Biobehav Rev 34(8):1277–1295

    PubMed  Article  Google Scholar 

  • Jean-Richard-Dit-Brussel P, Killcross S, McNally GP (2018) Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders. Neuropsychopharmacology 43:1639–1650

    Article  Google Scholar 

  • Kanoski SE, Walls EK, Davidson TL (2007) Interoceptive “satiety” signals produced by leptin and CCK. Peptides 28:988–1002

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Kelley ME, Liddon CJ, Ribeiro A, Greif AE, Podlesnik CA (2015) Basic and translational evaluation of renewal of operant responding. J Appl Behav Anal 48:390–401

    PubMed  Article  Google Scholar 

  • Kelley ME, Jimenez-Gomez C, Podlesnik CA, Morgan A (2018) Evaluation of renewal mitigation of negatively reinforced socially significant operant behavior. Learn Motiv 63:133–141

    Article  Google Scholar 

  • Kincaid SL, Lattal KA (2018) Beyond the breakpoint: reinstatement, renewal, and resrugence of ratio-strained behavior. J Exp Anal Behav 109:475–491

    PubMed  Article  Google Scholar 

  • Lattal KM (2007) Effects of ethanol on the encoding, consolidation, and expression of extinction following contextual fear conditioning. Behav Neurosci 121:1280–1292

    CAS  PubMed  Article  Google Scholar 

  • LeBlanc KH, Ostlund SB, Maidment NT (2012) Pavlovian-to-instrumental transfer in cocaine seeking rats. Behav Neurosci 126:681–689

    PubMed  PubMed Central  Article  Google Scholar 

  • Leitenberg H, Rawson RA, Bath K (1970) Reinforcement of competing behavior during extinction. Science 169:301–303

    CAS  PubMed  Article  Google Scholar 

  • Liddon CJ, Kelley ME, Rey CN, Liggett AP, Ribeiro A (2018) A translational analysis of ABA and ABC renewal of operant behavior. J Appl Behav Anal in press

  • Lieving GA, Lattal KA (2003) Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence. J Exp Anal Behav 80:217–233

    PubMed  PubMed Central  Article  Google Scholar 

  • Mackintosh NJ (1975) A theory of attention: variations in the associability of stimuli with reinforcement. Psychol Rev 82:276–298

    Article  Google Scholar 

  • Mantsch JR, Goeders NE (1998) Generalization of a restraint-induced discriminative stimulus to cocaine in rats. Psychopharmacology 468:423–426

    Article  Google Scholar 

  • Mantsch JR, Goeders NE (1999) Ketoconazole blocks the stress induced reinstatement of cocaine-seeking behavior in rats: the relationship to the discriminative stimulus effects of cocaine. Psychopharmacology 142:399–407

    CAS  PubMed  Article  Google Scholar 

  • Mantsch JR, Baker DA, Funk D, Lê AD, Shaham Y (2016) Stress-induced reinstatement of drug seeking: 20 years of progress. Neuropsychopharmacology 41:335–356

    CAS  PubMed  Article  Google Scholar 

  • Marchant NJ, Khuc TN, Pickens CL, Bonci A, Shaham Y (2013) Context-induced relapse to alcohol seeking after punishment in a rat model. Biol Psychiatry 73:256–262

    CAS  PubMed  Article  Google Scholar 

  • Marchant NJ, Campbell EJ, Pelloux Y, Bossert JM, Shaham Y (2018) Context-induced relapse after extinction versus punishment: similarities and differences. Psychopharmacology in press

  • Miller RR, Escobar M (2002) Associative interference between cues and between outcomes presented together and presented apart: an integration. Behav Process 57:163–185

    Article  Google Scholar 

  • Miller RR, Kasprow WJ, Schachtman TR (1986) Retrieval variability: sources and consequences. Am J Psychol 99:145–218

    CAS  PubMed  Article  Google Scholar 

  • Morell JR, Holland PC (1993) Summation and transfer of negative occasion setting. Anim Learn Behav 21:145–153

    Article  Google Scholar 

  • Nakajima S (2014) Renewal of signaled shuttle box avoidance in rats. Learn Motiv 46:27–43

    Article  Google Scholar 

  • Nakajima S, Tanaka S, Urushihara K, Imada H (2000) Renewal of extinguished lever-press responses upon return to the training context. Learn Motiv 31:416–431

    Article  Google Scholar 

  • Nakajima S, Urushihara K, Masaki T (2002) Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context. Learn Motiv 33:510–525

    Article  Google Scholar 

  • Nieto J, Uengoer M, Bernal-Gamboa R (2017) A reminder of extinction reduces relapse in an animal model of voluntary behavior. Learn Mem 24:76–80

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Olmstead MC, Lafond MV, Everitt BJ, Dickinson A (2001) Cocaine seeking by rats is a goal-directed action. Behav Neurosci 115:394–402

    CAS  PubMed  Article  Google Scholar 

  • Ostlund SB, Balleine BW (2007) Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav 35:43–52

    PubMed  Article  Google Scholar 

  • Panlilio LV, Thorndike EB, Schindler CW (2003) Reinstatement of punishment-suppressed opioid self-administration in rats: an alternative model of relapse to drug abuse. Psychopharmacology 168:229–235

    CAS  PubMed  Article  Google Scholar 

  • Panlilio LV, Thorndike EB, Schindler CW (2005) Lorazepam reinstates punishment-suppressed remifentanil self-administration in rats. Psychopharmacology 179:374–382

    CAS  PubMed  Article  Google Scholar 

  • Pearce JM, Hall G (1979) The influence of context-reinforcer associations on instrumental performance. Anim Learn Behav 7:504–508

    Article  Google Scholar 

  • Pelloux Y, Hoots JK, Cifani C, Adhikary S, Martin J, Minier-Toribio A, Bossert JM, Shaham Y (2018) Context-induced relapse to cocaine seeking after punishment-imposed abstinence is associated with activation of cortical and subcortical brain regions. Addict Biol 23:699–712

    CAS  PubMed  Article  Google Scholar 

  • Polack CW, Jozefowiez J, Miller RR (2017) Stepping back from ‘persistence and relapse’ to see the forest: associative interference. Behav Process 141:128–136

    Article  Google Scholar 

  • Reid RL (1958) The role of the reinforcer as a stimulus. Br J Psychol 49:202–209

    CAS  PubMed  Article  Google Scholar 

  • Rescorla RA (1993) Inhibitory associations between S and R in extinction. Anim Learn Behav 21:327–336

    Article  Google Scholar 

  • Rescorla RA (1995) Full preservation of a response-outcome association through training with a second outcome. Q J Exp Psychol 48b:252–261

    Google Scholar 

  • Rescorla RA (1996a) Response-outcome associations remain functional through interference treatments. Anim Learn Behav 24:450–458

    Article  Google Scholar 

  • Rescorla RA (1996b) Spontaneous recovery after training with multiple outcomes. Anim Learn Behav 24:11–18

    Article  Google Scholar 

  • Rescorla RA (1997a) Response inhibition in extinction. Q J Exp Psychol Sect B: Comp Physiol Psychol 50:238–252

    Google Scholar 

  • Rescorla RA (1997b) Spontaneous recovery of instrumental discriminative responding. Anim Learn Behav 25:485–497

    Article  Google Scholar 

  • Rescorla RA (2001) Experimental extinction. In: Mower RR, Klein SB (eds) Handbook of contemporary learning theories. Erlbaum, Mahwah, NJ, pp 119–154

    Google Scholar 

  • Rescorla RA, Skucy JC (1969) Effect of response-independent reinforcers during extinction. J Comp Physiol Psychol 67(3):381–389

    Article  Google Scholar 

  • Saini V, Sullivan WE, Baxter EL, DeRosa NM, Roane HS (2018) Renewal during functional communication training. J Appl Behav Anal, in press 51:603–619

    PubMed  Article  Google Scholar 

  • Sample CH, Jones S, Hargrave SL, Jarrard LE, Davidson TL (2016) Western diet and the weakening of the interoceptive stimulus control of appetitive behavior. Behav Brain Res 312:219–230

    PubMed  PubMed Central  Article  Google Scholar 

  • Schepers ST, Bouton ME (2015) Effects of reinforcer distribution during response elimination on resurgence of an instrumental behavior. J Exp Psychol: Anim Learn Cogn 41:179–192

    Google Scholar 

  • Schepers ST, Bouton ME (2017) Hunger as a context: food-seeking that is inhibited during hunger can renew in the context of satiety. Psychol Sci 28:1640–1648

    PubMed  PubMed Central  Article  Google Scholar 

  • Schepers ST, Bouton ME (2018) Stress as a context: stress causes relapse of inhibited food seeking if it has been associated with prior food seeking. Appetite (in press)

  • Shaham Y, Shalev U, Lu L, de Wit H, Stewart J (2003) The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology 168:3–20

    CAS  PubMed  Article  Google Scholar 

  • Shahan TA, Craig AR (2017) Resurgence as choice. Behav Process 141:100–127

    Article  Google Scholar 

  • Shahan TA, Sweeney MM (2011) A model of resurgence based on behavioral momentum theory. J Exp Anal Behav 95:91–108

    PubMed  PubMed Central  Article  Google Scholar 

  • Sinha R (2008) Chronic stress, drug use, and vulnerability to addiction. Ann N Y Acad Sci 1141:105–130

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Sinha R, Shaham Y, Heilig M (2011) Translational and reverse translational research on the role of stress in drug craving and relapse. Psychopharmacology 218:69–82

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Smith BM, Smith GS, Shahan TA, Madden GJ, Twohig MP (2017) Effects of differential rates of alternative reinforcement on resurgence of human behavior. J Exp Anal Behav 107:191–202

    PubMed  Article  Google Scholar 

  • Spear NE (1971) Forgetting as retrieval failure. In: Honig WK, James PHR (eds) Animal memory. Academic Press, San Diego, CA, pp 45–109

    Chapter  Google Scholar 

  • Spear NE (1981) Extending the domain of memory retrieval. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms. Erlbaum, Hillsdale, NJ, pp 341–378

    Google Scholar 

  • Spear NE, Smith GJ, Bryan R, Gordon W, Timmons R, Chiszar D (1980) Contextual influences on the interaction between conflicting memories in the rat. Anim Learn Behav, S 8:273–281

    Article  Google Scholar 

  • Sweeney MM, Shahan TA (2013) Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence. J Exp Anal Behav 100:102–116

    PubMed  Article  Google Scholar 

  • Thomas DR, McKelvie AR, Ranney M, Moye TB (1981) Interference in pigeons’ long-term memory viewed as a retrieval problem. Anim Learn Behav 9:581–586

    Article  Google Scholar 

  • Thomas DR, Moye TB, Kimose E (1984) The recency effect in pigeons’ long-term memory. Anim Learn Behav 12:21–28

    Article  Google Scholar 

  • Thomas DR, McKelvie AR, Mah WL (1985) Context as a conditional cue in operant discrimination reversal learning. J Exp Psychol Anim Behav Process 11:317–330

    Article  Google Scholar 

  • Thrailkill EA, Bouton ME (2015a) Extinction of chained instrumental behaviors: effects of procurement extinction on consumption responding. J Exp Psychol: Anim Learn Cogn 41:232–246

    Google Scholar 

  • Thrailkill EA, Bouton ME (2015b) Contextual control of instrumental actions and habits. J Exp Psychol: Anim Learn Cogn 41:69–80

    Google Scholar 

  • Thrailkill EA, Bouton ME (2016a) Extinction and the associative structure of heterogeneous instrumental chains. Neurobiol Learn Mem 133:61–68

    PubMed  PubMed Central  Article  Google Scholar 

  • Thrailkill EA, Bouton ME (2016b) Extinction of chained instrumental behaviors: effects of consumption extinction on procurement responding. Learn Behav 44:85–96

    PubMed  PubMed Central  Article  Google Scholar 

  • Thrailkill EA, Bouton ME (2017) Factors that influence the persistence and relapse of discriminated behavior chains. Behav Process 141:3–10

    Article  Google Scholar 

  • Thrailkill EA, Trott JM, Zerr CL, Bouton ME (2016) Contextual control of chained instrumental behaviors. J Exp Psychol: Anim Learn Cogn 42:401–414

    Google Scholar 

  • Todd TP (2013) Mechanisms of renewal after the extinction of instrumental behavior. J Exp Psychol Anim Behav Process 39:193–207

    PubMed  PubMed Central  Article  Google Scholar 

  • Todd TP, Winterbauer NE, Bouton ME (2012) Effects of the amount of acquisition and contextual generalization on the renewal of instrumental behavior after extinction. Learn Behav 40:145–157

    PubMed  Article  Google Scholar 

  • Todd TP, Vurbic D, Bouton ME (2014) Mechanisms of renewal after the extinction of discriminated operant behavior. J Exp Psychol: Anim Learn Cogn 40:355–368

    Google Scholar 

  • Torres SJ, Nowson CA (2007) Relationship between stress, eating behavior, and obesity. Nutrition 23:887–894

    PubMed  Article  Google Scholar 

  • Trask S (2019) Cues associated with alternative reinforcement during extinction can attenuate resurgence of an extinguished instrumental response. Learn Behav in press

  • Trask S, Bouton ME (2014) Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning. Learn Behav 42:281–288

    PubMed  PubMed Central  Article  Google Scholar 

  • Trask S, Bouton ME (2016) Discriminative properties of the reinforcer can be used to attenuate the renewal of extinguished operant behavior. Learn Behav 44:151–161

    PubMed  PubMed Central  Article  Google Scholar 

  • Trask S, Bouton ME (2018) Retrieval practice after multiple context changes, but not long retention intervals, reduces the impact of a final context change on instrumental behavior. Learn Behav 46:213–221

    PubMed  Article  Google Scholar 

  • Trask S, Schepers ST, Bouton ME (2015) Context change explains resurgence after the extinction of operant behavior. Mex J Behav Anal 41:187–210

    Google Scholar 

  • Trask S, Shipman ML, Green JT, Bouton ME (2017a) Inactivation of the prelimbic cortex attenuates context-dependent operant responding. J Neurosci 37:2317–2324

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  • Trask S, Thrailkill EA, Bouton ME (2017b) Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning. Behav Process 137:64–72

    Article  Google Scholar 

  • Trask S, Keim CL, Bouton ME (2018) Factors that encourage generalization from extinction to test reduce resurgence of an extinguished operant response. J Exp Anal Behav 110:11–23

    PubMed  Article  Google Scholar 

  • Vurbic D, Bouton ME (2011) Secondary extinction in Pavlovian fear conditioning. Learn Behav 39:202–211

    PubMed  PubMed Central  Article  Google Scholar 

  • Welker RL, McAuley K (1978) Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli. Anim Learn Behav 6:451–457

    Article  Google Scholar 

  • Willcocks AL, McNally GP (2014) An extinction retrieval cue attenuates renewal but not reacquisition of alcohol seeking. Behav Neurosci 128:83–91

    PubMed  Article  Google Scholar 

  • Winterbauer NE, Bouton ME (2010) Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 36:343–353

    PubMed  PubMed Central  Article  Google Scholar 

  • Winterbauer NE, Bouton ME (2011) Mechanisms of resurgence II: response-contingent reinforcers can reinstate a second extinguished behavior. Learn Motiv 42:154–164

    PubMed  PubMed Central  Article  Google Scholar 

  • Winterbauer NE, Bouton ME (2012) Effects of thinning the rate at which the alternative behavior is reinforced on resurgence of an extinguished instrumental response. J Exp Psychol Anim Behav Process 38:279–291

    PubMed  PubMed Central  Article  Google Scholar 

  • Zapata A, Minney VL, Shippenberg TS (2010) Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci 30:15457–15463

    CAS  PubMed  PubMed Central  Article  Google Scholar 

Download references

Acknowledgments

Preparation of this article was supported by Grant RO1 DA 033123 from NIH. I thank Catalina Rey, Scott Schepers, Mike Steinfeld, Eric Thrailkill, Travis Todd, and Sydney Trask for comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark E. Bouton.

Ethics declarations

Conflict of interest

The author declares no conflicts of interest.

Additional information

This article belongs to a Special Issue on Psychopharmacology of Extinction.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Bouton, M.E. Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control. Psychopharmacology 236, 7–19 (2019). https://doi.org/10.1007/s00213-018-5076-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00213-018-5076-4

Keywords

  • Extinction
  • Instrumental learning
  • Context
  • Interference