Advertisement

Psychopharmacology

, Volume 236, Issue 1, pp 7–19 | Cite as

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

  • Mark E. BoutonEmail author
Review

Abstract

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

Keywords

Extinction Instrumental learning Context Interference 

Notes

Acknowledgments

Preparation of this article was supported by Grant RO1 DA 033123 from NIH. I thank Catalina Rey, Scott Schepers, Mike Steinfeld, Eric Thrailkill, Travis Todd, and Sydney Trask for comments.

Compliance with ethical standards

Conflict of interest

The author declares no conflicts of interest.

References

  1. Adams CD (1982) Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q J Exp Psychol 34B:77–98Google Scholar
  2. Ahmed SH, Koob GF (1997) Cocaine-but not food-seeking behavior is reinstated by stress after extinction. Psychopharmacology 132:289–295CrossRefGoogle Scholar
  3. Baker AG (1990) Contextual conditioning during free-operant extinction: unsignaled, signaled, and backward-signaled noncontingent food. Anim Learn Behav 18:59–70Google Scholar
  4. Baker AG, Steinwald H, Bouton ME (1991) Contextual conditioning and reinstatement of extinguished instrumental responding. Q J Exp Psychol 43B:199–218Google Scholar
  5. Baker TB, Piper ME, McCarthy DE, Majeskie MR, Fiore MC (2004) Addiction motivation reformulated: an affective processing model of negative reinforcement. Psychol Rev 111:33–51PubMedGoogle Scholar
  6. Bernal-Gamboa R, Gámez AM, Nieto J (2017) Reducing spontaneous recovery and reinstatement of operant performance through extinction-cues. Behav Process 135(1–7):1–7Google Scholar
  7. Bossert JM, Liu SY, Lu L, Shaham Y (2004) A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. J Neurosci 24:10726–10730PubMedGoogle Scholar
  8. Bouton ME (1991) Context and retrieval in extinction and in other examples of interference in simple associative learning. In: Dachowski L, Flaherty CF (eds) Current topics in animal learning: brain, emotion, and cognition. Lawrence Erlbaum, Hillsdale, NJ, pp 25–53Google Scholar
  9. Bouton ME (1993) Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychol Bull 114:80–99PubMedPubMedCentralGoogle Scholar
  10. Bouton ME, García-Gutiérrez A (2006) Intertrial interval as a contextual stimulus. Behav Process 71:307–317Google Scholar
  11. Bouton ME, Hendrix MC (2011) Intertrial interval as a contextual stimulus: further analysis of a novel asymmetry in temporal discrimination learning. J Exp Psychol Anim Behav Process 37:79–93PubMedPubMedCentralGoogle Scholar
  12. Bouton ME, Schepers ST (2014) Resurgence of instrumental behavior after an abstinence contingency. Learn Behav 42:131–143PubMedPubMedCentralGoogle Scholar
  13. Bouton ME, Schepers ST (2015) Renewal after the punishment of free operant behavior. J Exp Psychol: Anim Learn Cogn 41:81–90Google Scholar
  14. Bouton ME, Todd TP (2014) A fundamental role for context in instrumental learning and extinction. Behav Process 104:13–19Google Scholar
  15. Bouton ME, Trask S (2016) Role of the discriminative properties of the reinforcer in resurgence. Learn Behav 44:137–150PubMedPubMedCentralGoogle Scholar
  16. Bouton ME, Kenney FA, Rosengard C (1990) State-dependent fear extinction with two benzodiazepine tranquilizers. Behav Neurosci 104:44–55PubMedGoogle Scholar
  17. Bouton ME, Rosengard C, Achenbach GG, Peck CA, Brooks DC (1993) Effects of contextual conditioning and unconditional stimulus presentation on performance in appetitive conditioning. Q J Exp Psychol 41B:63–95Google Scholar
  18. Bouton ME, Todd TP, Vurbic D, Winterbauer NE (2011) Renewal after the extinction of free operant behavior. Learn Behav 39:57–67PubMedPubMedCentralGoogle Scholar
  19. Bouton ME, Winterbauer NE, Vurbic D (2012) Context and extinction: mechanisms of relapse in drug self-administration. In M. Haselgrove & L. Hogarth (Eds.), Clinical applications of learning theory (pp. 103–133). East Sussex, UK: Psychology PressGoogle Scholar
  20. Bouton ME, Todd TP, León SP (2014) Contextual control of discriminated operant behavior. J Exp Psychol: Anim Learn Cogn 40:92–105Google Scholar
  21. Bouton ME, Trask S, Carranza-Jasso R (2016) Learning to inhibit the response during instrumental (operant) extinction. J Exp Psychol: Anim Learn Cogn 42:246–258Google Scholar
  22. Brooks DC (2000) Recent and remote extinction cues reduce spontaneous recovery. Q J Exp Psychol Sect B: Comp Physiol Psychol 53:25–58Google Scholar
  23. Brooks DC, Bouton ME (1993) A retrieval cue for extinction attenuates spontaneous recovery. J Exp Psychol Anim Behav Process 19:77–89PubMedGoogle Scholar
  24. Brooks DC, Bouton ME (1994) A retrieval cue attenuates response recovery (renewal) caused by a return to the conditioning context. J Exp Psychol Anim Behav Process 20:366–379Google Scholar
  25. Brooks DC, Fava DA (2017) An extinction cue reduces appetitive Pavlovian reinstatement in rats. Learn Motiv 58:59–65Google Scholar
  26. Buczek Y, Le AD, Wang A, Stewart J, Shaham Y (1999) Stress reinstates nicotine seeking but not sucrose solution seeking in rats. Psychopharmacology 144:183–188PubMedPubMedCentralGoogle Scholar
  27. Chaudri N, Sahuque LL, Cone JJ, Janak PH (2008) Reinstated ethanol-seeking in rats is modulated by environmental context and requires the nucleus accumbens core. Eur J Neurosci 28:2288–2298Google Scholar
  28. Cohenour JM, Volkert VM, Allen KD (2018) An experimental demonstration of AAB renewal in children with autism spectrum disorder. J Exp Anal Behav, in press 110:63–73PubMedGoogle Scholar
  29. Colwill RM (1991) Negative discriminative stimuli provide information about the identity of omitted response-contingent outcomes. Anim Learn Behav 19:326–336Google Scholar
  30. Colwill RM, Rescorla RA (1990) Evidence for the hierarchical structure of instrumental learning. Anim Learn Behav 18:71–82Google Scholar
  31. Corbit LH (2018) Understanding the balance between goal-directed and habitual behavioral control. Curr Opin Behav Sci 20:161–168Google Scholar
  32. Craig AR, Browning KO, Shahan TA (2017) Stimuli previously associated with reinforcement mitigate resurgence. J Exp Anal Behav 108:139–150PubMedGoogle Scholar
  33. Crombag HS, Shaham Y (2002) Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav Neurosci 116:169–173Google Scholar
  34. Cunningham CL (1979) Alcohol as a cue for extinction: state dependency produced by conditioned inhibition. Anim Learn Behav 7:45–52Google Scholar
  35. Davidson TL (1993) The nature and function of interoceptive signals to feed: toward integration of physiological and learning perspectives. Psychol Rev 100:640–657PubMedGoogle Scholar
  36. Davidson TL, Kanoski SE, Tracy AL, Walls EK, Clegg D, Benoit SC (2005) The interoceptive cue properties of ghrelin generalize to cues produced by food deprivation. Peptides 26:1602–1610PubMedGoogle Scholar
  37. Dickinson A (1985) Actions and habits: the development of behavioural autonomy. Philos Trans Royal Soc London B: Biol Sci 308:67–78Google Scholar
  38. Estes WK (1944) An experimental study of punishment. Psychol Monogr: Gen App 57:i–40Google Scholar
  39. Franks GJ, Lattal KA (1976) Antecedent reinforcement schedule training and operant response reinstatement in rats. Anim Learn Behav 4:374–378Google Scholar
  40. Gordon WC, Spear NE (1973) Effect of reactivation of a previously acquired memory on the interaction between memories in the rat. J Exp Psychol 99:349–355PubMedGoogle Scholar
  41. Hamlin AS, Newby J, McNally GP (2007) The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking. Neuroscience 146:525–536PubMedGoogle Scholar
  42. Hamlin AS, Clemens KJ, McNally GP (2008) Renewal of extinguished cocaine-seeking. Neuroscience 151:659–670PubMedGoogle Scholar
  43. Hammack SE, Cheung J, Rhodes KM, Schutz KC, Falls WA, Braas KM, May V (2009) Chronic stress increases pituitary adenylate cyclase-activating peptide (PACAP) and brain-derived neurotrophic factor (BDNF) mRNA expression in the bed nucleus of the stria terminalis (BNST): roles for PACAP in anxiety-like behavior. Psychoneuroendocrinology 34:833–843PubMedPubMedCentralGoogle Scholar
  44. Holland PC (1992) Occasion setting in Pavlovian conditioning. In D. L. Medin (ed.), The psychology of learning and motivation (Vol. 28, pp. 69–125). San Diego, CA: Academic PressGoogle Scholar
  45. Holland PC, Coldwell SE (1993) Transfer of inhibitory stimulus control in operant feature-negative discriminations. Learn Motiv 24:345–375Google Scholar
  46. Holmes NM, Marchand AR, Coutureau E (2010) Pavlovian to instrumental transfer: a neurobehavioural perspective. Neurosci Biobehav Rev 34(8):1277–1295PubMedGoogle Scholar
  47. Jean-Richard-Dit-Brussel P, Killcross S, McNally GP (2018) Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders. Neuropsychopharmacology 43:1639–1650Google Scholar
  48. Kanoski SE, Walls EK, Davidson TL (2007) Interoceptive “satiety” signals produced by leptin and CCK. Peptides 28:988–1002PubMedPubMedCentralGoogle Scholar
  49. Kelley ME, Liddon CJ, Ribeiro A, Greif AE, Podlesnik CA (2015) Basic and translational evaluation of renewal of operant responding. J Appl Behav Anal 48:390–401PubMedGoogle Scholar
  50. Kelley ME, Jimenez-Gomez C, Podlesnik CA, Morgan A (2018) Evaluation of renewal mitigation of negatively reinforced socially significant operant behavior. Learn Motiv 63:133–141Google Scholar
  51. Kincaid SL, Lattal KA (2018) Beyond the breakpoint: reinstatement, renewal, and resrugence of ratio-strained behavior. J Exp Anal Behav 109:475–491PubMedGoogle Scholar
  52. Lattal KM (2007) Effects of ethanol on the encoding, consolidation, and expression of extinction following contextual fear conditioning. Behav Neurosci 121:1280–1292PubMedGoogle Scholar
  53. LeBlanc KH, Ostlund SB, Maidment NT (2012) Pavlovian-to-instrumental transfer in cocaine seeking rats. Behav Neurosci 126:681–689PubMedPubMedCentralGoogle Scholar
  54. Leitenberg H, Rawson RA, Bath K (1970) Reinforcement of competing behavior during extinction. Science 169:301–303PubMedGoogle Scholar
  55. Liddon CJ, Kelley ME, Rey CN, Liggett AP, Ribeiro A (2018) A translational analysis of ABA and ABC renewal of operant behavior. J Appl Behav Anal in press Google Scholar
  56. Lieving GA, Lattal KA (2003) Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence. J Exp Anal Behav 80:217–233PubMedPubMedCentralGoogle Scholar
  57. Mackintosh NJ (1975) A theory of attention: variations in the associability of stimuli with reinforcement. Psychol Rev 82:276–298Google Scholar
  58. Mantsch JR, Goeders NE (1998) Generalization of a restraint-induced discriminative stimulus to cocaine in rats. Psychopharmacology 468:423–426Google Scholar
  59. Mantsch JR, Goeders NE (1999) Ketoconazole blocks the stress induced reinstatement of cocaine-seeking behavior in rats: the relationship to the discriminative stimulus effects of cocaine. Psychopharmacology 142:399–407PubMedPubMedCentralGoogle Scholar
  60. Mantsch JR, Baker DA, Funk D, Lê AD, Shaham Y (2016) Stress-induced reinstatement of drug seeking: 20 years of progress. Neuropsychopharmacology 41:335–356PubMedGoogle Scholar
  61. Marchant NJ, Khuc TN, Pickens CL, Bonci A, Shaham Y (2013) Context-induced relapse to alcohol seeking after punishment in a rat model. Biol Psychiatry 73:256–262PubMedGoogle Scholar
  62. Marchant NJ, Campbell EJ, Pelloux Y, Bossert JM, Shaham Y (2018) Context-induced relapse after extinction versus punishment: similarities and differences. Psychopharmacology in pressGoogle Scholar
  63. Miller RR, Escobar M (2002) Associative interference between cues and between outcomes presented together and presented apart: an integration. Behav Process 57:163–185Google Scholar
  64. Miller RR, Kasprow WJ, Schachtman TR (1986) Retrieval variability: sources and consequences. Am J Psychol 99:145–218PubMedGoogle Scholar
  65. Morell JR, Holland PC (1993) Summation and transfer of negative occasion setting. Anim Learn Behav 21:145–153Google Scholar
  66. Nakajima S (2014) Renewal of signaled shuttle box avoidance in rats. Learn Motiv 46:27–43Google Scholar
  67. Nakajima S, Tanaka S, Urushihara K, Imada H (2000) Renewal of extinguished lever-press responses upon return to the training context. Learn Motiv 31:416–431Google Scholar
  68. Nakajima S, Urushihara K, Masaki T (2002) Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context. Learn Motiv 33:510–525Google Scholar
  69. Nieto J, Uengoer M, Bernal-Gamboa R (2017) A reminder of extinction reduces relapse in an animal model of voluntary behavior. Learn Mem 24:76–80PubMedPubMedCentralGoogle Scholar
  70. Olmstead MC, Lafond MV, Everitt BJ, Dickinson A (2001) Cocaine seeking by rats is a goal-directed action. Behav Neurosci 115:394–402PubMedGoogle Scholar
  71. Ostlund SB, Balleine BW (2007) Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav 35:43–52PubMedGoogle Scholar
  72. Panlilio LV, Thorndike EB, Schindler CW (2003) Reinstatement of punishment-suppressed opioid self-administration in rats: an alternative model of relapse to drug abuse. Psychopharmacology 168:229–235PubMedGoogle Scholar
  73. Panlilio LV, Thorndike EB, Schindler CW (2005) Lorazepam reinstates punishment-suppressed remifentanil self-administration in rats. Psychopharmacology 179:374–382PubMedGoogle Scholar
  74. Pearce JM, Hall G (1979) The influence of context-reinforcer associations on instrumental performance. Anim Learn Behav 7:504–508Google Scholar
  75. Pelloux Y, Hoots JK, Cifani C, Adhikary S, Martin J, Minier-Toribio A, Bossert JM, Shaham Y (2018) Context-induced relapse to cocaine seeking after punishment-imposed abstinence is associated with activation of cortical and subcortical brain regions. Addict Biol 23:699–712PubMedGoogle Scholar
  76. Polack CW, Jozefowiez J, Miller RR (2017) Stepping back from ‘persistence and relapse’ to see the forest: associative interference. Behav Process 141:128–136Google Scholar
  77. Reid RL (1958) The role of the reinforcer as a stimulus. Br J Psychol 49:202–209PubMedGoogle Scholar
  78. Rescorla RA (1993) Inhibitory associations between S and R in extinction. Anim Learn Behav 21:327–336Google Scholar
  79. Rescorla RA (1995) Full preservation of a response-outcome association through training with a second outcome. Q J Exp Psychol 48b:252–261Google Scholar
  80. Rescorla RA (1996a) Response-outcome associations remain functional through interference treatments. Anim Learn Behav 24:450–458Google Scholar
  81. Rescorla RA (1996b) Spontaneous recovery after training with multiple outcomes. Anim Learn Behav 24:11–18Google Scholar
  82. Rescorla RA (1997a) Response inhibition in extinction. Q J Exp Psychol Sect B: Comp Physiol Psychol 50:238–252Google Scholar
  83. Rescorla RA (1997b) Spontaneous recovery of instrumental discriminative responding. Anim Learn Behav 25:485–497Google Scholar
  84. Rescorla RA (2001) Experimental extinction. In: Mower RR, Klein SB (eds) Handbook of contemporary learning theories. Erlbaum, Mahwah, NJ, pp 119–154Google Scholar
  85. Rescorla RA, Skucy JC (1969) Effect of response-independent reinforcers during extinction. J Comp Physiol Psychol 67(3):381–389Google Scholar
  86. Saini V, Sullivan WE, Baxter EL, DeRosa NM, Roane HS (2018) Renewal during functional communication training. J Appl Behav Anal, in press 51:603–619PubMedGoogle Scholar
  87. Sample CH, Jones S, Hargrave SL, Jarrard LE, Davidson TL (2016) Western diet and the weakening of the interoceptive stimulus control of appetitive behavior. Behav Brain Res 312:219–230PubMedPubMedCentralGoogle Scholar
  88. Schepers ST, Bouton ME (2015) Effects of reinforcer distribution during response elimination on resurgence of an instrumental behavior. J Exp Psychol: Anim Learn Cogn 41:179–192Google Scholar
  89. Schepers ST, Bouton ME (2017) Hunger as a context: food-seeking that is inhibited during hunger can renew in the context of satiety. Psychol Sci 28:1640–1648PubMedPubMedCentralGoogle Scholar
  90. Schepers ST, Bouton ME (2018) Stress as a context: stress causes relapse of inhibited food seeking if it has been associated with prior food seeking. Appetite (in press)Google Scholar
  91. Shaham Y, Shalev U, Lu L, de Wit H, Stewart J (2003) The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology 168:3–20Google Scholar
  92. Shahan TA, Craig AR (2017) Resurgence as choice. Behav Process 141:100–127Google Scholar
  93. Shahan TA, Sweeney MM (2011) A model of resurgence based on behavioral momentum theory. J Exp Anal Behav 95:91–108PubMedPubMedCentralGoogle Scholar
  94. Sinha R (2008) Chronic stress, drug use, and vulnerability to addiction. Ann N Y Acad Sci 1141:105–130PubMedPubMedCentralGoogle Scholar
  95. Sinha R, Shaham Y, Heilig M (2011) Translational and reverse translational research on the role of stress in drug craving and relapse. Psychopharmacology 218:69–82PubMedPubMedCentralGoogle Scholar
  96. Smith BM, Smith GS, Shahan TA, Madden GJ, Twohig MP (2017) Effects of differential rates of alternative reinforcement on resurgence of human behavior. J Exp Anal Behav 107:191–202PubMedGoogle Scholar
  97. Spear NE (1971) Forgetting as retrieval failure. In: Honig WK, James PHR (eds) Animal memory. Academic Press, San Diego, CA, pp 45–109Google Scholar
  98. Spear NE (1981) Extending the domain of memory retrieval. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms. Erlbaum, Hillsdale, NJ, pp 341–378Google Scholar
  99. Spear NE, Smith GJ, Bryan R, Gordon W, Timmons R, Chiszar D (1980) Contextual influences on the interaction between conflicting memories in the rat. Anim Learn Behav, S 8:273–281Google Scholar
  100. Sweeney MM, Shahan TA (2013) Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence. J Exp Anal Behav 100:102–116PubMedGoogle Scholar
  101. Thomas DR, McKelvie AR, Ranney M, Moye TB (1981) Interference in pigeons’ long-term memory viewed as a retrieval problem. Anim Learn Behav 9:581–586Google Scholar
  102. Thomas DR, Moye TB, Kimose E (1984) The recency effect in pigeons’ long-term memory. Anim Learn Behav 12:21–28Google Scholar
  103. Thomas DR, McKelvie AR, Mah WL (1985) Context as a conditional cue in operant discrimination reversal learning. J Exp Psychol Anim Behav Process 11:317–330Google Scholar
  104. Thrailkill EA, Bouton ME (2015a) Extinction of chained instrumental behaviors: effects of procurement extinction on consumption responding. J Exp Psychol: Anim Learn Cogn 41:232–246Google Scholar
  105. Thrailkill EA, Bouton ME (2015b) Contextual control of instrumental actions and habits. J Exp Psychol: Anim Learn Cogn 41:69–80Google Scholar
  106. Thrailkill EA, Bouton ME (2016a) Extinction and the associative structure of heterogeneous instrumental chains. Neurobiol Learn Mem 133:61–68PubMedPubMedCentralGoogle Scholar
  107. Thrailkill EA, Bouton ME (2016b) Extinction of chained instrumental behaviors: effects of consumption extinction on procurement responding. Learn Behav 44:85–96PubMedPubMedCentralGoogle Scholar
  108. Thrailkill EA, Bouton ME (2017) Factors that influence the persistence and relapse of discriminated behavior chains. Behav Process 141:3–10Google Scholar
  109. Thrailkill EA, Trott JM, Zerr CL, Bouton ME (2016) Contextual control of chained instrumental behaviors. J Exp Psychol: Anim Learn Cogn 42:401–414Google Scholar
  110. Todd TP (2013) Mechanisms of renewal after the extinction of instrumental behavior. J Exp Psychol Anim Behav Process 39:193–207PubMedPubMedCentralGoogle Scholar
  111. Todd TP, Winterbauer NE, Bouton ME (2012) Effects of the amount of acquisition and contextual generalization on the renewal of instrumental behavior after extinction. Learn Behav 40:145–157PubMedGoogle Scholar
  112. Todd TP, Vurbic D, Bouton ME (2014) Mechanisms of renewal after the extinction of discriminated operant behavior. J Exp Psychol: Anim Learn Cogn 40:355–368Google Scholar
  113. Torres SJ, Nowson CA (2007) Relationship between stress, eating behavior, and obesity. Nutrition 23:887–894Google Scholar
  114. Trask S (2019) Cues associated with alternative reinforcement during extinction can attenuate resurgence of an extinguished instrumental response. Learn Behav in pressGoogle Scholar
  115. Trask S, Bouton ME (2014) Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning. Learn Behav 42:281–288PubMedPubMedCentralGoogle Scholar
  116. Trask S, Bouton ME (2016) Discriminative properties of the reinforcer can be used to attenuate the renewal of extinguished operant behavior. Learn Behav 44:151–161PubMedPubMedCentralGoogle Scholar
  117. Trask S, Bouton ME (2018) Retrieval practice after multiple context changes, but not long retention intervals, reduces the impact of a final context change on instrumental behavior. Learn Behav 46:213–221PubMedGoogle Scholar
  118. Trask S, Schepers ST, Bouton ME (2015) Context change explains resurgence after the extinction of operant behavior. Mex J Behav Anal 41:187–210Google Scholar
  119. Trask S, Shipman ML, Green JT, Bouton ME (2017a) Inactivation of the prelimbic cortex attenuates context-dependent operant responding. J Neurosci 37:2317–2324PubMedPubMedCentralGoogle Scholar
  120. Trask S, Thrailkill EA, Bouton ME (2017b) Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning. Behav Process 137:64–72Google Scholar
  121. Trask S, Keim CL, Bouton ME (2018) Factors that encourage generalization from extinction to test reduce resurgence of an extinguished operant response. J Exp Anal Behav 110:11–23PubMedGoogle Scholar
  122. Vurbic D, Bouton ME (2011) Secondary extinction in Pavlovian fear conditioning. Learn Behav 39:202–211PubMedPubMedCentralGoogle Scholar
  123. Welker RL, McAuley K (1978) Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli. Anim Learn Behav 6:451–457Google Scholar
  124. Willcocks AL, McNally GP (2014) An extinction retrieval cue attenuates renewal but not reacquisition of alcohol seeking. Behav Neurosci 128:83–91PubMedGoogle Scholar
  125. Winterbauer NE, Bouton ME (2010) Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 36:343–353PubMedPubMedCentralGoogle Scholar
  126. Winterbauer NE, Bouton ME (2011) Mechanisms of resurgence II: response-contingent reinforcers can reinstate a second extinguished behavior. Learn Motiv 42:154–164PubMedPubMedCentralGoogle Scholar
  127. Winterbauer NE, Bouton ME (2012) Effects of thinning the rate at which the alternative behavior is reinforced on resurgence of an extinguished instrumental response. J Exp Psychol Anim Behav Process 38:279–291PubMedPubMedCentralGoogle Scholar
  128. Zapata A, Minney VL, Shippenberg TS (2010) Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci 30:15457–15463PubMedPubMedCentralGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.University of VermontBurlingtonUSA

Personalised recommendations