Abstract
The effect of noncontingent outcomes on an instrumental response-outcome (R-O) association was examined in four experiments using transfer tests. In each experiment, rats were first given instrumental discrimination training designed to establish different stimuli as signals (S+s) for different outcomes. Transfer responses were subjected to different treatments across the experiments and then tested with the S+s. In Experiments 1 and 2, two transfer responses were both initially trained with two contingent outcomes. Then, each transfer response was subjected either to the addition of noncontingent presentations of one of those outcomes (Experiment 1) or to the replacement of one of the contingent outcomes with noncontingent presentations of that outcome (Experiment 2). Transfer tests revealed no significant difference in the ability of an S+ to promote performance of a transfer response based on their shared association with either the contingent or the noncontingent outcome. These results suggest that a response reinforced with two outcomes remains equally well associated with both of those outcomes despite prolonged exposure to noncontingent presentations of one of those outcomes. In Experiments 3 and 4, the possibility that the noncontingent schedules of reinforcement used in Experiments 1 and 2 might be capable of establishing an association between a response and its noncontingent outcome was examined. Transfer responses were trained with one contingent outcome and a different noncontingent outcome. Performance of these transfer responses was augmented more by presentations of an S+ trained with the contingent outcome than with the noncontingent outcome. These results confirm previous reports that instrumental responses are sensitive to outcome contingencies in acquisition and that noncontingent outcome presentations do not weaken previously established R-O associations. Several explanations are considered for the failure of subsequent noncontingent presentations of an outcome to reduce the strength of its association with the instrumental response.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Adams, C. D., &Dickinson, A. (1981). Instrumental responding following reinforcer devaluation.Quarterly Journal of Experimental Psychology,33B, 109–121.
Amsel, A. (1958). The role of frustrative nonreward in noncontinuous reward situations.Psychological Bulletin,55, 102–119.
Ayres, J. J., Benedict, J. O., &Witcher, E. S. (1975). Systematic manipulation of individual events in a truly random control in rats.Journal of Comparative & Physiological Psychology,88, 97–103.
Benedict, J. O., &Ayres, J. J. (1972). Factors affecting conditioning in the truly random control procedure in the rat.Journal of Comparative & Physiological Psychology,78, 323–330.
Bolles, R. C. (1972). Reinforcement, expectancy, and learning.Psychological Review,79, 394–409.
Colwill, R. M. (1991). Negative discriminative stimuli provide information about the identity of omitted response-contingent outcomes.Animal Learning & Behavior,19, 326–336.
Colwill, R. M. (1994). Associative representations of instrumental contingencies. In D. L. Medin (Ed.),The psychology of learning and motivation (Vol. 31, pp. 1–72). New York: Academic Press.
Colwill, R. M., &Rescorla, R. A. (1985). Post-conditioning devaluation of a reinforcer affects instrumental responding.Journal of Experimental Psychology: Animal Behavior Processes,11, 120–132.
Colwill, R. M., &Rescorla, R. A. (1986). Associative structures in instrumental learning. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 20, pp. 55–104). New York: Academic Press.
Colwill, R. M., &Rescorla, R. A. (1988a). Associations between the discriminative stimulus and the reinforcer in instrumental learning.Journal of Experimental Psychology: Animal Behavior Processes,14, 155–164.
Colwill, R. M., &Rescorla, R. A. (1988b). The role of responsereinforcer associations increases throughout extended instrumental training.Animal Learning & Behavior,16, 105–111.
Colwill, R. M., &Triola, S. M. (2001).Instrumental responding remains under the control of the consequent outcome after extended training. Manuscript submitted for publication.
Davis, D. G., Staddon, J. E., Machado, A., &Palmer, R. G. (1993). The process of recurrent choice.Psychological Review,100, 320–341.
Davis, E. R., &Platt, J. R. (1983). Contiguity and contingency in the acquisition and maintenance of an operant.Learning & Motivation,14, 487–512.
Dickinson, A., &Charnock, D. J. (1985). Contingency effects with maintained instrumental reinforcement.Quarterly Journal of Experimental Psychology,37B, 397–416.
Hammond, L. J. (1980). The effect of contingency upon the appetitive conditioning of free-operant behavior.Journal of Experimental Analysis of Behavior,34, 297–304.
Mackintosh, N. J., &Dickinson, A. (1979). Instrumental (Type II) conditioning. In A. Dickinson & R. A. Boakes (Eds.),Mechanisms of learning and motivation (pp. 143–167). Hillsdale, NJ: Erlbaum.
Pearce, J. M., &Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.Psychological Review,87, 532–552.
Rescorla, R. A. (1989). Redundant treatments of neutral and excitatory stimuli in autoshaping.Journal of Experimental Psychology: Animal Behavior Processes,15, 212–223.
Rescorla, R. A. (1991). Associations of multiple outcomes with an instrumental response.Journal of Experimental Psychology: Animal Behavior Processes,17, 465–474.
Rescorla, R. A. (1992a). Response-independent outcome presentation can leave instrumental R-O associations intact.Animal Learning & Behavior,20, 104–111.
Rescorla, R. A. (1992b). Response-outcome versus outcome-response associations in instrumental learning.Animal Learning & Behavior,20, 223–232.
Rescorla, R. A. (1993). Preservation of response-outcome associations through extinction.Animal Learning & Behavior,21, 238–245.
Rescorla, R. A. (1995). Full preservation of a response-outcome association through training with a second outcome.Quarterly Journal of Experimental Psychology,48B, 252–261.
Rescorla, R. A., &Colwill, R. M. (1989). Associations with anticipated and obtained outcomes in instrumental learning.Animal Learning & Behavior,17, 291–303.
Rescorla, R. A., &Skucy, J. C. (1969). The effect of responseindependent reinforcers during extinction.Journal of Comparative & Physiological Psychology,67, 381–389.
Rescorla, R. A., &Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.),Classical conditioning II: Current research and theory (pp. 64–99). New York: Appleton-Century-Crofts.
Trapold, M. A., &Overmier, J. B. (1972). The second learning process in instrumental learning. In A. A. Black & W. F. Prokasy (Eds.),Classical conditioning II: Current research and theory (pp. 427–452). New York: Appleton-Century-Crofts.
Wagner, A. R. (1966). Frustration and punishment. In R. N. Haber (Ed.),Current research in motivation (pp. 229–239). New York: Holt, Rinehart & Winston.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by National Science Foundation Grants BNS-8915342 and IBN 9407326. I thank Scott Triola for assistance with data collection in Experiment 3.
Rights and permissions
About this article
Cite this article
Colwill, R.M. The effect of noncontingent outcomes on extinction of the response-outcome association. Animal Learning & Behavior 29, 153–164 (2001). https://doi.org/10.3758/BF03192824
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03192824