Abstract
In three experiments, we examined the effects of signaling reinforcement during operant responding in order to illuminate the factors underlying instrumental overshadowing and potentiation effects. Specifically, we examined whether signaling reinforcement produces an enhancement and attentuation of responding when the response-reinforcer correlation is weak and strong, respectively. In Experiment 1, rats responded on variable-ratio (VR) or variable-interval (VI) schedules that were equated for the number of responses emitted per reinforcer. A signal correlated with reinforcement enhanced response rates on the VR schedule, but attenuated response rates were produced by the signal on the VI schedule. In Experiment 2, two groups of rats responded on a VI schedule while the two other groups received a conjoint VI, negative fixed-ratio schedule in which the subjects lost the availability of reinforcements if they emitted high response rates. A reinforcement signal attenuated responding for the simple VI groups but not for the animals given the negative fixed-ratio component, although the signal improved response efficiency in both groups. In Experiment 3, a poor correlation between responding and reinforcement was produced by a VI schedule onto which the delivery of response-independent food was superimposed. A signal for reinforcement initially elevated responding on this schedule, relative to an unsignaled condition; however, this pattern was reversed with further training. In sum, the present experiments provide little support for the view that signaling reinforcement enhances responding when the response-reinforcer correlation is weak and attenuates responding when this correlation is strong.
References
Baum, W. M. (1973). The correlation-based law of effect.Journal of the Experimental Analysis of Behavior,20, 137–155.
Bouton, M. E., Jones, D. L., McPhillips, S. A., &Swartzentruber, D. (1986). Potentiation and overshadowing in odor-aversion learning: Role of method of odor presentation, the distal-proximal cue distinction, and the conditionability of odor.Learning & Motivation,17, 115–138.
Catania, A. C., &Keller, J. (1981). The concept of causation. In P. Harzem & M. Zeiler (Eds.),Advances in analysis of behavior: Vol. 2. Contiguity, contingency, and correlation (pp. 125–167). New York: Wiley.
Colwill, R. M., &Rescorla, R. A. (1988). The role of response-reinforcer associations increases throughout extended instrumental training.Animal Learning & Behavior,16, 105–111.
Dickinson, A., &Charnock, D. J. (1985). Contingency effects with maintained instrumental reinforcement.Quarterly Journal of Experimental Psychology,37B, 397–416.
Dickinson, A., Peters, R. C., &Shechter, S. (1984). Overshadowing of responding on ratio and interval schedules by an independent predictor of reinforcement.Behavioral Processes,9, 421–429.
Ettinger, R. H., Raw, A. K., &Staddon, J. E. R. (1987). Sensitivity to molar feedback functions: A test of molar optimality theory.Journal of Experimental Psychology: Animal Behavior Processes,13, 366–375.
Gibbon, J., &Balsam, P. (1981). Spreading associations in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.),Autoshaping and conditioning theory (pp. 219–253). New York: Academic Press.
Hall, G., Channell, S., &Schachtman, T. R. (1987). The instrumental overshadowing effect in pigeons: The role of response bursts.Quarterly Journal of Experimental Psychology,39B, 173–188.
Hammond, L. J. (1980). The effect of contingency upon appetitive conditioning of free-operant behavior.Journal of the Experimental Analysis of Behavior,34, 297–304.
Hammond, L. J., &Paynter, W. E., Jr. (1983). Probabilistic contingency theories of animal conditioning: A critical analysis.Learning & Motivation,14, 527–550.
Iversen, I. H. (1981). Response interaction with signaled delay of reinforcement.Behavioral Analysis Letters,1, 3–9.
Kasprow, W. J., Schachtman, T. R., &Miller, R. R. (1987). The comparator hypothesis of conditioned response generation: Manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing.Journal of Experimental Psychology: Animal Behavior Processes,13, 395–406.
Pearce, J. M., &Hall, G. (1978). Overshadowing the instrumental conditioning of a lever press response by a more valid predictor of the reinforcer.Journal of Experimental Psychology: Animal Behavior Processes,4, 356–367.
Rachlin, H. A., &Baum, W. M. (1972). Effects of alternative reinforcement: Does the source matter?Journal of the Experimental Analysis of Behavior,18, 231–241.
Reed, P., &Schachtman, T. R. (1989). Instrumental responding by rats on free-operant schedules with components that schedule response-dependent reinforcer omission: Implications for optimization theories.Animal Learning & Behavior,17, 328–338.
Reed, P., Schachtman, T. R., &Hall, G. (1988a). Overshadowing and potentiation of instrumental responding in rats as a function of the schedule of reinforcement.Learning & Motivation,19, 13–30.
Reed, P., Schachtman, T. R., &Hall, G. (1988b). Potentiation of responding on a VR schedule by a stimulus correlated with reinforcement: Effects of diffuse and localized signals.Animal Learning & Behavior,16, 75–82.
Rescorla, R. A. (1968). Probability of shock in the presence and absence of the CS in fear conditioning.Journal of Comparative & Physiological Psychology,66, 1–5.
Richards, R. W. (1981). A comparison of signaled and unsignaled delay of reinforcement.Journal of the Experimental Analysis of Behavior,35, 145–152.
Roberts, J. E., Tarpy, R. M., &Lea, S. E. G. (1984). Stimulus-response overshadowing: Effects of signaling reward On instrumental responding as measured by response rate and resistance to change.Journal of Experimental Psychology: Animal Behavior Processes,10, 244–255.
Schachtman, T. R., Reed, P., &Hall, G. (1987). Enhancement and attenuation of instrumental responding by signals for reinforcement on a VI schedule.Journal of Experimental Psychology: Animal Behavior Processes,13, 271–279.
Tarpy, R. M., &Roberts, J. E. (1985). Effects of signaled reward in instrumental conditioning: Enhanced learning on DRL and DRH schedules of reinforcement.Animal Learning & Behavior,13, 6–12.
Vaughan, W. (1982). Choice and the Rescorla-Wagner model. In M. L. Commons, R. J. Herrnstein, & H. Rachlin (Eds.),Quantitative analysis of behavior: Vol. 2. Matching and maximizing accounts (pp. 263–279). Cambridge, MA: Ballinger.
Vaughan, W., &Miller, H. L. (1984). Optimization versus response-strength accounts of behavior.Journal of the Experimental Analysis of Behavior,42, 337–348.
Williams, B. A., &Heyneman, N. (1982). Multiple determinants of “blocking” effects on operant behavior.Animal Learning & Behavior,10, 72–76.
Author information
Authors and Affiliations
Additional information
This research was supported in part by a grant from the United Kingdom Science and Engineering Research Council to G. Hall, and by funds from the University of Missouri.
Rights and permissions
About this article
Cite this article
Schachtman, T.R., Reed, P. The role of response-reinforcer correlation in signaled reinforcement effects. Animal Learning & Behavior 18, 51–58 (1990). https://doi.org/10.3758/BF03205239
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03205239
Keywords
- Variable Ratio Schedule
- Reinforcement Delay
- Nonreinforced Response
- Unsignaled Condition
- AnimalBehavior Process