Abstract
The rules which define the formal specifications of simple schedules of reinforcement have also been used to develop more complex schedules. Within these “second-order” schedules, previously neutral stimuli acquire various degrees of behavioral control. This paper describes some of the experiments used to determine the nature of this control.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AUTOR, S. M. (1960). The strength of conditioned rein forcers as a function of frequency and probability of reinforcement. Unpublished doctoral dissertation, Harvard University.
BARRETT, J. E. (1975). Conjunctive schedules of reinforcement II: Response requirements and stimulus effects. Journal of the Experimental Analysis of Behavior, 24, 23–31.
BLACK, R. E., WALTERS, G. C., & WEBSTER, C. D. (1972). Fixed-interval limited-hold avoidance with and without signalled reinforcement. Journal of the Experimental Analysis of Behavior, 17, 75–81.
BYRD, L. D., & MARR, M. J. (1969). Relations between patterns of responding and the presentation of stimuli under second-order schedules. Journal of the Experimental Analysis of Behavior, 12, 713–722.
CATANIA, A. C., YOHALEM, R., & SILVERMAN, P. J. (1980). Contingency and stimulus change in chained schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 33, 213–219.
COHEN, S. L., CALISTO, G., & LENTZ, B. E. (1979). Separating the reinforcing and discriminative properties of brief-stimulus presentation in second-order schedules. Journal of the Experimental Analysis of Behavior, 32, 149–156.
COHEN, S. L., & STUBBS, D. A. (1976). Discriminative properties of briefly presented stimuli. Journal of the Experimental Analysis of Behavior, 25, 15–25.
CORFIELD-SUMNER, P. K., & BLACKMAN, D. E. (1976). Fixed versus variable sequences of food and stimulus presentation in second-order schedules. Journal of the Experimental Analysis of Behavior, 26, 405–413.
de LORGE, J. (1967). Fixed-interval behavior maintained by conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 10, 271–276.
de LORGE, J. (1969). The influence of pairing with primary reinforcement on the maintenance of conditioned reinforcement in second-order schedules. In D. P. Hendry (Ed.), Conditioned reinforcement. Homewood, IL: Dorsey Press.
de LORGE, J. (1971). The effects of brief stimuli presented under a multiple schedule of second-order schedules. Journal of the Experimental Analysis of Behavior, 15, 19–25.
FANTINO, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior. Englewood Cliffs, NJ: Prentice-Hall.
FERSTER, C. B., & SKINNER, B. F. (1957). Schedules of reinforcement. Englewood Cliffs, NJ: Prentice-Hall.
FRY, W., KELLEHER, R. T., & COOK, L. (1960). A mathematical index of performance on fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 3, 193–199.
GOLLUB, L. R. (1977). Conditioned reinforcement: Schedule effects. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior. Englewood Cliffs, NJ: Prentice-Hall.
HINDE, R. A. (1970). Animal behavior (2nd ed.). New York: McGraw-Hill.
KEENAN, M. (1982). Behavioural organization in schedules of reinforcement. Unpublished D. Phil, thesis, New University of Ulster.
KEENAN, M., & LESLIE, J. C. (1981). Effects of fixed-time shocks and brief stimuli on food-maintained behavior of rats. Journal of the Experimental Analysis of Behavior, 36, 353–361.
KEENAN, M., & LESLIE, J. C. (1984). Separating response dependency and response-reinforcer contiguity in a recycling conjunctive schedule. Journal of the Experimental Analysis of Behavior, 41, 203–210.
KEENAN, M., & LESLIE, J. C. (in press). Varying response-reinforcer contiguity in a recycling conjunctive schedule. Journal of the Experimental Analysis of Behavior.
KELLEHER, R. T. (1966a). Chaining and conditioned reinforcement. In W. K. Honig (Ed.), Operant behavior: Areas of research and application. Englewood Cliffs, NJ: Prentice-Hall.
KELLEHER, R. T. (1966b). Conditioned reinforcement in second-order schedules. Journal of the Experimental Analysis of Behavior, 9, 475–485.
KELLEHER, R. T., & GOLLUB, L. R. (1962). A review of positive conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 5, 543–597.
MALAGODI, E. F., DE WEESE, J., & JOHNSTON, J. M. (1973). Second-order schedules: A comparison of chained, brief-stimulus, and tandem procedures. Journal of the Experimental Analysis of Behavior, 20, 447–460.
MARR, M. J. (1969). Second-order schedules. In D. P. Hendry (Ed.), Conditioned reinforcement. Homewood, IL: Dorsey Press.
MARR, M. J. (1979). Second-order schedules and the generation of unitary response sequences. In M. D. Zeiler & P. Harzem (Eds.), Reinforcement and the organization of behavior. New York: John Wiley.
MARR, M. J., & ZEILER, M. D. (1974). Schedules of response-independent conditioned reinforcement. Journal of the Experiment Analysis of Behavior, 21, 433–444.
MORSE, W. H., & KELLEHER, R. T. (1977). Determinants of reinforcmeent and punishment. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior. Englewood Cliffs, NJ: Prentice-Hall.
NEVIN, J. A., & MANDELL, C. (1978). Conditioned reinforcement and choice. Journal of the Experimental Analysis of Behavior, 29, 135–148.
ROSE, J. E., & FANTINO, E. (1978). Conditioned reinforcement and discrimination in second-order schedules. Journal of the Experimental Analysis of Behavior, 29, 393–418.
SQUIRES, N. K., NORBORG, J., & FANTINO, E. (1975). Second-order schedules: Discrimination of components. Journal of the Experimental Analysis of Behavior, 24, 157–171.
STADDON, J. E. R. (1972). Temporal control and the theory of reinforcement schedules. In R. M. Gilbert & J. R. Millenson (Eds.), Reinforcement: Behavior analyses. New York: Academic Press.
STADDON, J. E. R. (1974). Temporal control, attention, and memory. Psychological Review, 81, 375–391.
STUBBS, D. A. (1971). Second-order schedules and the problem of conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 16, 289–313.
STUBBS, D. A., & COHEN, S. L. (1972). Second-order schedules: Comparison of different procedures for scheduling paired and nonpaired brief stimuli. Journal of the Experimental Analysis of Behavior, 18, 403–413.
STUBBS, D. A., & SILVERMAN, P. J. (1972). Second-order schedules: Brief shock at the completion of each component. Journal of the Experimental Analysis of Behavior, 17, 201–212.
STUBBS, D. A., VAUTIN, S. J., REID, H. M., & DELEHANTY, D. L. (1978). Discriminative functions of schedule stimuli and memory: A combination of schedule and choice procedures. Journal of the Experimental Analysis of Behavior, 29, 167–180.
ZEILER, M. D. (1977). Schedules of reinforcement: The controlling variables. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 201–232). Englewood Cliffs, NJ: Prentice-Hall.
ZEILER, M. D. (1984). The sleeping giant: Reinforcement schedules. Journal of the Experimental Analysis of Behavior, 42, 485–493.
Author information
Authors and Affiliations
Additional information
This paper was completed while the author was in receipt of a European Exchange Fellowship from The Royal Society of London to the University of Cologne, W. Germany. I wish to express my sincere thanks to Rudolf Koester, Jutta Hanus, and Liam Toal for their help in the preparation of the manuscript.
Rights and permissions
About this article
Cite this article
Keenan, M. Second-Order Schedules. Psychol Rec 36, 407–417 (1986). https://doi.org/10.1007/BF03394959
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03394959