Abstract
Two experiments evaluated changes in response topography during extinction in human subjects. In Experiment 1, subjects fulfilled a sequence of DRL schedule parameters, responding on a computer keyboard to accumulate points on the monitor. Following the last DRL condition, an extinction condition was programmed during which points could no longer be accumulated. Response/reinforcer ratios increased consistently with each change in schedule parameter and interresponse time (IRT) distributions during extinction showed increased variability relative to preextinction baseline responding. In Experiment 2, subjects responded on a single DRL schedule value prior to being placed on extinction. Results paralleled those of Experiment 1, indicating greater response variability during extinction than during the DRL phase. The results are discussed within the context of a selectionist perspective on operant behavior, with extinction being identified as one ontogenic source of behavioral variability.
Similar content being viewed by others
References
ANTONITIS, J. J. (1951). Response variability in the white rat during conditioning, extinction and reconditioning. Journal of Experimental Psychology, 42, 273–281.
AZRIN, N. H., HUTCHINSON, R. R., & HAKE, D. F. (1966). Extinction-induced aggression. Journal of the Experimental Analysis of Behavior, 9, 191–204.
BARASH, D. R (1982). Sociobiology and behavior. New York: Elsevier.
BOREN, J. J., & DEVINE, D. D. (1968). The repeated acquisition of behavioral chains. Journal of the Experimental Analysis of Behavior, 11, 651–660.
CAMPBELL, D. T. (1987). Blind variation and selective retention in creative thought as in other knowledge processes. In G. Radnitzky & W.W. Bartley, III (Eds.), Evolutionary epistemology rationality and the sociology of knowledge. La Salle, IL: Open Court.
CATANIA, A. C., & HARNARD, S. (Eds.) (1986). The selection of behavior. The operant behaviorism of B. F. Skinner: Comments and consequences. New York: Cambridge University Press.
COSMIDES, L., & TOOBY, J. (1989). Evolutionary psychology and the generation of culture, Part 1: Theoretical considerations. Ethology and Sociobiology, 10, 29–49.
CRAWFORD, C. B. (1989). The theory of evolution: Of what value to psychology? Comparative Psychology, 103, 4–22.
CRAWFORD, C. B., & ANDERSON, J. L. (1989). Sociobiology: An environmental discipline? American Psychologist, 44, 1449–1459.
DONAHOE, J. W., BURGOS, J. E., & PALMER, D. C. (1993). Selectionist approach to reinforcement. Journal of the Experimental Analysis of Behavior, 58, 17–40.
DONAHOE, J. W., & PALMER, D. C. (1994). Learning and complex behavior. Boston: Allyn & Bacon.
EPSTEIN, R. (1983). Resurgence of previously reinforced behavior during extinction. Behavior Analysis Letters, 3, 391–397.
EPSTEIN, R. (1985). Extinction-induced resurgence: Preliminary investigations and possible applications. The Psychological Record, 35, 143–153.
FERSTER, C. B., & SKINNER, B. F. (1957). Schedules of reinforcement New York: Appleton-Century-Crofts.
GRUBER, H. E., & DAVIS, S. N. (1988). Inching our way up Mount Olympus: The evolving systems approach to creativity. In R. J. Sternberg (Ed.), The nature of creativity: Contemporary psychological perspectives (pp. 243–270). Cambridge: Cambridge University Press.
HARLOW, H. F. (1949). The formation of learning sets. Psychological Review, 56, 51–65.
HONIG, W. K., & STADDON, J. E. R. (1977). Handbook of operant behavior. Englewood Cliffs, NJ: Prentice-Hall.
HUMPHREYS, L. G. (1939). Acquisition and extinction of verbal expectations in a situation analogous to conditioning. Journal of Experimental Psychology, 25, 294–301.
JOHNSTON, J. M., & PENNYPACKER, H. S. (1993). Strategies and tactics of behavioral research. Hillsdale, NJ: Lawrence Erlbaum.
KOHLER, W. (1925). The mentality of apes. New York: Harcourt, Brace.
LOVAAS, I. O., & SIMMONS, J. Q. (1969). Manipulation of self-destruction in three retarded children. Journal of Applied Behavior Analysis, 2, 143–157.
MACHADO, A. (1989). Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior, 52, 155–166.
NEISWORTH, J. T., & MOORE, F. (1972). Operant treatment of asthmatic responding with the parent as therapist. Behavior Therapy, 3, 95–99.
NEWELL, A., & SIMON, H. A. (1972). Human problem solving. Englewood Cliffs, NY: Prentice Hall.
PAGE, S., & NEURINGER, A. (1985). Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes, 11, 429–452.
PERKINS, D. N. (1988). The possibility of invention. In R. J. Sternberg (Ed.), The nature of creativity: Contemporary psychological perspectives (pp. 362–385). Cambridge: Cambridge University Press.
PRYOR, K. W., HAAG, R., & O’REILLY, J. (1969). The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior, 12, 653–661.
RICHELLE, M. (1987). Variation and selection: The evolutionary analogy in Skinner’s theory. In S. Modgil & C. Modgil (Eds.), B. F. Skinner: Consensus and controversy. New York: Falmer Press.
RILLING, M. (1977). Stimulus control and inhibitory processes. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 432–480). Englewood Cliffs, NJ: Prentice-Hall.
RINGEN, J. D. (1993). Adaptation, teleology, and selection by consequences. Journal of the Experimental Analysis of Behavior, 60, 3–15.
ROBBINS, D. (1971). Partial reinforcement: A selective review of the alleyway literature since 1960. Psychological Bulletin, 76, 415–431.
SCHOENFELD, W. N., HARRIS, A. H., & FARMER, J. (1966). Conditioning response variability. Psychological Reports, 19, 551–557.
SCHWARTZ, B. (1980). Development of complex stereotyped behavior in pigeons. Journal of the Experimental Analysis of Behavior, 33, 153–166.
SCHWARTZ, B. (1982). Failure to produce response variability with reinforcement. Journal of the Experimental Analysis of Behavior, 37, 171–181.
SKINNER, B. F. (1953). Science and human behavior. New York: Macmillan.
SKINNER, B. F. (1966). The ontogeny and phylogeny of behavior. Science, 153, 1203–1213.
SKINNER, B. F. (1981). Selection by consequences. Science, 213, 501–504.
STAATS, A. W. (1981). Paradigmatic behaviorism, unified theory construction, and the Zeitgeist of separatism. American Psychologist, 36, 239–256.
SYMONS, D. (1987). If we’re all Darwinians, what’s the fuss about? In C. B. Crawford, M. S. Smith, & D. Krebs (Eds.), Sociobiology and psychology: Ideas, issues, and applications (pp. 121–146). Hillsdale, NJ: Erlbaum.
TODD, J. T., MORRIS, E. K., & FENZA, K. M. (1989). Temporal organization of extinction-induced responding in preschool children. The Psychological Record, 39, 117–130.
VOGEL, R., & ANNAU, Z. (1973). An operant discrimination task allowing variability of response patterning. Journal of the Experimental Analysis of Behavior, 20, 1–6.
WEINER, H. (1965). Conditioning history and maladaptive human operant behavior. Psychological Reports, 17, 935–942.
WEINER, H. (1969). Controlling human fixed-interval performance. Journal of the Experimental Analysis of Behavior, 12, 349–373.
WEINER, H. (1972). Controlling human fixed-interval performance with fixed-ratio responding or differential reinforcement of low-rate responding in mixed schedules. Psychonomic Science, 26, 191–192.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Morgan, D.L., Lee, K. Extinction-Induced Response Variability in Humans. Psychol Rec 46, 145–159 (1996). https://doi.org/10.1007/BF03395168
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03395168