Abstract
Token economies have been used to prompt and organize human economic behavior for centuries. Features important to the establishment and maintenance of token systems began to be formally studied in the laboratory around the turn of the twentieth century. Since that time, their utility in application has been considered one of the most important advances not only within behavior analysis but also in the field of psychology more generally. This chapter reviews laboratory research that has proven foundational to understanding how best to profitably arrange token economies in application. Literature concerning the relative influence of token economic features (token production, exchange production, and token exchange) is reviewed, along with research addressing how best to condition tokens as important stimuli, how to train extended behavioral chains, and how the inclusion of aversive techniques impacts responding. Beyond providing a basis for the effective development and implementation of token economies, the following will ideally function to advance the translational interchange between research and application regarding issues of social importance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ator, N. A. (1991). Subjects and instrumentation. In I. H. Iverson & K. A. Lattal (Eds.), Techniques in the behavioral and neural sciences: experimental analysis of behavior, Part I. Amsterdam: Elsevier Science Publishers. doi:10.1016/B978-0-444-81251-3.50005-9
Avendano y Carderera, M. (1859). Curso elemental de pedagogia (4th ed.). Madrid: Imprenta de D. Victoriano Hernando.
Ayllon, T., & Azrin, N. H. (1965). The measurement and reinforcement of behavior of psychotics. Journal of the Experimental Analysis of Behavior, 8, 357–383. doi:10.1901/jeab.1965.8-357.
Ayllon, T., & Azrin, N. H. (1968). The token economy: A motivational system for therapy and rehabilitation. New York: Appleton-Century-Crofts. doi:10.1016/0005-7967(69)90022-9
Azrin, N. H. (1960a). Effects of punishment intensity during variable-interval reinforcement. Journal of the Experimental Analysis of Behavior, 3, 123–142. doi:10.1901/jeab.1960.3-123.
Azrin, N. H., & Holz, W. C. (1966). Punishment. In W. K. Honig (Ed.), Operant behavior: Areas of research and applications (pp. 380–447). East Norwalk: Appleton-Century-Crofts.
Azrin, N. H., Holz, W. C., & Hake, D. F. (1963). Fixed-ratio punishment. Journal of the Experimental Analysis of Behavior, 6, 141–148. doi:10.1901/jeab.1963.6-141.
Boakes, R. A., Poli, M. M., Lockwood, M. J., & Goodall, G. G. (1978). A study of misbehavior: Token reinforcement in the rat. Journal of the Experimental Analysis of Behavior, 31, 71–81. doi:10.1901/jeab.1978.29-115.
Bouton, M. E. (2007). Learning and behavior: A contemporary synthesis. Sunderland: Sinauer Associates.
Branch, M. N. (2006). Roger T. Kelleher, behavior analyst. Journal of Applied Behavior Analysis, 86, 371–384. doi:10.1901/jeab.2006.25-06.
Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681–684. doi:10.1037/h0040090.
Brosnan, S. F., & de Waal, F. B. M. (2005). Responses to a simple barter task in chimpanzees, Pan troglodytes. Primates, 46, 173–182. doi: 10.1007/s10329-005-0125-0.
Bullock, C. E., & Hackenberg, T. D. (2006). Second-order schedules of token reinforcement with pigeons: Implications for unit price. Journal of the Experimental Analysis of Behavior, 85, 95–106. doi:10.1901/jeab.2006.116-04.
Burchard, J. D., & Barrera, F. (1972). An analysis of timeout and response cost in a programmed environment. Journal of Applied Behavior Analysis, 5, 271–282. doi:10.1901/jaba.1972.5-271.
Capaldi, E. J. (1967). A sequential hypothesis of instrumental learning. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 1). New York: Academic. doi:10.1016/S0079-7421(08)60513-7
Carr, E. G., & Durand, V. M. (1985). Reducing behavior problems through functional communication training. Journal of Applied Behavior Analysis, 18, 111–126. doi:10.1901/jaba.1985.18-111.
Conyers, C., Miltenberger, R., Maki, A., Barenz, R., Jurgens, M., Sailer, A., et al. (2004). A comparison of response cost and differential reinforcement of other behavior to reduce disruptive behavior in a preschool classroom. Journal of Applied Behavior Analysis, 37, 411–415. doi:10.1901/jaba.2004.37-411.
Cowles, J. T. (1937). Food-tokens as incentives for learning by chimpanzees. Comparative Psychological Monographs, 12, 1–96. doi:10.1037/14268-000.
Dallery, J., Silverman, K., Chutuape, M. A., Bigelow, G. E., & Stitzer, M. L. (2001). Voucher-based reinforcement of opiate plus cocaine abstinence in treatment-resistant methadone patients: Effects of reinforcer magnitude. Experimental and Clinical Psychopharmacology, 9, 317–325. doi:10.1037/1064-1297.9.3.317.
Dalton, A. J., Rubino, C. A., & Hislop, M. W. (1973). Some effects of token rewards on school achievement of children with Down’s syndrome. Journal of Applied Behavior Analysis, 6, 251–259. doi:10.1901/jaba.1973.6-251.
de Wit, H. (1996). Priming effects with drugs and other reinforcers. Experimental and Clinical Psychopharmacology, 4, 5–10. doi:10.1037/1064-1297.4.1.5.
DeLeon, I. G., & Iwata, B. A. (1996). Evaluation of a multiple-stimulus presentation format for assessing reinforce preferences. Journal of Applied Behavior Analysis, 29(4), 519–533. doi:10.1901/jaba.1996.29-519.
Delgado, J. M. R. (1963). Telemetry and telestimulation of the brain. In L. Slater (Ed.), Bio-telemetry (231–249). Oxford: Pergamon Press.
Dewsbury, D. A. (2003). Conflicting approaches: Operant psychology arrives at a primate laboratory. The Behavior Analyst, 26, 253–265.
Dinsmoor, J. A. (1983). Observing and conditioned reinforcement. Behavioral and Brain Sciences, 6, 693–704. doi:10.1017/S0140525X00017969.
Ellson, D. G. (1937). The acquisition of a token-reward habit in dogs. Journal of Comparative Psychology, 24, 505–522. doi:10.1037/h0063238.
Fantino, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 313–339). Englewood Cliffs: Prentice-Hall.
Flagel, S. B., Watson, S. J., Robinson, T. E., & Akil, H. (2007). Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmacology, 191, 599–607. doi:10.1007/s00213-006-0535-8.
Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts. doi:10.1037/10627-000
Foster, T. A., Hackenberg, T. D., & Vaidya, M. (2001). Second-order schedules of token reinforcement with pigeons: Effects of fixed- and variable-ratio exchange schedules. Journal of the Experimental Analysis of Behavior, 76, 159–178. doi:10.1901/jeab.2001.76-159.
Fox, D. K., Hopkins, B. L., & Anger, W. K. (1987). The long-term effects of a token economy on safety performance in open-pit mining. Journal of Applied Behavior Analysis, 20, 215–224. doi:10.1901/jaba.1987.20-215.
Gladman, F. J. (1885). School work: Organization and principles of education. London: Jarrold and Sons.
Grace, R. C. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113–129. doi:10.1901/jeab.1994.61-113.
Hackenberg, T. D. (2009). Token reinforcement: A review and analysis. Journal of the Experimental Analysis of Behavior, 91, 257–286. doi:10.1901/jeab.2009.91-257.
Hackenberg, T. D., & Vaidya, M. (2003). Determinants of pigeons’ choices in token-based self-control procedures. Journal of the Experimental Analysis of Behavior, 79, 207–218. doi:10.1901/jeab.2003.79-207.
Hake, D. F., Azrin, N. H., & Oxford, R. (1967). The effects of punishment intensity on squirrel monkeys. Journal of the Experimental Analysis of Behavior, 10, 95–107. doi:10.1901/jeab.1967.10-95.
Hendry, D. P. (1969). Conditioned reinforcement. Homewood: The Dorsey Press.
Henson, F. O. II (1975). An investigation of the effects of token reinforcement on divergent verbal responding. Journal of Applied Behavior Analysis, 8, 459. doi:10.1901/jaba.1975.8-459.
Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267–272. doi:10.1901/jeab.1961.4-267.
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–266. doi:10.1901/jeab.1970.13-243.
Higgins, S. T., Delaney, D. D., Budney, A. J., Bickel, W. K., Hughes, J. R., Foerg, F., et al. (1991). A behavioral approach to achieving initial cocaine abstinence. The American Journal of Psychiatry, 148, 1218–1224.
Hobbes, T. (2010). Leviathan- Revised Edition. In A. P. Martinich & B. Battiste (Eds.), Peterborough: Broadview Press.
Ingham, R. J. (1983). On token reinforcement and stuttering therapy: Another view on findings reported by Howie and Woods (1982). Journal of Applied Behavior Analysis, 16, 465–470. doi:10.1901/jaba.1983.16-465.
Iwata, B. A., Dorsey, M. F., Slifer, K. J., Bauman, K. E., & Richman, G. S. (1982). Toward a functional analysis of self-injury. Analysis and Intervention in Developmental Disabilities, 2, 3–20. doi:10.1016/0270-4684(82)90003-9.
Jackson, K., & Hackenberg, T. D. (1996). Token reinforcement, choice, and self-control in pigeons. Journal of the Experimental Analysis of Behavior, 66, 29–49. doi:10.1901/jeab.1996.66-29.
Kazdin, A. E. (1972). Response cost: The removal of conditioned reinforcers for therapeutic change. Behavior Therapy, 3, 533–546. doi:10.1016/S0005-7894(72)80001-7.
Kazdin, A. E. (1977). The token economy: A review and evaluation. New York: Plenum Press. doi:10.1007/978-1-4613-4121-5.
Kazdin, A. E., & Bootzin, R. R. (1972). The token economy: An evaluative review. Journal of Applied Behavior Analysis, 5, 343–372. doi:10.1901/jaba.1972.5-343.
Kelleher, R. T. (1956). Intermittent conditioned reinforcement in chimpanzees. Science, 124, 679–680. doi:10.1126/science.124.3224.679.
Kelleher, R. T. (1957). Conditioned reinforcement in chimpanzees. Journal of Comparative and Physiological Psychology, 49, 571–575. doi:10.1037/h0044327.
Kelleher, R. T. (1958). Fixed-ratio schedules of conditioned reinforcement with chimpanzees. Journal of the Experimental Analysis of Behavior, 1, 281–289. doi:10.1901/jeab.1958.1-281.
Kelleher, R. T. (1966). Chaining and conditioned reinforcement. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 160–212). New York: Appleton-Century-Crofts.
Lagorio, C. H., & Hackenberg, T. D. (2010). Risky choice in pigeons and humans: A cross-species comparison. Journal of the Experimental Analysis of Behavior, 93, 27–44. doi:10.1901/jeab.2010.93-27.
Lagorio, C. H., & Hackenberg, T. D. (2012). Risky choice in pigeons: Preference for amount variability using a token-reinforcement system. Journal of the Experimental Analysis of Behavior, 98, 139–154. doi:10.1901/jeab.2012.98-139.
Lattal, K. A. (1991). Scheduling positive reinforcers. In I. H. Iverson & K. A. Lattal (Eds.), Techniques in the behavioral and neural sciences: Experimental analysis of behavior, Part I. Amsterdam: Elsevier Science Publishers. doi:10.1016/B978-0-444-81251-3.50005-9
Logan, D. L. (1970). A “paper money” token system as a recording aid in institutional settings. Journal of Applied Behavior Analysis, 3, 183–184. doi:10.1901/jaba.1970.3-183.
Lucas, G. A., Deich, J. D., & Wasserman, E. A. (1981). Trace autoshaping: Acquisition, maintenance, and path dependence at long trace intervals. Journal of the Experimental Analysis of Behavior, 36, 61–74. doi:10.1901/jeab.1981.36-61.
Macaskill, A. C., & Hackenberg, T. D. (2012). The sunk cost effect with pigeons: Some determinants of decisions about persistence. Journal of the Experimental Analysis of Behavior, 97, 85–100. doi:10.1901/jeab.2012.97-85.
Mackintosh, N. J. (1974). The psychology of animal learning. London: Academic.
Malagodi, E. F. (1967a). Acquisition of the token-reward habit in the rat. Psychological Reports, 20, 1335–1342. doi:10.2466/pr0.1967.20.3c.1335.
Malagodi, E. F. (1967b). Fixed-ratio schedules of token reinforcement. Psychonomic Science, 8, 469–470.
Malagodi, E. F. (1967c). Variable-interval schedules of token reinforcement. Psychonomic Science, 8, 471–472.
Malagodi, E. F., Webbe, F. M., & Waddell, T. R. (1975). Second-order schedules of token reinforcement: Effects of varying the schedule of food presentation. Journal of the Experimental Analysis of Behavior, 24, 173–181. doi:10.1901/jeab.1975.24-173.
Marholin, D. II, & Gray, D. (1976). Effects of group response-cost procedures on cash shortages in a small business. Journal of Applied Behavior Analysis, 9, 25–30. doi:10.1901/jaba.1976.9-25.
Matson, J. L., & Boisjoli, J. A. (2009). The token economy for children with intellectual disability and/or autism: A review. Research in Developmental Disabilities, 30, 240–248. doi:10.1016/j.ridd.2008.04.001.
Mazur, J. E. (1983). Steady-state performance on fixed-, mixed-, and random-ratio schedules. Journal of the Experimental Analysis of Behavior, 39, 293–307. doi:10.1901/jeab.1983.39-293.
Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin & H. Rachlin (Eds.), Quantitative analyses of behavior: The effect of delay and of intervening events on reinforcement value (pp. 55–73). Hillsdale: Lawrence Erlbaum Associates.
Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96–112. doi:10.1037/0033-295X.108.1.96.
Mazur, J. E. (2006). Learning and behavior. Upper Saddle River: Pearson Prentice Hall.
Mazur, J. E., & Biondi, D. R. (2013). Pigeons’ choices with token stimuli in concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 99, 159–178. doi:10.1002/jeab.12.
McCulloch, T. L. (1937). The use of the “comfort” drive as motivation in visual discrimination by the infant chimpanzee. (Paper delivered at the 8th spring meeting, Eastern Branch of the American Psychological Association, April 3).
McDowell, J. J. (1988). Matching theory in natural human environments. The Behavior Analyst, 11, 95–108.
McDowell, J. J. (1989). Two modern developments in matching theory. The Behavior Analyst, 12, 153–166.
Miller, L. K. (2006). Principles of everyday behavior analysis (4th ed.). Belmont: Wadsworth., Centage Learning.
Miltenberger, R. G. (2012). Behavior modification: Principles and procedures. Belmont: Wadsworth/Cengage Learning.
Mischel, W., & Ebbesen, E. B. (1970). Attention in delay of gratification. Journal of Personality and Social Psychology, 16, 329–337. doi:10.1037/h0029815.
Morris, N. (2002). Maconochie’s gentlemen: The story of Norfolk Island and the roots of modern prison reform. New York: Oxford University Press. doi:10.1177/0032885502250397
Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23, 73–90. doi:10.1017/S0141525X00002405.
Pavlov, I. P. (1927). Conditioned reflexes. Oxford: Oxford University Press.
Petry, N. M. (2013). Contingency management for substance abuse treatment: A guide to implementing this evidence-based practice. New York: Routledge. doi:10.1080/1533256X.2013.842097
Phillips, E. L. (1968). Achievement place: Token reinforcement procedures in a home-style rehabilitation setting for pre-delinquent boys. Journal of Applied Behavior Analysis, 1, 213–223. doi:10.1901/jaba.1968.1-213.
Pietras, C. J., & Hackenberg, T. D. (2005). Response-cost punishment via token loss with pigeons. Behavioural Processes, 69, 343–356. doi:10.1016/j.beproc.2005.02.026.
Pietras, C. J., Brandt, A. E., & Searcy, G. D. (2010). Human responding on random-interval schedules of response-cost punishment: The role of reduced reinforcement density. Journal of the Experimental Analysis of Behavior, 93, 5–26. doi:10.1901/jeab.2010.93-5.
Prusky, G. T., Harker, K. T., Douglas, R. M., & Wishaw, I. Q. (2002). Variation in visual acuity within pigmented and between pigmented and albino rat strains. Behavioural Brain Research, 136, 339–348. doi:10.1016/S0166-4328(02)00126-2.
Raiff, B. R., Bullock, C. E., & Hackenberg, T. D. (2008). Response-cost punishment with pigeons: Further evidence of response suppression via token loss. Learning & Behavior, 36, 29–41. doi:10.3758/lb.36.1.29.
Reid, P. J. (1996). Excel-erated learning: Explaining in plain English how dogs learn and how best to teach them. Berkeley: James & Kenneth Publishers.
Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory. New York: Appleton-Century-Crofts.
Rodriguez, J. O., Montesinos, L., & Preciado, J. (2005). A 19th century predecessor of the token economy. Journal of Applied Behavior Analysis, 38, 427. doi:10.1901/jaba.2005.181-03.
Russo, D. C., & Koegel, R. L. (1977). A method for integrating an autistic child into a normal public-school classroom. Journal of Applied Behavior Analysis, 10, 579–590. doi:10.1901/jaba.1977.10-579.
Schlinger, H. D., Derenne, A., & Baron, A. (2008). What 50 years of research tell us about pausing under ratio schedules of reinforcement. The Behavior Analyst, 31, 39–60.
Schmandt-Besserat, D. (2012). Tokens in China, Europe and Africa—the significance. SCRIPTA, 4, 1–11.
Silverman, K. (2004). Exploring the limits and utility of operant conditioning in the treatment of drug addiction. The Behavior Analyst, 27, 209–230.
Silverman, K., Chutuape, M. A., Bigelow, G. E., & Stitzer, M. L. (1999). Voucher-based reinforcement of cocaine abstinence in treatment-resistant methadone patients: Effects of reinforcement magnitude. Psychopharmacology, 146, 128–138. doi:10.1007/s002130051098.
Shahan, T. A. (2010). Conditioned reinforcement and response strength. Journal of the Experimental Analysis of Behavior, 93, 269–289. doi:10.1901/jeab.2010.93-269.
Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. Oxford: Appleton-Century. doi:10.2307/1416495
Skinner, B. F. (1953). Science and Human Behavior. New York: Macmillan. doi:10.1002/sce.37303805120
Skinner, B. F. (1957). Verbal Behavior. New York: Appleton-Century-Crofts.
Smith, M. F. (1939). The establishment and extinction of the token-reward habit in the cat. The Journal of General Psychology, 20, 475–486. doi:10.1080/00221309.1939.9710023.
Sousa, C., & Matsuzawa, T. (2001). The use of tokens as rewards and tools by chimpanzees (Pan troglodytes). Animal Cognition, 4, 213–221. doi: 10.1007/s100710100104.
Stitzer, M. L., Petry, N. M., & Pierce, J. (2010). Motivational incentives research in the national drug abuse treatment clinical trials network. Journal of Substance Abuse Treatment, 38, 61–69. doi:10.1016/j.jsat.2009.12.010.
Thorndike, E. L. (1927). The law of effect. American Journal of Psychology, 39, 212–222. doi:10.2307/1415413.
Touchette, P. E., & Howard, J. S. (1984). Errorless learning: Reinforcement contingencies and stimulus control transfer in delayed prompting. Journal of Applied Behavior Analysis, 17, 175–188. doi:10.1901/jaba.1984.17-175.
Van Houten, R., Axelrod, S., Bailey, J. S., & Favell, J. E., Foxx, R. M., Iwata, B. A., & Lovaas, O. I. (1988). The right to effective behavioral treatment. The Behavior Analyst, 11, 111–114. doi:10.1901/jaba.1988.21-381.
Waddell, T. R., Leander, J. D., Webbe, F. M., & Malagodi, E. F. (1972). Schedule interactions in second-order fixed-interval (fixed-ratio) schedules of token reinforcement. Learning & Motivation, 3, 91–100. doi:10.1016/0023-9690(72)90050-1.
Wallace, I. (1977). Self-control techniques of famous novelists. Journal of Applied Behavior Analysis, 10, 515–525. doi:10.1901/jaba.1977.10-515.
Webbe, F. M., & Malagodi, E. F. (1978). Second-order schedules of token reinforcement: Comparisons of performance under fixed-ratio and variable-ratio exchange schedules. Journal of the Experimental Analysis of Behavior, 30, 219–224. doi:10.1901/jeab.1978.30-219.
Weiner, H. (1962). Some effects of response cost upon human operant behavior. Journal of the Experimental Analysis of Behavior, 5, 201–208. doi:10.1901/jeab.1962.5-201.
Weiner, H. (1963). Response cost and aversive control of human operant behavior. Journal of the Experimental Analysis of Behavior, 6, 415–421. doi:10.1901/jeab.1963.6-415.
Weiner, H. (1964). Response cost and fixed-ratio performance. Journal of the Experimental Analysis of Behavior, 7, 79–81. doi:10.1901/jeab.1964.7-79.
Williams, B. A. (1994). Conditioned reinforcement: Experimental and theoretical issues. The Behavior Analyst, 17, 261–285.
Wolfe, J. B. (1936). Effectiveness of token rewards for chimpanzees. Comparative Psychological Monographs, 12, 1–72.
Yankelevitz, R. L., Bullock, C. E., & Hackenberg, T. D. (2008). Reinforcer accumulation in a token-reinforcement context. Journal of the Experimental Analysis of Behavior, 90, 283–299. doi:10.1901/jeab.2008.90-283.
Zimmerman, J., & Ferster, C. B. (1964). Chained VI performance of pigeons maintained with an added stimulus. Journal of the Experimental Analysis of Behavior, 7, 83–89. doi:10.1901/jeab.1964.7-83.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this chapter
Cite this chapter
Lagorio, C., Yanagita, B. (2015). Basic Research Informing the Use of Token Economies in Applied Settings. In: DiGennaro Reed, F., Reed, D. (eds) Autism Service Delivery. Autism and Child Psychopathology Series. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-2656-5_8
Download citation
DOI: https://doi.org/10.1007/978-1-4939-2656-5_8
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-2655-8
Online ISBN: 978-1-4939-2656-5
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)