Abstract
Delays are frequent and natural events in the environments of children and adults alike. Foundational research studying the impact of delays on responding has focused on two major areas: delay of reinforcement and delay discounting. Although each area has a unique methodological approach and particular theoretical implications, both examine responding under conditions of delay, raising the question of whether they might be represented by a single process. This chapter discusses these issues with a particular eye to issues of relevance for application to autism spectrum disorders.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463–496. (http://dx.doi.org/10.1037/h0076860)
Ainslie, G., & Monterosso, J. R. (2003). Building blocks of self-control: Increased tolerance for delay with bundled rewards. Journal of the Experimental Analysis of Behavior, 79(1), 37–48. (http://dx.doi.org/10.1901/jeab.2003.79–37)
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington: American Psychiatric Publishing. (http://dx.doi.org/10.1176/appi.books.9780890425596.893619)
Anderson, K. G., & Woolverton, W. L. (2005). Effects of clomipramine on self-control choice in Lewis and Fischer rats. Pharmacology, Biochemistry and Behavior, 80, 387–393. (http://dx.doi.org/10.1016/j.pbb.2004.11.015)
Appelhans, B. M., Woolf, K., Pagoto, S. L., Schneider, K. L., Whited, M. C., & Liebman, R. (2011). Inhibiting food reward: Delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women. Obesity, 19(11), 2175–2182. (http://dx.doi.org/10.1038/oby.2011.57)
Arbuckle, J. L., & Lattal, K. A. (1988). Changes in functional response units with briefly delayed reinforcement. Journal of the Experimental Analysis of Behavior, 49(2), 249–263. (http://dx.doi.org/10.1901/jeab.1988.49–249)
Audrain-McGovern, J., Rodriguez, D., Epstein, L. H., Cuevas, J., Rodgers, K., & Wileyto, E. P. (2009). Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug and Alcohol Dependence, 103(9), 99–106. (http://dx.doi.org/10.1016/j.math.2007.09.008)
Baum, W. M. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137–153. (http://dx.doi.org/10.1901/jeab.1973.20–137)
Baum, W. M. (2002). From molecular to molar: A paradigm shift in behavior analysis. Journal of the Experimental Analysis of Behavior, 78(1), 95–116. (http://dx.doi.org/10.1901/jeab.2002.78–95)
Bechara, A. (2005). Decision making, impulse control and loss of willpower to resist drugs: A neurocognitive perspective. Nature Neuroscience, 8(11), 1458–1463. (http://dx.doi.org/10.1038/nn1584)
Bickel, W. K., & Marsch, L. A. (2001). Toward a behavioral economic understanding of drug dependence: Delay discounting processes. Addiction, 96(1), 73–86. (http://dx.doi.org/10.1046/j.1360–0443.2001.961736.x)
Bickel, W. K., & Mueller, E. T. (2009). Toward the study of trans-disease processes: A novel approach with special reference to the study of co-morbidity. Journal of Dual Diagnosis, 5(2), 131–138. (http://dx.doi.org/10.1080/15504260902869147)
Bickel, W. K., Odum, A. L., & Madden, G. J. (1999). Impulsivity and cigarette smoking: Delay discounting in current, never, and ex-smokers. Psychopharmacology, 146(4), 447–454. (http://dx.doi.org/10.1007/pl00005490)
Bickel, W. K., Miller, M. L., Yi, R., Kowal, B. P., Lindquist, D. M., & Pitcock, J. A. (2007). Behavioral and neuroeconomics of drug addiction: Competing neural systems and temporal discounting processes. Drug and Alcohol Dependence, 90S, S85–S91. (http://dx.doi.org/10.1016/j.drugalcdep.2006.09.016)
Bickel, W. K., Jones, B. A., Landes, R. D., Christensen, D. R., Jackson, L., & Mancino, M. (2010). Hypothetical intertemporal choice and real economic behavior: Delay discounting predicts voucher redemptions during contingency-management procedures. Experimental and Clinical Psychopharmacology, 18(6), 546–552. (http://dx.doi.org/10.1037/a0021739)
Bickel, W. K., Landes, R. D., Christensen, D. R., Jackson, L., Jones, B. A., Kurth-Nelson, Z., & Redish, A. D. (2011a). Single- and cross-commodity discounting among cocaine addicts: The commodity and its temporal location determine discounting rate. Psychopharmacology, 217(2), 177–187. (http://dx.doi.org/10.1007/s00213–011-2272-x)
Bickel, W. K., Yi, R., Landes, R. D., Hill, P. F., & Baxter, C. (2011b). Remember the future: Working memory training decreases delay discounting among stimulant addicts. Biological Psychiatry, 69(3), 260–265. (http://dx.doi.org/10.1016/j.biopsych.2010.08.017)
Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Koffarnus, M. N., & Gatchalian, K. M. (2012). Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacology & therapeutics, 134(3), 287–297. (http://dx.doi.org/10.1016/j.pharmthera.2012.02.004)
Bickel, W. K., Wilson, G. A., Franck, T. C., Mueller, T. E., Jarmolowicz, D. P., Koffarnus, M. N., & Fede, S. J. (2014). Using crowdsourcing to compare temporal, social temporal, and probability discounting among obese and non-obese individuals. Appetite, 75, 82–89. (http://dx.doi.org/10.1016/j.appet.2013.12.018)
Boomhower, S. R., Rasmussen, E. B., & Doherty, T. S. (2013). Impulsive-choice patterns for food in genetically lean and obese Zucker rats. Behavioural Brain Research, 241, 214–221. (http://dx.doi.org/10.1016/j.bbr.2012.12.013)
Byrne, T., LeSage, M. G., & Poling, A. (1997). Effects of chlorpromazine on rats’ acqusition of lever-press responding with immediate and delayed reinforcement. Pharmacology Biochemistry and Behavior, 58(1), 31–35. (http://dx.doi.org/10.1016/s0091–3057(96)00454-6)
Carr, J. E., Coriaty, S., Wilder, D. A., Gaunt, B. T., Dozier, C. L., Britton, L. N., Avina C., Reed, C. L. (2000). A review of “noncontingent” reinforcement as treatment for the aberrant behavior of individuals with developmental disabilities. Research in Developmental Disabilities, 21, 377–391. (http://dx.doi.org/10.1016/s0891-4222(00)00050-0)
Catania, A. C. (1963). Concurrent performances: A baseline for the study of reinforcement magnitude. Journal of Experimental Analysis of Behavior, 6(2), 299–300. (http://dx.doi.org/10.1901/jeab.1963.6–299)
Catania, A. C. (1971). Reinforcement schedules: The role of responses preceding the one that produces the reinforcer. Journal of the Experimental Analysis of Behavior, 15, 271–287. (http://dx.doi.org/10.1901/jeab.1971.15–271)
Catania, A. C. (2000). Ten points every behavior analyst needs to remember about reinforcement. In J. C. Leslie & D. Blackman (Eds.), Experimental and applied analysis of human behavior. Reno: Context Press.
Catania, A. C. (2005). The operant reserve: A computer simulation in (accelerated) real time. Behavioural Processes, 31, 257–278. (http://dx.doi.org/10.1016/j.beproc.2005.02.009)
Catania, A. C. (2013). Learning (5th ed.). Cornwall-on-Hudson: Sloan Publishing.
Cho, S. S., Ko, J. H., Pellecchia, G., Van Eimeren, T., Cilia, R., & Strafella, A. P. (2010). Continuous theta burst stimulation of right dorsolateral prefrontal cortex induces changes in impulsivity level. Brain Stimulation, 3(3), 170–176. (http://dx.doi.org/10.1016/j.brs.2009.10.002)
Coffey, S. F., Gudleski, G. D., Saladin, M. E., & Brady, K. T. (2003). Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Experimental and Clinical Psychopharmacology, 11(1), 18–25. (http://dx.doi.org/10.1037//1064–1297.11.1.18)
Critchfield, T. S. (2011). To a young basic scientist, about to embark on a program of translational research. The Behavior Analyst, 34, 137–148.
Dai, Z., Grace, R. C., & Kemp, S. (2009). Reward contrast in delay and probability discounting. Learning and Behavior, 37(3), 281–288. (http://dx.doi.org/10.3758/lb.37.3.281)
Dixon, M. R., & Cummings, A. (2001). Self-control in children with autism: Response allocation during delay to reinforcement. Journal of Applied Behavior Analysis, 34, 491–495. (http://dx.doi.org/10.1901/jaba.2001.34-491)
Dixon, M. R., Jacobs, E. A., & Sanders, S. (2006). Contextual control of delay discounting by pathological gamblers. Journal of Applied Behavior Analysis, 39(4), 413–422. (http://dx.doi.org/10.1901/jaba.2006.173–05)
Elcoro, M., & Lattal, K. A. (2011). Effects of unsignaled delays of reinforcement on fixed-interval schedule performance. Behavioural Processes, 88(1), 47–52. (http://dx.doi.org/10.1016/j.beproc.2011.07.001)
Elcoro, M., Silva, S. P., & Lattal, K. A. (2008). Visual reinforcement in the female Siamese fighting fish, Betta splendens. Journal of the Experimental Analysis of Behavior, 2008, 53–60. (http://dx.doi.org/10.1901/jeab.2008.90-53)
Ferster, C. B., & Hammer, C. (1965). Variables determining the effects of delay in reinforcement. Journal of the Experimental Analysis of Behavior, 8, 243–254. (http://dx.doi.org/10.1901/jeab.1965.8-243)
Figner, B., Knoch, D., Johnson, E. J., Krosch, A. R., Lisanby, S. H., Fehr, E., & Weber, E. U. (2010). Lateral prefrontal cortex and self-control in intertemporal choice. Nature Neuroscience, 13(5), 538–539. (http://dx.doi.org/10.1038/nn.2516)
Fisher, W. W., Thompson, R. H., DeLeon, I. G., Piazza, C. C., Kuhn, D. E., Rodriquez-Carter, V., & Adelinis, J. D. (1999). Noncontingent reinforcement: Effects of satiation verus choice responding. Research in Developmental Disabilities, 20, 411–427. (http://dx.doi.org/10.1016/s0891-4222(99)00022-0)
Galuska, C. M., & Woods, J. H. (2005). Acqusition of cocaine self-administration with unsignaled delayed reinforcement in rhesus monkeys. Journal of the Experimental Analysis of Behavior, 84, 269–280. (http://dx.doi.org/10.1901/jeab.2005.99-04)
Giordano, L., Bickel, W. K., Loewenstein, G., Jacobs, E. A., Marsch, L., & Badger, G. J. (2002). Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology, 163(2), 174–182. (http://dx.doi.org/10.1007/s00213–002-1159-2)
Gonzalez, F. A., & Newlin, R. J. (1976). Effects of a delay-reinforcement procedure on performance under IRT > t schedules. Journal of the Experimental Analysis of Behavior, 26(2), 221–235. (http://dx.doi.org/10.1901/jeab.1976.26-221)
Green, L., & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130(5), 769–792. (http://dx.doi.org/10.1037/0033-2909.130.5.769)
Grosch, J., & Neuringer, A. (1981). Self-control in pigeons under the Mischel paradigm. Journal of the Experimental Analysis of Behavior, 35, 3–21. (http://dx.doi.org/10.1901/jeab.1981.35-3)
Hagopian, L. P., Boelter, E. W., & Jarmolowicz, D. P. (2011). Reinforcement schedule thinning following functional communication training: Review and recomendations. Behavior Analysis in Practice, 4, 4–16. (http://dx.doi.org/10.1901/jaba.2001.34-17)
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13(2), 243–266. (http://dx.doi.org/10.1901/jeab.1970.13-243)
Hinson, J. M., Jameson, T. L., & Whitney, P. (2003). Impulsive decision making and working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29(2), 298–306. (http://dx.doi.org/10.1037/0278-7393.29.2.298)
Hoerger, M. L., & Mace, F. C. (2006). A computerized test of self-control predicts classroom behavior. Journal of Applied Behavior Analysis, 39(2), 147–159. (http://dx.doi.org/10.1901/jaba.2006.171-04)
Hoffman, W. F., Schwartz, D. L., Huckans, M. S., McFarland, B. H., Meiri, G., Stevens, A. A., & Mitchell, S. H. (2008). Cortical activation during delay discounting in abstinent methamphetamine dependent individuals. Psychopharmacology (Berl), 201(2), 183–193. (http://dx.doi.org/10.1007/s00213-008-1261-1)
Huskinson, S. L., Krebs, C. A., & Anderson, K. G. (2012). Strain differences in delay discounting between Lewis and Fischer 344 rats at baseline and following acute and chronic administration of d-amphetamine. Pharmacology Biochemistry and Behavior, 101(3), 403–416. (http://dx.doi.org/10.1016/j.pbb.2012.02.005)
Jarmolowicz, D. P., & Lattal, K. A. (2011). Reinforcer efficacy, response persistence, and delay of reinforcement. Acta de Investigacion Psicologia, 1, 1–13.
Jarmolowicz, D. P., & Lattal, K. A. (2013). Delayed reinforcement and fixed-ratio performance. Journal of the Experimental Analysis of Behavior, 100(3), 370–395. (http://dx.doi.org/10.1002/jeab.48)
Jarmolowicz, D. P., Bickel, W. K., & Gatchalian, K. M. (2013). Alcohol-dependent individuals discount sex at higher rates than controls. Drug and Alcohol Dependence, 131(3), 320–323. (http://dx.doi.org/10.1016/j.drugalcdep.2012.12.014)
Jarmolowicz, D. P., Cherry, J. B. C., Reed, D. R., Bruce, J. M., Crespi, J. M., Lusk, J. L., & Bruce, A. S. (2014a). Robust relation between temporal discounting rates and body mass. Appetite, 78, 63–67. (http://dx.doi.org/10.1016/j.appet.2014.02.013)
Jarmolowicz, D. P., Landes, R. D., Christensen, D. R., Jones, B. A., Jackson, L., Yi, R., & Bickel, W. K. (2014b). Discounting of money and sex: Effects of commodity and temporal position in stimulant-dependent men and women. Addictive Behaviors, 39, 1652–1657. (http://dx.doi.org/10.1016/j.addbeh.2014.04.026)
Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10(12), 1625–1633. (http://dx.doi.org/10.1038/nn2007)
Kable, J. W., & Glimcher, P. W. (2010). An “as soon as possible” effect in human intertemporal decision making: Behavioral evidence and neural mechanisms. Journal of Neurophysiology, 103(5), 2513–2531. (http://dx.doi.org/10.1152/jn.00177.2009)
Kirby, K. N. (2009). One-year temporal stability of delay-discount rates. Psychonomic Bulletin and Review, 16(3), 457–462. (http://dx.doi.org/10.3758/pbr.16.3.457)
Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999). Heroin addicts have higher discount rates for delayed rewards than non-drug using controls. Journal of Experimental Psychology: General, 128(1), 78–87. (http://dx.doi.org/10.1111/j.1360-0443.2003.00669.x)
Klingberg, T., Forssberg, H., & Westerberg, H. (2002). Training of working memory in children with ADHD. Journal of Clinical and Experimental Neuropsychology, 24(6), 781–791. doi:10.1076/jcen.24.6.781.8395
Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., Westerberg, H., et al. (2005). Computerized training of working memory in children with ADHD—A randomized, controlled trial. Journal of the American Acacamy of Child and Adolescent Psychiatry, 44(2), 177–186. (http://dx.doi.org/10.1097/00004583–200502000-00010)
Koffarnus, M. N., Jarmolowicz, D. P., Mueller, E. T., & Bickel, W. K. (2013). Changing discounting in light of the competing neurobehavioral decision systems theory. Journal of the Experimental Analysis of Behavior, 99(1), 32–57. doi:10.1002/jeab.2
Landes, R. D., Christensen, D. R., & Bickel, W. K. (2012). Delay discounting decreases in those completing treatment for opioid dependence. Experimental and Clinical Psychopharmacology, 20(4), 302–309. (http://dx.doi.org/10.1037/a0027391)
Lattal, K. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93(1), 129–139. (http://dx.doi.org/10.1901/jeab.2010.93-129)
Lattal, K. A., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 16(1), 27–39. (ttp://dx.doi.org/10.1037//0097-7403.16.1.27)
Lattal, K. A., & Shahan, T. A. (1997). Differing views of contingencies: How contiguous? The Behavior Analyst, 20, 149–154.
Lattal, K. A., & Ziegler, D. R. (1982). Briefly delayed reinforcement: An interresponse time analysis. Journal of the Experimental Analysis of Behavior, 37(3), 407–416. (http://dx.doi.org/10.1901/jeab.1982.37-407)
Lawyer, S. R., Williams, S. A., Prihodova, T., Rollins, J. D., & Lester, A. C. (2010). Probability and delay discounting of hypothetical sexual outcomes. Behavioural Processes, 84(3), 687–692. (http://dx.doi.org/10.1016/j.beproc.2010.04.002)
LeBoeuf, R. A. (2006). Discount rates for time versus dates: The sensitivity of discounting to time-interval description. Journal of Marketing Research, 43(1), 59–72. (http://dx.doi.org/10.1509/jmkr.43.1.59)
Mace, F. C., & Critchfield, T. S. (2010). Translational research in behavior analysis: Historical traditions and imperative for the future. Journal of the Experimental Analysis of Behavior, 93(3), 293–312. (http://dx.doi.org/10.1901/jeab.2010.93-293)
Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: Drug and monetary rewards. Experimental and Clinical Psychopharmacology, 5(3), 256–262. (http://dx.doi.org/10.1037//1064-1297.5.3.256)
Madden, G. J., Smith, N. G., Brewer, A. T., Pinkston, J. W., Johnson, P. S. (2008). Steady-state assessment of impulsive choice in Lewis and Fischer 344 rats: between-condition delay manipulations. Journal of the Experimental Analysis of Behavior, 90, 333–344. (http://dx.doi.org/10.1901/jeab.2008.90-333)
Magan, E., Dweck, C. S., & Gross, J. J. (2008). The hidden-zero effect. Psychological Science, 19(7), 648–649. (http://dx.doi.org/10.1111/j.1467-9280.2008.02137.x)
Malkoc, S. A., Zauberman, G., & Bettman, J. R. (2010). Unstuck from the concrete: Carryover effects of abstract mindsets in intertemporal preferences. Organizational Behavior and Human Decision Processes, 113, 112–126. (http://dx.doi.org/10.1016/j.obhdp.2010.07.003)
Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analysis of behavior (Vol. 5, pp. 55–73). Hillsdale: Erlbaum.
Mazur, J. E. (2013). Learning and behavior (7th ed.). New Jersey: Pearson.
Mazur, J. E., & Logue, A. W. (1978). Choice in a "self-control" paradigm: Effects of a fading procedure. Journal of the Experimental Analysis of Behavior, 30(1), 11–17. (http://dx.doi.org/10.1901/jeab.1978.30–11)
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306(5695), 503–507. (http://dx.doi.org/10.1126/science.1100907)
Mischel, W. (1966). Theory and research on the antecedents of self-imposed delay of reward. Progress in Experimental Personality Research, 3, 85–132.
Mischel, W., & Ebbesen, E. B. (1970). Attention in delay of gratification. Journal of Personality and Social Psychology, 16, 329–337. (http://dx.doi.org/10.1037/h0029815)
Mischel, W., Ebbesen, E. B., & Zeiss, A. R. (1972). Cognitive and attentional mechanisms in delay of gratification. Journal of Personality and Social Psychology, 21, 204–218. (http://dx.doi.org/10.1037/h0032198)
Mischel, W., Shoda, Y., & Rodriguez, M. I. (1989). Delay of gratification in children. Science, 244(4907), 933–938. (ttp://dx.doi.org/10.1126/science.2658056)
Monterosso, J., & Ainslie, G. (2007). The behavioral economics of will in recovery from addiction. Drug and Alcohol Dependence, 90(Suppl. 1), S100–S111. (http://dx.doi.org/10.1016/j.drugalcdep.2006.09.004)
Monterosso, J. R., & Luo, S. (2010). An argument against dual valuation system competition: Cognitive capacities supporting future orientation mediate rather than compete with visceral motivation. Journal of Neuroscience, Psychology, and Economics, 3, 1–14. (http://dx.doi.org/10.1037/a0016827)
Neef, N. A., Bicard, D. F., & Endo, S. (2001). Assessment of impulsivity and the development of self-control in students with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 34, 397–408. (http://dx.doi.org/10.1901/jaba.2001.34–397)
Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of Behavior, 21, 389–408. (http://dx.doi.org/10.1901/jeab.1974.21–389)
Newquist, M. H., Dozier, C. L., & Neidert, P.L. (2012). A comparison of the effects of brief rules, a timer, and preferred toys on self-control. Journal of Applied Behavior Analysis, 45, 497–509. (http://dx.doi.org/10.1901/jaba.2012.45-497)
Odum, A. L. (2011a). Delay discounting: Trait variable? Behavioral Processes, 87, 1–9. (http://dx.doi.org/10.1016/j.beproc.2011.02.007)
Odum, A. L. (2011b). Delay discounting: I’m a k, You’re a k. Journal of the Experimental Analysis of Behavior, 96(3), 427–439. (http://dx.doi.org/10.1901/jeab.2011.96-423)
Odum, A. L., & Rainaud, C. P. (2003). Discounting of delayed hypothetical money, alcohol, and food. Behavioural Processes, 64(3), 305–313. (http://dx.doi.org/10.1016/s0376-6357(03)00145-1)
Odum, A. L., Baumann, A. A., & Rimington, D. D. (2006). Discounting of delayed hypothetical money and food: Effects of amount. Behavioural Processes, 73(3), 278–284. (http://dx.doi.org/10.1016/j.beproc.2006.06.008)
Okouchi, H. (2009). Response acqusition by humans with delayed reinforcement. Journal of the Experimental Analysis of Behavior, 91(3), 377–390. (http://dx.doi.org/10.1901/jeab.2009.91–377)
Peters, J., & Buchel, C. (2010). Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron, 66(1), 138–148. (http://dx.doi.org/10.1016/j.neuron.2010.03.026)
Petry, N. M. (2001a). Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology, 154(3), 243–250. (http://dx.doi.org/10.1007/s002130000638)
Petry, N. M. (2001b). Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. Journal of Abnormal Psychology, 110(3), 482–487. (http://dx.doi.org/10.1037//0021–843x.110.3.482)
Poling, A., & Edwards, T. L. (2011). Translational research: It's not 1960s behavior analysis. The Behavior Analyst, 34, 23–26.
Rachlin, H. (2006). Notes on discounting. Journal of the Experimental Analysis of Behavior, 85(3), 425–435. (http://dx.doi.org/10.1901/jeab.2006.85–05)
Rachlin, H., & Green, L. (1972). Commitment, choice, and self-control. Journal of the Experimental Analysis of Behavior, 17, 15–22. (http://dx.doi.org/10.1901/jeab.1972.17-15)
Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55(2), 233–244. (http://dx.doi.org/10.1901/jeab.1991.55-233)
Radu, P. T., Yi, R., Bickel, W. K., Gross, J. J., & McClure, S. M. (2011). A mechanism for reducing delay discounting by altering temporal attention. Journal of the Experimental Analysis of Behavior, 96(3), 363–385. (http://dx.doi.org/10.1901/jeab.2011.96–363)
Rasmussen, E. B., Lawyer, S. R., & Reilly, W. (2010). Percent body fat is related to delay and probability discounting for food in humans. Behavioural Processes, 83(1), 23–30. (http://dx.doi.org/10.1016/j.beproc.2009.09.001)
Read, D., Frederick, S., Orsel, B., & Rahman, J. (2005). Four score and seven years from now: The date/delay effect in temporal discounting. Management Science, 51(9), 1326–1335. (http://dx.doi.org/10.1287/mnsc.1050.0412)
Reed, D. D., & Martens, B. K. (2011). Temporal discounting predicts student responsiveness to exchange delays in a classroom token system. Journal of Applied Behavior Analysis, 44(1), 1–18. (http://dx.doi.org/10.1901/jaba.2011.44-1)
Reilly, M. P., & Lattal, K. A. (2004). Within-session delay of reinforcement gradients. Journal of the Experimental Analysis of Behavior, 82(1), 21–35. (http://dx.doi.org/10.1901/jeab.2004.82-21)
Reynolds, B. (2006). A review of delay-discounting research with humans: Relations to drug use and gambling. Behavioural Pharmacology, 17(8), 651–667. (http://dx.doi.org/10.1097/fbp.0b013e3280115f99)
Richards, R. W. (1981). A comparison of signaled and unsignaled delay of reinforcement. Journal of the Experimental Analysis of Behavior, 35(2), 145–152. (http://dx.doi.org/10.1901/jeab.1981.35-145)
Samaha, A. L., Vollmer, T. R., Borrero, C., Sloman, K., Pipkin, C. S., & Bourret, J. (2009). Analyses of response-stimulus sequences in descriptive observations. Journal of Applied Behavior Analysis, 42(2), 442–447. (http://dx.doi.org/10.1901/jaba.2009.42-447)
Schweitzer, J. B., & Sulzer-Azaroff, B. (1988). Self-control: Teaching tolerance for delay in impulsive children [Research Support, U.S. Govt, Non-P.H.S.]. Journal of the Experimental Analysis of Behavior, 50(2), 173–186. (http://dx.doi.org/10.1901/jeab.1988.50-173)
Sgro, J. A., Dyal, J. A., & Antastasio, E. J. (1967). Effects of constant delay of reinforcement on acqusition asymptote and resistance to extinction. Journal of Experimental Psychology, 73, 634–636. (http://dx.doi.org/10.1037/h0024385)
Shahan, T. A., & Lattal, K. A. (2005). Unsignaled delay of reinforcement, relative time, and resistance to change. Journal of the Experimental Analysis of Behavior, 83(3), 201–219. (http://dx.doi.org/10.1901/jeab.2005.62-04)
Sheffer, C., MacKillop, J., McGeary, J., Landes, R. D., Carter, L., Yi, R., Bickel, W. K., et al. (2012). Delay discounting, locus of control, and cognitive impulsiveness independently predict tobacco dependence treatment outcomes in a highly dependent, lower socioeconomic group of smokers. American Journal on Addictions, 21(3), 221–232. (http://dx.doi.org/10.1111/j.1521-0391.2012.00224.x)
Sheffer, C. E., Mennemeier, M., Landes, R. D., Bickel, W. K., Brackman, S., Dornhoffer, J., Kimbrell, T., Brown, G. (2013). Neuromodulation of delay discounting, the reflection effect, and cigarette smoking. Journal of Substance Abuse Treatment, 45(2), 206–214. (http://dx.doi.org/10.1016/j.jsat.2013.01.012)
Sizemore, O. J., & Lattal, K. A. (1977). Dependency, temporal contiguity, and response-independent reinforcement. Journal of the Experimental Analysis of Behavior, 27, 119–125. (http://dx.doi.org/10.1901/jeab.1977.27-119)
Sizemore, O. J., & Lattal, K. A. (1978). Unsignalled delay of reinforcement in variable-interval schedules. Journal of the Experimental Analysis of Behavior, 30(2), 169–175. (http://dx.doi.org/10.1901/jeab.1978.30-169)
Skinner, B. F. (1935). The generic nature of the concepts of stimulus and response. The Journal of General Psychology, 12, 40–65. (http://dx.doi.org/10.1080/00221309.1935.9920087)
Skinner, B. F. (1938). The behavior of organisms. New York: Appleton-Century-Crofts.
Skinner, B. F. (1948). Walden two. Indianapolis: Hackett Publishing Company.
Skinner, B. F. (1953). Science and human behavior. New York: The Macmillan Company.
Snycerski, S., Laraway, S., Huitema, B. E., & Poling, A. (2004). The effects of behavioral history on response acqusition with immediate and delayed reinforcement. Journal of the Experimental Analysis of Behavior, 2004(81), 51–64. (http://dx.doi.org/10.1901/jeab.2004.81-51)
Stanger, C., Ryan, S. R., Fu, H., Landes, R. D., Jones, B. A., Bickel, W. K., & Budney, A. J. (2011). Delay discounting predicts adolescent substance abuse treatment outcome. Experimental and Clinical Psychopharmacology, 20, 205–212. (http://dx.doi.org/10.1037/a0026543)
Stein, J. S., Johnson, P. S., Renda, C. R., Smits, R. R., Liston, K. J., Shahan, T. A., & Madden, G. J. (2013). Early and prolonged exposure to reward delay: Effects on impulsive choice and alcohol self-administration in male rats. Experimental and Clinical Psychopharmacology, 21(2), 172–180. (http://dx.doi.org/10.1037/a0031245)
van den Bos, W., & McClure, S.M. (2013). Towards a general model of temporal discounting. Journal of the Experimental Analysis of Behavior, 99, 58–73. doi:10.1002/jeab.6
van Haaren, F. (1992). Response acqusition with fixed and variable delays of reinforcement in male and female wistar rats. Physiology and Behavior, 52(4), 767–772. (http://dx.doi.org/10.1016/0031-9384(92)90412-u)
Vollmer, T. R., Borrero, J. C., Lallli, J. S., & Daniel, D. (1999). Evaluating self-control and impulsivity in children with severe behavior disorders. Journal of Applied Behavior Analysis, 32, 451–466. (http://dx.doi.org/10.1901/jaba.1999.32-451)
Vuchinich, R. E., & Simpson, C. A. (1998). Hyperbolic temporal discounting in social drinkers and problem drinkers. Experimental and Clinical Psychopharmacology, 6(3), 292–305. (http://dx.doi.org/10.1037//1064-1297.6.3.292)
Washio, Y., Higgins, S. T., Heil, S. H., McKerchar, T. L., Badger, G. J., Skelly, J. M., & Dantona, R. L. (2011). Delay discounting is associated with treatment response among cocaine-dependent outpatients. Experimental and Clinical Psychopharmacology, 19(3), 243–248. (http://dx.doi.org/10.1037/a0023617)
Westerberg, H., Jacobaeus, H., Hirvikoski, T., Clevberger, P., Osternsson, M., Bartfai, A., & Klingberg, T. (2007). Computerized working memory training after stroke—a pilot study. Brain Injury, 21(1), 21–29. (http://dx.doi.org/10.1037/a0023617)
Wilkenfield, J., Nichel, M., Blakely, E., & Poling, A. (1992). Acqusition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures. Journal of the Experimental Analysis of Behavior, 58, 431–443. (http://dx.doi.org/10.1901/jeab.1992.58-431)
Williams, B. A. (1976). The effects of unsignalled delayed reinforcement. Journal of the Experimental Analysis of Behavior, 26(3), 441–449. (http://dx.doi.org/10.1901/jeab.1976.26-441)
Willner, P., Bailey. R., Parry, R., & Dymond, S. (2010). Performance in temporal discounting tasks by people with intellectual disabilities reveals difficulties in decision-making and impulse control. American Journal on Intellectual and Developmental Disabilities, 115(2), 157–171. (http://dx.doi.org/10.1352/1944-7558-115.2.157)
Yi, R., Johnson, M. W., Giordano, L. A., Landes, R. D., Badger, G. J., & Bickel, W. K. (2008). The effects of reduced cigarette smoking on discounting future rewards: An initial evaluation. The Psychological Record, 58(2), 163–174.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this chapter
Cite this chapter
Jarmolowicz, D., Hudnall, J., Lemley, S. (2015). Delay of Reinforcement: Current Status and Future Directions. In: DiGennaro Reed, F., Reed, D. (eds) Autism Service Delivery. Autism and Child Psychopathology Series. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-2656-5_14
Download citation
DOI: https://doi.org/10.1007/978-1-4939-2656-5_14
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-2655-8
Online ISBN: 978-1-4939-2656-5
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)