Skip to main content
SpringerLink
Log in

Delay and Probability Discounting in Humans: An Overview

  • Sketch
  • Published:
The Psychological Record Aims and scope Submit manuscript

An Erratum to this article was published on 01 July 2013

Abstract

The purpose of this review is to introduce the reader to the concepts of delay and probability discounting as well as the major empirical findings to emerge from research with humans on these concepts. First, we review a seminal discounting study by Rachlin, Raineri, and Cross (1991) as well as an influential extension of this study by Madden, Petry, Badger, and Bickel (1997). In doing so, we describe the general procedure used for assessing discounting and the resulting form of the obtained discounting functions. With this as background, we review additional empirical findings that have emerged over the last 20 years, by addressing issues such as time consistency and preference reversals, magnitude effects, and the gain-loss asymmetry. Finally, we conclude with a discussion of more recent developments and their implications for the future of this growing area.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • AUDRAIN-MCGOVERN, J., RODRIGUEZ, D., EPSTEIN, L. H., CUEVAS, J., RODGERS, K., & WILEYTO, E. P. (2009). Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug and Alcohol Dependence, 103, 99–106.

    Article  PubMed  PubMed Central  Google Scholar 

  • BAKER, F., JOHNSON, M. W., & BICKEL, W. K. (2003). Delay discounting in current and never-before cigarette smokers: Similarities and differences across commodity, sign, and magnitude. Journal of Abnormal Psychology, 112, 382–392.

    Article  PubMed  Google Scholar 

  • BICKEL, W. K., & MARSCH, L. A. (2001). Toward a behavioral economic understanding of drug dependence: Delay discounting processes. Addiction, 96, 73–86.

    Article  PubMed  Google Scholar 

  • BICKEL, W. K., YI, R., LANDES, R. D., HILL, P. F., & BAXTER, C. (2011). Remember the future: Working memory training decreases delay discounting among stimulant addicts. Biological Psychiatry, 69, 260–265.

    Article  PubMed  Google Scholar 

  • DU, W., GREEN, L., & MYERSON, J. (2002). Cross-cultural comparison of discounting of delayed and probabilistic rewards. The Psychological Record, 52, 479–492.

    Article  Google Scholar 

  • EPSTEIN, L. H., RICHARDS, J. B., SAAD, F. G., PALUCH, R. A., ROEMMICH, J. N., & LERMAN, C. (2003). Comparison between two measures of delay discounting in smokers. Experimental and Clinical Psychopharmacology, 11, 131–138.

    Article  PubMed  Google Scholar 

  • ESTLE, S. J., GREEN, L., MYERSON, J., & HOLT, D. D. (2006). Differential effects of amount on temporal and probability discounting of gains and losses. Memory & Cognition, 34, 914–928.

    Article  Google Scholar 

  • ESTLE, S. J., GREEN, L., MYERSON, J., & HOLT, D. D. (2007). Discounting of monetary and directly consumable rewards. Psychological Science, 18, 58–63.

    Article  PubMed  Google Scholar 

  • GREEN, L., FISHER, E. B., PERLOW, S., & SHERMAN, L. (1981). Preference reversal and self control: Choice as a function of reward amount and delay. Behaviour Analysis Letters, 1, 43–51.

    Google Scholar 

  • GREEN, L., FRISTOE, N., & MYERSON, J. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin & Review, 1, 383–389.

    Article  Google Scholar 

  • GREEN, L., & MYERSON, J. (1993). Alternative frameworks for the analysis of self-control. Behavior and Philosophy, 21, 37–47.

    Google Scholar 

  • GREEN, L., & MYERSON, J. (1996). Exponential versus hyperbolic discounting of delayed outcomes: Risk and waiting time. American Zoologist, 36, 496–505.

    Article  Google Scholar 

  • GREEN, L., & MYERSON, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130, 769–792.

    Article  PubMed  PubMed Central  Google Scholar 

  • GREEN, L., & MYERSON, J. (2010). Experimental and correlational analyses of delay and probability discounting. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 67–92). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • GREEN, L., MYERSON, J., HOLT, D. D., SLEVIN, J. R., & ESTLE, S. J. (2004). Discounting of delayed food rewards in pigeons and rats: Is there a magnitude effect? Journal of Experimental Analysis of Behavior, 81, 39–50.

    Article  Google Scholar 

  • GREEN, L., MYERSON, J., & MCFADDEN, E. (1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25, 715–723.

    Article  Google Scholar 

  • GREEN, L., MYERSON, J., & OSTASZEWSKI, P. (1999). Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 418–427.

    PubMed  Google Scholar 

  • HIGGINS, S. T., SILVERMAN, K., & HEIL, S. H. (2008). Contingency management in substance abuse treatment. New York, NY: Guilford Press.

    Google Scholar 

  • HOLT, D. D., GREEN, L., MYERSON, J., & ESTLE, S. J. (2008). Preference reversals with losses. Psychonomic Bulletin & Review, 15, 89–95.

    Article  Google Scholar 

  • JOHNSON, M. W., & BICKEL, W. K. (2002). Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior, 77, 129–146.

    Article  PubMed  PubMed Central  Google Scholar 

  • JOHNSON, M. W., BICKEL, W. K., BAKER, F., MOORE, B. A., BADGER, G. J., & BUDNEY, A. J. (2010). Delay discounting in current and former marijuana-dependent individuals. Experimental and Clinical Psychopharmacology, 18, 99–107.

    Article  PubMed  PubMed Central  Google Scholar 

  • KILLEEN, P. R. (2009). An additive-utility model of delay discounting. Psychological Review, 116, 602–619.

    Article  PubMed  Google Scholar 

  • KIRBY, K. N. (1997). Bidding on the future: Evidence against normative discounting of delayed rewards. Journal of Experimental Psychology: General, 126, 54–70.

    Article  Google Scholar 

  • KIRBY, K. N. (2009). One-year temporal stability of delay-discount rates. Psychonomic Bulletin & Review, 16, 457–462.

    Article  Google Scholar 

  • KIRBY, K. N., & HERRNSTEIN, R. J. (1995). Preference reversals due to myopic discounting of delayed reward. Psychological Science, 6, 83–89.

    Article  Google Scholar 

  • KIRBY, K. N., & MARAKOVIĆ, N. N. (1995). Modeling myopic decisions: Evidence for hyperbolic delay-discounting within subjects and amounts. Organization Behavior and Human Decision Processes, 64, 22–30.

    Article  Google Scholar 

  • KOWAL, B. P., YI, R., ERISMAN, A. C., & BICKEL, W. K. (2007). A comparison of two algorithms in computerized temporal discounting procedures. Behavioural Processes, 75, 231–236.

    Article  PubMed  Google Scholar 

  • KRISHNAN-SARIN, S., REYNOLDS, B., DUHIG, A. M., SMITH, A., LISS, T., MCFETRIDGE, A., … POTENZA, M. N. (2007). Behavioral impulsivity predicts treatment outcome in a smoking cessation program. Drug and Alcohol Dependence, 88, 79–82.

    Article  PubMed  Google Scholar 

  • LAGORIO, C. H., & MADDEN, G. J. (2005). Delay discounting of real and hypothetical rewards III: Steady-state assessments, forced-choice trials, and all real rewards. Behavioural Processes, 69, 173–187.

    Article  PubMed  Google Scholar 

  • LOEWENSTEIN, G., & THALER, R. H. (1989). Anomalies: Intertemporal choice. Journal of Economic Perspectives, 3, 181–193.

    Article  Google Scholar 

  • MACKILLOP, J., & KAHLER, C. W. (2009). Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug and Alcohol Dependence, 104, 197–203.

    Article  PubMed  PubMed Central  Google Scholar 

  • MADDEN, G. J., BEGOTKA, A. M., RAIFF, B. R., & KASTERN, L. L. (2003). Delay discounting of real and hypothetical rewards. Experimental and Clinical Psychopharmacology, 11, 139–145.

    Article  PubMed  Google Scholar 

  • MADDEN, G. J., & BICKEL, W. K. (Eds.). (2010). Impulsivity: The behavioral and neurological science of discounting. Washington, DC: American Psychological Association.

    Google Scholar 

  • MADDEN, G. J., BICKEL, W. K., & JACOBS, E. A. (1999). Discounting of delayed rewards in opioid-dependent outpatients: Exponential or hyperbolic discounting functions? Experimental and Clinical Psychopharmacology, 7, 284–293.

    Article  PubMed  Google Scholar 

  • MADDEN, G. J., PETRY, N. M., BADGER, G. J., & BICKEL, W. K. (1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: Drug and monetary rewards. Experimental and Clinical Psychopharmacology, 5, 256–262.

    Article  PubMed  Google Scholar 

  • MADDEN, G. J., RAIFF, B. R., LAGORIO, C. H., BEGOTKA, A. M., MUELLER, A. M., HEHLI, D. J., & WEGENER, A. (2004). Delay discounting of potentially real and hypothetical rewards II: Between- and within-subjects comparisons. Experimental and Clinical Psychopharmacology, 12, 251–261.

    Article  PubMed  Google Scholar 

  • MAZUR, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E., Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analysis of behavior: Vol. 5. The effect of delay and of intervening events of reinforcement value (pp. 55–73). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • MAZUR, J. E. (2006). Mathematical models and the experimental analysis of behavior. Journal of the Experimental Analysis of Behavior, 85, 275–291.

    Article  PubMed  PubMed Central  Google Scholar 

  • MCKERCHAR, T. L., GREEN, L., & MYERSON, J. (2010). On the scaling interpretation of exponents in hyperboloid models of delay and probability discounting. Behavioural Processes, 84, 440–444.

    Article  PubMed  PubMed Central  Google Scholar 

  • MCKERCHAR, T. L., GREEN, L., MYERSON, J., PICKFORD, T. S., HILL, J. C., & STOUT, S. C. (2009). A comparison of four models of delay discounting in humans. Behavioural Processes, 81, 256–259.

    Article  PubMed  Google Scholar 

  • MITCHELL, S. H., & WILSON, V. B. (2010). The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses. Behavioural Processes, 83, 36–40.

    Article  PubMed  Google Scholar 

  • MURPHY, J. G., VUCHINICH, R. E., & SIMPSON, C. A. (2001). Delayed reward and cost discounting. The Psychological Record, 51, 571–588.

    Google Scholar 

  • MURPHY, S. A., COLLINS, L. M., & RUSH, A. J. (2007). Customizing treatment to the patient: Adaptive treatment strategies. Drug and Alcohol Dependence, 88S, S1–S3.

    Article  PubMed  PubMed Central  Google Scholar 

  • MYERSON, J., & GREEN, L. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64, 263–276.

    Article  PubMed  PubMed Central  Google Scholar 

  • MYERSON, J., GREEN, L., & MORRIS, J. (2011). Modeling the effect of reward amount on probability discounting. Journal of the Experimental Analysis of Behavior, 95, 175–187.

    Article  PubMed  PubMed Central  Google Scholar 

  • MYERSON, J., GREEN, L., & WARUSAWITHARANA, M. (2001). Area under the curve as a measure of discounting. Journal of the Experimental Analysis of Behavior, 76, 235–243.

    Article  PubMed  PubMed Central  Google Scholar 

  • ODUM, A. L. (2011). Delay discounting: Trait variable? Behavioural Processes, 87, 1–9.

    Article  PubMed  PubMed Central  Google Scholar 

  • ODUM, A. L., & BAUMANN, A. A. L. (2010). Delay discounting: State and trait variable. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 39–65). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • ODUM, A. L., & RAINAUD, C. P. (2003). Discounting of delayed hypothetical money, alcohol, and food. Behavioural Processes, 64, 305–313.

    Article  PubMed  Google Scholar 

  • RACHLIN, H. (2000). The science of self-control. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • RACHLIN, H. (2006). Notes on discounting. Journal of the Experimental Analysis of Behavior, 85, 425–435.

    Article  PubMed  PubMed Central  Google Scholar 

  • RACHLIN, H., CASTROGIOVANNI, A., & CROSS, D. (1987). Probability and delay in commitment. Journal of the Experimental Analysis of Behavior, 48, 347–353.

    Article  PubMed  PubMed Central  Google Scholar 

  • RACHLIN, H., & GREEN, L. (1972). Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior, 17, 15–22.

    Article  PubMed  PubMed Central  Google Scholar 

  • RACHLIN, H., RAINERI, A., & CROSS, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55, 223–244.

    Article  Google Scholar 

  • RAINERI, A., & RACHLIN, H. (1993). The effect of temporal constraints on the value of money and other commodities. Journal of Behavioral Decision Making, 6, 77–94.

    Article  Google Scholar 

  • REYNOLDS, B. (2006). A review of delay-discounting research with humans: Relations to drug use and gambling. Behavioural Pharmacology, 17, 651–667.

    Article  PubMed  Google Scholar 

  • REYNOLDS, B., RICHARDS, J. B., HORN, K., & KARRAKER, K. (2004). Delay discounting and probability discounting as related to cigarette smoking status in adults. Behavioural Processes, 65, 35–42.

    Article  PubMed  Google Scholar 

  • REYNOLDS, B., & SCHIFFBAUER, R. (2004). Measuring state changes in human delay discounting: An experiential discounting task. Behavioural Processes, 67, 343–356.

    Article  PubMed  Google Scholar 

  • RICHARDS, J. B., MITCHELL, S. H., DE WIT, H., & SEIDEN, L. S. (1997). Determination of discount functions in rats with an adjusting-amount procedure. Journal of the Experimental Analysis of Behavior, 67, 353–366.

    Article  PubMed  PubMed Central  Google Scholar 

  • RODZON, K., BERRY, M. S., & ODUM, A. L. (2011). Within-subject comparison of degree of delay discounting using titrating and fixed sequence procedures. Behavioural Processes, 86, 164–167.

    Article  PubMed  Google Scholar 

  • SAMUELSON, P. A. (1937). A note on measurement of utility. The Review of Economic Studies, 4, 155–161.

    Article  Google Scholar 

  • SIMPSON, C. A., & VUCHINICH, R. E. (2000). Reliability of a measure of temporal discounting. The Psychological Record, 50, 3–16.

    Article  Google Scholar 

  • WASHIO, Y., HIGGINS, S. T., HEIL, S. H., MCKERCHAR, T. L., BADGER, G. J., SKELLY, J. M., & DANTONA, R. L. (2011). Delay discounting is associated with treatment response among cocaine-dependent outpatients. Experimental and Clinical Psychopharmacology, 19, 243–248.

    Article  PubMed  PubMed Central  Google Scholar 

  • YI, R., CHASE, W., & BICKEL, W. K. (2007). Probability discounting among cigarette smokers and nonsmokers: Molecular analysis discerns group differences. Behavioural Pharmacology, 18, 633–639.

    Article  PubMed  Google Scholar 

  • YI, R., MITCHELL, S. H., & BICKEL, W. K. (2010). Delay discounting and substance abuse-dependence. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 191–211). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • YOON, J. H., HIGGINS, S. T., HEIL, S. H., SUGARBAKER, R. J., THOMAS, C. S., & BADGER, G. J. (2007). Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Experimental and Clinical Psychopharmacology, 15, 176–186.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Jacksonville State University, USA

    Todd L. McKerchar & C. Renee Renda

  2. Utah State University, USA

    C. Renee Renda

Authors
  1. Todd L. McKerchar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Renee Renda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Todd L. McKerchar.

Additional information

An erratum to this article is available at http://dx.doi.org/10.11133/j.tpr.63.3.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McKerchar, T.L., Renda, C.R. Delay and Probability Discounting in Humans: An Overview. Psychol Rec 62, 817–834 (2012). https://doi.org/10.1007/BF03395837

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03395837

Keyword

Search

Navigation