Skip to main content
SpringerLink
Log in

Choice Behavior

  • Reference work entry
  • First Online:
Book cover Encyclopedia of Computational Neuroscience

  • 76 Accesses

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • Afriat S (1967) The construction of utility functions from expenditure data. Int Econ Rev 8:67–77

    Article  Google Scholar 

  • Ainslie G (1974) Impulse control in pigeons. J Exp Anal Behav 21:485–489

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–496

    Article  CAS  PubMed  Google Scholar 

  • Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214–1221

    Article  CAS  PubMed  Google Scholar 

  • Bernoulli D (1954) Exposition of a new theory on the measurement of risk. Econometrica 22:23

    Article  Google Scholar 

  • Burke CJ, Tobler PN (2011) Coding of reward probability and risk by single neurons in animals. Front Neurosci 5:121

    Article  PubMed  PubMed Central  Google Scholar 

  • Cai X, Kim S, Lee D (2011) Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69:170–182

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Charnov EL (1976) Optimal foraging, the marginal value theorem. Theor Popul Biol 9:129–136

    Article  CAS  PubMed  Google Scholar 

  • Christopoulos GI, Tobler PN, Bossaerts P, Dolan RJ, Schultz W (2009) Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J Neurosci 29:12574–12583

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Elliott R, Agnew Z, Deakin JFW (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 27:2213–2218

    Article  CAS  PubMed  Google Scholar 

  • Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, Fehr E, Weber EU (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13:538–539

    Article  CAS  PubMed  Google Scholar 

  • Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–1902

    Article  CAS  PubMed  Google Scholar 

  • Fiorillo CD, Tobler PN, Schultz W (2005) Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav Brain Funct BBF 1:7

    Article  CAS  PubMed  Google Scholar 

  • Friedman M, Savage LJ (1948) The utility analysis of choices involving risk. J Polit Econ 56:279

    Article  Google Scholar 

  • Glimcher PW (2008) Understanding risk: a guide for the perplexed. Cogn Affect Behav Neurosci 8:348–354

    Article  PubMed  Google Scholar 

  • Glimcher PW (2010) Foundations of neuroeconomic analysis. Oxford University Press, New York

    Book  Google Scholar 

  • Glimcher PW, Rustichini A (2004) Neuroeconomics: the consilience of brain and decision. Science 306:447–452

    Article  CAS  PubMed  Google Scholar 

  • Green L, Fristoe N, Myerson J (1994) Temporal discounting and preference reversals in choice between delayed outcomes. Psychon Bull Rev 1:383–389

    Article  CAS  PubMed  Google Scholar 

  • Green L, Myerson J, Calvert AL (2010) Pigeons’ discounting of probabilistic and delayed reinforcers. J Exp Anal Behav 94:113–123

    Article  PubMed  PubMed Central  Google Scholar 

  • Hamilton WD (1964a) The genetical evolution of social behaviour. I. J Theor Biol 7:1–16

    Article  CAS  PubMed  Google Scholar 

  • Hamilton WD (1964b) The genetical evolution of social behaviour. II. J Theor Biol 7:17–52

    Article  CAS  PubMed  Google Scholar 

  • Harbaugh W, Krause K, Berry T (2001) GARP for kids: on the development of rational choice behavior. Am Econ Rev 91(5):1539–1545

    Article  Google Scholar 

  • Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324:646–648

    Article  CAS  PubMed  Google Scholar 

  • Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14:933–939

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Herrnstein RJ (1961) Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4:267–272

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Houthakker H (1950) Revealed preference and the utility function. Economica 17:159–174

    Article  Google Scholar 

  • Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625–1633

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Kable JW, Glimcher PW (2009) The neurobiology of decision: consensus and controversy. Neuron 63:733–745

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Kacelnik A (1997) Normative and descriptive models of decision making: time discounting and risk sensitivity. Ciba Found Symp 208:51–70

    CAS  PubMed  Google Scholar 

  • Kacelnik A, Bateson M (1996) Risky theories – the effects of variance on foraging decisions. Integr Comp Biol 36:402–434

    Google Scholar 

  • Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263

    Article  Google Scholar 

  • Kahnt T, Heinzle J, Park SQ, Haynes J-D (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010–6015

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Kalenscher T, Pennartz CM (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84:284–315

    Article  PubMed  Google Scholar 

  • Kalenscher T, Van Wingerden M (2011) Why we should use animals to study economic decision making – a perspective. Front Neurosci 5:82

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalenscher T, Diekamp B, Güntürkün O (2003) Neural architecture of choice behaviour in a concurrent interval schedule. Eur J Neurosci 18:2627–2637

    Article  PubMed  Google Scholar 

  • Kalenscher T, Windmann S, Diekamp B, Rose J, Güntürkün O, Colombo M (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15:594–602

    Article  CAS  PubMed  Google Scholar 

  • Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21:1162–1178

    Article  PubMed  PubMed Central  Google Scholar 

  • Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Kolling N, Behrens TEJ, Mars RB, Rushworth MFS (2012) Neural mechanisms of foraging. Science 336:95–98

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Koopmans TC (1960) Stationary ordinal utility and impatience. Econometrica 28:287–309

    Article  Google Scholar 

  • Kuhnen CM, Knutson B (2005) The neural basis of financial risk taking. Neuron 47:763–770

    Article  CAS  PubMed  Google Scholar 

  • Louie K, Glimcher PW (2010) Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci 30:5498–5507

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Louie K, Glimcher PW (2012) Efficient coding and the neural representation of value. Ann N Y Acad Sci 1251:13–32

    Article  PubMed  Google Scholar 

  • Louie K, Grattan LE, Glimcher PW (2011) Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci 31:10627–10639

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Mar AC, Walker ALJ, Theobald DE, Eagle DM, Robbins TW (2011) Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci 31:6398–6404

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Mazur JE (1984) Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol Anim Behav Process 10:426–436

    Article  Google Scholar 

  • Mazur JE (1988) Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav 49:37–47

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503–507

    Article  CAS  PubMed  Google Scholar 

  • McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27:5796–5804

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • McCoy AN, Platt ML (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 8:1220–1227

    Article  CAS  PubMed  Google Scholar 

  • McDiarmid CG, Rilling ME (1965) Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychon Sci 2:195–196

    Article  Google Scholar 

  • Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160:290–298

    Article  CAS  Google Scholar 

  • O’Neill M, Schultz W (2010) Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68:789–800

    Article  CAS  PubMed  Google Scholar 

  • Padoa-Schioppa C (2007) Orbitofrontal cortex and the computation of economic value. Ann N Y Acad Sci 1121:232–253

    Article  PubMed  Google Scholar 

  • Padoa-Schioppa C (2009) Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 29:14004–14014

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333–359

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223–226

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11:95–102

    Article  CAS  PubMed  Google Scholar 

  • Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233–238

    Article  CAS  PubMed  Google Scholar 

  • Prelec D, Loewenstein G (1991) Decision making over time and under uncertainty: a common approach. Manag Sci 37:770–786

    Article  Google Scholar 

  • Rachlin H, Green L (1972) Commitment, choice and self control. J Exp Anal Behav 17:15–22

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233–244

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262–270

    Article  CAS  PubMed  Google Scholar 

  • Roesch MR, Bryden DW (2011) Impact of size and delay on neural activity in the rat limbic corticostriatal system. Front Neurosci 5:130

    Article  PubMed  PubMed Central  Google Scholar 

  • Roesch MR, Olson CR (2005) Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol 94:2457–2471

    Article  PubMed  Google Scholar 

  • Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51:509–520

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Roitman JD, Roitman MF (2010) Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31:1492–1500

    Article  PubMed  PubMed Central  Google Scholar 

  • Rolls ET, McCabe C, Redoute J (2008) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18:652–663

    Article  PubMed  Google Scholar 

  • Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161–1168

    Article  CAS  PubMed  Google Scholar 

  • Rudorf S, Preuschoff K, Weber B (2012) Neural correlates of anticipation risk reflect risk preferences. J Neurosci 32:16683–16692

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 4:155–161

    Article  Google Scholar 

  • Samuelson PA (1938) A note on the pure theory of consumer’s behaviour. Economica 5:61–71

    Article  Google Scholar 

  • Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, Bossaerts P (2008) Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond Ser B Biol Sci 363:3801–3811

    Article  Google Scholar 

  • Schultz W, O’Neill M, Tobler PN, Kobayashi S (2011) Neuronal signals for reward risk in frontal cortex. Ann N Y Acad Sci 1239:109–117

    Article  PubMed  Google Scholar 

  • Stephens DW (2008) Decision ecology: foraging and the ecology of animal decision making. Cogn Affect Behav Neurosci 8:475–484

    Article  PubMed  Google Scholar 

  • Stephens DW, Anderson D (2001) The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav Ecol 12:330–339

    Article  Google Scholar 

  • Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782–1787

    Article  CAS  PubMed  Google Scholar 

  • Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642–1645

    Article  CAS  PubMed  Google Scholar 

  • Tobler PN, O’Doherty JP, Dolan RJ, Schultz W (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621–1632

    Article  PubMed  Google Scholar 

  • Tobler PN, Christopoulos GI, O’Doherty JP, Dolan RJ, Schultz W (2009) Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A 106:7185–7190

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Van Duuren E, Van Der Plasse G, Lankelma J, Joosten RNJMA, Feenstra MGP, Pennartz CMA, Van Duuren E, Van der Plasse G (2009) Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci 29:8965–8976

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Von Neumann J, Morgenstern O (1944) Theory of games and economic behavior. Princeton University Press, Princeton

    Google Scholar 

  • Wallis JD (2012) Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat Neurosci 15:13–19

    Article  CAS  Google Scholar 

  • Wallis JD, Kennerley SW (2011) Contrasting reward signals in the orbitofrontal cortex and anterior cingulate cortex. Ann N Y Acad Sci 1239:33–42

    Article  PubMed  Google Scholar 

  • Winstanley CA, Theobald DEH, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718–4722

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Comparative Psychology, Institute of Experimental Psychology, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany

    Marijn van Wingerden & Tobias Kalenscher

Authors
  1. Marijn van Wingerden
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tobias Kalenscher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marijn van Wingerden .

Editor information

Editors and Affiliations

  1. Emory University, Atlanta, GA, USA

    Dieter Jaeger

  2. University of Arkansas, Fayetteville, AR, USA

    Ranu Jung

Section Editor information

  1. National Research Council, Institute of Biophysics, Palermo, Italy

    Michele Migliore

  2. Computational Physiology Lab, Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, USA

    Christiane Linster

  3. Department of Biology, Emory University, Atlanta, GA, USA

    Francesco Cavarretta

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Science+Business Media, LLC, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

van Wingerden, M., Kalenscher, T. (2022). Choice Behavior. In: Jaeger, D., Jung, R. (eds) Encyclopedia of Computational Neuroscience. Springer, New York, NY. https://doi.org/10.1007/978-1-0716-1006-0_311

Download citation

Publish with us

Policies and ethics

Search

Navigation