Synonyms
Definition
The pattern of response allocation when making a selection among several choice alternatives.
Detailed Description
Choice behavior – the description of response allocation patterns when making a selection among several choice alternatives, as well as the identification of the choice-underlying psychological and neural mechanisms and their evolutionary origins – has been the topic of study in many scientific disciplines. Economics, mainly micro- and macroeconomics, has generated formal models of choice behavior that are designed to make accurate predictions of (aggregate) human behavior while making as few assumptions as possible and while being agnostic about the choice-underlying mental mechanisms. Psychologists are traditionally more concerned with describing and explaining the observable reality of human decision, but psychological theory is often also tested with animal models as approximations of specific,...
References
Afriat S (1967) The construction of utility functions from expenditure data. Int Econ Rev 8:67–77
Ainslie G (1974) Impulse control in pigeons. J Exp Anal Behav 21:485–489
Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–496
Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214–1221
Bernoulli D (1954) Exposition of a new theory on the measurement of risk. Econometrica 22:23
Burke CJ, Tobler PN (2011) Coding of reward probability and risk by single neurons in animals. Front Neurosci 5:121
Cai X, Kim S, Lee D (2011) Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69:170–182
Charnov EL (1976) Optimal foraging, the marginal value theorem. Theor Popul Biol 9:129–136
Christopoulos GI, Tobler PN, Bossaerts P, Dolan RJ, Schultz W (2009) Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J Neurosci 29:12574–12583
Elliott R, Agnew Z, Deakin JFW (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 27:2213–2218
Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, Fehr E, Weber EU (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13:538–539
Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–1902
Fiorillo CD, Tobler PN, Schultz W (2005) Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav Brain Funct BBF 1:7
Friedman M, Savage LJ (1948) The utility analysis of choices involving risk. J Polit Econ 56:279
Glimcher PW (2008) Understanding risk: a guide for the perplexed. Cogn Affect Behav Neurosci 8:348–354
Glimcher PW (2010) Foundations of neuroeconomic analysis. Oxford University Press, New York
Glimcher PW, Rustichini A (2004) Neuroeconomics: the consilience of brain and decision. Science 306:447–452
Green L, Fristoe N, Myerson J (1994) Temporal discounting and preference reversals in choice between delayed outcomes. Psychon Bull Rev 1:383–389
Green L, Myerson J, Calvert AL (2010) Pigeons’ discounting of probabilistic and delayed reinforcers. J Exp Anal Behav 94:113–123
Hamilton WD (1964a) The genetical evolution of social behaviour. I. J Theor Biol 7:1–16
Hamilton WD (1964b) The genetical evolution of social behaviour. II. J Theor Biol 7:17–52
Harbaugh W, Krause K, Berry T (2001) GARP for kids: on the development of rational choice behavior. Am Econ Rev 91(5):1539–1545
Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324:646–648
Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14:933–939
Herrnstein RJ (1961) Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4:267–272
Houthakker H (1950) Revealed preference and the utility function. Economica 17:159–174
Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625–1633
Kable JW, Glimcher PW (2009) The neurobiology of decision: consensus and controversy. Neuron 63:733–745
Kacelnik A (1997) Normative and descriptive models of decision making: time discounting and risk sensitivity. Ciba Found Symp 208:51–70
Kacelnik A, Bateson M (1996) Risky theories – the effects of variance on foraging decisions. Integr Comp Biol 36:402–434
Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263
Kahnt T, Heinzle J, Park SQ, Haynes J-D (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010–6015
Kalenscher T, Pennartz CM (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84:284–315
Kalenscher T, Van Wingerden M (2011) Why we should use animals to study economic decision making – a perspective. Front Neurosci 5:82
Kalenscher T, Diekamp B, Güntürkün O (2003) Neural architecture of choice behaviour in a concurrent interval schedule. Eur J Neurosci 18:2627–2637
Kalenscher T, Windmann S, Diekamp B, Rose J, Güntürkün O, Colombo M (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15:594–602
Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21:1162–1178
Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159
Kolling N, Behrens TEJ, Mars RB, Rushworth MFS (2012) Neural mechanisms of foraging. Science 336:95–98
Koopmans TC (1960) Stationary ordinal utility and impatience. Econometrica 28:287–309
Kuhnen CM, Knutson B (2005) The neural basis of financial risk taking. Neuron 47:763–770
Louie K, Glimcher PW (2010) Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci 30:5498–5507
Louie K, Glimcher PW (2012) Efficient coding and the neural representation of value. Ann N Y Acad Sci 1251:13–32
Louie K, Grattan LE, Glimcher PW (2011) Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci 31:10627–10639
Mar AC, Walker ALJ, Theobald DE, Eagle DM, Robbins TW (2011) Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci 31:6398–6404
Mazur JE (1984) Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol Anim Behav Process 10:426–436
Mazur JE (1988) Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav 49:37–47
McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503–507
McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27:5796–5804
McCoy AN, Platt ML (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 8:1220–1227
McDiarmid CG, Rilling ME (1965) Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychon Sci 2:195–196
Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160:290–298
O’Neill M, Schultz W (2010) Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68:789–800
Padoa-Schioppa C (2007) Orbitofrontal cortex and the computation of economic value. Ann N Y Acad Sci 1121:232–253
Padoa-Schioppa C (2009) Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 29:14004–14014
Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333–359
Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223–226
Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11:95–102
Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233–238
Prelec D, Loewenstein G (1991) Decision making over time and under uncertainty: a common approach. Manag Sci 37:770–786
Rachlin H, Green L (1972) Commitment, choice and self control. J Exp Anal Behav 17:15–22
Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233–244
Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262–270
Roesch MR, Bryden DW (2011) Impact of size and delay on neural activity in the rat limbic corticostriatal system. Front Neurosci 5:130
Roesch MR, Olson CR (2005) Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol 94:2457–2471
Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51:509–520
Roitman JD, Roitman MF (2010) Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31:1492–1500
Rolls ET, McCabe C, Redoute J (2008) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18:652–663
Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161–1168
Rudorf S, Preuschoff K, Weber B (2012) Neural correlates of anticipation risk reflect risk preferences. J Neurosci 32:16683–16692
Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 4:155–161
Samuelson PA (1938) A note on the pure theory of consumer’s behaviour. Economica 5:61–71
Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, Bossaerts P (2008) Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond B Biol Sci 363:3801–3811
Schultz W, O’Neill M, Tobler PN, Kobayashi S (2011) Neuronal signals for reward risk in frontal cortex. Ann N Y Acad Sci 1239:109–117
Stephens DW (2008) Decision ecology: foraging and the ecology of animal decision making. Cogn Affect Behav Neurosci 8:475–484
Stephens DW, Anderson D (2001) The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav Ecol 12:330–339
Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782–1787
Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642–1645
Tobler PN, O’Doherty JP, Dolan RJ, Schultz W (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621–1632
Tobler PN, Christopoulos GI, O’Doherty JP, Dolan RJ, Schultz W (2009) Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A 106:7185–7190
Van Duuren E, Van Der Plasse G, Lankelma J, Joosten RNJMA, Feenstra MGP, Pennartz CMA, Van Duuren E, Van der Plasse G (2009) Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci 29:8965–8976
Von Neumann J, Morgenstern O (1944) Theory of games and economic behavior. Princeton University Press, Princeton
Wallis JD (2012) Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat Neurosci 15:13–19
Wallis JD, Kennerley SW (2011) Contrasting reward signals in the orbitofrontal cortex and anterior cingulate cortex. Ann N Y Acad Sci 1239:33–42
Winstanley CA, Theobald DEH, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718–4722
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this entry
Cite this entry
van Wingerden, M., Kalenscher, T. (2013). Choice Behavior. In: Jaeger, D., Jung, R. (eds) Encyclopedia of Computational Neuroscience. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7320-6_311-1
Download citation
DOI: https://doi.org/10.1007/978-1-4614-7320-6_311-1
Received:
Accepted:
Published:
Publisher Name: Springer, New York, NY
Online ISBN: 978-1-4614-7320-6
eBook Packages: Springer Reference Biomedicine and Life SciencesReference Module Biomedical and Life Sciences