Encyclopedia of Computational Neuroscience

Living Edition
| Editors: Dieter Jaeger, Ranu Jung

Choice Behavior

  • Marijn van WingerdenEmail author
  • Tobias Kalenscher
Living reference work entry
DOI: https://doi.org/10.1007/978-1-4614-7320-6_311-1

Synonyms

Definition

The pattern of response allocation when making a selection among several choice alternatives.

Detailed Description

Choice behavior – the description of response allocation patterns when making a selection among several choice alternatives, as well as the identification of the choice-underlying psychological and neural mechanisms and their evolutionary origins – has been the topic of study in many scientific disciplines. Economics, mainly micro- and macroeconomics, has generated formal models of choice behavior that are designed to make accurate predictions of (aggregate) human behavior while making as few assumptions as possible and while being agnostic about the choice-underlying mental mechanisms. Psychologists are traditionally more concerned with describing and explaining the observable reality of human decision, but psychological theory is often also tested with animal models as approximations of specific,...

Keywords

Utility Function Anterior Cingulate Cortex Choice Behavior Delay Discount Discount Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

References

  1. Afriat S (1967) The construction of utility functions from expenditure data. Int Econ Rev 8:67–77CrossRefGoogle Scholar
  2. Ainslie G (1974) Impulse control in pigeons. J Exp Anal Behav 21:485–489PubMedCentralPubMedCrossRefGoogle Scholar
  3. Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–496PubMedCrossRefGoogle Scholar
  4. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214–1221PubMedCrossRefGoogle Scholar
  5. Bernoulli D (1954) Exposition of a new theory on the measurement of risk. Econometrica 22:23CrossRefGoogle Scholar
  6. Burke CJ, Tobler PN (2011) Coding of reward probability and risk by single neurons in animals. Front Neurosci 5:121PubMedCentralPubMedCrossRefGoogle Scholar
  7. Cai X, Kim S, Lee D (2011) Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69:170–182PubMedCentralPubMedCrossRefGoogle Scholar
  8. Charnov EL (1976) Optimal foraging, the marginal value theorem. Theor Popul Biol 9:129–136PubMedCrossRefGoogle Scholar
  9. Christopoulos GI, Tobler PN, Bossaerts P, Dolan RJ, Schultz W (2009) Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J Neurosci 29:12574–12583PubMedCentralPubMedCrossRefGoogle Scholar
  10. Elliott R, Agnew Z, Deakin JFW (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 27:2213–2218PubMedCrossRefGoogle Scholar
  11. Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, Fehr E, Weber EU (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13:538–539PubMedCrossRefGoogle Scholar
  12. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–1902PubMedCrossRefGoogle Scholar
  13. Fiorillo CD, Tobler PN, Schultz W (2005) Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav Brain Funct BBF 1:7CrossRefGoogle Scholar
  14. Friedman M, Savage LJ (1948) The utility analysis of choices involving risk. J Polit Econ 56:279CrossRefGoogle Scholar
  15. Glimcher PW (2008) Understanding risk: a guide for the perplexed. Cogn Affect Behav Neurosci 8:348–354PubMedCrossRefGoogle Scholar
  16. Glimcher PW (2010) Foundations of neuroeconomic analysis. Oxford University Press, New YorkCrossRefGoogle Scholar
  17. Glimcher PW, Rustichini A (2004) Neuroeconomics: the consilience of brain and decision. Science 306:447–452PubMedCrossRefGoogle Scholar
  18. Green L, Fristoe N, Myerson J (1994) Temporal discounting and preference reversals in choice between delayed outcomes. Psychon Bull Rev 1:383–389PubMedCrossRefGoogle Scholar
  19. Green L, Myerson J, Calvert AL (2010) Pigeons’ discounting of probabilistic and delayed reinforcers. J Exp Anal Behav 94:113–123PubMedCentralPubMedCrossRefGoogle Scholar
  20. Hamilton WD (1964a) The genetical evolution of social behaviour. I. J Theor Biol 7:1–16PubMedCrossRefGoogle Scholar
  21. Hamilton WD (1964b) The genetical evolution of social behaviour. II. J Theor Biol 7:17–52PubMedCrossRefGoogle Scholar
  22. Harbaugh W, Krause K, Berry T (2001) GARP for kids: on the development of rational choice behavior. Am Econ Rev 91(5):1539–1545CrossRefGoogle Scholar
  23. Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324:646–648PubMedCrossRefGoogle Scholar
  24. Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14:933–939PubMedCentralPubMedCrossRefGoogle Scholar
  25. Herrnstein RJ (1961) Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4:267–272PubMedCentralPubMedCrossRefGoogle Scholar
  26. Houthakker H (1950) Revealed preference and the utility function. Economica 17:159–174CrossRefGoogle Scholar
  27. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625–1633PubMedCentralPubMedCrossRefGoogle Scholar
  28. Kable JW, Glimcher PW (2009) The neurobiology of decision: consensus and controversy. Neuron 63:733–745PubMedCentralPubMedCrossRefGoogle Scholar
  29. Kacelnik A (1997) Normative and descriptive models of decision making: time discounting and risk sensitivity. Ciba Found Symp 208:51–70PubMedGoogle Scholar
  30. Kacelnik A, Bateson M (1996) Risky theories – the effects of variance on foraging decisions. Integr Comp Biol 36:402–434CrossRefGoogle Scholar
  31. Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263CrossRefGoogle Scholar
  32. Kahnt T, Heinzle J, Park SQ, Haynes J-D (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010–6015PubMedCentralPubMedCrossRefGoogle Scholar
  33. Kalenscher T, Pennartz CM (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84:284–315PubMedCrossRefGoogle Scholar
  34. Kalenscher T, Van Wingerden M (2011) Why we should use animals to study economic decision making – a perspective. Front Neurosci 5:82PubMedCentralPubMedCrossRefGoogle Scholar
  35. Kalenscher T, Diekamp B, Güntürkün O (2003) Neural architecture of choice behaviour in a concurrent interval schedule. Eur J Neurosci 18:2627–2637PubMedCrossRefGoogle Scholar
  36. Kalenscher T, Windmann S, Diekamp B, Rose J, Güntürkün O, Colombo M (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15:594–602PubMedCrossRefGoogle Scholar
  37. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21:1162–1178PubMedCentralPubMedCrossRefGoogle Scholar
  38. Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159PubMedGoogle Scholar
  39. Kolling N, Behrens TEJ, Mars RB, Rushworth MFS (2012) Neural mechanisms of foraging. Science 336:95–98PubMedCentralPubMedCrossRefGoogle Scholar
  40. Koopmans TC (1960) Stationary ordinal utility and impatience. Econometrica 28:287–309CrossRefGoogle Scholar
  41. Kuhnen CM, Knutson B (2005) The neural basis of financial risk taking. Neuron 47:763–770PubMedCrossRefGoogle Scholar
  42. Louie K, Glimcher PW (2010) Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci 30:5498–5507PubMedCentralPubMedCrossRefGoogle Scholar
  43. Louie K, Glimcher PW (2012) Efficient coding and the neural representation of value. Ann N Y Acad Sci 1251:13–32PubMedCrossRefGoogle Scholar
  44. Louie K, Grattan LE, Glimcher PW (2011) Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci 31:10627–10639PubMedCentralPubMedCrossRefGoogle Scholar
  45. Mar AC, Walker ALJ, Theobald DE, Eagle DM, Robbins TW (2011) Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci 31:6398–6404PubMedCentralPubMedCrossRefGoogle Scholar
  46. Mazur JE (1984) Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol Anim Behav Process 10:426–436CrossRefGoogle Scholar
  47. Mazur JE (1988) Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav 49:37–47PubMedCentralPubMedCrossRefGoogle Scholar
  48. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503–507PubMedCrossRefGoogle Scholar
  49. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27:5796–5804PubMedCrossRefGoogle Scholar
  50. McCoy AN, Platt ML (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 8:1220–1227PubMedCrossRefGoogle Scholar
  51. McDiarmid CG, Rilling ME (1965) Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychon Sci 2:195–196CrossRefGoogle Scholar
  52. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160:290–298CrossRefGoogle Scholar
  53. O’Neill M, Schultz W (2010) Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68:789–800PubMedCrossRefGoogle Scholar
  54. Padoa-Schioppa C (2007) Orbitofrontal cortex and the computation of economic value. Ann N Y Acad Sci 1121:232–253PubMedCrossRefGoogle Scholar
  55. Padoa-Schioppa C (2009) Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 29:14004–14014PubMedCentralPubMedCrossRefGoogle Scholar
  56. Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333–359PubMedCentralPubMedCrossRefGoogle Scholar
  57. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223–226PubMedCentralPubMedCrossRefGoogle Scholar
  58. Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11:95–102PubMedCentralPubMedCrossRefGoogle Scholar
  59. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233–238PubMedCrossRefGoogle Scholar
  60. Prelec D, Loewenstein G (1991) Decision making over time and under uncertainty: a common approach. Manag Sci 37:770–786CrossRefGoogle Scholar
  61. Rachlin H, Green L (1972) Commitment, choice and self control. J Exp Anal Behav 17:15–22PubMedCentralPubMedCrossRefGoogle Scholar
  62. Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233–244PubMedCentralPubMedCrossRefGoogle Scholar
  63. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262–270PubMedCrossRefGoogle Scholar
  64. Roesch MR, Bryden DW (2011) Impact of size and delay on neural activity in the rat limbic corticostriatal system. Front Neurosci 5:130PubMedCentralPubMedCrossRefGoogle Scholar
  65. Roesch MR, Olson CR (2005) Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol 94:2457–2471PubMedCrossRefGoogle Scholar
  66. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51:509–520PubMedCentralPubMedCrossRefGoogle Scholar
  67. Roitman JD, Roitman MF (2010) Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31:1492–1500PubMedCentralPubMedCrossRefGoogle Scholar
  68. Rolls ET, McCabe C, Redoute J (2008) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18:652–663PubMedCrossRefGoogle Scholar
  69. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161–1168PubMedCrossRefGoogle Scholar
  70. Rudorf S, Preuschoff K, Weber B (2012) Neural correlates of anticipation risk reflect risk preferences. J Neurosci 32:16683–16692PubMedCrossRefGoogle Scholar
  71. Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 4:155–161CrossRefGoogle Scholar
  72. Samuelson PA (1938) A note on the pure theory of consumer’s behaviour. Economica 5:61–71CrossRefGoogle Scholar
  73. Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, Bossaerts P (2008) Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond B Biol Sci 363:3801–3811PubMedCentralPubMedCrossRefGoogle Scholar
  74. Schultz W, O’Neill M, Tobler PN, Kobayashi S (2011) Neuronal signals for reward risk in frontal cortex. Ann N Y Acad Sci 1239:109–117PubMedCrossRefGoogle Scholar
  75. Stephens DW (2008) Decision ecology: foraging and the ecology of animal decision making. Cogn Affect Behav Neurosci 8:475–484PubMedCrossRefGoogle Scholar
  76. Stephens DW, Anderson D (2001) The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav Ecol 12:330–339CrossRefGoogle Scholar
  77. Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782–1787PubMedCrossRefGoogle Scholar
  78. Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642–1645PubMedCrossRefGoogle Scholar
  79. Tobler PN, O’Doherty JP, Dolan RJ, Schultz W (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621–1632PubMedCentralPubMedCrossRefGoogle Scholar
  80. Tobler PN, Christopoulos GI, O’Doherty JP, Dolan RJ, Schultz W (2009) Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A 106:7185–7190PubMedCentralPubMedCrossRefGoogle Scholar
  81. Van Duuren E, Van Der Plasse G, Lankelma J, Joosten RNJMA, Feenstra MGP, Pennartz CMA, Van Duuren E, Van der Plasse G (2009) Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci 29:8965–8976PubMedCrossRefGoogle Scholar
  82. Von Neumann J, Morgenstern O (1944) Theory of games and economic behavior. Princeton University Press, PrincetonGoogle Scholar
  83. Wallis JD (2012) Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat Neurosci 15:13–19CrossRefGoogle Scholar
  84. Wallis JD, Kennerley SW (2011) Contrasting reward signals in the orbitofrontal cortex and anterior cingulate cortex. Ann N Y Acad Sci 1239:33–42PubMedCrossRefGoogle Scholar
  85. Winstanley CA, Theobald DEH, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718–4722PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Department of Comparative Psychology, Institute of Experimental PsychologyHeinrich-Heine University DüsseldorfDüsseldorfGermany