Advertisement

Value Maps, Drives, and Emotions

  • Daniel S. Levine
Chapter
Part of the Springer Series in Cognitive and Neural Systems book series (SSCNS)

Abstract

This chapter discusses value maps, drives, and emotions through the modeling of decision making, judgment, and choice. Ever the since the seminal work of Amos Tversky and Nobel Laureate Daniel Kahneman (Tversky and Kahneman 1974, 1981), it has been known that decision models based on rational maximization of expected utility do not capture the typical choices that people or nonhuman animals make in risky situations, even when extensive numerical or probabilistic information is available. Moreover, many of those choices tend to be strongly influenced by emotions and values in ways that are predictable, repeatable, and therefore amenable to theory development.

Keywords

Anterior Cingulate Cortex Prospect Theory Skin Conductance Response Iowa Gambling Task Probability Weighting Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. .
    Alexander G. E., Crutcher, M. D., and DeLong, M. R. (1990). Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, “prefrontal” and “limbic” functions. Progress in Brain Research, 85, 119–146.CrossRefPubMedGoogle Scholar
  2. .
    Allais, P. M. (1953). Le comportement de l’homme rationnel devant le risqué: Critique des postulats et axiomes de l’école américaine. Econometrica, 21, 503–546.CrossRefGoogle Scholar
  3. .
    Barbas, H., and Zikopoulos, B. (2006). Sequential and parallel circuits for emotional processing in primate orbitofrontal cortex. In D. Zald and S. L. Rauch (Eds.), The orbitofrontal cortex (pp. 57–80). Oxford: Oxford University Press.CrossRefGoogle Scholar
  4. .
    Barch, D. M., Braver, T. S., Akbudak, E., Conturo, T., Ollinger, J., and Snyder, A. (2001). Anterior cingulate cortex and response conflict: Effects of response modality and processing domain. Cerebral Cortex, 11, 837–848.CrossRefPubMedGoogle Scholar
  5. .
    Barron, G., and Erev, I. (2003). Small feedback-based decisions and their limited correspondence to description-based decisions. Journal of Behavioral Decision Making, 16, 215–233.CrossRefGoogle Scholar
  6. .
    Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7–15.CrossRefPubMedGoogle Scholar
  7. .
    Bechara, A., Damasio, H., and Damasio, A. R. (2000). Emotion, decision making, and the orbitofrontal cortex. Cerebral Cortex, 10, 295–307.CrossRefPubMedGoogle Scholar
  8. .
    Blair, K., Marsh, A. A., Morton, J., Vythilingam, M., Jones, M., Mondillo, K., Pine, D. C., Drevets, W. C., and Blair, J. R. (2006). Choosing the lesser of two evils, the better of two goods: Specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. Journal of Neuroscience, 26, 11379–11386.CrossRefPubMedGoogle Scholar
  9. .
    Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., and Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624–652.CrossRefPubMedGoogle Scholar
  10. .
    Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., and Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30, 619–639.CrossRefPubMedGoogle Scholar
  11. .
    Brown, J. W., and Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science, 307, 1118–1121.CrossRefPubMedGoogle Scholar
  12. .
    Bunge, S. A. (2004). How we use rules to select actions: A review of evidence from cognitive neuroscience. Cognitive, Affective, & Behavioral Neuroscience, 4, 564–579.CrossRefGoogle Scholar
  13. .
    Busemeyer, J. R., Jessup, R. K., Johnson, J. G., and Townsend, J. T. (2006). Building bridges between neural models and complex decision making behavior. Neural Networks, 19, 1047–1058.CrossRefPubMedGoogle Scholar
  14. .
    Busemeyer, J. R., and Townsend, J. T. (1993). Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review, 100, 432–459.CrossRefPubMedGoogle Scholar
  15. .
    Bush, G., Luu, P., and Posner, M. I. (2000). Cognitive and emotional influences in anterior cingulate cortex. Trends in Cognitive Science, 4, 215–222.CrossRefGoogle Scholar
  16. .
    Cacioppo, J. T., and Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42, 116–131.CrossRefGoogle Scholar
  17. .
    Cacioppo, J. T., Petty, R. E., Feinstein, J. A., and Jarvis, W. B. G. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin, 119, 197–253.CrossRefGoogle Scholar
  18. .
    Carpenter, G. A., and Grossberg, S. (1987). A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54–115.CrossRefGoogle Scholar
  19. .
    Carpenter, G. A., Grossberg, S., and Reynolds, J. H. (1991a). ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks, 4, 565–588.CrossRefGoogle Scholar
  20. .
    Carpenter, G. A., Grossberg, S., and Rosen, D. B. (1991b). Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4, 759–771.CrossRefGoogle Scholar
  21. .
    Coleman, S., Brown, V. R., Levine, D. S., and Mellgren, R. L. (2005). A neural network model of foraging decisions made under predation risk. Cognitive, Affective, and Behavioral Neuroscience, 5, 434–451.CrossRefPubMedGoogle Scholar
  22. .
    Curşeu, P. L. (2006). Need for cognition and rationality in decision-making. Studia Psychologica, 48, 141–156.Google Scholar
  23. .
    Damasio, A. R. (1994). Descartes’ error: Emotion, reason, and the human brain. New York: Grosset/Putnam.Google Scholar
  24. .
    DeMartino, B., Kumaran, D., Seymour, B., and Dolan, R. (2006). Frames, biases, and rational decision-making in the human brain. Science, 313, 684–687.CrossRefGoogle Scholar
  25. .
    Denes-Raj, V., and Epstein, S. (1994). Conflict between intuitive and rational processing: When people behave against their better judgment. Journal of Personality and Social Psychology, 66, 819–829.CrossRefPubMedGoogle Scholar
  26. .
    DeNeys, W., Vartanian, O., and Goel, V. (2008). Smarter than we think: When our brain detects we’re biased. Psychological Science, 19, 483–489.CrossRefGoogle Scholar
  27. .
    Dias, R., Robbins, T. W., and Roberts, A. C. (1996). Dissociation in prefrontal cortex of affective and attentional shifts. Nature, 380, 69–72.CrossRefPubMedGoogle Scholar
  28. .
    Dranias, M., Grossberg, S., and Bullock, D. (2008). Dopaminergic and non-dopaminergic value systems in conditioning and outcome-specific revaluation. Brain Research, 1238, 239–287.CrossRefPubMedGoogle Scholar
  29. .
    Eisler, R., and Levine, D. S. (2002). Nurture, nature, and caring: We are not prisoners of our genes. Brain and Mind, 3, 9–52.CrossRefGoogle Scholar
  30. .
    Elliott, R., Agnew, Z., and Deakin, J. F. W. (2008). Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. European Journal of Neuroscience, 27, 2213–2218.CrossRefPubMedGoogle Scholar
  31. .
    Frank, M. J., and Claus, E. D. (2006). Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review, 113, 300–326.CrossRefPubMedGoogle Scholar
  32. .
    Grossberg, S. (1972a). A neural theory of punishment and avoidance. I. Qualitative theory. Mathematical Biosciences, 15, 39–67.Google Scholar
  33. .
    Grossberg, S. (1972b). A neural theory of punishment and avoidance. II. Quantitative theory. Mathematical Biosciences, 15, 253–285.Google Scholar
  34. .
    Grossberg, S. (1988). Nonlinear neural networks: Principles, mechanisms, and architectures. Neural Networks, 1, 17–61.CrossRefGoogle Scholar
  35. .
    Grossberg, S., and Gutowski, W. (1987). Neural dynamics of decision making under risk: Affective balance and cognitive-emotional interactions. Psychological Review, 94, 300–318.CrossRefPubMedGoogle Scholar
  36. .
    Haber, S. N., Kim, K.-S., Mailly, P., and Calzavara, R. (2006). Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. Journal of Neuroscience, 26, 8368–8376.CrossRefPubMedGoogle Scholar
  37. .
    Hertwig, R., Barron, G., Weber, E. U., and Erev, I. (2004). Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15, 534–539.CrossRefPubMedGoogle Scholar
  38. .
    Heyman, J., Mellers, B. A., Tishcenko, S., and Schwartz, A. (2004). I was pleased a moment ago: How pleasure varies with background and foreground reference points. Motivation and Emotion, 28, 65–83.CrossRefGoogle Scholar
  39. .
    Huettel, S. A., and Misiurek, J. (2004). Modulation of prefrontal cortex activity by information toward a decision rule. Neuroreport, 15, 1883–1886.CrossRefPubMedGoogle Scholar
  40. .
    Iyer, L. R., Doboli, S., Minai, A. A., Brown, V. R., Levine, D. S., and Paulus, P. B. (2009). Neural dynamics of idea generation and the effects of priming. Neural Networks, 22, 674–686.CrossRefPubMedGoogle Scholar
  41. .
    Johnson, E. J., Schulte-Mecklenbeck, M., and Willemsen, M. C. (2008). Process models deserve process data: Comment on Brandstätter, Gigerenzer, and Hertwig (2006). Psychological Review, 115, 263–273.CrossRefPubMedGoogle Scholar
  42. .
    Kahneman, D., and Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237–251.CrossRefGoogle Scholar
  43. .
    Kahneman, D., and Tversky, A. (1990). Prospect theory: An analysis of decision under risk. In P. K. Moser (Ed.), Rationality in action: Contemporary approaches (pp. 140–170). New York: Cambridge University Press. (Originally published in Econometrica, 47, 263–291, 1979).Google Scholar
  44. .
    Krawczyk, D., Levine, D. S., Ramirez, P. A., Robinson, R., and Togun, I. (2008). fMRI study of rational versus irrational choices on a ratio bias task. Poster at the annual meeting of the Society for Judgment and Decision Making, Chicago.Google Scholar
  45. .
    Krynski, T. R., and Tenenbaum, J. B. (2007). The role of causality in judgment under uncertainty. Journal of Experimental Psychology, General, 136, 430–450.CrossRefGoogle Scholar
  46. .
    Lazarus, R. S. (1982). Thoughts on the relations between emotion and cognition. American Psychologist, 37, 1019–1024.CrossRefGoogle Scholar
  47. .
    Leven, S. J., and Levine, D. S. (1996). Multiattribute decision making in context: a dynamical neural network methodology. Cognitive Science, 20, 271–299.CrossRefGoogle Scholar
  48. .
    Levine, D. S. (2000). Introduction to neural and cognitive modeling (2nd ed.) Mahwah, N. J.: Lawrence Erlbaum Associates.Google Scholar
  49. .
    Levine, D. S. (2007). Seek simplicity and distrust it: Knowledge maximization versus effort minimization. Proceedings of KIMAS 2007.Google Scholar
  50. .
    Levine, D. S. (2009a). Brain pathways for cognitive-emotional decision making in the human animal. Neural Networks, 22, 286–293.CrossRefPubMedGoogle Scholar
  51. .
    Levine, D. S. (2009b). Where is utopia in the brain? Utopian Studies, 20, 249–274.Google Scholar
  52. .
    Levine, D. S., Mills, B. A., and Estrada, S. (2005). Modeling emotional influences on human decision making under risk. Proceedings of International Joint Conference on Neural Networks, 1657–1662.Google Scholar
  53. .
    Levine, D. S., and Perlovsky, L. I. (2008a). A network model of rational versus irrational choices on a probability maximization task. IEEE: Proceedings of WCCI 2008.Google Scholar
  54. .
    Levine, D. S., and Perlovsky, L. I. (2008b). Simplifying heuristics versus careful thinking: scientific analysis of millennial spiritual issues. Zygon, 43, 797–821.CrossRefGoogle Scholar
  55. .
    Maia, T. V., and McClelland, J. L. (2004). A reexamination of the evidence for the somatic marker hypothesis: What participants really know in the Iowa gambling task. Proceedings of the National Academy of Sciences, 101, 16075–16080.CrossRefGoogle Scholar
  56. .
    Mellers, B. (2000). Choice and the relative pleasure of consequences. Psychological Bulletin, 126, 910–924.CrossRefPubMedGoogle Scholar
  57. .
    Öngur, D., and Price, J. L. (2000). The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex, 10, 206–219.CrossRefPubMedGoogle Scholar
  58. .
    O’Toole, A. J., Jiang, F., Abdi, H., Pénard, N., Dunlop, J. P., and Parent, M. A. (2007). Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. Journal of Cognitive Neuroscience, 19, 1735–1752.CrossRefPubMedGoogle Scholar
  59. .
    Pacini, R., and Epstein, S. (1999). The relation of rational and experiential information processing styles to personality, basic beliefs, and the ratio-bias phenomenon. Journal of Personality and Social Psychology, 76, 972–987.CrossRefPubMedGoogle Scholar
  60. .
    Perlovsky, L. I. (2006). Toward physics of the mind: Concepts, emotions, consciousness, and symbols. Physics of Life Reviews, 3, 23–55.CrossRefGoogle Scholar
  61. .
    Pessoa, L. (2008). On the relationship between emotion and cognition. Nature Reviews in Neuroscience, 9, 148–158.CrossRefGoogle Scholar
  62. .
    Piazza, M., Izard, V., Pinel, P., Le Bihan, D., and Dehaene, S. (2004). Tuning curves for approximate numerosity in the human intraparietal sulcus. Neuron, 44, 547–555.CrossRefPubMedGoogle Scholar
  63. .
    Raijmakers, M. E. J., and Molenaar, P. C. M. (1997). Exact ART: A complete implementation of an ART network. Neural Networks, 10, 649–669.CrossRefPubMedGoogle Scholar
  64. .
    Ramirez, P. A., and Levine, D. S. (2009). Expanding beyond the foundations of decision making: Perceived differences in the value of resources. Poster at the annual meeting of the Society for Judgment and Decision Making, Boston.Google Scholar
  65. .
    Reyna, V. F., and Brainerd, C. J. (2008). Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learning and Individual Differences, 18, 89–107.CrossRefGoogle Scholar
  66. .
    Reyna, V. F., Lloyd, F. J., and Brainerd, C. J. (2003). Memory, development, and rationality: An integrative theory of judgment and decision making. In S. Schneider and J. Shanteau (Eds.), Emerging perspectives on judgment and decision making (pp. 201–245). New York: Cambridge University Press.Google Scholar
  67. .
    Rieskamp, J. (2008). The probabilistic nature of preferential choice. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1446–1465.CrossRefPubMedGoogle Scholar
  68. .
    Roe, R. M., Busemeyer, J. R., and Townsend, J. T. (2001). Multialternative decision field theory: A dynamic connectionist model of decision making. Psychological Review, 108, 370–392.CrossRefPubMedGoogle Scholar
  69. .
    Rolls, E. T. (2000). The orbitofrontal cortex and reward. Cerebral Cortex, 10, 284–294.CrossRefPubMedGoogle Scholar
  70. .
    Rolls, E. T. (2006). The neurophysiology and functions of the orbitofrontal cortex. In D. Zald and S. L. Rauch (Eds.), The orbitofrontal cortex (pp. 95–124). Oxford: Oxford University Press.CrossRefGoogle Scholar
  71. .
    Rottenstreich, Y., and Hsee, C. (2001). Money, kisses, and electric shocks: On the affective psychology of risk. Psychological Science, 12, 185–190.CrossRefPubMedGoogle Scholar
  72. .
    Royer, S., and Paré, D. (2002). Bidirectional synaptic plasticity in intercalated amygdala neurons and the extinction of conditioned fear responses. Neuroscience, 115, 455–462.CrossRefPubMedGoogle Scholar
  73. .
    Schoenbaum, S., Setlow, B., Saddoris, M., and Gallagher, M. (2003). Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron, 39, 855–867.CrossRefPubMedGoogle Scholar
  74. .
    Solomon, R. L., and Corbit, J. D. (1974). An opponent-process theory of motivation: I. Temporal dynamics of affect. Psychological Review, 81, 119–145.Google Scholar
  75. .
    Tremblay, L., and Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704–707.CrossRefPubMedGoogle Scholar
  76. .
    Trepel, C., Fox, C. R., and Poldrack, R. A. (2005). Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. Cognitive Brain Research, 23, 34–50.CrossRefPubMedGoogle Scholar
  77. .
    Tversky, A., and Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.CrossRefPubMedGoogle Scholar
  78. .
    Tversky, A., and Kahneman, D. (1981). The framing of decisions and the rationality of choice. Science, 211, 453–458.CrossRefPubMedGoogle Scholar
  79. .
    Tversky, A., and Kahneman, D. (2004). Advances in prospect theory: Cumulative representation of uncertainty. In E. Shafir, Preference, belief, and similarity: Selected writings by Amos Tversky (pp. 673–702). Cambridge, MA: MIT. This was originally published in Journal of Risk and Uncertainty, 5, 297–323, 1992.Google Scholar
  80. .
    Wagar, B., and Thagard, P. (2004). Spiking Phineas Gage. Psychological Review, 111, 67–79.CrossRefPubMedGoogle Scholar
  81. .
    Weber, E. U., Shafir, S., and Blais, A.-R. (2004). Predicting risk sensitivity in humans and lower animssals: Risk as variance or coefficient of variation. Psychological Review, 111, 430–445.CrossRefPubMedGoogle Scholar
  82. .
    Zadeh, L. (1965). Fuzzy sets. Information and Control, 8, 338–353.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.Department of PsychologyUniversity of Texas at ArlingtonArlingtonUSA

Personalised recommendations