Skip to main content

Multiple Neural Circuits in Value-Based Decision-Making

  • Conference paper
  • First Online:
Advances in Cognitive Neurodynamics (III)
  • 700 Accesses

Abstract

Valuation is an essential function in decision-making. To understand the nature of the distinct neural systems used in such valuation, we performed monkey single-unit recording experiments and a human fMRI experiment using (1) a perceptual discrimination task with asymmetric reward, and (2) a reward inference task. The results suggest that both the primate and human brain have, at least, two distinct valuation systems: one in the nigro-striatal circuit (the stimulus-based valuation system) and the other in the PFC circuit (the knowledge-based valuation system). We propose that the stimulus-based valuation system calculates values based on the empirical and probabilistic relation between an event and its outcome. The knowledge-based valuation system generates values by further extension of directly-experienced association through categorical processes and rules, thereby enabling animals to predict the outcome of an inexperienced event.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rangel, A., Camerer, C., Montague, P.R.: A framework for studying the neurobiology of value-based decision-making. Nat. Rev. Neurosci. 9 (2008) 545–556

    Article  CAS  PubMed  Google Scholar 

  2. Yamamoto, M., Okuda, J., Samejima, K., Sakagami, M.: Differential reward prediction on salient and uncertain perception as revealed by random dot motion stimuli and fMRI. Soc. Neurosci. Abstr. (2007) 311.12

    Google Scholar 

  3. Nomoto, K., Schultz, W., Watanabe, T., Sakagami, M.: Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J. Neurosci. 30 (2010) 10692–10702

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  4. Pan, X., Sawa, K., Tsuda, I., Tsukada, M., Sakagami, M.: Reward prediction based on stimulus categorization in primate lateral prefrontal cortex. Nat. Neurosci. 11 (2008) 703–712

    Article  CAS  PubMed  Google Scholar 

  5. Haber, S.N.: The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26 (2003) 317–330

    Article  PubMed  Google Scholar 

  6. Schultz, W., Dayan, P., Montague, P.R.: A neural substrate of prediction and reward. Science, 275 (1997) 1593–1599

    Article  CAS  PubMed  Google Scholar 

  7. Tobler, P.N., O’Doherty, J.P., Dolan, R.J., Schultz, W.: Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 97 (2007) 1621–1632

    Article  PubMed Central  PubMed  Google Scholar 

  8. Summerfield, C., Egner, T., Mangels, J., Hirsch, J.: Mistaking a house for a face: neural correlates of misperception in healthy humans. Cereb. Cortex, 16 (2006) 500–508

    Article  PubMed  Google Scholar 

  9. Hayden, B.Y., Pearson, J.M., Platt, M.L.: Fictive reward signals in the anterior cingulate cortex. Science, 324 (2009) 248–250

    Article  Google Scholar 

  10. Yoshida, W., Seymour, B., Friston, K.J., Dolan, R.J.: Neural mechanisms of belief inference during cooperative games. J. Neurosci. 30 (2010) 10744–10751

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  11. Kim, J., Shadlen, M.N.: Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 2 (1999) 176–185

    Article  PubMed  Google Scholar 

  12. Daw, N.D., Niv, Y., Dayan, P.: Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8 (2005) 1704–1711

    Article  CAS  PubMed  Google Scholar 

  13. Behrens, T.E., Hunt, L.T., Rushworth, M.F.: The computation of social behavior. Science, 324 (2009) 1160–1164

    Article  CAS  PubMed  Google Scholar 

  14. Hare, T.A., Camerer, C.F., Rangel, A.: Self-control in decision-making involves modulation of the vMPFC valuation system. Science, 324 (2009) 646–648

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

Our research was supported by the twenty-first Century Center of Excellence (COE) program (Integrative Human Science Program, Tamagawa University) and the global COE program (Origins of the Social Mind, Tamagawa University) from the Japan Society for Promotion of Science (JSPS), and Grants-in-Aid for Scientific Research on Priority areas from the Ministry of Education, Culture, Sports, Science and Technology, Japan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Masamichi Sakagami .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht

About this paper

Cite this paper

Sakagami, M. (2013). Multiple Neural Circuits in Value-Based Decision-Making. In: Yamaguchi, Y. (eds) Advances in Cognitive Neurodynamics (III). Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4792-0_55

Download citation

Publish with us

Policies and ethics