Advertisement

Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

  • Dan-Dan Hong
  • Wen-Qiang Huang
  • Ai-Ai Ji
  • Sha-Sha Yang
  • Hui Xu
  • Ke-Yi Sun
  • Aihua Cao
  • Wen-Jun Gao
  • Ning Zhou
  • Ping Yu
Original Article

Abstract

The orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC) are known to participate in risk-based decision-making. However, whether neuronal activities of these two brain regions play similar or differential roles during different stages of risk-based decision-making process remains unknown. Here we conducted multi-channel in vivo recordings in the OFC and mPFC simultaneously when rats were performing a gambling task. Rats were trained to update strategy as the task was shifted in two stages. Behavioral testing suggests that rats exhibited different risk preferences and response latencies to food rewards during stage-1 and stage-2. Indeed, the firing patterns and numbers of non-specific neurons and nosepoking-predicting neurons were similar in OFC and mPFC. However, there were no reward-expecting neurons and significantly more reward-excitatory neurons (fired as rats received rewards) in the mPFC. Further analyses suggested that nosepoking-predicting neurons may encode the overall value of reward and strategy, whereas reward-expecting neurons show more intensive firing to a big food reward in the OFC. Nosepoking-predicting neurons in mPFC showed no correlation with decision-making strategy updating, whereas the response of reward-excitatory neurons in mPFC, which were barely observed in OFC, were inhibited during nosepoking, but were enhanced in the post-nosepoking period. These findings indicate that neurons in the OFC and mPFC exhibit distinct responses in decision-making process during reward consumption and strategy updating. Specifically, OFC encodes the overall value of a choice and is thus important for learning and strategy updating, whereas mPFC plays a key role in monitoring and execution of a strategy.

Keywords

Risk-based decision-making Orbital frontal cortex Medial prefrontal cortex Multi-channel units recording 

Notes

Acknowledgements

This work was supported by research grants from Science and Technology Project of Beijing Municipal Education Commission (KM201410028019) of China, National Natural Science Foundation of China (81401131) and China Postdoctoral Science Foundation (2015 M572049). We thank Dr. Gang Song (Institute of Medical Engineering and Science, Massachusetts Institute of Technology) and Dr. Dong Wang (Institute of Drug Addiction, National Institute of Health, USA) for critically reading the manuscript and useful suggestions, as well as Dr. Kimberly Urban for editorial assistance.

Authors Contributions

Wen-Qiang Huang, Ai-Ai Ji, Sha-Sha Yang and Ke-Yi Sun conducted the experiments, Dan-Dan Hong, Wen-Qiang Huang and Ai-Ai Ji analyzed the data. Dan-Dan Hong, Wen-Qiang Huang, Sha-Sha Yang, Hui Xu and Aihua Cao wrote the results and manuscript. Wen-Jun Gao revised the paper. Ning Zhou conceived and supervised the project. Ping Yu conceived and supervised the project and wrote the paper.

Compliance with ethical standards

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Alexander WH, Brown JW (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14:1338–1344CrossRefGoogle Scholar
  2. Barrus MM, Hosking JG, Cocker PJ, Winstanley CA (2017) Inactivation of the orbitofrontal cortex reduces irrational choice on a rodent betting task. Neuroscience 345:38–48CrossRefGoogle Scholar
  3. Burton AC, Kashtelyan V, Bryden DW, Roesch MR (2014) Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex. Cereb Cortex 24:3310–3321CrossRefGoogle Scholar
  4. Christakou A, Brammer M, Giampietro V, Rubia K (2009) Right ventromedial and dorsolateral prefrontal cortices mediate adaptive decisions under ambiguity by integrating choice utility and outcome evaluation. J Neurosci 29:11020–11028CrossRefGoogle Scholar
  5. Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146:145–157CrossRefGoogle Scholar
  6. Euston DR, Gruber AJ, McNaughton BL (2012) The role of medial prefrontal cortex in memory and decision making. Neuron 76:1057–1070CrossRefGoogle Scholar
  7. Floresco SB (2015) The nucleus accumbens: an interface between cognition, emotion, and action. Annu Rev Psychol 66:25–52CrossRefGoogle Scholar
  8. Jentsch JD, Woods JA, Groman SM, Seu E (2010) Behavioral characteristics and neural mechanisms mediating performance in a rodent version of the balloon analog risk task. Neuropsychopharmacology 35:1797–1806CrossRefGoogle Scholar
  9. Kahnt T, Heinzle J, Park SQ, Haynes JD (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010–6015CrossRefGoogle Scholar
  10. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21:1162–1178CrossRefGoogle Scholar
  11. Kepecs A, Uchida N, Zariwala HA, Mainen ZF (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455:227–231CrossRefGoogle Scholar
  12. Levy I, Snell J, Nelson AJ, Rustichini A, Glimcher PW (2010) Neural representation of subjective value under risk and ambiguity. J Neurophysiol 103:1036–1047CrossRefGoogle Scholar
  13. Likhtik E, Paz R (2015) Amygdala-prefrontal interactions in (mal)adaptive learning. Trends Neurosci 38:158–166CrossRefGoogle Scholar
  14. Ogawa M, van der Meer MA, Esber GR, Cerri DH, Stalnaker TA, Schoenbaum G (2013) Risk-responsive orbitofrontal neurons track acquired salience. Neuron 77:251–258CrossRefGoogle Scholar
  15. Orsini CA, Trotta RT, Bizon JL, Setlow B (2015) Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment. J Neurosci 35:1368–1379CrossRefGoogle Scholar
  16. Ostlund SB, Balleine BW (2007) Orbitofrontal cortex mediates outcome encoding in pavlovian but not instrumental conditioning. J Neurosci 27:4819–4825CrossRefGoogle Scholar
  17. Paine TA, Asinof SK, Diehl GW, Frackman A, Leffler J (2013) Medial prefrontal cortex lesions impair decision-making on a rodent gambling task: reversal by D1 receptor antagonist administration. Behav Brain Res 243:247–254CrossRefGoogle Scholar
  18. Pais-Vieira M, Lima D, Galhardo V (2007) Orbitofrontal cortex lesions disrupt risk assessment in a novel serial decision-making task for rats. Neuroscience 145:225–231CrossRefGoogle Scholar
  19. Paxinos G, Watson C (1996) The rat brain in stereotaxic coordinates, 3rd edn. Academic Press, San DiegoGoogle Scholar
  20. Pickens CL, Saddoris MP, Setlow B, Gallagher M, Holland PC, Schoenbaum G (2003) Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci 23:11078–11084CrossRefGoogle Scholar
  21. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545–556CrossRefGoogle Scholar
  22. Rivalan M, Coutureau E, Fitoussi A, Dellu-Hagedorn F (2011) Inter-individual decision-making differences in the effects of cingulate, orbitofrontal, and prelimbic cortex lesions in a rat gambling task. Front Behav Neurosci 5:22CrossRefGoogle Scholar
  23. Roitman JD, Roitman MF (2010) Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31:1492–1500CrossRefGoogle Scholar
  24. Rushworth MF, Behrens TE, Rudebeck PH, Walton ME (2007) Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn Sci 11:168–176CrossRefGoogle Scholar
  25. Schoenbaum G, Roesch MR, Stalnaker TA (2006) Orbitofrontal cortex, decision-making and drug addiction. Trends Neurosci 29:116–124CrossRefGoogle Scholar
  26. Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1:199–208CrossRefGoogle Scholar
  27. Sescousse G, Redoute J, Dreher JC (2010) The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci 30:13095–13104CrossRefGoogle Scholar
  28. Shadlen MN, Shohamy D (2016) Decision making and sequential sampling from memory. Neuron 90:927–939CrossRefGoogle Scholar
  29. St Onge JR, Floresco SB (2010) Prefrontal cortical contribution to risk-based decision making. Cereb Cortex 20:1816–1828CrossRefGoogle Scholar
  30. St Onge JR, Stopper CM, Zahm DS, Floresco SB (2012) Separate prefrontal-subcortical circuits mediate different components of risk-based decision making. J Neurosci 32:2886–2899CrossRefGoogle Scholar
  31. Stalnaker TA, Cooch NK, McDannald MA, Liu TL, Wied H, Schoenbaum G (2014) Orbitofrontal neurons infer the value and identity of predicted outcomes. Nat Commun 5:3926CrossRefGoogle Scholar
  32. Stalnaker TA, Cooch NK, Schoenbaum G (2015) What the orbitofrontal cortex does not do. Nat Neurosci 18:620–627CrossRefGoogle Scholar
  33. Stopper CM, Floresco SB (2015) Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia. Schizophr Bull 41:9–14CrossRefGoogle Scholar
  34. Stott JJ, Redish AD (2014) A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour. Philos Trans R Soc Lond Ser B Biol Sci 369:315–318CrossRefGoogle Scholar
  35. Sul JH, Kim H, Huh N, Lee D, Jung MW (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66:449–460CrossRefGoogle Scholar
  36. Takahashi YK, Roesch MR, Wilson RC, Toreson K, O'Donnell P, Niv Y, Schoenbaum G (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590–1597CrossRefGoogle Scholar
  37. van Duuren E, van der Plasse G, Lankelma J, Joosten RN, Feenstra MG, Pennartz CM (2009) Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci 29:8965–8976CrossRefGoogle Scholar
  38. Visser LD, Homberg JR, Mitsogiannis M et al (2011) Rodent versions of the Iowa gambling task: opportunities and challenges for the understanding of decision-making. Front Neurosci 5:109Google Scholar
  39. Wenqiang H, Shasha Y, Ping Y (2016) Neural mechanisms of risky decision-making based on rodent research. Adv Psychol Sci 24:1767–1779Google Scholar
  40. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81:267–279CrossRefGoogle Scholar
  41. Zeeb FD, Winstanley CA (2011) Lesions of the basolateral amygdala and orbitofrontal cortex differentially affect acquisition and performance of a rodent gambling task. J Neurosci 31:2197–2204CrossRefGoogle Scholar
  42. Zeeb FD, Robbins TW, Winstanley CA (2009) Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34:2329–2343CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Dan-Dan Hong
    • 1
  • Wen-Qiang Huang
    • 1
  • Ai-Ai Ji
    • 1
  • Sha-Sha Yang
    • 1
  • Hui Xu
    • 2
  • Ke-Yi Sun
    • 1
  • Aihua Cao
    • 3
  • Wen-Jun Gao
    • 4
  • Ning Zhou
    • 5
  • Ping Yu
    • 1
  1. 1.Beijing Key Laboratory of Learning and Cognition, College of PsychologyCapital Normal UniversityBeijingChina
  2. 2.Interdepartmental Program in NeuroscienceUniversity of UtahSalt Lake CityUSA
  3. 3.Department of PediatricsShandong University Qilu HospitalJinanChina
  4. 4.Department of Neurobiology and AnatomyDrexel University College of MedicinePhiladelphiaUSA
  5. 5.The General Hospital of Chinese People’s Liberation ArmyBeijingChina

Personalised recommendations