A Computational Model of the Role of Serotonin in Reversal Learning
It has been shown that the action of serotonin on the orbito-frontal cortex (OFC) is crucial for the inhibition phase of reversal learning. Serotonin has also been shown to facilitate the induction of LTD throughout the prefrontal cortex. We present a biologically realistic, systems level model which proposes a mechanism for the release of serotonin in response to the omission of an expected reward. Serotonin release, as a result of the combination of excitation of the dorsal raphé nucleus (DRN) pathway and the lack of inhibition of the DRN from the lateral habenula, leads to LTD in the OFC and suppression of excitation of the nucleus accumbens shell due to reward predicting sensory stimuli. Behavioural inhibition is controlled via the shell-ventral pallido-mediodorsal pathway, which serves as a feed forward switching mechanism and enables the behavioural inhibition required to achieve reversal learning.
KeywordsConditional Stimulus Unconditional Stimulus Ventral Tegmental Area Behavioural Inhibition Orbitofrontal Cortex
Unable to display preview. Download preview PDF.
- 1.Bianco, I.H., Wilson, S.W.: The habenular nuclei: a conserved asymmetric relay station in the vertebrate brain. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 364(1519), 1005–1020 (2009)Google Scholar
- 2.Brown, J., Bullock, D., Grossberg, S.: How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J. Neurosci. 19(23), 10502–10511 (1999)Google Scholar
- 6.Dayan, P.: Motivated reinforcement learning. In: Advances in Neural Information Processing Systems 13 (2001)Google Scholar
- 10.Moren, J., Balkenius, C.: A computational model of emotional learning in the amygdala. In: From Animals to Animats 6, pp. 383–391 (2000)Google Scholar
- 13.Pavlov, I.P.: Conditioned reflexes. Oxford University Press, Oxford (1927)Google Scholar
- 15.Schoenbaum, G., Chiba, A.A., Gallagher, M.: Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 19(5), 1876–1884 (1999)Google Scholar
- 16.Schoenbaum, G., Roesch, M.R., Stalnaker, T.A., Takahashi, Y.K.: A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10(12), 885–892 (2009)Google Scholar
- 19.Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction. MIT, Cambridge (1998)Google Scholar