Computation with Dopaminergic Modulation
Dopamine (DA) is a neuromodulator released by midbrain neurons with widespread projections throughout the brain. Dopaminergic modulation has diverse effects on cellular, motor, and cognitive functions, including reinforcement learning, working memory, and attention. Dysregulation of dopamine also plays a central role in the breakdown of these functions in disorders such as Parkinson’s disease and schizophrenia.
DA is a neuromodulator released by neurons in two nuclei of the midbrain: the ventral tegmental area (VTA) and the substantia nigra pars compacta (SNc). The axons of these neurons project to a large number of cortical and subcortical areas. Prefrontal cortex, motor cortex, and the striatum are among the most densely innervated areas. DA release tends to be fairly homogeneous across DA neurons, by virtue of electrical coupling between the axons of adjacent neurons, which induces highly synchronous firing. As pointed out by Paul...
KeywordsPrediction Error Reinforcement Learning Pathological Gambling Active Maintenance Gain Modulation
- Houk JC, Adams JL, Barto AG (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Houk JC, Davis JL, Beiser DG (eds) Models of information processing in the basal ganglia. MIT Press, Cambridge, MA, pp 249–270Google Scholar
- Roesch MR, Calu DJ, Schoenbaum G (2007) Dopamine neurons encode the better options in rats deciding between differently delayed or sized rewards. Nature Neuroscience 10:1615:1624Google Scholar
- Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge, MAGoogle Scholar