Advertisement

Neural Dynamics of the Basal Ganglia During Perceptual, Cognitive, and Motor Learning and Gating

  • Stephen GrossbergEmail author
Chapter
Part of the Innovations in Cognitive Neuroscience book series (Innovations Cogn.Neuroscience)

Abstract

This article summarizes neural models that simulate how the basal ganglia contribute to associative and reinforcement learning, and to movement gating, in multiple brain systems. The first model proposes how the substantia nigra pars compacta (SNc) generates widespread dopaminergic learning signals in response to unexpected rewarding cues, including a circuit for adaptively timed learning using metabotropic glutamate receptor (mGluR)-mediated Ca2+ spikes that occur with different delays in striosomal cells. Similar circuits for spectral timing occur in cerebellum and hippocampus. The TELOS model shows how the substantia nigra pars reticulata (SNr) learns to selectively gate saccadic eye movements or cognitive plans, and how spatially invariant object categories can activate spatially variant representations to control specific actions. The VITE model proposes how basal ganglia gating controls selection and variable speeds of arm movements. The cARTWORD model explains how prefrontally controlled basal ganglia gates can explain phonemic restoration, notably how future context can influence how past sounds are consciously heard. The MOTIVATOR model clarifies how the basal ganglia and amygdala coordinate their complementary functions to control learning and performance of motivated acts. The lisTELOS model proposes how sequences of saccades can be learned and performed from an Item-Order-Rank spatial working memory under the control of three parallel basal ganglia loops. Basal ganglia gating in the regulation of working memory storage, visual imagery, useful field of view, thinking, planning, and Where’s Waldo searching are also discussed, as is how its breakdown can lead to hallucinations.

Keywords

Basal ganglia Prefrontal cortex Inferotemporal cortex Parietal cortex Frontal eye fields Supplementary eye fields Superior colliculus Amygdala Orbitofrontal cortex Motor cortex Spinal cord Cerebellum Supplementary eye fields Saccades Arm movements Item-Order-Rank working memory Reinforcement learning Adaptive timing Movement gating Visual imagery Spatial attention Thinking Planning Search Hallucinations 

References

  1. Aggleton JP (1993) The contribution of the amygdala to normal and abnormal emotional states. Trends Neurosci 16:328–333PubMedCrossRefGoogle Scholar
  2. Alexander GE, Crutcher MD (1990) Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 1:266–271CrossRefGoogle Scholar
  3. Alexander GE, DeLong M, Strick PL (1996) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357–381CrossRefGoogle Scholar
  4. Andersen RA, Snyder LH, Bradley BC, Xing J (1997) Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu Rev Neurosci 20:303–330PubMedCrossRefGoogle Scholar
  5. Averbeck B, Chafee M, Crowe D, Georgopoulos A (2002) Parallel processing of serial movements in prefrontal cortex. Proc Natl Acad Sci 99:13172–13177PubMedPubMedCentralCrossRefGoogle Scholar
  6. Averbeck B, Chafee M, Crowe D, Georgopoulos A (2003) Neural activity in prefrontal cortex during copying geometrical shapes. I. Single cells encode shape, sequence, and metric parameters. Exp Brain Res 150:127–141PubMedCrossRefGoogle Scholar
  7. Bar M, Tootell RBH, Schacter DL, Greve DN, Fischl B, Mendola JD, Rosen BR, Dale AM (2001) Cortical mechanisms specific to explicit object recognition. Neuron 29:529–535PubMedCrossRefGoogle Scholar
  8. Barbas H (1995) Anatomic basis of cognitive-emotional interactions in the primate prefrontal cortex. Neurosci Biobehav Rev 19:499–510PubMedCrossRefGoogle Scholar
  9. Barbas H, Pandya D (1987) Architecture and frontal cortical connections of the premotor cortex (area 6) in the rhesus monkey. J Comp Neurol 256:211–228PubMedCrossRefGoogle Scholar
  10. Baxter MG, Parker A, Lindner CC, Izquierdo AD, Murray EA (2000) Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci 20:4311–4319PubMedGoogle Scholar
  11. Berdyyeva T, Olson C (2009) Monkey supplementary eye field neurons signal the ordinal position of both actions and objects. J Neurosci 29:591–599PubMedPubMedCentralCrossRefGoogle Scholar
  12. Bhatt R, Carpenter G, Grossberg S (2007) Texture segregation by visual cortex: perceptual grouping, attention, and learning. Vis Res 47:3173–3211PubMedCrossRefGoogle Scholar
  13. Bichot NP, Schall JD, Thompson KG (1996) Visual feature selectivity in frontal eye fields induced by experience in mature macaques. Nature 381:697–699PubMedCrossRefGoogle Scholar
  14. Brown J, Bullock D, Grossberg S (1999) How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J Neurosci 19:10502–10511PubMedGoogle Scholar
  15. Brown J, Bullock D, Grossberg S (2004) How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neural Netw 17:471–510PubMedCrossRefGoogle Scholar
  16. Bullier J, Hupe JM, James A, Girard P (1996) Functional interactions between areas V1 and V2 in the monkey. J Physiol Paris 90:217–220PubMedCrossRefGoogle Scholar
  17. Bullock D, Grossberg S (1988) Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. Psychol Rev 95:49–90PubMedCrossRefGoogle Scholar
  18. Bullock D, Grossberg S (1991) Adaptive neural networks for control of movement trajectories invariant under speed and force rescaling. Hum Mov Sci 10:3–53CrossRefGoogle Scholar
  19. Bullock D, Cisek P, Grossberg S (1998) Cortical networks for control of voluntary arm movements under variable force conditions. Cereb Cortex 8:48–62PubMedCrossRefGoogle Scholar
  20. Bullock D, Grossberg S, Guenther FH (1993) A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm. J Cogn Neurosci 5:408–435PubMedCrossRefGoogle Scholar
  21. Buschman TJ, Miller EK (2007) Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315:1860–1862PubMedCrossRefGoogle Scholar
  22. Cao Y, Grossberg S (2005) A laminar cortical model of stereopsis and 3D surface perception: closure and da Vinci stereopsis. Spat Vis 18:515–578PubMedCrossRefGoogle Scholar
  23. Cao Y, Grossberg S, Markowitz J (2011) How does the brain rapidly learn and reorganize view- and positionally-invariant object representations in inferior temporal cortex? Neural Netw 24:1050–1061PubMedCrossRefGoogle Scholar
  24. Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRefGoogle Scholar
  25. Carpenter GA, Grossberg S (1991) Pattern recognition by self-organizing neural networks. MIT Press, CambridgeGoogle Scholar
  26. Chang H-C, Grossberg S, Cao Y (2014) Where’s Waldo? How perceptual cognitive, and emotional brain processes cooperate during learning to categorize and find desired objects in a cluttered scene. Front Integr Neurosci. doi: 10.3389/fnint.2014.0043 Google Scholar
  27. Cohen MA, Grossberg S (1986) Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. Hum Neurobiol 5:1–22PubMedGoogle Scholar
  28. Cohen MA, Grossberg S (1987) Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. Appl Opt 26:1866–1891PubMedCrossRefGoogle Scholar
  29. Contreras-Vidal JL, Grossberg S, Bullock D (1997) A neural model of cerebellar learning for arm movement control: cortico-spino-cerebellar dynamics. Learn Mem 3:475–502PubMedCrossRefGoogle Scholar
  30. Corbit LH, Balleine BW (2005) Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J Neurosci 25:962–70PubMedCrossRefGoogle Scholar
  31. Crosson B (1985) Subcortical functions in language: a working model. Brain Lang 25:257–292PubMedCrossRefGoogle Scholar
  32. Damasio AR (1999) The feeling of what happens: body and emotion in the making of consciousness. Houghton Mifflin Harcourt, BostonGoogle Scholar
  33. Desimone R (1998) Visual attention mediated by biased competition in extrastriate visual cortex. Philos Trans R Soc Lond B 353:1245–1255CrossRefGoogle Scholar
  34. Deubel H, Schneider WX (1996) Saccade target selection and object recognition: evidence for a common attentional mechanism. Vis Res 36:1827–1837PubMedCrossRefGoogle Scholar
  35. Dickinson A, Balleine BW (2001) The role of learning in the operation of motivational systems. In: Pashler HE, Gallistel R (eds) Steven’s handbook of experimental psychology, 3rd edn. Wiley, New York, pp 497–533Google Scholar
  36. Dormont J, Conde H, Farin D (1998) The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat. I. Context-dependent and reinforcement-related single unit activity. Exp Brain Res 121:401–410PubMedCrossRefGoogle Scholar
  37. Dranias M, Grossberg S, Bullock D (2008) Dopaminergic and non-dopaminergic value systems in conditioning and outcome-specific revaluation. Brain Res 1238:239–287PubMedCrossRefGoogle Scholar
  38. Eichenbaum H, Lipton PA (2008) Towards a functional organization of the medial temporal lobe memory system: role of the parahippocampal and medial entorhinal cortical areas. Hippocampus 18:1314–1324PubMedPubMedCentralCrossRefGoogle Scholar
  39. Ewert JP, Schurg-Pfeiffer E, Schwippert WW (1996) Influence of pretectal lesions on tectal responses to visual stimulation in anurans: field potential, single neuron and behavior analyses. Acta Biol Hung 47:89–111PubMedGoogle Scholar
  40. Fang L, Grossberg S (2009) From stereogram to surface: How the brain sees the world in depth. Spatial Vision 22:45–82.PubMedCrossRefGoogle Scholar
  41. Farrell S, Lewandowsky S (2004) Modelling transposition latencies: constraints for theories of serial order memory. J Mem Lang 51:115–135CrossRefGoogle Scholar
  42. Fazl A, Grossberg S, Mingolla E (2009) View-invariant object category learning, recognition, and search: how spatial and object attention are coordinated using surface-based attentional shrouds. Cogn Psychol 58:1–48PubMedCrossRefGoogle Scholar
  43. Fiala JC, Grossberg S, Bullock D (1996) Metabotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye blink response. J Neurosci 16:3760–3774PubMedGoogle Scholar
  44. Foley NC, Grossberg S, Mingolla E (2012) Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding. Cogn Psychol 65:77–117PubMedPubMedCentralCrossRefGoogle Scholar
  45. Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-medicated Parkinsonism. J Cogn Neurosci 17:51–72PubMedCrossRefGoogle Scholar
  46. Frank MJ, Loughry B, O’Reilly RC (2001) Interactions between the frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1:137–160PubMedCrossRefGoogle Scholar
  47. Gancarz G, Grossberg G (1998) A neural model of the saccade generator in the reticular formation. Neural Netw 11:1159–1174PubMedCrossRefGoogle Scholar
  48. Gancarz G, Grossberg S (1999) A neural model of the saccadic eye movement control explains task-specific adaptation. Vis Res 39:3123–3143PubMedCrossRefGoogle Scholar
  49. Gaspar P, Bloch B, Le Moine C (1995) D1 and D2 receptor gene expression in the rat frontal cortex: cellular localization in different classes of efferent neurons. Eur J Neurosci 7:1050–1063PubMedCrossRefGoogle Scholar
  50. Gaudiano P, Grossberg S (1991) Vector associative maps: unsupervised real-time error-based learning and control of movement trajectories. Neural Netw 4:147–183CrossRefGoogle Scholar
  51. Gaudiano P, Grossberg S (1992) Adaptive vector integration to endpoint: self-organizing neural circuits for control of planned movement trajectories. Hum Mov Sci 11:141–155CrossRefGoogle Scholar
  52. Gaymard B, Pierrot-Deseilligny C, Rivaud S (1990) Impairment of sequences of memory-guided saccades after supplementary motor area lesions. Ann Neurol 28:622–626PubMedCrossRefGoogle Scholar
  53. Gaymard B, Rivaud S, Pierrot-Deseilligny C (1993) Role of the left and right supplementary motor areas in memory-guided saccade sequences. Ann Neurol 34:404–406PubMedCrossRefGoogle Scholar
  54. Gerfen CR, Engber TM, Mahan LC, Susel Z, Chase TN, Monsama FJ, Sibley DR (1990) D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250:1429–1432PubMedCrossRefGoogle Scholar
  55. Gibbon J, Church RM, Meck WH (1984) Scalar timing in memory. Ann N Y Acad Sci 423:52–77PubMedCrossRefGoogle Scholar
  56. Gorchetchnikov A, Grossberg S (2007) Space, time, and learning in the hippocampus: how fine spatial and temporal scales are expanded into population codes for behavioral control. Neural Netw 20:182–193PubMedCrossRefGoogle Scholar
  57. Gove A, Grossberg S, Mingolla E (1995) Brightness perception, illusory contours, and corticogeniculate feedback. Vis Neurosci 12:1027–1052PubMedCrossRefGoogle Scholar
  58. Grahn JA, Parkinson JA, Owen AM (2009) The role of the basal ganglia in learning and memory: neuropsychological studies. Behav Brain Res 199:53–60PubMedCrossRefGoogle Scholar
  59. Green CS, Bavelier D (2003) Action video game modifies visual selective attention. Nature 423:534–537PubMedCrossRefGoogle Scholar
  60. Green CS, Bavelier D (2007) Action-video-game experience alters the spatial resolution of vision. Psychol Sci 18:88–94PubMedPubMedCentralCrossRefGoogle Scholar
  61. Gross CG, Desimone R, Albright TD, Schwartz EL (1985) Inferior temporal cortex and pattern recognition. Exp Brain Res Suppl 11:179–201CrossRefGoogle Scholar
  62. Grossberg S (1971) On the dynamics of operant conditioning. J Theor Biol 33:225–255PubMedCrossRefGoogle Scholar
  63. Grossberg S (1972a) A neural theory of punishment and avoidance, I: qualitative theory. Math Biosci 15:39–67CrossRefGoogle Scholar
  64. Grossberg S (1972b) A neural theory of punishment and avoidance, II: quantitative theory. Math Biosci 15:253–285CrossRefGoogle Scholar
  65. Grossberg S (1973) Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud Appl Math 52(3):213–257CrossRefGoogle Scholar
  66. Grossberg S (1975) A neural model of attention, reinforcement, and discrimination learning. Int Rev Neurobiol 18:263–327PubMedCrossRefGoogle Scholar
  67. Grossberg S (1978a) A theory of human memory: self-organization and performance of sensory-motor codes, maps, and plans. In: Rosen R, Snell F (eds) Progress in theoretical biology, vol 5. Academic, New York, pp 233–374CrossRefGoogle Scholar
  68. Grossberg S (1978b) Behavioral contrast in short term memory: serial binary memory models or parallel continuous memory models. J Math Psychol 17:199–219Google Scholar
  69. Grossberg S (1982) Processing of expected and unexpected events during conditioning and attention: a psychophysiological theory. Psychol Rev 89:529–572PubMedCrossRefGoogle Scholar
  70. Grossberg S (1984) Some psychophysiological and pharmacological correlates of a developmental, cognitive, and motivational theory. In: Karrer R, Cohen J, Tueting P (eds) Brain and information: event related potentials. New York Academy of Sciences, New York, pp 58–142Google Scholar
  71. Grossberg S (1986) The adaptive self-organization of serial order in behavior: speech, language, and motor control. In: Schwab EC, Nusbaum HC (eds) Pattern recognition by humans and machines, Vol. 1: speech perception. Academic, New York, pp 187–294CrossRefGoogle Scholar
  72. Grossberg S (1999) The link between brain learning, attention, and consciousness. Conscious Cogn 8:1–44PubMedCrossRefGoogle Scholar
  73. Grossberg S (2000a) How hallucinations may arise from brain mechanisms of learning, attention, and volition. J Int Neuropsychol Soc 6:579–588CrossRefGoogle Scholar
  74. Grossberg S (2000b) The complementary brain: unifying brain dynamics and modularity. Trends Cogn Sci 4:233–246PubMedCrossRefGoogle Scholar
  75. Grossberg S (2000c) The imbalanced brain: from normal behavior to schizophrenia. Biol Psychiatry 48:81–98PubMedCrossRefGoogle Scholar
  76. Grossberg S (2003) Resonant neural dynamics of speech perception. J Phon 31:423–445CrossRefGoogle Scholar
  77. Grossberg S (2009) Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion, and action. Philos Trans R Soc Lond 364:1223–1234CrossRefGoogle Scholar
  78. Grossberg S (2013) Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world. Neural Netw 37:1–47PubMedCrossRefGoogle Scholar
  79. Grossberg S (2016) Towards solving the hard problem of consciousness: the varieties of brain resonances and the conscious experiences that they support. Submitted for publicationGoogle Scholar
  80. Grossberg S, Gutowski WE (1987) Neural dynamics of decision making under risk: affective balance and cognitive-emotional interactions. Psychol Rev 94:300–318Google Scholar
  81. Grossberg S, Kazerounian S (2011) Laminar cortical dynamics of conscious speech perception: a neural model of phonemic restoration using subsequent context in noise. J Acoust Soc Am 130:440–460PubMedCrossRefGoogle Scholar
  82. Grossberg S, Kuperstein M (1989) Neural dynamics of adaptive sensory-motor control: expanded edition. Pergamon Press, ElmsfordGoogle Scholar
  83. Grossberg S, Levine DS (1987) Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, inter-stimulus interval, and secondary reinforcement. Appl Opt 26:5015–5030PubMedCrossRefGoogle Scholar
  84. Grossberg S, Merrill JWL (1992) A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cogn Brain Res 1:3–38CrossRefGoogle Scholar
  85. Grossberg S, Merrill JWL (1996) The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. J Cogn Neurosci 8:257–277PubMedCrossRefGoogle Scholar
  86. Grossberg S, Myers CW (2000) The resonant dynamics of speech perception: interword integration and duration-dependent backward effects. Psychol Rev 107:735–767PubMedCrossRefGoogle Scholar
  87. Grossberg S, Paine RW (2000) A neural model of corticocerebellar interactions during attentive imitation and predictive learning of sequential handwriting movements. Neural Netw 13:999–1046PubMedCrossRefGoogle Scholar
  88. Grossberg S, Pearson L (2008) Laminar cortical dynamics of cognitive and motor working memory, sequence learning and performance: toward a unified theory of how the cerebral cortex works. Psychol Rev 115:677–732PubMedCrossRefGoogle Scholar
  89. Grossberg S, Pilly PK (2012) How entorhinal grid cells may learn multiple spatial scales from a dorsoventral gradient of cell response rates in a self-organizing map. PLoS Comput Biol 8(10):31002648. doi: 10.1371/journal.pcbi.1002648 CrossRefGoogle Scholar
  90. Grossberg S, Pilly PK (2014) Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales, attention, and oscillations. Philos Trans R Soc 369:20120524CrossRefGoogle Scholar
  91. Grossberg S, Repin DV (2003) A neural model of how the brain represents and compares multi-digit numbers: spatial and categorical processes. Neural Netw 16:1107–1140PubMedCrossRefGoogle Scholar
  92. Grossberg S, Schmajuk NA (1987) Neural dynamics of attentionally-modulated Pavlovian conditioning: conditioned reinforcement, inhibition, and opponent processing. Psychobiology 15:195–240Google Scholar
  93. Grossberg S, Schmajuk NA (1989) Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw 2:79–102CrossRefGoogle Scholar
  94. Grossberg S, Seidman D (2006) Neural dynamics of autistic behaviors: cognitive, emotional, and timing substrates. Psychol Rev 113:483–525PubMedCrossRefGoogle Scholar
  95. Grossberg S, Versace M (2008) Spikes, synchrony, and attentive learning by laminar thalamocortical circuits. Brain Res 1218:278–312PubMedCrossRefGoogle Scholar
  96. Grossberg S, Vladusich T (2010) How do children learn to follow gaze, share joint attention, imitate their teachers, and use tools during social interactions? Neural Netw 23:940–965PubMedCrossRefGoogle Scholar
  97. Grossberg S, Boardman I, Cohen C (1997a) Neural dynamics of variable-rate speech categorization. J Exp Psychol Hum Percept Perform 23:418–503CrossRefGoogle Scholar
  98. Grossberg S, Roberts K, Aguilar M, Bullock D (1997b) A neural model of multimodal adaptive saccadic eye movement control by superior colliculus. J Neurosci 17:9706–9725PubMedGoogle Scholar
  99. Grossberg S, Bullock D, Dranias M (2008) Neural dynamics underlying impaired autonomic and conditioned responses following amygdala and orbitofrontal lesions. Behav Neurosci 122:1100–1125PubMedCrossRefGoogle Scholar
  100. Grossberg S, Markowitz J, Cao Y (2011) On the road to invariant recognition: explaining tradeoff and morph properties of cells in inferotemporal cortex using multiple-scale task-sensitive attentive learning. Neural Netw 24:1036–1049PubMedCrossRefGoogle Scholar
  101. Grossberg S, Srihasam K, Bullock D (2012) Neural dynamics of saccadic and smooth pursuit eye movement coordination during visual tracking of unpredictably moving targets. Neural Netw 27:1–20PubMedCrossRefGoogle Scholar
  102. Grossberg S, Yazdanbakhsh A (2005) Laminar cortical dynamics of 3D surface perception: stratification, transparency, and neon color spreading. Vis Res 45:1725–1743PubMedCrossRefGoogle Scholar
  103. Guenther FH (1995) Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production. Psychol Rev 102:594–621PubMedCrossRefGoogle Scholar
  104. Guenther FH, Ghosh SS, Tourville JA (2006) Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang 96:280–301PubMedCrossRefGoogle Scholar
  105. Guitton D, Buchtel HA, Douglas RM (1985) Frontal lobe lesions in man cause difficulties in suppressing reflexive glances and in generating goal-directed saccades. Exp Brain Res 58:455–472PubMedCrossRefGoogle Scholar
  106. Hafting T, Fyhn M, Molden S, Moser MB, Moser EI (2005) Microstructure of a spatial map in the entorhinal cortex. Nature 436:801–806PubMedCrossRefGoogle Scholar
  107. Hatfield T, Han JS, Conley M, Gallagher M, Holland P (1996) Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J Neurosci 16:5256–5265PubMedGoogle Scholar
  108. Heide W, Binkofski F, Seitz R, Posse S, Nitschke M, Freund H, Kömpf D (2001) Activation of frontoparietal cortices during memorized triple-step sequences of saccadic eye movements: an fMRI study. Eur J Neurosci 13:1177–1189PubMedCrossRefGoogle Scholar
  109. Hikosaka O, Wurtz RH (1983) Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J Neurophysiol 49:1285–1301PubMedGoogle Scholar
  110. Hikosaka O, Wurtz RH (1989) The basal ganglia. In: Wurtz R, Goldberg M (eds) The neurobiology of saccadic eye movements. Elsevier, Amsterdam, pp 257–281Google Scholar
  111. Hikosaka O, Sakamoto M, Usui S (1989a) Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61:780–798PubMedGoogle Scholar
  112. Hikosaka O, Sakamoto M, Usui S (1989b) Functional properties of monkey caudate neurons I. Activities related to saccadic eye movements. J Neurophysiol 61:780–798PubMedGoogle Scholar
  113. Histed MH, Miller EK (2006) Microstimulation of frontal cortex can reorder a remembered spatial sequence. PLoS Biol 4(5):e134PubMedPubMedCentralCrossRefGoogle Scholar
  114. Hollerman J, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304–309PubMedCrossRefGoogle Scholar
  115. Horak FB, Anderson ME (1984) Influence of globus pallidus on arm movements in monkeys, II. Effects of stimulation. J Neurophysiol 52:305–322PubMedGoogle Scholar
  116. Houghton G (1990) The problem of serial order: a neural network model of sequence learning and recall. In: Dale R, Mellish C, Zock M (eds) Current research in natural language generation. Academic Press Professional, San Diego, pp 287–319Google Scholar
  117. Huerta M, Kaas J (1990) Supplementary eye field as defined by intracortical microstimulation: connections in macaques. J Comp Neurol 293:299–330PubMedCrossRefGoogle Scholar
  118. Isoda M, Tanji J (2002) Cellular activity in the supplementary eye field during sequential performance of multiple saccades. J Neurophysiol 88:3541–3545PubMedCrossRefGoogle Scholar
  119. Isoda M, Tanji J (2003) Contrasting neuronal activity in the supplementary and frontal eye fields during temporal organization of multiple saccades. J Neurophysiol 90:3054–3065PubMedCrossRefGoogle Scholar
  120. Kastner S, Ungerleider LG (2001) The neural basis of biased competition in human visual cortex. Neuropsychologia 39:1263–1276PubMedCrossRefGoogle Scholar
  121. Kemel ML, Desban M, Gauchy C, Glowinski J, Besson MJ (1988) Topographical organization of efferent projections from the cat substantia nigra pars reticulata. Brain Res 455:307–323PubMedCrossRefGoogle Scholar
  122. Kobatake E, Tanaka K (1994) Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J Neurophysiol 71:856–867PubMedGoogle Scholar
  123. Komatsu H, Ideura Y (1993) Relationships between color, shape, and pattern selectivities of neurons in the inferior temporal cortex of the monkey. J Neurophysiol 70:677–694PubMedGoogle Scholar
  124. Lashley K (1951) The problem of serial order in behavior. In: Jeffress LA (ed) Cerebral mechanisms in behavior. Wiley, New York, pp 112–131Google Scholar
  125. LeDoux JE (1993) Emotional memory systems in the brain. Behav Brain Res 58:69–79PubMedCrossRefGoogle Scholar
  126. Lee C, Rohrer W, Sparks D (1988) Population coding of saccadic eye movements by neurons in the superior colliculus. Nature 332:357–360PubMedCrossRefGoogle Scholar
  127. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145–163PubMedGoogle Scholar
  128. MacDonald CJ, Lepage KQ, Eden UT, Eichenbaum H (2011) Hippocampal ‘time cells’ bridge the gap in memory for discontiguous events. Neuron 71:737–749PubMedPubMedCentralCrossRefGoogle Scholar
  129. Marin O, Sweets WJ, Gonzalez A (1998) Evolution of the basal ganglia in tetrapods: a new perspective based on recent studies in amphibians. Trends Neurosci 21:487–494PubMedCrossRefGoogle Scholar
  130. Middleton F, Strick P (2000) Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Rev 31:236–250PubMedCrossRefGoogle Scholar
  131. Mink J (1996) The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50:381–425PubMedCrossRefGoogle Scholar
  132. Mink JW, Thach WT (1993) Basal ganglia intrinsic circuits and their role in behavior. Curr Opin Neurobiol 3:950–957PubMedCrossRefGoogle Scholar
  133. Mirenowicz J, Schultz W (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72:1024–1027PubMedGoogle Scholar
  134. Nakamura K, Ono T (1986) Lateral hypothalamus neuron involvement in integration of natural and artificial rewards and cue signals. J Neurophysiol 55:163–181PubMedGoogle Scholar
  135. O’Keefe J, Dostrovsky J (1971) The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res 34:171–175PubMedCrossRefGoogle Scholar
  136. Ottes F, Van Gisbergen J, Eggermont J (1984) Metrics of saccade responses to visual double stimuli: two different modes. Vis Res 24:1169–1179PubMedCrossRefGoogle Scholar
  137. Pasupathy A, Miller EK (2004) Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433:873–876CrossRefGoogle Scholar
  138. Petit L, Orssaud C, Tzourio N, Crivello F, Berthoz A, Mazoyer B (1996) Functional anatomy of a prelearned sequence of horizontal saccades in humans. J Neurosci 16:3714–3726PubMedGoogle Scholar
  139. Pilly PK, Grossberg S (2012) How do spatial learning and memory occur in the brain? Coordinated learning of entorhinal grid cells and hippocampal place cells. J Cogn Neurosci 24:1031–1054PubMedCrossRefGoogle Scholar
  140. Pilly PK, Grossberg S (2013) Spiking neurons in a hierarchical self-organizing map model can learn to develop spatial and temporal properties of entorhinal grid cells and hippocampal place cells. PLoS One 8(4):e60599. http://dx.plos.org/10.1371/journal.pone.0060599 Google Scholar
  141. Raizada R, Grossberg S (2003) Towards a theory of the laminar architecture of cerebral cortex: computational clues from the visual system. Cereb Cortex 13:100–113PubMedCrossRefGoogle Scholar
  142. Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89:1009–1023PubMedCrossRefGoogle Scholar
  143. Salin P, Bullier J (1995) Corticocortical connections in the visual system: structure and function. Physiol Rev 75:107–154PubMedGoogle Scholar
  144. Samuel A (1981a) Phonemic restoration: insights from a new methodology. J Exp Psychol Hum Percept Perform 4:474–494Google Scholar
  145. Samuel A (1981b) The role of bottom-up confirmation in the phonemic restoration illusion. J Exp Psychol Hum Percept Perform 7:1124–1131PubMedCrossRefGoogle Scholar
  146. Schlag J, Schlag-Rey M (1987) Evidence for a supplementary eye field. J Neurophysiol 57:179–200PubMedGoogle Scholar
  147. Schoenbaum G, Setlow B, Saddoris MP, Gallagher M (2003) Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39:855–867PubMedCrossRefGoogle Scholar
  148. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1–27PubMedGoogle Scholar
  149. Schultz W, Apicelli P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595–4610PubMedGoogle Scholar
  150. Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13:900–913PubMedGoogle Scholar
  151. Schultz W, Romo R, Ljungberg T, Mirenowicz J, Hollerman J, Dickinson A (1995) Reward-related signals carried by dopamine neurons. In: Houk J, Davis J, Beiser D (eds) Models of information processing in the basal ganglia. MIT Press, Cambridge, pp 11–27Google Scholar
  152. Schultz W, Dayan P, Montague P (1997) A neural substrate of prediction and reward. Science 275:1593–1598PubMedCrossRefGoogle Scholar
  153. Sears LL, Finn PR, Steinmetz JE (1994) Abnormal classical eye-blink conditioning in autism. J Autism Dev Disord 24:737–751PubMedCrossRefGoogle Scholar
  154. Setlow B, Gallagher M, Holland PC (2002a) The basolateral complex of the amygdala is necessary for acquisition but not expression of CS motivational value in appetitive Pavlovian second-order conditioning. Eur J Neurosci 15:1841–1853PubMedCrossRefGoogle Scholar
  155. Setlow B, Holland PC, Gallagher M (2002b) Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive Pavlovian second-order conditioned responses. Behav Neurosci 116:267–275PubMedCrossRefGoogle Scholar
  156. Sigala N, Logothetis NK (2002) Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 415:318–320PubMedCrossRefGoogle Scholar
  157. Silver MR, Grossberg S, Bullock D, Histed MH, Miller EK (2011) A neural model of sequential movement planning and control of eye movements: item-order-rank working memory and saccade selection by the supplementary eye fields. Neural Netw 26:29–58PubMedCrossRefGoogle Scholar
  158. Srihasam K, Bullock D, Grossberg S (2009) Target selection by frontal cortex during coordinated saccadic and smooth pursuit eye movements. J Cogn Neurosci 21:1611–1627PubMedCrossRefGoogle Scholar
  159. Surmeier DJ, Ding J, Day M, Wang Z, Shen W (2007) D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends Neurosci 30:228–235PubMedCrossRefGoogle Scholar
  160. Takakusaki K, Shiroyama T, Kitai S (1997) Two types of cholinergic neurons in the rat tegmental pedunculopontine nucleus: electrophysiological and morphological characterization. Neuroscience 79:1089–1109PubMedCrossRefGoogle Scholar
  161. Tanaka K, Saito H, Fukada Y, Moriya M (1991) Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J Neurophysiol 66:170–189PubMedGoogle Scholar
  162. Warren RM (1970) Perceptual restoration of missing speech sounds. Science 167:392–393PubMedCrossRefGoogle Scholar
  163. Warren R (1984) Perceptual restoration of obliterated sounds. Psychol Bull 96:371–383PubMedCrossRefGoogle Scholar
  164. Warren R, Obusek C (1971) Speech perception and phonenemic restorations. Percept Psychophys 9:358–362CrossRefGoogle Scholar
  165. Warren R, Sherman A (1974) Phonemic restorations based on subsequent context. Percept Psychophys 16:150–156CrossRefGoogle Scholar
  166. Warren R, Warren R (1970) Auditory illusions and confusions. Sci Am 223:30–36PubMedCrossRefGoogle Scholar
  167. Yang S, Heinen S, Missal M (2008) The effects of microstimulation of the dorsomedial frontal cortex on saccade latency. J Neurophysiol 99:1857–1870PubMedCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Center for Adaptive Systems, Graduate Program in Cognitive and Neural Systems, Department of MathematicsBoston UniversityBostonUSA

Personalised recommendations