Biological Cybernetics

, Volume 92, Issue 6, pp 427–437 | Cite as

Agents of the mind

Article

Abstract

The higher order circuitry of the brain is comprised of a large-scale network of cerebral cortical areas that are individually regulated by loops through subcortical structures, particularly through the basal ganglia and cerebellum. These subcortical loops have powerful computational architectures. Using, as an example, the relatively well-understood processing that occurs in the cortical/basal ganglionic/cerebellar distributed processing module that generates voluntary motor commands, I postulate that a network of analogous agents is an appropriate framework for exploring the dynamics of the mind.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Albus, JS 1981Brains, behavior and roboticsByte Books PetersboroughNHGoogle Scholar
  2. Andreasen, NC 1999A unitary model of schizophrenia: bleuler’s “fragmented phrene” as schizencephalyArch Gen Psychiatry56781787CrossRefPubMedGoogle Scholar
  3. Axelrod, R 1997

    Advancing the art of simulation in the social sciences

    Conte, RHegselmann, RTerna, P eds. Simulating Social PhenomenaSpringerBerlin Heidelberg New York2140
    Google Scholar
  4. Barto, AG 1995

    Adaptive critics and the basal ganglia

    Houk, JCDavis, JLBeiser, DG eds. Models of Information Processing in the Basal GangliaMIT PressCambridge215232
    Google Scholar
  5. Barto, AG, Fagg, AH, Sitkoff, N, Houk, JC 1999A cerebellar model of timing and prediction in the control of reachingNeural Comput11565594CrossRefPubMedGoogle Scholar
  6. Beiser, DG, Houk, JC 1998Model of cortical-basal ganglionic processing: encoding the serial order of sensory eventsJ Neurophysiol7931683188PubMedGoogle Scholar
  7. Benecke, R, Rothwell, JC, Dick, JPR, Day, DL, Marsden, CD 1987Disturbance of sequential movements in patients with Parkinson’s diseaseBrain110361379PubMedGoogle Scholar
  8. Berlim, MT, Mattevi, BS, Belmonte-de-Abreu, P, Crow, TJ 2003The etiology of schzophrenia and the origin of language: Overrview of a theoryCompr Psychiatry44714CrossRefPubMedGoogle Scholar
  9. Bliss, TVP, Collingridge, GL 1993A synaptic model of memory: long-term potentiation in the hippocampusNature3613139Google Scholar
  10. Brodal, P, Bjaalie, JG 1997

    Salient anatomic features of the cortico-ponto-cerebellar pathway

    Zeeuw, CIDStrata, PVoogd, J eds. Progress in Brain ResearchElsevierAmsterdam227249
    Google Scholar
  11. Charpier, S, Deniau, JM 1997In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiationProc Natl Acad Sci9470367040CrossRefPubMedGoogle Scholar
  12. Crick, F, Koch, C 2003A framework for conciousnessNat Neurosci6119126CrossRefPubMedGoogle Scholar
  13. Dagher, A, Owen, AM,  et al. 1999Mapping the network for planning: a correlational PET activation study with the Tower of London taskBrain12219731987CrossRefPubMedGoogle Scholar
  14. Debiec, J, LeDoux, JE, Nadler, K 2002Cellular and systems reconsolidation in the hippocampusNeuron36527538CrossRefPubMedGoogle Scholar
  15. Doya, K 2002Metalearning and neuromodulationNeural Networks15495506CrossRefPubMedGoogle Scholar
  16. Doya, K 1999What are the computations of the cerebellum, the basal ganglia and the cerebral cortexNeural Netw12961974CrossRefPubMedGoogle Scholar
  17. Dum, RP, Strick, PL 2002An unfolded map of the cerebellar dentate nucleus and its projections to the cerebral cortexJ. Neurophysiol.89634639Google Scholar
  18. Elman, JL 2004An alternative view of the mental lexiconTrends Cogn Sci8301306CrossRefPubMedGoogle Scholar
  19. Enna, SJ, Bowery, NG 2004GABAb receptor alterations as indicators of physiological and pharmacological functionBiochemi Pharmacol6815411548Google Scholar
  20. Felleman, DJ, Essen, DC 1991Distributed hierarchical processing in the primate cerebral cortexCerebral Cortex1147PubMedGoogle Scholar
  21. Fraser, D, Park, S, Clark, G, Yohanna, D, Houk, JC 2004Spatial serial order processing in schizophreniaSchizophrenia Res70203213CrossRefGoogle Scholar
  22. Freedman, R, Leonard, S, Oliney, A, Kaufmann, CA, Malaspina, D, Cloninger, CR, Svrakic, D, Faraone, SV, Tsuang, MT 2001Evidence for the multigenic inheritance of schizophreniaAm J Med Genet (Neuropsychiatric Genetics)105794800CrossRefGoogle Scholar
  23. Freeman WJ (2005) Self organizing criticality in scale-free neocortical dyanamics. Biol Cybern (this issue).Google Scholar
  24. Freeman, WJ 2003A neurobiological theory of meaning in perception. Part I: Information and meaning in nonconvergent and nonlocal brain dynamicsInt J Bifurcation Chaos1324932511CrossRefMathSciNetGoogle Scholar
  25. Fuster, JM 2001The Prefrontal cortex – an update: time is of the essenceNeruon30319333CrossRefGoogle Scholar
  26. Fuster, JM 1997

    The prefrontal cortex and the temporal organization of behavior

    Sakata, H Mikami, AFuster, JM eds. The association cortex - structure and functionHarwood Academic PublishersThe Netherlands1531
    Google Scholar
  27. Genet, S, Delord, B 2002A biophysical model of nonlinear dynamics underlying plateau potentials and calcium spikes in Purkinje cell dendritesJ Neurophysiol8824302444PubMedGoogle Scholar
  28. Gibson, AR, Houk, JC, Kohlerman, NJ 1985Magnocellular red nucleus activity during different types of limb movement in the macaque monkeyJ Physiol [ Lond]358527549Google Scholar
  29. Goldman-Rakic, PS 1988Topography of cognition: parallel distributed networks in primate association cortexAnn Rev Neurosci11137156CrossRefPubMedGoogle Scholar
  30. Goldman-Rakic, PS, Funahashi, S, Bruce, CJ 1990Neocortical memory circuits. In.: The brain: cold spring harbor symposia on quantitative biologyCold Spring Harbor Laboratory PressNew YorkGoogle Scholar
  31. Graybiel, AM 1991Basal ganglia – input, neural activity, and relation to the cortexCurr Opin Neurobiol1644651PubMedGoogle Scholar
  32. Gruber, AJ, Solla, SA, Surmeier, DJ, Houk, JC 2003Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistabilityJ Neurophysiol9010951114PubMedGoogle Scholar
  33. Gruber AJ, Solla SA, Houk JC (2003) Dopamine induced bistability enhances signal-processing in spiny neurons. NIPS.Google Scholar
  34. Hauser, MD, Chomsky, N, Tecumseh, FW 2002The faculty of language: what it is, who has it, and how did it evolveScience 29815691579Google Scholar
  35. Holdefer, RN, Miller, LE, Chen, LL, Houk, JC 2000Functional connectivity between cerebellum and primary motor cortex in the awake monkeyJ Neurophysiol84585590PubMedGoogle Scholar
  36. Holdefer, RN, Houk, JC, Miller, LE 2005Movement-related discharge in the cerebellar nuclei persists after local injections of GABAa antagonistsJ Neurophysiol933543CrossRefPubMedGoogle Scholar
  37. Holmes, G 1939The cerebellum of man. (The Hughlings Jackson Memorial Lecture)Brain62130Google Scholar
  38. Hoover, JE, Strick, PL 1999The organization of cerebellar and basal ganglia outputs to Primary motor cortex as revealed by retrograde transneuronal transport of herpes simplex virus type 1J Neuroscience1914462463Google Scholar
  39. Houk JC, Fraser D, Fishbach A, Roy SA, Simo LS, Bastianen C, Fansler- Wald D, Miller LE, Reber PJ, Botvinick M (2005) Action selection in subcortical loops through basal ganglia. Proceedings of the 1st International Workshop on Modeling Natural Action Selection, Edinburgh, July 2005Google Scholar
  40. Houk, JC 2001

    Neurophysiology of frontal-subcortical loops

    Lichter, DGCummings, JL eds. Frontal-subcortical circuits in psychiatry and neurologyGuilford PublicationsNew York92113
    Google Scholar
  41. Houk, JC 1997On the role of the cerebellum and basal ganglia in cognitive signal-processingProg Brain Res114543552PubMedGoogle Scholar
  42. Houk, JC, Adams, JL, Barto, AG 1995

    A model of how the basal ganglia generates and uses neural signals that predict reinforcement

    Houk, JCDavis, JLBeiser, DG eds. Models of information processing in the basal gangliaMIT PressCambridge249274
    Google Scholar
  43. Houk, JC, Barto, AG 1992

    Distributed sensorimotor learning

    Stelmach, GERequin, J eds. Tutorials in motor behavior IIElsevierAmsterdam71100
    Google Scholar
  44. Houk, JC, Keifer, J, Barto, AG 1993Distributed motor commands in the limb premotor networkTrends Neurosci162733CrossRefPubMedGoogle Scholar
  45. Houk JC, Mugnaini E (2002) Cerebellum. In: Squire LR, Bloom FE Roberts ea JL (eds) Fundamental neuroscience. Academic NewYorkGoogle Scholar
  46. Houk, JC, Alford, S 1996Computational significance of the cellular mechanisms for synaptic plasticity in Purkinje cellsBehav Brain Sci19457461Google Scholar
  47. Houk, JC, Wise, SP 1995Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling actionCerebral Cortex595110PubMedGoogle Scholar
  48. Hua, SE, Houk, JC 1997Cerebellar guidance of premotor network development and sensorimotor learningLearn Mem46376PubMedGoogle Scholar
  49. Inase, M, Sakai, ST, Tanji, J 1996Overlapping corticostriatal projections from the supplementary motor area and the primary motor cortex in the macaque monkey: an anterograde double labeling studyJ Comp Neurol373283296CrossRefPubMedGoogle Scholar
  50. Jiang, MC, Alheid, GF, Nunzi, MG, Houk, JC 2002Cerebellar input to magnocellular neurons in the red nucleus of the mouse: Synaptic analysis in horizontal brain slices incorporating cerebello-rubal pathwaysNeuroscience110105121Google Scholar
  51. Ito, M 2001Cerebellar long-term depression: Characterization, signal transduction, and functional rolesPhysiol Rev8111431195PubMedGoogle Scholar
  52. Kawagoe, R, Takikawa, Y, Hikosaka,  1998Expectation of reward modulates cognitive signals in the basal gangliaNat Neurosci1411416Google Scholar
  53. Kelly, RM, Strick, PL 2003Macroarchiteccture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal mutisynaptic circuitsProg Brain Res143441451Google Scholar
  54. Kelly RM, Strick PL (2004) Cerebellar loops with motor cortex and prefrontal cortex of a non-human primate. J Neuroscience.Google Scholar
  55. Kim, SG, Ugurbil, K, Strick, PL 1994Activation of a cerebellar output nucleus during cognitive processingScience265949951PubMedGoogle Scholar
  56. Kincaid, AE, Zheng, T, Wilson, CJ 1998Connectivity and Convergence of single corticostriatal axonsJ Neuroscience1847224731Google Scholar
  57. Lamarre, Y, Spidalieri, G 1983Fast ballistic arm movements triggered by visual, auditory, and somesthetic stimuli in the monkey. I. Activity of percentral cortical neuronsJ Neurophysiol5013431358Google Scholar
  58. Middleton, FA, Strick, PL 1997

    Newconcepts about the organization of basal ganglia output

    Obeso, JADeLong, MROhye, CMarsden, CD eds. The basal ganglia and new surgical approaches for parkinson’s disease, advances in neurologyLippincott-Raven PublishersPhiladelphia5768
    Google Scholar
  59. Miller, LE, Houk, JC 1995Motor co-ordinates in primate red nucleus: Preferential relation to muscle activation versus kinematic variablesJ Physiol Lond488533548PubMedGoogle Scholar
  60. Minsky, M 1986The Society of mindSimon and SchusterNew YorkGoogle Scholar
  61. Minsky, M 1963

    Steps toward artificial intelligence

    Feigenbaum, EAFeldman, J eds. Computers and thoughtMcGraw-HillNYC
    Google Scholar
  62. Nicola, SM, Surmeier, DJ, Malenka, RC 2000Dopminergic modulation of neuronal excitability in the striatum and nucleus accumbensAnn Rev Neurosci23185215CrossRefPubMedGoogle Scholar
  63. Novak, KE, Miller, LE, Houk, JC 2002The use of overlapping submovements in the control of rapid hand movementsExp Brain Res144351364CrossRefPubMedGoogle Scholar
  64. Ohl, FW, Scheich, H, Freeman, WJ 2001Change in pattern of ongoing cortical activity with auditory category learningNature412733736CrossRefPubMedGoogle Scholar
  65. Perrett, MH, Harries, HH, Mistlin, JJ, Hietanen, JK, Benson, JJ, Bevan, R, Thomas, S, Oram, MW, Ortega, J, Brierley, K 1990Social signals analyzed at the single cell level: someone is looking at me, something touched me, something movedInt J Comp Psychol42555Google Scholar
  66. Petersen, SE, Fiez, JA 1993The processing of single words studied with positron emission tomographyAnnu Rev Neurosci16509530CrossRefPubMedGoogle Scholar
  67. Requin, J, Riehle, A, Seal, J 1988Neuronal activity and information processing in motor control: From stages to continuous flowBiol Psychol26179198CrossRefPubMedGoogle Scholar
  68. Riolo, RL, Cohen, MD, Axelrod, R 2001Evolution of cooperation without reciprocityNature414441443Google Scholar
  69. Sakai, K, Hikosaka, O, Takino, R, Miyauchi, S, Nielsen, M, Tamada, T 2000What and When: Paralled and convergent processing in motor controlJ Neurosci2026912700Google Scholar
  70. Schmahmann, JD, Pandya, DN 1997Anatomic organization of the basilar pontine projections from prefrontal cortices in rhesus monkeyJ Neurosci17438458Google Scholar
  71. Schultz, W 1998Predictive reward signal of dopamine neuronsJ Neurophysiol80127PubMedGoogle Scholar
  72. Schultz, W, Romo, R, Ljungberg, T, Mirenowicz, J, Hollerman, JR, Dickinson, A 1995

    Reward-related signals carried by dopamine neurons

    Houk, JCDavis, JLBeiser, DG eds. Models of Information Processing in the Basal GangliaMIT PressCambridge233248
    Google Scholar
  73. Seth, AK, McKinstry, JL, Edelman, GM, Krichmar, JL 2004Visual binding through reentrant connectivity and dynamic synchronization in a brain-based deviceCerebral Cortex14118599CrossRefPubMedGoogle Scholar
  74. Strick, PL, Dum, RP, Picard, N 1995

    Macro-organization of the circuits connecting the basal ganglia with the cortical motor areas

    Houk, JCDavis, JLBeiser, DG eds. Models of Information Processing in the Basal GangliaMIT PressCambridge117130
    Google Scholar
  75. Tanji, J 2001Sequential organization of multiple movements: involvement of cortical motor areasAnn Rev Neurosci24631651CrossRefPubMedGoogle Scholar
  76. Tepper, JM, Koos, T, Wilson, CJ 2004GABAergic microcircuits in the neostriatumTrends Neurosci27662669CrossRefPubMedGoogle Scholar
  77. Tyrrell, T, Willshaw, D 1992Cerebellar cortex: its simulation and the relevance of Marr’s theoryPhil Trans Royal Soc Lond B336239257Google Scholar
  78. Wichmann, T, Bergman, H, Starr, PA, Subramanian, T, Watts, RL, DeLong, MR 1999Comparison of MPTP-induced changes in spontaneous neuronal discharge in the internal pallidal segment and in the substantia nigra pars reticulata in primatesExp Brain Res125397409CrossRefPubMedGoogle Scholar
  79. Wilensky, U, Reisman, K 1998

    Learning biology through constructing and testing computational theories – an embodied modeling approach

    Bar-Yam, Y eds. Proceedings of the second international conference on complex systemsNew England Complex Systems InstituteNashua
    Google Scholar
  80. Wilson, CJ 1990Basal Ganglia In: The synaptic organization of the brain Oxford University PressNY279316Google Scholar
  81. Yeterian, EH, Hoesen, GW 1978Cortico-striate projections in the rhesus monkey: the organization of certain cortico-caudate connectionsBrain Res1394363CrossRefPubMedGoogle Scholar

Copyright information

© Springer-Verlag 2005

Authors and Affiliations

  1. 1.Feinberg School of MedicineNorthwestern UniversityChicagoUSA

Personalised recommendations