Abstract
The first two main rounds of neural computing focused on adaptation and self-organization in neural networks, and on use of analog VLSI for compartmental modeling of the neuron, respectively. This paper is a prospectus for a third round of neural computing: analyzing the architecture of the primate brain to extract neural information processing principles and translate them into biologically-inspired operating systems and computer architectures. The way in which the cerebellum interacts with other brain regions in learning how to better control and coordinate movements provides a case study to introduce key ideas for these three rounds of neural computation. It is argued that the third round will develop and exploit general insights into brain architectures, their function and dynamics, that will provide a principled combination of cooperative computation, learning and perceptual robotics (i.e., the integration of action, perception and computation). This new effort is motivated by recent advances in computational neuroscience research, studying examples of system evolution ranging from low-level vision to how the interactions between frontal and parietal cortices serve action recognition (the mirror system), and language. The paper also notes the vast difference between the slow biological evolution of diverse brains and the needs of computer technology for explicit tools for the design and testing of novel programs and architectures, and suggests the challenges of developing a reflection methodology for wrapping modules with descriptions that can be automatically updated as the module itself adapts through learning. The Appendix provides a road map for approaching the voluminous literature on brain theory and neural networks.
Similar content being viewed by others
References
Amari S and Arbib MA (1977) Competition and cooperation in neural nets. In: Metzler J (ed) Systems Neuroscience, pp. 119–165. Academic Press
Arbib MA (1964) Brains, Machines and Mathematics. McGraw-Hill, New York
Arbib MA (1981) Perception structures and distributed motor control. In: Brooks VB (ed) Handbook of Physiology, Section 2: The Nervous System, Vol. II, Motor Control, Part I, pp. 1449–1480. American Physiological Society
Arbib MA (1989) The Metaphorical Brain 2: Neural Network and Beyond. Wiley-Interscience, New York
Arbib MA (ed) (1995) The Handbook of Brain Theory and Neural Networks. Bradford Books/The MIT Press
Arbib MA (1988) Neural computing: The challenge of the neurally-inspired. EDUCOM Bulletin 23(1): 2–12
Arbib MA (2001) Grounding the mirror system hypothesis for the evolution of the languageready brain. In: Angelo Cangelosi and Domenico Parisi (eds) Simulating the Evolution of Language. Springer-Verlag
Arbib MA (2002) The mirror system, imitation, and the evolution of language. In: Chrystopher Nehaniv and Kerstin Dautenhahn (eds) Imitation in Animals and Artifacts. The MIT Press, to appear
Arbib MA (ed) (2003) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press
Arbib MA (2003a) From Rana computatrix to human language: Towards a computational neuroethology of language evolution. Phil Trans R Soc Lond, in press
Arbib MA (2003b) Schema theory. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press
Arbib MA, Alexander A and Weitzenfeld W (2002) NSL Neural Simulation Language. In: Arbib MA and Grethe JS (eds) Computing the Brain: A Guide to Neuroinformatics, pp. 71–90. Academic Press, San Diego, CA
Arbib MA, Billard A, Iacoboni M and Oztop E (2000) Synthetic brain imaging: Grasping, mirror neurons and imitation. Neural Networks 13: 975–997
Arbib MA, Bischoff A, Fagg AH and Grafton ST (1994) Synthetic PET: Analyzing large-scale properties of neural networks. Human Brain Mapping 2: 225–233
Arbib MA, Érdi P and Szentágothai J (1998) Neural Organization: Structure, Function, and Dynamics. The MIT Press, Cambridge, MA
Arbib MA, Iberall T and Lyons D (1985) Coordinated control program for movements of the hand. In: Goodwin AW and Darian-Smith I (eds) Hand Function and the Neocortex, Exp Brain Res Suppl 10, pp. 111–129
Arbib MA and Ehrig H (1990) Linking schemas and module specifications for distributed systems. Proceedings of the Workshop on Distributed Computing Systems. Cario
Atkeson CG, Moore AW and Schaal S (1997) Locally weighted learning for control. Artificial Intelligence Review 11: 75–113
Bartlett FC (1932) Remembering. Cambridge University Press
Barto AG, Sutton RS and Brouwer P (1981) Associative search network: A reinforcement learning associative memory. Biol Cybernetics 40: 201–211
Bell AJ and Sejnowski TJ (1995) An information maximization approach to blind separation and blind deconvolution. Neural Computation 7: 1129–1159
Bellman KL (1993) Flexible Software Environments Supporting the Design of Complex Systems, Proceedings of the Artificial Intelligence in Logistics Meeting, 8-10 March 1993. Williamsburg, Va, American Defense Preparedness Association
Bellman KL (2000) Developing a concept of self for constructed autonomous systems. In: Proceedings of EMCRS'2000: The 15th European Meeting on Cybernetics and Systems Research, Symposium on Autonomy Control: Lessons from the Emotional, 25-28 April 2000, Vienna Volume, pp. 693–698
Bridgeman B, Gemmer A, Forsman T and Huemer V (2000) Processing spatial information in the sensorimotor branch of the visual system. Vision Research 40: 3539–3552
Bridgeman B, Peery S and Anand S (1997) Interaction of cognitive and sensorimotor maps of visual space. Perception and Psychophysics 59: 456–469
Castiello U, Paulignan Y and Jeannerod M (1991) Temporal dissociation of motor responses and subjective awareness: A study in normal subjects. Brain 114: 2639–2655
Corballis MC (2002) From Hand to Mouth: The Origins of Language. Princeton University Press, Princeton, NJ
Damper RI, French RLB and Scutt TW (2000) ARBIB: An autonomous robot based on inspiration from biology. Robotics and Autonomous Systems 31: 247–274
Dayan P, Hinton GE, Neal RM and Zemel RS (1995) The Helmholtz machine. Neural Computation 7: 889–904
Douglas R and Rasche C (2003) Silicon neurons. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press
Doya K (1999) What are the computations in the cerebellum, the basal ganglia, and the cerebral cortex. Neural Networks 12: 961–974
Fagg AH and Arbib MA (1998) Modeling parietal-premotor interactions in primate control of grasping. Neural Networks 11: 1277–1303
Gibson JJ (1966) The Senses Considered as Perceptual Systems. Allen and Unwin
Goldman-Rakic PS (1990) Parallel systems in the cerebral cortex: The topography of cognition. In: Arbib MA and Robinson JA (eds) Natural and Artificial Parallel Computation, pp. 155–176. The MIT Press, Cambridge, MA
Goodale MA and Milner AD (1992) Separate visual pathways for perception and action. Trends in Neuroscience 15: 20–25
Goodale MA, Milner AD, Jakobson LS and Carey DP (1991) A neurological dissociation between perceiving objects and grasping them. Nature 349: 154–156
Head H and Holmes G (1911) Sensory disturbances from cerebral lesions. Brain 34: 102–254
Hebb Donald O (1949) The Organization of Behavior. J. Wiley and Sons, New York
Hewes G (1973) Primate communication and the gestural origin of language. Current Anthropology 14: 5–24
Jackson JH (1878-1879) On affections of speech from disease of the brain. Brain 1: 304–330, 2: 203-222, 323-356
Iberall T, Binghma G and Arbib MA (1986) Opposition space as a structuring concept for the analysis of skilled hand movements. Experimental Brain Research Series 15: 158–173
Jacobs RA, Jordan MI, Nowlan SJ and Hinton GE (1991) Adaptive mixtures of local experts. Neural Computation 3: 79–87
Jeannerod M and Biguer B (1982) Visuomotor mechanisms in reaching within extra-personal space. In: Ingle DJ, Mansfield RJW and Goodale MA (eds) Advances in the Analysis of Visual Behavior, pp. 387–409. The MIT Press, Cambridge, MA
Jennerod M, Arbib MA, Rizzolatti G and Sakata H (1995) Grasping objects: The cortical mechanisms of visuomotor transformation. Trends in Neurosciences 18: 314–320
Kiczales G, des Rivieres J and Bobrow DG (1991) the Art of the Meta-Object Protocol. The MIT Press, Cambridge, MA
Kimura D (1993) Neuromotor Mechanisms in Human Communication. Oxford University Press, Oxford, New York
Kohonen T (1988) Self-Organization and Associative Memory, 2nd Edition. Springer-Verlag
Kornfeld WA and Hewitt C (1981) The scientific community metaphor. IEEE Trans on Systems, Man and Cybernetics 11: 23–33
Landauer CA and Bellman KL (1993) The Role of Self-Referential Logics in a Software Architecture Using Wrappings. Proceedings of ISS '93: The 3rd Irvine Software Symposium, 30 April 1993. UC Irvine, California
Landauer CA and Bellman KL (1996) Constructed complex systems: Issues, architectures and wrappings. In: Proceedings EMCSR 96: Thirteenth European Meeting on Cybernetics and Systems Research, Symposium on Complex Systems Analysis and Design, 9-12 April 1996, Vienna, pp. 233–238
Lyons DM and Arbib MA (1989) A formal model of computation for sensory-based robotics. IEEE Trans on Robotics and Automation 5: 280–293
McCulloch WS and Pitts WH (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5: 115–133
McCulloch WS, Arbib MA and Cowan JD (1962) Neurological models and integrative processes. In: Yovits MC, Jacobi GT and Goldstein GD (eds) Self-Organizing Systems, pp. 49–59. Spartan Books
Mead C (1989) Analog VLSI and Neural Systems. Addison-Wesley, Reading, MA
Mead C and Conway L (1980) Introduction to VLSI Systems. Addison-Wesley, Reading, MA
Minsky ML (1961) Steps toward artificial intelligence. Proc IRE 49: 8–30
Minsky ML (1985) The Society of Mind. Simon and Schuster, New York
Newell KM, Scully DM, McDonald PV and Baillargeon R (1989) Task constraints and infant grip configurations. Development Pyshobiology 22: 817–831
Nolfi S and Parisi D (2003) Evolution of Artificial Neural Networks. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press
Oztop E and Arbib MA (2002) Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics 87: 116–140
Oztop E, Bradley N and Arbib MA (2003) Learning to Grasp I: The Infant Learning to Grasp Model (ILGM), to appear
Piaget J (1971) Biology and Knowledge. Edinburgh University Press, Edinburgh
Prager JM and Arbib MA (1982) Computing the optic flow: The MATCH algorithm and prediction. Computer Vision, Graphics and Image Processing 24: 271–304
Rall W(1995) Perspective on neuron model complexity. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, pp. 728–732. A Bradford Book/The MIT Press
Rizzolatti G and Arbib MA (1998) Language within our grasp. Trends in Neurosciences 21(5): 188–194
Rizzolatti G, Camarda R, Fogassi L, Gentilucci M, Luppino G and Matelli M (1988) Functional oraganization of inferior Area 6 in the Macaque Monkey II. Area F5 and the control of distal movements. Exp Brain Res 71: 491–507
Rizzolatti G, Fadiga L, Gallese V and Fogassi L (1996a) Premotor cortex and the recognition of motor actions. Cogn Brain Res 3: 131–141
Rizzolatti G, Fadiga L, Matelli M, Bettinardi V, Perani D and Fazio F (1996) Localization of grasp representations in humans by positron emission tomography: 1. Observation versus execution. Exp Brain Res 111: 246–252
Rosenblatt F (1958) The perceptron: A probabilistic model for information storage and organization in the brain. Psychol Rev 65: 386–408
Rumelhart DE and McCelland JL (eds) (1986) Parallel Distributed Processing: Explorations in the Miscrostructure of Cognition. A Bradford Book/The MIT Press, Cambridge, MA
Rumelhart DE, Hinton GE and Williams RJ (1986) Learning and internal representations by error propagation. In: Rumelhart D and McClelland J (eds) Parallel Distributed Processing: Explorations in the Microstructure of Cognition 1, pp. 318–362. The MIT Press
Schölkopf B and Smola AJ (2002) Learning with Kernels. The MIT Press, Cambridge, MA
Stokoe WC (2001) Language in Hand: Why Sign Came Before Speech. Gallaudet University Press, Washington, DC
Sutton RS and Barto AG (1998) Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA
Taira M, Mine S, Georgopoulos AP, Murata A and Sakata H (1990) Parietal cortex neurons of the monkey related to the visual guidance of hand movement. Exp Brain Res 83: 29–36
Turing AM (1936) On computable numbers with an application to the entscheidungsproblem. Proc London Math Soc Ser 2(42): 230–265
Turing AM (1952) The chemical basis of morphogenesis. Phil Trans Roy Soc Lond B237: 37–72
Umilta MA, Kohler E, Gallese V, Fogassi L, Fadiga L, Keysers C and Rizzolatti G (2001) I know what you are doing: A neurophysiological study. Neuron 31: 155–165
Ungeleider LG and Mishkin M (1982) Two cortical visual systems. In: Ingle DJ, Goodale MA and Mansfield RJW (eds) Analysis of Visual Behavior. The MIT Press, Cambridge, MA
von der Malsburg C (1988) Pattern recognition by labeled graph matching. Neural Networks 1: 141–148
von Neumann J (1966) Theory of Self-Reproducing Automata (edited and completed by Burks AW). University of Illinois Press, Champaign, IL
von Neumann J, Burks A and Goldsteine HH (1947-1948) Planning and Coding of Problems for an Electronic Computing Instrument. Institute for Advanced Study, Princeton (reprinted in von Neumann's, Collected Works 5: 80–235)
Weitzenfeld A and Arbib MA (1994) NSL - Neural Simulation Language. In: Skrzypek J (ed) Neural Network Simulation Environments, pp. 73–93. Kluwer Academic Publishers, Boston, MA
Wiener N (1948) Cybernetics: Or Control and Communication in the Animal and the Machine. The Technology Press and Wiley (Second Edition, The MIT Press, 1961)
Williams CKI (1998) Prediction with Gaussian processes: From linear regression to linear prediction and beyond. In: Jordan MI (ed) Learning in Graphical Models, pp. 599–621. Kluwer Academic Publishers, Dordrecht
Willshaw DJ and von der Malsburg C (1976) How patterned neural connections can be set up by self-organization. Proc R Soc Lond B194: 431–445
Zukow-Goldring P, Arbib MA and Oztop E (2002) Language and Mirror System: A Perception/Action Based Approach to Communicative Development (Working Draft, 22 June 2002)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Arbib, M.A. Towards a neurally-inspired computer architecture. Natural Computing 2, 1–46 (2003). https://doi.org/10.1023/A:1023390900317
Issue Date:
DOI: https://doi.org/10.1023/A:1023390900317