Neural Systems Engineering
Biological brains and engineered electronic computers fall into different categories. Both are examples of complex information processing systems, but beyond this point their differences outweigh their similarities. Brains are flexible, imprecise, error-prone and slow; computers are inflexible, precise, deterministic and fast. The sets of functions at which each excels are largely non-intersecting. They simply seem to be different types of system. Yet throughout the (admittedly still rather short) history of computing, scientists and engineers have made attempts to cross-fertilize ideas from neurobiology into computing in order to build machines that operate in a manner more akin to the brain. Why is this?
Part of the answer is that brains display very high levels of concurrency and fault-tolerance in their operation, both of which are properties that we struggle to deliver in engineered systems. Understanding how the brain achieves these properties may help us discover ways to transfer them to our machines. In addition, despite their impressive ability to process numbers at ever-increasing rates, computers continue to be depressingly dumb, hard to use and totally lacking in empathy for their hapless users. If we could make interacting with a computer just a bit more like interacting with another person, life would be so much easier for so many people.
KeywordsNeural System Logic Gate Spike Neural Network Leaky Integrator Spike Event
Unable to display preview. Download preview PDF.
- 1.Adrian ED 1964 Basis of sensation. Haffner, London, UK.Google Scholar
- 2.Austin J, Kennedy J, Lees K (1995) The Advanced Uncertain Reasoning Archi-tecture, AURA. In: Proc. Weightless Neural Network Workshop (WNNW’95), 26-27 September, University of Kent, UK.Google Scholar
- 7.Eliasmith C, Anderson CH 2003 Neural Engineering. MIT Press, Cambridge, MA.Google Scholar
- 8.Fatt P, Katz B 1952 Spontaneous subthreshold activity at motor nerve endings. J. Physiology, 117: 109-128.Google Scholar
- 10.Furber SB, Temple S, Brown AD (2006) On-chip and inter-chip networks for modeling large-scale neural systems. In: Proc. Intl. Symp. Circuits and Systems (ISCAS’06), 21-24 May, Kos, Greece. IEEE Press, Piscataway, NJ: 1945-1948.Google Scholar
- 11.Furber SB, Temple S, Brown AD 2006 High-performance computing for sys-tems of spiking neurons. In: Kovacs T, Marshall JAR (eds.) Proc. Adaptation in Artificial and Biological Systems Workshop (AISB’06) - GC5: Architecture of Brain and Mind 2, 3-6 April, Bristol, UK. Society for Aartificial Intelligence and the Simulaiton of behavior: 29-36.Google Scholar
- 14.Hebb DO 1949 The Organization of Behavior: A Neuropsychological Theory. Wiley, New York, NY.Google Scholar
- 15.Hellmich HH, Geike M, Griep P, Mahr P, Rafanelli M, Klar H (2005) Emulation engine for spiking neurons and adaptive synaptic weights. In: Proc. Intl. Joint Conf. Neural Networks (IJCNN’05), 31 July - 4 August, Montreal, Canada. 5: 3261-3266.Google Scholar
- 16.Hodgkin A, Huxley AF 1952 A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiology, 117: 500-544.Google Scholar
- 18.Izhikevich EM (2005) Simulation of large-scale brain models. (available online at:http://vesicle.nsi.edu/users/izhikevich/human brain simulation/Blue Brain. htm#Simulation of Large-Scale Brain Models - last accessed October 2007)
- 20.Jahnke A, Roth U, Klar H 1996 A SIMD/dataflow architecture for a neu-rocomputer for spike-processing neural networks (NESPINN). MicroNeuro, 96: 232-237.Google Scholar
- 24.Lichtsteiner P, Posch C, Delbruck T (2006) A 128 × 128 120 dB 30 mW asyn-chronous vision sensor that responds to relative intensity change. In: Proc. Intl. Solid State Circuits Conf. (ISSCC’06), 4-9 February, San Francisco, CA: 508-509.Google Scholar
- 26.Mahowald M 1992 VLSI analogs of neuronal visual processing: a synthesis of form and function. PhD Dissertation, California Institute of Technology, Pasadena, CA.Google Scholar
- 32.Moore GE 1965 Cramming more components onto integrated circuits. Electronics, 38(8): 114-117.Google Scholar
- 33.Mountcastle V 1978 An organizing principle for cerebral function: the unit module and the distributed system. In: Edelman GM, Mountcastle VB (eds.) The Mindful Brain. MIT Press, Cambridge, MA: 7-50.Google Scholar
- 34.NEURON (available online at: http://www.neuron.yale.edu/neuron- last accessed October 2007).
- 37.Prange SJ, Klar H (1993) Cascadable digital emulator IC for 16 biological neurons. In: Proc. 40th Intl. Solid State Cicruits Conf. (ISSCC’93), 24-26 February, San Francisco, CA: 234-235, 0294.Google Scholar
- 40.Schoenauer T, Mehrtash N, Jahnke A, Klar H 1998 MASPINN: novel concepts for a neuro-accelerator for spiking neural networks. In: Lindblad T, Padgett ML, Kinser JM (eds.) Proc. Workshop on Virtual Intelligence and Dynamic Neural Networks (VIDYNN’98), 26-28 June, Stockholm, Sweden: 87-97.Google Scholar
- 41.Schwartz J, Begley S 2003 The Mind and the Brain: Neuroplasticity and the Power of Mental Force. Regan Books, New York, NY.Google Scholar
- 42.Sivilotti M 1991 Wiring considerations in analog VLSI systems, with applica-tion to field-programmable networks. PhD Dissertation, California Institute of Techology, Pasadena, CA.Google Scholar
- 43.Sloman A (2004) GC5: The architecture of brain and mind. In: Hoare CAR, Milner R (eds.) UKCRC Grand Challenges in Computing - Research. British Computer Society, Edinburgh, UK: 21-24.Google Scholar
- 45.Werbos P 1994 The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting. Wiley, New York, NY.Google Scholar
- 48.Zhu J, Sutton P 2003 FPGA Implementations of neural networks - a survey of a decade of progress. In: Cheung PYK, Constantinides GA, de Sousa JT (eds.) Proc. 13th Annual Conf. Field Programmable Logic and Applications (FPL’03), 1-3 September, Lisbon, Portugal. Springer-Verlag, Berlin: 1062-1066.Google Scholar