Journal of Computational Neuroscience

, Volume 5, Issue 4, pp 353–364 | Cite as

Adapting a Feedforward Heteroassociative Network to Hodgkin-Huxley Dynamics

  • William W. Lytton


Using the original McCulloch-Pitts notion of simple on and off spike coding in lieu of rate coding, an Anderson-Kohonen artificial neural network (ANN) associative memory model was ported to a neuronal network with Hodgkin-Huxley dynamics. In the ANN, the use of 0/1 (no-spike/spike) units introduced a cross-talk term that had to be compensated by introducing balanced feedforward inhibition. The resulting ANN showed good capacity and fair selectivity (rejection of unknown input vectors). Translation to the Hodgkin-Huxley model resulted in a network that was functional but not at all robust. Evaluation of the weaknesses of this network revealed that it functioned far better using spike timing, rather than spike occurrence, as the code. The algorithm requires a novel learning algorithm for feedforward inhibition that could be sought physiologically.

associative memory inhibition artificial neural network hippocampus 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abbott LF, Kepler TB (1990) Model neurons: from Hodgkin-Huxley to Hopfield. Paper presented at the Eleventh Sitges Conference on Neural Networks, Sitges, Spain.Google Scholar
  2. Alger BE, Pitler TA, Wagner JJ, Martin LA, Morishita W, Kirov SA, Lenz RA (1996) Retrograde signalling in depolarization-induced suppression of inhibition in rat hippocampal ca1 cells. J Physiol (Lond) 496: 197–209.Google Scholar
  3. Amaral DG, Ishizuka N, Claiborne B (1990) Neurons, numbers and the hippocampal network. In: Progress in Brain Research. Elsevier Science Publishers.Google Scholar
  4. Amit D (1989) Modelling Brain Function. Cambridge University Press, Cambridge.Google Scholar
  5. Anderson JA (1972) A simple neural network generating an interactive memory. Math. biosci. 14: 197–220.Google Scholar
  6. Anderson JA, Rosenfeld E (1988) Neurocomputing: Foundations of research. MIT Press, Cambridge, MA.Google Scholar
  7. Barkai E, Bergman RE, Horwitz G, Hasselmo ME (1994) Modulation of associative memory function in a biophysical simulation of rat piriform cortex. J. Neurophysiol. 72: 659–677.Google Scholar
  8. Blazis DEJ, Fischer TM, Carew TJ (1993) A neural network model of inhibitory information processing in aplysia. Neural Computation 5: 213–227.Google Scholar
  9. Borg-Graham LJ (1991) Modeling the non-linear conductances of excitable membranes. In: Wheal H, Chad J, eds. Cellular and Molecular Neurobiology: A Practical Approach, Oxford, New York, pp. 247–275.Google Scholar
  10. Buckmaster PS, Schwartzkroin PA (1995) Interneurons and inhibition in the dentate gyrus in vivo. Neurosci 15: 774–789.Google Scholar
  11. Bullock TH (1993) Integrative systems research on the brain: resurgence and new opportunities. Annual Review of Neuroscience 16: 1–15.Google Scholar
  12. Bullock TH (1997) Signals and signs in the nervous system: the dynamic anatomy of electrical activity is probably information-rich. Proceedings of the National Academy of Sciences of the United States of America 94: 1–6.Google Scholar
  13. Celebrini S, Thorpe S, Trotter Y, Imbert M (1993) Dynamics of orientation coding in area V1 of the awake primate. Visual Neuroscience 10: 811–825.Google Scholar
  14. Damasio AR (1990) Category-related recognition defects as a clue to the neural substrates of knowledge. Trends Neurosci 13: 95–98.Google Scholar
  15. deCharms RC, Merzenich MM (1996) Primary cortical representation of sounds by the coordination of action-potential timing. Nature 381: 610–613.Google Scholar
  16. Destexhe A, Mainen ZF, Sejnowski TJ (1994) Synthesis of models for excitable membranes, synaptic transmission and neuromodulation using a common kinetic formalism. J. Comput. Neurosci. 1: 195–230.Google Scholar
  17. Destexhe A, Mainen ZF, Sejnowski TJ (1994a) An efficient method for computing synaptic conductances based on a kinetic model of receptor binding. Neural Comput. 6: 14–18.Google Scholar
  18. Fischer TM, Carew TJ (1993) Activity-dependent potentiation of recurrent inhibition: a mechanism for dynamic gain control in the siphon withdrawal reflex of aplysia. J. Neurosci. 13: 1302–1314.Google Scholar
  19. Fransen E, Lansner A (1995) Low spiking rates in a population of mutually exciting pyramidal cells. Network 6: 271–288. 2660.Google Scholar
  20. Fricke RA, Prince DA (1984) Electrophysiology of dentate gyrus granule cells. J. Neurophysiol. 51: 195–209.Google Scholar
  21. Fukai T (1996) Competition in the temporal domain among neural activities phase-locked to subthreshold oscillations. Biol. Cybernetics 75: 453–461.Google Scholar
  22. Gardner-Medwin AR (1976) The recall of events through the learning of associations between their parts. Proc. R. Soc. Lond. B 194: 375–402.Google Scholar
  23. Gray CM (1994) Synchronous oscillations in neuronal systems: Mechanisms and functions. J. of Comput. Neurosci. 1: 11–38.Google Scholar
  24. Gray CM, Konig P, Engel AK, Singer W (1989) Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338: 334–337.Google Scholar
  25. Gray C, Singer W (1989) Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proc. Natl. Acad. Sci. USA 86: 1698–1702.Google Scholar
  26. Hille B (1996) A K+ channel worthy of attention. Science 273: 1677.Google Scholar
  27. Hines M (1993) NEURON – A program for simulation of nerve equations. In: Eeckman, F, ed. Neural systems: Analysis and modeling, Kluwer Academic Publishers, Boston, MA, pp. 127–136.Google Scholar
  28. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. USA 79: 2554–2558.Google Scholar
  29. Hopfield JJ (1984) Neurons with graded response have collective computation abilities. Proc. Nat. Acad. Sci. USA 81: 3088–3092.Google Scholar
  30. Hopfield JJ (1995) Pattern recognition computation using action potential timing for stimulus representation. Nature 376: 33–36.Google Scholar
  31. Joris PX, Carney LH, Smith PH, Yin TC (1994) Enhancement of neural synchronization in the anteroventral cochlear nucleus I responses to tones at the characteristic frequency. J. of Neurophysiol. 71: 1022–1036.Google Scholar
  32. Kapur A, Lytton WW, Ketchum K, L Haberly (1997b) Regulation of the NMDA component of EPSPs by different components of postsynaptic GABAergic inhibition: A computer simulation analysis in piriform cortex. J. Neurophysiol. 78: 2546–2559.Google Scholar
  33. Kapur A, Pearce R, Lytton WW, L Haberly (1997a) GABAA-mediated IPSCs in piriform cortex have fast and slow components with different properties and locations on pyramidal cells: Study with physiological and modeling methods. J. Neurophysiol. 78: 2531–2545.Google Scholar
  34. Kohonen T (1972) Correlation matrix memories. IEEE Transactions on Computers C?21: 353–359.Google Scholar
  35. Lansner A, Fransen E (1992) Modelling hebbian cell assemblies comprised of cortical neurons. Network 3: 105–119. 2659.Google Scholar
  36. Lansner A, Fransen E (1995) Improving the realism of attractor models by using cortical columns as functional units. In: J. Bower, ed. The Neurobiology of Computation: Proceedings of the Third Annual Computation and Neural Systems Conference, Kluwer Academic Publishers, Boston, MA.Google Scholar
  37. Lisman JE, Idiart MA (1995) Storage of 7 ± 2 short-term memories in oscillatory subcycles. Science 267: 1512–1515.Google Scholar
  38. Lytton WW (1996) Optimizing synaptic conductance calculation for network simulations. Neural Comput. 8: 501–510.Google Scholar
  39. Lytton WW (1997) Brain organization: from molecules to parallel processing. In: Trimble, M and Cummings, J, eds. Contemporary Behavioral Neurology, Butterworth–Heinemann, Newton, MA, pp. 5–28.Google Scholar
  40. Lytton WW, Hellman KM, Sutula TP (1998) Computer models of hippocampal circuit changes of the kindling model of epilepsy. Artificial Intelligence in Medicine.Google Scholar
  41. Lytton WW, Sejnowski TJ (1991) Inhibitory interneurons may help synchronize oscillations in cortical pyramidal neurons. J. Neurophysiol. 66: 1059–1079.Google Scholar
  42. Maass W (1997) Fast sigmoidal networks via spiking neurons. Neural Comput. 9: 279–304.Google Scholar
  43. Marr D (1971) Simple memory a theory for archicortex. Phil. Trans. R. Soc. Lond. B 262: 23–81.Google Scholar
  44. Marr D. (1982) Vision. Freeman, San Francisco, CA.Google Scholar
  45. McCulloch W, Pitts W (1943) A logical calculus of ideas immanent in nervous activity. Bull. Math. Biophysics 5: 115–133.Google Scholar
  46. Menschik ED, Finkel LH (in press) Neuromodulatory control of hippocampal function: Towards a model of Alzheimer's disease. Artificial Intelligence in Medicine.Google Scholar
  47. Murthy V, Fetz E (1992) Coherent 25-to 35-Hz oscillations in the sensorimotor cortex of awake behaving monkeys. Proc. Natl. Acad. Sci. USA 89: 5670–5674.Google Scholar
  48. O'Reilly RC, McClelland JL (1994) Hippocampal conjunctive encoding, storage, and recall: avoiding a trade-off. Hippocampus 4: 661–682.Google Scholar
  49. Parodi O, Combe P, Ducom JC (1996) Temporal coding in vision: Coding by the spike arrival times leads to oscillations in the case of moving targets. Biol. Cybernetics 74: 497–509.Google Scholar
  50. Pitler TA, Alger BE (1994) Depolarization-induced suppression of gabaergic inhibition in rat. Neuron 13: 1447–1455.Google Scholar
  51. Pribram KH (1969) The limbic systems, efferent control of neural inhibition and behavior. Scientific Am. 220: 73–86.Google Scholar
  52. Scharfman HE (1994) Evidence from simultaneous intracellular recordings in rat hippocampal slices that area CA3 pyramidal cells innervate dentate hilar mossy cells. J. Neurophysiol. 2: 2167–2180.Google Scholar
  53. Stemmler M (1996) A single spike suffices-the simplest form of stochastic resonance in model neurons. Network-Comput. in Neural Sys. 7: 687–716. 2655.Google Scholar
  54. Stevens CF (1966) Neurophysiology: A Primer. Wiley, New York.Google Scholar
  55. Teyler TJ, DiScenna P (1986) The hippocampal memory indexing theory. Behavioral Neurosci. 100: 147–154.Google Scholar
  56. Thorpe S (1990) Spike arrival times: a highly efficient coding scheme for neural networks. In: Eckmiller, R, Hartman, G, and Hauske, G, eds. Parallel processing in neural systems, Elsevier, Amsterdam, The Netherlands, pp. 91–94.Google Scholar
  57. Thorpe S, Fize D, Marlot C (1996) Speed of processing in the human visual system. Nature 381: 520–522.Google Scholar
  58. Tovée MJ (1994) Neuronal processing: How fast is the speed of thought?. Current Biol. 4: 1125–1127.Google Scholar
  59. Tovee MJ, Rolls ET, Treves A, Bellis RP (1993) Information encoding and the responses of single neurons in the primate temporal visual cortex. J. of Neurophysiol. 70: 640–654.Google Scholar
  60. Treves A, Rolls ET (1991) What determines the capacity of associative memories in the brain. Network: Comput. and Neural Sys. 2: 371–397.Google Scholar
  61. Treves A, Rolls ET (1994) Computational analysis of the role of the hippocampus in memory. Hippocampus 4: 374–391.Google Scholar
  62. Van Essen DC, Maunsell JHR (1983) Hierarchical organization and functional streams in the visual cortex. Trends Neurosci. 6: 370–375.Google Scholar
  63. Willshaw DJ, Buckingham JT (1990) Anassessment of Marr's theory of the hippocampus as a temporary memory store. Phil. Trans. R. Soc. Lond. B 329: 205–215.Google Scholar
  64. Willshaw DJ, Buneman OP, Longuet-Higgins HC (1969) Nonholographic associative memory. Nature 222: 960–962.Google Scholar

Copyright information

© Kluwer Academic Publishers 1998

Authors and Affiliations

  • William W. Lytton
    • 1
  1. 1.Department of Neurology and Neuroscience Training Program, Wm. S. Middleton VA HospitalUniversity of WisconsinMadison

Personalised recommendations