Journal of Computational Neuroscience

, Volume 9, Issue 2, pp 171–185 | Cite as

The Autapse: A Simple Illustration of Short-Term Analog Memory Storage by Tuned Synaptic Feedback

  • H. Sebastian Seung
  • Daniel D. Lee
  • Ben Y. Reis
  • David W. Tank


According to a popular hypothesis, short-term memories are stored as persistent neural activity maintained by synaptic feedback loops. This hypothesis has been formulated mathematically in a number of recurrent network models. Here we study an abstraction of these models, a single neuron with a synapse onto itself, or autapse. This abstraction cannot simulate the way in which persistent activity patterns are distributed over neural populations in the brain. However, with proper tuning of parameters, it does reproduce the continuously graded, or analog, nature of many examples of persistent activity. The conditions for tuning are derived for the dynamics of a conductance-based model neuron with a slow excitatory autapse. The derivation uses the method of averaging to approximate the spiking model with a nonspiking, reduced model. Short-term analog memory storage is possible if the reduced model is approximately linear and if its feedforward bias and autapse strength are precisely tuned.

short-term memory persistent neural activity synaptic feedback reverberating circuit 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abeles M (1991) Corticonics: Neural Circuits of the Cerebral Cortex. Cambridge University, Cambridge.Google Scholar
  2. Amit DJ (1995) The Hebbian paradigm reintegrated: Local reverberations as internal representations. Behav. Brain Sci. 18:617-626.Google Scholar
  3. Amit DJ, Brunel N, Tsodyks MV (1994) Correlations of cortical Hebbian reverberations: Theory versus experiment. J. Neurosci. 14:6435-6445.Google Scholar
  4. Arnold DB, Robinson DA (1992) A neural network model of the vestibulo-ocular reflex using a local synaptic learning rule. Phil. Trans. R. Soc. Lond. B337:327-330.Google Scholar
  5. Arnold DB, Robinson DA (1997) The oculomotor integrator: Testing of a neural network model. Exp. Brain Res. 113:57-74.Google Scholar
  6. Bekkers JM, Stevens CF (1991) Excitatory and inhibitory autaptic currents in isolated hippocampal neurons maintained in cell culture. Proc. Natl. Acad. Sci. USA 88(17):7834-7838.Google Scholar
  7. Camperi M, Wang XJ (1998) A model of visuospatial working memory in prefrontal cortex: Recurrent network and cellular bistability [in process citation]. J. Comput. Neurosci. 5(4):383-405.Google Scholar
  8. Cannon SC, Robinson DA, Shamma S (1983) A proposed neural network for the integrator of the oculomotor system. Biol. Cybern. 49:127-136.Google Scholar
  9. Ermentrout B (1994) Reduction of conductance-based models with slow synapses to neural nets. Neural Comput. 6:679-695.Google Scholar
  10. Ermentrout B (1998a) Linearization of f-i curves by adaptation. Neural Comput. 10:1721-1729.Google Scholar
  11. Ermentrout B (1998b) Neural networks as spatio-temporal pattern-forming systems. Rep. Prog. Phys. 61:353-430.Google Scholar
  12. Fluster JM (1995) Memory in the Cerebral Cortex. MIT Press, Cambridge, MA.Google Scholar
  13. Georgopoulos AP, Taira M, Lukashin A (1993) Cognitive neurophysiology of the motor cortex. Science 260:47-52.Google Scholar
  14. Griniasty M, Tsodyks MV, Amit DJ (1993) Conversion of temporal correlations between stimuli to spatial correlations between attractors. Neural Comput. 5:1-17.Google Scholar
  15. Hebb DO (1949) Organizational Behavior. Wiley, New York.Google Scholar
  16. Herrmann M, Hertz JA, Prugel-Bennett A (1995) Analysis of synfire chains. Network 6:403-414.Google Scholar
  17. Hertz J, Prugel-Bennett A (1996) Learning short synfire chains by self-organization. Network 7:357-363.Google Scholar
  18. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79:2554-2558.Google Scholar
  19. Kamath BY, Keller EL (1976) A neurological integrator for the oculomotor control system. Math. Biosci. 30:341-352.Google Scholar
  20. Lorente de No R (1933) Vestibulo-ocular reflex arc. Arch. Neurol. Psych. 30:245-291.Google Scholar
  21. Lubke J, Markram H, Frotscher M, Sakmann B (1996) Frequency and dendritic distribution of autapses established by layer 5 pyramidal neurons in the developing rat neocortex: Comparison with synaptic innervation of adjacent neurons of the same class. J. Neurosci. 16(10):3209-3218.Google Scholar
  22. Maass W, Natschlager T (1997) Networks of spiking neurons can emulate arbitrary Hopfield nets in temporal coding. Network 8:355-371.Google Scholar
  23. Muller RU, Ranck Jr JB, Taube JS (1996) Head direction cells: Properties and functional significance. Curr. Opin. Neurobiol. 6:196-206.Google Scholar
  24. Nakahara H, Doya K (1998) Near-saddle-node bifurcation behavior as dynamics in working memory for goal-directed behavior. Neural Comput. 10(1):113-132.Google Scholar
  25. Prut Y, Fetz EE (1999) Primate spinal interneurons show premovement instructed delay activity. Nature 401(6753):590-594.Google Scholar
  26. Rinzel J, Frankel P (1992) Activity patterns of a slow synapse network predicted by explicitly averaging spike dynamics. Neural Comput. 4:534-545.Google Scholar
  27. Romo R, Brody CD, Hernandez A, Lemus L (1999) Neuronal correlates of parametric working memory in the prefrontal cortex. Nature 399(6735):470-473.Google Scholar
  28. Sanders JA, Verhulst F (1985) Averaging Methods in Nonlinear Dynamical Systems. Applied mathematical sciences. Springer-Verlag, New York.Google Scholar
  29. Segal MM (1991) Epileptiform activity in microcultures containing one excitatory hippocampul neuron. J. Neurophysiol. 65(4):761-770.Google Scholar
  30. Segal MM (1994) Endogenous bursts underlie seizurelike activity in solitary excitatory hippocampal neurons in microcultures. J. Neurophysiol. 72(4):1874-1884.Google Scholar
  31. Seung HS (1996) How the brain keeps the eyes still. Proc. Natl. Acad. Sci. USA 93:13339-13344.Google Scholar
  32. Seung HS (1997) Learning to integrate without visual feedback. Soc. Neurosci. Abstr. 23(1):8.Google Scholar
  33. Seung HS (1998) Learning continuous attractors in recurrent networks. Adv. Neural Info. Proc. Sys. 10:654-660.Google Scholar
  34. Seung HS, Lee DD, Reis BY, Tank DW (2000) Stability of the memory of eye position in a recurrent network of conductance-based model neurons. Neuron. 26:259-271.Google Scholar
  35. Shriki O, Sompolinksy H, Hansel D (1999) Rate models for conductance based cortical neural networks. Unpublished.Google Scholar
  36. Tamas G, Buhl EH, Somogyi P (1997) Massive autaptic self-innervation of gabaergic neurons in cat visual cortex. J. Neurosci. 17(16):6352-6364.Google Scholar
  37. Wang XJ (1998) Calcium coding and adaptive temporal computation in cortical pyramidal neurons. J. Neurophysiol. 79:1549-1566.Google Scholar
  38. Wang XJ, Rinzel J (1992) Alternating and synchronous rhythms in reciprocally coupled inhibitory model neurons. Neural Comput. 1992:534-545.Google Scholar
  39. Zhang K (1996) Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: A theory. J. Neurosci. 16:2112-2126.Google Scholar
  40. Zisper D, Kehoe B, Littlewort G, Fuster J (1993) A spiking network model of short-term active memory. J. Neurosci. 13:3406-3420.Google Scholar

Copyright information

© Kluwer Academic Publishers 2000

Authors and Affiliations

  • H. Sebastian Seung
    • 1
    • 2
  • Daniel D. Lee
    • 3
  • Ben Y. Reis
    • 3
  • David W. Tank
    • 3
  1. 1.Brain and Cognitive Sciences DepartmentMassachusetts Institute of TechnologyCambridge
  2. 2.Bell LaboratoriesLucent TechnologiesMurray Hill
  3. 3.Bell LaboratoriesLucent TechnologiesMurray Hill

Personalised recommendations