Biological Cybernetics

, Volume 69, Issue 1, pp 77–86 | Cite as

Pattern association and retrieval in a continuous neural system

  • Hung-Jen Chang
  • Joydeep Ghosh


This paper studies the behavior of a large body of neurons in the continuum limit. A mathematical characterization of such systems is obtained by approximating the inverse input-output nonlinearity of a cell (or an assembly of cells) by three adjustable linearized sections. The associative spatio-temporal patterns for storage in the neural system are obtained by using approaches analogous to solving space-time field equations in physics. A noise-reducing equation is also derived from this neural model. In addition, conditions that make a noisy pattern retrievable are identified. Based on these analyses, a visual cortex model is proposed and an exact characterization of the patterns that are storable in this cortex is obtained. Furthermore, we show that this model achieves pattern association that is invariant to scaling, translation, rotation and mirror-reflection.


Large Body Visual Cortex Field Equation Neural System Continuum Limit 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Amari SI (1972) Characteristics of random nets of analog neuron-like elements. IEEE Trans Syst Man Cybern 2:1443–1463Google Scholar
  2. Amari SI (1975) Homogeneous nets of neuron-like elements. Biol Cybern 17:211–220Google Scholar
  3. Amari SI (1977) Dynamics of pattern formation in lateral-inhibition type neural fields. Biol Cybern 27:77–87Google Scholar
  4. Amari SI, Arbib MA (1977) Competition and cooperation in neural nets. In Metzler J (eds) Systems neuroscience. Academic Press, New York, pp 119–165Google Scholar
  5. Anderson JA (1968) A memory storage model utilizing spatial correlation function. Kybernetik 5:113–119Google Scholar
  6. Beaulieu C, Colonnier M (1983) The number of neurons in the different laminae of the binocular and monocular regions of area 17 in the cat. J Comp Neurol 217:337–344Google Scholar
  7. Beaulieu C, Colonnier M (1985) A laminar analysis of round-asymmetrical and flat-asymmetrical synapses on spins, dendritic trunks and cell bodies in area 17 of the cat. J Comp Neurol 231:180–189Google Scholar
  8. Blinkov SM, Glezer II (1968) The human brain in figures and tables. Plenum Press, New YorkGoogle Scholar
  9. Bochner S, Chandrasekharan K (1949) Fourier transforms. University Press, Princeton USAGoogle Scholar
  10. Caianiello ER (1961) Outline of a theory of thought-processes and thinking machines. J Theor Biol 2:204–235Google Scholar
  11. Chang HJ, Ghosh J, Liano K (1992) A macroscopic model of neural ensembles: Learning-induced oscillations in a cell assembly. Int J Neural Systems 3:179–198Google Scholar
  12. Cowan JD (1967) A mathematical theory of central nervous activity, Thesis, University of LondonGoogle Scholar
  13. Eillias SA, Grossberg S (1975) Pattern formation, contrast control and oscillations in the short-term memory of shunting on-center off-surround networks. Biol Cybern 20:69–98Google Scholar
  14. Ermentrout GB, Cowan JD (1979) A mathematical theory of visual hallucination patterns. Biol Cybern 34:137–150Google Scholar
  15. Ermentrout GB, Cowan JD (1980) Large scale spatially organized activity in neural nets. SIAM J Appl Math 38:1–21Google Scholar
  16. Ermentrout B, Campbell J, Oster G (1986) A model for patterns based on neural activity. Veliger 28:369–388Google Scholar
  17. Fukushima K (1980) Neocognitron: A self-organization neural network model for a mechanism of pattern recognition unaffected by a shift in position. Biol Cybern 36: 192–202Google Scholar
  18. Hochstein S, Spitzer H (1985) One, few, infinity: linear and nonlinear processing in the visual cortex. In: Rose D, Dobson VG (eds) Models of the visual cortex. John Wiley, New York, pp 341–350Google Scholar
  19. Kohonen T (1989) Self-organization and associative memory. Springer, Berlin Heidelberg New YorkGoogle Scholar
  20. Porter D, Stirling DSG (1990) Integral equations. Cambridge University Press, Cambridge, USAGoogle Scholar
  21. Schwartz EL (1980) Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding. Vision Res 20:645–669Google Scholar
  22. Smirnov VI (1964) Integral equations and partial differential equations. Addison-Wesley, ReadingGoogle Scholar
  23. Stanley JC (1976) Simulation studies of a temporal sequence memory model. Biol Cyber 24:121–137Google Scholar
  24. Thomas E, Patton P, Wyatt RE (1991) A computational model of the vertical anatomical organization of primary visual cortex. Biol Cybern 65:189–202Google Scholar
  25. Traub RD, Miles R, Wong RKS (1989) Model of the origin of rhythmic population oscillations in the hippocampal slice. Science 243:1319–1325Google Scholar
  26. Wehmeier U, Dong D, Koch C, Van Essen D (1989) Modeling the mammalian visual system. In: Koch C, Segev I (eds) Methods in neuronal modeling, from synapses to networks. MIT Press, Cambridge, pp 335–359Google Scholar
  27. Willner BE, Miranker ML, Lu CP (1990) Neural organization of the locomotive oscillator. Technical Report RC 16390 (No. 72765), IBM Research Report, TJ Watson Research CenterGoogle Scholar
  28. Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13:55–80Google Scholar

Copyright information

© Springer-Verlag 1993

Authors and Affiliations

  • Hung-Jen Chang
    • 1
  • Joydeep Ghosh
    • 1
  1. 1.Department of Electrical and Computer EngineeringThe University of Texas at AustinAustinUSA

Personalised recommendations