Journal of Computational Neuroscience

, Volume 8, Issue 1, pp 19–50 | Cite as

A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning

  • Duane Q. Nykamp
  • Daniel Tranchina


We explore a computationally efficient method of simulating realistic networks of neurons introduced by Knight, Manin, and Sirovich (1996) in which integrate-and-fire neurons are grouped into large populations of similar neurons. For each population, we form a probability density that represents the distribution of neurons over all possible states. The populations are coupled via stochastic synapses in which the conductance of a neuron is modulated according to the firing rates of its presynaptic populations. The evolution equation for each of these probability densities is a partial differential-integral equation, which we solve numerically. Results obtained for several example networks are tested against conventional computations for groups of individual neurons.

We apply this approach to modeling orientation tuning in the visual cortex. Our population density model is based on the recurrent feedback model of a hypercolumn in cat visual cortex of Somers et al. (1995). We simulate the response to oriented flashed bars. As in the Somers model, a weak orientation bias provided by feed-forward lateral geniculate input is transformed by intracortical circuitry into sharper orientation tuning that is independent of stimulus contrast.

The population density approach appears to be a viable method for simulating large neural networks. Its computational efficiency overcomes some of the restrictions imposed by computation time in individual neuron simulations, allowing one to build more complex networks and to explore parameter space more easily. The method produces smooth rate functions with one pass of the stimulus and does not require signal averaging. At the same time, this model captures the dynamics of single-neuron activity that are missed in simple firing-rate models.

neural networks modeling population density orientation tuning visual cortex 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abbott LF, van Vreeswijk C (1993) Asynchronous states in networks of pulse-coupled oscillators. Phys. Rev. E 48:1483-1490.Google Scholar
  2. Adorján P, Barna G, Érdi P, Obermayer K (1999) A statistical neural field approach to orientation selectivity. Neurocomputing, 26-27:477-482.Google Scholar
  3. Amari S (1974) A method of statistical neurodynamics. Kybernetik 14:201-215.Google Scholar
  4. Barna G, Gröbler T, Érdi P (1998) Statistical model of the hippocampal CA3 region, II. The population framework: Model of rhythmic activity in the CA3 slice. Biol. Cybern. 79:309-321.Google Scholar
  5. Ben-Yishai R, Lev Bar-Or R, Sompolinsky H (1995) Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. USA 92:3844-3848.Google Scholar
  6. Brunel N, Hakim V (1999) Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Comput. 11:1621-1671.Google Scholar
  7. Carandini M, Ringach D (1997) Predictions of a recurrent model of orientation selectivity. Vision Res. 21:3061-3071.Google Scholar
  8. Chawanya T, Aoyagi A, Nishikawa I, Okuda K, Kuramoto Y (1993) A model for feature linking via collective oscillations in the primary visual cortex. Biol. Cybern. 68:483-490.Google Scholar
  9. Çinlar E (1972) Superposition of point processes. In PAW Lewis, ed. Stochastic Point Processes: Statistical Analysis, Theory, and Applications. Wiley, New York, NY. pp. 549-606.Google Scholar
  10. Crank J, Nicolson P (1947) A practical method for numerical evaluation of solutions for partial differential equations of the heat conduction type. Proc. Camb. Philos. Sco. 43:50-67.Google Scholar
  11. Gerstner W (1995) Time structure of the activity in neural network models. Phys. Rev. E 51:738-758.Google Scholar
  12. Gerstner W (1999) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput. (to appear).Google Scholar
  13. Gerstner W, van Hemmen JL (1994) Coding and information processing in neural networks. In E Domany, JL van Hemmen, K Schulten, eds. Models of Neural Networks II. Springer-Verlag, New York, NY. pp. 1-93.Google Scholar
  14. Hansel D, Sompolinsky H (1996) Chaos and synchrony in a model of a hypercolumn in visual cortex. J. Comp. Neurosci. 3:7-34.Google Scholar
  15. Howe JR, Sutor B, Zieglgansberger W (1987) Baclofen reduces post-synaptic potentials of rat cortical neurones by an action other than its hyperpolarizing action. J. Physiology 384:539-569.Google Scholar
  16. Knight BW (1972a) Dynamics of encoding in a population of neurons. J. Gen. Physiol. 59:734-766.Google Scholar
  17. Knight BW (1972b) The relationship between the firing rate of a single neuron and the level of activity in a population of neurons: Experimental evidence for resonant enhancement in the population response. J. Gen. Physiol. 59:767-778.Google Scholar
  18. Knight BW (2000) Dynamics of encoding in neuron populations: Some general mathematical features. Neural Comput. (to appear).Google Scholar
  19. Knight BW, Manin D, Sirovich L (1996) Dynamical models of interacting neuron populations. In EC Gerf, ed. Symposium on Robotics and Cybernetics: Computational Engineering in Systems Applications. Cite Scientifique, Lille, France.Google Scholar
  20. Kuramoto Y (1991) Collective synchronization of pulse-coupled oscillators and excitable units. Physica D 50:15-30.Google Scholar
  21. Omurtag A, Knight BW, Sirovich L (2000) On the simulation of large populations of neurons. J. Comp. Neurosci. 8:51-53.Google Scholar
  22. Pham J, Pakdaman K, Champagnat J, Vibert JF (1998) Activity in sparsely connected excitatory neural networks: Effect of connectivity. Neural Networks 11:415-434.Google Scholar
  23. Shapley R, Sompolinsky H (1997) New perspectives on the mechanisms for orientation selectivity. Curr. Op. Biol. 7:514-522.Google Scholar
  24. Sirovich L, Knight BW, Omurtag A (1999) Dynamics of neuronal populations: The equilibrium solution. SIAM (to appear).Google Scholar
  25. Somers DC, Nelson SB, Sur M (1995) An emergent model of orientation selectivity in cat visual cortical simple cells. J. Neurosci. 15:5448-5465.Google Scholar
  26. Strogatz SH, Mirollo RE (1991) Stability of incoherence in a population of coupled oscillators. J. Stat. Phys. 63:613-635.Google Scholar
  27. Tanabe S, Pakdaman K, Nomura T, Sato S (1998) Dynamics of an ensemble of leaky integrate-and-fire neuron models and its response to a pulse input. Technical Report of IEICE, NLP98-14:41-48.Google Scholar
  28. Treves A (1993) Mean-field analysis of neuronal spike dynamics. Network 4:259-284.Google Scholar
  29. Tuckwell HC (1988) Introduction to Theoretic Neurobiology. Cambridge University Press, New York, NY. Vol. 2, pp. 111-189.Google Scholar
  30. Victor JD (1987) The dynamics of the cat retinal X cell centre. J. Physiol. 386:219-246.Google Scholar
  31. Wilbur WJ, Rinzel J (1983) A theoretical basis for large coefficient of variation and bimodality in neuronal interspike interval distributions. J. Theor. Biol. 105:345-368.Google Scholar
  32. Wilson HR, Cowan JD (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical J. 12:1-24.Google Scholar
  33. Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik13:55-80.Google Scholar

Copyright information

© Kluwer Academic Publishers 2000

Authors and Affiliations

  • Duane Q. Nykamp
    • 1
  • Daniel Tranchina
    • 2
  1. 1.Courant Institute of Mathematical SciencesNew York UniversityNew York
  2. 2.Department of Biology, Courant Institute of Mathematical Sciences, and Center for Neural ScienceNew York UniversityNew York

Personalised recommendations