Going Beyond a Mean-field Model for the Learning Cortex: Second-Order Statistics
- 52 Downloads
Mean-field models of the cortex have been used successfully to interpret the origin of features on the electroencephalogram under situations such as sleep, anesthesia, and seizures. In a mean-field scheme, dynamic changes in synaptic weights can be considered through fluctuation-based Hebbian learning rules. However, because such implementations deal with population-averaged properties, they are not well suited to memory and learning applications where individual synaptic weights can be important. We demonstrate that, through an extended system of equations, the mean-field models can be developed further to look at higher-order statistics, in particular, the distribution of synaptic weights within a cortical column. This allows us to make some general conclusions on memory through a mean-field scheme. Specifically, we expect large changes in the standard deviation of the distribution of synaptic weights when fluctuation in the mean soma potentials are large, such as during the transitions between the “up” and “down” states of slow-wave sleep. Moreover, a cortex that has low structure in its neuronal connections is most likely to decrease its standard deviation in the weights of excitatory to excitatory synapses, relative to the square of the mean, whereas a cortex with strongly patterned connections is most likely to increase this measure. This suggests that fluctuations are used to condense the coding of strong (presumably useful) memories into fewer, but dynamic, neuron connections, while at the same time removing weaker (less useful) memories.
KeywordsMean-field Cortex Memory Learning Modelling
Unable to display preview. Download preview PDF.
- 3.Freeman, W.J.: Predictions on neocortical dynamics derived from studies in paleocortex. In: Basar, E., Bullock, T.H. (eds.) Induced Rhythms of the Brain, chap. 9, pp. 183–199. Birkhaeuser, Boston (1992)Google Scholar
- 12.Bazhenov, M., Timofeev, I., Steriade, M., Sejnowski, T.J.: Model of thalamocortical slow-wave sleep oscillations and transitions to activated states. J. Neurosci. 22, 8691–8704 (2002)Google Scholar
- 16.Robinson, P.A., Rennie, C.J., Wright, J.J., Bahramali, H., Gordon, E., Rowe, D.L.: Prediction of electroencephalographic spectra from neurophysiology. Phys. Rev. E 63, 021,903 (2001)Google Scholar
- 20.Bienenstock, E.L., Cooper, L.N., Munro, P.W.: Theory for the development of neuron selectivity: orientation specificity and binocular interation in visual cortex. J. Neurosci. 2, 32–48 (1982)Google Scholar
- 24.Hebb, D.O.: The Organization of Behaviour. Wiley, New York (1949)Google Scholar
- 27.Steyn-Ross, D.A., Steyn-Ross, M.L., Sleigh, J.W., Wilson, M.T., Gillies, I.P., Wright, J.J.: The sleep cycle modelled as a cortical phase transition. J. Biophys. 31, 547–569 (2005)Google Scholar
- 35.Kloeden, P.E., Platen, E.: Numerical Solution of Stochastc Differential Equations. Springer, Berlin (1992)Google Scholar
- 43.Steriade, M., Núnez, A., Amzica, F.: A novel slow (<1 Hz) oscillation of neocortical neurons in vivo: depolarizing and hyperpolarizing components. J. Neurosci. 13, 3252–3265 (1993)Google Scholar
- 46.Steriade, M., Timofeev, I., Grenier, F.: Natural waking and sleep states: a view from inside neocortical neurons. J. Neurophysiol. 85, 1969–1985 (2001)Google Scholar