Second order spiking perceptrons
According to the diffusion approximation and usual approximation scheme, we present two more biologically plausible so called second order spiking perceptron (SOSP) and extended second order spiking perceptron (ESOSP) based on the integrate-and-fire model with renewal process inputs, which employ both first and second statistical representation, i.e., the means, variances and correlations of the synaptic input. We show through various examples that such perceptrons, even a single neuron, are able to perform various complex non-linear tasks like the XOR problem, which is impossible to be solved by traditional single-layer perceptrons. Here our perceptrons offer a significant advantage over classical models, in that they include the second order statistics in computations, specially in that the ESOSP considers the learning of variance in the training. Our ultimate purpose is to open up the possibility of carrying out a stochastic computation in neuronal networks.
KeywordsIntegrate-and-fire Renewal process input Second order statistics Non-linear discrimination
The authors would like to thank the any anonymous referees for their useful comments and suggestions. This work was partially supported by National Natural Science Foundation of China (10571051) and Scientific Research Fund of Hunan Provincial Education Department (08C588).
- Feng JF (2003) Computational neuroscience—a comprehensive approach. CRC Press, Chapman-HallGoogle Scholar
- Gerstner W, Kistler W (2003) Spiking neuron models. Cambridge University Press, CambridgeGoogle Scholar
- Leng G, Brown CH, Bull PM et al (2001) Responses of magnocellular neurons to osmotic stimulation involves coactivation of excitatory and inhibitory input: an experimental and theoretical analysis. J Neurosci 21:6967–6977Google Scholar
- Matthews PBC (1996) Relationship of firing intervals of human motor units to the trajectory of post-spike after-hyperpolarization and synaptic noise. J Physiol 492:596–628Google Scholar
- Pavlidis NG, Tasoulis DK, Plagianakos VP et al (2005) Neural network training using evolutionary algorithms. In: Proceedings of international joint conference on neural networks (IJCNN’05)Google Scholar
- Tuckwell HC (1988) Introduction to theoretical neurobiology. Cambridge University Press, CambridgeGoogle Scholar