Regulation toward Self-organized Criticality in a Recurrent Spiking Neural Reservoir

  • Simon Brodeur
  • Jean Rouat
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7552)

Abstract

Generating stable yet performant spiking neural reservoirs for classification applications is still an open issue. This is due to the extremely non-linear dynamics of recurrent spiking neural networks. In this perspective, a local and unsupervised learning rule that tunes the reservoir toward self-organized criticality is proposed, and applied to networks of leaky integrate-and-fire neurons with random and small-world topologies. Longer sustained activity for both topologies was elicited after learning compared to spectral radius normalization (global rescaling scheme). The ability to control the desired regime of the reservoir was shown and quick convergence toward it was observed for speech signals. Proposed regulation method can be applied online and leads to reservoirs more strongly adapted to the task at hand.

Keywords

local plasticity unsupervised learning reservoir computing edge-of-chaos speech processing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Triefenbach, F., Jalalvand, A., Schrauwen, B., Martens, J.P.: Phoneme Recognition with Large Hierarchical Reservoirs. In: Proceedings of Advances in Neural Information Processing Systems, NIPS (2010)Google Scholar
  2. 2.
    Maass, W., Natschläger, T., Markram, H.: Fading memory and kernel properties of generic cortical microcircuit models. Journal of Physiology 98, 315–330 (2004)Google Scholar
  3. 3.
    Bertschinger, N., Natschläger, T.: Real-time computation at the edge of chaos in recurrent neural networks. Neural Computation 16, 1413–1436 (2004)MATHCrossRefGoogle Scholar
  4. 4.
    Schrauwen, B., Büsing, L., Legenstein, R.: On computational power and the order-chaos phase transition in reservoir computing. In: Proceedings of Advances in Neural Information Processing Systems, NIPS (2008)Google Scholar
  5. 5.
    Roeschies, B., Igel, C.: Structure optimization of reservoir networks. Logic Journal of IGPL 18, 635–669 (2009)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Verstraeten, D., Schrauwen, B., D’Haene, M., Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Networks 20, 391–403 (2007)MATHCrossRefGoogle Scholar
  7. 7.
    Kello, C.T., Mayberry, M.R.: Critical branching neural computation. In: Proceedings of International Joint Conference on Neural Networks, IJCNN (2010)Google Scholar
  8. 8.
    Kello, C.T., Kerster, B., Johnson, E.: Critical branching neural computation, neural avalanches, and 1/f scaling. In: Proceedings of the 33rd Annual Conference of the Cognitive Science Society (2011)Google Scholar
  9. 9.
    Goodman, D.F.M., Brette, R.: The brian simulator. Frontiers in Neuroscience 3, 192–197 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Simon Brodeur
    • 1
  • Jean Rouat
    • 1
  1. 1.NECOTIS, GEGIUniv. de SherbrookeCanada

Personalised recommendations