Advertisement

Towards Deterministic and Stochastic Computations with the Izhikevich Spiking-Neuron Model

  • Ramin M. Hasani
  • Guodong Wang
  • Radu Grosu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10306)

Abstract

In this paper we analyze simple computations with spiking neural networks (SNN), laying the foundation for more sophisticated calculations. We consider both a deterministic and a stochastic computation framework with SNNs, by utilizing the Izhikevich neuron model in various simulated experiments. Within the deterministic-computation framework, we design and implement fundamental mathematical operators such as addition, subtraction, multiplexing and multiplication. We show that cross-inhibition of groups of neurons in a winner-takes-all (WTA) network-configuration produces considerable computation power and results in the generation of selective behavior that can be exploited in various robotic control tasks. In the stochastic-computation framework, we discuss an alternative computation paradigm to the classic von Neumann architecture, which supports information storage and decision making. This paradigm uses the experimentally-verified property of networks of randomly connected spiking neurons, of storing information as a stationary probability distribution in each of the sub-network of the SNNs. We reproduce this property by simulating the behavior of a toy-network of randomly-connected stochastic Izhikevich neurons.

Notes

Acknowledgments

This work was partially supported by the NSF-Frontiers CyberCardia Award, FWF-NFN RiSE Award, FWF-DC LMCS Award, FFG Harmonia Award, FFG Em2Apps Award, and the TUW CPPS-DK Award.

References

  1. 1.
    Herz, A.V.M., Gollisch, T., Machens, C.K., Jaeger, D.: Modeling single-neuron dynamics and computations: a balance of detail and abstraction. Science 314(5796), 80–85 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Abbott, L.F., Kepler, T.B.: Model neurons: from Hodgkin-huxley to hopfield. In: Garrido, L. (ed.) Statistical Mechanics of Neural Networks. LNP, vol. 368, pp. 5–18. Springer, Heidelberg (1990)CrossRefGoogle Scholar
  3. 3.
    Izhikevich, E.M.: Which model to use for cortical spiking neurons. IEEE Trans. Neural Netw. 15, 1063–1070 (2004)CrossRefGoogle Scholar
  4. 4.
    Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500 (1952)CrossRefGoogle Scholar
  5. 5.
    Koch, C., Segev, I.: Methods in Neuronal Modeling: From Ions to Networks. MIT Press, Cambridge (1998)Google Scholar
  6. 6.
    Izhikevich, E.M.: Simple model of spiking neurons. IEEE Trans. Neural Netw. 14, 1569–1572 (2003)CrossRefGoogle Scholar
  7. 7.
    Schutter, E.D.: Computational Modeling Methods for Neuroscientists. The MIT Press, Cambridge (2009)CrossRefzbMATHGoogle Scholar
  8. 8.
    Pfeil, T., Grubl, A., Jeltsch, S., Muller, E., Muller, P., Petrovici, M.A., Schmuker, M., Bruderle, D., Schemmel, J., Meier, K.: Six networks on a universal neuromorphic computing substrate. arXiv preprint arXiv:1210.7083 (2012)
  9. 9.
    McDonnell, M.D., Boahen, K., Ijspeert, A., Sejnowski, T.J.: Engineering intelligent electronic systems based on computational neuroscience [scanning the issue]. Proc. IEEE 102(5), 646–651 (2014)CrossRefGoogle Scholar
  10. 10.
    Benjamin, B.V., Gao, P., McQuinn, E., Choudhary, S., Chandrasekaran, A.R., Bussat, J.-M., Alvarez-Icaza, R., Arthur, J.V., Merolla, P.A., Boahen, K.: Neurogrid: a mixed-analog-digital multichip system for large-scale neural simulations. Proc. IEEE 102(5), 699–716 (2014)CrossRefGoogle Scholar
  11. 11.
    Maass, W.: Noise as a resource for computation and learning in networks of spiking neurons. Proc. IEEE 102(5), 860–880 (2014)CrossRefGoogle Scholar
  12. 12.
    Hasani, R.M.: Design of CMOS silicon neurons for noise assisted computations in spiking neural networks. Politesi Digital Library of PhD and Post Graduate Theses, Politecnico di Milano (2015)Google Scholar
  13. 13.
    Hasani, R.M., Ferrari, G., Yamamoto, H., Kono, S., Ishihara, K., Fujimori, S., Tanii, T., Prati, E.: Control of the correlation of spontaneous neuron activity in biological and noise-activated CMOS artificial neural icrocircuits. arXiv preprint arXiv:1702.07426 (2017)
  14. 14.
    Magee, J.C.: Dendritic ih normalizes temporal summation in hippocampal CA1 neurons. Nat. Neurosci. 2(6), 508–514 (1999)CrossRefGoogle Scholar
  15. 15.
    Maass, W.: On the computational power of winner-take-all. Neural Comput. 12(11), 2519–2535 (2000)CrossRefGoogle Scholar
  16. 16.
    Habenschuss, S., Jonke, Z., Maass, W.: Stochastic computations in cortical microcircuit models. PLoS Comput. Biol. 9(11), e1003311 (2013)CrossRefGoogle Scholar
  17. 17.
    Jones, P.W., Gabbiani, F.: Logarithmic compression of sensory signals within the dendritic tree of a collision-sensitive neuron. J. Neurosci. 32(14), 4923–4934 (2012)CrossRefGoogle Scholar
  18. 18.
    Vul, E., Pashler, H.: Measuring the crowd within probabilistic representations within individuals. Psychol. Sci. 19(7), 645–647 (2008)CrossRefGoogle Scholar
  19. 19.
    Tenenbaum, J.B., Kemp, C., Griffiths, T.L., Goodman, N.D.: How to grow a mind: statistics, structure, and abstraction. Science 331(6022), 1279–1285 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Jonke, Z., Habenschuss, S., Maass, W.: Solving constraint satisfaction problems with networks of spiking neurons. Front. Neurosci. 10, 118 (2016)CrossRefGoogle Scholar
  21. 21.
    Binas, J., Indiveri, G., Pfeiffer, M.: Spiking analog VLSI neuron assemblies as constraint satisfaction problem solvers. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 2094–2097. IEEE (2016)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Cyber Physical Systems Group, Institute of Computer EngineeringVienna University of TechnologyViennaAustria

Personalised recommendations