Advertisement

Biological Cybernetics

, Volume 113, Issue 1–2, pp 179–190 | Cite as

Spiking networks as efficient distributed controllers

  • Fuqiang HuangEmail author
  • ShiNung Ching
Original Article
  • 110 Downloads

Abstract

In the brain, networks of neurons produce activity that is decoded into perceptions and actions. How the dynamics of neural networks support this decoding is a major scientific question. That is, while we understand the basic mechanisms by which neurons produce activity in the form of spikes, whether these dynamics reflect an overlying functional objective is not understood. In this paper, we examine neuronal dynamics from a first-principles control-theoretic viewpoint. Specifically, we postulate an objective wherein neuronal spiking activity is decoded into a control signal that subsequently drives a linear system. Then, using a recently proposed principle from theoretical neuroscience, we optimize the production of spikes so that the linear system in question achieves reference tracking. It turns out that such optimization leads to a recurrent network architecture wherein each neuron possess integrative dynamics. The network amounts to an efficient, distributed event-based controller where each neuron (node) produces a spike if doing so improves tracking performance. Moreover, the dynamics provide inherent robustness properties, so that if some neurons fail, others will compensate by increasing their activity so that the tracking objective is met.

Keywords

Spiking networks Neural networks Decoding Event-based control 

References

  1. 1.
    Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5(11):1226–1235CrossRefGoogle Scholar
  2. 2.
    Paul JW (1989) Neural networks for control and system identification. In: Proceedings of the 28th IEEE conference on decision and control, 1989. IEEE, pp 260–265Google Scholar
  3. 3.
    Narendra KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1(1):4–27CrossRefGoogle Scholar
  4. 4.
    Eliasmith C, Anderson CH (2004) Neural engineering: computation, representation, and dynamics in neurobiological systems. MIT press, CambridgeGoogle Scholar
  5. 5.
    Hunt KJ, Sbarbaro D, Zbikowski R, Gawthrop PJ (1992) Neural networks for control systems—a survey. Automatica 28(6):1083–1112CrossRefGoogle Scholar
  6. 6.
    Miller WT, Werbos PJ, Sutton RS (1995) Neural networks for control. MIT press, CambridgeCrossRefGoogle Scholar
  7. 7.
    Lewis FW, Jagannathan S, Yesildirak A (1998) Neural network control of robot manipulators and non-linear systems. CRC Press, Boca RatonGoogle Scholar
  8. 8.
    Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3(3):127–149CrossRefGoogle Scholar
  9. 9.
    Bialek W, Rieke F, Van Steveninck De Ruyter RR, Warland D (1991) Reading a neural code. Science 252(5014):1854–1857CrossRefGoogle Scholar
  10. 10.
    Abbott LF, DePasquale B, Memmesheimer R-M (2016) Building functional networks of spiking model neurons. Nat Neurosci 19(3):350–355CrossRefGoogle Scholar
  11. 11.
    Rao RPN, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2(1):79CrossRefGoogle Scholar
  12. 12.
    Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, Friston KJ (2012) Canonical microcircuits for predictive coding. Neuron 76(4):695–711CrossRefGoogle Scholar
  13. 13.
    Boerlin M, Denève S (2011) Spike-based population coding and working memory. PLoS Comput Biol 7(2):e1001080CrossRefGoogle Scholar
  14. 14.
    Martin B, Christian KM, Sophie D (2013) Predictive coding of dynamical variables in balanced spiking networks. PLoS Comput Biol 9(11):e1003258CrossRefGoogle Scholar
  15. 15.
    Fuqiang H, James R, ShiNung C (2017) Optimizing the dynamics of spiking networks for decoding and control. In: American control conference (ACC), 2017. IEEE, pp 2792–2798Google Scholar
  16. 16.
    Abbott LF (1999) Lapicque’s introduction of the integrate-and-fire model neuron (1907). Brain Res Bull 50(5–6):303–304CrossRefGoogle Scholar
  17. 17.
    Bekolay T, Bergstra J, Hunsberger E, DeWolf T, Stewart TC, Rasmussen D, Choo X, Voelker A, Eliasmith C (2014) Nengo: a python tool for building large-scale functional brain models. Front Neuroinf 7:48CrossRefGoogle Scholar
  18. 18.
    Waegeman T, Schrauwen B et al (2012) Feedback control by online learning an inverse model. IEEE Trans Neural Netw Learn Syst 23(10):1637–1648CrossRefGoogle Scholar
  19. 19.
    Olfati-Saber R, Fax JA, Murray RM (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233CrossRefGoogle Scholar
  20. 20.
    Seuret A, Prieur C, Tarbouriech S, Zaccarian L (2016) Lq-based event-triggered controller co-design for saturated linear systems. Automatica 74:47–54CrossRefGoogle Scholar
  21. 21.
    Peter D, Abbott LF (2001) Theoretical neuroscience, vol 10. MIT Press, CambridgeGoogle Scholar
  22. 22.
    Kalman RE (1963) Mathematical description of linear dynamical systems. J Soc Ind Appl Math Ser A Control 1(2):152–192CrossRefGoogle Scholar
  23. 23.
    Johnson EC, Jones DL, Ratnam R (2016) A minimum-error, energy-constrained neural code is an instantaneous-rate code. J Comput Neurosci 40(2):193–206CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.The Department of Electrical and Systems EngineeringWashington UniversitySt. LouisUSA

Personalised recommendations