Advertisement

Biological Cybernetics

, Volume 113, Issue 1–2, pp 83–92 | Cite as

A normative approach to neuromotor control

  • Max BernikerEmail author
  • Steven Penny
Original Article

Abstract

While we can readily observe and model the dynamics of our limbs, analyzing the neurons that drive movement is not nearly as straightforward. As a result, their role in motor behavior (e.g., forward models, state estimators, controllers, etc.) remains elusive. Computational explanations of electrophysiological data often rely on firing rate models or deterministic spiking models. Yet neither can accurately describe the interactions of neurons that issue spikes, probabilistically. Here we take a normative approach by designing a probabilistic spiking network to implement LQR control for a limb model. We find typical results: cosine tuning curves, population vectors that correlate with reaching directions, low-dimensional oscillatory activity for reaches that have no oscillatory movement, and changes in neuron’s tuning curves after force field adaptation. Importantly, while the model is consistent with these empirically derived correlations, we can also analyze it in terms of the known causal mechanism: an LQR controller and the probability distributions of the neurons that encode it. Redesigning the system under a different set of assumptions (e.g. a different controller, or network architecture) would yield a new set of testable predictions. We suggest this normative approach can be a framework for examining the motor system, providing testable links between observed neural activity and motor behavior.

Keywords

Spiking neural network Normative modeling Motor control Tuning curves 

References

  1. Amirikian B, Georgopoulos AP (2000) Directional tuning profiles of motor cortical cells. Neruosci Res 36(1):73–79CrossRefGoogle Scholar
  2. Bourdoukan R, Barrett D, Denève S, Machens CK (2012) Learning optimal spike-based representations. In: Advances in neural information processing systems, pp 2285–2293Google Scholar
  3. Churchland MM, Cunningham JP, Kaufman MT, Foster JD, Nuyujukian P, Ryu SI, Shenoy KV (2012) Neural population dynamics during reaching. Nature 487:51CrossRefGoogle Scholar
  4. Corcos DM, Gottlieb GL, Agarwal GC (1989) Organizing principles for single-joint movements. II. A speed-sensitive strategy. J Neurophysiol 62(2):358–368CrossRefGoogle Scholar
  5. Denève S, Alemi A, Bourdoukan R (2017) The brain as an efficient and robust adaptive learner. Neuron 94:969–977CrossRefGoogle Scholar
  6. DeWolf T (2016) A spiking neural model of adaptive arm control. Proc R Soc B 283:20162134CrossRefGoogle Scholar
  7. Georgopoulos AP (1982) On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neurosci 2:1527–1537CrossRefGoogle Scholar
  8. Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416–1419CrossRefGoogle Scholar
  9. Jordan MI, Gharamani Z, Jaakkola TS, Saul LK (1999) An introduction to variational methods for graphical models. Mach Learn 37:183–223CrossRefGoogle Scholar
  10. Kuo AD (1995) An optimal control model for analyzing human postural balance. IEEE Trans Biomed Eng 42:87–101CrossRefGoogle Scholar
  11. Laje R, Buonomano DV (2013) Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat Neurosci 16(7):925CrossRefGoogle Scholar
  12. Le Quoc V (2012) Building high-level features using large scale unsupervised learning. In: IEEE international conference on acoustics, speech and signal processing (ICASSP)Google Scholar
  13. Li CSR, Padoa-Schioppa C, Bizzi E (2001) Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field. Neuron 30:593–607CrossRefGoogle Scholar
  14. Mante V, Sussillo D, Shenoy KV, Newsome WT (2013) Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78–84CrossRefGoogle Scholar
  15. Moreno-Bote R (2014) Poisson-like spiking in circuits with probabilistic synapses. PLoS Comput Biol 10:1003522CrossRefGoogle Scholar
  16. Mutha PK, Sainburg RL (2007) Control of velocity and position in single joint movements. Hum Mov Sci 26(6):808–823CrossRefGoogle Scholar
  17. Nagasaki H (1989) Asymmetric velocity and acceleration profiles of human arm movements. Exp Brain Res 74(2):319–326CrossRefGoogle Scholar
  18. Neal RM (1990) Learning stochastic feedforward networks. Technical Report. CRG-TR-90-7, Connectionist Research Group, Department of Computer Science, University of Toronto, OntarioGoogle Scholar
  19. Padoa-Schioppa C, Li CSR, Bizzi E (2004) Neuronal activity in the supplementary motor area of monkeys adapting to a new dynamic environment. J Neurophysiol 91:449–473CrossRefGoogle Scholar
  20. Rumelhart DE, Hinton GE, Williams RJ (1985) Learning internal representations by error propagation (No. ICS-8506). California Univ, San Diego, La Jolla Inst for Cognitive ScienceGoogle Scholar
  21. Scott SH (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5:532CrossRefGoogle Scholar
  22. Sussillo D, Abbott LF (2009) Generating coherent patterns of activity from chaotic neural networks. Neuron 63:544–557CrossRefGoogle Scholar
  23. Sussillo D, Barak O (2013) Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks. Neural Comput 25:626–649CrossRefGoogle Scholar
  24. Thalmeier D, Uhlmann M, Kappen HJ, Memmesheimer RM (2016) Learning universal computations with spikes. PLoS Comput Biol 12(6):e1004895CrossRefGoogle Scholar
  25. Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci 7:907CrossRefGoogle Scholar
  26. Walden RH (1999) Analog-to-digital converter survey and analysis. IEEE J Sel Areas Commun 17(4):539–550CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.University of Illinois at ChicagoChicagoUSA

Personalised recommendations