# A normative approach to neuromotor control

## Abstract

While we can readily observe and model the dynamics of our limbs, analyzing the neurons that drive movement is not nearly as straightforward. As a result, their role in motor behavior (e.g., forward models, state estimators, controllers, etc.) remains elusive. Computational explanations of electrophysiological data often rely on firing rate models or deterministic spiking models. Yet neither can accurately describe the interactions of neurons that issue spikes, probabilistically. Here we take a normative approach by designing a probabilistic spiking network to implement LQR control for a limb model. We find typical results: cosine tuning curves, population vectors that correlate with reaching directions, low-dimensional oscillatory activity for reaches that have no oscillatory movement, and changes in neuron’s tuning curves after force field adaptation. Importantly, while the model is consistent with these empirically derived correlations, we can also analyze it in terms of the known causal mechanism: an LQR controller and the probability distributions of the neurons that encode it. Redesigning the system under a different set of assumptions (e.g. a different controller, or network architecture) would yield a new set of testable predictions. We suggest this normative approach can be a framework for examining the motor system, providing testable links between observed neural activity and motor behavior.

## Keywords

Spiking neural network Normative modeling Motor control Tuning curves## References

- Amirikian B, Georgopoulos AP (2000) Directional tuning profiles of motor cortical cells. Neruosci Res 36(1):73–79CrossRefGoogle Scholar
- Bourdoukan R, Barrett D, Denève S, Machens CK (2012) Learning optimal spike-based representations. In: Advances in neural information processing systems, pp 2285–2293Google Scholar
- Churchland MM, Cunningham JP, Kaufman MT, Foster JD, Nuyujukian P, Ryu SI, Shenoy KV (2012) Neural population dynamics during reaching. Nature 487:51CrossRefGoogle Scholar
- Corcos DM, Gottlieb GL, Agarwal GC (1989) Organizing principles for single-joint movements. II. A speed-sensitive strategy. J Neurophysiol 62(2):358–368CrossRefGoogle Scholar
- Denève S, Alemi A, Bourdoukan R (2017) The brain as an efficient and robust adaptive learner. Neuron 94:969–977CrossRefGoogle Scholar
- DeWolf T (2016) A spiking neural model of adaptive arm control. Proc R Soc B 283:20162134CrossRefGoogle Scholar
- Georgopoulos AP (1982) On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neurosci 2:1527–1537CrossRefGoogle Scholar
- Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416–1419CrossRefGoogle Scholar
- Jordan MI, Gharamani Z, Jaakkola TS, Saul LK (1999) An introduction to variational methods for graphical models. Mach Learn 37:183–223CrossRefGoogle Scholar
- Kuo AD (1995) An optimal control model for analyzing human postural balance. IEEE Trans Biomed Eng 42:87–101CrossRefGoogle Scholar
- Laje R, Buonomano DV (2013) Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat Neurosci 16(7):925CrossRefGoogle Scholar
- Le Quoc V (2012) Building high-level features using large scale unsupervised learning. In: IEEE international conference on acoustics, speech and signal processing (ICASSP)Google Scholar
- Li CSR, Padoa-Schioppa C, Bizzi E (2001) Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field. Neuron 30:593–607CrossRefGoogle Scholar
- Mante V, Sussillo D, Shenoy KV, Newsome WT (2013) Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78–84CrossRefGoogle Scholar
- Moreno-Bote R (2014) Poisson-like spiking in circuits with probabilistic synapses. PLoS Comput Biol 10:1003522CrossRefGoogle Scholar
- Mutha PK, Sainburg RL (2007) Control of velocity and position in single joint movements. Hum Mov Sci 26(6):808–823CrossRefGoogle Scholar
- Nagasaki H (1989) Asymmetric velocity and acceleration profiles of human arm movements. Exp Brain Res 74(2):319–326CrossRefGoogle Scholar
- Neal RM (1990) Learning stochastic feedforward networks. Technical Report. CRG-TR-90-7, Connectionist Research Group, Department of Computer Science, University of Toronto, OntarioGoogle Scholar
- Padoa-Schioppa C, Li CSR, Bizzi E (2004) Neuronal activity in the supplementary motor area of monkeys adapting to a new dynamic environment. J Neurophysiol 91:449–473CrossRefGoogle Scholar
- Rumelhart DE, Hinton GE, Williams RJ (1985) Learning internal representations by error propagation (No. ICS-8506). California Univ, San Diego, La Jolla Inst for Cognitive ScienceGoogle Scholar
- Scott SH (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5:532CrossRefGoogle Scholar
- Sussillo D, Abbott LF (2009) Generating coherent patterns of activity from chaotic neural networks. Neuron 63:544–557CrossRefGoogle Scholar
- Sussillo D, Barak O (2013) Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks. Neural Comput 25:626–649CrossRefGoogle Scholar
- Thalmeier D, Uhlmann M, Kappen HJ, Memmesheimer RM (2016) Learning universal computations with spikes. PLoS Comput Biol 12(6):e1004895CrossRefGoogle Scholar
- Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci 7:907CrossRefGoogle Scholar
- Walden RH (1999) Analog-to-digital converter survey and analysis. IEEE J Sel Areas Commun 17(4):539–550CrossRefGoogle Scholar