Cooperative Motor Learning Model for Cerebellar Control of Balance and Locomotion
A computational model in the framework of reinforcement learning, called Cooperative Motor Learning (CML) model, is proposed to realize cerebellar control of balance and locomotion. In the CML model, cerebellum is a parallel pathway that the vermis and the flocculonodular lobe play a role of reflex actions executor, and that the intermediate zone of the cerebellum participates in initiating voluntary actions. During the training phase, the cerebral cortex provides the predictive error through climbing fiber to modulate the concurrently activated synapses between parallel fibers and purkinje cells. Meanwhile, the intermediate zone of the cerebellum computes the temporal difference (TD) error as a training signal for the cerebral cortex. In the simulation experiment for the balance of double inverted pendulum on a cart, a well-trained CML model can smoothly push the pendulum into the equilibrium position.
KeywordsCerebral Cortex Purkinje Cell Reinforcement Learning Intermediate Zone Parallel Fiber
Unable to display preview. Download preview PDF.
- 2.Marr, D.: A Theory of Cerebellar Cortex. Journal of Physiology 202, 437–470 (1969)Google Scholar
- 11.Houk, J.C., Buckingham, J.T., Barto, A.G.: Models of the Cerebellum and Motor Learning. Behavioral and Brain Sciences 19, 368–383 (1996)Google Scholar
- 14.Stein, J.F., Glickstein, M.: Role of The Cerebellum in Visual Guidance of Movement. Physiological Reviews 74, 967–1017 (1992)Google Scholar
- 17.Barto, A.G., Sutton, R.S., Anderson, C.: Neuron-like Adaptive Elements That Can Solve Difficult Learning Control Problems. IEEE Transactions on Systems, Man, and Cybernetics 13, 834–846 (1983)Google Scholar