Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex
- 6.1k Downloads
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field.
KeywordsBasal ganglia cerebellum anatomical link Nucleo-olivary inhibition Movement disorders Parkinson’s disease tremor Cerebellar motor and cognitive function Non-invasive brain stimulation
The cerebellum works in concert with cortex and the basal ganglia as a fundamental building block in motor and cognitive tasks of various complexity, from sensorimotor mapping to reasoning [1, 2, 3, 4]. This systems-level view is increasingly supported by evidence demonstrating that the cerebellum and the basal ganglia receive input from, and send output to, different cortical areas through multisynaptic loops that have been assumed to be anatomically segregated and to perform distinct functional operations [5, 6, 7, 8, 9, 10]. Moreover, recent findings reveal the existence of an anatomical substrate for the bidirectional communication between cerebellum and basal ganglia. In particular, studies on rats  and monkeys  have demonstrated that the cerebellum sends a strong disynaptic projection to the striatum through the thalamus. Furthermore, recent studies in monkeys have shown that the subthalamic nucleus sends a disynaptic projection to the cerebellar cortex by way of the pontine nuclei . Similar evidence has been recently reported in the human brain .
These data have stimulated new research to investigate the reciprocal influence between these brain areas and the different forms of learning typically associated with them: supervised learning in the cerebellum based on plasticity of parallel fiber-Purkinje cell synapses [15, 16, 17]; unsupervised learning in the cortex based on associative Hebbian processes [18, 19, 20]; and trial-and-error (reinforcement learning) in the basal ganglia based on reward prediction errors computed at level of the striatum and depending on dopamine signals [21, 22]. Several recent studies have tried to integrate these apparently disconnected learning processes, focusing for example on the role of the cerebellum in regulating the plasticity of premotor and motor networks during sensorimotor learning [23, 24, 25, 26, 27]; the involvement of the cerebellum in the reinforcement learning processes underlying the computation of sensory and reward prediction errors during motor adaptation [28, 29, 30, 31, 32, 33]; the role of the cerebellum and basal ganglia in the cortical acquisition of high-level cognitive (non-motor) functions [1, 3, 4]; and the influence of cerebellum and basal ganglia on motor cortical plasticity in health and in Parkinson’s disease [34, 35]. Finally, data supporting a close interaction between cerebellar, basal ganglia, and cortical areas have recently stimulated new research on the role of cerebellum and basal ganglia in functions typically associated with cortical areas (e.g., action understanding ) and the role of cerebellar and cortical areas in impairments typically associated with basal ganglia, such as Tourette’s syndrome, dystonia, and Parkinson’s disease [36, 37, 38, 39, 40].
Despite this recent progress, we still lack a comprehensive framework that defines cerebellar function from a wider, systems-level perspective [4, 41, 42]. Viewing cerebellum, cortex, and basal ganglia as an integrated system could lead to understand their functional and learning processes in radically different ways. The goal of this consensus paper is to feed the discussion on the fundamental interactions between the functional and plasticity processes of cerebellum, cortex, and basal ganglia, conceived as forming an integrated system underlying several motor and cognitive functions.
Evidence of the interactions between the functional and learning processes in the cerebellum, cortex, and basal ganglia comes from different scientific disciplines and methodologies: from neurophysiology to computational modelling and from behavioral methods to neuropsychological and brain imaging approaches. Unfortunately, discussion between experts using these different approaches is often limited. We believe that a multi-methodological and multidisciplinary discussion is necessary to fully understand the integrated dynamics of the cerebellar-basal-ganglia-cortical system. This consensus paper offers an up-to-date overview on this discussion as it collects contributions from an interdisciplinary community of scientists actively involved in the investigation of cerebellum that provide a range of different, sometimes controversial, viewpoints.
The issue begins with the paper of Bostan and Strick that introduces and reviews the recent neurophysiological and neuroanatomical evidence on the cerebellar connections with the cerebral cortex and the basal ganglia.
The next two contributions, by Verschure et al. and by Jörntell, further expand the systems-level view of cerebellar interconnections supported by the analysis of the previous piece (by Bostan and Strick). Verschure et al. raise the fascinating possibility that the nucleo-olivary pathway balances the contribution of feedback (mediated by brain stem nuclei) and feed-forward (cerebellar) modes of motor control. Jörntell provides an overview of the spinal inputs into the cerebellum, discussing how these inputs allow the cerebellum to keep informed about the excitatory drive on low level motor functions. He thus proposes that the major role of the cerebellum is to allow many spinal inputs to be associated with one another in specific environmental contexts.
The contribution of Houk provides a theoretical, systems-level perspective of how the cerebellar-cortical and basal ganglia-cortical loops may interact to affect learning and control processes.
Along similar lines, the contribution of Doya elaborates his previous theory of motor control and learning, based on the idea that different brain areas implement different learning algorithms, to account for recent findings discussed by Bostan and Strick on the circuitry between the cerebellum and the basal ganglia.
Pivoting on recent empirical evidence, Miall suggests that the cerebellum may support a single operation, acting as a short-term predictor within the cerebellar-basal-ganglia-cortical system. He also discusses data on medium-term, post-learning, memory consolidation effects in this system.
Lago-Rodriguez and Galea summarize the importance of using non-invasive techniques (such as transcranial magnetic stimulation (TMS) or transcranial direct current stimulation (tDCS)) to investigate the causal role of the cerebellum in motor function and its interactions with other brain regions.
Finally, the last two papers provide some examples of the consequences of abnormal interactions between cerebellum, basal ganglia, and cortical systems. Popa and Kishore discuss data supporting how impaired cerebellar plasticity mechanisms could contribute to Parkinson’s disease and dyskinesia. Caligiore et al. build on recent data that suggest an involvement of cerebellum in Parkinson’s disease and discuss some cortical-subcortical circuits within the cerebellar-basal-ganglia-cortical network that could be involved in Parkinson’s resting tremor.
Taken together, these empirical and theoretical contributions offer readers a broad and up-to-date framework to describe the dynamic interplay between functioning and learning mechanisms in the cerebellum, basal ganglia, and cortex, pointing out the key open issues for future research. The final part of the article summarizes the main topics and analyzes the main elements of consensus—or lack of consensus among the authors. As discussed in the “Summary and conclusions” section, consensus exists on several key aspects of cerebellar-basal-ganglia-cortical function; at the same time, there are various topics that are still debated and where consensus cannot be reached yet, reflecting the relative novelty of the topic. These open points represent interesting and promising directions for future research.
Cerebellar Connections with the Cerebral Cortex and the Basal Ganglia (A.C. Bostan, P.L. Strick)
The classical view of cerebellar function has been that it is exclusively concerned with the control of movement through descending control and influence on the primary motor cortex (M1). The cerebellum was thought to receive information from multiple neocortical areas and funnel it back to M1 . More recent analyses of cerebellar outputs have resulted in a dramatic shift in the conceptualization of cerebellar function.
To date, all of the areas in the cerebral cortex that are targets of cerebellar output also have prominent projections to the cerebellar cortex via the pontine nuclei (Fig. 1a). Thin axon collaterals from approximately 20 % of ponto-cerebellar neurons reach the dentate nucleus  and may allow excitatory inputs from cortical areas, such as M1, to reach the dentate . Interestingly, areas of the cerebral cortex that lack substantial projections to the cerebellum (e.g., areas 46v, 12, and TE) do not appear to be major targets of cerebellar output. If these principles apply to all cerebro-cerebellar networks, then all of the areas of cerebral cortex that project to the cerebellum may be the targets of cerebellar output. This would include such diverse areas as regions of extrastriate cortex, cingulate cortex, and the parahippocampal gyrus [48, 49].
The distinct motor and non-motor domains observed in the dentate nucleus have their counterparts in cerebellar cortex (Fig. 1c, d). The motor domain includes a region primarily in the anterior lobe (lobules III–VI) and another in the paramedian lobule and adjacent cerebellar hemisphere (HVIIB and HVIII). These regions have been shown to both receive inputs from and send outputs to M1, forming a closed-loop circuit  (Fig. 1c). The non-motor domain is extensive and involves the portions of the posterior vermis and hemisphere that lie between the two regions of motor representation. Regions within the non-motor domain of cerebellar cortex also participate in distinct closed-loop circuits with regions of prefrontal cortex  (Fig. 1d). Thus, multiple closed-loop circuits represent a fundamental feature of interactions between the cerebellum and the cerebral cortex.
The evidence that cerebellar output influences multiple areas of prefrontal and posterior parietal cortex provides the anatomical substrate for a distinct cerebellar contribution to non-motor aspects of behavior . To date, most theories of cerebellar function are based on the understanding of cerebellar contributions to motor control [41, 51]. Further research is needed to determine the nature and full extent of cerebellar contributions to non-motor function.
Overall, neuroanatomical studies using virus transneuronal tracers have demonstrated that the output from the cerebellum reaches vast areas of the cerebral cortex, including regions of prefrontal and posterior parietal cortex. Furthermore, the cerebellum is reciprocally connected with the basal ganglia, indicating that the two subcortical structures are part of a densely interconnected network. These new results challenge us to discover both the entire range of behaviors that are influenced by this network and the neural computations it implements.
Regulating the Recruitment of the Cerebellum via the Nucleo-Olivary Inhibition (P.F.M.J. Verschure, R. Zucca, I. Herreros)
The Distributed Adaptive Control theory of mind and brain describes the brain as a multi-layered control system including the body, predefined reactive control, adaptive control for state space acquisition and action shaping, and lastly the contextual control for the generation of goal-oriented plans for action [53, 54]. This raises the specific question of how these different control layers interact. The study of the cerebellum allows us to investigate in detail how reactive and adaptive control systems are interfaced. In particular, the eyeblink conditioning paradigm allows the study of the integration of cerebellar predictive commands with brainstem level reactive feedback commands. Here, we discuss this interaction between cerebellum and these lower level reflexes with the idea that it can inform hypotheses about the interaction between the cerebellum and high-level structures of the central nervous system, such as cortex and basal ganglia. In eyeblink conditioning, a subject learns to respond with an anticipatory action—the so-called conditioned response (CR)—to a naturally neutral stimulus—the conditioned stimulus (CS)—that has been coupled through the experimental training with a blink-eliciting noxious stimulus—the unconditioned stimulus (US). Experimental evidence suggests that the cerebellum provides the substrate for CR acquisition [55, 56, 57, 58, 59, 60, 61, 62, 63] (but see  and Delgado-García in  for alternative views). In line with that hypothesis, it has been proposed that in eyeblink conditioning, the cerebellum substitutes reactive reflexes by anticipatory actions . However, a closer look at the resultant behavior reveals that, rather than totally replacing reactive feedback commands, feed-forward cerebellar commands are merged with them [59, 65, 68].
The difference between total or gradual replacement of reflexes by anticipatory actions becomes relevant when considering an instrumental version of the eyeblink conditioning paradigm where the US is provided by an air puff whose noxious effect can partially be prevented by the anticipatory blink itself [59, 61, 66, 68]. In contrast, in classical—or Pavlovian—eyeblink conditioning electrical shocks to the periorbital area are usually employed as US, in which case neither the UR nor the CR have operational value, i.e., the responses do not ameliorate the effect of the US [60, 67]. In the instrumental contingency that uses air puffs as US, the anticipatory response establishes a behavioral feedback that, as learning progresses, diminishes the sensed intensity of the aversive and learning-inducing US [65, 66, 67]. One may expect that the subject will completely avoid any aversive effect of the unconditioned stimulus by blinking preemptively, namely, to expect a complete substitution of reactive feedback by predictive feed-forward control after learning. However, behavior indicates that at learning asymptote subjects only display a partial anticipatory closure of the eyelid to the CS and will only completely close their eyes after perception of the US [59, 68, 69, 70]. This implies that a significant part of the protective action of the putative CR still takes place reactively and is thus a UR.
We can explain this hybrid feedback/feed-forward control model from the perspective of optimality . Namely, if one considers that both the protective action and the failure to avoid the US carry a cost, optimal behavior will depend on an effort/error tradeoff. In the case of eyeblink conditioning, the tradeoff may comprise of keeping the eyes open to sample visual information, versus protecting the cornea from potentially harming stimuli. NOI, by adjusting the relative weight of the internal feedback, can therefore set a balance between anticipation and reaction such that the overall cost is minimized . In other words, cerebellar learning is not minimizing error but rather minimizing cost, including the cost of not sampling the external environment.
Mixed feed-forward and feedback control is considered the most robust control strategy, combining the efficiency of anticipatory action with the inherent robustness of feedback control. As we just observed, in nature, a balance between both modes of control can be found in the conditioning of the eye blink response and its realization in the cerebellum. Understanding this phenomenon requires complete consideration of the systems-level interactions between the cerebellar adaptive layer, the reactive brain stem motor nuclei, and the controlled plant (eyelid/nictitating membrane). Here, the use of a systems-level modelling approach has generated the testable prediction that the NOI is the critical interface regulating the coupling of cerebellum enabled predictive feed-forward control and reactive control achieved by brainstem feedback controllers. At this point, the question arises of how the NOI is itself regulated to achieve an optimal balance between the reactive and adaptive modes of control. The substantia nigra has been shown to send dopaminergic projections to the nucleo-olivary pathway , whose functional relevance is not yet understood. We propose that through this dopaminergic neuromodulatory output, the basal ganglia may regulate activity in the nucleo-olivary pathway and consequently control contextually the recruitment of the cerebellum. In the case of eyeblink conditioning, such control may result in a modulation of the learning rate and of the amplitude of the CR at learning asymptote. Indeed, IO cells have been shown to reproduce, in eyeblink conditioning, the encoding of temporal-difference prediction errors already found in dopaminergic cells of the basal ganglia , indicating an at least correlational link between dopaminergic and inferior olivary activity. In the broader context of this consensus paper, we propose that the NOI realizes a mechanism that allows to contextually adjust the contribution of distinct cortico-cerebellar loops to cortical computations and that such regulation might depend on neuromodulatory output from the basal ganglia.
The NOI pathway is a basic element of the cerebellar circuit with pervasive projections of climbing fibers throughout the cerebellar cortex. At this point, it is attractive to speculate that the possibility of regulating the degree of recruitment of the cerebellum by contextually adjusting the level of NOI would augment the computational power and versatility of brain networks that include the cerebellum, allowing them to shift contextually between more certain (prediction-based) and/or more uncertain (reactive-based) modes of control. It appears likely that this would be a more pressing control problem when we consider higher brain structures that are interfaced to the cerebellum. Indeed, given that the balancing of feedback and feed-forward control is essential for adaptive behavior, an imbalance of the two might account for pathologies such as Parkinson’s disease dyskinesia. More concretely, we can hypothesize that the over-activation of the cerebellar cortex discussed by Popa and Kishore below could result from a too strong NOI that by silencing the inferior olive increases the tonic level of activity in Purkinje cells . This points to the NOI pathway as a possible target for studies with animal models of Parkinson’s disease.
Spinocerebellar Circuitry—Consequences for the Organization of Neocortical Motor Control (H. Jörntell)
Cerebro-cerebellar communication is often implicitly assumed to refer to the cortico-pontine system and the projections back from the cerebellum to neocortex via the thalamus. However, a substantial part of the interplay between the neocortex and the cerebellum is likely to occur via the spinocerebellar systems. If the basal ganglia initiate the release of motor programs or motor command signals via the neocortex, corticospinal axons will inevitably activate large parts of the circuitry in the spinal cord. As many neuronal components in the spinal circuitry project to the cerebellum, in addition to alpha-motor neurons or spinal motor pools , the spinocerebellar pathways are an important source of information about the neocortical activity [80, 87].
The multitude of spinocerebellar pathways [80, 81] is of central importance to the coordination of limb movements . The spinocerebellar and spino-reticulo-cerebellar pathways represent information from spinal motor circuits that are composed of various spinal interneurons. Almost all corticospinal tract axons terminate within the pool of spinal interneurons rather than the alpha-motor neurons directly [83, 84], which puts the interneurons in a key position for the majority of the motor control functions exerted by the brain. This pool of interneurons integrates the motor command signal from the neocortex with local sensory feedback, such as cutaneous information, tendon organ afferents, and muscle spindle afferents both of type I and type II. Spinal interneurons can either have direct recurrent connections that ascend all the way to the cerebellum  or the lateral reticular nucleus [86, 87], or they can utilize specialized ascending neurons such as the neurons of Clarke’s column . These systems display differences regarding their detailed connectivity and the information they sample within the spinal cord. Consequently, the ascending projections from these systems will serve the overall function of providing the cerebellum with a wide monitoring of the activity in spinal motor circuits. Spinal interneurons are involved in the muscle synergy selection when the spinal motor circuitry is driven by descending motor control signals from the neocortex and/or subcortical motor systems . Hence, the cerebellum can use the spinocerebellar systems to be informed about the relative excitatory drive on specific synergical components and on the low level motor functions resident in the spinal cord [89, 90].
In many respects, the intrinsic processing within the cerebellar cortex can to a large extent considered to be solved . Mossy fiber information is transmitted through the granule cell layer and reaches the molecular layer, where the signal is given a specific synaptic weight in the Purkinje cell through learning. Due to the presence of local inhibitory interneurons, this synaptic weight can also have a negative value on the Purkinje cell. Hence, observed excitatory and inhibitory inputs to these cells in vivo can to a large extent be explained by learning , which is related to the climbing fiber signal the Purkinje cell receives. In light of this relatively simple circuitry function, a natural consequence is that the key function of the cerebellar cortex becomes that of a major associative element. The individual Purkinje cell has in itself massive associative power, due to the very high number of parallel fiber synapses and interneuron synapses it receives. An array of Purkinje cells that compose a functional microzone, and which targets the same group of cells in the efferent cerebellar nucleus and therefore can be considered a “super”-Purkinje cell, has a tremendous associative power . One important possible consequence of this arrangement is that the cerebellum can associate many specific basal (spinal) synergy components in the right temporal order to help synthesize compound movements . Although there is a debate on the pattern of convergence of mossy fiber information in individual granule cells, at least for limb controlling areas of the cerebellar cortex mossy fiber information from individual functional pathways is directly transmitted through granule cells and reflected in the output of the Purkinje cells [92, 93]. In this case, there is an unconditional transmission of information through the granule layer from individual functional pathways, which means that the information carried by these pathways can be integrated by the Purkinje cell without being dependent on concomitant input from other mossy fiber systems in contrast to what was assumed in the original Marr-Albus theory of cerebellar information processing .
However, there are naturally many details left to solve for the internal processing in the cerebellar cortex. One example is how the global balance of activity in the perpetually active cerebellar circuitry is maintained, where the feedback loops formed by the inhibitory Golgi cells, the nucleo-olivary inhibitory pathway, and the control of the overall Purkinje cell firing level from climbing fibers are likely to be important . Another example is the role of the various neuromodulators, of which there is ample representation in the cerebellum. But with respect to the direct fast processing, which at least under limb movement control is the main functional contribution of the cerebellum, the structure and physiology of the cerebellar-cortical circuitry do not seem to provide a substrate for adding substantial computations of highly advanced functions on the information it receives. But it does allow the coupling/association of a very large amount of mossy fiber information, which in itself can represent advanced functions, as described above. In the case of spinocerebellar systems, such functions can already be represented in the information that reaches the cerebellum, and the task of the cerebellum becomes that of finding which of these many functions should be associated with each other, and under which context they should be associated.
The DPM Architecture for Learning and Control (J. Houk)
Operations in the Subcortical Loops
How does the BG loop learn appropriate sets of goals among which to choose? The input to BG from cortex is diverse and it converges onto a sophisticated pattern classification stage (Fig. 5), located in the striatum of the BG loop . The sophisticated properties of the striatum include spiny projection neurons (SPNs) endowed with bistability and nonlinear amplification  and a sparse inhibitory network expressing complex dynamics . Furthermore, the learning and performance of SPNs is modulated by reward prediction signals (purple diamond) sent from dopamine (DA) neurons in the midbrain. Due to this modulation, combined with a competitive process that profits from presynaptic inhibition , SPNs learn to detect diverse patterns of activity in cortex, patterns that encode opportune goals. In any given experience, a few winners of the competition lead to a coarse selection of preeminent goals for obtaining future reward .
How does the CB loop learn to generate an intention for accomplishing one of the goals that was selected by BG? Neural representations of selected goals are transmitted from cortex to two subdivisions of the cerebellum. The excitatory loop (green arrows) targets the cerebellar nucleus and engages the nonlinear amplification stage in Fig. 5. Positive feedback through cerebellar nucleus causes the loop to behave in a bistable manner . Bistability is regulated by prominent inhibitory input from the cerebellar cortex (red circles), designating the refinement stage in Fig. 5. The error correction signal (purple diamond) from climbing fibers trains the principal inhibitory neurons (the Purkinje cells) to regulate bistability in a highly complex manner . Transitions between a quiescent downstate and an intense upstate need to be controlled. The CB loop learns to program an intention, patiently wait for the initiation of the intention by some event, and then terminate the intention in advance of it achieving its goal. The latter is a critical step that prevents the limb from crashing into the target and amounts to predictive control as discussed by Miall in a later section. A successful intention command controls the state transitions of the loop between cerebellar nucleus and the cerebral cortex, which is a very difficult problem. This intention command serves as the ultimate output of the DPM that is transmitted from a particular area of Ctx. It may represent a movement command, a working memory, or a neural representation of a plan, depending on the particular DPM [96, 107].
Functions Performed by Arrays of DPM
The former paragraphs explain how the three main parts of a DPM, an area of Ctx, a BG loop, and a CB loop, operate individually. Now, I would like to discuss how arrays of DPMs function in combination. The work done on mirror neurons  and on imitation learning  provides excellent topics. Mirror neurons are active when a subject performs a goal-directed action and also when the subject observes another individual performing the same action. This special correspondence between observation and action has been called congruence. If the DPM theory is generally applicable, it has to account for the emergence of congruence during ontogenesis. As a consequence of developmental plasticity, the infant must learn not only how to reach and grasp a specific target but also higher level actions such as bringing a morsel of food to the mouth and eating it. The infant must also learn to recognize when another individual performs the same actions. Hierarchically diverse levels of goal are learned in BG loops guided by reinforcement learning. SPNs must learn not only to fire when a subject is presented a goal for its own action but also when it observes another individual performing the same action. Meanwhile in CB loops, the infant must learn parameterizable intentions for generating outcomes capable of fulfilling the different goals. Often it is assumed that the theory of reinforcement learning specifies how basal ganglia learn primitive actions (say, muscle commands) and ensembles of them (say whole movements or longer courses of actions), but this is not biologically realistic. Muscle commands, and other kinds of intention, are clearly learned and generated in CB loops to satisfy goals that are learned and selected by BG loops. Normally, the two kinds of loop work together to select and generate appropriate actions. These learning and control operations need to be explored in simulations of DPM arrays with different parameter sets.
An early stage of imitation learning can be traced to the superior temporal sulcus (STS) using arguments that focus only on the cortical areas that are involved in the mirror neuron network . Most models do not invoke the subcortical loops that learn to control each cortical node in the mirror neuron network. I agree with Caligiore and colleagues  that this focus of the mirror neuron field is inadequate. We now have a good understanding of how loops through BG discover opportune goals and how loops through CB adapt to generate and refine intentions that accomplish these goals. The focus of mirror neuron research needs to shift towards exploring how these goal/intention congruences are learned by arrays of DPMs. Within the hierarchy of the mirror neuron system, each DPM evokes a different meaning. In the course of developmental practice, these different kinds of knowledge are exported to the different cortical nodes for more rapid automatic execution. The latter are examples of cortical habits, which clearly may include sequential chunks of action.
Different learning rules in cerebral cortex, basal ganglia, and cerebellum
Excitatory afferents onto pyramidal cells
Striatum cortical afferents onto spiny neurons
Parallel fibers onto Purkinje cells
Learning Rule & operation
Hebbian & coincidence
Reinforcement & coincidence · reward
Supervised & coincidence · error
Cerebellum and Basal Ganglia Work Together for Model-Based Actions (K. Doya)
Based on the anatomical and physiological evidence available by the end of the last century, I proposed a theoretical framework that the cerebellum, the basal ganglia, and the cerebral cortex are specialized for supervised, reinforcement, and unsupervised learning, respectively [41, 111]. This view has received some support and raised some debate among theoreticians and experimentalists.
In the last decade, there have been significant new observations regarding the interaction between the cerebellum and the basal ganglia. The cerebellar output is disynaptically connected to the basal ganglia through dentate nucleus–centrolateral thalamus–striatum pathway . It was recently demonstrated that stimulation of dentate neurons evokes short-latency (about 10 ms) responses in about half of the striatal neurons . It was further revealed that the basal ganglia output is also disynaptically connected to the cerebellum through subthalamic nucleus–pontine nucleus–cerebellar cortex pathway . Thus, the existence of the short-cut connections between the cerebellum and the basal ganglia is becoming a new anatomical consensus , but what are their computational roles?
A possible role of the dentato-thalamo-striatal pathway is model-based evaluation of action candidates. The forward model learned in the lateral cerebellum predicts the resulting sensory state for a candidate action and its output is sent through the thalamus to the striatum, which estimates the value of the predicted state. An interesting observation  is that optogenetic stimulation of the dentate-thalamo-striatal pathway reverts cortico-striatal long-term depression (LTD) to LTP, which had been reported to happen with dopamine stimulation . Previous self-stimulation experiments showed that the striosome compartment is more effective in inducing self-stimulation than the matrix compartment . It is not known whether the dentato-thalamo-striatal pathway has any preference projections, but a possible scenario is that the cerebellar input activates the striosome neurons that activate dopamine neurons.
The function of the subthalamo-ponto-cerebellar pathway is harder to interpret. The subthalamic nucleus is a part of the “indirect pathway” of the basal ganglia that is implicated in action inhibition and aversive learning [116, 117]. Thus, a possible function of the pathway is to provide a “Stop!” signal to the cerebellum for withholding ongoing movements. Another possibility, though highly speculative, is to signal “off-line” status to the cerebellum, notifying that currently the basal ganglia have withheld execution of motor programs (though inhibition of the thalamus and midbrain motor nuclei via globus pallidus and substantia nigra reticulata, respectively) so that the cerebellar internal models can be safely used for off-line mental simulation.
Here, I presented some views based on the hypothesis that the cerebellum provides internal models of the body and the environmental dynamics for model-based motor control and decisions [41, 111]. There are, however, proposals and accumulating evidence suggesting that the frontal and parietal cortices as well as the hippocampus play important roles in model-based planning and decisions [118, 119, 120]. A possible difference of the internal models provided by the cerebellum and the cortex may be that the cerebellum learns deterministic input–output mapping with its mostly feed-forward circuit, while the cortex learns joint or conditional probability models through iterative dynamics using its heavily recurrent circuit. Probabilistic models are more general, as it includes deterministic models as extreme cases, but deterministic models have the virtue of simplicity. The hippocampus may enable reuse and editing of episodic memories for planning about the future. These ideas are all speculative, but recent optogenetic tools for pathway-specific circuit manipulations can make it possible to test these hypotheses. The big challenge for us theoreticians is to provide hypotheses worthy of laborious testing.
A Systems-Level View of Cerebellar Motor and Cognitive Function (R.C. Miall)
A Uniform Structure and Specific Connections
The cytoarchitecture of the cerebellar cortex is strikingly consistent, both across its span and across species. This very extensive neural sheet, estimated to be equal in area of one hemisphere of the human cerebral cortex , is heavily interconnected with cerebral cortical areas, and recently evidence of bidirectional connections between cerebellum and basal ganglia has emerged [6, 13]. The consistent cerebellar structure and circuitry, reciprocally connected to many different extra-cerebellar structures, suggest strongly that a common neural operation is performed within each micro-complex. In contrast, cerebral cortical areas are uniquely organized, with each cortical area dedicated to a specific function or functions. Function follows form.
A Singular Processing Hypothesis
Three critical questions arise from this view (none of which is new and all have been raised before). The first question is what might be this proposed single operation or transformation performed by the cerebellar cortex. This is analogous to the algorithmic level of analysis that David Marr proposed 40 years ago . There are still multiple alternative answers, ranging from a timing device, or associative learning network, to my preferred hypothesis, as a short-term predictor—specifically that the cerebellum contributes a state estimation towards forward modelling, predicting the causal chain from motor commands to changes in state of the modelled system . We have recent evidence that the same may hold true for prediction in language processing .
The second question is how the cerebellar neural circuitry supports whatever singular operation it achieves (Marr’s physical level of analysis). A full answer will depend on a deeper understanding than we currently have of the processing of each cell type, the interactions between the interneurons within the cerebellum, and the consequences for information processing of the interconnections between mossy fiber inputs and Purkinje cell outputs . This must include not only interactions between cells in the cerebellar cortex but also the short-range connections between cortex and deep cerebellar nuclei and between cerebellum and inferior olive. This latter connection is probably one of the most critical to understand, as the evidence for climbing fiber-driven LTD at the Purkinje cell inputs is overwhelming, and evidence for more subtle changes at other synapses within the cortical sheet is strong. So understanding what the inferior olivary teaching signal represents will determine what cortical process is sculpted and refined by these synaptic events .
The third question is analogous to Marr’s computational level of analysis. What is the function of the interconnected network running, for example, from parietal and sensorimotor cortical areas through the cerebellum and its output to the thalamus, and projecting back to the same sensorimotor cortical areas? Here, the answer must be given in terms of the network and cannot be answered by reference to cerebellar or cortical processes in isolation.
Evidence for cerebellar interactions with cortical sensorimotor areas is found at all levels—from tracer studies in non-human primates, human diffusion tensor imaging and functional connectivity measures, lesion studies, and electrical and magnetic stimulation studies. What these cannot tell us is what signals are carried or the functional role of the cerebro-cerebellar loop. Our experimental approach has been to use TMS to disrupt cerebellar operations and test consequences on behavior [124, 127]; in both studies, we showed change in behavior consistent with a loss of predictions generated by the cerebellum—the former study tested linguistic prediction, the latter reaching behavior. We are using functional imaging to understand the co-activation of cerebral and cerebellar areas  and more recently to explore how their connectivity changes as a consequence of learning . We have also used tDCS to manipulate either cerebellar or cerebral excitability, and this is highlighting a secondary modulatory level of cerebellar-cerebral interaction [131, 132, 133]. In detail, we have shown corresponding changes in cognitive tasks when we depress cerebellar activity with cathodal tDCS or activate frontal cortex with anodal tDCS. We believe the former effect is mediated by cerebellar disinhibition of cerebral cortex; both Lago-Rodriguez and Galea and Popa and Kishore discuss this mechanism in more detail below.
To conclude, neuroanatomy suggests a singular role for the cerebellum, within multiple functionally distinct cerebro-cerebello-thalamic circuits. Evidence is accumulating that this role is in prediction and in learning through experience. Medium-term, post-learning, changes in connectivity between the cerebellum and the cerebral cortex reflect the consolidation of these processes and may depend upon cerebellar and basal ganglia interactions.
What Have We Learnt from Non-Invasive Brain Stimulation Studies Regarding the Role of the Cerebellum and Its Interactions with Other Brain Regions in Motor Control and Learning? (A. Lago-Rodriguez, J.M. Galea)
Over several decades, a substantial body of work has investigated the role of the cerebellum and its connections with other brain areas in human motor control and learning . Non-invasive brain stimulation techniques such as TMS and tDCS have been used to probe the functional importance of cerebellar connectivity in motor control/learning. In general, tDCS has been used to locally modulate cerebellar excitability , whereas TMS has been applied to either locally disrupt cerebellar processes  or to evaluate cerebellar-primary motor cortex (M1) inhibitory connectivity (cerebellar brain inhibition (CBI)) . CBI takes advantage of the cerebellum’s inhibitory connections with M1, applying a conditioning pulse of TMS to the cerebellum prior to stimulating the M1. The following section will provide an overview of what we have learnt using non-invasive brain stimulation regarding the role of the cerebellum and its connections with other brain regions in motor control/learning. We will focus on studies of upper limb reaching movements and highlight the issues still to be resolved.
The cerebellum is essential for accurate reaching performance. For example, patients with cerebellar lesions often show highly variable and imprecise reaching behavior . TMS evidence from both healthy participants and cerebellar ataxic patients  suggest that human’s ability to perform accurate reaching is highly dependent on the strength of connectivity between the cerebellum and M1. Put simply, increased inhibitory output from the cerebellum to M1 (CBI) correlates with movement precision, where stronger inhibition is associated with greater precision . Interestingly, participant’s dominant hand showed greater CBI and reaching precision than their non-dominant hand. It is tempting to suggest that stronger inhibition by the cerebellum may underlie the preference for dominant hand movements. However, it is important to point out that the observed correlations between CBI and behavioral precision do not speak to causality. Therefore, it is also possible that hand preference leads to a practice effect which enhance cerebellar connectivity . What role could the connectivity between the cerebellum and M1 play in reaching accuracy? Accurate state estimation (e.g., estimating current limb position) is vital for the precise control of reaching movements. It is believed that a cerebellar forward model, which predicts the sensory consequences of motor commands, is crucial for accurate and up-to-date state estimation . The correlation between behavioral precision and higher CBI would be consistent with this framework, particularly if one makes the assertion that increased CBI is indicative of a stronger forward model .
In addition to motor control, the cerebellum plays a pivotal role in error-based motor learning, often referred to as motor adaptation . This process is crucial for maintaining accurate reaching behavior in response to novel environments that cause errors in performance. Modulation of cerebellar activity by tDCS leads to polarity-dependent changes in motor adaptation rates to visuomotor , locomotor , and dynamic  novel perturbations. Whereas anodal tDCS leads to faster motor adaptation, cathodal stimulation decreases adaptation rates [31, 160, 161]. This clearly identifies a prominent role of the cerebellum in motor adaptation; however, how important are its connections to other brain areas? Previous work has shown that the cerebellum decreases its inhibition over M1 (decreased CBI) when movement corrections (motor adaptation) are required to respond to environmental changes [162, 163]. These results are in line with a reduction of cerebellar Purkinje cells activity in response to error signals and support the notion that mechanisms similar to LTD are the most important neurophysiological processes underlying the cerebellar contribution to motor adaptation .
Posterior Parietal Cortex (PPC)
Current theories of motor control suggest that the anatomical connection between the cerebellum and PPC plays a critical role in maintaining accurate voluntary movements . Despite this, no brain stimulation work has investigated the functional importance of cerebellar-PPC connectivity to motor control and adaptation. One reason for this is the complexity involved in such a study. For example, this issue could be investigated by comparing the influence of concurrent cerebellar tDCS on cerebellar-M1 and PPC-M1 paired-pule TMS. This complex brain stimulation design would then have to be coupled with a motor task.
Basal Ganglia/Frontal Cortex
There is now increasing evidence that error-based motor learning occurs through multiple processes that are not all cerebellar-dependent (reinforcement learning/use-dependent learning/explicit strategies) . Although discussion of these processes is beyond this current review, it is important to mention that they can often take place concurrently or even in a competing manner . However, very little is known regarding the neural basis of the interaction between cerebellar-dependent motor adaptation and possible frontal/basal ganglia-dependent learning (explicit strategies/reinforcement learning). Although we know that the cerebellum has connections to both the basal ganglia and the frontal cortex , the functional relevance of these connections to the interaction between different learning processes is currently unknown. Once again, the complexity involved in studying these connections with brain stimulation is significant. One possible solution would be to examine the interaction of these motor learning processes during concurrent brain stimulation (TMS/tDCS) and fMRI.
Cerebellar Modulation of Cortical Plasticity in Basal Ganglia-Related Movement Disorders (T. Popa, A. Kishore)
The abnormalities in M1 plasticity in patients with disorders such as primary dystonia and Parkinson’s disease (PD) are generally attributed to abnormal basal ganglia input to the M1. Non-invasive studies testing the efficiency of cerebellar modulation of cortical excitability were recently reported in patients with writer’s cramp [172, 173]. Though the ongoing M1 plasticity was not different from age-matched healthy volunteers, both excitation and inhibition of the cerebellar cortex were ineffective in modulating the heterosynaptic cortical plasticity in patients with writer’s cramp. Also, the extent of modulation of motor cortex plasticity by cerebellar inhibition had an impact on the efficiency of online adaptation in a sensorimotor adaptation task . This deficiency might lead to degradation, with time, of the specific, vulnerable, motor programs for tasks that require reinforcement by online sensorimotor adaptation such as writing. However, clinically relevant improvement in dystonia was not observed following a single session of artificial cerebellar excitation  or inhibition in patients with writer’s cramp . This is not surprising since abnormal motor programs for writing must have been reinforced over years, before becoming manifest and it might require many cerebellar stimulation sessions to reverse this process .
Studies of plasticity changes in M1 in early PD report variable results. The results are more consistent regarding the loss of bidirectional plasticity of M1 in advanced PD patients with motor complications of levodopa treatment [176, 177, 178]. There is indirect evidence that cerebellar modulation of M1 plasticity is impaired in advanced PD patients with levodopa-induced dyskinesias. Repeated sessions of cerebellar inhibition could enhance the M1 heterosynaptic plasticity  and concurrently reduce the severity of dyskinesias [179, 180]: the greater the enhancement of M1 plasticity following cerebellar inhibition, the greater was dyskinesias reduction. This raises an interesting question whether there is a state of deficient cerebellar inhibitory modulation or excessive cerebellar excitation in advanced PD.
Another important detail concerning this heavily interdependent circuit is the increased activity in the cerebellar cortex that inhibits the cerebellar output from the nuclei, which, in turn, project not only to the thalamic relays but also to key hubs in the brainstem, like the inferior olive. However, most of the spontaneous activity in the cerebellar cortex is driven by intrinsic (non-synaptic) mechanisms and the level of spontaneous activity in Purkinje cells is reciprocally regulated by the activity of the inferior olive (through the nucleo-olivary inhibition). Any regulation of the strength of this negative link remotely from other brain structures or artificially (pharmacologically or with invasive-non-invasive stimulation) could be a means to adjust the level of spontaneous activity in the cerebellar cortex and subsequently in the whole network.
The Basal Ganglia-Cortical-Cerebellar Network in Parkinson’s Resting Tremor (D. Caligiore, R.C. Helmich, M. Dirkx, G. Baldassarre)
Studies in non-human primates have shown the presence of several anatomical pathways between the basal ganglia and the cerebello-thalamo-cortical circuit. First, the STN has both afferent and efferent connections with the cerebello-thalamo-cortical circuit: it receives direct anatomical projections from the primary motor cortex and sends disynaptic projections to the cerebellar cortex through the pontine nuclei [4, 13]. In PD, the activity of excitatory/glutamatergic output neurons of the STN is increased , and this may trigger the cerebellar cortex via the pontine nuclei, as these projections are largely glutamergic . In this way, the STN may work as a switch that triggers, through the subthalamo-ponto-cerebellar pathway, abnormal activity in the cerebello-thalamo-cortical circuit. Although this hypothesis explains why DBS of the STN and ventral intermediate nucleus (VIM) are very effective in treating resting tremor [191, 192], it diminishes the role of the internal globus pallidus (GPi) in the generation of tremor. This does not explain the presence of tremor-related activity in the GPi [183, 193] and the fact that DBS targeting the GPi effectively reduces tremor . Second, the basal ganglia and the cerebello-thalamo-cortical circuit may interact at the level of the motor cortex, where both circuits anatomically converge . Specifically, the GPi sends GABA-ergic projections to the anterior part of the ventrolateral thalamus (VLa) which in turn sends excitatory efferents to the motor cortex that projects to the posterior part of the ventrolateral thalamus (VLp, also termed VIM), which receives cerebellar projections . This hypothesis would explain why DBS of the STN, GPi, and VIM are all effective in treating tremor [191, 192, 194]. Third, the basal ganglia may engage the cerebello-thalamo-cortical circuit also through the zona incerta, which receives projections from the GPi and sends GABA-ergic projections to the VLp . Finally, the basal ganglia may interact with the cerebello-thalamo-cortical circuit through the peripheral nervous system. That is, after tremor initiation by the basal ganglia, tremor-related somatosensory afferents transmitted to the cerebellum may engage the cerebello-thalamo-cortical circuit . However, this hypothesis does not fit with data showing that peripheral deafferentation, peripheral anesthesia of tremulous muscles, and mechanical perturbations have little effect on PD tremor (for a review, see ). To conclude, there is currently no definite evidence which of the pathways connecting the basal ganglia with the cerebello-thalamo-cortical circuit contribute to PD tremor.
Given the complex involvement of different neural circuits, a systems-level perspective on PD tremor is required to answer this question. Systems-level questions require systems-level outcome measures, and the development of new analysis tools has made this possible. For example, rather than testing for altered activity in a set of brain regions, or altered functional connectivity between two different brain regions, dynamic causal modelling (DCM) allows one to statistically compare different network configurations based on fMRI data. A second approach could rely on computational modelling [39, 199] that has the advantage to allow one to directly measure the effects of adding or removing specific pathways on the oscillatory output of the system. Finally, animal models of tremulous PD may be helpful to test whether the resection of specific pathways interferes with tremor. For example, this approach has been applied to a mouse model of dystonia where resection of the anatomical pathway between cerebellum and basal ganglia was shown to reduce dystonic symptoms .
A systems-level view of tremor may improve existing treatments, for example by tailoring GPi-DBS to ongoing activity in the motor cortex . It may also facilitate the development of new treatments. For example, computational models informed by functional imaging may allow us to test new anti-tremor treatments “in silico” before transferring them to animals or patients .
Summary and Conclusions
The nine manuscripts collected in this consensus paper involved 18 scholars whose expertise covers different scientific disciplines including, among others, neurophysiology, theoretical neuroscience, and neuropsychology. A first notable fact that emerges from the paper is that, although starting from such different backgrounds, all the contributors agreed on the importance of studying the cerebellar function from an integrative perspective that takes into account the interplay between cerebellar, cortical, and basal ganglia networks. Bostan and Strick underline how the reciprocal anatomical loops between the cerebellum and the cerebral cortex involve both motor and non-motor cortical areas. Verschure et al. further support and expand the analysis of Bostan and Strick by underlining the role of the nucleo-olivary pathway to manage the contribution of feedback and feed-forward aspects of motor control. Similarly, Jörntell underlines how the spinal inputs into the cerebellum allow it to be informed about the excitatory drive on low level motor functions, so also adding the spinal cord to the systems-level view on cerebellum. Furthermore, Bostan and Strick emphasize their recent findings on the connectivity between the cerebellum and the basal ganglia. While most of the authors propose possible systems-level effects of these bidirectional cerebellar-basal ganglia anatomical pathways, Houk decided to not explicitly include them in his entry. Houk claims that they are too sparse and there are not enough data to properly address the question about which role they might play in the cerebello-cortical-basal ganglia system. Houk only proposes here that such collateral synapses might grow in strength the gain of the positive feedback managed by the cerebellar-cortical loops discussed in his entry and, as a consequence, such loops would become extremely difficult to control. Aside from this, there is unanimous agreement between all the authors of the consensus paper that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. In this respect, Doya proposes novel untested theories regarding the role of such cerebellar-basal ganglia loop.
The cross-disciplinary discussion between the contributors allows the identification of some points of agreement and disagreement about specific mechanisms through which the cerebellum expresses its functions in synergy with cortex and basal ganglia according to a systems-level view. Below, we summarize the result of such discussion by considering three main topics addressed by the authors: (i) cerebellar systems-level mechanisms for learning and adaptation; (ii) cerebellar systems-level mechanisms underlying dystonia and Parkinson’s disease; and (iii) techniques for systems-level analysis of cerebellar functions.
Cerebellar Systems-Level Mechanisms for Learning and Adaptation
Houk reviews his previous proposal claiming that cerebellum, cortex, and basal ganglia form DPMs where basal ganglia-thalamo-cortical loops discover goals through reinforcement learning processes; cerebello-thalamo-cortical loops learn to generate intentions through supervised learning. According to this proposal, knowledge that is gleaned in basal ganglia and cerebellum is progressively transferred to the cerebral cortex. The basal ganglia-cortex and cerebellum-cortex loops tutor the cortex to learn what has been learned in the subcortical loops. Verschure et al. agree with this view and underline how the learning processes that Houk proposes for cerebellum, basal ganglia, and cortex are compatible with Doya’s attribution of supervised, unsupervised, and reward-based learning to, respectively, cerebellum, cortex, and basal ganglia. Interestingly, Verschure et al. also suggest that the regulation of the cerebellar feedback inhibition to the olive discussed in their entry may be the mechanism by which the cerebellar contribution to each DPM gradually adjusts to contextual requirements. Indeed, the DPM systems-level architecture may benefit of a mechanism allowing a flexible reconfiguration (or weighting) of its basic layout. The network could entertain modes of behavior that are more “cerebello-centric” (for instance to adapt to a new change in a sensorimotor contingency) to “cortex-centric” behaviors. Similarly, Miall agrees with the general ideas proposed by Houk, even if he mainly stresses the role of the cerebellum as a predictor.
Doya elaborates his previous theory of motor control and learning according to which the cerebellum, the basal ganglia, and the cerebral cortex are specialized for supervised, reinforcement, and unsupervised learning, respectively, in order to account for the recent findings on the circuitry between the cerebellum and the basal ganglia reviewed by Bostan and Strick. In particular, the author suggests that a possible role of the dentato-thalamo-striatal pathway may be a model-based evaluation of action candidates during the reinforcement learning processes. On the other side, the function of the subthalamo-ponto-cerebellar pathway may be to provide a “Stop!” signal to the cerebellum to activate a motor program for withholding ongoing movements. Another possibility may be that the subthalamo-ponto-cerebellar circuit may signal an “off-line” status to the cerebellum, notifying that currently the basal ganglia have withheld execution of motor programs so that the cerebellar internal models can be safely used for off-line mental simulation. Kishore and Popa consider this latter hypothesis highly speculative. They do not completely agree with the first hypothesis, observing that while it might be true for gaze control, axial muscle control, and background spinal circuits’ modulation, it might be not true for complex motor control of the limbs as well as for motor plan discrimination. This is therefore one example of topic where consensus cannot be reached yet and a topic that is critical for future research to explore.
Lago-Rodriguez and Galea agree with the Doya’s perspective and extend it by specifying the importance of the anatomical connections between cerebellum and posterior parietal cortex to motor control and adaptation. The authors review evidence suggesting that error-based motor learning occurs through multiple processes that are not all cerebellar-dependent (reinforcement learning/use-dependent learning/explicit strategies) and that require the involvement of a cortical-subcortical network including cerebellum, frontal cortex, and basal ganglia. This view is also in agreement with the evidence reviewed by Bostan and Strick and with the theoretical proposal of Houk. In addition, Lago-Rodriguez and Galea discuss recent data suggesting that cerebellar inhibition is important for implementing motor control, while the alleviation of cerebellar inhibition is associated with motor adaptation (see the paragraph below on “Techniques for systems-level analysis of cerebellar functions” for more details on the non-invasive brain stimulation techniques used by Lago-Rodriguez and Galea to study this effect). Caligiore et al. support this dual role of the cerebellum underlying how the increased motor adaptation due to an alleviation of cerebellar inhibition raises the question whether the cerebellum has an intrinsic role in motor adaptation or whether the cerebellum “opens” M1 to the influence of other networks (such as trans-cortical or fronto-striatal systems).
Miall presents neuroimaging evidence for the involvement of cerebro-cerebellar and cerebellar-basal ganglia interconnections in learning and long-term memory consolidation. On this basis, Miall supports the idea that the cerebellum employs a set of operating/learning principles that are replicated many times across the cerebellar cortex. Each replication has a specific function because it connects with specific brain regions. Miall gives three possible operating/learning principles, namely as a timing device, an associative learning network, and a short-term predictor, stressing the importance of the latter with respect to the other two. Not all the contributors agreed with this preference for the role of the cerebellum as a short-term predictor. For example, Houk supports the idea that all the three singular operating/learning principles are equally implemented by the cerebellum working in concert with cortical and basal ganglia areas. However, Miall also suggests that studies of learning from experience indicate that knowledge is consolidated in several cerebral sites outside the cerebellum after a time delay. Houk agrees with this view and suggests a possible mechanism underlying it which is based on the cerebello-cortical systems-level learning processes described in his entry. In particular, Houk describes an exportation mechanism whereby knowledge can be transferred from the cerebellum to the cerebral cortex through rehearsal or practice. This mechanism, which relies on Hebbian learning in cortex, tutored by input from the cerebellum, may be at the basis of the consolidation processes discussed by Miall. This hypothesis—which has parallels in the way other brain areas such as the hippocampus might “train” the cerebral cortex off-line [202, 203]—deserves future investigations.
Cerebellar Systems-Level Mechanisms Underlying Dystonia and Parkinson’s Disease
Popa and Kishore describe how the altered interaction between cerebellar and fronto-striatal systems may play a role in movement disorders such as dystonia and Parkinson’s disease. In the same line, Caligiore et al. discuss how pathology in the interconnections between the cerebellum and the cerebral cortex and between the cerebellum and the basal ganglia reviewed by Bostan and Strick may contribute to the manifestation of resting tremor in Parkinson’s disease. There was a large agreement between the authors of the consensus paper about these systems-level perspectives to study dystonia and Parkinson’s disease. Caligiore et al. underline an interesting question raised by the paper of Popa and Kishore about to what extent the altered balance between activity in the basal ganglia and cerebellum in advanced Parkinson’s disease is caused by the primary pathology (i.e., dopamine depletion in the basal ganglia) or by a maladaptive compensation (e.g., increased activity in the cerebellum). Verschure et al. stress how the contribution of Popa and Kishore is very important as it spells out functional hypotheses on the systems-level interaction between cerebellum, basal ganglia, and cortex that can be translated into clinical applications. Verschure et al. propose that the nucleo-olivary inhibition discussed in their entry may have a critical role in explaining the hypotheses put forward by Popa and Kishore: the over-activation of the cerebellar cortex discussed by Popa and Kishore may result from excessive nucleo-olivary inhibition that, by silencing the inferior olive, increases the tonic level of activity in Purkinje cells . This points to this specific pathway as a possible target for studies with animal models of Parkinson’s disease. It is also interesting to note a further link between the contribution of Popa and Kishore and the contributions of Lago-Rodríguez and Galea and of Miall: they all describe what appear to be congruent first- and second-order effects of the same basic principle of cerebellar control of the motor cortex. Namely, that cerebellar activity has an initial short-term effect on the control of neuronal activity in the motor cortex and a second long-term effect in controlling neuronal activity in motor cortex through plasticity.
Houk appreciates the “dimmer-switch” hypothesis proposed in [36, 183], further elaborated by Caligiore et al., underlining how it fits well with the DPM model of brain architecture outlined in his contribution. In addition, Houk proposes a possible systems-level mechanism within the DPM model to account for resting tremor. Using the DPM model, Houk predicts that in Parkinson’s disease, the loop through basal ganglia suffers from depleted dopamine and therefore learns goals poorly. As a consequence, it initiates actions pathologically in the positive feedback loop between the motor cortex and the cerebellar nucleus: instead of a normal motor command, what is initiated is an oscillation at the tremor frequency, and this oscillation is sustained and amplified by positive feedback. Purkinje cells in the cerebellar cortex have difficulty to refine this tentative action, so they occasionally just increase their discharge to force the bistable loop into its down state. This terminates the tremor completely. Then, after a while, the basal ganglia try again to initiate an action, and again, this results in an oscillation rather than in a proper action. This hypothesis suggests that tremor initiation may be a failed initiation of a voluntary action, which emerges as a tremor oscillation in the dopamine-depleted basal ganglia loop. This suggestion is at first surprising, given that the classical Parkinson’s tremor occurs at rest and disappears when patients make a voluntary action . On the other hand, there is empirical support for such a mechanism: Hallett and colleagues  have shown that the pattern of alternating activity in agonist and antagonist muscles seen during Parkinson’s disease resting tremor strongly resembles the activity seen during voluntary flexion of the arm. They also found that in many patients with Parkinson’s disease, a single “beat of tremor” preceded voluntary movements, even when there was no clinically noticeable tremor. This suggests that (the initiation of) resting tremor and voluntary actions arise from similar oscillations in the motor cortex, which may explain why they do not occur simultaneously .
Techniques for Systems-Level Analysis of Cerebellar Functions
The contributions of Popa and Kishore and of Lago-Rodríguez and Galea touch a field that is fundamental to the debate of this consensus paper: the study of systems-level interactions using non-invasive perturbation methods. The contribution by Popa and Kishore describes the first test of protocols of TMS applied to the cerebellum aimed at the alleviation of dyskinesia in PD patients. The success of such protocols is explained based on the modulation of motor cortex plasticity by the cerebellum. In the same line, Lago-Rodríguez and Galea review the effect of TMS and tDCS perturbations of the cerebello-cortical interactions both in control and learning during reaching tasks. The premise is that TMS in the cerebellum has an inhibitory effect on the M1—the so-called CBI. Thus, the main result reviewed is that CBI is lateralized stronger for the dominant hemisphere. Additionally, it is also highlighted that CBI decreases during motor adaptation. Regarding the interactions between cerebellum and basal ganglia, the authors sketch the methods that would allow the test of those interactions with non-invasive techniques. Interestingly, the data discussed by Miall in his contribution further support the analysis of the method discussed by Lago-Rodríguez and Galea. Moreover, the data discussed by Lago-Rodríguez and Galea, related to the critical contribution of cerebellar inhibition in motor control and adaptation, and the hypothesis supported by Verschure et al. about the gradual recruitment of the cerebellum through the regulation of the nucleo-olivary inhibition, reinforce reciprocally. Verschure et al. propose a mechanism (idiosyncratic of the olivo-cerebellar system) through which the amplitude of the modulations of the cerebellar output could be adjusted following contextual changes. Verschure et al. suggest that the sudden introduction of a perturbation in an adaptation protocol may cause a loss of certainty that would induce the cerebellum to decrease its anticipatory/predictive contribution to ongoing behavior. Then, a tempting hypothesis is that CBI can be a read-out of that contribution and its decrease a fingerprint of the ensuing modulation.
Most contributors of this paper agree that the involvement of trans-cortical and fronto-striatal systems to support the dual role of the cerebellum for motor control/adaptation (Lago-Rodriguez and Galea) and the interaction between the cerebello-fronto-striatal pathways (Popa and Kishore) and between subthalamo-ponto-cerebellar and cerebello-thalamo-cortical circuits (Caligiore et al.) is an important objective for further research and will likely require new network-based monitoring/therapeutic methods and systems-level computational models.
Cortico-Subcortical Interactions Support Higher Cognitive Functions
Another emerging theme across several contributions of this consensus paper is that the systems-level view pursued here could be important to re-think the traditional hypotheses on the motor and especially the cognitive functions of the cerebellum in the light of the most recent evidence ([1, 2, 133]; see the recent consensus paper of Koziol and colleagues ). In this respect, Bostan and Strick highlight how the reciprocal anatomical loops between the cerebellum and the cerebral cortex involve both motor and non-motor cortical areas. In the same line, Miall underlines how the cortical-cerebellar network can be important for managing predictive mechanisms during language processing . This claim is supported by empirical data showing that the right lateral cerebellum is connected with cortical language and higher cognitive areas such as the dorsolateral prefrontal cortex and the Broca’s area [1, 124].
This perspective suggests that higher level cognitive processes are not segregated within “higher-level cortical areas,” but they are realized in the same cortical-subcortical loops that support actions. In more details, cortical areas implement cognitive functions through mechanisms involving cerebellum and basal ganglia, and they depend on subcortical processes in order to execute many of their functions efficiently. In this way, higher-level functions of the cortex are expressed through its interactions with “lower level” systems which, in turn, are critical in modulating cortical functions . This view contrasts the traditional distinction between brain areas which support higher cognition (mainly cortex) and brain areas which support action (mainly basal ganglia/cerebellum) and perception [135, 136]. This perspective is also supported by the embodied-grounded theories of cognition that are increasingly challenging traditional views of cognition by arguing that cognitive representations forming high-level knowledge are grounded in sensory and motor experiences rather than being processed in an amodal/abstract conceptual system [137, 138, 139, 140]. An increasing amount of empirical evidence supports embodied cognition views. Examples include changes in motor behavior or perceptual experience as a result of semantic processing [140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150], or changes in categorization [151, 152] and mental manipulations of objects [153, 154], that reflect sensory and motor experiences (see  for a recent review).
Given the established empirical foundation, and the relatively underspecified theories to date, many researchers are extremely interested in embodied-grounded cognition but are clamoring for more specification about how the cortical-subcortical brain areas may be involved . Embodied-cognition views are also supported by conceptual and computational models proposing specific computational mechanisms on how high-level cognition processes might strongly depend on processes implemented in brain sensorimotor areas. For example, an intriguing hypothesis is that one such cortico-cerebellar loop might permit the control of internal thought processes, reusing the same internal models and mechanisms that permit the cortico-cerebellar control of overt actions . A related hypothesis is that the architecture of higher cognition and executive function is a sophistication of—and largely reuses—existing sensorimotor circuits and associated internal models, rather than relying on segregated neuronal circuits, but in an off-line (detached) mode . In this perspective, the off-line re-enactment of action, perception, and emotional processes, which is based on internally generated (not stimulus-dependent) brain dynamics , realizes higher cognitive functions such as planning and long-term decisions and also entrains the online sensorimotor processes that ultimately realize the planned courses of actions [9, 144, 145]. Supporting this idea is the fact that the neuronal systems for mental imagery and motor preparation are closely related [20, 146, 147, 148, 153, 154]. The conceptual and computational models summarized here only grasp the surface of the cortical-subcortical processes that support higher cognition. The systems-level view of cerebellar functions presented in this article might be the basis of further theoretical, empirical, and modelling investigations addressing the problem of which brain structures and mechanisms underlie embodied-grounded cognition and emotional/motivational processes.
As this paper and especially the final discussion has highlighted, the integrative dynamics of the cerebello-basal ganglia-thalamo-cortical system is a vibrant and relatively new theme, which is already generating a variety of empirical studies, computational explorations, and theoretical hypotheses. While a definite consensus statement on how the cerebellum works in synergy with basal ganglia and cortical areas has not yet been reached, the contributions presented in this paper all recognize the central importance of studying cerebellar function from a wider, systems-level perspective that fully acknowledges its close interplay with different brain areas. The papers cover a broad spectrum of themes, some of which are relatively more consolidated, while others are more novel and even speculative, thus deserving future investigations. The combination and elaboration of the ideas presented here represent a first step towards a new consensus on the function of the cerebellum within larger brain networks and hold the promise to understand the cerebellar, basal ganglia, and cortical functional and learning processes in radically different ways.
The present research was supported by the European Commission 7th Framework Programme (FP7/2007-2013), “Challenge 2—Cognitive Systems, Interaction, Robotics,” grant agreement No. ICT IP-231722, project “IM-CLeVeR—Intrinsically Motivated Cumulative Learning Versatile Robots” to D. Caligiore; by the Human Frontier Science Program (HFSP), award number RGY0088/2014 to G. Pezzulo; in parts by funds from the Office of Research and Development, Medical Research Service, Department of Veterans Affairs and National Institutes of Health Grants R01 NS24328, R01 MH56661, P40 OD010996, and P30 NS076405 to P. L. Strick; by the European Research Council project MotMotLearn (637488) to J. Galea; by the MRC (grant R/J012610/1) to R.C. Miall and Wellcome Trust, grant WT087554 to R.C. Miall and A. Lago-Rodriguez; by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 341196 to P. F. M. J. Verschure; and by the European Commission’s Horizon 2020 socSMC (under agreement number socSMC-641321H2020-FETPROACT-2014) to I. Herreros. We thank the two anonymous reviewers and Professor Michael A. Arbib who have contributed to enhance the quality of this consensus paper with precious comments.
Conflict of Interest
The authors declare that they have no competing interests.
- 10.Baldassarre G, Caligiore D, Mannella F. The hierarchical organisation of cortical and basal-ganglia systems: a computationally-informed review and integrated hypothesis. In: Baldassarre G, Mirolli M, editors. Computational and robotic models of the hierarchical organization of behavior. Berlin: Springer; 2013. p. 237–70.CrossRefGoogle Scholar
- 18.Dayan P, Abbott LF. Theoretical neuroscience: computational and mathematical modeling of neural systems. J Cognitive Neurosci. 2013;15(1):154–5.Google Scholar
- 19.Caligiore D, Borghi AM, Parisi D, Baldassarre G. Affordances and compatibility effects: a neural-network computational model. In: Mayor J, Ruh N, Plunkett K editors. Connectionist models of behaviour and cognition II: Proceedings of the 11th Neural Computation and Psychology Workshop. Singapore: World Scientific; 2008. p. 15–26Google Scholar
- 25.Schweighofer N, Arbib MA, Dominey PF. A model of the cerebellum in adaptive control of saccadic gain. I. The model and its biological substrate. Biol Cybern. 1996a;75:19–28.Google Scholar
- 26.Schweighofer N, Arbib MA, Dominey PF. A model of the cerebellum in adaptive control of saccadic gain. II. Simulation results. Biol Cybern. 1996b;75:29–36.Google Scholar
- 35.Kishore A, Popa T, Meunier S. Cerebellar influence on motor cortex plasticity: behavioral implications for Parkinson’s disease. Front Neurol. 2014;5:68. doi: 10.3389/fneur.2014.00068.
- 57.Jirenhed DA, Hesslow G. Are Purkinje cell pauses drivers of classically conditioned blink responses? Cerebellum 2015:1–9.Google Scholar
- 59.Carrel AJ, Zbarska S, Zenitsky GD, Bracha V. A trigeminal conditioned stimulus yields fast acquisition of cerebellum-dependent conditioned eyeblinks. Behav Brain Sci. 2012;226(1):189–96.Google Scholar
- 67.Gormezano I, Kehoe EJ, Marshall BS. Twenty years of classical conditioning with the rabbit. Prog Psychobiol Physiol Psychol. 1983;10:197–275.Google Scholar
- 73.Herreros I, Giovannucci A, Taub AH, Hogri R, Magal A, Bamford S, et al. A cerebellar neuroprosthetic system: computational architecture and in vivo test. Front Bioeng Biotechnol. 2014;2:14. doi: 10.3389/fbioe.2014.00014.
- 76.Brandi S, Herreros I, Verschure PFMJ. Optimization of the anticipatory reflexes of a computational model of the cerebellum. In: Lepora NF, Mura A, Krapp HG, Verschure PFMJ, Prescott TJ, editors. Biomimetic and biohybrid systems. Berlin: Springer; 2014. p. 11–22.Google Scholar
- 95.Jörntell H. Cerebellar synaptic plasticity and the credit assignment problem. Cerebellum. 2014. doi: 10.1007/s12311-014-0623-y.
- 99.Houk JC, Adams JL, Barto AG. A model of how the basal ganglia generates and uses neural signals that predict reinforcement. In: Houk JC, Davis JL, Beiser DG, editors. Models of information processing in the basal ganglia. Cambridge, MA: MIT Press; 1995. p. 249–74.Google Scholar
- 101.Houk JC. Action selection and refinement in subcortical loops through basal ganglia and cerebellum. In: Seth AK, Prescott TJ, Bryson JJ, editors. Modelling natural action selection. Cambridge: Cambridge University Press; 2012. p. 176–207.Google Scholar
- 107.Houk J, Mugnaini E. Cerebellum. In: Squire LR, Bloom FE, Roberts JL, McConnell SK, editors. Fundamental neuroscience. San Diego: Academic; 2003. p. 841–72.Google Scholar
- 121.Sereno MI, Diedrichsen J, Tachrount M, Silva G, De Zeeuw CI. Reconstruction and unfolding of the human cerebellar cortex from high-resolution post-mortem MRI. Abst Soc Neurosci. 2014; Abstract No. 733.01, Washington D.C.Google Scholar
- 122.Marr D, Poggio T. From understanding computation to understanding neural circuitry. Artificial Intelligence Laboratory. A.I. Memo 1976; Massachusetts Institute of Technology. AIM-357.Google Scholar
- 132.Pope P, Brenton J, Miall RC. Task-specific facilitation of cognition by anodal transcranial direct current stimulation of the prefrontal cortex. Cereb Cortex. 2015.Google Scholar
- 134.Koziol LF, Budding DE. Subcortical structures and cognition: implications for neuropsychological assessment. Springer Science & Business Media 2009.Google Scholar
- 136.Lakoff G, Johnson M. Philosophy in the flesh. New York: Basic Books; 1999.Google Scholar
- 157.Schlerf JE, Galea JM, Spampinato D, Celnik PA. Laterality differences in cerebellar-motor cortex connectivity. Cereb Cortex. 2015;25(7):1827–34.Google Scholar
- 174.Linssen MW, van Gaalen J, Munneke MA, Hoffland BS, Hulstijn W, van de Warrenburg BP. A single session of cerebellar theta burst stimulation does not alter writing performance in writer’s cramp. Brain. 2015;138(Pt 6):e355. doi: 10.1093/brain/awu321.
- 175.Meunier S, Popa T, Hubsch C, Roze E, Kishore A. Reply: a single session of cerebellar theta burst stimulation does not alter writing performance in writer’s cramp. Brain. 2015;138(Pt 6):e355. doi: 10.1093/brain/awu321.
- 188.Qamhawi Z, Towey D, Shah B, Pagano G, Seibyl J, Marek K, et al. Clinical correlates of raphe serotonergic dysfunction in early Parkinson’s disease. Brain 2015;138(Pt 10):2964–73. doi: 10.1093/brain/awv215.
- 189.Isaias IU, Marzegan A, Pezzoli G, Marotta G, Canesi M, Biella GE, et al. A role for locus coeruleus in Parkinson tremor. Front Hum Neurosci. 2011;5:179. doi: 10.3389/fnhum.2011.00179.
- 199.Caligiore D, Helmich R, Hallett M, Timmermann L, Toni I, Baldassarre G (in preparation). Abnormal interactions in the basal ganglia-cortex-cerebellum system produce Parkinson symptoms.Google Scholar
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.