Abstract
Background
How tissue and organ sizes are specified is one of the great unsolved mysteries in biology. Experiments and mathematical modeling implicate feedback control of cell lineage progression, but a broad understanding of what lineage feedback accomplishes is lacking.
Results
By exploring the possible effects of various biologically relevant disturbances on the dynamic and steady state behaviors of stem cell lineages, we find that the simplest and most frequently studied form of lineage feedback - which we term renewal control - suffers from several serious drawbacks. These reflect fundamental performance limits dictated by universal conservation-type laws, and are independent of parameter choice. Here we show that introducing lineage branches can circumvent all such limitations, permitting effective attenuation of a wide range of perturbations. The type of feedback that achieves such performance - which we term fate control - involves promotion of lineage branching at the expense of both renewal and (primary) differentiation. We discuss the evidence that feedback of just this type occurs in vivo, and plays a role in tissue growth control.
Conclusions
Regulated lineage branching is an effective strategy for dealing with disturbances in stem cell systems. The existence of this strategy provides a dynamics-based justification for feedback control of cell fate in vivo.
See commentary article: http://dx.doi.org/10.1186/s12915-015-0123-7.
Similar content being viewed by others
Background
The sizes of organs are often achieved with high precision, commonly being specified both genetically and autonomously (that is, size is controlled by tissues themselves, and not by their surroundings) [1,2]. Such observations imply that growing tissues ‘know’ the size they need to attain, but how this is implemented is not generally understood.
In engineering, set-point control is commonly achieved through feedback, especially ‘integral’ feedback, in which corrections to system behavior grow in magnitude the longer a system’s output differs from a set-point. The idea that feedback is important in tissue growth control is old [3], but only recently has it been shown that one particular form of feedback - in which the differentiated cells at the ends of lineages (‘terminal cells’) inhibit the self-renewal probability of the stem or progenitor cells that produce them - has the characteristics of an integral control circuit, and can thereby set a steady state or final tissue size that is insensitive to multiple types of perturbations [4].
The existence of this type of feedback has been documented in several cell lineages, including skeletal muscle, the olfactory epithelium, and the hematopoietic system [4-8]. In the first two cases, the direct mediators of feedback are secreted molecules of the tumor growth factor beta (TGF-β) superfamily. The fact that TGF-β family members suppress self-renewal (promoting differentiation) in other lineages as well (for example, [9-11]) suggests that this growth control strategy may be widespread, although the limited spatial ranges over which growth factors and other secreted signaling molecules act (typically 0.1 mm or less [12-17]) suggest that this type of local feedback most likely operates on the tissue, rather than the organ scale (for example, controlling epithelial thickness, or the sizes of compartments like intestinal crypts and epidermal appendages). Still, even if other feedback mechanisms come into play at larger scales (for example, mechanical forces, humoral factors), the general strategy of using a measure of differentiated cell content to feed back upon the renewal-versus-differentiation behavior of stem and progenitor cells - which we refer to here as renewal control - provides an appealing strategy for achieving set-point control of growth, as well as dynamics of growth and regeneration that fit with what is often observed in vivo [8,18,19].
Despite the appeal of the renewal control strategy, there are reasons to expect that it comes at the expense of performance tradeoffs [20], that is, the cost of making tissue growth more robust to certain kinds of perturbations (for example, a subset of those illustrated in Figure 1) might be to make it more fragile to others. Here we show that this is indeed the case, regardless of whether continually renewing or fully differentiated tissues are being produced. In particular, we show that the high-gain feedback necessary for fast response and rejection of certain classes of disturbances invariably renders such systems less robust (or even unstable) in the face of other disturbances. Using tools from robust control theory, we show that the reasons for this limitation are structural, that is, they relate to the nature of the feedback strategy, not choices of parameters used to implement it.
Intriguingly, we find these tradeoffs can be alleviated through an alternate strategy that we refer to as fate control, whereby lineages branch - that is, stem or progenitor cells produce more than one type of differentiated product - and the branching decision becomes the target of feedback control. Remarkably, just such behavior was recently described in the olfactory epithelium, where two TGF-β family members, activin and GDF11, that mediate feedback control of neuron number were found to regulate the progression of neural stem cell progeny down a non-neuronal, supporting-cell lineage branch [5]. Indeed, lineage branching is a common feature of many tissues, both during development and regeneration [21-25]. We show here that such differentiation schemes solve an important, generic control problem in the feedback regulation of growth.
Results
Feedback regulation of stem cell renewal robustly stabilizes lineage pathways
We begin by considering the simplest example of renewal control, in which feedback acts upon a stem cell (type 1) whose progeny either remain stem cells or differentiate into terminal, post-mitotic (type 2) cells (Figure 2A). We let v stand for the rate of cell division (that is, the cell doubling time is ln 2/v); p d for the probability, at each division, that daughter cells differentiate; p r for the probability, at each division, that daughter cells remain stem cells (hence p r =1- p d ); and d for the probability, per unit time, that terminal cells die. If we let x 1 and x 2 stand for the concentrations (or numbers) of stem and terminal cells, respectively, then for large enough cell numbers, the dynamics of the system may be described by a pair of ordinary differential equations:
in which renewal control is represented by the fact that p r and p d are taken to be functions of x 2 (that is, levels of differentiated cells influence the renewal or differentiation choice of stem cells), subject to the condition p r (x 2 ) + p d (x 2 ) = 1. The form of each equation derives from the fact that the rate of production of each cell type occurs at the rate of the stem cell cycle multiplied by two (because two daughter cells are produced with each division) times the probability that a stem cell daughter becomes either a stem cell (p r ) or a differentiated cell (p d ). The additional ‘-1’ in the first equation reflects the fact that, with each stem cell division, one ‘mother’ cell disappears. This model reduces to the one used by [4], if the parameter p r is replaced p and p d by 1-p.
For constant values of p r and p d , system 1 trajectories necessarily blow up for p r > 0.5 and converge to zero for p r < 0.5. A stable steady state requires negative feedback, that is, p r(x 2 ) must be a declining function of x 2 around the value of x 2 at which p r (x 2 ) = 0.5. Such feedback produces not only stability, but also robustness, in the sense that the level of terminal cells in the system at steady state becomes determined only by the relationship between x 2 and p r , and not by the other parameters of the system, v and d, or by initial conditions. Such ‘perfect’ robustness is a result of integral-like control implemented by the feedback loop, with integrator σ = lnx 1 and error e = (2p r (x 2 )-1)v (as alluded to in [4].)
For some steady state properties of system 1, the exact shape of the feedback function is irrelevant, but to understand dynamic behaviors or responses to external perturbations, the details are important, particularly the steepness, or ‘aggressiveness’ with which p r changes with x 2. If we let k r stand for the propensity of stem cells to self-renew, and k d their propensity to differentiate, then the net renewal probability p r can be written as k r /(k r + k d ) = 1/(1 + k d /k r ). In other words, p r can be thought of as a monotonic function of the ratio between underlying propensities to differentiate and renew. In the simulations presented here, we take this ratio to be \( 0.5+0.5{\left({x}_2/{\overline{x}}_2\right)}^n \), such that parameter \( {\overline{x}}_2 \) corresponds to the value of x 2 at which stability (balanced renewal and differentiation) is achieved, and parameter n captures the feedback gain (steepness). This parameterization approximates most smooth, monotonic saturating functions well enough that the qualitative behaviors we report below hold true even when p r is defined in a variety of other ways. This is because, as we show, the critical feature for these behaviors is the slope of p r near the steady state, which is directly related to the aggressiveness (gain) of the feedback.
Renewal control is sensitive to many types of biologically relevant disturbance
As shown in Figure 1, stem cell systems potentially face many kinds of perturbation. ‘Active’ stem cells may be recruited from ‘quiescent’ populations, and stem cells may undergo cell death, or become quiescent themselves. The speed of the cell cycle may vary from cell to cell, and may be influenced by environmental factors (for example, proximity to nutrients, temperature gradients). Environmental inputs may also affect the decision to renew or differentiate, but even without environmental forcing, stochastic effects that result from symmetric patterns of divisions (where both stem cell progeny adopt the same fate, as occurs commonly in many mammalian tissues) will create substantial fluctuations in stem cell pool sizes [26]. Rates of loss of terminally differentiated stem cell progeny can also be expected to fluctuate because of disease, injury, or variable patterns of organ use. For example, in the olfactory epithelium, in which feedback controls neuron number [4,5,27], the rate of neuron turnover is highly dependent on the environment in which animals are reared [28].
Figure 2 illustrates the effects of some of these kinds of perturbations on the behavior of a renewal-controlled lineage (system 1, as shown schematically in panel A). For example, simulations in panels B-E explore the effects of a time-varying rate of loss of terminal cells (parameter d). In panel B, stochastic noise is added to this loss rate (here the gain of the feedback is taken to be n = 2). Notice how, even though the system’s steady state behavior would be perfectly robust to a constant step change in d, it does not compensate well for fluctuating d. In panels C and D, the fluctuations imposed on d are oscillatory, at fixed frequencies, and the effect of different feedback gains is considered (in engineering it is common to characterize the responses of systems to sinusoidal perturbations because, as discussed below, time-varying perturbations can always be decomposed into sums of sinusoids). The results show that increasing feedback gain helps suppress the effects of low frequency oscillations in d, but amplifies the effects of high frequency ones.
It is not necessary to use fluctuating or periodic disturbances to bring out the limitations of high-gain feedback. For example, in Figure 2E, the system was subjected to a constant loss of 10% of stem cells per cell cycle (for example, representing stem cell death, or diversion of stem cells to differentiate in an alternate way). This produces a steady state error in the number of terminal cells. With increasing feedback gain the error can be diminished (it is straightforward to show that the steady state error - that is, the difference between the unperturbed and perturbed steady state populations of stem cells, see Box 1 for details - is equal to \( \left(1-{0.636}^{1/n}\right){\overline{x}}_2 \)), but this occurs only at the expense of producing ever larger oscillations in terminal cell numbers.
Figure 2F models the response to an acute injury that removes a large proportion (half) of all terminal cells. With increasing feedback gain, the system can recover its terminal cells (that is, regenerate) ever more rapidly, but only at the expense of larger, longer-lasting oscillations. Indeed, for high enough gain (n > 4), oscillations become so large that, effectively, no steady state is achieved. In tissues that rapidly regenerate after just such injuries, for example, the olfactory epithelium and the liver, such large swings in terminal cell number are not observed [18,19] although, interestingly, marked oscillations in terminal cell numbers do happen in some tissues [29], as well as in a variety of pathological conditions [30-33].
Finally, Figure 2G,H models the impact of stochasticity in stem cell numbers, as might be expected to arise due to random patterns of division. Such fluctuations can be large for small, compartmentalized stem cell pools (for example, intestinal crypts, in which random symmetric divisions drive frequent extinction of stem cell clones [34]) but may even be significant in large, non-compartmentalized epithelia. This is because secreted factors that mediate lineage feedback will have limits to their spatial range, so that if most cells tend to remain close to where they were generated, feedback will be effectively compartmentalized, even if there are no fixed boundaries. In these simulations, stochasticity was introduced through adding a noise term (birth-death process) to the right hand side of the first equation of system 1. As the results show, for low feedback gains, feedback reduces the variation in stem and terminal cell numbers, but with increasing gain this effect reverses, and the variance increases. At the highest gains (when feedback is effectively switch-like), the probability distribution for terminal cell numbers becomes very broad (Figure 2H).
Simulations of the effects of other types of disturbances show similar tradeoffs between the ability of high feedback gains to reject disturbances and the ability of the system to avoid oscillation and instability (Additional file 1: Figure S2). These include constant increases to stem cell numbers (as might reflect the recruitment of quiescent cells) or fluctuations in the parameters underlying the feedback function itself (for example, the intrinsic propensity of cells to differentiate or renew), as might reflect normal variability in the levels of cellular proteins that drive cellular decision-making.
Performance limitations are imposed by the structure of the lineage pathway
In the above examples, steady state errors created by some, but not all, disturbances to a renewal-controlled lineage can be reduced by aggressive feedback, but high feedback gains also bring on oscillations and instability. What accounts for such behavior? Is it a result of particular choices of parameters, or the means of realizing the feedback?
The tools of robust control theory provide a way to address such questions. Briefly, for a given system, one can calculate a frequency-dependent function S - the sensitivity function - that captures the ability of feedback control to attenuate disturbances of different frequencies (see Box 1). When |S| < 1, feedback diminishes the effect of a perturbation; when |S| > 1 it amplifies it. Because time-varying disturbances can be decomposed into components of different frequencies, a plot of |S| versus frequency provides a global view of performance. Such a plot is shown for system 1 in Figure 2I, for different values of feedback gain. In all cases, feedback attenuates low-frequency (slowly changing) disturbances, but amplifies high-frequency (rapidly changing) ones. The higher the gain, the better the performance at low frequencies and the worse the performance at high ones. This suggests that ‘hard limits’ underlie the behaviors observed in Figure 2B-H. Indeed, as shown in Box 2 (and explained further in Additional file 1: Supporting Information), the architecture of system 1 ensures that |S| must obey a conservation law, implying that |S| cannot be made small for all frequencies simultaneously. In effect, improved performance (smaller |S|) for a certain range of frequencies necessarily implies poorer performance (larger |S|) for some other range of frequencies. The existence of this tradeoff is independent of both the parameters of the system and the way feedback is realized, that is, the functional form of p r(x 2).
A second limitation imposed solely by the structure of the system involves a relationship between the aggressiveness of feedback and stability (the ability to reach a steady state). As shown in Figure 2I, beyond a certain level of gain, perturbation frequencies exist at which |S| approaches infinity (a phenomenon known as high-gain instability). This corresponds to the observation, seen in Figure 2E-G, of sustained oscillations when feedback gains are sufficiently high (for example, n > 4).
In Figure 2I, disturbance frequencies are expressed in time units equal to the length of the stem cell cycle. Thus, one way to make the system better able to reject higher-frequency perturbations would be to speed up cell division so that, relative to the cell cycle, any given perturbation would be of lower frequency. Indeed, introducing additional negative feedback control of cell cycle speed v - as does occur with GDF11 in the olfactory epithelium [4] - can modestly extend the range of disturbance frequencies over which robust control can be achieved. It does not, however, remove the performance limitations imposed by the system’s structure (see Additional file 1: Supporting Information for further details). Such limitations also persist if the length of the lineage is increased (by adding an intermediate cell stage to the pathway).
Removing performance limitations through controlled pathway branching
The reason the performance limitations discussed above are inherent in the structure of system 1 is that the probabilities of renewal and differentiation are necessarily coupled. With stem cells able to make only two choices at each division, negative regulation of one of them implies positive regulation of the other. But stem and progenitor cells could have other choices. They could differentiate along an alternate trajectory, producing a different cell type, becoming quiescent, or even choosing to die. Such choices create branches in cell lineages, and examples of such branching exist in both vertebrates and invertebrates, during development and regeneration, and in both solid and blood-borne tissues [21-25]. Even in tissues in which lineage branching has not been demonstrated directly, the observation that different cell types appear in temporal waves (either during development or regeneration) is consistent with the model of a common stem or progenitor cell that gradually alters its differentiation choices over time (for example, [35,36]).
The behavior of the simplest system in which a stem cell under feedback control by descendants of one cell type (‘type 2’) can choose stochastically to switch to production of an alternate differentiated cell type (‘type 3’) is:
in which p a(x 2) stands for the probability of choosing the type 3 fate. Because type 3 cells are not taken to have any influence on the production of type 1 or type 2 cells, the first two equations are identical to those in system 1; indeed if the alternative cell fate is death, then the third equation can be omitted altogether. What is significantly different about system 2 is that the condition p r (x 2) + p d (x 2) = 1 no longer holds, being replaced by p r (x 2) + p d (x 2) + p a (x 2) = 1. This means that regulation of p r(x 2) in one direction no longer guarantees that p d(x 2) must change in the opposite direction. The possible ways in which p r(x 2) and p d(x 2) may now be jointly regulated are enumerated in Figure 3A.
The first two strategies shown are either unstable or unrealizable. The third strategy is, essentially, renewal control, and suffers from all the limitations discussed above. The last strategy, however, in which there is positive feedback regulation of p a with simultaneous negative regulation of p r and p d, behaves dramatically differently. A cartoon representation of system 2 with this feedback strategy - which we refer to here as fate control - is shown in Figure 4A.
As before, we motivate our choice for the form of the feedback function by considering that the three probabilities, p r, p d, and p a, arise from independent propensities, k r, k d, and k a, to self renew, differentiate into type 2 cells, or differentiate into type 3 cells, respectively. With positive feedback on k a, that is, k a(x 2) that is monotonically increasing in x 2, there can now be negative feedback on both p r and p d, because:
For simplicity, we consider here the situation in which k r and k d are not themselves regulated, so that they maintain a fixed ratio κ = k d/k r; consequently p d = κp r. In most numerical simulations we take \( {k}_r=1,{k}_d=0.5,\kern0.5em {k}_a\left({x}_2\right)=0.5{\left({x}_2/{\overline{x}}_2\right)}^n \). However, as before, the results are not particularly sensitive to this parameterization. This is because, as before, the critical feature is the slope of p r and p d near the steady state, which is directly related to the aggressiveness of the feedback.
Figure 4 illustrates the performance of this system in exactly the same disturbance scenarios that were explored for renewal control in Figure 2. The previously identified performance tradeoffs and instabilities are now gone. Fluctuations in the turnover rate of type 2 cells are effectively suppressed by high-gain feedback without introducing any oscillatory tendency (Figure 4B-D). High feedback gain also enables the system to compensate for both a constant rate of loss of stem cells, and an abrupt removal of terminal cells, without the risk of instability in either case (Figure 4E,F). Such feedback also prevents stochastic fluctuations in stem cell numbers from propagating to terminal cell numbers (Figure 4G,H).
The reason for these dramatic improvements is evident in the plot of |S| versus disturbance frequency (Figure 4I). No longer does a conservation law require reductions in |S| at some frequencies to be balanced by increases in |S| at others. No longer does high feedback gain promote instability. As a result, high gains can be used to enable responses to disturbances that are arbitrarily fast (gains up to n = 100 are considered in Figure 4C-H). Under such conditions, the response to a deficit of terminal cells of type 2 would be for stem cells to renew and generate cells of type 2 at a constant, high rate until a sufficient number were produced, then rapidly switch to generating cells of type 3.
Branched lineages and layered architectures
Branched lineages can escape the performance limitations of unbranched ones because, through fate control, they can realize negative feedback on both the probability of replication (p r ) and the probability of differentiation into terminal cells (p d ). But what about the alternative fate that the lineage branch creates? In the event that that fate is not cell death, will the numbers of such cells be well controlled? In system 2, with p r a decreasing function of x 2, we see that the value of the alternate cell population (x 3 ) always reaches a steady state, but unlike x 2 , it is not robust, being linearly dependent on d/d 3 , the ratio of the turnover rates of x 2 and x 3 . Moreover, cell type 3 is highly ‘exposed’ to disturbances, as disturbances on the other cell types directly affect the dynamics of x 3, and there is no direct influence of x 3 on its own value. Put another way, whereas the existence of cell type 3 can help solve some of the control problems faced by cell type 2, controlling cell type 3 requires additional mechanisms (and those mechanisms should not interfere with the control of cell type 2).
If cell type 3 is a terminally differentiated cell, there are not too many options, other than to regulate its turnover. But if it is a progenitor cell, it could receive negative feedback from its own differentiated progeny, much like cell type 1 does. We refer to this as a ‘layered’ lineage architecture because one layer (progenitor cell type 1 fed back upon by differentiated cell type 2) branches to give rise to a second layer (progenitor cell type 3 fed back upon by differentiated cell type 4). Of course, we might expect that negative feedback at the second layer will be subjected to the same challenges and tradeoffs discussed for simple unbranched lineages (that is, system 1), unless that layer itself branches, creating a progenitor cell type 5 that is fed back upon by a differentiated cell type 6.
Indeed, one could imagine a succession of many layers, each controlling itself through feedback, and branching to produce the next layer. In fact, there are many in vivo systems in which the dynamics of cell type production and progenitor cell potency suggest the existence of such layered architectures (see Discussion). To explore their control implications, we compare two different layered scenarios: in one (Figure 3B), negative feedback occurs at each stage only through down-regulation of p r and up-regulation of p d (that is, renewal control). In the other (Figure 3C), feedback at each stage occurs through up-regulation of p a , with concomitant down-regulation of both p r and p d (fate control).
Analysis of steady state behavior indicates that either strategy improves parametric robustness (insensitivity to parameters), although perfect robustness exists only at the first layer. At each subsequent layer, integral feedback control is ‘leaky’, due to the (uncontrolled) influx of cells from the previous layer. The size of this leak at any given level can be kept small by having the influx from the previous level be small compared with the expansion of progenitors at that level.
In terms of responses to the sorts of disturbances described in Figures 2 and 4, the renewal control and fate control strategies perform very differently. Figure 5 illustrates responses to the same kind of stochastic disturbances that were explored in Figures 2B and 4B, applied now to all three stem/progenitor cell types in a three-layer branched lineage. With renewal control (Figure 5A,C), disturbances are transmitted to and may even be amplified at the level of the terminal cells. By contrast, with fate control (Figure 5B,D), the effects of such disturbances can be damped out (for these simulations, a feedback gain of n = 2 was used in the renewal control example, as it gave the best control, whereas a gain of n = 100 was used in the fate control example). These results closely mimic what was seen in Figures 2B and 4B, and the reasons are the same: fate control can exploit high-gain feedback to suppress disturbances, whereas renewal control cannot.
Branched lineages and ‘final state’ tissues
Not all tissues arrive at a final size through a balance between cell production and cell loss. Many tissues are generated by stem cells that exist only transiently during development, producing terminal cells that survive for the life of the organism. For example, most of the mammalian nervous system falls into this category [35]. Such self-terminating, or ‘final state’ tissues can be modeled using the same approach as for steady state tissues, by simply setting the turnover rates for terminal cells to zero [4]. For a simple, unbranched, one-stage lineage with renewal control, nearly perfect robustness of final terminal cell numbers can be observed [4], demonstrating that renewal control provides integral feedback in final state tissues as well as steady state ones.
Should the effects of perturbations on models of final state tissues also resemble what occurs in steady state models? Intuition suggests that terminal cell oscillations will not occur in final state models, because the oscillations in steady state models depend upon cell turnover (that is, they are ‘relaxation’ oscillations). Instead, the consequence of overshooting a goal should simply be an irremediable overproduction of terminal cells.
To explore, quantitatively, the effect of feedback and branching on final state systems, we studied the same three-layer lineages and feedback strategies shown in Figure 5, but set cell turnover rates to zero. Figure 6A,B shows the dynamics of production of the initial terminal cell type (type 2 cells), either using renewal control or fate control at different feedback gains. Parameters were chosen to produce the same final numbers in both cases. We note that the total number of cell divisions does not differ substantially between the two cases.
In Figure 6C,D we explore the effects of a constant perturbation to stem cells (type 1 cells), by imposing a steady loss rate on x 1 , similar to what was done in Figures 2E and 4E. As anticipated, oscillations are not seen, but final state errors in the numbers of terminal (type 2) cells occur. These are plotted in Figure 6C,D as a function of the feedback gain. Here we see that high gain improves performance for both control strategies, but with renewal control (C) the effect is modest at best, with the final disturbance to terminal cell numbers actually exceeding the fractional rate of stem cell loss. By contrast, with fate control (D), a sufficiently high gain can suppress the effects of stem cell loss nearly completely (up to reasonable loss rates).
Figure 6E,F shows the dynamics of terminal cell production for a three-layered topology when there is no disturbance present and when there is loss of stem-like cells at each of the layers. One noticeable difference is that fate control (F) generates terminal cell types in distinct temporal waves, whereas with renewal control (E), all cell types appear more or less at the same time. Furthermore, with renewal control the timing of cell type production does not change substantially when there is stem cell loss, whereas with fate control the production of terminal cell types is markedly delayed (even though this strategy eventually does a much better job of producing desired final cell numbers).
Discussion
Feedback regulation of cell lineage progression has recently been recognized as an important strategy for the control of tissue growth and homeostasis (for example, [4,6,8,37]). Negative regulation of stem or progenitor cell renewal by differentiated progeny - a strategy we refer to here as renewal control - can stabilize stem cell numbers, speed regeneration, and establish tissue sizes that are robust both to growth parameters (cell cycle speed, cell turnover) and initial conditions [4,38]. Yet, as we demonstrate here, this strategy also limits the ability of tissues to deal with a variety of realistic perturbations, including losses or additions to stem cell pools, or time-varying disturbances to cell numbers or growth parameters. By contrast, feedback regulation of lineage branching can circumvent these limitations. We refer to fate control as the strategy by which differentiated cells drive stem or progenitor cells to differentiate along a secondary fate pathway, at the expense (at least in part) of stem or progenitor cell renewal. The latter stipulation ensures that fate control also incorporates negative feedback on renewal, which is why it still achieves the desirable stability and robustness properties of renewal control, even while escaping the latter’s limitations.
Fundamentally, the limitations of renewal control arise because of the unavoidable coupling between renewal and differentiation, which causes responses to perturbations initially to go in a ‘wrong’ (that is, anti-homeostatic) direction. For example, with renewal control, an excess of differentiated cells will eventually restore their numbers through suppression of stem cell renewal (which lowers the number of stem cells). But because the only alternative to renewal is differentiation, reducing renewal will always initially lead to an increase in differentiated cell numbers, the opposite of a restoring effect. Such maladaptive dynamics are characteristic of what, in control theory terminology, is referred to as a ‘non-minimum phase’ system, and it is straightforward to show that an unbranched, renewal-controlled lineage is structurally non-minimum phase. By contrast, a fate control strategy is minimum phase, because differentiation (down a primary fate pathway) and renewal can be suppressed simultaneously (through up-regulation of progression toward an alternative fate). Control engineers make considerable efforts to avoid non-minimum phase systems, as they are generally subject to undesirable tradeoffs, the most serious of which can be captured by conservation laws requiring that the attenuation of some disturbances must come at the expense of the amplification of others. The presence of such tradeoffs for renewal control is clearly shown in Figures 2, 5, and 6. One of the most severe tradeoffs is that increasing feedback gains, which might otherwise help with the rejection of disturbances, can lead to increasing oscillation and, ultimately, instability. By contrast, with fate control, high gains (for example, switch-like responses) are never problematic (and often desirable).
In view of these findings, one might expect fate control to be especially prevalent in biology. Identifying it in biological data requires showing both that a lineage is branched, and that feedback promotes differentiation toward an alternative fate. Many lineages are indeed branched, including ones in the hematopoietic system, the nervous system, and connective tissue [22-25]. Even in tissues in which lineage relationships are not fully understood, the sequential appearance of cell types over time, during development or regeneration, often suggests lineage branching (for example, [39]). Moreover, hematopoietic and neural lineages are commonly depicted in terms of layered branching architectures similar to those in Figure 3 [21,23]. It should be noted that nothing about fate control as a feedback strategy requires layered lineages to be as deterministic and irreversible as suggested by Figure 3: even an architecture in which a multipotent stem cell always has some probability of producing every differentiated cell type, and simply gradually changes those probabilities as different cell types are produced, should behave similarly - from the standpoint of control - to an architecture with fixed layers.
Evidence that feedback factors produced by terminal cells promote fate transitions is harder to come by, but observations in at least two systems - the olfactory epithelium and the neural retina - support this view. In the mouse olfactory epithelium, it was recently shown that a single type of stem cell acts as the precursor of both the committed progenitors of neurons and sustentacular (glial) cells [5]. Activin βB, which is produced by the neuronal cells of the epithelium, feeds back onto this stem cell to inhibit neuronal, and favor glial, differentiation. The fact that stem cell numbers rise in activin βB-null mutant mice implies that activin not only promotes glial fate choice but also decreases stem cell renewal, as required by an effective fate control strategy. The molecular mechanism of activin action in this tissue provides a likely explanation for its fate-controlling effect, as it targets for rapid degradation the transcription factor Ascl1, which is known to drive neuronal fate choice (in this tissue and in others [5,40-42]).
In the mouse retina, ganglion cells (one of the earliest-generated neuronal cell types) produce GDF11, which feeds back on multipotent retinal progenitors to decrease the probability that their offspring adopt a ganglion cell fate, and increase the probability that amacrine and photoreceptor cells (which normally appear after ganglion cells) are produced [43]. The production of still other cell types of the neural retina in an orderly sequence suggests that other fate-controlling signals either direct sequential lineage branching (for example, as diagrammed in Figure 3), or gradually alter the alternate fates available at the end of a single lineage branch (as recently proposed [44]). The molecular nature of such signals has yet to be discovered, however.
Studies in the intestine also provide evidence for fate control as a strategy for regulating cell numbers. In mouse intestine, the effects of genetic ablation of bone morphogenetic protein (BMP) receptors from the intestinal epithelial lineage indicate that the BMPs produced by one class of terminal cells (enterocytes, or absorptive cells) feed back to promote differentiation of a common progenitor into enteroendocrine cells, an alternate lineage branch [45]. That this feedback is involved in the control of terminal cell numbers is demonstrated by the increased number of dividing cells per crypt, and increased villus length, in the receptor-mutant animals.
Other examples of cell number control via fate control are likely to exist, especially if one expands the notion of fate choice to include cell emigration or death. For example, in the hematopoietic system, regulated stem cell death is known to play an important role in controlling steady state cell numbers [46], and it has been suggested that mobilization of stem cells from the marrow to the blood serves a similar homeostatic role [47]. The high rate of progenitor cell death that is observed in lymphoid lineages [48] could also play a role in numerical homeostasis, outside of its known role in selection for appropriate antigen-reactivity. Even in the nervous system, it has recently been argued that regulated progenitor cell death plays an important role in tissue size control [49].
As discussed above, one of the advantages of a fate control feedback strategy is that it allows for the use of high gain (that is, steep feedback) to suppress disturbances. Although it is not simple to measure gains in vivo, recent observations in the developing mouse intestinal epithelium [36] support the view that, in at least some cases, gains are indeed high: in that tissue, postnatal development is characterized by a period of nearly pure exponential expansion of stem cells, which switches abruptly to one of stem cell homeostasis (stabilizing enterocyte production at a roughly constant rate). Switching occurs in each crypt as it reaches a threshold size, suggesting control by local feedback. The abruptness of the switch (the extent to which stem cell renewal does not decrease until crypts have reached nearly their full complement of stem cells) suggests a high feedback gain.
Although the present study demonstrates some of the advantages of fate control over renewal control, in terms of stability and disturbance rejection, it should come as no surprise that fate control also entails tradeoffs. For example, the mechanisms required to enable controlled lineage branching and high gain are likely more complex than those needed simply to regulate renewal. In addition, high-gain control forces cells of different types to appear in a sequential fashion (the higher the gain, the less overlapping the periods of production), which might not be desirable in all tissues. And when the purpose of an alternative fate is solely to control the numbers of cells that adopt a primary fate (that is, when the alternative fate is death or emigration), fate control is associated with the extra ‘overhead’ (in terms of time and materials) of producing cells that are not actually needed. Thus, the extent to which tissues are better served by renewal control or fate control is likely to depend strongly on the timing with which cells of different types are needed, the types of disturbances that are likely to arise, and the costs of implementing each type of strategy.
It should also be kept in mind that the analysis and simulations in the present study explore only some of the simplest possible implementations of renewal and fate control. A variety of additional interactions could modify or expand the options for achieving effective control; these might include feedback from non-terminal cells; alternative fates that can later be reversed (for example, quiescence; see Additional file 1: Supporting Information); a ratio of propensities to renew versus adopt a primary fate that is not held constant, but varies with feedback; positive feedback on renewal; and spatial effects (where the diffusion of feedback signals is explicitly accounted for). Exploration of these and other possibilities may be needed before detailed validation of specific control models with biological data will become practicable.
Conclusions
Tissues achieve and maintain appropriate sizes in large part through the regulated progression of cells through lineages. Although negative feedback control of self-renewal has been shown to play an important role in this process, pure renewal control - in which differentiation along a single pathway is the only alternative - brings with it a variety of undesirable properties. Using tools from robust control theory, we show that the limitations of renewal control can be circumvented through the introduction of lineage branching, with feedback promoting alternate fate choice at the expense of both primary fate choice and self-renewal. Generic results such as these allow us to interpret common biological phenomena, such as lineage branching, sequential production of cell types, and programmed cell death, in a new light: not as mechanisms required to produce the cells of a tissue, but as hallmarks of a strategy for achieving control over cell numbers and dynamics.
Methods
Simulations were done using the control systems toolbox and the ode solver ode45 in MathWorks Matlab 8.1. The derivations of the transfer functions are shown in Additional file 1: Supporting Information.
References
Day SJ, Lawrence PA. Measuring dimensions: the regulation of size and shape. Development. 2000;127:2977–87.
Wolpert L. Arms and the man: the problem of symmetric growth. PLoS Biol. 2010;8:e1000477.
Bullough WS. Mitotic and functional homeostasis: a speculative review. Cancer Res. 1965;25:1683–727.
Lander AD, Gokoffski KK, Wan FYM, Nie Q, Calof AL. Cell lineages and the logic of proliferative control. PLoS Biol. 2009;7:e1000015.
Gokoffski KK, Wu HH, Beites CL, Kim J, Kim EJ, Matzuk MM, et al. Activin and GDF11 collaborate in feedback control of neuroepithelial stem cell proliferation and fate. Development. 2011;138:4131–42.
Kirouac DC, Madlambayan GJ, Yu M, Sykes EA, Ito C, Zandstra PW. Cell-cell interaction networks regulate blood stem and progenitor cell fate. Mol Syst Biol. 2009;5:293.
Kirouac DC, Ito C, Csaszar E, Roch A, Yu M, Sykes EA, et al. Dynamic interaction networks in a hierarchically organized tissue. Mol Syst Biol. 2010;6:417.
Marciniak-Czochra A, Stiehl T, Ho AD, Jager W, Wagner W. Modeling of asymmetric cell division in hematopoietic stem cells - regulation of self-renewal is essential for efficient repopulation. Stem Cells Dev. 2009;18:377–85.
Kitisin K, Saha T, Blake T, Golestaneh N, Deng M, Kim C, et al. TGF-β signaling in development. Sci STKE. 2007;2007:cm1.
Gamez B, Rodriguez-Carballo E, Ventura F. BMP signaling in telencephalic neural cell specification and maturation. Front Cell Neurosci. 2013;7:87.
Jarrin M, Pandit T, Gunhaga L. A balance of FGF and BMP signals regulates cell cycle exit and Equarin expression in lens cells. Mol Biol Cell. 2012;23:3266–74.
Teleman AA, Cohen SM. Dpp gradient formation in the Drosophila wing imaginal disc. Cell. 2000;103:971–80.
Yu SR, Burkhardt M, Nowak M, Ries J, Petrasek Z, Scholpp S, et al. Fgf8 morphogen gradient forms by a source-sink mechanism with freely diffusing molecules. Nature. 2009;461:533–6.
Muller P, Rogers KW, Jordan BM, Lee JS, Robson D, Ramanathan S, et al. Differential diffusivity of Nodal and Lefty underlies a reaction–diffusion patterning system. Science. 2012;336:721–4.
Sarris M, Masson JB, Maurin D, Van der Aa LM, Boudinot P, Lortat-Jacob H, et al. Inflammatory chemokines direct and restrict leukocyte migration within live tissues as glycan-bound gradients. Curr Biol. 2012;22:2375–82.
Shimozono S, Iimura T, Kitaguchi T, Higashijima S, Miyawaki A. Visualization of an endogenous retinoic acid gradient across embryonic development. Nature. 2013;496:363–6.
Weber M, Hauschild R, Schwarz J, Moussion C, de Vries I, Legler DF, et al. Interstitial dendritic cell guidance by haptotactic chemokine gradients. Science. 2013;339:328–32.
Calof AL, Hagiwara N, Holcomb JD, Mumm JS, Shou J. Neurogenesis and cell death in olfactory epithelium. J Neurobiol. 1996;30:67–81.
Michalopoulos GK, DeFrances MC. Liver regeneration. Science. 1997;276:60–6.
Csete ME, Doyle JC. Reverse engineering of biological complexity. Science. 2002;295:1664–9.
Livesey FJ, Cepko CL. Vertebrate neural cell-fate determination: lessons from the retina. Nat Rev Neurosci. 2001;2:109–18.
Ohlstein B, Spradling A. The adult Drosophila posterior midgut is maintained by pluripotent stem cells. Nature. 2006;439:470–4.
Orkin SH, Zon LI. Hematopoiesis: an evolving paradigm for stem cell biology. Cell. 2008;132:631–44.
Ribes V, Balaskas N, Sasai N, Cruz C, Dessaud E, Cayuso J, et al. Distinct Sonic Hedgehog signaling dynamics specify floor plate and ventral neuronal progenitors in the vertebrate neural tube. Genes Dev. 2010;24:1186–200.
Frenette PS, Pinho S, Lucas D, Scheiermann C. Mesenchymal stem cell: keystone of the hematopoietic stem cell niche and a stepping-stone for regenerative medicine. Annu Rev Immunol. 2013;31:285–316.
Sun Z, Komarova NL. Stochastic modeling of stem-cell dynamics with control. Math Biosci. 2012;240:231–40.
Wu HH, Ivkovic S, Murray RC, Jaramillo S, Lyons KM, Johnson JE, et al. Autoregulation of neurogenesis by GDF11. Neuron. 2003;37:197–207.
Hinds JW, Hinds PL, McNelly NA. An autoradiographic study of the mouse olfactory epithelium: evidence for long-lived receptors. Anat Rec. 1984;210:375–83.
Plikus MV, Mayer JA, de la Cruz D, Baker RE, Maini PK, Maxson R, et al. Cyclic dermal BMP signalling regulates stem cell activation during hair regeneration. Nature. 2008;451:340–8.
Haurie C, Dale DC, Mackey MC. Cyclical neutropenia and other periodic hematological disorders: a review of mechanisms and mathematical models. Blood. 1998;92:2629–40.
Mahaffy JM, Edelstein-Keshet L. Modeling cyclic waves of circulating T cells in autoimmune diabetes. Siam J Appl Math. 2007;67:915–37.
Dingli D, Antal T, Traulsen A, Pacheco JM. Progenitor cell self-renewal and cyclic neutropenia. Cell Prolif. 2009;42:330–8.
Colijn C, Fowler AC, Mackey MC. High frequency spikes in long period blood cell oscillations. J Math Biol. 2006;53:499–519.
Snippert HJ, van der Flier LG, Sato T, van Es JH, van den Born M, Kroon-Veenboer C, et al. Intestinal crypt homeostasis results from neutral competition between symmetrically dividing Lgr5 stem cells. Cell. 2010;143:134–44.
Donovan SL, Dyer MA. Regulation of proliferation during central nervous system development. Semin Cell Dev Biol. 2005;16:407–21.
Itzkovitz S, Blat IC, Jacks T, Clevers H, van Oudenaarden A. Optimality in the development of intestinal crypts. Cell. 2012;148:608–19.
Manceau M, Gros J, Savage K, Thome V, McPherron A, Paterson B, et al. Myostatin promotes the terminal differentiation of embryonic muscle progenitors. Genes Dev. 2008;22:668–81.
Lo WC, Chou CS, Gokoffski KK, Wan FY, Lander AD, Calof AL, et al. Feedback regulation in multistage cell lineages. Math Biosci Eng. 2009;6:59–82.
Duncan AW, Dorrell C, Grompe M. Stem cells and liver regeneration. Gastroenterology. 2009;137:466–81.
Vierbuchen T, Ostermeier A, Pang ZP, Kokubu Y, Sudhof TC, Wernig M. Direct conversion of fibroblasts to functional neurons by defined factors. Nature. 2010;463:1035–41.
Serre A, Snyder EY, Mallet J, Buchet D. Overexpression of basic helix-loop-helix transcription factors enhances neuronal differentiation of fetal human neural progenitor cells in various ways. Stem Cells Dev. 2012;21:539–53.
Imayoshi I, Isomura A, Harima Y, Kawaguchi K, Kori H, Miyachi H, et al. Oscillatory control of factors determining multipotency and fate in mouse neural progenitors. Science. 2013;342:1203–8.
Kim J, Wu HH, Lander AD, Lyons KM, Matzuk MM, Calof AL. GDF11 controls the timing of progenitor cell competence in developing retina. Science. 2005;308:1927–30.
He J, Zhang G, Almeida AD, Cayouette M, Simons BD, Harris WA. How variable clones build an invariant retina. Neuron. 2012;75:786–98.
Auclair BA, Benoit YD, Rivard N, Mishina Y, Perreault N. Bone morphogenetic protein signaling is essential for terminal differentiation of the intestinal secretory cell lineage. Gastroenterology. 2007;133:887–96.
Oguro H, Iwama A. Life and death in hematopoietic stem cells. Curr Opin Immunol. 2007;19:503–9.
Abkowitz JL, Robinson AE, Kale S, Long MW, Chen J. Mobilization of hematopoietic stem cells during homeostasis and after cytokine exposure. Blood. 2003;102:1249–53.
Opferman JT. Apoptosis in the development of the immune system. Cell Death Differ. 2008;15:234–42.
McConnell MJ, MacMillan HR, Chun J. Mathematical modeling supports substantial mouse neural progenitor cell death. Neural Dev. 2009;4:28.
Jacobsen EW. On the dynamics of integrated plants - non-minimum phase behavior. J Process Control. 1999;9:439–51.
Chandra FA, Buzi G, Doyle JC. Glycolytic oscillations and limits on robust efficiency. Science. 2011;333:187–92.
Buzi G, Doyle J. Topological tradeoffs in autocatalytic metabolic pathways. In: Proceedings of the 49th Conference on Decision and Control (CDC), 15–17 December 2010, Georgia, Atlanta. IEEE: New York; 2010. p. 4697–702.
Skogestad S, Postlethwaite I. Multivariable feedback control: analysis and design. 2nd ed. Hoboken, NJ: John Wiley; 2005.
Freudenberg JS, Looze DP. Right half plane poles and zeros and design tradeoffs in feedback-systems. IEEE T Automat Contr. 1985;30:555–65.
Acknowledgements
We thank John Doyle, Anne Calof, and Sameeran Kunche for helpful discussions, and Jeremy Green for critical reading of the manuscript. This work was supported by ETH Zurich, the Human Frontier Science Program Grant RGP0061/2011 and NIH grant P50-GM076516.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
GB conceived the project, developed the models and performed the simulations, analyzed the results, and wrote the manuscript. ADL analyzed the results, helped guide the research direction, provided biological insights and connections, and wrote the manuscript. MK analyzed the results, helped guide the research direction, supervised the computational and control theoretic aspects, and wrote the manuscript. All authors read and approved the final manuscript.
Authors’ information
ADL and MK are co-senior authors.
Additional file
Additional file 1:
Supporting Information. Modeling and Analysis Details. Table S1: Parameter values used in the simulations shown in Figures 2 and 4. Table S2: Parameter values used in the simulations shown in Figures 5 and 6. Figure S1: Steady state perturbations. Figure S2: Renewal control disturbance response. Figure S3: Fate control disturbance response.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Buzi, G., Lander, A.D. & Khammash, M. Cell lineage branching as a strategy for proliferative control. BMC Biol 13, 13 (2015). https://doi.org/10.1186/s12915-015-0122-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12915-015-0122-8