# Coping with time scales in disease systems analysis: application to bone remodeling

## Abstract

In this study we demonstrate the added value of mathematical model reduction for characterizing complex dynamic systems using bone remodeling as an example. We show that for the given parameter values, the mechanistic RANK-RANKL-OPG pathway model proposed by Lemaire et al. (J Theor Biol 229:293–309, 2004) can be reduced to a simpler model, which can describe the dynamics of the full Lemaire model to very good approximation. The response of both models to changes in the underlying physiology and therapeutic interventions was evaluated in four physiologically meaningful scenarios: (i) estrogen deficiency/estrogen replacement therapy, (ii) Vitamin D deficiency, (iii) ageing, and (iv) chronic glucocorticoid treatment and its cessation. It was found that on the time scale of disease progression and therapeutic intervention, the models showed negligible differences in their dynamic properties and were both suitable for characterizing the impact of estrogen deficiency and estrogen replacement therapy, Vitamin D deficiency, ageing, and chronic glucocorticoid treatment and its cessation on bone forming (osteoblasts) and bone resorbing (osteoclasts) cells. It was also demonstrated how the simpler model could help in elucidating qualitative properties of the observed dynamics, such as the absence of overshoot and rebound, and the different dynamics of onset and washout.

## Keywords

Disease progression modeling Mathematical model reduction Osteoporosis Bone cell interaction model RANK-RANKL-OPG## Introduction

The objective of disease system analysis is to characterize and predict the status of biological systems under physiological and pathophysiological conditions as well as the impact of therapeutic interventions [1, 2, 3]. Models characterizing this dynamic behavior can be established at different levels of complexity, ranging from data driven and descriptive to completely mechanistic approaches (systems pharmacology) [3, 4]. Descriptive approaches usually start at a clinical observation level and become increasingly more complex in order to understand the system better, whereas systems pharmacology approaches start at the molecular level and provide a full description of the pathways involved. While descriptive models may not predict the clinical response beyond the data on which they were established, completely mechanistic approaches may face problems with the identifiability of model parameters [3, 4]. To obtain a sufficient understanding of a biological system, its dynamics, and the impact of therapeutic interventions, a compromise between the descriptive and the systems approach is frequently needed. This compromise results in mechanisms-based disease system models, which strive to characterize a system’s behavior rather than its complexity [5].

One important challenge to be met when developing mechanism-based disease system models is the appropriate handling of the different time scales present in biological systems. While processes on the molecular level, such as receptor binding or enzymatic reactions, are usually fast (within milliseconds), it can take months or even years before clinical signs and symptoms of chronic, progressive diseases become manifest. The design of mechanism-based disease system models consequently relies on a sufficient understanding of the relative speeds of the underlying (patho)physiological processes. Acquiring this information requires familiarity with various mathematical analysis techniques including dimensional analysis, dynamical systems analysis, and mathematical model reduction approaches (i.e., singular perturbation theory (see, e.g. [6]). When applying these techniques for the analysis of complex dynamic systems, the relative importance and speed of the different processes involved can be determined. Information on the system’s dynamic properties thus obtained can then be used to derive simpler models. Such reduced models yield dynamic properties that are very similar to those of completely mechanistic models but require the identification of fewer parameters. They also yield important insights into the impact of different parameters on the full system and often explicit expressions and quantitative estimates for drug-, system-, and/or disease-specific characteristics, such as clearance or the area under the curve of different compounds [6, 7].

The objective of this article is to demonstrate the added value of mathematical model reduction for establishing mechanism-based disease system models, using bone remodeling as an example. Bone remodeling is a physiological process that allows continuous renewal and repair of bone structure [8]. It is accomplished by groups of osteoblasts (bone forming cells) and osteoclasts (bone resorbing cells), which closely collaborate in so-called basic multicellular units (BMU) [9, 10]. The interaction between osteoblasts and osteoclasts is highly regulated and provides the basis for a temporally and spatially coordinated bone remodeling process. Disturbances in the regulation of these cell–cell interactions can result in pathophysiological conditions, such as osteoporosis [11].

The RANK-RANKL-OPG signaling pathway is one of the key players involved in the osteoblast-osteoclast regulation [12]. This regulatory pathway consists of three main components: (i) the receptor activator of nuclear factor κB (RANK), which is expressed on the surface of osteoclasts, (ii) the RANK ligand (RANKL), a polypeptide expressed on the surface of osteoblasts, and (iii) osteoprotegerin (OPG), a soluble decoy receptor for RANKL released by osteoblasts [12]. To date, multiple conceptual bone cell interaction models have been established [10, 13, 14, 15, 16, 17, 18] some of which specifically incorporate the RANK-RANKL-OPG pathway [10, 13, 16]. Of these conceptual frameworks, Lemaire et al. were the first to propose a model, where the interaction between the different types of bone cells within a BMU (responding osteoblasts (*R*), active osteoblasts (*B*), and active osteoclasts (*C*)) is mediated by the RANK-RANKL-OPG regulatory pathway [13].

It will be shown how the mechanistic bone cell interaction model proposed by Lemaire et al. [13] may be mathematically reduced for the parameter values quoted in [13] and for physiologically and therapeutically relevant time scales. The dynamic properties of the full and the reduced model will then be compared using simulations, in which the response of both models to changes in physiological states and/or therapeutic interventions will be evaluated using physiologically meaningful scenarios. Estrogen (deficiency and replacement therapy) will be used as the primary example. In addition, the effects of Vitamin D, ageing, and chronic glucocorticoid treatment on the bone cell dynamics will be evaluated. The reduced model will then be used to obtain answers to questions about qualitative properties of response curves, such as the possibility of overshoot and rebound. Finally, we will conclude with a discussion of the advantages and limitations of mathematical model reduction as well as its implications for clinical situations.

## Materials and methods

*.*[13], both the osteoblastic and the osteoclastic cell line consist of cells at different levels of maturation (cf. Fig. 1). Responding osteoblasts (

*R*) are recruited from a large pool of uncommitted osteoblast progenitor cells (

*R*

_{ u }), which then differentiate into active, bone-forming osteoblasts (

*B*). Active, bone-removing osteoclasts (

*C*), on the other hand, are recruited from a pool of osteoclast progenitor cells (

*C*

_{ P }) upon stimulation of RANK by its ligand. In addition to this receptor-mediated osteoblast-osteoclast interaction, a number of local and systemic hormones play a role in the regulation of bone remodeling. Of these factors, transforming growth factor beta (TGF-

*β*) and parathyroid hormone (PTH) have been incorporated into the Lemaire model [13]. TGF-

*β*is released from the bone by active osteoclasts and promotes multiple mechanisms of action: (1) it stimulates the recruitment of responding osteoblasts, (2) it inhibits the differentiation of responding osteoblasts into active osteoblasts, and (3) it stimulates the apoptosis of active osteoclasts. PTH, on the other hand, promotes its effect on osteoblasts and osteoclasts through the RANK-RANKL-OPG pathway, where it stimulates the expression of RANKL and suppresses the secretion of OPG.

*D*

_{ R }represents the differentiation rate of osteoblast progenitors,

*D*

_{ B }the differentiation rate of responding osteoblasts,

*D*

_{ C }the differentiation rate of osteoclast precursors,

*π*

_{ C }(

*C*) the TGF-

*β*receptor occupancy, and

*π*

_{ L }(

*R,B*) the RANK receptor occupancy. While

*π*

_{ C }(

*C*) is dependent on the amount of TGF-

*β*released from bone by active osteoclasts,

*π*

_{ L }(

*R,B*) is determined by the amount of RANKL attached to the surface of active osteoblasts (

*K*

_{ L }

^{ P }) and the OPG production rate of responding osteoblasts (

*K*

_{ O }

^{ P }) as shown in Eqs. 2–4.

*β*to its receptor is faster than any changes in the active osteoclast population,

*π*

_{ C }(

*C*) can be expressed as a function of

*C*, i.e.

*f*

_{0}equals the minimum receptor occupancy and

*C*

^{ s }is half the value of

*C*necessary to obtain maximum TGF-

*β*receptor occupancy (cf. Eq. 2). For the dependence of

*π*

_{ L }on

*R*and

*B*we have the expression,

*α*and

*β*can be computed from equation (4) in which

*π*

_{ P }represents the fraction of occupied PTH receptors,

*β*, Vitamin D affects \( \pi_{P} \) and hence

*α*and

*β*, ageing affects

*C*

^{ s }and hence \( \pi_{C} \left( C \right) \), and glucocorticoid treatment affects

*D*

_{ R }. As a result, physiological processes and therapeutic interventions will cause these parameters to change with time (cf.

*Evaluation of model behavior*).

*initially*, the values of all the parameters are those given by Lemaire et al. [13] (cf. Table 1), and that the system starts from the baseline values

*R*

_{0},

*B*

_{0}, and

*C*

_{0}for those parameters:

Parameter values provided by Lemaire et al. [13]

Symbol | Unit | Value | Description |
---|---|---|---|

| pM day | 7 × 10 | Differentiation rate of osteoblast progenitors |

| day | 0.7 | Differentiation rate of responding osteoblasts |

| day | 0.189 | Elimination rate of active osteoblasts |

| pM day | 2.1 × 10 | Differentiation rate of osteoclast precursors |

| day | 0.7 | Osteoclast apoptosis rate due to TGF- |

| Dimensionless | 0.05 | Positive constant characterizing the minimum TGF- |

| pM | 5 × 10 | About half the value of |

| pM | 10 | Rate of OPG-RANKL binding |

| day | 10 | Rate of OPG-RANKL dissociation |

| pM | 5.8 × 10 | Rate of RANK-RANKL binding |

| day | 1.7 × 10 | Rate of RANK-RANKL dissociation |

| pM | 0.02 | Rate of PTH binding to its receptor |

| day | 3 | Rate of PTH dissociation from its receptor |

| pM | 10 | Fixed concentration of RANK |

| pM/pM cells | 3 × 10 | Maximum number of RANKL attached to the cell surface of each active osteoblast |

| day | 0.35 | Elimination rate of OPG |

| pM day | 2 × 10 | Minimum OPG production rate per responding osteoblast |

| pM day | 0 | Rate of PTH administration |

| pM day | 250 | Rate of PTH synthesis |

| day | 86 | Rate of PTH elimination |

*R*

_{0},

*B*

_{0}, and

*C*

_{0}satisfy the algebraic equations

*t*= 0. The respective values of the parameters used in Eqs. 1–6, as given by Lemaire et al. [13], are presented in Table 1. Numeric values for the baseline concentrations are computed in Appendix A:

### Mathematical model reduction

*R*

_{0},

*B*

_{0}and

*C*

_{0}as reference values for the concentrations, we put

*π*

_{ C }(

*C*):

*Reduced Model*for the estrogen scenario, where

*β*is the only parameter that changes with time, i.e.

*β*=

*β(t)*. We denote the initial value of

*β*by

*β*

_{0}, i.e.

*β*(0) =

*β*

_{0}, and write

For the other scenarios we obtain the same *Reduced Model*. For these scenarios the derivation is very similar and we shall not reproduce it here.

*B*

_{0}and

*C*

_{0}and the parameter

*α,*which is constant in this scenario. This results in the system

*π*

_{ z }(1) is the baseline value of

*π*

_{ z }(

*z*).

*y*or

*B*is given by

*k*

_{ B }, with a corresponding half-life of ln(2)/

*k*

_{ B }, a characteristic time scale

*T*= 1/

*k*

_{ B }was chosen. The new dimensionless time

*τ*is consequently defined as:

*τ*is incorporated into (13), the system becomes

*ε*= 0.11 and

*μ*= 1.58. The small value of

*ε*, relative to the other coefficients in the system, implies that

*x*(

*τ*) rapidly converges to a zero of the right hand side of the first equation of (15), while

*z*(

*τ*) changes only slowly. Thus, after a brief initial period,

*x*(

*τ*) and

*z*(

*τ*) are to good approximation related by the equation

*x*and

*z*are in

*quasi*-

*equilibrium*or

*quasi*-

*steady state*. For more details of this “quasi-steady state approximation” we refer to [6, 7, 19, 20].

*x*from the second and third equation of the system (13) and so to obtain a simpler system, which only involves the dimensionless concentrations

*y*and

*z*:

*Reduced System*(see Appendix C for details),

*R*=

*R(C)*is defined by the expression:

Thus, we have shown that for the parameter values used in Lemaire et al. [13], after a brief initial period we may put the right-hand side of the equation for d*R/*d*t* to zero and use the resulting equation to express *R* in terms of *C*, which allows one to reduce the original system involving the three dependent variables *R*, *B*, and *C* to one of two with the dependent variables *B* and *C*. We refer to the latter system as the *Reduced System*.

For the other three scenarios we arrive at the same *Reduced System* (19) and (20). However, different parameters may vary with time. Thus, in the Vitamin D scenario, both *α* and *β* vary with time, in the ageing scenario it is *π* _{ c }(*C*) that changes and in the glucocorticoid scenario *D* _{ R } changes with time.

The reduced system (19), is of a type recently discussed by Zumsande et al. [21]. However, in their study they focused on the stability of steady states. As we shall see, this is no issue in our study because for the parameter values from Lemaire et al. the baseline is stable, and remains so when it slowly changes under the impact of disease progression and therapeutic interventions.

Reduction to a two-dimensional system opens the way for a transparent discussion of its dynamics. The state of a system at a given time *t*, is given by the pair (*B*(*t*), *C*(*t*)), which can be represented by a point in the (*B*, *C*)-plane (in terms of dimensionless variables this is the (*y*, *z*)-plane), often referred to as the *Phase Plane*. In Appendix B we describe how the state (*B*(*t*), *C*(*t*)) moves through the phase plane as time progresses and show what information about the system we can derive from it.

### Evaluation of the model behavior

Simulation parameters

Scenario | Parameter | Unit | Value | Description |
---|---|---|---|---|

Estrogen | | pM | 21985 | Value of |

| Dimensionless | 0.9994 | Maximum inhibition of OPG production | |

| day | 0.0015 | Rate at which estrogen production declines | |

| day | 0.015 | Rate at which estrogen production increases during estrogen replacement therapy | |

| pM | 3000 | Maximum increase in | |

Vitamin D | | pM | 1479 | Value of |

| pM | 1460 | Maximum value of | |

| pM | 21985 | Value of | |

| pM | 22274 | Value of | |

Ageing | | pM | 5 × 10 | Value of |

| Dimensionless | 5.5 | Factor by which | |

| day | 6 × 10 | Rate at which | |

Glucocorticoids | | pM day | 7 × 10 | Differentiation rate of osteoblast progenitors at time zero |

| pM day | 1.7 × 10 | Differentiation rate of osteoblast progenitors at time infinity | |

| day | 7.8 × 10 | Rate of onset of glucocorticoid-induced side effects | |

| day | 7.8 × 10 | Rate at which glucocorticoid-induced side effects wash out |

#### Estrogen

Estrogen promotes its action, at least in part, through the RANK-RANKL-OPG pathway by stimulating the production of OPG [13]. As estrogen production increases significantly during menarche, the RANKL/OPG ratio decreases resulting in a relative decrease in osteoclast activity leading to a substantial increase in longitudinal and radial bone growth as well as rapid skeletal mineralization [22]. On the other hand, a decrease in estrogen production by 85–90% during menopause results in rapid bone loss and subsequently in an increased risk of bone fracture [22]. The decrease in estrogen production during menopausal transition does not occur instantaneously but slowly evolves over a period of several years.

*K*

_{ O }

^{ P }) [8]. It was assumed for this simulation that

*K*

_{ O }

^{ P }decreases from 2 × 10

^{5}pM day

^{−1}/pM cells to 158 pM day

^{−1}/pM cells [13], resulting in a corresponding drop in

*β*(cf. (4)). We assume a mono-exponential decline of

*β*over a period of 5 years (which corresponds to a

*t*

_{1/2}of 1.25 years and

*k*

_{dis}= 0.0015 day

^{−1}),

*β*

_{bas}(0) =

*β*

_{0}is the initial baseline value and

*β*

_{bas}(∞) =

*β*

_{0}(1-

*I*

_{max}) with

*I*

_{max}= 0.9994 as the maximum inhibition of OPG production.

*β*

_{bas}(

*t*) is the baseline value of

*β*as it evolves with time, given by (21), and

*β*

_{int}(

*t*) the change in

*β*caused by the therapeutic intervention. An additive term was used for characterizing the therapeutic intervention, where the loss of endogenous estrogen is balanced by a supply of exogenous estrogen:

In this equation, ∆*β* represents the maximum increase in *β* due to estrogen replacement, *k* _{int} the rate at which the corresponding OPG production increases, *t* _{1} the time at which treatment with exogenous estrogen starts, *t* _{2} the time at which treatment is discontinued (*t* _{1} = 1 year and *t* _{2} = 4 years), and *H* the Heaviside function.^{1}

#### Vitamin D

Vitamin D plays an important role in maintaining the body’s calcium and phosphate homeostasis and is consequently important for the formation as well as the maintenance of bone [27]. While recent morphogenetic studies also suggest a direct effect on the osteoblastic phenotype expression [28], Vitamin D promotes its main effect on bone by regulating PTH levels and thus the RANKL/OPG ratio. At physiological levels, Vitamin D decreases the synthesis and secretion of PTH [29] as well as the number of PTH receptors [30, 31] resulting in a decrease in RANKL expression and an increase in OPG secretion. In case of Vitamin D deficiency, this inhibiting effect on PTH diminishes leading to an increased RANKL/OPG ratio and increased bone resorption.

Calcitriol, the bioactive form of Vitamin D, is formed from mainly two biologically inert precursors, cholecalciferol and ergocalciferol, via biotransformation in the liver and the kidneys [27]. Cholecalciferol is formed in the skin when 7-dehydrocholesterol is exposed to ultraviolet B light (UVB, 290–320 nm), whereas ergocalciferol is produced by plants and taken up by diet. Assuming that the dietary intake of ergocalciferol does not significantly change during the course of 1 year, changes in Vitamin D levels, and thus changes in bone mineral density, are correlated with seasonal differences in sunlight exposure [32].

*S*

_{ P }) of the following form:

*S*

_{ P,min}= 250 pM/day is the normal value and

*S*

_{ P,max}= 3765 pM/day is the value characterizing maximal Vitamin D deficiency (cf. Lemaire et al.). If no additional PTH is administered, the PTH receptor occupancy

*π*

_{ P }is proportional to

*S*

_{ P }(cf. (Appendix A, Eq. 28)) This fluctuation in

*S*

_{ P }results in periodic changes in the values of

*α*and

*β*.

#### Ageing

Ageing is associated with significant bone loss in both men and women [33]. The extent of this loss can differ between the different bone sites and has been associated with a decrease in TGF-*β* production as well as its release from bone [34, 35, 36]. Once TGF-*β* levels decrease, their stimulating effect on osteoclast apoptosis decrease resulting in increased osteoclast activity and increased bone resorption. In addition, the differentiation of OPG-secreting responding osteoblasts to RANKL-expressing active osteoblasts is no longer inhibited. This gradual loss of regulatory feedback leads to an increased RANKL/OPG ratio and further stimulation of osteoclasts.

*β*content was modeled by Lemaire et al. [13] by decreasing the value of

*π*

_{ C }(

*C*) by a factor of 5.5. However,

*π*

_{ C }(

*C*) is a non-linear function, which depends on

*C*,

*f*

_{0}, and

*C*

^{ s }as shown in Eq. 2. Decreasing this function by a constant factor does consequently require additional assumptions. For this analysis, it was assumed that the decrease in

*π*

_{ C }is caused by an increase in

*C*

^{ s }(about half the value of

*C*necessary to obtain maximum TGF-

*β*receptor occupancy) since more bone needs to be resorbed to yield the same amount of TGF-

*β*. It was further assumed that these age-dependent changes in TGF-

*β*become clinically relevant for individuals aged 65 and older and manifest themselves over a period of approximately 12.5 years (average life expectancy in Western World: 75–80 years). The change of the bone’s TGF-

*β*content over time (

*C*

^{ s }(

*t*)) can be computed according to Eq. 25,

*C*

_{0}

^{ s }represents the bone’s TGF-

*β*content at the age of 65,

*k*

_{age}the rate and

*λ*> 1 the extent by which

*C*

^{ s }increases in the elderly.

#### Glucocorticoids

Bone loss and increased fracture risk due to long-term glucocorticoid therapy is the most common cause of drug-induced osteoporosis [37]. The extent of this drug-induced side effect seems to be dependent on the cumulative glucocorticoid dose and affects trabecular bone more than cortical bone [37, 38]. Although glucocorticoid receptors are present in almost every vertebrate cell, glucocorticoids seem to primarily affect bone formation by decreasing the expression of osteoblastic differentiation factors, such as core binding factor A1 [39, 40, 41].

*D*

_{ R }). Since these drug-related adverse effects only emerge after a chronic treatment with glucocorticoids, it was assumed for this simulation that

*D*

_{ R }decreases slowly from 7 × 10

^{−4}to 1.7 × 10

^{−4}pM/day at a rate

*k*

_{dis}over 5 years as shown in Eq. 26 [13]. In this simulation we take

*k*

_{dis}= 0.00078 day

^{−1}.

*T*= 2190 days), the system completely recovers and equilibrates at its original baseline

*D*

_{ R }(0). Results from a study in patients with rheumatoid arthritis receiving low-dose prednisone suggest that this recovery process is relatively fast and occurs within 1 year [42]. Respective changes in bone cells during (0 <

*t*≤

*T*) and after (

*T*<

*t*< ∞) treatment with glucocorticoids can be computed according to Eq. 27.

Here, *T* represents the time at which treatment with glucocorticoids was discontinued and *k* _{wash} represents the first-order rate constant characterizing the offset of the glucocorticoid effect.

### Software

Simulations were performed in MatLab version R2011a. In light of the stiffness of the system, the ode-solver “ode23s” was used.

## Results

Application of dimensional analysis to the conceptual bone cell interaction model by Lemaire et al. [13] allowed us to evaluate (i) the relative importance of its model terms, (ii) the relative speeds of the processes involved, and (iii) the critical dimensionless numbers (often combinations of parameters), which determine the qualitative character of the dynamics of the system. In particular, we were able to show mathematically that responding osteoblasts (*R*) rapidly reach a quasi-steady state with active osteoclasts (*C*) for the model parameters provided in [13]. Thus, for *R* and *C* the quasi-steady state assumption was shown to hold and the original three-dimensional system containing *R*, *B*, and *C* could be reduced to a simpler, two-dimensional system, whose dynamics is determined by *B* and *C*. Reduction to a two-dimensional system further allowed for a graphical representation of its dynamics in the planar *State Space*. While the state of the system can be depicted as a point in the state space, its evolution is characterized by a respective curve parameterized by the time *t* (the orbit, cf. Fig. 9 in Appendix B). Representation in the state space also enables a transparent discussion of the system’s dynamics and readily reveals qualitative properties, such as the absence of overshoot and rebound.

When evaluating the performance of both the full Lemaire model and the reduced model following rapid interventions, such as a sudden decrease or increase in estrogen levels (Appendix B), our findings show that the dynamic properties of both models are very similar but not identical (Fig. 8 in Appendix B). Small discrepancies between the dynamic properties of the two models exist during the first 10–20 days after the rapid intervention. Once the speed of the onset and/or offset of these interventions decreases to more (patho)physiological/therapeutic levels, the profiles of both models become more and more similar. On the time scale of disease progression and therapeutic intervention both the full Lemaire model and the mathematically reduced model show negligible differences in their ability to characterizing the dynamic interaction between osteoclasts and osteoblasts.

### Estrogen

*C*than for

*R*and

*B*resulting in an elevated

*C*/

*B*ratio (high turnover) and thus increased bone resorption (Fig. 2). On the other hand, the system equilibrates at a new steady-state upon start of the estrogen replacement therapy (Fig. 3, “Materials and methods” section), which is different from its original baseline. The establishment of a new steady-state results in a slow-down or even halt of osteoporotic processes. It should be noted though that for symptomatic therapeutic interventions, such as estrogen replacement therapy, the underlying disease is still progressing at its natural rate [3]. The status of patients having received symptomatic treatments will consequently be indistinguishable from that of untreated patients once the treatment has been discontinued and the drug effect has washed out.

### Vitamin D

*C*/

*B*ratio, which is maximally elevated during the winter when Vitamin D levels are lowest.

### Ageing

*β*content due to ageing also result in a rapid increase of the active osteoclast to active osteoblast ratio as shown in Fig. 5. Our findings further indicate that these changes in the

*C/B*ratio are non-reversible and lead to a rapid increase in the breakdown of bone in subjects 65 and older.

### Glucocorticoids

*C*/

*B*ratio (i.e., high bone turnover) and a subsequent decrease in bone mass. However, these glucocorticoid-induced site effects are reversible as the maturation of osteoblast progenitors can recover upon termination drug treatment (Fig. 7, “Materials and methods” section). The system’s recovery also results in the reestablishment of the original

*C*/

*B*ratio and subsequently no further bone loss.

## Discussion

The effects of both local and systemic control mechanisms on the regulation of bone remodeling result in the establishment of a complex framework that contains multiple spatial and temporal levels. To obtain a sufficient understanding of this framework, its dynamics, and the impact of therapeutic interventions and disease processes, the use of mathematical models is required (for a more elaborate conceptual discussion of the role of mathematical modeling for characterizing bone turnover see also [43]). Mathematical modeling provides a powerful tool as it allows incorporation of information from different in vitro and in vivo experiments into a single approach. Once developed and validated, these models can be used in silico to explore the cause-effect relationship and to assist the formulation of new hypotheses as well as the design of new experimental studies. However, as these frameworks become more complex, problems with identifying the key mechanisms that cause a system to undergo pathophysiological changes may arise [3, 4]. To identify these key components, sufficient understanding of a system’s dynamic properties is often more informative than characterizing its complexity. One way of exploring a system’s dynamic properties is to mathematically reduce completely mechanistic models in order to evaluate (1) the relative importance of the various model components and (2) the relative speed of the processes involved for the overall performance of the system.

To demonstrate the benefits and limitations of model reduction, we analyzed the well-known bone-cell interaction model proposed by Lemaire et al. [13], which is based on the RANK-RANKL-OPG signaling pathway. By performing a dimensional analysis, we identified critical properties, such as overall and relative time scales, on the basis of the parameter values quoted in [13]. We found that for these parameter values the dynamics of the responding osteoblasts was relatively fast compared to that of active osteoblasts and osteoclasts. The dynamics of the system were thus primarily driven by changes in osteoclasts and active osteoblasts, whilst responding osteoblasts follow their lead. Although not all of the parameter values provided in [13] seem to have been previously validated, corresponding model-predicted bone cell dynamics are in agreement with clinical observations [44], where rapid changes in bone resorption markers during/after treatment with conjugated estrogen and/or alendronate are followed by respective changes in bone formation markers.

Based on these findings, the conceptual bone cell interaction model by Lemaire et al. [13] could be reduced from a three- to a two-dimensional system. Reducing the model’s complexity allowed for a transparent discussion of its dynamics and also opened the way for a geometric, two-dimensional analysis. This approach added significantly to the transparency of the system as it allowed its representation in the *Phase Plane*. Results of this geometric analysis indicate that there can be no overshoot at onset and no rebound at washout for the reduced model. Given the proximity of the concentration curves of the reduced and full model this implies that any overshoot or rebound the full model might exhibit will be very small (cf. Appendix B).

When simulating the response of both the full Lemaire model and the mathematically reduced model to rapid changes, such as a sudden onset/offset of effect, we showed that there is overall a good match between the two models (cf. Fig. 8). Small discrepancies in their dynamic properties were only observed during the first 10–20 days after the onset/offset of the effect. However, once the relative speeds of the underlying (patho)physiological processes and therapeutic interventions were taken into account, both models were at any time at quasi-equilibrium (Figs. 2, 3, 4, 5, 6, 7). Consequently, both models can be used interchangeably for characterizing bone cell dynamics on the time scale of disease progression and therapeutic intervention. From a data analysis point of view, the use of the simpler model is advantageous as fewer parameters have to be identified and estimated. This aspect becomes particularly important for the analysis of clinical data, where usually only few samples per subject are available. On the other hand, the development and validation of disease system models heavily depends on current knowledge about the biological system, the availability of sufficient data on different spatial/temporal levels, and the availability of appropriate software tools that allow running and visualizing these models based on widely accepted modeling standards [4, 45].

The application of advanced mathematical and statistical tools, such as mathematical model reduction, can guide the development of disease system models as it allows one to identify the rate-limiting steps within complex, dynamic systems. The joint use of systems pharmacology and mathematical model reduction approaches provides, therefore, a powerful combination as it can guide the identification of drug-, system-, and disease-specific parameters, informative biomarkers as well as the generation of data, where such information can be obtained from. In particular, knowledge on the system’s dynamics and the time scales involved in the establishment of disease and drug effects can guide clinical trial design as it allows to identifying its maximal susceptibility to changes in the underlying physiology and/or therapeutic interventions. For example, the response of the reduced model to a step-decrease in estrogen suggests that in this case a washout design would be superior to a delayed start design for characterizing the impact of this physiological change on bone remodeling. This is due to the fact that in this case equilibrium is reached much faster after washout of the intervention than following its onset (cf. Appendix B; Figs. 8, 9). These findings are in agreement with those of Ploeger and Holford, who found a washout design superior to a delayed start design for characterizing and distinguishing treatment effect types in Parkinson’s disease [46].

In conclusion, mathematical model reduction is a valuable approach for analyzing disease systems and simplifying complex models while maintaining their dynamic properties. A significant decrease in the number of parameters to be identified and estimated in addition to an increased system transparency qualifies reduced models as tools to evaluate the impact of changes in physiological states and/or therapeutic interventions with respect to the different time scales involved.

## Footnotes

- 1.
The Heaviside function

*H*(*s*) is defined as follows:*H*(*s*) = 0 for*s*< 0 and*H*(*s*) = 1 for*s*> 0. Thus, for any time*T*> 0,*H*(*t*−*T*) = 0 for*t*<*T*and*H*(*t*−*T*) = 1 for*t*>*T*.

## Notes

### Acknowledgements

The authors would like to thank Drs. Oscar E. Della-Pasqua, Rik de Greef and Thomas Kerbusch for their valuable comments and suggestions. This study was performed within the framework of Dutch Top Institute Pharma, “Mechanism-based PK/PD modeling platform (project number D2-104)”.

## Open Access

This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

## References

- 1.Chan PL, Holford NH (2001) Drug treatment effects on disease progression. Annu Rev Pharmacol Toxicol 41:625–659PubMedCrossRefGoogle Scholar
- 2.Danhof M, de Jongh J, De Lange EC, Della Pasqua O, Ploeger BA, Voskuyl RA (2007) Mechanism-based pharmacokinetic-pharmacodynamic modeling: biophase distribution, receptor theory, and dynamical systems analysis. Annu Rev Pharmacol Toxicol 47:357–400PubMedCrossRefGoogle Scholar
- 3.Post TM, Freijer JI, DeJongh J, Danhof M (2005) Disease system analysis: basic disease progression models in degenerative disease. Pharm Res 22:1038–1049PubMedCrossRefGoogle Scholar
- 4.Schmidt S, Post TM, Boroujerdi MA, van Kesteren C, Ploeger BA, Della Pasqua OE, Danhof M (2010) Disease progression analysis: towards mechanism-based models. In: Kimko HC, Peck CC (eds) Clinical trial simulations, 1st edn. Springer, New York, pp 437–459Google Scholar
- 5.Post TM (2009) Disease system analysis: between complexity and (over)simplification. Dissertation, Leiden UniversityGoogle Scholar
- 6.Peletier LA, Benson N, van der Graaf PH (2009) Impact of plasma-protein binding on receptor occupancy: an analytical description. J Theor Biol 256:253–262PubMedCrossRefGoogle Scholar
- 7.Peletier LA, Benson N, van der Graaf PH (2010) Impact of protein binding on receptor occupancy: a two-compartment model. J Theor Biol 265:657–671PubMedCrossRefGoogle Scholar
- 8.Post TM, Cremers SC, Kerbusch T, Danhof M (2010) Bone physiology, disease and treatment: towards disease system analysis in osteoporosis. Clin Pharmacokinet 49:89–118PubMedCrossRefGoogle Scholar
- 9.Parfitt AM (2002) Targeted and nontargeted bone remodeling: relationship to basic multicellular unit origination and progression. Bone 30:5–7PubMedCrossRefGoogle Scholar
- 10.Pivonka P, Zimak J, Smith DW, Gardiner BS, Dunstan CR, Sims NA, Martin TJ, Mundy GR (2008) Model structure and control of bone remodeling: a theoretical study. Bone 43:249–263PubMedCrossRefGoogle Scholar
- 11.Compston JE (2001) Sex steroids and bone. Physiol Rev 81:419–447PubMedGoogle Scholar
- 12.Boyce BF, Xing L (2008) Functions of RANKL/RANK/OPG in bone modeling and remodeling. Arch Biochem Biophys 473:139–146PubMedCrossRefGoogle Scholar
- 13.Lemaire V, Tobin FL, Greller LD, Cho CR, Suva LJ (2004) Modeling the interactions between osteoblast and osteoclast activities in bone remodeling. J Theor Biol 229:293–309PubMedCrossRefGoogle Scholar
- 14.Komarova SV, Smith RJ, Dixon SJ, Sims SM, Wahl LM (2003) Mathematical model predicts a critical role for osteoclast autocrine regulation in the control of bone remodeling. Bone 33:206–215PubMedCrossRefGoogle Scholar
- 15.Moroz A, Crane MC, Smith G, Wimpenny DI (2006) Phenomenological model of bone remodeling cycle containing osteocyte regulation loop. Biosystems 84:183–190PubMedCrossRefGoogle Scholar
- 16.Peterson MC, Riggs MM (2010) A physiologically based mathematical model of integrated calcium homeostasis and bone remodeling. Bone 46:49–63PubMedCrossRefGoogle Scholar
- 17.Rattanakul C, Lenbury Y, Krishnamara N, Wollkind DJ (2003) Modeling of bone formation and resorption mediated by parathyroid hormone: response to estrogen/PTH therapy. Biosystems 70:55–72PubMedCrossRefGoogle Scholar
- 18.Wimpenny DI, Moroz A (2007) On allosteric control model of bone turnover cycle containing osteocyte regulation loop. Biosystems 90:295–308PubMedCrossRefGoogle Scholar
- 19.Bender CM, Orzag SA (1978) Advanced mathematical methods for scientists and engineers: asymptotic methods and perturbation theory. Mc-Graw Hill, Inc, New YorkGoogle Scholar
- 20.Segel LA (1988) On the validity of the steady state assumption of enzyme kinetics. Bull Math Biol 50:579–593PubMedGoogle Scholar
- 21.Zumsande M, Stiefs D, Siegmund S, Gross T (2011) General analysis of mathematical models for bone remodeling. Bone 48:910–917PubMedCrossRefGoogle Scholar
- 22.Clarke BL, Khosla S (2010) Female reproductive system and bone. Arch Biochem Biophys 503:118–128PubMedCrossRefGoogle Scholar
- 23.Soules MR, Sherman S, Parrott E, Rebar R, Santoro N, Utian W, Woods N (2001) Executive summary: stages of reproductive aging workshop (STRAW) July, 2001. Menopause 8:402–7, Park City, UtahGoogle Scholar
- 24.Anderson GL, Limacher M, Assaf AR, Bassford T, Beresford SA, Black H, Bonds D, Brunner R, Brzyski R, Caan B, Chlebowski R, Curb D, Gass M, Hays J, Heiss G, Hendrix S, Howard BV, Hsia J, Hubbell A, Jackson R, Johnson KC, Judd H, Kotchen JM, Kuller L, LaCroix AZ, Lane D, Langer RD, Lasser N, Lewis CE, Manson J, Margolis K, Ockene J, O’Sullivan MJ, Phillips L, Prentice RL, Ritenbaugh C, Robbins J, Rossouw JE, Sarto G, Stefanick ML, Van Horn L, Wactawski-Wende J, Wallace R, Wassertheil-Smoller S (2004) Effects of conjugated equine estrogen in postmenopausal women with hysterectomy: the Women’s Health Initiative randomized controlled trial. JAMA 291:1701–1712PubMedCrossRefGoogle Scholar
- 25.Pinkerton JV, Stovall DW (2010) Reproductive aging, menopause, and health outcomes. Ann NY Acad Sci 1204:169–178PubMedCrossRefGoogle Scholar
- 26.Rossouw JE, Anderson GL, Prentice RL, LaCroix AZ, Kooperberg C, Stefanick ML, Jackson RD, Beresford SA, Howard BV, Johnson KC, Kotchen JM, Ockene J (2002) Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results from the women’s health initiative randomized controlled trial. JAMA 288:321–333PubMedCrossRefGoogle Scholar
- 27.Zhang R, Naughton DP (2010) Vitamin D in health and disease: current perspectives. Nutr J 9:65PubMedCrossRefGoogle Scholar
- 28.St-Arnaud R (2008) The direct role of vitamin D on bone homeostasis. Arch Biochem Biophys 473:225–230PubMedCrossRefGoogle Scholar
- 29.Slatopolsky E, Dusso A, Brown A (1999) New analogs of vitamin D3. Kidney Int 73:S46–S51CrossRefGoogle Scholar
- 30.Titus L, Jackson E, Nanes MS, Rubin JE, Catherwood BD (1991) 1,25-dihydroxyvitamin D reduces parathyroid hormone receptor number in ROS 17/2.8 cells and prevents the glucocorticoid-induced increase in these receptors: relationship to adenylate cyclase activation. J Bone Miner Res 6:631–637PubMedCrossRefGoogle Scholar
- 31.Xie LY, Leung A, Segre GV, Yamamoto I, Abou-Samra AB (1996) Downregulation of the PTH/PTHrP receptor by vitamin D3 in the osteoblast-like ROS 17/2.8 cells. Am J Physiol 270:E654–E660PubMedGoogle Scholar
- 32.Holford NHG, Baathe S and Karlsson M (2001) Auckland bones and summer sun. In: Annual meeting of the population approach group in Europe, BaselGoogle Scholar
- 33.Riggs BL, Khosla S, Melton LJ III (2002) Sex steroids and the construction and conservation of the adult skeleton. Endocr Rev 23:279–302PubMedCrossRefGoogle Scholar
- 34.Kahn A, Gibbons R, Perkins S and Gazit D (1995) Age-related bone loss. A hypothesis and initial assessment in mice. Clin Orthop Relat Res 313: 69–75Google Scholar
- 35.Marie P (1997) Growth factors and bone formation in osteoporosis: roles for IGF-I and TGF-beta. Rev Rhum Engl Ed 64:44–53PubMedGoogle Scholar
- 36.Nicolas V, Prewett A, Bettica P, Mohan S, Finkelman RD, Baylink DJ, Farley JR (1994) Age-related decreases in insulin-like growth factor-I and transforming growth factor-beta in femoral cortical bone from both men and women: implications for bone loss with aging. J Clin Endocrinol Metab 78:1011–1016PubMedCrossRefGoogle Scholar
- 37.Gourlay M, Franceschini N, Sheyn Y (2007) Prevention and treatment strategies for glucocorticoid-induced osteoporotic fractures. Clin Rheumatol 26:144–153PubMedCrossRefGoogle Scholar
- 38.Van Staa TP, Leufkens HG, Abenhaim L, Zhang B, Cooper C (2005) Use of oral corticosteroids and risk of fractures. June, 2000. J Bone Miner Res 20:1487–1494 discussion 1486PubMedGoogle Scholar
- 39.Alliston T, Choy L, Ducy P, Karsenty G, Derynck R (2001) TGF-beta-induced repression of CBFA1 by Smad3 decreases cbfa1 and osteocalcin expression and inhibits osteoblast differentiation. EMBO J 20:2254–2272PubMedCrossRefGoogle Scholar
- 40.Ducy P, Schinke T, Karsenty G (2000) The osteoblast: a sophisticated fibroblast under central surveillance. Science 289:1501–1504PubMedCrossRefGoogle Scholar
- 41.Komori T, Yagi H, Nomura S, Yamaguchi A, Sasaki K, Deguchi K, Shimizu Y, Bronson RT, Gao YH, Inada M, Sato M, Okamoto R, Kitamura Y, Yoshiki S, Kishimoto T (1997) Targeted disruption of Cbfa1 results in a complete lack of bone formation owing to maturational arrest of osteoblasts. Cell 89:755–764PubMedCrossRefGoogle Scholar
- 42.Laan RF, van Riel PL, van de Putte LB, van Erning LJ, van’t Hof MA, Lemmens JA (1993) Low-dose prednisone induces rapid reversible axial bone loss in patients with rheumatoid arthritis. A randomized, controlled study. Ann Intern Med 119:963–968PubMedGoogle Scholar
- 43.Pivonka P, Komarova SV (2010) Mathematical modeling in bone biology: from intracellular signaling to tissue mechanics. Bone 47:181–189PubMedCrossRefGoogle Scholar
- 44.Greenspan SL, Emkey RD, Bone HG, Weiss SR, Bell NH, Downs RW, McKeever C, Miller SS, Davidson M, Bolognese MA, Mulloy AL, Heyden N, Wu M, Kaur A, Lombardi A (2002) Significant differential effects of alendronate, estrogen, or combination therapy on the rate of bone loss after discontinuation of treatment of postmenopausal osteoporosis. A randomized, double-blind, placebo-controlled trial. Ann Intern Med 137:875–883PubMedGoogle Scholar
- 45.Hunter P, Nielsen P (2005) A strategy for integrative computational physiology. Physiology (Bethesda) 20:316–325CrossRefGoogle Scholar
- 46.Ploeger BA, Holford NH (2009) Washout and delayed start designs for identifying disease modifying effects in slowly progressive diseases using disease progression analysis. Pharm Stat 8:225–238PubMedCrossRefGoogle Scholar
- 47.Blanchard P, Devaney RJ, Hall GR (1998) Differential equations. Brooks/Cole, BelmontGoogle Scholar