Abstract
Background
Most clinical trials of antipsychotics in children are brief, failing to address their long-term safety, particularly when taken concurrently with other psychotropics. This hypothesis-generating analysis evaluates potential correlates of weight gain in children receiving extended risperidone treatment.
Methods
Medically healthy 7–17 year-old patients treated with risperidone for six months or more were enrolled. Anthropometric measurements were conducted. Developmental and medication history was obtained from the medical record. Information related to birth weight, dietary intake, physical activity, and parental weight was collected. Mixed regression analyses explored the contribution of various demographic and clinical factors to age- and sex-adjusted weight and body mass index (BMI) z scores over the treatment period.
Results
The sample consisted of 110 patients (89% males) with a mean age of 11.8 years (sd = 2.9) upon enrollment. The majority had an externalizing disorder and received 0.03 mg/kg/day (sd = 0.02) of risperidone, for 2.5 years (sd = 1.7), to primarily target irritability and aggression (81%). Polypharmacy was common with 71% receiving psychostimulants, 50% selective serotonin reuptake inhibitors (SSRIs), and 32% α2-agonists. Weight and BMI z score were positively correlated with baseline weight at the start of risperidone, treatment duration, and the weight-adjusted dose of risperidone but inversely associated with the weight-adjusted dose of psychostimulants and the concurrent use of SSRIs and α2-agonists. The effect of risperidone dose appeared to attenuate as treatment extended while that of psychostimulants became more significant. The rate of change in weight (or BMI) z score prior to and within the first 12 weeks of risperidone treatment did not independently predict future changes neither did birth weight, postnatal growth, dietary intake, physical activity, or parental weight.
Conclusions
This comprehensive analysis exploring correlates of long-term weight (or BMI) change in risperidone-treated youths revealed that pharmacotherapy exerts significant but complex effects.
Trial Registration
Not applicable.
Similar content being viewed by others
Background
The use of atypical antipsychotics (AAPs) in children and adolescents has risen sharply over the last decade [1, 2]. Several AAPs have received FDA approval for treatment of pediatric psychiatric conditions [3–6]. Moreover, AAPs in general, and risperidone in particular, significantly reduce irritability and aggression, which contributes to expanding their use to the more commonly-occurring disruptive behavior disorders [7, 8]. Thus, given that further rise in the prescribing of AAPs to youths is anticipated, optimizing safety and tolerability is imperative. This is especially true since most pediatric psychiatric disorders targeted with AAPs are chronic, necessitating extended treatment [9, 10].
One particularly concerning AAP-related adverse event is developmentally-inappropriate weight gain [11, 12]. Obesity is an increasingly prevalent cardiometabolic risk factor leading to insulin resistance, dyslipidemia, and hypertension, among other sequelae [13]. Childhood obesity, specifically, is worrisome as it is strongly associated with adverse cardiometabolic conditions in adulthood [14]. Thus, AAP-induced weight gain in this vulnerable population has raised considerable concerns among clinicians and the public alike [15, 16].
In fact, substantial evidence has linked the use of most AAPs to weight gain, with this outcome being particularly prominent in youths [12, 17]. Still, significant inter-individual variability exists in the susceptibility to gain weight during AAP treatment, both in adult and pediatric samples [12, 17]. Thus, identifying factors associated with weight gain during AAP treatment can help clinicians better estimate the risk/benefit ratio during the decision-making process.
To that end, research investigating childhood predictors of adult obesity can be informative. Specifically, such characteristics as birth weight [18], postnatal weight gain [19], physical activity [20], and dietary intake [20] have all been implicated in obesity risk. However, their contribution to the propensity to gain weight from AAPs has not been fully explored. Moreover, while a few studies have linked weight at the start of AAP treatment [11, 21, 22], AAP dose [12], the rate of weight gain during the first few weeks of AAP treatment [22, 23], and polypharmacy [24] to AAP-induced weight gain in relatively short-term pediatric studies, these factors have not been thoroughly researched during long-term AAP treatment.
Thus, the aim of this hypothesis-generating analysis was to investigate whether the various demographic and clinical factors reviewed above affect weight gain during long-term risperidone treatment. Risperidone remains the best-studied and most widely used AAP in youth [1, 5–7]. We hypothesized that low birth weight, rapid postnatal growth, and higher doses of risperidone will be associated with excessive weight gain. Conversely, high physical activity, a healthy diet, and co-treatment with psychostimulants will be associated with more age-appropriate weight gain.
Methods
Participants
This study has been previously described [11, 25]. Briefly, 7 to 17 year-old patients treated with risperidone for six months or more were enrolled, irrespective of their primary psychiatric diagnosis or indication for risperidone. Concurrent treatment with additional psychotropics at enrollment, but not with other antipsychotics, was allowed. Subjects with neurological or medical conditions that could confound the metabolic assessments were excluded as were pregnant females and those receiving hormonal contraception. The primary aim of the study was to investigate the metabolic, hormonal, and skeletal adverse events of risperidone during long-term use.
Procedures
This study was approved by the local Institutional Review Board. Written assent was obtained from children ≤ 14 years old and consent from adolescents and parents or guardians.
We recorded, from the medical record, the start and stop dates of each psychotropic, changes in the dosage and formulation, and the indication for risperidone. All dosages of psychostimulants were expressed in methylphenidate equivalents for amphetamines (x 2) [11]. We defined an SSRI unit as being equivalent to a daily dose of 10 mg of escitalopram, 20 mg of citalopram, fluoxetine, or paroxetine, and 50 mg of sertraline or fluvoxamine [25].
Upon enrollment, height was measured to the nearest 0.1 cm using a stadiometer (Holtain Ltd., UK) and weight was recorded to the nearest 0.1 kg using a digital scale (Scaletronix, Wheaton, IL), while wearing indoor clothes without shoes. In addition, we extracted, from the medical record, all height and weight measurements. When both were available, body mass index (BMI, kg/m2) was computed. However, since clinicians are more likely to measure weight than height, the database contained more than twice as many measurements for weight as for height or BMI. Importantly, measurements collected during clinic visits falling within a month of the research visits were highly correlated with the research measurements [mean interval = 16 days (sd = 9) for height (n = 69) and 17 days (sd = 9) for weight (n = 97)]. The intra-class correlations were all above 0.97 (95% confidence intervals [CI] ranging between 0.96 - 0.99) for unadjusted height and weight as well as for their sex- and age-adjusted z scores.
A best-estimate diagnosis, following the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) [26], was generated based on a review of the psychiatric record often supplemented by a brief clinical interview, a standardized interview of the parent using the NIMH Diagnostic Interview Schedule for Children (DISC-IV; N = 95, 58%) [27], and the Child Behavior Checklist (N = 120, 74%) [28].
At enrollment, the parent completed a questionnaire regarding the pregnancy, the child’s birth weight, and current parental height and weight. The intraclass correlation coefficient between parental report and birth record was 0.91 for birth weight (95% CI = 0.86-0.95, n = 62) and 0.86 for duration of gestation (95% CI = 0.78-0.92, n = 57). Thus, parental report was used when the actual birth record could not be obtained. In addition, three groups were defined based on a change of 0.67 z score point in weight between birth and 2 years of life [19]. This magnitude of change has been recommended to select children with significant postnatal growth and corresponds to the width of each percentile band (e.g., 3, 10, 25, etc.) on standard growth charts [19].
The participants completed the 2004 Block Kids Food Frequency Questionnaire, with assistance from the parent when necessary [29]. This was reviewed by a research dietician to confirm completeness and accuracy. This questionnaire estimates the daily caloric intake and diet composition during the week prior to enrollment.
We also asked the subjects, with parental assistance when necessary, to list the five physical activities they participate in the most and to estimate the number of days per week that they engage in each one. This allowed computing the average number of days per week that the child engages in at least one of these five activities prior to enrollment. Furthermore, they reported the duration of their sleep and screen time (i.e., time spent watching television or playing video games and gameboy). Finally, using a five-point Likert scale, the parent compared their child’s activity level to same-age peers [11].
Data analysis
This hypothesis-generating analysis aimed to identify which demographic and clinical variables were associated with weight gain during extended treatment with risperidone. However, in order to account for the natural growth observed in children monitored over several years, weight and BMI measurements were converted into age- and sex-adjusted z scores using the 2000 Center for Disease Control normative data [30]. A z score refers to the number of standard deviations above or below the mean, in a particular population. Similarly, a z score was generated for birth weight, adjusting for gender and gestational age [31].
In order to model weight (or BMI) z score change after risperidone was started, a hierarchical linear mixed model analysis was used to fit the trajectory of sex-age-adjusted weight (or BMI) z score over time by estimating a mean curve for weight (or BMI) z score over time for the overall group from the individual curve of each child. Thus, the model included both a fixed and random effect for intercept and slope (i.e., time), to represent the mean curve and the random variation of each child’s curve from the mean curve, respectively. The selected covariates of baseline weight (or BMI) z score (i.e., one obtained on or within a month before starting risperidone), weight-adjusted (mg/kg) daily dose of risperidone, age when risperidone was started, and weight-adjusted (mg/kg) daily dose of psychostimulants were included in this “primary” model since they have either been shown to affect AAP-induced weight (or BMI) gain or because there was a theoretical reason to believe so [11]. Interactive effects between time and other variables were tested and the significant ones were kept in the model. Because we anticipated that weight gain will plateau at some point after risperidone is started, the log transform of time was used in the model. Since BMI normally declines before it “rebounds” between 2.0 and 5.5 years of age, those measurements recorded before age 5.5 were excluded from the BMI analyses [30]. Finally, since the participants (7%) could have received antipsychotics other than risperidone prior to, but not at, enrollment, observations obtained after initiation of AAPs other than risperidone were excluded from the analysis.
Additional variables were subsequently added to the “primary” model to explore their independent contribution to risperidone-induced weight (or BMI) gain. When several related variables were tested (e.g., diet or physical activity), a backward model selection was applied to remove non-significant (α >5%) effects from the mixed regression model.
We also aimed to evaluate the association between change in weight prior to risperidone treatment with the change afterwards. For instance, we sought to explore whether children who might have lost weight before risperidone was started, presumably due to psychostimulants [32], exhibited accelerated weight gain with risperidone. Thus, we initially regressed weight (or BMI) z scores, obtained before starting risperidone, on time. This analytical method was used because, in this observational study, weight (or BMI) measurements were collected at the discretion of the clinicians, at varying time points during the course of treatment. The slope estimate of change in weight (or BMI) z score over time was standardized by dividing it by its own standard deviation in order to adjust for the variability in the number of observations used to estimate the slope for each subject. The standardized slope from this linear regression model was, subsequently, added to the “primary” linear mixed model as an additional predictor. A similar approach was used to model weight change during the first three months of risperidone treatment in order to explore whether it was associated with further weight gain.
All the statistical tests performed were two-tailed, using SAS version 9.2 for Windows (SAS Institute Inc., Cary, NC). Since this was a hypothesis-generating analysis, we did not correct for the number of tests conducted.
Results
Subject characteristics
A total of 163 participants were recruited into the study of whom 110 (67%) had the necessary data to contribute to testing the “primary” model. The single most common reason for exclusion from the analysis was the absence of a baseline weight in 26% of the sample. The demographic and clinical characteristics of those contributing to this analysis are reported in Table 1. Across all the demographic and clinical variables listed in Table 1 through 3, only weight z score (but not BMI z score) was different between those included and excluded from the analysis.
The mean age at enrollment of the participants was 11.8 years (sd = 2.9) and the mean duration of treatment with risperidone was 2.5 years (sd = 1.7). The majority (81%, n = 89) received risperidone to target irritability and aggression, after having failed to respond to other psychotropics over 2.3 years (sd = 2.3).
As shown in Table 1, attention deficit hyperactivity disorder (ADHD) and disruptive behavior disorders were most common. As is typical for such a clinical sample, comorbidity was prevalent, with a median number of diagnoses of 2 (Interquartile range [IQR] = 1). Moreover, polypharmacy was the rule with only 4% (n = 4) of the sample taking risperidone alone. In fact, the median number of psychotropics, taken in addition to risperidone, was 3 (IQR = 1), with psychostimulants, selective serotonin reuptake inhibitors (SSRIs), and α2-agonists (i.e., clonidine or guanfacine) being the most co-prescribed (Table 2). Other psychotropics received upon enrollment by a minority of participants include trazodone (n = 5), imipramine (n = 4), clomipramine (n = 3), valproate (n = 2), bupropion (n = 2), gabapentin (n = 2), lithium (n = 1), oxcarbazepine (n = 1), topiramate (n = 1), lamotrigine (n = 1), levetiracetam (n = 1), buspirone (n = 1), and venlafaxine (n = 1).
As previously reported [11], weight and BMI z scores significantly increased, after risperidone was started, by nearly 0.5 z score point (p<.0001) (Table 1).
Weight gain during risperidone treatment; “primary” model
Over a period extending between 15.6 years before and 8.4 years after risperidone was started, a mean of 15.1 (sd = 12.2) weight measurements were available per month for the sample. More than twice as many measurements (mean = 31.7, sd = 10.9) per month were available for the period extending between 2.5 years before and 2.5 years after risperidone was started.
Using mixed regression analysis to test the “primary” model, baseline weight z score (β = 1.13, p < .0001), time on risperidone (β = 0.16, p < .0001), and the weight-adjusted dose of risperidone (β = 2.6, p < .0001) were all positively associated with weight z score. In addition, the interaction effect of time and baseline weight z score was significant (β = −0.05, p <; .005) as well as that of time and the weight-adjusted dose of psychostimulants (β = −0.04, p <; .0001). This suggests that, over time, the association between baseline weight z score and subsequent measurements attenuates while that of psychostimulants becomes more prominent. There was no significant effect of age when risperidone was started (p > .5).
Similarly, baseline BMI z score (β = 1.05, p <; .0001), time on risperidone (β = 0.16, p <; .0001), and the weight-adjusted dose of risperidone (β = 14.0, p <; .0001) were positively associated with BMI z score with the weight-adjusted dose of psychostimulants being negatively so (β = −0.19, p <; .0001). Again, the effect of baseline BMI z score wanes over time (interaction effect β = −0.05, p <; .02). In addition, the interaction effect of time and the dose of risperidone was significant (interaction effect β = −1.96, p <; .001), also suggesting that the association between the dose of risperidone and BMI z score declines over the course of treatment.
Effect of concomitant psychotropics
Besides psychostimulants, SSRIs and α2-agonists were the most commonly co-prescribed psychotropics in this sample (Table 2). Thus, we investigated their potential effect on risperidone-induced weight gain. The number of SSRI units was negatively associated with weight z score (β = −0.05, p = .0005) while both SSRIs and α2-agonists were negatively associated with BMI z score (β = −0.06, p <; .04 and β = −0.14, p = .0006, respectively), after accounting for the other “primary” covariates.
Effect of birth weight and growth rate in infancy
Birth weight z score, adjusted for gender and gestational age, was significantly correlated with weight z score at the onset of psychotropic treatment (Spearman’s r = 0.29, p = .0007) but not with BMI z score (Spearman’s r = 0.13, p > .1). However, it did not significantly contribute to the mixed regression model of either weight or BMI z score (both p values > .1), after accounting for the other “primary” covariates.
Between birth and 2 years of life, weight z score increased by an average of 0.6 (sd = 1.3). Of the 70 participants who had this information available, 14% (n = 10) showed a reduction of their weight z score by more than 0.67 point, 50% showed no significant change, and 36% (n = 25) showed an increase by more than 0.67 point (i.e., catch-up group). This postnatal change in weight z score did not significantly influence weight or BMI z score during risperidone treatment, after accounting for the other “primary” covariates (all p values > .1).
Effect of pre-risperidone change in weight or BMI z scores
Next, we explored whether the change in weight during the 18 months prior to risperidone initiation improved model prediction of weight gain in risperidone-treated children. As described above, we estimated the slope of change in weight z score for each individual and standardized it before entering it in the mixed regression model as an additional covariate. Data were available to compute this slope in 96 participants, of whom 33 had a negative slope (i.e., they lost weight during that period), 45 had a null slope, and 18 had a positive one. After accounting for the “primary” covariates, the slope of weight z score did not significantly contribute to the model. Similar results were found for BMI z score.
Effect of acute post-risperidone change in weight or BMI z scores
We, then, explored whether the change in weight during the first three months after risperidone was started was associated with further weight z score changes. Again, we estimated the slope of change in weight z score for each individual and standardized it before entering it in the mixed regression model as an additional covariate. Data were available to compute this slope in 40 participants for the weight and in 17 for the BMI z score analyses. After accounting for the “primary” covariates, the slope of change in weight z score during the first 3 months of treatment did not significantly contribute to the model. However, there was a suggestion of a positive association between the change in BMI z score during the first 3 months of risperidone treatment and further increase in BMI z score (β = 0.10, p <; .1), after taking into account the other “primary” covariates.
Effect of dietary intake, physical activity, and parental BMI
Table 3 lists the mean values of the different variables related to dietary intake and physical activity. After controlling for the other covariates in the “primary” model, neither dietary intake, nor physical activity, maternal BMI, or paternal BMI obtained at enrollment significantly contributed to the change in weight or BMI z scores.
Discussion
To our knowledge, this is the first pediatric study, spanning several years before and after the onset of risperidone treatment, to identify several independent correlates of change in weight (BMI). The possible confounding effect of other AAPs was removed by restricting this analysis to a single agent, risperidone, which is the most commonly-used and best investigated antipsychotic in youths [1, 5–7]. In addition, this sample included a heterogeneous clinical group, representative of the general population treated with AAPs. While baseline weight (or BMI) z score and the daily dose of risperidone were associated with a higher weight (or BMI) z score during risperidone treatment, these effects subsided over time. On the other hand, psychostimulants, SSRIs, and α2-agonists were associated with lower weight (BMI).
Dose-dependent weight gain with risperidone
Studies in adults suggest that for some, but perhaps not all, AAPs, weight gain and cardiometabolic abnormalities are dose-dependent [34]. In children and adolescents, short-term, randomized clinical trials and observational studies have found weight gain to be dose-dependent for risperidone and aripiprazole but not quetiapine [6, 12, 35]. The findings with risperidone are inconsistent, however, perhaps because, in the one clinical trial in bipolar disorder that failed to find a dose effect, the treatment groups were not matched on baseline weight [36]. Regardless, because of the short-term duration of these trials, it is difficult to make predictions about weight changes over longer periods of exposure. Moreover, most pediatric clinical trials conducted to date have not enrolled participants based on weight at the onset of treatment or AAP-naïve status, two related characteristics associated with AAP-induced weight gain [11, 12, 22, 37, 38].
Another critical factor influencing a potential link between AAP dose and weight gain is medication adherence. Adherence is often suboptimal during extended treatment of any kind, but perhaps particularly so in the population of children receiving AAPs. Furthermore, treatment adherence is often challenging to capture accurately in naturalistic long-term studies such as the one reported here. This is particularly important since several antipsychotic-related adverse events that could potentially reduce adherence, such as sedation or hyperprolactinemia, are dose-dependent [36, 39, 40]. Finally, adjusting the dose for weight, as we have done, or measuring the medication serum concentration could increase the sensitivity of dose as a predictor of weight gain.
The factors mentioned above might explain some of the inconsistency in the literature regarding the dose effect of AAPs on weight gain. Moreover, we found that the dose of risperidone is associated with an increase in BMI z score but this effect wanes over time. This too could explain why only some studies have found a dose effect. Since weight gain eventually plateaus, following an interval whose duration is related to several factors including baseline weight and status of prior treatment with AAPs, it is likely that dose exerts a significant effect during the initial phase of treatment but this gradually wanes as weight gain nears its plateau. In other words, our findings suggest that youth receiving a lower dose of risperidone will gain weight at a slower rate. However, during extended treatment, the eventual weight accrued might be similar to when higher doses are used, since each individual will eventually reach his/her new homeostatic set point, as modified by AAP treatment. The metabolic consequences of these differing trajectories have been reported elsewhere [41].
Contribution of concurrent psychotropic medications
Psychostimulants are known to suppress appetite and growth [32]; thus, investigators have explored whether these medications protect against AAP-related weight gain. Two large, short-term, studies failed to find a “protective” effect of concurrent psychostimulant treatment [12, 42]. A third, albeit smaller, study showed a similar lack of effect [43]. However, such studies usually require maintaining the dose of psychostimulants stable for a period of time prior to and during AAP treatment. Unlike in our prior publication where concomitant exposure to psychostimulants was simply averaged across the risperidone-treatment period [11], our current, more precise, analysis revealed that a weight-adjusted dose of concomitant psychostimulant therapy was associated with less weight gain and that this effect seemed to persist over time. Figure 1 illustrates the trajectory of BMI z score of two, hypothetical, otherwise identical risperidone-treated children except that only one of them is receiving concurrent treatment with a psychostimulant.
Trajectory of weight gain with and without treatment with psychostimulants. Estimated trajectory of BMI z score change over a two-year period in a hypothetical participant on risperidone monotherapy and one on a combination of risperidone and a psychostimulant. These trajectories were modeled for a prototypical participant using the sample mean for baseline BMI z score (0.13), age at the onset of risperidone treatment (9.3 years), daily weight-adjusted dose of risperidone (0.03 mg/kg/d) and methylphenidate (0.9 mg/kg/d).
In adults, acute SSRI monotherapy tends to either be weight neutral or to reduce weight. However, an increase in weight has been noted over longer periods of treatment [44]. This effect varies across the different SSRIs, with fluoxetine being least associated with weight gain and paroxetine most [44]. While short-term studies have described similar findings in children [45, 46], to our knowledge, only one intermediate-term placebo controlled pediatric trial of an SSRI reported weight changes. In that multiphase study, fluoxetine led to a reduction in weight during the first 19 weeks [47]. This appears to have partially recovered by week 51, though the study suffered from a significant attrition [See authors reply in ref [48]]. Fluoxetine was the most commonly used SSRI in our sample and no one received paroxetine (Table 2), perhaps explaining why SSRI treatment was associated with less weight gain in our sample. The limited number of participants receiving various SSRIs, however, does not allow us to explore their differential effect. Of note is that fluoxetine is a potent inhibitor of the CYP2D6 enzyme which is the predominant pathway for risperidone metabolism. However, the active moiety serum concentration (i.e., combined risperidone and 9-hydroxyrisperidone concentration) is at most minimally increased [49, 50]. This could, theoretically, accentuate weight gain from risperidone, although the effect is likely negligible. One significant challenge is how to validly capture effective SSRI exposure across varying formulations, developmental stages, and levels of medication adherence. We used the formula described above because of the ease of its clinical use. However, serotonin transporter occupancy might be more accurate had this information been available for children as for adults [51, 52].
Alpha2-agonists can cause anorexia acutely but have also been reported to cause weight gain [53]. To our knowledge, the long-term effect of α2-agonists on weight in youth has not been investigated in controlled studies. Therefore, our finding of an inverse association between the use of α2-agonists and BMI z score awaits replication but highlights the complex potential outcomes when multiple psychotropics are combined.
One note of caution is that the negative associations between SSRIs and α2-agonists and weight do not imply that these medications are “protective” against risperidone-induced weight gain. Rather, they merely suggest that risperidone-treated children who are concurrently taking SSRIs or α2-agonists tend to have lower weight/BMI. Therefore, our findings should be interpreted cautiously and not considered to justify polypharmacy.
Contribution of birth weight, caloric intake, physical activity, and parental weight
Several studies have linked birth weight to weight later in life [18]. Similarly, an association between rapid growth in infancy or childhood and excessive weight and insulin resistance later on has also been documented [19]. These findings are believed to support the “thrifty phenotype” hypothesis purporting that nutritionally-depriving conditions program the body to optimize energy conservation [54]. When followed by free access to energy-rich food, this “homeostatic reprogramming” could lead to excessive fat accumulation and the development of obesity and insulin resistance [54]. We hypothesized that the “thrifty phenotype” would accentuate the increased energy intake or conservation associated with risperidone treatment, thus leading to more weight gain. However, neither birth weight nor postnatal growth appeared to significantly contribute to risperidone-related weight gain in our sample, after the other significant factors were taken into account.
The contribution of high-calorie diets and a sedentary lifestyle to the obesity epidemic in the world is well documented [20]. Moreover, interventions that modify either one of these factors have resulted in weight loss [20]. More specifically, AAPs induce weight gain primarily by increasing appetite and caloric intake [55–57], though they could reduce physical activity due to sedation. We failed to find such an association, perhaps because we collected these data long after risperidone had been initiated and weight gain stabilized. This might also explain why we did not find an association between parental BMI and the children’s propensity to gain weight.
Contribution of weight trajectories before and after risperidone initiation
The discontinuation of psychostimulants is followed by accelerated growth [58]. Conversely, as noted earlier, prior treatment status is a strong correlate of AAP-induced weight gain. Nonetheless, we found no significant association between change in weight prior to the onset of risperidone and the change afterwards.
Weight gain during the first few weeks of olanzapine treatment is a strong predictor of future change in weight [22, 59]. We found only a statistical trend suggesting that an increase in BMI z score during the first three months of treatment is associated with further weight gain during more extended treatment, after taking into effect the other “primary” covariates. However, the sample size in this analysis was too small and requires future replications.
The results reported here are subject to limitations. First, it would be ideal if a randomized trial involving various AAPs explored both efficacy and tolerability during extended exposure. However, such a study is challenging to conduct for ethical, budgetary, and practical reasons. Alternatively, studies such as this one can help fill the gap by providing sorely-needed information about the long-term safety of AAPs using a more pragmatic design. Nonetheless, this remains a retrospective study with missing data, particularly regarding patients who discontinue risperidone early on and, as a result, are not enrolled. It is somewhat reassuring that the amplitude of weight gain we found is comparable to that reported in shorter-term studies [12]. In addition, nearly a third of our participants (53/163) were excluded from the analysis due to missing data. They differed from the included participants on enrollment weight, but not BMI, z score. Thus, this finding could be due to a type I error since it was the only variable that was significantly different between the two groups across 39 tested. Secondly, the specific aim of the parent study was to investigate the metabolic and skeletal effects of risperidone specifically in youths who have been receiving it over extended periods of time. It is in these children that one would be most concerned about long-term AAP safety, making the results both relevant to common clinical practice and generalizable to the broad population of children treated with AAPs. Third, except for those obtained upon study enrollment, all anthropometric measurements were not necessarily collected following standard procedures. However, like others [60], we found weight and height measurements extracted from the medical record to be highly correlated with the corresponding research measurements, obtained within a month. Further, we contend that it is the trajectory of change in weight (or BMI) during the course of treatment, as opposed to single measurements, that is of most clinical relevance. Modeling the weight (BMI) trajectory requires serial measurements, making it less susceptible to measurement errors. Fourth, we used the prescribed dose of risperidone as a predictor rather than risperidone serum concentration. This is particularly important as the serum concentration, had it been obtained repeatedly over the treatment course, would have better captured medication adherence. As discussed earlier, long-term adherence is challenging to estimate accurately and tends to decrease over time. In fact, this phenomenon could potentially explain the apparent attenuation of the effect of risperidone dose on weight that we found. Fifth, while comorbidity was common, the prevalence of various disorders was somewhat bimodal with ADHD and disruptive behavior disorders being almost universal with the other disorders afflicting a relative minority. This precluded our ability to explore whether the underlying psychiatric disorders moderated risperidone-related weight gain. Short-term randomized pediatric trials in disruptive behavior, bipolar, psychotic, tic, and pervasive developmental disorders have all revealed a somewhat comparable weight gain with AAPs [22, 36, 61–64]. However, none of these studies directly compared weight gain across different disorders, leaving unanswered the question of whether psychopathology moderates one’s propensity to gain weight during AAP treatment. Also, with the heritability of AAP-induced weight gain estimated at 60 to 80% [65], it is likely that genetic factors contribute to this adverse event as we and others have shown [66, 67]. These were not considered in the present analysis but should be in future ones. Finally, it is important to replicate our findings in a larger sample where females and individuals from a diverse racial/ethnic background are better represented.
Conclusions
In sum, we investigated the role of several demographic and clinical factors in weight gain during extended risperidone treatment in children. We found that baseline weight and the dose of risperidone were associated with weight gain but their effects subside as exposure continues. On the other hand, commonly co-prescribed medications, including psychostimulants, SSRIs, and α2-agonists, were associated with lower weight. Finally, additional putative risk factors, like birth weight, postnatal growth, physical activity, and dietary intake appear to play a limited role, if any.
While no single intervention will be sufficient to address a multi-factorial clinical problem like balancing the risk/benefit ratio of AAP treatment, our findings shed light on the complexity of how risperidone and commonly prescribed psychotropics influence weight gain and obesity risk during long-term treatment in youths. They specifically suggest that psychotropics play a potentially important role in altering the trajectory of weight gain during development. This effect might have implications in the subsequent development of cardiometabolic abnormalities and, therefore, offers an opportunity for preventive interventions.
References
Comer JS, Olfson M, Mojtabai R: National trends in child and adolescent psychotropic polypharmacy in office-based practice, 1996–2007. Journal of the American Academy of Child and Adolescent Psychiatry. 2010, 49: 1001-1010. 10.1016/j.jaac.2010.07.007.
Olfson M, Crystal S, Huang C, Gerhard T: Trends in antipsychotic drug use by very young, privately insured children. J Am Acad Child Adolesc Psychiatry. 2010, 49: 13-23.
US FDA approves SEROQUEL for the pediatric treatment of schizophrenia and bipolar mania: http://www.astrazeneca-us.com/?itemId=7659483.
Zyprexa: Medication Guide. http://www.fda.gov/downloads/Drugs/DrugSafety/UCM134700.pdf.
FDA Approves the First Drug to Treat Irritability Associated with Autism, Risperdal. http://www.fda.gov/bbs/topics/NEWS/2006/NEW01485.html.
Recommendation of Approvable Action for risperidone (Risperdal®) for the Treatment of Schizophrenia and Bipolar I Disorder in Pediatric Patients (response to PWR).http://www.fda.gov/downloads/Drugs/DevelopmentApprovalProcess/DevelopmentResources/UCM163241.pdf.
Findling RL: Atypical antipsychotic treatment of disruptive behavior disorders in children and adolescents. The J Clin Psychiatry. 2008, 69 (Suppl 4): 9-14.
Pliszka SR, Crismon ML, Hughes CW, Corners CK, Emslie GJ, Jensen PS, McCracken JT, Swanson JM, Lopez M: The Texas Children's Medication Algorithm Project: revision of the algorithm for pharmacotherapy of attention-deficit/hyperactivity disorder. J A Acad Child Adolesc Psychiatry. 2006, 45: 642-657. 10.1097/01.chi.0000215326.51175.eb.
RUPP AN: Risperidone treatment of autistic disorder: longer-term benefits and blinded discontinuation after 6 months. Am J Psychiatry. 2005, 162: 1361-1369.
Reyes M, Buitelaar J, Toren P, Augustyns I, Eerdekens M: A randomized, double-blind, placebo-controlled study of risperidone maintenance treatment in children and adolescents with disruptive behavior disorders. Am J Psychiatry. 2006, 163: 402-410. 10.1176/appi.ajp.163.3.402.
Calarge CA, Acion L, Kuperman S, Tansey M, Schlechte JA: Weight gain and metabolic abnormalities during extended risperidone treatment in children and adolescents. J Child Adolesc Psychopharmacol. 2009, 19: 101-109. 10.1089/cap.2008.007.
Correll CU, Manu P, Olshanskiy V, Napolitano B, Kane JM, Malhotra AK: Cardiometabolic risk of second-generation antipsychotic medications during first-time use in children and adolescents. JAMA. 2009, 302: 1765-1773. 10.1001/jama.2009.1549.
Reaven GM: Insulin resistance: the link between obesity and cardiovascular disease. Endocrinol Metab Clin North Am. 2008, 37: vii-viii.
Steinberger J, Daniels SR, Eckel RH, Hayman L, Lustig RH, McCrindle B, Mietus-Snyder ML: Progress and challenges in metabolic syndrome in children and adolescents: a scientific statement from the American Heart Association Atherosclerosis, Hypertension, and Obesity in the Young Committee of the Council on Cardiovascular Disease in the Young; Council on Cardiovascular Nursing; and Council on Nutrition, Physical Activity, and Metabolism. Circulation. 2009, 119: 628-647. 10.1161/CIRCULATIONAHA.108.191394.
Correll CU, Carlson HE: Endocrine and metabolic adverse effects of psychotropic medications in children and adolescents. J Am Acad Child Adolesc Psychiatry. 2006, 45: 771-791. 10.1097/01.chi.0000220851.94392.30.
Wilson D: Book Weight Gain Associated With Antipsychotic Drugs (Editor ed.^eds.). Weight Gain Associated With Antipsychotic Drugs. 2009, City: The New York Times Company
Allison DB, Mentore JL, Heo M, Chandler LP, Cappelleri JC, Infante MC, Weiden PJ: Antipsychotic-induced weight gain: a comprehensive research synthesis. Am J Psychiatry. 1999, 156: 1686-1696.
Druet C, Ong KK: Early childhood predictors of adult body composition. Best Pract Res Clin Endocrinol Metab. 2008, 22: 489-502. 10.1016/j.beem.2008.02.002.
Monteiro PO, Victora CG: Rapid growth in infancy and childhood and obesity in later life–a systematic review. Obes Rev. 2005, 6: 143-154. 10.1111/j.1467-789X.2005.00183.x.
Barlow SE: Expert committee recommendations regarding the prevention, assessment, and treatment of child and adolescent overweight and obesity: summary report. Pediatrics. 2007, 120 (Suppl 4): S164-S192.
Fleischhaker C, Heiser P, Hennighausen K, Herpertz-Dahlmann B, Holtkamp K, Mehler-Wex C, Rauh R, Remschmidt H, Schulz E, Warnke A: Weight gain in children and adolescents during 45 weeks treatment with clozapine, olanzapine and risperidone. J Neural Transm. 2008, 115: 1599-1608. 10.1007/s00702-008-0105-9.
Lipkovich I, Kryzhanovskaya LA, Robertson-Plouch C, Xu W, Watson SB, Tohen MF: Predicting substantial weight gain in olanzapine-treated adolescents with schizophrenia or bipolar disorder. 2008, IL: In American Academy of Child and Adolescent Psychiatry; Chicago
Lipkovich I, Citrome L, Perlis R, Deberdt W, Houston JP, Ahl J, Hardy T: Early predictors of substantial weight gain in bipolar patients treated with olanzapine. J Clin Psychopharmacol. 2006, 26: 316-320. 10.1097/01.jcp.0000219916.88810.1c.
Correll CU: Weight gain and metabolic effects of mood stabilizers and antipsychotics in pediatric bipolar disorder: a systematic review and pooled analysis of short-term trials. J Am Acad Child Adolesc Psychiatry. 2007, 46: 687-700. 10.1097/chi.0b013e318040b25f.
Calarge CA, Zimmerman B, Xie D, Kuperman S, Schlechte JA: A cross-sectional evaluation of the effect of risperidone and selective serotonin reuptake inhibitors on bone mineral density in boys. J Clin Psychiatry. 2010, 71: 338-347. 10.4088/JCP.08m04595gre.
Association AP: Diagnostic and Statistical Manual of Mental Disorders, Text Revision. 2000, Washington, DC: American Psychiatric Association, 4
Shaffer D, Fisher P, Lucas CP, Dulcan MK, Schwab-Stone ME: NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses. J Am Acad Child Adolesc Psychiatry. 2000, 39: 28-38. 10.1097/00004583-200001000-00014.
Achenbach TM, Rescorla LA: Manual for the ASEBA School-Age Froms & Profiles. 2001, Burlington, VT: Research Center for Children, Youth & Families
Block G, Murphy M, Roullet JB, Wakimoto P, Crawford PB, Block T: Pilot validation of a FFQ for children 8–10 years (Abstract). 2000, City
Ogden CL, Kuczmarski RJ, Flegal KM, Mei Z, Guo S, Wei R, Grummer-Strawn LM, Curtin LR, Roche AF, Johnson CL: Centers for Disease Control and Prevention 2000 growth charts for the United States: improvements to the 1977 National Center for Health Statistics version. Pediatrics. 2002, 109: 45-60. 10.1542/peds.109.1.45.
Oken E, Kleinman KP, Rich-Edwards J, Gillman MW: A nearly continuous measure of birth weight for gestational age using a United States national reference. BMC Pediatr. 2003, 3: 1-10. 10.1186/1471-2431-3-1.
Faraone SV, Biederman J, Morley CP, Spencer TJ: Effect of stimulants on height and weight: a review of the literature. J Am Acad Child Adolesc Psychiatry. 2008, 47: 994-1009.
Swanson JM, Elliott GR, Greenhill LL, Wigal T, Arnold LE, Vitiello B, Hechtman L, Epstein JN, Pelham WE, Abikoff HB, et al: Effects of stimulant medication on growth rates across 3 years in the MTA follow-up. J Am Acad Child Adolesc Psychiatry. 2007, 46: 1015-1027. 10.1097/chi.0b013e3180686d7e.
Simon V, van Winkel R, De Hert M: Are weight gain and metabolic side effects of atypical antipsychotics dose dependent? A literature review. J Clin Psychiatry. 2009, 70: 1041-1050. 10.4088/JCP.08r04392.
Seroquel® (quetiapine fumarate) Tablets for the treatment of pediatric patients with schizophrenia (13–17 years old) or bipolar mania (10–17 years old). Briefing Document for Psychopharmacologic Drugs Advisory Committee, Meeting of June 9 and 10. 2009, http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/Drugs/PsychopharmacologicDrugsAdvisoryCommittee/UCM164280.pdf.
Haas M, Delbello MP, Pandina G, Kushner S, Van Hove I, Augustyns I, Quiroz J, Kusumakar V: Risperidone for the treatment of acute mania in children and adolescents with bipolar disorder: a randomized, double-blind, placebo-controlled study. Bipolar Disord. 2009, 11: 687-700. 10.1111/j.1399-5618.2009.00750.x.
Stockton G, Manos G, Forbes RA, Mankoski R: Effect of prior antipsychotic exposure on weight gain during aripiprazole treatment of irritability associated with autistic disorder. 2010, NY: In AACAP annual meeting; New York City
Saddichha S, Ameen S, Akhtar S: Predictors of antipsychotic-induced weight gain in first-episode psychosis: conclusions from a randomized, double-blind, controlled prospective study of olanzapine, risperidone, and haloperidol. J Clin Psychopharmacol. 2008, 28: 27-31. 10.1097/jcp.0b013e3181602fe6.
Findling RL, Nyilas M, Forbes RA, McQuade RD, Jin N, Iwamoto T, Ivanova S, Carson WH, Chang K: Acute treatment of pediatric bipolar I disorder, manic or mixed episode, with aripiprazole: a randomized, double-blind, placebo-controlled study. J Clin Psychiatry. 2009, 70: 1441-1451. 10.4088/JCP.09m05164yel.
Calarge CA, Ellingrod VL, Acion L, Miller DD, Moline J, Tansey MJ, Schlechte JA: Variants of the dopamine D2 receptor gene and risperidone-induced hyperprolactinemia in children and adolescents. Pharmacogenet Genomics. 2009, 19: 373-382. 10.1097/FPC.0b013e328329a60f.
Calarge C, Xie D, Zimmerman B: Clinical Predictors of Weight Change During Long-Term Risperidone Treatment. 2011, FL: Boca Raton
Penzner JB, Dudas M, Saito E, Olshanskiy V, Parikh UH, Kapoor S, Chekuri R, Gadaleta D, Avedon J, Sheridan EM, et al: Lack of effect of stimulant combination with second-generation antipsychotics on weight gain, metabolic changes, prolactin levels, and sedation in youth with clinically relevant aggression or oppositionality. J Child Adolesc Psychopharmacol. 2009, 19: 563-573. 10.1089/cap.2009.0051.
Armenteros JL, Lewis JE, Davalos M: Risperidone augmentation for treatment-resistant aggression in attention-deficit/hyperactivity disorder: a placebo-controlled pilot study. J Am Acad Child Adolesc Psychiatry. 2007, 46: 558-565. 10.1097/chi.0b013e3180323354.
Goldstein BJ, Goodnick PJ: Selective serotonin reuptake inhibitors in the treatment of affective disorders--III. Tolerability, safety and pharmacoeconomics. J Psychopharmacol. 1998, 12: S55-S87.
Wagner KD, Robb AS, Findling RL, Jin J, Gutierrez MM, Heydorn WE: A randomized, placebo-controlled trial of citalopram for the treatment of major depression in children and adolescents. Am J Psychiatry. 2004, 161: 1079-1083. 10.1176/appi.ajp.161.6.1079.
Wagner KD, Ambrosini P, Rynn M, Wohlberg C, Yang R, Greenbaum MS, Childress A, Donnelly C, Deas D: Efficacy of sertraline in the treatment of children and adolescents with major depressive disorder: two randomized controlled trials. JAMA. 2003, 290: 1033-1041. 10.1001/jama.290.8.1033.
Nilsson M, Joliat MJ, Miner CM, Brown EB, Heiligenstein JH: Safety of subchronic treatment with fluoxetine for major depressive disorder in children and adolescents. J Child Adolesc Psychopharmacol. 2004, 14: 412-417. 10.1089/cap.2004.14.412.
Calarge C, Kuperman S: Fluoxetine for depression relapse prevention. J Am Acad Child Adolesc Psychiatry. 2005, 44: 966-967. author reply 967–968
Heykants J, Huang ML, Mannens G, Meuldermans W, Snoeck E, Van Beijsterveldt L, Van Peer A, Woestenborghs R: The pharmacokinetics of risperidone in humans: a summary. J Clin Psychiatry. 1994, 55 (Suppl): 13-17.
Calarge CA, Miller DD: Predictors of risperidone and 9-hydroxyrisperidone serum concentration in children and adolescents. J Child Adolesc Psychopharmacology. 2011, 21: 163-169. 10.1089/cap.2010.0038.
Meyer JH, Wilson AA, Sagrati S, Hussey D, Carella A, Potter WZ, Ginovart N, Spencer EP, Cheok A, Houle S: Serotonin transporter occupancy of five selective serotonin reuptake inhibitors at different doses: an [11 C]DASB positron emission tomography study. Am J Psychiatry. 2004, 161: 826-835. 10.1176/appi.ajp.161.5.826.
Suhara T, Takano A, Sudo Y, Ichimiya T, Inoue M, Yasuno F, Ikoma Y, Okubo Y: High levels of serotonin transporter occupancy with low-dose clomipramine in comparative occupancy study with fluvoxamine using positron emission tomography. Arch Gen Psychiatry. 2003, 60: 386-391. 10.1001/archpsyc.60.4.386.
Vanina Y, Podolskaya A, Sedky K, Shahab H, Siddiqui A, Munshi F, Lippmann S: Body weight changes associated with psychopharmacology. Psychiatr Serv. 2002, 53: 842-847. 10.1176/appi.ps.53.7.842.
Dulloo AG: Regulation of fat storage via suppressed thermogenesis: a thrifty phenotype that predisposes individuals with catch-up growth to insulin resistance and obesity. Horm Res. 2006, 65 (Suppl 3): 90-97.
Basson BR, Kinon BJ, Taylor CC, Szymanski KA, Gilmore JA, Tollefson GD: Factors influencing acute weight change in patients with schizophrenia treated with olanzapine, haloperidol, or risperidone. J Clin Psychiatry. 2001, 62: 231-238. 10.4088/JCP.v62n0404.
Fountaine RJ, Taylor AE, Mancuso JP, Greenway FL, Byerley LO, Smith SR, Most MM, Fryburg DA: Increased food intake and energy expenditure following administration of olanzapine to healthy men. Obesity (Silver Spring). 2010, 18: 1646-1651. 10.1038/oby.2010.6.
Gothelf D, Falk B, Singer P, Kairi M, Phillip M, Zigel L, Poraz I, Frishman S, Constantini N, Zalsman G, et al: Weight gain associated with increased food intake and low habitual activity levels in male adolescent schizophrenic inpatients treated with olanzapine. Am J Psychiatry. 2002, 159: 1055-1057. 10.1176/appi.ajp.159.6.1055.
Safer DJ, Allen RP, Barr E: Growth rebound after termination of stimulant drugs. J Pediatr. 1975, 86: 113-116. 10.1016/S0022-3476(75)80720-7.
Lipkovich I, Jacobson JG, Hardy TA, Hoffmann VP: Early evaluation of patient risk for substantial weight gain during olanzapine treatment for schizophrenia, schizophreniform, or schizoaffective disorder. BMC Psychiatry. 2008, 8: 78-10.1186/1471-244X-8-78.
Arterburn D, Ichikawa L, Ludman EJ, Operskalski B, Linde JA, Anderson E, Rohde P, Jeffery RW, Simon GE: Validity of Clinical Body Weight Measures as Substitutes for Missing Data in a Randomized Trial. Obes Res Clin Pract. 2008, 2: 277-281. 10.1016/j.orcp.2008.09.002.
Aman MG, Binder C, Turgay A: Risperidone effects in the presence/absence of psychostimulant medicine in children with ADHD, other disruptive behavior disorders, and subaverage IQ. J Child Adolesc Psychopharmacol. 2004, 14: 243-254. 10.1089/1044546041649020.
McCracken JT, McGough J, Shah B, Cronin P, Hong D, Aman MG, Arnold LE, Lindsay R, Nash P, Hollway J, et al: Risperidone in children with autism and serious behavioral problems. N Engl J Med. 2002, 347: 314-321. 10.1056/NEJMoa013171.
Scahill L, Leckman JF, Schultz RT, Katsovich L, Peterson BS: A placebo-controlled trial of risperidone in Tourette syndrome. Neurology. 2003, 60: 1130-1135. 10.1212/01.WNL.0000055434.39968.67.
Sikich L, Frazier JA, McClellan J, Findling RL, Vitiello B, Ritz L, Ambler D, Puglia M, Maloney AE, Michael E, et al: Double-blind comparison of first- and second-generation antipsychotics in early-onset schizophrenia and schizo-affective disorder: findings from the treatment of early-onset schizophrenia spectrum disorders (TEOSS) study. Am J Psychiatry. 2008, 165: 1420-1431. 10.1176/appi.ajp.2008.08050756.
Gebhardt S, Theisen FM, Haberhausen M, Heinzel-Gutenbrunner M, Wehmeier PM, Krieg JC, Kuhnau W, Schmidtke J, Remschmidt H, Hebebrand J: Body weight gain induced by atypical antipsychotics: an extension of the monozygotic twin and sib pair study. J Clin Pharm Ther. 2010, 35: 207-211. 10.1111/j.1365-2710.2009.01084.x.
De Luca V, Mueller DJ, de Bartolomeis A, Kennedy JL: Association of the HTR2C gene and antipsychotic induced weight gain: a meta-analysis. Int J Neuropsychopharmacol. 2007, 10: 697-704.
Calarge CA, Ellingrod VL, Zimmerman B, Acion L, Sivitz WI, Schlechte JA: Leptin gene -2548 G/A variants predict risperidone-associated weight gain in children and adolescents. Psychiatr Genet. 2009, 19: 320-327. 10.1097/YPG.0b013e3283328e06.
Acknowledgments
This study was funded by a 2005 Young Investigator Award and by the National Institute of Health (RR024979, R21MH080968, and K23MH085005). The content is solely the responsibility of the authors and does not necessarily represent the official views of the funding agencies.
The authors thank the families and the staff in the University of Iowa Child and Adolescent Psychiatry clinic and in the Clinical Research Unit. We also acknowledge the helpful comments of John Newcomer, M.D.
Aspects of this work have been presented at the 51th NCDEU Annual Meeting, June, 2011, Boca Raton, FL.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors report no competing interests.
Dr. Calarge has received research grant support from the National Institute of Mental Health, (NIMH), the National Alliance for Research in Schizophrenia and Depression (NARSAD), and the Children’s Miracle Network. Dr. Nicol has received research grant support from the National Institute of Mental Health, (NIMH), the National Alliance for Research in Schizophrenia and Depression (NARSAD), the Sydney R. Baer, Jr. Foundation, the Communities Helping Adolescent Depression and Suicide (CHADS) Coalition for Mental Health, the Dana Brown Charitable Trust Foundation and Pfizer Inc. She also receives royalties from Jones & Bartlett Learning for a pediatric metabolic monitoring form. Dr. Zimmerman and Dr. Xie have no conflict of interest to disclose.
Authors’ contributions
All authors have given final approval of the submitted version of the manuscript. CC: Designed and conducted the study, contributed to data analysis/interpretation and manuscript preparation. BZ and DX: Conducted the data analysis and contributed to the interpretation of findings and to manuscript preparation. GN: Contributed to the interpretation of findings and to manuscript preparation.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Calarge, C.A., Nicol, G., Xie, D. et al. Correlates of weight gain during long-term risperidone treatment in children and adolescents. Child Adolesc Psychiatry Ment Health 6, 21 (2012). https://doi.org/10.1186/1753-2000-6-21
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1753-2000-6-21