# GAD vaccine reduces insulin loss in recently diagnosed type 1 diabetes: findings from a Bayesian meta-analysis

- 1.6k Downloads
- 9 Citations

## Abstract

### Aims/hypothesis

GAD is a major target of the autoimmune response that occurs in type 1 diabetes mellitus. Randomised controlled clinical trials of a GAD + alum vaccine in human participants have so far given conflicting results.

### Methods

In this study, we sought to see whether a clearer answer to the question of whether GAD65 has an effect on C-peptide could be reached by combining individual-level data from the randomised controlled trials using Bayesian meta-analysis to estimate the probability of a positive biological effect (a reduction in C-peptide loss compared with placebo approximately 1 year after the GAD vaccine).

### Results

We estimate that there is a 98% probability that 20 μg GAD with alum administered twice yields a positive biological effect. The effect is probably a 15–20% reduction in the loss of C-peptide at approximately 1 year after treatment. This translates to an annual expected loss of between −0.250 and −0.235 pmol/ml in treated patients compared with an expected 2 h AUC loss of −0.294 pmol/ml at 1 year for untreated newly diagnosed patients.

### Conclusions/interpretation

The biological effect of this vaccination should be developed further in order to reach clinically desirable reductions in insulin loss in patients recently diagnosed with type 1 diabetes.

## Keywords

Bayes methods Glutamic acid decarboxylase (GAD) Meta-analysis Type 1 diabetes Vaccine## Abbreviations

- PPBE
Probability of positive biological effect

- RCT
Randomised controlled trial

## Introduction

GAD RCTs

Ludvigsson (2008) [4] | Wherrett (2011) [5] | Ludvigsson (2012) [6] | |
---|---|---|---|

| 70 | 145 | 334 |

Age, years (range) | 10–18 | 3−45 | 10–18 |

Months since diagnosis at entry (maximum) | 18 | 3 | 3 |

GAD dosing | 20 μg GAD + alum | 20 μg GAD + alum | 20 μg GAD + alum |

Control | Alum | Alum | Alum |

Schedule (GAD) | Two -dose: days 1 and 30 | Three-dose: baseline, weeks 4 and 12 Two-dose: baseline and week 4 | Four-dose: days 1, 30, 90 and 270 Two-dose: days 1 and 30 |

Primary endpoint | 15 month change in fasting C-peptide | Baseline adjusted mean 2 h C-peptide AUC at 12 months | Baseline adjusted 15 month change in 2 h C-peptide AUC |

| 0.28 | Two-dose: 0.50 Three-dose: 0.98 | Two-dose: 0.13 Four-dose: 0.20 |

Based on a PubMed search of the literature, the earliest published Phase 2 or Phase 3 RCT of GAD vaccination was Ludvigsson et al (2008) [4], in which 70 patients with recent-onset type 1 diabetes were randomised (1:1) to receive either 20 μg GAD with alum (GAD) or a placebo of alum in a two-dose regimen at days 1 and 30 post-randomisation. This was followed in 2011 by a TrialNet study led by Wherrett et al [5] in which 145 participants were enrolled into a three-arm RCT (1:1:1) and given one of the following three treatments: three doses of GAD given at weeks 0, 4 and 12 after randomisation; two doses of GAD at baseline and week 4 and one dose of placebo at week 12; or three doses of placebo. Finally, another RCT by Ludvigsson et al appeared in 2012 [6], which enrolled 334 participants into three treatment groups that received: 20 μg GAD given in four doses (days 1, 30, 90 and 270); 20 μg GAD given in two doses (days 1 and 30) with placebo given on the other days; or placebo given on all dosing days for the placebo group.

The primary findings from these three studies were markedly different. In Ludvigsson (2008) [4], a statistically significant (*p* = 0.045) difference was found in the change in fasting C-peptide concentration at 30 months, with GAD-vaccinated individuals showing a smaller loss than the placebo group. In addition, a statistically significant reduction in C-peptide loss, measured by the change in stimulated C-peptide area over a 2 h test (AUC) was observed at 15 months (*p* = 0.01) and 30 months (*p* = 0.04). However, the primary endpoint, the 15-month change in fasting C-peptide concentration, failed to reach statistical significance (*p* = 0.28). Contrary to these findings, both Wherrett (2011) and Ludvigsson (2012) reported non-significant findings for their primary endpoint – the change in stimulated C-peptide AUC at 12 and 15 months, respectively.

Further consideration of the studies (Table 1) reveals differences in their design and analysis. Both Ludvigsson studies [4, 6] had a restricted age range (10–18 years) compared with Wherrett’s study, which enrolled participants as young as 3 and as old as 45 years. Ludvigsson (2008) [4] enrolled participants up 18 months after diagnosis, whereas the other two studies enrolled individuals within 3 months. Finally, not only did the primary endpoints differ (a 15 month change in fasting C-peptide level in Ludvigsson [2008], a 12 month change in stimulated 2 h C-peptide AUC in Wherrett [2011] and a 15 month AUC change in Ludvigsson [2012]), but the analyses were also heterogeneous. In Ludvigsson (2008), the arithmetic difference of C-peptide (both fasting and AUC) at 15 months and baseline were compared after adjusting for baseline C-peptide; in Wherrett (2011), the geometric mean of the AUC + 1 (i.e. the number 1 was added to the AUC value) was compared after adjusting for the baseline natural logarithm of AUC + 1, sex and age; and in Ludvigsson (2012), the natural logarithm of the proportion change from baseline was compared after adjusting for baseline log AUC and country of the clinical site.

In this study, we conducted a meta-analysis using individual-level data from these clinical RCTs in order to determine the probability that GAD has any positive biological effect, defining a ‘positive biological effect’ as a reduction of C-peptide loss 12–15 months after diagnosis of type 1 diabetes compared with placebo. This ‘posterior probability of positive effect’ was estimated using Bayesian methods [7]. Our goal in conducting this meta-analysis was to see whether a clearer answer to the question of whether GAD65 has an effect on C-peptide could be reached by combining the data from the RCTs.

## Methods

As described above, we used individual-level data from three major GAD trials (Table 1) which, as of 1 June 2015, represented the entirety of published clinical RCTs of GAD in relation to a reduction in the loss of endogenous insulin production in patients with recent-onset type 1 diabetes. Two of the studies [4, 6] were sponsored by Diamyd, the company producing the vaccine. The third trial was conducted by TrialNet independently of Diamyd, with the same study drug donated by the company.

We used Bayes methods to compute ‘posterior probabilities’ of biological effect (reduction of insulin secretion loss compared with placebo) using data combined from the three studies. As described below, the adjective ‘posterior’ is used to denote that this probability is computed after the data have been observed.

The Bayes method is similar to computation of the predictive value for a diagnostic test, which can itself be thought of as a ‘posterior probability‘. For example, in diagnostic testing, one begins with an initial (i.e. prior to diagnostic testing) assessment of the probability that the patient has a disease (e.g. disease prevalence) and then updates that assessment using the data from a test to yield an improved probability assessment of disease (the ‘posterior probability’, which is synonymous with predictive value). Bayes methods simply supply the calculus needed to compute the posterior probability of a treatment or biological effect using the data from a scientific study. Further information about Bayes methods in clinical research can be found elsewhere [8, 9, 10] . Although Bayesian approaches to the design of clinical trials have been used in type 2 diabetes [11], as of the time of our review they had not appeared in the literature on type 1 diabetes. However, Bayesian methods in type 1 diabetes outside of RCTs can be found: for example, Irie et al [12] employed a Bayesian method for genome-wide gene expression data of CD4^{+} T cells; a Bayesian method for normalisation of quantitative PCR data in profiling urinary microRNA in the nephropathy of type 1 diabetes by Argyropoulos et al [13, 14] has been published; and as recently as 2015, Bayesian methods were applied to improve glucose sensor models [15].

To make the interpretation of ‘biological effect’ similar across the studies, our endpoint was the natural logarithm of 2 h stimulated C-peptide AUC after 1 year expressed as a proportion of baseline. Interpretation of the posterior probability of a biological effect (PPBE) was then similar for each study as the comparison was the difference in mean log_{ e } (proportion of baseline) in the GAD-treated group minus the mean for the placebo group. As a positive treatment effect means a reduction in loss, positive values for this difference meant that GAD treatment had a positive biological effect. Thus, the probability that the effect of treatment with GAD had a positive biological effect equals the posterior probability that the coefficient of GAD treatment is greater than zero when the placebo group is considered as the referent.

Our meta-analysis combined individual-level data from the three studies related to the endpoint as well as age, sex and log baseline C-peptide. The availability of other data was variable among the studies so was not included in forming our meta-analysis database.

As a ‘prior’ distribution for the biological effect of GAD, we assumed equipoise, that is, we assumed that a negative biological effect was as likely as a positive biological effect. We then used the combined data to ‘update’ the equipoise prior for the combined data. In addition, we applied the Bayes method to each of the same statistical models used in each of the three studies and conducted a sensitivity analysis by examining the effects of changing our assumptions on the prior.

The model fit for meta-analysis was: change in log (C-peptide AUC) = Intercept + Study + Baseline log (C-peptide AUC) + Age + Sex + Treatment, where ‘log’ refers to the natural logarithm. This was a generalised linear model with normally distributed errors and statistical estimation accomplished using the Bayes statement in the SAS V9.4 (SAS Institute, Cary, NC, USA) GENMOD procedure. The model included the source of the data (the study) as a fixed classificatory effect in order to examine possible inherent differences between the studies that could not be accounted for by the variables included in the meta-analysis database. Age (years) was included as a continuous variable. Sex (male/female) had ‘male’ as the referent category. Treatment was included as a classification variable with 0, 2, 3 and 4 doses of GAD. Conjugate normal (0.1 × 10^{6}) priors were assumed for all regression coefficients in the generalised model with identity link function and normal distribution of errors. An improper prior was assumed for the dispersion parameter of the errors. Maximum likelihood estimates were used as the initial values of the chain. The Bayes estimation of posterior distributions used Gibbs sampling with a burn-in size of 2000 followed by 10,000 sets of sampled parameter estimates from the posterior. Evaluation of convergence and model run were assessed with Geweke diagnostics and plots of parameter values across the 10,000 runs and autocorrelation plots. These results are available from the corresponding author. Posterior estimates were output and graphed using GraphPad Prism V.6.00 for Windows (GraphPad Software, La Jolla, CA, USA; www.graphpad.com). For sensitivity analysis, we considered Jeffery’s and uniform distributions as alternatives for the priors.

## Results

Examination of the posterior probability histograms from each of the three studies (Fig. 1a–c) highlights the heterogeneity between the studies. While each of the Ludvigsson studies [4, 6] provided a high PPBE for the two-dose GAD treatment, the Wherrett study provided a much lower PPBE. We used post hoc methods to identify potential reasons for the differences between the studies.

*p*< 0.05) older, and the baseline log AUC was higher in Ludvigsson (2008) [4] than in the other studies. Some literature suggests that older individuals with type 1 diabetes have reduced C-peptide loss compared with younger individuals, which may lead to the smaller apparent effects of GAD that were seen in Wherrett (2011). On the other hand, subgroups reported in Wherrett (2011) did not show a statistically significant difference in C-peptide change when comparing younger with older participants. There were also some data to suggest that higher baseline values of C-peptide AUC are associated with increased loss due to a ‘basement’ restriction, so we would expect more of a loss in Ludvigsson (2008), as was indeed observed. Of course, the inclusion of these covariates in the analysis of the combined datasets should control for these differences when computing posterior probabilities of biological effect, so we felt that other differences needed to be considered. However, we were prevented from doing this because no other variables were consistently available in each of the datasets provided to us.

Statistical comparison of covariates between studies

Variable | Study: mean (95% CI) | Wherrett (2011)–Ludvigsson (2008) | Wherrett (2011)–Ludvigsson (2012) | Ludvigsson (2012)– Ludvigsson (2008) | Overall |
---|---|---|---|---|---|

Age (years) | Ludvigsson (2008): 13 (12, 15) | 3.79 (2.28, 5.30) | 4.08 (3.05, 5.12) | 0.29 (−1.07, 1.64) | |

Wherrett (2011): 17 (16, 18) | |||||

Ludvigsson (2012): 13 (12, 14) | |||||

Log baseline AUC log | Ludvigsson (2008): 0.10 (−0.20, 0.22) | −0.53 (−0.68, −0.39) | 0.09 (−0.01, 0.19) | −0.62 (−0.76, −0.49) | |

Wherrett (2011): −0.43 (−0.52, −0.35) | |||||

Ludvigsson (2012): −0.52 (−0.58, −0.46) |

We were nonetheless able to conduct a post hoc comparison of the percentage of ‘placebo responders’ between the studies. A placebo responder is defined here as a participant treated with placebo who showed a maintained or increased C-peptide AUC from baseline. We decided to compare this variable as it measures, to some extent, a potential bias arising from the mechanisms of patient selection between the studies.

Summary of results from sensitivity analyses: posterior PPBE using models from each source publication (i.e. differing outcome and explanatory variables)

Source publication | Outcome | Explanatory variables used in source publication | Prior information used | Dose information | Posterior PPBE (%) |
---|---|---|---|---|---|

Ludvigsson (2008) [4] | C-peptide change (15 months) | Treatment baseline C-peptide | Normal distribution | Two-dose | 85.88 |

Ludvigsson (2008) [4] | C-peptide change (30 months) | Treatment baseline C-peptide | Normal distribution | Two-dose | 97.63 |

Ludvigsson (2008) [4] | AUC change (15 months) | Treatment baseline AUC | Normal distribution | Two-dose | 99.38 |

Ludvigsson (2008) [4] | AUC change (30 months) | Treatment baseline AUC | Normal distribution | Two-dose | 98.16 |

Wherrett (2011) [5] | log | Sex Age Treatment Baseline log | Normal distribution | Two-dose | 26.76 |

Three-dose | 68.82 | ||||

Ludvigsson (2012) [6] | log | Treatment log Month Treatment × month log | Normal distribution | Two-dose | 97.14 |

Four-dose | 96.82 |

Summary of results from sensitivity analyses: posterior PPBE and changing prior distribution

Source publication | Coefficient prior | SD prior | PPBE due to treatment (%) |
---|---|---|---|

Ludvigsson (2008) [4] | Normal | Gamma | 99.38 |

Ludvigsson (2008) [4] | Jeffrey’s | Gamma | 99.32 |

Ludvigsson (2008) [4] | Uniform | Gamma | 99.32 |

Ludvigsson (2008) [4] | Normal | Improper | 99.38 |

Ludvigsson (2008) [4] | Jeffrey’s | Improper | 99.32 |

Ludvigsson (2008) [4] | Uniform | Improper | 99.32 |

## Discussion

In this study, we sought to answer the question ‘Should development of the GAD vaccine be continued or discontinued?’ The currently published RCT literature provides conflicting information and the studies are not by themselves sufficient to answer our question. In addition, from the decision-maker’s position, an answer to the question ultimately requires an assessment of the probability of whether or not the GAD vaccine is biologically effective. For this, we used Bayesian methods to determine the posterior probability of biological effect. Such a strategy has been advocated as an aid to the interpretation of RCTs [7]. We used a natural starting point for this prior assessment, equipoise, in which we assigned a 50% chance of a positive biological effect. We then used data to update the prior using Bayesian methods. From this resultant ‘posterior’ distribution, we were then able to compute the PPBE, thus providing the information needed for answering our question.

Our analysis of the combined data estimates there to be a high (approximately 98%) probability that two-dose GAD vaccine has a positive biological effect, i.e. a reduction in C-peptide loss compared with placebo. The most likely (modal) value of the biological effect is a 15–20% reduction in loss relative to placebo. Greenbaum et al [16] estimated a C-peptide AUC loss of −0.0245 pmol/ml per month, which translates to an expected loss of −0.294 pmol/ml at 1 year for untreated newly diagnosed patients. We therefore estimate that, most probably, two doses of 20 μg GAD with alum GAD vaccine reduces C-peptide AUC loss by on average 0.044–0.059 pmol/ml after 1 year. That is, GAD vaccine is likely to reduce the 1 year loss to somewhere between −0.250 and −0.235 pmol/year. Similar levels of biological effect for three- and four-dose GAD were estimated. However, these two estimates were based on data coming only from single studies: three-dose treatment in Wherrett (2011) [5] and four-dose treatment in Ludvigsson (2012) [6]. We thus conclude that, most likely, the dosing regimens considered to date confer rather small and similar clinical benefits. On the other hand, a clinical benefit has to be put in relation to the feasibility and tolerability of the treatment. Thus, for GAD therapy, which is extremely easy for the patient, and has no known treatment-related adverse events, a clinical benefit of 15–20% may be as relevant and valuable as a 25–30% efficacy using a treatment modality that is more difficult to administer and/or has larger risks and more common and serious adverse events.

Of course, one must also consider the impact of GAD therapy on other endpoints (e.g. HbA_{1c} concentration, insulin usage, glycaemic variation, hypoglycaemia, etc.) to fully support a clinical benefit for it. However, some experts argue that C-peptide retention is a clinically important endpoint in its own right, pointing to research suggesting that residual C-peptide confers clinical benefits including better long-term glycaemic control [17, 18, 19]. Nonetheless, our study was designed to answer the question of whether or not GAD therapy should be developed further, so we await optimisation of this vaccine before a robust appraisal of its full clinical benefit can be attempted.

Another limitation of our study is that our meta-analysis had to limit explanatory variables to those that were common to all studies. For example, disease duration was collected by each study but only analysed as a covariate in Ludvigsson (2008) [4], in which it was found to be not statistically significant. Future studies of GAD should consider a comprehensive and common ‘core’ set of covariates for consistency and to be used in meta-analyses.

The potential of a differential selection of participants needs to be investigated further and emphasises the need for improved selection methods in clinical trials of type 1 diabetes. To this end, biomarkers that are able to select for rapid C-peptide loss need to be developed and adopted in type 1 diabetes clinical trials.

We conclude that it is highly likely that GAD vaccine has a positive biological effect. However, this might be rather small under the dose and treatment regimens considered so far in published trials. In sum, our synthesis of published RCT evidence encourages continued investigation of the GAD vaccine, specifically into ways, for example giving it as part of combination therapies that will increase its effectiveness.

## Notes

### Funding

This work was supported by JDRF grant 1-INO-20140170-A-V.

### Acknowledgements

Data were generously shared by J. Ludvigsson and Diamyd, and by D. K. Wherrett from the TrialNet.

### Duality of interest

The authors declare that there is no duality of interest associated with this manuscript.

### Contribution statement

CAB wrote the manuscript and researched data. CM provided statistical analysis, contributed to discussion and reviewed/edited the manuscript. CAB, CM, KCH, DKW and JP contributed to the conception and design of this study, to the proposal funded by the JDRF and to discussion, and reviewed/edited the manuscript. DKW and JL contributed data. JL also contributed to discussion and reviewed/edited the manuscript. All authors have given final approval of this version of the manuscript. CAB is the guarantor of this work and, as such, had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

## References

- 1.Tian J, Kaufman DL (2009) Antigen-based therapy for the treatment of type 1 diabetes. Diabetes 58:1939–1946CrossRefPubMedPubMedCentralGoogle Scholar
- 2.Tian J, Clare-Salzler M, Herschenfeld A et al (1996) Modulating autoimmune responses to GAD inhibits disease progression and prolongs islet graft survival in diabetes-prone mice. Nat Med 2:1348–1353CrossRefPubMedGoogle Scholar
- 3.Tisch R, Liblau RS, Yang XD, Liblau P, McDevitt HO (1998) Induction of GAD65-specific regulatory T-cells inhibits ongoing autoimmune diabetes in nonobese diabetic mice. Diabetes 47:894–899CrossRefPubMedGoogle Scholar
- 4.Ludvigsson J, Faresjo M, Hjorth M et al (2008) GAD treatment and insulin secretion in recent-onset type 1 diabetes. N Engl J Med 359:1909–1920CrossRefPubMedGoogle Scholar
- 5.Wherrett DK, Bundy B, Becker DJ et al (2011) Antigen-based therapy with glutamic acid decarboxylase (GAD) vaccine in patients with recent-onset type 1 diabetes: a randomised double-blind trial. Lancet 378:319–327CrossRefPubMedPubMedCentralGoogle Scholar
- 6.Ludvigsson J, Krisky D, Casas R et al (2012) GAD65 antigen therapy in recently diagnosed type 1 diabetes mellitus. N Engl J Med 366:433–442CrossRefPubMedGoogle Scholar
- 7.Wijeysundera DN, Austin PC, Hux JE, Beattie WS, Laupacis A (2009) Bayesian statistical inference enhances the interpretation of contemporary randomized controlled trials. J Clin Epidemiol 62(13–21), e15Google Scholar
- 8.Lee JJ (2011) Demystify statistical significance--time to move on from the p value to bayesian analysis. J Natl Cancer Inst 103:2–3CrossRefPubMedGoogle Scholar
- 9.Lee JJ, Chu CT (2012) Bayesian clinical trials in action. Stat Med 31:2955–2972CrossRefPubMedPubMedCentralGoogle Scholar
- 10.Goodman S (2008) A dirty dozen: twelve p-value misconceptions. Semin Hematol 45:135–140CrossRefPubMedGoogle Scholar
- 11.Skrivanek Z, Berry S, Berry D et al (2012) Application of adaptive design methodology in development of a long-acting glucagon-like peptide-1 analog (dulaglutide): statistical design and simulations. J Diabetes Sci Technol 6:1305–1318CrossRefPubMedPubMedCentralGoogle Scholar
- 12.Irie J, Reck B, Wu Y et al (2008) Genome-wide microarray expression analysis of CD4+ T cells from nonobese diabetic congenic mice identifies Cd55 (Daf1) and Acadl as candidate genes for type 1 diabetes. J Immunol 180:1071–1079CrossRefPubMedPubMedCentralGoogle Scholar
- 13.Argyropoulos C, Wang K, McClarty S, et al (2013) Erratum: Urinary microRNA profiling in the nephropathy of type 1 diabetes. PLoS one 8. doi: 10.1371/annotation/37e647d5-1781-4edf-86a8-e3b533c32ad9
- 14.Argyropoulos C, Wang K, McClarty S et al (2013) Urinary microRNA profiling in the nephropathy of type 1 diabetes. PLoS One 8, e54662CrossRefPubMedPubMedCentralGoogle Scholar
- 15.Emami A, Rabasa-Lhoret R, Haidar A (2015) Enhancing glucose sensor models: modeling the drop-outs. Diabetes Technol Ther 17:420–426CrossRefPubMedGoogle Scholar
- 16.Greenbaum CJ, Beam CA, Boulware D et al (2012) Fall in C-peptide during first 2 years from diagnosis: evidence of at least two distinct phases from composite type 1 diabetes TrialNet data. Diabetes 61:2066–2073CrossRefPubMedPubMedCentralGoogle Scholar
- 17.Kuhtreiber WM, Washer SL, Hsu E et al (2015) Low levels of C-peptide have clinical significance for established type 1 diabetes. Diabet Med: J Br Diab Assoc 32:1346–1353CrossRefGoogle Scholar
- 18.Sjoberg S, Gjotterberg M, Berglund L, Moller E, Ostman J (1991) Residual C-peptide excretion is associated with a better long-term glycemic control and slower progress of retinopathy in type I (insulin-dependent) diabetes mellitus. J Diabet Complications 5:18–22Google Scholar
- 19.Luppi P, Cifarelli V, Wahren J (2011) C-peptide and long-term complications of diabetes. Pediatr Diabetes 12:276–292CrossRefPubMedGoogle Scholar