Mixed treatment comparisons (MTCs) are increasingly important in the assessment of the benefit–risk profile of pharmaceutical treatments for relapsing–remitting multiple sclerosis (RRMS). Interpretation of MTCs requires a clear understanding of the methods of analysis and population studied. The objectives of this work were to compare MTCs of pharmaceutical treatments for RRMS, including a detailed description of differences in populations, treatments assessed, methods used and findings; and to discuss key considerations when conducting an MTC.
Fourteen databases were searched until July 2019 to identify MTCs (published during or after 2010) in adults (at least 18 years of age) with RRMS or rapidly evolving severe RRMS treated with any form of pharmaceutical treatment. No language restriction was imposed.
Twenty-seven MTCs assessing 21 treatments were identified. Comparison highlighted many differences in conduct and reporting between MTCs relating to the patient populations or treatments included, duration of follow-up and outcomes of interest measured. The lack of similarity between the MTCs leads to questions about variability in the robustness of analyses and makes comparisons between studies challenging.
Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings. For MTCs to be relevant, the choice of outcome measures should reflect clinical practice. Combination of treatments or of outcomes measured at different points of time should be avoided, as should imputation without justification. Furthermore, all approved treatment options should be included and updates of MTCs should be conducted when data for new treatments are published.
|Interpretation of mixed treatment comparisons (MTCs) requires a clear understanding of the methods of analysis and population studied.|
|MTCs of pharmaceutical treatments for relapsing–remitting multiple sclerosis were detailed and compared.|
|A comparison of all identified MTCs showed that the findings of each individual MTC were not directly comparable with the others because of differences in the disease-modifying therapies (DMTs) compared, included studies, effect measures and analysis methods.|
|Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings.|
|For MTCs to be relevant, the choice of outcome measures should reflect clinical practice, combination of treatments or outcomes measured at different points of time should be avoided, as should imputation without justification, all approved treatment options should be included, and updates of MTCs should be conducted when data for new treatments are published.|
This article is published with digital features to facilitate understanding of the article. To view digital features for this article go to https://doi.org/10.6084/m9.figshare.12912209.
In the last 8 years, the number of approved disease-modifying therapies (DMTs) for multiple sclerosis (MS), a chronic autoimmune-mediated inflammatory disease of the central nervous system, has more than doubled. In contrast with the requirements of regulatory bodies for randomised controlled trials (RCTs) directly comparing new treatments with placebo and/or one active comparator , a broader evidence base is needed to inform how new medicines should fit into existing treatment algorithms . Mixed treatment comparisons (MTCs) utilise a totality of data by combining both direct and indirect evidence . Consequently, they have become increasingly important to the scientific and clinical community as well as reimbursement agencies by enabling objective comparison of the efficacy and safety of MS therapies that have never been compared head-to-head [4,5,6].
As discussed by Giovannoni et al. , the field of MTC continues to evolve and mature. Interpreting MTC findings is complex, particularly in MS where diagnostic criteria [8,9,10,11], definition of clinical outcomes and patient populations studied have changed over time . These temporal changes in clinical study design make meeting the necessary assumptions of RCT homogeneity, similarity and transitivity in MTC difficult to achieve in MS [13, 14], resulting in variable conclusions depending on how systematic review and MTC are performed. The combination of RCTs conducted in populations with different subtypes of MS, different sets of treatments, or doses licensed under different regulatory authorities, while pragmatic, can provide limited or invalid information when applied to a different clinical context.
However, progress has been made in enhancing understanding of the strengths and limitations of MTC findings through improved transparency of study conduct and reporting. The application of, for example, standards defined by the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA)  and the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guidelines  aim to improve completeness of meta-analyses and MTC reporting, providing important insights to decision-makers on the applicability of MTC findings to their patient populations.
We undertook a comparison of existing MTCs of DMTs in MS to assess their relevance to European decision-makers. Here, we present a detailed discussion of the differences identified between MTCs in the populations studied, treatments assessed, methods employed and implications for interpretation of findings.
As part of a systematic review to inform an up-to-date MTC of DMTs at European Commission-approved doses for the treatment of relapsing–remitting MS (RRMS), already completed MTCs were also identified and extracted for comparison. This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.
Searches were conducted to identify MTCs of pharmaceutical treatments for MS. The following databases and resources were searched from inception to July 2019: Cochrane Database of Systematic Reviews (CDSR); Database of Abstracts of Reviews of Effects (DARE); Health Technology Assessment (HTA) Database; National Institute for Health Research (NIHR) Journals Library; International Prospective Register of Systematic Reviews (PROSPERO); National Institute for Health and Care Excellence (NICE) Guidance; Kleijnen Systematic Reviews (KSR) Evidence; Canadian Agency for Drugs and Technologies in Health (CADTH); MEDLINE; MEDLINE Epub Ahead of Print; MEDLINE In-Process; MEDLINE Daily Update; PubMed; and Embase. Reference lists of included studies and systematic reviews were screened to identify any additional relevant studies. The Cochrane Library search strategy and results of all searches are provided in Appendix 1 of the supplementary material.
Published and unpublished MTCs were included when they reported on adults (at least 18 years of age) with a confirmed diagnosis of RRMS or rapidly evolving severe (RES) RRMS, treated with any form of pharmaceutical treatment. Inclusion was limited to studies published during or after 2010, but no language restriction was imposed.
Methods of Study Selection, Quality Assessment and Data Extraction
Two reviewers independently assessed studies for inclusion and extracted data on the inclusion criteria, systematic review methods, analysis methods and results (relapse, disability progression and safety) for each MTC; any discrepancies were resolved by discussion or by reference to a third reviewer.
We present a narrative synthesis comparing the scope, systematic review methods, analysis methods and findings of MTCs in MS.
Literature searches yielded 1627 references. After removing duplicates (n = 367) and references published before 2010 (n = 261), a total of 999 references were available for screening. Titles and abstracts were screened and 56 potentially relevant papers were ordered as full texts. One MTC was identified checking the reference lists of full-text papers. Of these, 45 references (relating to 27 individual MTCs) were included (Fig. 1).
Comparison of Inclusion Criteria and Methodology
The majority of MTCs included patients with RRMS (Table 1). Two [17, 18] included studies in patients with all subtypes of MS, and four [19,20,21,22] included studies which enrolled patients with relapsing MS, encompassing RRMS, secondary progressive multiple sclerosis with relapses, progressive–relapsing MS or combinations thereof. These six studies did not provide subgroup analyses of patients with RRMS only. Two MTCs [23, 24] focused on RES and highly active RRMS, while two [25, 26] focused on RRMS, with the stipulation that the population in the included trials must be at least 80% patients with RRMS. The CADTH 2013  study also focused on trials in patients with RRMS but specified that the population should be more than 50% RRMS.
Many of the MTCs did not report full details of their methodologies. In 12 of the studies [17, 19, 21, 24, 28,29,30,31,32,33,34,35] omissions were identified in reporting of inclusion screening, data extraction, quality assessment or discrepancy resolution. Table 1 details the inclusion criteria and methods used in the systematic review underlying the MTCs.
Treatments Assessed by Included MTCs
Each MTC included different DMTs, in part due to the timing of new treatments becoming available after previous MTCs had been conducted (Table 2). Studies also focussed on different aspects of DMTs formulation or mechanism of action. For example, Tolley  only included treatments that were delivered by subcutaneous injection, resulting in the exclusion of alemtuzumab, dimethyl fumarate, fingolimod, natalizumab and teriflunomide; while Filippini  focused on immunomodulators and immunosuppressants for all subtypes of MS. The majority of MTCs focussed on monotherapies; however, three [18, 27, 36] also allowed the inclusion of combination treatments.
Further variation arose because of reviews limiting/restricting the inclusion of studies using treatment doses approved/licensed in particular countries/regions (e.g. Tolley  and Hutchinson  limited inclusion to treatment doses that were approved in the European Union or the USA). In CADTH 2013 , inclusion was limited to doses that were licensed in Canada and approved by Health Canada plus a selection of emerging treatments at that time (alemtuzumab, dimethyl fumarate, teriflunomide) that were not limited by dose.
Of the most recent MTCs published, the study by McCool  included daclizumab, which, although approved at the time of the analysis, was subsequently withdrawn by the manufacturer because of concerns about the benefit–risk profile. This MTC also included cladribine 5.25 mg/kg, a dosing regimen which is off-label for the treatment of MS. Removal of these drugs/doses from the networks may potentially lead to different results and conclusions.
Annualised Relapse Rate
Annualised relapse rate (ARR), often included in clinical trials as a surrogate for future disability, was the most widely reported outcome in the MTCs identified and was therefore chosen to compare methods and results related to it. Table 3 presents an overview of methods used in the analyses. A summary of the available results for all treatments compared with placebo is presented in Table 4.
In 19 of the MTCs [19, 20, 23,24,25,26,27,28,29, 31, 33, 35,36,37,38,39,40,41,42,43] relapse was analysed on the basis of the ARR. Appropriate data on MS subtype were more commonly reported in the more recent studies and were often unavailable for older treatments. In patients with high disease activity despite previous treatment, there were insufficient data to form a network, as shown in the study by Huisman .
Differences were observed in the statistical approaches applied in measuring ARR between the MTCs. Fourteen [19, 20, 24,25,26,27, 31, 35, 37,38,39, 41,42,43] analysed ARR as a Poisson outcome based on the total number of relapses and the total number of person-years of follow-up, while six [17, 18, 21, 22, 34, 44] used a different approach by considering recurrence of relapse as a binary outcome based on the number of patients with relapse and the total number of patients. Four MTCs [[17, 18, 21, 22] reported the results as odds ratios (ORs), two [37, 44] as risk ratios, and three [34, 38, 39] as hazard ratios. This approach meant that the results of these MTCs are not directly comparable to each other, or to other MTCs using a rate ratio as the outcome measure.
In ten out of 16 MTCs the analysis was based on using Bayesian methods to fit generalised linear models [18, 19, 25, 27,28,29, 33, 38, 39, 41, 43]. Hutchinson  also used linear models but applied frequentist methods in SAS software to fit the model. Two MTCs [36, 44] used linear models applying frequentist methods using the Stata statistical software. Six other studies used Bayesian methods but did not report further details [17, 20, 23, 24, 31, 40] while Melendez-Torres 2017  used frequentist methods without providing further details. Two studies [21, 22] used the Bucher method for indirect comparison, and three studies [30, 34, 35] did not report the methods for MTC. Zagmutt  assessed adverse events (AEs) rather than relapses so was not included in this comparison. In 14 of 19 MTCs, the primary analysis used a random-effects model. A fixed-effects model was the primary analysis for seven studies [23, 28, 31, 37,38,39, 41] and was also reported for comparison in three [25, 27, 40]. Three studies [33,34,35] did not report their statistical model while Zagmutt 2015  included no MTC of ARR.
Overall, a comparison of all identified MTCs showed that the findings of each individual MTC were not directly comparable with the others because of differences in the DMTs compared, included studies, effect measures and analysis methods (Table 4). Nevertheless, the estimated treatment effects relative to placebo were generally in the same direction for those treatment effects that were reported by multiple studies. This trend was consistent across outcomes and across populations, but the magnitude of the effects and the associated uncertainty varied as a result of the differences between MTCs (e.g. risk ratio of 0.32 for natalizumab in CADTH , compared with 0.46 in Tramacere ). In particular, Filippini  was an outlier, with the ORs for IFNβ1a and teriflunomide favouring placebo, in contrast to other MTCs of the same treatments.
The results available from nine MTCs [19, 21, 22, 24, 26, 29, 30, 36, 40] were limited in applicability to decision-making as they reported the relative effects of one drug compared with other treatments in line with the objectives of the studies, and therefore did not present results for all treatments compared with placebo. Three studies [17, 26, 34] combined all of the IFNβ1a treatments into a single treatment class, while two [18, 44] merged treatments in studies comparing the same agent at different doses but summing the number of events and the sample size.
Twenty-seven MTCs were identified. As detailed above, variation in the clinical question to be answered, as defined by the population, intervention, comparator, outcomes (PICO) framework, accounted for the differences in included populations, treatments assessed and methods of analysis used. Many of these differences have a potential impact on the findings of the review or possibly limit the relevance of a particular review for decision-makers. However, the estimated treatment effects in comparison with placebo were generally in the same direction across MTCs of the same treatments (Table 4). A number of examples of the differences between MTCs, and the potential implications, are discussed below.
Consistent more generally with other neurological diseases, diagnosis of MS poses challenges, which, together with changing clinical criteria, have resulted in an evidence base for treatment which has a high level of heterogeneity in study populations (the ‘Will Rogers phenomenon’) . In addition, outcome measures and definitions have changed over time such that two studies, conducted 20 years apart and both reporting relapse outcomes, may not measure the same clinical state [8, 11]. The increase in treatment options has also influenced the types of patients included in more recent clinical trials. This creates considerable limitations in comparing the effectiveness of new treatments to existing treatment options, where the previous evidence base may largely comprise heterogeneous studies. Therefore, authors of MTCs should carefully examine the inclusion criteria and characteristics of study participants in the identified studies, to ensure the subsequent analyses uphold similarity assumptions. For example, whether the definition of “serious adverse event” included or excluded relapse of MS differed between RCTs. It would be advisable to investigate the effect of this issue in sensitivity analyses, and it may be useful to involve clinical input to ensure that all assumptions are valid, and that all-important disease modifiers, characteristics or biases are investigated.
Five of the identified MTCs included a trial in which 19% of patients had a diagnosis of clinically isolated syndrome . While inclusion of studies with a limited proportion of participants with other subtypes of MS is acceptable, that proportion should be relatively small (e.g. less than 15% ), to reduce the potential impact of including results of patients with higher or lower disease stage which might have a different treatment response compared with the population of interest.
Intervention and Comparators
Traditional meta-analyses compare only a few, often two, treatments while MTCs enable the comparison of all relevant treatments in a certain disease. In many cases, the selection of treatments assessed by an MTC is related to the date of publication; as treatments and trials for MS have evolved over time, we have witnessed a corresponding natural evolution of MTCs from simple networks involving IFN and glatiramer acetate to more complex networks involving newer products such as natalizumab and fingolimod. As many treatments in MS have never been directly compared, MTCs should ideally include all relevant treatments, thus presenting the reader with a comprehensive overview of all available treatment options while increasing the connectivity of the network. If treatments are excluded, the reasons for choosing particular treatments should be transparent and the rationale for exclusion documented. Regular updates are also needed to include newly available treatments and data.
Five of the identified MTCs combined individual DMTs into classes or combined different doses of a single treatment before conducting the MTC. Drugs grouped into the same class may still differ by structure, pharmacokinetics and mode of action and these differences translate into clinical practice in terms of both efficacy and tolerability. Therefore, no two drugs are really the same and grouping them into a similar class requires many, often limiting, assumptions and risks a potential loss of important information about the comparative benefits and harms . It should be noted that the results obtained by this approach would be applicable only to a hypothetical average treatment rather than any of the individual treatment doses. It is likely that this decision will also have an impact on the relative effect of other treatments in the same network. If treatments are combined, e.g. to increase sample size, this should be clearly documented, and the effect explored in sensitivity analyses.
Careful consideration of the outcome definition is required in terms of its description but also with regards to the type of data (discrete or continuous) and whether intention-to-treat or per-protocol analysis was employed, ensuring similarity assumptions. This is especially important if comparing results between different reviews, and clinical opinion is useful for establishing the best outcome to measure effectiveness or safety.
When analysing endpoints, such as AEs, as a binary outcome, studies can only be combined in the analysis if they measure the outcome at the same point in time. Two studies [27, 43] appear to have combined results for the endpoints of confirmed disease progression after 3 and 6 months (CDP3M, CDP6M), respectively (data not shown). Combining endpoints makes it much harder, or even impossible, to compare the outcome with other studies and to interpret the results. It could be assumed that the results would be mainly driven by CDP3M as this is more widely reported. As different disability criteria and lengths of confirmation can cause variation in observed results, the definition of disease progression should be clearly reported .
As shown in Table 3, 13 MTCs analysed ARR as a Poisson outcome based on the total number of relapses and the total number of person-years of follow-up. These values were frequently not reported in the primary studies and therefore would have required imputation. The total number of relapses was typically imputed from the reported ARR values and the exposure time in person-years was typically imputed from the study duration multiplied by the number of patients who completed the trial. Two MTCs [27, 43] assumed that all patients completed the trial if the percentage of completers was not reported. In the trials which did report the percentage of completers, patients who discontinued may have contributed to the total number of relapses, but would be excluded from contributing to the exposure time, therefore increasing the imputed relapse rate. In those trials where the number of completers was not reported and 100% completion was assumed, those patients who discontinued could contribute to the exposure time but could not contribute any further relapses, therefore decreasing the imputed relapse rate. Two studies [26, 31] imputed the exposure time as study duration multiplied by the number of completers, plus half of the study duration multiplied by the number who withdrew. This has a similar impact to the assumptions of the CADTH 2013  study in that the patients who discontinued did not contribute equally to the number of relapses and the exposure time. The other studies reporting ARR did not report the assumptions made to impute missing data. The net effect of these assumptions is difficult to assess as this depends on the number of studies that did or did not report specific values which cannot be determined from the published articles. Therefore, imputation should either be avoided or assumptions should be clearly reported while following standard recommendations [4, 49, 50].
Systematic Review Methods
Studies analysed in MTC should be identified by a systematic literature review in order to minimise the risk of publication bias and other biases [4, 51]. Nine MTCs did not report how many people were involved in the screening for relevant studies which could indicate a risk that relevant studies may have been missed. Twelve MTCs did not report double data extraction of studies, which increases the risk that relevant data were missed or extracted incorrectly .
All methods should be clearly reported, following established guidelines, to enable the reader to assess the risk of bias [15, 16, 52]. Assessment of methodological rigour is hampered when reporting is limited (e.g. five of the identified MTCs were published only as conference abstracts).
When conducting MTCs, authors can choose between a frequentist and a Bayesian framework. In general, both methods are accepted by decision-makers. However, more guidance is available for the Bayesian approach as it can incorporate previous evidence in the prior distributions . While effect estimates of the two methods are comparable, different measures of uncertainties (Bayesian: credible intervals, frequentist: confidence interval) are obtained.
Similar to classical meta-analyses, authors can decide to run a fixed-effects or a random-effects analysis. While both approaches are acceptable , some authors advise using a random-effects analysis to account for potential ‘additional heterogeneity in an indirect comparison compared to a direct comparison’ . However, Bayesian random effects analyses are less applicable when there are only a few studies to compare .
Two reviews [18, 44] assumed ‘that treated and control group participants who contributed to missing outcome data both had an unfavourable outcome’. This assumption is likely to have contributed to differences in the effect estimates compared with the other MTCs (Table 4). Ideally, such assumptions should be explored in sensitivity analyses and discussed in detail, in order to ensure transparency.
This paper aimed to raise awareness of issues related to the conduct and reporting of MTCs in MS to support an accurate interpretation of results by decision-makers so that limitations in the robustness of analyses can be factored into an understanding of the applicability and relevance of findings.
Clear and transparent reporting of methods, results and assumptions made in the analyses should be presented [4, 15, 51, 52, 55]. The choice of outcome measure should be explicit and reflect standard clinical practice. Both the pooling of treatments (assumption of class effect) and the combination of outcomes measured at different points in time should ideally be avoided, or the effect explored in sensitivity analyses. Further, imputation of results without a clear justification should also be discouraged. Basic assumptions of homogeneity, similarity and consistency should be explored when conducting MTCs . MTCs should include all relevant treatment options.
A second paper by Giovannoni et al.  presents the results of a recent MTC of DMTs for RRMS and discusses how to avoid some of the issues identified in this paper.
European Medicines Agency. Guideline on clinical investigation of medicinal products for the treatment of Multiple Sclerosis. EMA/CHMP/771815/2011, Rev. 2. March 2015. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2015/03/WC500185161.pdf. Accessed 3 Feb 2020.
Claflin SB, Broadley S, Taylor BV. The effect of disease modifying therapies on disability progression in multiple sclerosis: a systematic overview of meta-analyses. Front Neurol. 2019;9:1–25.
Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004;23(20):3105–24.
Higgins J, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. Version 5.1.0. (updated March 2011) Cochrane. www.training.cochrane.org/handbook. Accessed 7 Aug 2014.
Laws A, Kendall R, Hawkins N. A comparison of national guidelines for network meta-analysis. Value Health. 2014;17(5):642–54.
Coleman CI, Phung OJ, Cappelleri JC, et al. Use of mixed treatment comparisons in systematic reviews. Rockville: Agency for Healthcare Research and Quality; 2012.
Giovannoni G, Lang S, Wolff R, et al. A systematic review and mixed treatment comparison of pharmaceutical interventions for multiple sclerosis. Neurol Ther. 2020. https://doi.org/10.1007/s40120-020-00212-5.
Poser CM, Paty DW, Scheinberg L, et al. New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol. 1983;13(3):227–31.
McDonald WI, Compston A, Edan G, et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the Diagnosis of Multiple Sclerosis. Ann Neurol. 2001;50(1):121–7.
Polman CH, Reingold SC, Edan G, et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the “McDonald criteria”. Ann Neurol. 2005;58(6):840–6.
Polman CH, Reingold SC, Banwell B, et al. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol. 2011;69(2):292–302.
Zhang Y, Salter A, Wallström E, Cutter G, Stüve O. Evolution of clinical trials in multiple sclerosis. Ther Adv Neurol Disord. 2019;12:1756286419826547.
Tonin FS, Rotta I, Mendes AM, Pontarolo R. Network meta-analysis: a technique to gather evidence from direct and indirect comparisons. Pharm Pract. 2017;15(1):943.
Song F, Loke YK, Walsh T, Glenny A-M, Eastwood AJ, Altman DG. Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ. 2009;338:b1147.
Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84.
Jansen JP, Fleurence R, Devine B, et al. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011;14(4):417–28.
Aggarwal S, Kumar S, Topalogu H. Comparison of network meta-analysis and traditional meta-analysis for prevention of relapses in multiple sclerosis. Value Health. 2015;18(7):A660.
Filippini G, Del Giovane C, Vacchi L, et al. Immunomodulators and immunosuppressants for multiple sclerosis: a network meta-analysis. Cochrane Database Syst Rev. 2013;6:CD008933.
McCool R, Wilson K, Arber M, et al. Systematic review and network meta-analysis comparing ocrelizumab with other treatments for relapsing multiple sclerosis. Mult Scler Relat Disord. 2019;29:55–61.
Hamidi V, Couto E, Ringerike T, Klemp M. A multiple treatment comparison of eleven disease-modifying drugs used for multiple sclerosis. J Clin Med Res. 2018;10(2):88–105.
Hadjigeorgiou GM, Doxani C, Miligkos M, et al. A network meta-analysis of randomized controlled trials for comparing the effectiveness and safety profile of treatments with marketing authorization for relapsing multiple sclerosis. J Clin Pharm Ther. 2013;38(6):433–9.
Zintzaras E, Doxani C, Mprotsis T, Schmid CH, Hadjigeorgiou GM. Network analysis of randomized controlled trials in multiple sclerosis. Clin Ther. 2012;34(4):857–69.
Huisman E, Papadimitropoulou K, Jarrett J, et al. Systematic literature review and network meta-analysis in highly active relapsing-remitting multiple sclerosis and rapidly evolving severe multiple sclerosis. BMJ Open. 2017;7(3):e013430.
Guo J, Das Gupta R, Fahrbach K, Wissinger E, Cox F. A network meta-analysis comparing alemtuzumab to natalizumab in patients with relapsing-remitting multiple sclerosis with rapidly evolving severe disease. Mult Scl. 2016;22(3 Suppl):772.
Tolley K, Hutchinson M, You X, et al. A network meta-analysis of efficacy and evaluation of safety of subcutaneous pegylated interferon beta-1a versus other injectable therapies for the treatment of relapsing-remitting multiple sclerosis. PLoS One. 2015;10(6):e0127960.
Hutchinson M, Fox RJ, Havrdova E, et al. Efficacy and safety of BG-12 (dimethyl fumarate) and other disease-modifying therapies for the treatment of relapsing-remitting multiple sclerosis: a systematic review and mixed treatment comparison. Curr Med Res Opin. 2014;30(4):613–27.
Canadian Agency for Drugs and Technologies in Health. Comparative clinical and cost-effectiveness of drug therapies for relapsing-remitting multiple sclerosis. CADTH. 2013. https://www.ncbi.nlm.nih.gov/books/NBK169748/. Accessed 3 Feb 2020.
Martina R, Jenkins D, Bujkiewicz S, Dequen P, Abrams K, GetReal Workpackage 1. The inclusion of real world evidence in clinical development planning. Trials. 2018;19(1):468.
Salas PAO, Parra CO, Florez CEP, Goez LM, Velez-van-Meerbeke A, Rodriguez JH. Safety liver profile of teriflunomide versus interferon β in multiple sclerosis: systematic review and indirect comparison meta-analysis. Mult Scler Relat Disord. 2018;26:192–200.
Sultanov M, Almadiyeva A, Absattarova K, Semenova Y. Natalizumab versus glatiramer acetate in relapsing-remitting multiple sclerosis: a network meta-analysis. Value Health. 2018;21(Suppl 3):S331.
Fogarty E, Schmitz S, Tubridy N, Walsh C, Barry M. Comparative efficacy of disease-modifying therapies for patients with relapsing remitting multiple sclerosis: systematic review and network meta-analysis. Mult Scler Relat Disord. 2016;9:23–30.
Zagmutt FJ, Carroll CA. Meta-analysis of adverse events in recent randomized clinical trials for dimethyl fumarate, glatiramer acetate and teriflunomide for the treatment of relapsing forms of multiple sclerosis. Int J Neurosci. 2015;125(11):798–807.
Cutter G, Fahrbach K, Huelin R, Wissinger E, Kitio-Dschassi B, Dive-Pouletty C. Relative efficacy of teriflunomide 14 mg in relapsing MS: a mixed-treatment comparison. Mult Scler. 2013;19(10):1413.
Del Santo F, Maratea D, Fadda V, Trippoli S, Messori A. Treatments for relapsing-remitting multiple sclerosis: summarising current information by network meta-analysis. Eur J Clin Pharmacol. 2012;68(4):441–8.
Tyas D, Roskell N, Zimovetz E, Rycroft C, Eckert B. Annualized relapse rate of first-line treatments for multiple sclerosis: a meta-analysis, including indirect comparisons versus fingolimod. Neurology. 2012;78(1 Suppl).
Xu X, Chi S, Wang Q, et al. Efficacy and safety of monoclonal antibody therapies for relapsing remitting multiple sclerosis: a network meta-analysis. Mult Scler Relat Disord. 2018;25:322–8.
Li H, Hu F, Zhang Y, Li K. Comparative efficacy and acceptability of disease-modifying therapies in patients with relapsing-remitting multiple sclerosis: a systematic review and network meta-analysis. J Neurol. 2019. https://doi.org/10.1007/s00415-019-09395-w.
Lucchetta RC, Tonin FS, Borba HHL, et al. Disease-modifying therapies for relapsing-remitting multiple sclerosis: a network meta-analysis. CNS Drugs. 2018;32(9):813–26.
Lucchetta RC, Tonin FS, Borba HHL, et al. Immunomodulators and immunosuppressants for patients with relapsing-remitting multiple sclerosis: a network meta-analysis. Value Health. 2018;21(Suppl 1):S203–4.
Siddiqui MK, Khurana IS, Budhia S, Hettle R, Harty G, Wong SL. Systematic literature review and network meta-analysis of cladribine tablets versus alternative disease-modifying treatments for relapsing-remitting multiple sclerosis. Curr Med Res Opin. 2018;34(8):1361–71.
Institute for Clinical Economic Review. Disease-modifying therapies for relapsing remitting and primary-progressive multiple sclerosis: effectiveness and value final evidence report. ICER. 2017. https://icer-review.org/wp-content/uploads/2016/08/CTAF_MS_Final_Report_030617.pdf. Accessed 3 Feb 2020.
Melendez-Torres GJ, Auguste P, Armoiry X, et al. Clinical effectiveness and cost-effectiveness of beta-interferon and glatiramer acetate for treating multiple sclerosis: systematic review and economic evaluation. Health Technol Assess. 2017;21(52):1–352.
Couto E, Hamidi V, Ringerike T, Odgaard-Jensen J, Harboe I, Klemp M. Medicines used for multiple sclerosis—a health technology assessment. Oslo: Knowledge Centre for the Health Services at The Norwegian Institute of Public Health (NIPH); 2016.
Tramacere I, Del Giovane C, Salanti G, D’Amico R, Filippini G. Immunomodulators and immunosuppressants for relapsing-remitting multiple sclerosis: a network meta-analysis. Cochrane Database Syst Rev. 2015;9:CD011381.
Sormani MP. The Will Rogers phenomenon: the effect of different diagnostic criteria. J Neurol Sci. 2009;287(1 Suppl):S46–9.
O’Connor P, Filippi M, Arnason B, et al. 250 microg or 500 microg interferon beta-1b versus 20 mg glatiramer acetate in relapsing-remitting multiple sclerosis: a prospective, randomised, multicentre study. Lancet Neurol. 2009;8(10):889–97.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). General methods: version 5.0. IQWiG. 2016. https://www.iqwig.de/en/methods/methods-paper.3020.html. Accessed 3 Feb 2020.
Kalincik T, Cutter G, Spelman T, et al. Defining reliable disability outcomes in multiple sclerosis. Brain. 2015;138(Pt 11):3287–98.
Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16.
Suthar A, Lawn S, del Amo J, et al. Antiretroviral therapy for prevention of tuberculosis in adults with HIV: a systematic review and meta-analysis. PLoS Med. 2012;9(7):e1001270.
Centre for Reviews and Dissemination B. Systematic reviews. CRDs guidance for undertaking reviews in health care. CRD. 2009. https://www.york.ac.uk/media/crd/Systematic_Reviews.pdf. Accessed 3 Feb 2020.
Hoaglin DC, Hawkins N, Jansen JP, et al. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011;14(4):429–37.
Haute Authorite de Sante. Indirect comparisons: methods and validity. HAS. 2009. https://www.has-sante.fr/portail/upload/docs/application/pdf/2011-02/summary_report__indirect_comparisons_methods_and_validity_january_2011_2.pdf. Accessed 3 Feb 2020.
Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Stat Soc Ser A (Stat Soc). 2009;172(1):137–59.
Jansen JP, Trikalinos T, Cappelleri JC, et al. Indirect treatment comparison/network meta-analysis study questionnaire to assess relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report. Value Health. 2014;17(2):157–73.
Richard Birnie produced tables and figures, screened search results, selected full-text studies for inclusion and performed data extraction.
Work on this systematic review was sponsored by Biogen. Biogen was given the opportunity to comment on the draft paper, but the authors had full editorial freedom. Biogen funded the journal’s Rapid Service Fee.
Medical Writing and Editorial Assistance
Editorial assistance in the preparation of this article was provided by Zoe Whittington and James Davies of OPEN VIE (Marlow, UK). Funding for this assistance was provided by Biogen.
All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published.
Maria Pia Sormani, Robert Wolff, Shona Lang, Steven Duffy, Robert Hyde, Elizabeth Kinter, Craig Wakeford, Gavin Giovannoni and Jos Kleijnen have nothing to disclose.
Compliance with Ethics Guidelines
This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.
All data generated or analyzed during this study are included in this published article/as supplementary information files.
To view digital features for this article go to https://doi.org/10.6084/m9.figshare.12912209.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Pia Sormani, M., Wolff, R., Lang, S. et al. Overview of Differences and Similarities of Published Mixed Treatment Comparisons on Pharmaceutical Interventions for Multiple Sclerosis. Neurol Ther 9, 335–358 (2020). https://doi.org/10.1007/s40120-020-00213-4
- Disease-modifying therapies
- Healthcare decision-making
- Mixed treatment comparison
- Multiple sclerosis
- Relapsing–remitting multiple sclerosis