Skip to main content

Overview of Differences and Similarities of Published Mixed Treatment Comparisons on Pharmaceutical Interventions for Multiple Sclerosis



Mixed treatment comparisons (MTCs) are increasingly important in the assessment of the benefit–risk profile of pharmaceutical treatments for relapsing–remitting multiple sclerosis (RRMS). Interpretation of MTCs requires a clear understanding of the methods of analysis and population studied. The objectives of this work were to compare MTCs of pharmaceutical treatments for RRMS, including a detailed description of differences in populations, treatments assessed, methods used and findings; and to discuss key considerations when conducting an MTC.


Fourteen databases were searched until July 2019 to identify MTCs (published during or after 2010) in adults (at least 18 years of age) with RRMS or rapidly evolving severe RRMS treated with any form of pharmaceutical treatment. No language restriction was imposed.


Twenty-seven MTCs assessing 21 treatments were identified. Comparison highlighted many differences in conduct and reporting between MTCs relating to the patient populations or treatments included, duration of follow-up and outcomes of interest measured. The lack of similarity between the MTCs leads to questions about variability in the robustness of analyses and makes comparisons between studies challenging.


Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings. For MTCs to be relevant, the choice of outcome measures should reflect clinical practice. Combination of treatments or of outcomes measured at different points of time should be avoided, as should imputation without justification. Furthermore, all approved treatment options should be included and updates of MTCs should be conducted when data for new treatments are published.

FormalPara Key Summary Points
Interpretation of mixed treatment comparisons (MTCs) requires a clear understanding of the methods of analysis and population studied.
MTCs of pharmaceutical treatments for relapsing–remitting multiple sclerosis were detailed and compared.
A comparison of all identified MTCs showed that the findings of each individual MTC were not directly comparable with the others because of differences in the disease-modifying therapies (DMTs) compared, included studies, effect measures and analysis methods.
Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings.
For MTCs to be relevant, the choice of outcome measures should reflect clinical practice, combination of treatments or outcomes measured at different points of time should be avoided, as should imputation without justification, all approved treatment options should be included, and updates of MTCs should be conducted when data for new treatments are published.

Digital Features

This article is published with digital features to facilitate understanding of the article. To view digital features for this article go to


In the last 8 years, the number of approved disease-modifying therapies (DMTs) for multiple sclerosis (MS), a chronic autoimmune-mediated inflammatory disease of the central nervous system, has more than doubled. In contrast with the requirements of regulatory bodies for randomised controlled trials (RCTs) directly comparing new treatments with placebo and/or one active comparator [1], a broader evidence base is needed to inform how new medicines should fit into existing treatment algorithms [2]. Mixed treatment comparisons (MTCs) utilise a totality of data by combining both direct and indirect evidence [3]. Consequently, they have become increasingly important to the scientific and clinical community as well as reimbursement agencies by enabling objective comparison of the efficacy and safety of MS therapies that have never been compared head-to-head [4,5,6].

As discussed by Giovannoni et al. [7], the field of MTC continues to evolve and mature. Interpreting MTC findings is complex, particularly in MS where diagnostic criteria [8,9,10,11], definition of clinical outcomes and patient populations studied have changed over time [12]. These temporal changes in clinical study design make meeting the necessary assumptions of RCT homogeneity, similarity and transitivity in MTC difficult to achieve in MS [13, 14], resulting in variable conclusions depending on how systematic review and MTC are performed. The combination of RCTs conducted in populations with different subtypes of MS, different sets of treatments, or doses licensed under different regulatory authorities, while pragmatic, can provide limited or invalid information when applied to a different clinical context.

However, progress has been made in enhancing understanding of the strengths and limitations of MTC findings through improved transparency of study conduct and reporting. The application of, for example, standards defined by the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) [15] and the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guidelines [16] aim to improve completeness of meta-analyses and MTC reporting, providing important insights to decision-makers on the applicability of MTC findings to their patient populations.

We undertook a comparison of existing MTCs of DMTs in MS to assess their relevance to European decision-makers. Here, we present a detailed discussion of the differences identified between MTCs in the populations studied, treatments assessed, methods employed and implications for interpretation of findings.


As part of a systematic review to inform an up-to-date MTC of DMTs at European Commission-approved doses for the treatment of relapsing–remitting MS (RRMS), already completed MTCs were also identified and extracted for comparison. This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.

Search Methods

Searches were conducted to identify MTCs of pharmaceutical treatments for MS. The following databases and resources were searched from inception to July 2019: Cochrane Database of Systematic Reviews (CDSR); Database of Abstracts of Reviews of Effects (DARE); Health Technology Assessment (HTA) Database; National Institute for Health Research (NIHR) Journals Library; International Prospective Register of Systematic Reviews (PROSPERO); National Institute for Health and Care Excellence (NICE) Guidance; Kleijnen Systematic Reviews (KSR) Evidence; Canadian Agency for Drugs and Technologies in Health (CADTH); MEDLINE; MEDLINE Epub Ahead of Print; MEDLINE In-Process; MEDLINE Daily Update; PubMed; and Embase. Reference lists of included studies and systematic reviews were screened to identify any additional relevant studies. The Cochrane Library search strategy and results of all searches are provided in Appendix 1 of the supplementary material.

Inclusion Criteria

Published and unpublished MTCs were included when they reported on adults (at least 18 years of age) with a confirmed diagnosis of RRMS or rapidly evolving severe (RES) RRMS, treated with any form of pharmaceutical treatment. Inclusion was limited to studies published during or after 2010, but no language restriction was imposed.

Methods of Study Selection, Quality Assessment and Data Extraction

Two reviewers independently assessed studies for inclusion and extracted data on the inclusion criteria, systematic review methods, analysis methods and results (relapse, disability progression and safety) for each MTC; any discrepancies were resolved by discussion or by reference to a third reviewer.

We present a narrative synthesis comparing the scope, systematic review methods, analysis methods and findings of MTCs in MS.


Literature searches yielded 1627 references. After removing duplicates (n = 367) and references published before 2010 (n = 261), a total of 999 references were available for screening. Titles and abstracts were screened and 56 potentially relevant papers were ordered as full texts. One MTC was identified checking the reference lists of full-text papers. Of these, 45 references (relating to 27 individual MTCs) were included (Fig. 1).

Fig. 1

Flow chart of study searches and inclusion. MTC mixed treatment comparison

Comparison of Inclusion Criteria and Methodology

The majority of MTCs included patients with RRMS (Table 1). Two [17, 18] included studies in patients with all subtypes of MS, and four [19,20,21,22] included studies which enrolled patients with relapsing MS, encompassing RRMS, secondary progressive multiple sclerosis with relapses, progressive–relapsing MS or combinations thereof. These six studies did not provide subgroup analyses of patients with RRMS only. Two MTCs [23, 24] focused on RES and highly active RRMS, while two [25, 26] focused on RRMS, with the stipulation that the population in the included trials must be at least 80% patients with RRMS. The CADTH 2013 [27] study also focused on trials in patients with RRMS but specified that the population should be more than 50% RRMS.

Table 1 Inclusion criteria for and systematic review methods of included MTCs

Many of the MTCs did not report full details of their methodologies. In 12 of the studies [17, 19, 21, 24, 28,29,30,31,32,33,34,35] omissions were identified in reporting of inclusion screening, data extraction, quality assessment or discrepancy resolution. Table 1 details the inclusion criteria and methods used in the systematic review underlying the MTCs.

Treatments Assessed by Included MTCs

Each MTC included different DMTs, in part due to the timing of new treatments becoming available after previous MTCs had been conducted (Table 2). Studies also focussed on different aspects of DMTs formulation or mechanism of action. For example, Tolley [25] only included treatments that were delivered by subcutaneous injection, resulting in the exclusion of alemtuzumab, dimethyl fumarate, fingolimod, natalizumab and teriflunomide; while Filippini [18] focused on immunomodulators and immunosuppressants for all subtypes of MS. The majority of MTCs focussed on monotherapies; however, three [18, 27, 36] also allowed the inclusion of combination treatments.

Further variation arose because of reviews limiting/restricting the inclusion of studies using treatment doses approved/licensed in particular countries/regions (e.g. Tolley  [25] and Hutchinson [26] limited inclusion to treatment doses that were approved in the European Union or the USA). In CADTH 2013 [27], inclusion was limited to doses that were licensed in Canada and approved by Health Canada plus a selection of emerging treatments at that time (alemtuzumab, dimethyl fumarate, teriflunomide) that were not limited by dose.

Of the most recent MTCs published, the study by McCool [19] included daclizumab, which, although approved at the time of the analysis, was subsequently withdrawn by the manufacturer because of concerns about the benefit–risk profile. This MTC also included cladribine 5.25 mg/kg, a dosing regimen which is off-label for the treatment of MS. Removal of these drugs/doses from the networks may potentially lead to different results and conclusions.

Table 2 Treatments assessed by included MTCs

Annualised Relapse Rate

Annualised relapse rate (ARR), often included in clinical trials as a surrogate for future disability, was the most widely reported outcome in the MTCs identified and was therefore chosen to compare methods and results related to it. Table 3 presents an overview of methods used in the analyses. A summary of the available results for all treatments compared with placebo is presented in Table 4.

Table 3 MS relapse: analysis methods
Table 4 MS relapse—results

In 19 of the MTCs [19, 20, 23,24,25,26,27,28,29, 31, 33, 35,36,37,38,39,40,41,42,43] relapse was analysed on the basis of the ARR. Appropriate data on MS subtype were more commonly reported in the more recent studies and were often unavailable for older treatments. In patients with high disease activity despite previous treatment, there were insufficient data to form a network, as shown in the study by Huisman [23].

Differences were observed in the statistical approaches applied in measuring ARR between the MTCs. Fourteen [19, 20, 24,25,26,27, 31, 35, 37,38,39, 41,42,43] analysed ARR as a Poisson outcome based on the total number of relapses and the total number of person-years of follow-up, while six [17, 18, 21, 22, 34, 44] used a different approach by considering recurrence of relapse as a binary outcome based on the number of patients with relapse and the total number of patients. Four MTCs [[17, 18, 21, 22] reported the results as odds ratios (ORs), two [37, 44] as risk ratios, and three [34, 38, 39] as hazard ratios. This approach meant that the results of these MTCs are not directly comparable to each other, or to other MTCs using a rate ratio as the outcome measure.

In ten out of 16 MTCs the analysis was based on using Bayesian methods to fit generalised linear models [18, 19, 25, 27,28,29, 33, 38, 39, 41, 43]. Hutchinson [26] also used linear models but applied frequentist methods in SAS software to fit the model. Two MTCs [36, 44] used linear models applying frequentist methods using the Stata statistical software. Six other studies used Bayesian methods but did not report further details [17, 20, 23, 24, 31, 40] while Melendez-Torres 2017 [42] used frequentist methods without providing further details. Two studies [21, 22] used the Bucher method for indirect comparison, and three studies [30, 34, 35] did not report the methods for MTC. Zagmutt [32] assessed adverse events (AEs) rather than relapses so was not included in this comparison. In 14 of 19 MTCs, the primary analysis used a random-effects model. A fixed-effects model was the primary analysis for seven studies [23, 28, 31, 37,38,39, 41] and was also reported for comparison in three [25, 27, 40]. Three studies [33,34,35] did not report their statistical model while Zagmutt 2015 [32] included no MTC of ARR.


Overall, a comparison of all identified MTCs showed that the findings of each individual MTC were not directly comparable with the others because of differences in the DMTs compared, included studies, effect measures and analysis methods (Table 4). Nevertheless, the estimated treatment effects relative to placebo were generally in the same direction for those treatment effects that were reported by multiple studies. This trend was consistent across outcomes and across populations, but the magnitude of the effects and the associated uncertainty varied as a result of the differences between MTCs (e.g. risk ratio of 0.32 for natalizumab in CADTH [27], compared with 0.46 in Tramacere [44]). In particular, Filippini [18] was an outlier, with the ORs for IFNβ1a and teriflunomide favouring placebo, in contrast to other MTCs of the same treatments.

The results available from nine MTCs [19, 21, 22, 24, 26, 29, 30, 36, 40] were limited in applicability to decision-making as they reported the relative effects of one drug compared with other treatments in line with the objectives of the studies, and therefore did not present results for all treatments compared with placebo. Three studies [17, 26, 34] combined all of the IFNβ1a treatments into a single treatment class, while two [18, 44] merged treatments in studies comparing the same agent at different doses but summing the number of events and the sample size.


Twenty-seven MTCs were identified. As detailed above, variation in the clinical question to be answered, as defined by the population, intervention, comparator, outcomes (PICO) framework, accounted for the differences in included populations, treatments assessed and methods of analysis used. Many of these differences have a potential impact on the findings of the review or possibly limit the relevance of a particular review for decision-makers. However, the estimated treatment effects in comparison with placebo were generally in the same direction across MTCs of the same treatments (Table 4). A number of examples of the differences between MTCs, and the potential implications, are discussed below.


Consistent more generally with other neurological diseases, diagnosis of MS poses challenges, which, together with changing clinical criteria, have resulted in an evidence base for treatment which has a high level of heterogeneity in study populations (the ‘Will Rogers phenomenon’) [45]. In addition, outcome measures and definitions have changed over time such that two studies, conducted 20 years apart and both reporting relapse outcomes, may not measure the same clinical state [8, 11]. The increase in treatment options has also influenced the types of patients included in more recent clinical trials. This creates considerable limitations in comparing the effectiveness of new treatments to existing treatment options, where the previous evidence base may largely comprise heterogeneous studies. Therefore, authors of MTCs should carefully examine the inclusion criteria and characteristics of study participants in the identified studies, to ensure the subsequent analyses uphold similarity assumptions. For example, whether the definition of “serious adverse event” included or excluded relapse of MS differed between RCTs. It would be advisable to investigate the effect of this issue in sensitivity analyses, and it may be useful to involve clinical input to ensure that all assumptions are valid, and that all-important disease modifiers, characteristics or biases are investigated.

Five of the identified MTCs included a trial in which 19% of patients had a diagnosis of clinically isolated syndrome [46]. While inclusion of studies with a limited proportion of participants with other subtypes of MS is acceptable, that proportion should be relatively small (e.g. less than 15% [47]), to reduce the potential impact of including results of patients with higher or lower disease stage which might have a different treatment response compared with the population of interest.

Intervention and Comparators

Traditional meta-analyses compare only a few, often two, treatments while MTCs enable the comparison of all relevant treatments in a certain disease. In many cases, the selection of treatments assessed by an MTC is related to the date of publication; as treatments and trials for MS have evolved over time, we have witnessed a corresponding natural evolution of MTCs from simple networks involving IFN and glatiramer acetate to more complex networks involving newer products such as natalizumab and fingolimod. As many treatments in MS have never been directly compared, MTCs should ideally include all relevant treatments, thus presenting the reader with a comprehensive overview of all available treatment options while increasing the connectivity of the network. If treatments are excluded, the reasons for choosing particular treatments should be transparent and the rationale for exclusion documented. Regular updates are also needed to include newly available treatments and data.

Five of the identified MTCs combined individual DMTs into classes or combined different doses of a single treatment before conducting the MTC. Drugs grouped into the same class may still differ by structure, pharmacokinetics and mode of action and these differences translate into clinical practice in terms of both efficacy and tolerability. Therefore, no two drugs are really the same and grouping them into a similar class requires many, often limiting, assumptions and risks a potential loss of important information about the comparative benefits and harms [7]. It should be noted that the results obtained by this approach would be applicable only to a hypothetical average treatment rather than any of the individual treatment doses. It is likely that this decision will also have an impact on the relative effect of other treatments in the same network. If treatments are combined, e.g. to increase sample size, this should be clearly documented, and the effect explored in sensitivity analyses.


Careful consideration of the outcome definition is required in terms of its description but also with regards to the type of data (discrete or continuous) and whether intention-to-treat or per-protocol analysis was employed, ensuring similarity assumptions. This is especially important if comparing results between different reviews, and clinical opinion is useful for establishing the best outcome to measure effectiveness or safety.

When analysing endpoints, such as AEs, as a binary outcome, studies can only be combined in the analysis if they measure the outcome at the same point in time. Two studies [27, 43] appear to have combined results for the endpoints of confirmed disease progression after 3 and 6 months (CDP3M, CDP6M), respectively (data not shown). Combining endpoints makes it much harder, or even impossible, to compare the outcome with other studies and to interpret the results. It could be assumed that the results would be mainly driven by CDP3M as this is more widely reported. As different disability criteria and lengths of confirmation can cause variation in observed results, the definition of disease progression should be clearly reported [48].

As shown in Table 3, 13 MTCs analysed ARR as a Poisson outcome based on the total number of relapses and the total number of person-years of follow-up. These values were frequently not reported in the primary studies and therefore would have required imputation. The total number of relapses was typically imputed from the reported ARR values and the exposure time in person-years was typically imputed from the study duration multiplied by the number of patients who completed the trial. Two MTCs [27, 43] assumed that all patients completed the trial if the percentage of completers was not reported. In the trials which did report the percentage of completers, patients who discontinued may have contributed to the total number of relapses, but would be excluded from contributing to the exposure time, therefore increasing the imputed relapse rate. In those trials where the number of completers was not reported and 100% completion was assumed, those patients who discontinued could contribute to the exposure time but could not contribute any further relapses, therefore decreasing the imputed relapse rate. Two studies [26, 31] imputed the exposure time as study duration multiplied by the number of completers, plus half of the study duration multiplied by the number who withdrew. This has a similar impact to the assumptions of the CADTH 2013 [27] study in that the patients who discontinued did not contribute equally to the number of relapses and the exposure time. The other studies reporting ARR did not report the assumptions made to impute missing data. The net effect of these assumptions is difficult to assess as this depends on the number of studies that did or did not report specific values which cannot be determined from the published articles. Therefore, imputation should either be avoided or assumptions should be clearly reported while following standard recommendations [4, 49, 50].

Systematic Review Methods

Studies analysed in MTC should be identified by a systematic literature review in order to minimise the risk of publication bias and other biases [4, 51]. Nine MTCs did not report how many people were involved in the screening for relevant studies which could indicate a risk that relevant studies may have been missed. Twelve MTCs did not report double data extraction of studies, which increases the risk that relevant data were missed or extracted incorrectly [4].

All methods should be clearly reported, following established guidelines, to enable the reader to assess the risk of bias [15, 16, 52]. Assessment of methodological rigour is hampered when reporting is limited (e.g. five of the identified MTCs were published only as conference abstracts).

Analysis Methods

When conducting MTCs, authors can choose between a frequentist and a Bayesian framework. In general, both methods are accepted by decision-makers. However, more guidance is available for the Bayesian approach as it can incorporate previous evidence in the prior distributions [6]. While effect estimates of the two methods are comparable, different measures of uncertainties (Bayesian: credible intervals, frequentist: confidence interval) are obtained.

Similar to classical meta-analyses, authors can decide to run a fixed-effects or a random-effects analysis. While both approaches are acceptable [6], some authors advise using a random-effects analysis to account for potential ‘additional heterogeneity in an indirect comparison compared to a direct comparison’ [53]. However, Bayesian random effects analyses are less applicable when there are only a few studies to compare [54].

Two reviews [18, 44] assumed ‘that treated and control group participants who contributed to missing outcome data both had an unfavourable outcome’. This assumption is likely to have contributed to differences in the effect estimates compared with the other MTCs (Table 4). Ideally, such assumptions should be explored in sensitivity analyses and discussed in detail, in order to ensure transparency.


This paper aimed to raise awareness of issues related to the conduct and reporting of MTCs in MS to support an accurate interpretation of results by decision-makers so that limitations in the robustness of analyses can be factored into an understanding of the applicability and relevance of findings.

Clear and transparent reporting of methods, results and assumptions made in the analyses should be presented [4, 15, 51, 52, 55]. The choice of outcome measure should be explicit and reflect standard clinical practice. Both the pooling of treatments (assumption of class effect) and the combination of outcomes measured at different points in time should ideally be avoided, or the effect explored in sensitivity analyses. Further, imputation of results without a clear justification should also be discouraged. Basic assumptions of homogeneity, similarity and consistency should be explored when conducting MTCs [14]. MTCs should include all relevant treatment options.

A second paper by Giovannoni et al. [7] presents the results of a recent MTC of DMTs for RRMS and discusses how to avoid some of the issues identified in this paper.


  1. 1.

    European Medicines Agency. Guideline on clinical investigation of medicinal products for the treatment of Multiple Sclerosis. EMA/CHMP/771815/2011, Rev. 2. March 2015. Accessed 3 Feb 2020.

  2. 2.

    Claflin SB, Broadley S, Taylor BV. The effect of disease modifying therapies on disability progression in multiple sclerosis: a systematic overview of meta-analyses. Front Neurol. 2019;9:1–25.

    Google Scholar 

  3. 3.

    Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004;23(20):3105–24.

    CAS  Google Scholar 

  4. 4.

    Higgins J, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. Version 5.1.0. (updated March 2011) Cochrane. Accessed 7 Aug 2014.

  5. 5.

    Laws A, Kendall R, Hawkins N. A comparison of national guidelines for network meta-analysis. Value Health. 2014;17(5):642–54.

    Google Scholar 

  6. 6.

    Coleman CI, Phung OJ, Cappelleri JC, et al. Use of mixed treatment comparisons in systematic reviews. Rockville: Agency for Healthcare Research and Quality; 2012.

    Google Scholar 

  7. 7.

    Giovannoni G, Lang S, Wolff R, et al. A systematic review and mixed treatment comparison of pharmaceutical interventions for multiple sclerosis. Neurol Ther. 2020.

    Article  Google Scholar 

  8. 8.

    Poser CM, Paty DW, Scheinberg L, et al. New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol. 1983;13(3):227–31.

    CAS  Google Scholar 

  9. 9.

    McDonald WI, Compston A, Edan G, et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the Diagnosis of Multiple Sclerosis. Ann Neurol. 2001;50(1):121–7.

    CAS  Google Scholar 

  10. 10.

    Polman CH, Reingold SC, Edan G, et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the “McDonald criteria”. Ann Neurol. 2005;58(6):840–6.

    Google Scholar 

  11. 11.

    Polman CH, Reingold SC, Banwell B, et al. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol. 2011;69(2):292–302.

    Google Scholar 

  12. 12.

    Zhang Y, Salter A, Wallström E, Cutter G, Stüve O. Evolution of clinical trials in multiple sclerosis. Ther Adv Neurol Disord. 2019;12:1756286419826547.

    Google Scholar 

  13. 13.

    Tonin FS, Rotta I, Mendes AM, Pontarolo R. Network meta-analysis: a technique to gather evidence from direct and indirect comparisons. Pharm Pract. 2017;15(1):943.

    Google Scholar 

  14. 14.

    Song F, Loke YK, Walsh T, Glenny A-M, Eastwood AJ, Altman DG. Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ. 2009;338:b1147.

    Google Scholar 

  15. 15.

    Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84.

    Google Scholar 

  16. 16.

    Jansen JP, Fleurence R, Devine B, et al. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011;14(4):417–28.

    Google Scholar 

  17. 17.

    Aggarwal S, Kumar S, Topalogu H. Comparison of network meta-analysis and traditional meta-analysis for prevention of relapses in multiple sclerosis. Value Health. 2015;18(7):A660.

    Google Scholar 

  18. 18.

    Filippini G, Del Giovane C, Vacchi L, et al. Immunomodulators and immunosuppressants for multiple sclerosis: a network meta-analysis. Cochrane Database Syst Rev. 2013;6:CD008933.

    Google Scholar 

  19. 19.

    McCool R, Wilson K, Arber M, et al. Systematic review and network meta-analysis comparing ocrelizumab with other treatments for relapsing multiple sclerosis. Mult Scler Relat Disord. 2019;29:55–61.

    Google Scholar 

  20. 20.

    Hamidi V, Couto E, Ringerike T, Klemp M. A multiple treatment comparison of eleven disease-modifying drugs used for multiple sclerosis. J Clin Med Res. 2018;10(2):88–105.

    Google Scholar 

  21. 21.

    Hadjigeorgiou GM, Doxani C, Miligkos M, et al. A network meta-analysis of randomized controlled trials for comparing the effectiveness and safety profile of treatments with marketing authorization for relapsing multiple sclerosis. J Clin Pharm Ther. 2013;38(6):433–9.

    CAS  Google Scholar 

  22. 22.

    Zintzaras E, Doxani C, Mprotsis T, Schmid CH, Hadjigeorgiou GM. Network analysis of randomized controlled trials in multiple sclerosis. Clin Ther. 2012;34(4):857–69.

    CAS  Google Scholar 

  23. 23.

    Huisman E, Papadimitropoulou K, Jarrett J, et al. Systematic literature review and network meta-analysis in highly active relapsing-remitting multiple sclerosis and rapidly evolving severe multiple sclerosis. BMJ Open. 2017;7(3):e013430.

    Google Scholar 

  24. 24.

    Guo J, Das Gupta R, Fahrbach K, Wissinger E, Cox F. A network meta-analysis comparing alemtuzumab to natalizumab in patients with relapsing-remitting multiple sclerosis with rapidly evolving severe disease. Mult Scl. 2016;22(3 Suppl):772.

    Google Scholar 

  25. 25.

    Tolley K, Hutchinson M, You X, et al. A network meta-analysis of efficacy and evaluation of safety of subcutaneous pegylated interferon beta-1a versus other injectable therapies for the treatment of relapsing-remitting multiple sclerosis. PLoS One. 2015;10(6):e0127960.

    Google Scholar 

  26. 26.

    Hutchinson M, Fox RJ, Havrdova E, et al. Efficacy and safety of BG-12 (dimethyl fumarate) and other disease-modifying therapies for the treatment of relapsing-remitting multiple sclerosis: a systematic review and mixed treatment comparison. Curr Med Res Opin. 2014;30(4):613–27.

    CAS  Google Scholar 

  27. 27.

    Canadian Agency for Drugs and Technologies in Health. Comparative clinical and cost-effectiveness of drug therapies for relapsing-remitting multiple sclerosis. CADTH. 2013. Accessed 3 Feb 2020.

  28. 28.

    Martina R, Jenkins D, Bujkiewicz S, Dequen P, Abrams K, GetReal Workpackage 1. The inclusion of real world evidence in clinical development planning. Trials. 2018;19(1):468.

    Google Scholar 

  29. 29.

    Salas PAO, Parra CO, Florez CEP, Goez LM, Velez-van-Meerbeke A, Rodriguez JH. Safety liver profile of teriflunomide versus interferon β in multiple sclerosis: systematic review and indirect comparison meta-analysis. Mult Scler Relat Disord. 2018;26:192–200.

    Google Scholar 

  30. 30.

    Sultanov M, Almadiyeva A, Absattarova K, Semenova Y. Natalizumab versus glatiramer acetate in relapsing-remitting multiple sclerosis: a network meta-analysis. Value Health. 2018;21(Suppl 3):S331.

    Google Scholar 

  31. 31.

    Fogarty E, Schmitz S, Tubridy N, Walsh C, Barry M. Comparative efficacy of disease-modifying therapies for patients with relapsing remitting multiple sclerosis: systematic review and network meta-analysis. Mult Scler Relat Disord. 2016;9:23–30.

    Google Scholar 

  32. 32.

    Zagmutt FJ, Carroll CA. Meta-analysis of adverse events in recent randomized clinical trials for dimethyl fumarate, glatiramer acetate and teriflunomide for the treatment of relapsing forms of multiple sclerosis. Int J Neurosci. 2015;125(11):798–807.

    CAS  Google Scholar 

  33. 33.

    Cutter G, Fahrbach K, Huelin R, Wissinger E, Kitio-Dschassi B, Dive-Pouletty C. Relative efficacy of teriflunomide 14 mg in relapsing MS: a mixed-treatment comparison. Mult Scler. 2013;19(10):1413.

    Google Scholar 

  34. 34.

    Del Santo F, Maratea D, Fadda V, Trippoli S, Messori A. Treatments for relapsing-remitting multiple sclerosis: summarising current information by network meta-analysis. Eur J Clin Pharmacol. 2012;68(4):441–8.

    Google Scholar 

  35. 35.

    Tyas D, Roskell N, Zimovetz E, Rycroft C, Eckert B. Annualized relapse rate of first-line treatments for multiple sclerosis: a meta-analysis, including indirect comparisons versus fingolimod. Neurology. 2012;78(1 Suppl).

  36. 36.

    Xu X, Chi S, Wang Q, et al. Efficacy and safety of monoclonal antibody therapies for relapsing remitting multiple sclerosis: a network meta-analysis. Mult Scler Relat Disord. 2018;25:322–8.

    Google Scholar 

  37. 37.

    Li H, Hu F, Zhang Y, Li K. Comparative efficacy and acceptability of disease-modifying therapies in patients with relapsing-remitting multiple sclerosis: a systematic review and network meta-analysis. J Neurol. 2019.

    Article  Google Scholar 

  38. 38.

    Lucchetta RC, Tonin FS, Borba HHL, et al. Disease-modifying therapies for relapsing-remitting multiple sclerosis: a network meta-analysis. CNS Drugs. 2018;32(9):813–26.

    Google Scholar 

  39. 39.

    Lucchetta RC, Tonin FS, Borba HHL, et al. Immunomodulators and immunosuppressants for patients with relapsing-remitting multiple sclerosis: a network meta-analysis. Value Health. 2018;21(Suppl 1):S203–4.

    Google Scholar 

  40. 40.

    Siddiqui MK, Khurana IS, Budhia S, Hettle R, Harty G, Wong SL. Systematic literature review and network meta-analysis of cladribine tablets versus alternative disease-modifying treatments for relapsing-remitting multiple sclerosis. Curr Med Res Opin. 2018;34(8):1361–71.

    CAS  Google Scholar 

  41. 41.

    Institute for Clinical Economic Review. Disease-modifying therapies for relapsing remitting and primary-progressive multiple sclerosis: effectiveness and value final evidence report. ICER. 2017. Accessed 3 Feb 2020.

  42. 42.

    Melendez-Torres GJ, Auguste P, Armoiry X, et al. Clinical effectiveness and cost-effectiveness of beta-interferon and glatiramer acetate for treating multiple sclerosis: systematic review and economic evaluation. Health Technol Assess. 2017;21(52):1–352.

    CAS  Google Scholar 

  43. 43.

    Couto E, Hamidi V, Ringerike T, Odgaard-Jensen J, Harboe I, Klemp M. Medicines used for multiple sclerosis—a health technology assessment. Oslo: Knowledge Centre for the Health Services at The Norwegian Institute of Public Health (NIPH); 2016.

    Google Scholar 

  44. 44.

    Tramacere I, Del Giovane C, Salanti G, D’Amico R, Filippini G. Immunomodulators and immunosuppressants for relapsing-remitting multiple sclerosis: a network meta-analysis. Cochrane Database Syst Rev. 2015;9:CD011381.

    Google Scholar 

  45. 45.

    Sormani MP. The Will Rogers phenomenon: the effect of different diagnostic criteria. J Neurol Sci. 2009;287(1 Suppl):S46–9.

    Google Scholar 

  46. 46.

    O’Connor P, Filippi M, Arnason B, et al. 250 microg or 500 microg interferon beta-1b versus 20 mg glatiramer acetate in relapsing-remitting multiple sclerosis: a prospective, randomised, multicentre study. Lancet Neurol. 2009;8(10):889–97.

    Google Scholar 

  47. 47.

    Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). General methods: version 5.0. IQWiG. 2016. Accessed 3 Feb 2020.

  48. 48.

    Kalincik T, Cutter G, Spelman T, et al. Defining reliable disability outcomes in multiple sclerosis. Brain. 2015;138(Pt 11):3287–98.

    Google Scholar 

  49. 49.

    Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16.

    Google Scholar 

  50. 50.

    Suthar A, Lawn S, del Amo J, et al. Antiretroviral therapy for prevention of tuberculosis in adults with HIV: a systematic review and meta-analysis. PLoS Med. 2012;9(7):e1001270.

    CAS  Google Scholar 

  51. 51.

    Centre for Reviews and Dissemination B. Systematic reviews. CRDs guidance for undertaking reviews in health care. CRD. 2009. Accessed 3 Feb 2020.

  52. 52.

    Hoaglin DC, Hawkins N, Jansen JP, et al. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011;14(4):429–37.

    Google Scholar 

  53. 53.

    Haute Authorite de Sante. Indirect comparisons: methods and validity. HAS. 2009. Accessed 3 Feb 2020.

  54. 54.

    Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Stat Soc Ser A (Stat Soc). 2009;172(1):137–59.

    Google Scholar 

  55. 55.

    Jansen JP, Trikalinos T, Cappelleri JC, et al. Indirect treatment comparison/network meta-analysis study questionnaire to assess relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report. Value Health. 2014;17(2):157–73.

    Google Scholar 

Download references


Richard Birnie produced tables and figures, screened search results, selected full-text studies for inclusion and performed data extraction.


Work on this systematic review was sponsored by Biogen. Biogen was given the opportunity to comment on the draft paper, but the authors had full editorial freedom. Biogen funded the journal’s Rapid Service Fee.

Medical Writing and Editorial Assistance

Editorial assistance in the preparation of this article was provided by Zoe Whittington and James Davies of OPEN VIE (Marlow, UK). Funding for this assistance was provided by Biogen.


All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published.


Maria Pia Sormani, Robert Wolff, Shona Lang, Steven Duffy, Robert Hyde, Elizabeth Kinter, Craig Wakeford, Gavin Giovannoni and Jos Kleijnen have nothing to disclose.

Compliance with Ethics Guidelines

This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.

Data Availability

All data generated or analyzed during this study are included in this published article/as supplementary information files.

Author information



Corresponding author

Correspondence to Robert Wolff.

Additional information

Digital Features

To view digital features for this article go to

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 23 kb)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Pia Sormani, M., Wolff, R., Lang, S. et al. Overview of Differences and Similarities of Published Mixed Treatment Comparisons on Pharmaceutical Interventions for Multiple Sclerosis. Neurol Ther 9, 335–358 (2020).

Download citation


  • Disease-modifying therapies
  • Healthcare decision-making
  • Mixed treatment comparison
  • Multiple sclerosis
  • Relapsing–remitting multiple sclerosis