Abstract
Background
Uncertainty in model-based cost-utility analyses is commonly assessed in a probabilistic sensitivity analysis. Model parameters are implemented as distributions and values are sampled from these distributions in a Monte Carlo simulation. Bootstrapping is an alternative method that requires fewer assumptions and incorporates correlations between model parameters.
Methods
A Markov model-based cost–utility analysis comparing oromucosal spray containing delta-9-tetrahidrocannabinol + cannabidiol (Sativex®, nabiximols) plus standard care versus standard spasticity care alone in the management of multiple sclerosis spasticity was performed over a 5-year time horizon from the Belgian healthcare payer perspective. The probabilistic sensitivity analysis was implemented using a bootstrap approach to ensure that the correlations present in the source clinical trial data were incorporated in the uncertainty estimates.
Results
Adding Sativex® spray to standard care was found to dominate standard spasticity care alone, with cost savings of €6,068 and a quality-adjusted life year gain of 0.145 per patient over the 5-year analysis. The probability of dominance increased from 29% in the first year to 94% in the fifth year, with the probability of QALY gains in excess of 99% for all years considered.
Conclusions
Adding Sativex® spray to spasticity care was found to dominate standard spasticity care alone in the Belgian healthcare setting. This study showed the use of bootstrapping techniques in a Markov model probabilistic sensitivity analysis instead of Monte Carlo simulations. Bootstrapping avoided the need to make distributional assumptions and allowed the incorporation of correlating structures present in the original clinical trial data in the uncertainty assessment.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Cost-effectiveness analysis (CEA) of new and current health services and technologies has become key in decision-making and health policy [1, 2]. Cost–utility analysis (CUA), a form of CEA that uses Quality-Adjusted Life Years (QALYs) as a measure of effectiveness, takes into account the value that individuals assign to health states [3,4,5,6]. Such evaluations provide key information to guide resource allocation considering the social perspective [1, 4,5,6]. One of the most common types of models used for CEA/CUA are Markov models. In these models, uncertainty around the cost-effectiveness results is commonly assessed using probabilistic sensitivity analyses (PSA). For model-based CEA, the PSA is usually implemented using Monte Carlo simulation. This requires that the model parameters are not implemented as point estimates, but as parametric distributions from which values are then sampled in the Monte Carlo simulation. Correlations between the parameters of the model are typically not included in the PSA, which can result in imprecise estimates of the uncertainty around the cost-effectiveness results.
In many cases, data at the individual patient level, such as those from a clinical trial, are used to calculate the parameters of a Markov model. The correlating structures present in these data can be incorporated in the PSA using bootstrapping techniques. Rather than sampling values from the distribution of each model parameter separately (as is done in a Monte Carlo simulation), values of the model parameters for the PSA can be calculated jointly for each bootstrap of the clinical trial data on which they are based. This ensures that any correlating structures present in these data sources are preserved and reflected in the estimates of the uncertainty from the PSA. In addition, the use of bootstrapping instead of Monte Carlo simulations avoids the need to make parametric assumptions about the distributions of the data used to populate the model. Therefore, the resulting estimates of the uncertainty of the CEA from the PSA reflect more accurately the uncertainty present in the clinical trial data that are used to calculate the parameters of the Markov model. In this study, we will demonstrate this in a CUA for a new cannabinoid-based approved medicine for the management of resistant multiple sclerosis (MS) spasticity (muscle rigidity and spasms) from a Belgian healthcare payer perspective.
MS is an autoimmune disease affecting the central nervous system [7, 8]. It is considered a high prevalence condition in Europe with a rate up to 83/100,000 inhabitants [9, 10]. One common symptom in MS patients is spasticity, present in up to 80% of patients as disease evolves [11], which is perceived as involuntary permanent activation of the muscles, often associated with spasms, pain and worsening of sleep, bladder function, mobility, and other MS spasticity associated symptoms [12]. MS reduces greatly the quality of life (QoL) of patients and interferes with the ability to work [12,13,14]. Furthermore, QoL diminishes as spasticity severity increases [15,16,17,18] and is one of the leading causes of distress in MS patients and caregivers [13, 19, 20]. Therefore, MS places a notorious economic burden in patients, family members, and health care systems [13, 21].
Management of MS aims to control and prevent the frequency and severity of the disease relapses, slowing down its progression [7, 22] and to minimize symptoms, including spasticity [23]. MS Standard-of-Care (SoC) implies multidisciplinary health care at once [7] as MS patients often need a combination of pharmacological treatment and physical therapy [23]. Sativex® (US adopted name nabiximols), a standardized compound of delta-9-tetrahydrocannabinol (THC) and cannabidiol (CBD) approved by health authorities in more than 20 countries, is indicated when patients become resistant to primary and/or secondary line of MS spasticity treatment [17, 24, 25]. The efficacy of this medication at reducing the severity of MS-related spasticity has been demonstrated in several randomized-controlled trials and observational studies [17, 26,27,28,29,30,31]. In 2012, two studies were published which assessed the cost-effectiveness of Sativex® as add-on therapy in comparison with oral anti-spasticity medicines alone for MS spasticity symptoms. The first, a study by Lu et al., was conducted in the UK setting [32]. The second, a study by Slof et al., considered the German and Spanish settings [33].
The Lu et al. study used a three-state Markov model with 4-week cycles from the National Health Service (NHS) perspective with a 5-year time horizon. The model applied a mean daily dose of 8.3 sprays obtained from a 12-week-long randomized clinical trial following the titration period and used this throughout the time horizon of the model [32]. The model resulted in an incremental cost-effectiveness ratio of £49,300. However, more recent data from the Mobility ImproVEment (MOVE) 2 study and an MS registry study in the UK indicated that patients adjusted their mean daily intake to 6.7 sprays/day after 3 months and down to 6.2 sprays/day after a year of ongoing treatment [34, 35] and the Sativex® daily dose was 4.2 sprays after a mean of 1.2 years of treatment [33, 36]. Therefore, the ICER was likely overestimated.
The study by Slof et al. [33] used a seven-state Markov model. They used the same length cycles and time horizon as Lu et al., but used dose per day figures that were in line with long-term use data. Their findings resulted in Sativex® being the dominant option in Spain, and cost-effective in Germany, with an ICER of €11,214 / QALY gained [33].
In 2015, another CUA was published by Slof et al. [34] using an updated version of the 2012 model to assess the cost-effectiveness of Sativex® in an Italian setting. The updates included a probabilistic sensitivity analysis (PSA) using Monte Carlo simulation. Using a 5-year time horizon, the 2015 model resulted in Sativex® being cost-effective in Italy with an ICER of €4,968/QALY gained. However, the uncertainty surrounding transition probabilities and resource use—both key model parameters—were not considered in the PSA. In addition, correlations between the model parameters were not considered in the PSA.
In the present study, the use of bootstrapping methodology instead of Monte Carlo simulation as a means of performing a PSA is presented. Moreover, the model uses the results from a Sativex® clinical trial that recently became available, the SAVANT trial [24]. In this trial, the efficacy of the medication as add-on treatment to SoC was assessed using a wash-out period to minimize carry-over effects, a method not applied in the previous studies. The uncertainty around the transition probabilities, the utilities, and the resource use were included in the bootstrap-based PSA. This allowed the assessment of the cost-effectiveness of Sativex® as add-on therapy for the treatment of MS spasticity in the Belgian setting, according to insights provided by the most recently available data and with more accurate assessment of the uncertainty than before.
Methods
A Markov model was used to evaluate the cost-effectiveness of standard-of-care with Sativex®(nabiximols) as adjuvant therapy compared to SoC alone. The model structure was based on the model published by Slof and colleagues in 2015 [34] and used the same 5-year time horizon (65 cycles). The model includes seven Markov states: three states for each arm related to severity of spasticity, and one state for death. The classification of severity of spasticity was based on MS spasticity Numerical Rating Scale (NRS) scores. NRS is a 10-point rating scale used to assess spasticity, ranging from 0 (no spasticity) to 10 (worst possible spasticity). Following past uses of the model, mild spasticity was defined as NRS score below 3.3, moderate spasticity as NRS score between 3.3 and 6.6, and severe spasticity as NRS score above 6.6 (see Fig. 1).
The main source of effectiveness data inputs in the model was the recent Sativex® SAVANT clinical trial (EudraCT Number: 2015-004451-40) [24]. The length of the cycles of the Markov model was 28 days to closely match the design of the clinical trial, facilitating the use of the bootstrap technique on the patient-level data in the PSA. The primary objective of the SAVANT trial was to evaluate the efficacy of Sativex® as add-on therapy compared to further optimized standard antispastic therapy in subjects with moderate-to-severe spasticity due to MS who had not gained adequate relief through two optimized standard antispastic drugs. The trial consisted of three phases after the initial screening period: a single-blinded trial period phase, a wash-out phase, and a double-blinded phase (see Fig. 2).
Overview of the design of the SAVANT trial and the cycles of the Markov model. SoC standard-of-care. Numbers between brackets indicate the total number of patients included in each phase of the trial, and available number of patients for calculating the transition probabilities for each cycle in the Markov model SoC standard-of-care
After initial screening (visit 1), 190 eligible patients entered the 4-week single-blinded trial period phase (visit 2) where every patient received Sativex® treatment in addition to SoC. Patients uptitrated the medication to their optimal efficacy dose (max. dose allowed 12 sprays per day) as an add-on to their standard antispastic medication, until they achieved symptom relief. During the single-blinded phase, 134 patients were identified as early responders (improvement of spasticity NRS score ≥ 20% versus baseline) and subsequently entered the wash-out phase. In the wash-out phase (visit 3), all initial responders continued to receive their underlying standard anti-spasticity medication but not Sativex®. The wash-out phase lasted until the MS spasticity NRS score was reduced by at least 80%. Patients who did not achieve this reduction in 4 weeks were withdrawn from the study. 106 patients fulfilled these requirements and entered the subsequent double-blinded phase (visits 4–7). Patients were randomly assigned to a 12-week treatment period with either Sativex® as add-on to the standard underlying antispastic medications (n = 53), or placebo as add-on (n = 53). All patients were asked to keep daily diaries between visits, which included self assessments of their spasticity using the NRS. Quality of life of patients was assessed using the SF-36 at each visit. Further details of the clinical trial can be found elsewhere [24].
Transition probabilities
The transition probabilities between the mild, moderate, and severe states for the SoC + Sativex® arm for cycles 1–5 were calculated using the data from the SAVANT trial. In our base case scenario, transition probabilities for cycle 6 and subsequent cycles were assumed to be the same as those for cycle 5. Therefore, it is assumed that patients in SoC + Sativex® arm maintained the active treatment effects after the end of the trial period. Indeed, recent published literature has shown a treatment effect for a year or even longer [29, 37].
Available number of patients for calculating the transition probabilities ranged from n = 180 in cycle 1 to n = 38 for cycle 5 (end of randomized period, see Fig. 2). Probabilities for discontinuation with Sativex® for cycles 2, 3, and 4 were based on the SAVANT trial at 3.8% for mild, moderate, and severe. The discontinuation probability for cycle 5 and subsequent cycles was 3.5% based on a relevant long-term Sativex® study [38].
Transition probabilities between the mild, moderate, and severe spasticity state for the SoC arm were based on the retrospective observational study by Arroyo on MS spasticity patients previous to Sativex® introduction [39], rather than on the SAVANT trial because of its much longer time span (> 2 years). We included a scenario where the transition probabilities for the SoC arm were based on the SAVANT trial in the sensitivity analyses (see below).
General population life tables were obtained from the Belgium statistical office (2017) and used to determine the transition probabilities to death. These increased with the age of the cohort as it progressed through the model, ranging from 0.020% for the first cycle (i.e., age of 51) to 0.035% for the last cycles, corresponding to the age of 56. The same probabilities were used for both arms of the model. The transition probabilities between the mild, moderate, and severe states for the SoC + Sativex® arm can be found in Table 1. An overview of all transition probabilities used, including treatment discontinuation and death, can be found in the online appendix.
Costs
Sativex® costs
Gradual initial dosing of Sativex® (nabiximols), as requested in the up-titration present in the approved label, was assumed in the model. The mean observed dose during the single-blind phase of the SAVANT trial was not reported in the publication by Markovà et al. [24]. Therefore, for the first cycle (first month trial period), a mean of 6.9 sprays/day was used, obtained from Novotna et al. (2011) [17]. For cycles 2–5, the mean observed dose at the end of the single-blind phase of the SAVANT trial was used (7.7 sprays/day). The lower mean observed dosage at the end of the double-blind phase from the SAVANT trial was used for cycle 6 (7.3 sprays/day). This was then linearly decreased for each cycle to a dose of 6.2 sprays/day at cycle 14 (i.e., at the 1 year time horizon), based on long-term dosage found in the long-term MOVE 2 observational study [35]. The dosage for cycle 14 was also used for all subsequent cycles (i.e., cycles 15–65 corresponding to a time horizon of up to 5 years). The Sativex® price used in the model was the list price of €466.40 for a 3 × 10 ml vial pack, where each 10 ml vial contains 90 pulverizations.
Other costs
In addition to costs related to the use of Sativex®, there are other costs associated with the spasticity standard-of-care. It was assumed that there were no differences in resource use related to SoC between the two arms of the model. Resource use estimates related to SoC were obtained from a Delphi panel consisting of eight clinical experts in the field of MS spasticity from Belgium. Experts individually provided their estimates on the treatment regimens used for patients with mild, moderate, and severe spasticity. Included were drug therapy; surgical procedures; healthcare system visits (e.g., primary care/GP, emergency room); and tests and monitoring (e.g., MRI, hematology). Unit costs for 2019 were obtained from the Belgian National Institute for Health and Disability Insurance (RIZIV) and the Belgian Centre for Pharmacotherapeutic Information (BCFI). Where up-to-date information on costs could not be found, costs were updated to 2019 values using published Belgian inflation rates. Details of all items included in the utilization of resources, together with the unit costs, are summarized in the online appendix. Costs were discounted using a discount rate of 3.0%, in line with Belgian guidelines [40].
Quality of life and utilities
QoL data in the SAVANT trial were collected using the SF-36 QoL questionnaire [24]. Utilities for mild, moderate, and severe MS spasticity used in the model could not be based directly on EQ-5D-3L observations and were therefore derived via mapping. First, the 12 SF-36 responses that form the SF-12 were selected, thereby changing SF-36 profiles into SF-12 profiles. Next, the response mapping algorithm developed by Gray et al. [41] was used to convert reported individual patient SF-12 profiles into EQ-5D-3L utilities. The EQ-5D-3L utilities were calculated using the European VAS value set [42]. Following this procedure, EQ-5D utilities for each of the reported SF-12 profiles were created. This resulted in mean utilities for mild spasticity equal to 0.594, for moderate spasticity equal to 0.509, and for severe spasticity equal to 0.499. QALYs were discounted using a discount rate of 1.5% per year, in line with Belgian guidelines.
Sensitivity analyses
The probabilistic sensitivity analysis (PSA) of the Markov model was performed using 1,000 bootstraps. In a bootstrap procedure multiple “bootstrapped” data sets are generated based on an “original” data set, by resampling with replacement from the original data (with the same size as the original sample). Each of these bootstrapped samples resembles a repetition of the original study. The bootstrapped samples differ from one another because of the sampling with replacement. The clinical and QoL data from the SAVANT trial were included in the bootstrap procedure as well as the resource use data from the Delphi panel.
For the clinical trial data, the bootstrap was stratified to retain the number of patients in each treatment arm at each phase of the clinical trial. The data from the 190 patients at the start of the single-blind phase, the 53 patients in the SoC + active treatment arm of the double-blind phase, and the 53 patients in the SoC arm of the double-blind phase were bootstrapped separately. This stratification was done to maintain the structure of the trial in the bootstraps. Therefore, the correlations between transitions probabilities between the three health states (mild, moderate, and severe) and the utilities of these health states that were stated within clinical trial data were all included in our PSA.
The bootstrap procedure incorporated the variability between SF-12 states reported by patients in the same Markov state. The mapped utilities for each of the SF-12 health states were included in our data as point estimates, since the uncertainty due to applying the mapping algorithm is minimal compared to the variability between SF-12 states reported by patients in the same Markov state [43].
The Delphi panel data on use of resources were included in the bootstrap procedure. This allowed potential differences in expert response characteristics and group bias to be reflected in the uncertainty estimates of the PSA. Following the same line of reasoning as for the utilities, the uncertainty surrounding the unit costs were not included in the PSA as they can be expected to be minimal compared to the uncertainty due to differences in resource use as provided by the Delphi panel.
The patient-level data from the SAVANT trial were used as is. Missing data were not imputed, because this would impact the estimates of the uncertainty of the data. Given the adherence to the trial protocol, a bias due to missing values was not expected . The data obtained from the Delphi panel did not contain any missing values. The algorithm that was followed for the bootstrapping procedure is specified in Box 1.
Since different sources of efficacy evidence were available, two scenarios were explored in addition to the base case analysis (see Fig. 3). In the base case scenario, transition probabilities between the mild, moderate, and severe state for the SoC arm were based on the long-term retrospective observational study by Arroyo et al. [39]. Scenario 1 explored instead the impact of calculating the SoC arm transition probabilities from the SAVANT trial data, meaning that in scenario 1, all efficacy data are based on the SAVANT trial. As the trial data were used, the bootstrapping procedure used for the PSA in scenario 1 also included the calculations for the transition probabilities of the SoC arm.
For scenario 2, patients in the SoC + Sativex® arm were assumed to have no further beneficial effect of the active medication following the clinical trial (i.e., after the 5th cycle), even though they still receive Sativex® treatment. That is, transition probabilities for cycle 6 and subsequent cycles were based on the long-term retrospective observational study by Arroyo [39] and, therefore, the same as in the SoC arm. This is a conservative scenario, since patients in the SoC + Sativex® arm after the end of the trial (from cycle 6 +) still incur the costs related to Sativex®, but no longer have any treatment benefits related to Sativex®. This scenario uses the least amount of data from the SAVANT trial.
The model implementation in MS Excel was evaluated using a thorough QA/QC evaluation of the existing model, including the model structure, the assumptions, calculations, and the programming.
Results
Our base case resulted in SoC + Sativex® (nabiximols) being the dominant strategy (i.e., cost-saving while QALY gaining) for time horizons of 2 or more years, with ICERs between €22,187 for a 1-year time horizon decreasing to negative €41,942 for a 5-year time horizon (Table 2). The results from the PSA showed that the probability that SoC + Sativex® is dominant compared to SoC alone varied from 28.9% for a time horizon of 1 year to 94.1% for a time horizon of 5 years. The probability of QALY gains for patients was over 99% for all 5 time horizons. The cost-effectiveness plane showing the uncertainty surrounding the incremental costs and QALYs for the 1-year time horizon and the 5-year time horizon is shown in Fig. 4. Both additional conservative control scenarios (one using SAVANT trial data for the SoC arm transition probabilities and one assuming no further beneficial effect of the active medication after the 5th cycle for scenario 2) were no longer the dominant treatment option. However, both scenarios did result in ICERs below €25,000/QALY for time horizons of 2 years or longer (see Table 2).
Discussion
In this study, we adapted an existing Markov model to assess cost-effectiveness of adding Sativex® spray to spasticity care to the Belgian setting. Markov models are commonly used for determining cost-effectiveness. Estimates of uncertainty around the cost-effectiveness figures are generally included in these models using probabilistic sensitivity analyses. In trial-based economic evaluations, bootstrapping is commonly used to obtain these estimates of uncertainty (see for example [44,45,46]); however, this is not the case when Markov models are used. For Markov models, in most cases, the PSA consists of a Monte Carlo simulation sampling values from model parameters implemented as different distributions. In this study, the uncertainty around the model parameters (and consequently around the obtained costs, QALYs, and ICERs) was estimated by means of bootstrapping techniques applied to the source data: the clinical trial data for the transition probabilities and utility estimates, and the resource use panel for the cost estimates. Note that the new sources of data (i.e., the SAVANT trial data and the Belgium specific model inputs) mostly impact the mean values of the model outcomes, whereas the bootstrapping procedure impacts the estimates of uncertainty. One advantage of bootstrapping compared to Monte Carlo simulation is that correlations (in our case between transition probabilities and utilities) are taken into account. Incorporating the correlation between model parameters can in principle also be done for Monte Carlo simulation using Cholesky Decomposition. However, that is only applicable to parameters with normal distributions. Given that in Markov models, the model parameters are typically not normal distributions, but, e.g., Dirichlet for probabilities, including the correlations properly is not feasible in most cases. This also highlights the second benefit of bootstrapping, namely that distributional assumptions can be avoided.
The transition probabilities and utilities used in the model were based on to the latest available sources of data for the active medication, using the recent SAVANT trial. Resource use estimates and unit costs from the Belgian healthcare public system perspective were used. Results showed that in the Belgian framework with a 5-year time horizon, adding Sativex® (nabiximols) to standard of care for the treatment of MS-related spasticity results in cost savings of €6,068 per patient with QALY gains of 0.145 per patient compared to standard of care treatment alone, being the dominant treatment strategy. The Bootstrapping PSA showed that the probability that Sativex® as add-on therapy to standard of care is the dominant strategy when using a 5-year time horizon at 94%. The analyses were carried out according to the Belgian HTA guidelines, which specify that no explicit discrete ICER threshold is used in Belgium [40].
Four previous cost-effectiveness analyses for Sativex® have been published. The study from the UK perspective from 2012 resulted in an ICER of £49,300 per QALY [32]. The study for Germany and Spain, also from 2012, resulted in an ICER of €11,214 per QALY for Germany, and in Sativex® being the dominant option in Spain [33]. The study for Italy from 2015 resulted in an ICER of €4,968 per QALY [34]. Our results, based on the Belgian setting and including the recent SAVANT trial as main source of our data, are similar to those found in Spain, and more favourable for Sativex®, when compared to the other three countries.
The Italian study included a PSA based on Monte Carlo simulations, but did not report the 95% confidence intervals surrounding the ICER [34]. Based on inspection of Fig. 3 of the paper (i.e., the cost-effectiveness acceptability curve), the 95% confidence interval surrounding the ICER can be estimated to be between €2,500 and €7,500 or between -50% and + 50% of the value of the ICER. Comparing those values with the results from this model showed that including uncertainty of the transition probabilities and resource use in the PSA leads to a much higher estimates of uncertainty surrounding the ICER. In addition, using bootstrapping in the PSA allowed for the incorporation of the correlation between the transition probabilities and utilities of the health states, which were based on the data from the same clinical trial. Additionally, there was no need to make any parametric assumptions with respect to the distributions for the transition probabilities, utilities, or resource use items. The latter were included in the PSA as a bootstrap over the Delphi panel.
The analyses of the two conservative scenarios demonstrated that the data source chosen for the transition probabilities impacted the results. However, in both cases, the ICER was below €25,000 from year 2 onwards. This implies that, although there is no dominance of Sativex® in these conservative scenarios, adding it as a treatment in MS patients is cost-effective.
A limitation of this study was that we did not include the uncertainty of all model parameters in the PSA. Uncertainty surrounding the transition probabilities based on the observational study by Arroyo et al. [39] (e.g., the SoC arm in the base case scenario) was obtained from the literature. Therefore, we could not include those in our bootstrap procedures for the PSA.
If the primary data are available, and this is the only source of data of that type, then bootstrapping should be preferred over Monte Carlo. If additional sources of data need to be included, they can be combined by incorporating them in the distributions used in Monte Carlo. Alternatively, if the additional sources of data allow this, the additional sources of data can be reverse engineered to match the format of the primary data (e.g., Kaplan–Meier curves can be reverse engineered into patient-level data). This would allow bootstrapping to be applied to the combined set. In cases where this is not possible (e.g., an NMA is required), the only option is to use Monte Carlo.
Conclusion
The analyses showed that bootstrapping techniques can be used in the PSA of a Markov model, thereby properly incorporating correlations between model parameters and avoiding the need of making any parametric assumptions of the model inputs. In addition, the study showed that in a Belgium setting, under the modelled conditions, the use of Sativex® (nabiximols) as add-on therapy for resistant MS spasticity was found to be cost-saving, providing QALY gains compared to current standard-of-care treatment for resistant MS spasticity patients under safe conditions. Therefore, Sativex® should be considered as a valuable add-on treatment available for patients suffering from MS-related resistant spasticity.
Availability of data and materials
Not applicable.
Code availability
Not applicable.
References
Bodrogi, J., Kaló, Z.: Principles of pharmacoeconomics and their impact on strategic imperatives of pharmaceutical research and development. Br. J. Pharmacol. 159, 1367–1373 (2010). https://doi.org/10.1111/j.1476-5381.2009.00550.x
Olsen, J.A.: Principles in Health Economics and Policy. Oxford University Press, Oxford (2009)
Szende, A., Oppe, M., Devlin, N.: EQ-5D Value Sets: Inventory, Comparative Review and User Guide. EuroQol Group Monographs. Springer, Dordrecht (2007)
Gray, A.M., Clarke, P.M., Wolstenholme, J.L., Wordsworth, S.: Applied Methods of Cost-Effectiveness Analysis in Health Care. Oxford University Press, Oxford (2011)
Drummond, M.F., Sculpher, M.J., Torrance, G.W., O’Brien, B.J., Stoddart, B.J.: Methods for the Economic Evaluation of Health Care Programmes, 3rd edn. Oxford University Press, Oxford (2005)
Briggs, A., Sculpher, M.J., Claxton, K.: Decision Modelling for Health Economic Evaluation. Oxford University Press, Oxford (2006)
Pugliatti, M., Rosati, G., Carton, H., Riise, T., Drulovic, J., Vecsei, L., et al.: The epidemiology of multiple sclerosis in Europe. Eur. J. Neurol. 13, 700–722 (2006). https://doi.org/10.1111/j.1468-1331.2006.01342.x
Fenu, G., Fronza, M., Lorefice, L., Arru, M., Coghe, G., Frau, J., et al.: Performance in daily activities, cognitive impairment and perception in multiple sclerosis patients and their caregivers. BMC Neurol. 18, 212 (2018). https://doi.org/10.1186/s12883-018-1224-z
Kingwell, E., Marriott, J.J., Jetté, N., Pringsheim, T., Makhani, N., Morrow, S.A., et al.: Incidence and prevalence of multiple sclerosis in Europe: A systematic review. BMC Neurol. 13, 128 (2013). https://doi.org/10.1186/1471-2377-13-128
Kurtzke, J.F.: Multiple sclerosis in time and space: Geographic clues to cause. J. Neurovirol. 6(Suppl 2), S134–S140 (2000)
Kister, I., Bacon, T.E., Chamot, E., Salter, A.R., Cutter, G.R., Kalina, J.T., et al.: Natural history of multiple sclerosis symptoms. Int. J. Multi. Scler. Care. 15, 146–156 (2013). https://doi.org/10.7224/1537-2073.2012-053
Messina, S., Solaro, C., Righini, I., Bergamaschi, R., Bonavita, S., Bossio, R.B., et al.: Sativex in resistant multiple sclerosis spasticity: Discontinuation study in a large population of Italian patients (SA.FE. study). PLoS ONE 12, e0180651 (2017). https://doi.org/10.1371/journal.pone.0180651
Rizzo, M.A., Hadjimichael, O.C., Preiningerova, J., Vollmer, T.L.: Prevalence and treatment of spasticity reported by multiple sclerosis patients. Mult. Scler. J. 10, 589–595 (2004). https://doi.org/10.1191/1352458504ms1085oa
MS Trust: Multiple Sclerosis Information for Health and Social Care Professionals, 4th edn. MS Trust, London (2011)
Bavikatte, G., Gaber, T.: Approach to spasticity in general practice. Br. J. Med. Pract. 22, 29–29 (2009)
Andlin-Sobocki, P., Jonsson, B., Wittchen, H.U., Olesen, J.: Cost of disorders of the brain in Europe. Eur. J. Neurol. 12, 1–27 (2005). https://doi.org/10.1111/j.1468-1331.2005.01202.x
Novotna, A., Mares, J., Ratcliffe, S., Novakova, I., Vachova, M., Zapletalova, O., et al.: A randomized, double-blind, placebo-controlled, parallel-group, enriched-design study of nabiximols* (Sativex ®), as add-on therapy, in subjects with refractory spasticity caused by multiple sclerosis. Eur. J. Neurol. 18, 1122–1131 (2011). https://doi.org/10.1111/j.1468-1331.2010.03328.x
Farrar, J.T., Troxel, A.B., Stott, C., Duncombe, P., Jensen, M.P.: Validity, reliability, and clinical importance of change in a 0–10 numeric rating scale measure of spasticity: A post hoc analysis of a randomized, double-blind, placebo-controlled trial. Clin. Ther. 30, 974–985 (2008). https://doi.org/10.1016/j.clinthera.2008.05.011
Hemmett, L., Holmes, J., Barnes, M., Russell, N.: What drives quality of life in multiple sclerosis? QJM 97, 671–676 (2004). https://doi.org/10.1093/qjmed/hch105
Figved, N., Myhr, K.M., Larsen, J.P., Aarsland, D.: Caregiver burden in multiple sclerosis: The impact of neuropsychiatric symptoms. J. Neurol. Neurosurg. Psychiatry. 78, 1097–1102 (2007). https://doi.org/10.1136/jnnp.2006.104216
Zwibel, H.L.: Contribution of impaired mobility and general symptoms to the burden of multiple sclerosis. Adv. Ther. 26, 1043–1057 (2009). https://doi.org/10.1007/s12325-009-0082-x
Kobelt, G., Eriksson, J., Phillips, G., Berg, J.: The burden of multiple sclerosis 2015: Methods of data collection, assessment and analysis of costs, quality of life and symptoms. Mult. Scler. J. 23, 4–16 (2017). https://doi.org/10.1177/1352458517708097
Zettl, U.K., Rommer, P., Hipp, P., Patejdl, R.: Evidence for the efficacy and effectiveness of THC-CBD oromucosal spray in symptom management of patients with spasticity due to multiple sclerosis. Ther. Adv. Neurol. Disord. 9, 9–30 (2016). https://doi.org/10.1177/1756285615612659
Markovà, J., Essner, U., Akmaz, B., Marinelli, M., Trompke, C., Lentschat, A., et al.: Sativex ® as add-on therapy vs further optimized first-line ANTispastics (SAVANT) in resistant multiple sclerosis spasticity: a double-blind, placebo-controlled randomised clinical trial. Int. J. Neurosci. 129, 119–128 (2019). https://doi.org/10.1080/00207454.2018.1481066
Almirall: Sativex Oromucosal spray: Summary of product characteristics. https://www.medicines.org.uk/emc/product/602/smpc (2012). Accessed 15 Mar 2020
Collin, C., Davies, P., Mutiboko, I.K., Ratcliffe, S.: Randomized controlled trial of cannabis-based medicine in spasticity caused by multiple sclerosis. Eur. J. Neurol. 14, 290–296 (2007). https://doi.org/10.1111/j.1468-1331.2006.01639.x
Collin, C., Ehler, E., Waberzinek, G., Alsindi, Z., Davies, P., Powell, K., et al.: A double-blind, randomized, placebo-controlled, parallel-group study of Sativex, in subjects with symptoms of spasticity due to multiple sclerosis. Neurol. Res. 32, 451–459 (2010). https://doi.org/10.1179/016164109X12590518685660
Wade, D.T., Collin, C., Stott, C., Duncombe, P.: Meta-analysis of the efficacy and safety of Sativex (nabiximols), on spasticity in people with multiple sclerosis. Mult. Scler. J. 16, 707–714 (2010). https://doi.org/10.1177/1352458510367462
Flachenecker, P., Henze, T., Zettl, U.K.: Long-term effectiveness and safety of nabiximols (tetrahydrocannabinol/cannabidiol oromucosal spray) in clinical practice. Eur. Neurol. 72, 95–102 (2014). https://doi.org/10.1159/000360285
Patti, F., Messina, S., Solaro, C., Amato, M.P., Bergamaschi, R., Bonavita, S., et al.: Efficacy and safety of cannabinoid oromucosal spray for multiple sclerosis spasticity. J. Neurol. Neurosurg. Psychiatry. 87, 944–951 (2016). https://doi.org/10.1136/jnnp-2015-312591
Vermersch, P., Trojano, M.: Tetrahydrocannabinol: Cannabidiol oromucosal spray for multiple sclerosis-related resistant spasticity in daily practice. Eur. Neurol. 76, 216–226 (2016). https://doi.org/10.1159/000449413
Lu, L., Pearce, H., Roome, C., Shearer, J., Lang, I.A., Stein, K.: Cost effectiveness of oromucosal cannabis-based medicine (Sativex®) for spasticity in multiple sclerosis. Pharmacoeconomics 30, 1157–1171 (2012). https://doi.org/10.2165/11598470-000000000-00000
Slof, J., Gras, A.: Sativex® in multiple sclerosis spasticity: A cost–effectiveness model. Expert Rev. Pharmacoecon. Outcomes Res. 12, 439–441 (2012). https://doi.org/10.1586/erp.12.40
Slof, J., Ruiz, L., Vila, C.: Cost-effectiveness of Sativex in multiple sclerosis spasticity: New data and application to Italy. Expert Rev. Pharmacoeconomics Outcomes Res. 15, 379–391 (2015). https://doi.org/10.1586/14737167.2015.1025759
Flachenecker, P., Henze, T., Zettl, U.K.: Nabiximols (THC/CBD oromucosal spray, Sativex®) in clinical practice: Results of a Multicenter, Non-Interventional Study (MOVE 2) in Patients with Multiple Sclerosis Spasticity. Eur. Neurol. 71, 271–279 (2014). https://doi.org/10.1159/000357427
Etges, T., Karolia, K., Grint, T., Taylor, A., Lauder, H., Daka, B., Wright, S.: An observational postmarketing safety registry of patients in the UK, Germany, and Switzerland who have been prescribed Sativex® (THC:CBD, nabiximols) oromucosal spray. Ther. Clin. Risk. Manag. 12, 1667–1675 (2016). https://doi.org/10.2147/TCRM.S115014
Oreja-Guevara, C., Casanova, B., Ordás, C.M., Vila, C., Asensio, D., Massana, M.: Observational safety study of THC:CBD Oromucosal Spray (Sativex) in multiple sclerosis patients with spasticity. Clin. Exp. Pharmacol. 5, 184 (2015). https://doi.org/10.4172/2161-1459.100018
Wade, D.T., Makela, P.M., House, H., Bateman, C., Robson, P.: Long-term use of a cannabis-based medicine in the treatment of spasticity and other symptoms in multiple sclerosis. Mult. Scler. J. 12, 639–645 (2006). https://doi.org/10.1177/1352458505070618
Arroyo, R., Vila, C., Clissold, S.: Retrospective observational study of the management of multiple sclerosis patients with resistant spasticity in Spain: the ‘5E’ study. Expert Rev. Pharmacoecon. Outcomes Res. 11, 205–213 (2011). https://doi.org/10.1586/erp.11.6
Cleemput, I., Neyt, M., Van de Sande, S., Thiry, N.: Belgian guidelines for economic evaluations and budget impact analyses: Second Edition. KCE Report, vol. 183C. Belgian Health Care Knowledge Centre (KCE), Brussels (2012).
Gray, A.M., Rivero-Arias, O., Clarke, P.M.: Estimating the association between SF-12 responses and EQ-5D utility values by response mapping. Med. Decis. Mak. 26, 18–29 (2006). https://doi.org/10.1177/0272989X05284108
Greiner, W., Weijnen, T., Nieuwenhuizen, M., Oppe, S., Badia, X., Busschbach, J., et al.: A single European currency for EQ-5D health states. Eur. J. Heal. Econ. 4, 222–231 (2003). https://doi.org/10.1007/s10198-003-0182-5
Gray, A.M., Rivero-Arias, O., Leal, J., Dakin, H., Ramos-Goñi, J.: How important is parameter uncertainty around the UK EQ-5D-3L value set when estimating treatment effects? In: Joint meeting of the Health Economists’ Study Group and the Collège des économistes de la santé Aix-en-Provence, France. Health Economics Research Centre. Nuffield Department of Population Health (2012)
Barrett, S., Begg, S., O’Halloran, P., Kingsley, M.: Cost-effectiveness of telephone coaching for physically inactive ambulatory care hospital patients: economic evaluation alongside the Healthy4U randomised controlled trial. BMJ Open 9(12), e032500 (2019). https://doi.org/10.1136/bmjopen-2019-032500
Panca, M., Christie, D., Cole, T.J., Costa, S., Gregson, J., Holt, R., et al.: Cost-effectiveness of a community-delivered multicomponent intervention compared with enhanced standard care of obese adolescents: Cost-utility analysis alongside a randomised controlled trial (the HELP trial). BMJ Open 8(2), e018640 (2018). https://doi.org/10.1136/bmjopen-2017-018640
Patel, N., Beeken, R.J., Leurent, B., Omar, R.Z., Nazareth, I., Morris, S.: Cost-effectiveness of habit-based advice for weight control versus usual care in general practice in the Ten Top Tips (10TT) trial: Economic evaluation based on a randomised controlled trial. BMJ Open 8(8), e017511 (2018). https://doi.org/10.1136/bmjopen-2017-017511
Funding
This study was funded by Almirall.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Model implementation and analyses were performed by MO, JMR-G, and AE-C. The first draft of the manuscript was written by MO. All authors contributed to the writing of the manuscript and commented to previous versions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
Mark Oppe, Anabel Estévez-Carrillo, and Juan M. Ramos-Goñi are consultants at Axentiva Solutions S.L. and have received financial support from Almirall for conducting this work. Daniela Ortín-Sulbarán works as market access specialist at Almirall and Carlos Vila Silván is a global medical advisor at Almirall. The authors have no other relevant affiliations or financial involvement with any organization or entity with a financial interest in or financial conflict with the subject matter or materials discussed in the manuscript apart from those disclosed.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Oppe, M., Ortín-Sulbarán, D., Vila Silván, C. et al. Cost-effectiveness of adding Sativex® spray to spasticity care in Belgium: using bootstrapping instead of Monte Carlo simulation for probabilistic sensitivity analyses. Eur J Health Econ 22, 711–721 (2021). https://doi.org/10.1007/s10198-021-01285-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10198-021-01285-1