Skip to main content

Generating EQ-5D-5L health utility scores from BASDAI and BASFI: a mapping study in patients with axial spondyloarthritis using longitudinal UK registry data

Abstract

Background

Preference-based health-state utility values (HSUVs), such as the EuroQol five-dimensional questionnaire (EQ-5D-5L), are needed to calculate quality-adjusted life-years (QALYs) for cost-effectiveness analyses. However, these are rarely used in clinical trials of interventions in axial spondyloarthritis (axSpA). In these cases, mapping can be used to predict HSUVs.

Objective

To develop mapping algorithms to estimate EQ-5D-5L HSUVs from the Bath Ankylosing Disease Activity Index (BASDAI) and the Bath Ankylosing Spondylitis Functional Index (BASFI).

Methods

Data from the British Society for Rheumatology Biologics Register in Ankylosing Spondylitis (BSRBR-AS) provided 5122 observations with complete BASDAI, BASFI, and EQ-5D-5L responses covering the full range of disease severity. We compared direct mapping using adjusted limited dependent variable mixture models (ALDVMMs) and optional inclusion of the gap between full health and the next feasible value with indirect response mapping using ordered probit (OPROBIT) and generalised ordered probit (GOPROBIT) models. Explanatory variables included BASDAI, BASFI, and age. Metrics to assess model goodness-of-fit and performance/accuracy included Akaike and Bayesian information criteria (AIC/BIC), mean absolute error (MAE) and root mean square error (RMSE), plotting predictive vs. observed estimates across the range of BASDAI/BASFI and comparing simulated data with the original data set for the preferred/best model.

Results

Overall, the ALDVMM models that did not formally include the gap between full health and the next feasible value outperformed those that did. The four-component mixture models (with squared terms included) performed better than the three-component models. Response mapping using GOPROBIT (no squared terms included) or OPROBIT (with squared terms included) offered the next best performing models after the three-component ALDVMM (with squared terms). Simulated data of the preferred model (ALDVMM with four-components) did not significantly underestimate uncertainty across most of the range of EQ-5D-5L values, however the proportion of data at full health was underrepresented, likely due in part to model fitting on a small number of observations at this point in the actual data (4%).

Conclusions

The mapping algorithms developed in this study enabled the generation of EQ-5D-5L utilities from BASDAI/BASFI. The indirect mapping equations reported for the EQ-5D-5L facilitate the calculation of the EQ-5D-5L utility scores using other UK and country-specific value sets.

Introduction

The EuroQol five-dimensional questionnaire (EQ-5D) is one of the most frequently used measures for the collection of health-related quality of life (HRQoL) data, required for use in cost-effectiveness analysis when quality-adjusted life-years (QALYs) are calculated. In the UK this is reflected in current National Institute of Health and Care Excellence (NICE) Methods Guidance [1] relating to economic evaluation. However, the guidance also recognises that outcomes included in clinical studies often do not include preference-based measures (PBMs) such as the EQ-5D to generate health-state utility values (HSUVs). In such cases, when PBM data are unavailable, “mapping” from other relevant clinical outcome and disease measures that have been collected in clinical trials to estimate a PBM has been advocated [e.g., 2, 3]. In a review of economic models included in 71 NICE submissions (53 manufacturer submissions, 18 assessment group reports) the EQ-5D was used in 49% of submissions and mapping to a generic HRQoL measure was performed in 27% of submissions [4].

Axial spondyloarthritis (axSpA) is a common rheumatic chronic progressive inflammatory disease, leading to joint damage/pain, stiffness, impaired physical function, fatigue and reductions in quality of life [5]. AxSpA primarily affects the spine and sacroiliac joints but it also associated with peripheral arthritis plus various extra-articular features such as enthesitis, uveitis, inflammatory bowel disease and psoriasis. AxSpA typically has its onset early in adulthood [6] and is more common in men than in women [7]. AxSpA patients incur significant direct NHS costs, which are mainly due to costs associated with prescriptions, and outpatient and day unit use [8]. There are also indirect costs to society as axSpA affects young patients who have to take time off work and in the worst cases may permanently cease paid employment [9,10,11]. Until recently, treatment has largely been limited to NSAIDS and physiotherapy, while DMARDs, though effective in other inflammatory conditions, have shown little efficacy for axSpA. The introduction of anti-TNF biologic therapies licensed for use in the management of axSpA (e.g., etanercept, adalimumab) has been associated with significantly improved outcomes, including improvements in pain, stiffness, fatigue, and work outcomes such as improved productivity [12,13,14,15,16]. However, many of the pivotal trials for new biologics therapies did not include a generic preference-based HRQoL instrument such as the EQ-5D nor a preference-based condition-specific HRQoL measure. These preference-based measures allow direct comparison of outcomes associated with alterative interventions both within similar and across different therapeutic areas. Within the field of axSpA, analysts have conducted mapping studies to estimate the relationship between EQ-5D and clinical outcome measures, most predominantly the Bath Ankylosing Disease Activity Index (BASDAI) [17] and the Bath Ankylosing Spondylitis Functional Index (BASFI) [18]. In the UK for example, all appraisals of biologic therapies undertaken by NICE and their broader guidelines on the management of axSpA relied on a mapping approach [19]. Until recently, such mapping studies were based on linear regression models [19,20,21,22,23,24]. However, recent evidence suggests that such an approach may lead to biased estimates, with such models tending to show poor statistical properties in terms of goodness-of-fit, with a major limitation being lack of ability to predict values at the extreme ends of the distribution [e.g., 25, 26]. In particular the statistical model underestimates utility values for those patients with little or no functional disability (and/or low disease activity) but overestimates the utility score for those with poor function (and/or high disease activity). Ultimately, this may lead to biased estimates of the cost-effectiveness of interventions. This poor statistical fit typically arises due to the special characteristics of health utility instruments. Specifically, utility instruments have upper and lower bounds, tend to have a mass at one or more at the upper bounds, and can be further characterised by multimodality and skewness. Of course, we are not implying that researchers should not ever consider using these ‘basic’ models – only to flag an awareness that linear models have been shown to perform less well relative to other mapping approaches in the published literature. Many published mapping studies do in fact include the results from linear regression models, to allow comparison with other mapping approaches and so we also have done this in the current mapping study.

Recently Wailoo et al. [27] implemented an alternative mapping approach that linked BASDAI and BASFI to the 3-level version of the EQ-5D (EQ-5D-3L). This used a mixture modelling approach, which involves mixtures of normal distributions being used because of their flexibility and ability to capture multimodality [28, 29]. This approach does not permit generation of predicted values outside the feasible range by its design. This demonstrated improved statistical performance over the linear regression model in terms of Akaike and Bayesian information criteria, root mean square error, and mean absolute error, fitted the data well at high EQ-5D levels and did not predict unfeasible EQ-5D values. This approach has also been applied in a number of different diseases and conditions [30] including rheumatoid arthritis (RA) [31, 32] and asthma [25], breast cancer populations [30], and traumatic brain injury [33].

In axSpA, few studies of directly elicited EQ-5D data have been published, and as a consequence, economic models included in Health Technology Assessments (HTAs) of axSpA treatments have been based on EQ-5D utilities estimated from mapping exercises [19] using the EQ-5D-3L. For instance, three studies identified in the HERC Database of Mapping Studies [34] are all based on the EQ-5D-3L [21, 27, 35]. Two studies used simple linear regression statistical model mapping methods [21, 35], a feature common to all previous NICE assessments of biologic therapies in axSpA [19]. A third study found that other direct mapping methods using bespoke adjusted limited dependent variable mixture models (ALDVMMs) and indirect response mapping offered a better fit to the observed data than simple linear regression [27]. To our knowledge, there are currently no published mapping algorithms that estimate EQ-5D-5L utilities from BASDAI or BASFI scores. This paper provides the first mapping algorithms from BASDAI/BASFI to the EQ-5D-5L instrument for axSpA. Our study is also the first mapping study that uses a UK data set based on data from the British Society for Rheumatology Biologics Register in AS (BSRBR-AS) which includes observations that come from England, Scotland and Wales (with the largest contribution from England, n = 4595, and n = 382, n = 145, respectively). We applied the current England published tariff value set which has been used in a number of recent studies in the mapping literature [e.g., 25, 3638], although we acknowledge that NICE currently recommend mapping to the 3L using the van Hout crosswalk to convert the EQ-5D-5L responses to EQ-5D-3L scores.

Methods

Study dataset

Patient-level data were collected over a 5-year period from December 2012 to June 2017 as part of a UK-wide prospective observational cohort study – the British Society for Rheumatology Biologics Register in AS (BSRBR-AS). For a full description of the study, see Macfarlane et al. [39]. The study included patients with axSpA who were naïve to biologic therapy at the time of recruitment. Those about to commence anti-TNF biologic therapy entered a “biologic” sub-cohort with other patients assigned to a “non-biologic” sub-cohort. The primary objective of the study was to determine the long-term safety of biologic treatment. Secondary objectives were to assess differences in malignancy, serious comorbidity, all-cause mortality, and impact on specific clinical domains (physical and mental health and QoL) including work outcomes between biologic and non-biologic cohorts. Patients were followed-up for up to 5 years. Data were obtained at baseline and at standard clinical follow-up visits – at 3, 6, and 12 months and then annually for the biologic cohort, and annually for the non-biologic cohort. Each follow-up involved the collection of clinical and self-report data (BASDAI [17], BASFI [18], and the EQ-5D-5L [40, 41]. Patients were potentially eligible for the BSRBR-AS study if they were aged ≥ 16 years and met the Assessment of SpondyloArthritis Society (ASAS) criteria for radiographic and non-radiographic axSpA.

Outcome measures

EQ-5D-5L

The EQ-5D-5L is a generic HRQoL instrument comprising five dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) [41]. There are five-levels of the perceived problems per dimension (no problems, slight problems, moderate problems, severe problems, and extreme problems). Responses to the questionnaire were scored using the English EQ-5D-5L value set [42] which ranges from an ‘index score’ of –0.285 (state 55555) to 1 (state 11111). A value of 1 represents full/perfect health, a value of 0 is considered equivalent to being dead, and values can also be negative, representing a state worse than death. There is also a gap between full health and the next feasible health state value of 0.950, which is referred to as the truncation point [25, 30]. This is the highest possible value generated by the EQ-5D-5L instrument that is not represented by full health. The lower limit for the EQ-5D-5L is − 0.285.

BASDAI

The BASDAI is a self-reported instrument consisting of six questions focusing on five major symptoms of the disease over the past week (fatigue, spinal and hip pain, swelling and pain in peripheral joints, enthesitis, duration and severity of morning stiffness) [17]. The BASDAI consists of a 1 – 10 scale (1 = no problem and 10 = the worst problem). To give each symptom equal weighting, the mean (average) of the two scores relating to morning stiffness is taken. The resulting 0 to 50 score is divided by 5 to give a final 0 – 10 BASDAI score.

BASFI

The BASFI is a self-assessed instrument represented as a mean of 10 questions from a visual analogue scale (ranging from 0 being easy and 10 being impossible), 8 of which relate to the person’s degree of functional limitation and 2 of which relate to a subject’s ability to cope with everyday life/tasks [18]. Each question is answered on a 10 cm horizontal visual analogue scale, the mean of which gives the BASFI score (0–10). An increase in BASFI score indicates a worsening condition.

Statistical analysis

Conceptual overlap

The estimation of a mapping algorithm relies on conceptual overlap between the source measure/s (BASDAI/BASFI) and the target measure (EQ-5D-5L). No overlap in content implies that mapping is unlikely to capture the relationship between the measures to estimate health utilities [43]. Spearman rank correlation coefficients were used to test the correlations between the BASDAI/BASFI total scores and EQ-5D-5L index scores or item responses/domains, to investigate the degree of conceptual overlap.

Model development

Our study followed published recommendations of mapping best practice [3, 44,45,46]. Generally, there are two broad approaches to mapping: direct mapping, which models the EQ-5D index values using regression models, and indirect mapping, also referred to as response mapping, which models responses to each item of EQ-5D and then calculates the predicted utilities as a separate second step. We tested both approaches. We also included linear regression for comparative purposes with these two methods.

In the direct mapping approach, adjusted limited dependent variable mixed models (i.e., direct mapping models) were implemented using the publicly available Stata command “aldvmm” [47]. This method for estimating EQ-5D has been previously implemented by Hernández et al. [e.g., 28, 29], who combined bespoke distributions in a mixture model. These include a discrete element using multinomial logit models for the probability of component (or latent class) membership, including a component representing full health. Using multiple components in a mixture model allows us to compare the multimodal properties of the distribution. The EQ-5D-5L does not show a (single) normal distribution and so it is important to be able to accurately estimate this unusual distribution. The ALDVMM method limits the underlying distribution which is limited at both ends, with a gap and allows a mass of observations at one end like a Tobit model. The mixture of several of these allows non-normal distributions to be approximated.

By limiting the dependent variable, the ALDVMM prevents prediction below -0.285 or above 1. It also takes into account the next feasible health state (i.e., to mirror feasible values in the tariff). The aldvmm Stata function has extra options including permitting the user to specify the next feasible value after full health for the target utility instrument (i.e. the “truncation point,” thus creating the typical gap seen in PBMs). There is also the possibility to specify no truncation and therefore allow each component of the mixture model to be fully continuous up to the highest feasible value of 1 for full health [25, 30]. This modelling approach has also been successfully applied in previous mapping studies (to the EQ-5D-3L) in a range of settings, including axSpA, and RA populations in the UK setting [27, 30, 31].

We tested models with different numbers of components. In particular, we considered models with three and four separate components, informed on the basis of existing mapping literature [27,28,29,30]. We further compared different numbers of components in the mixture models with and without a specified gap between full health and the next feasible value.

In the response mapping approach, ordered probit (OPROBIT) and generalised ordered probit (GOPROBIT) models were estimated for each dimension/domain of the EQ-5D-5L to predict the probabilities of a given response level. We then calculated the expected EQ-5D-5L scores on the basis of the probabilities of each of the possible 3125 health states as a second step. This modelling approach has been successfully applied to the EQ-5D-3L previously in AS [27] and RA populations in the UK setting [29, 31].

All analyses were undertaken with STATA v15. Models were estimated using maximum likelihood. Due to individuals contributing multiple observations, robust standard errors (and their reported p values) were estimated to take account of the repeated observations, similar to previous approaches [27]. In terms of model specification, we considered BASDAI, BASFI, and age, as potential independent variables (and squared terms) in all models, as these are the most common covariates which have been previously included in published mapping models using the EQ-5D-3L [19, 27].

Assessing model performance

Good mapping practice suggests that mapping algorithms should, where possible, be estimated in an ‘estimation sample’ and then predictions should be made in an external ‘validation sample’ [44]. Predicted scores are then compared with actual observed scores to assess model performance. In our study however, no such suitable external data set was available and therefore we used the full data (5122) to estimate and validate model predictions. This approach is consistent with the approach used in the previous mapping study using the EQ-5D-3L in AS [27].

To compare results across models/ assess predictive ability we considered different measures of goodness-of-fit statistics in line with good mapping best practice [3, 44,45,46]. These comprised Akaike’s and Bayesian Information Criteria (AIC/BIC), overall mean estimates, mean error (ME), mean absolute error (MAE), and root mean squared error (RMSE), as well as considered visual representations of model fit. We plotted the means of the predicted values of EQ-5D-5L with the mean observed values, across the range of disease severity. Also, for those settings in which analysts wish to use the models to simulate individual level EQ-5D data, rather than generate expected (e.g., mean cohort) EQ-5D values, we then additionally compared the simulated EQ-5D-5L data for the preferred model with the original actual/observed data. This additional step allows assessment of how well the chosen model will estimate any uncertainty in the model. This further level of model validation is important, as often cost-effectiveness analyses using a long-time horizon are performed by simulating many hypothetical, individual patients. In this situation, the analyst requires statistical models to estimate EQ-5D scores for these individuals. The simulated data are produced by incorporating not only the explanatory variables for each patient but also the random error term(s) for the statistical model. To illustrate the predictive accuracy in terms of uncertainty of the preferred model, we simulated 1000 data points from the preferred model for each of the observations in the BSRBR-AS dataset and then plotted the cumulative distribution function (CDF).

Models were ranked according to their ME, MAE, and RMSE, such that each model had a set of three rankings. The three rankings were summed to calculate an overall ranking. The lower the overall ranking, the better the performance of the model, i.e., thus, in principle, the best performing one model would be the lowest value in the overall ranking results.

To enable future use in economic evaluations, an Excel tool to implement selected algorithms was produced. Also, variance–covariance matrices were included with the spreadsheet tool for the purpose of probabilistic sensitivity analysis [3, 44,45,46].

Results

Descriptive statistics

The BSRBR-AS mapping dataset of patients had complete BASDAI and BASFI and complete EQ-5D-5L data. There were no patients excluded from the current mapping study. This included a total of 5122 observations with complete information on BASDAI, BASFI and EQ-5D-5L from 1965 patients. Patients’ responses spanned the full BASDAI and BASFI values. For the EQ-5D-5L 4.4% (223/5122) of observations were at full health (i.e., values = 1.0) and 2.8% (144/5122) of observations were negative. Figure 1 shows a histogram of the distribution of EQ-5D-5L index values/scores, exhibiting several of the usual characteristics associated with this measure. First there is a mass of observations at 1. Second, there is a gap (where no EQ-5D values are possible) between these observations and those for any level of impairment, e.g., the gap in values between 1 and 0.950 (next best health state value). The data show a large number of observations clustered around the value of 0.95, specifically: 0.2% of observations had values of 0.95 (n = 11); 0.3% of 0.942 (n = 17); 11.8% of 0.937 (n = 606), and 2.4% (n = 124) were in the range 0.90 < 0.924. In addition, there is a multi-modal distribution (at least 2 peaks).

Fig. 1
figure 1

Distribution of EQ-5D-5L values (Total sample, N = 5122)

Patient characteristics and summary statistics are reported in Table 1. Overall, the mean (SD) age was 51.0 (14.5) years old and the majority of respondents were male (70.0%). The mean (SD) BASDAI and BASFI scores were 4.3 (2.5) and 4.4 (2.9), respectively. The mean EQ-5D value was 0.69 (0.26).

Table 1 Sample characteristics

Table 2 presents the bivariate correlation coefficients between total scores and domains of the EQ-5D-5L and BASDAI/BASFI scores. Generally, there appeared to be ‘high’ (negative) and significant correlation between EQ-5D and BASDAI and BASFI scores (− 0.7897 and − 0.8016 respectively, p < 0.0001). The correlation was negative because better scores are indicated by higher EQ-5D and lower BASDAI/BASFI scores. Correlations between individual EQ-5D domains and BASDAI and BASFI were ‘moderate’ to ‘high’ (positive) and significant (range 0.4351 to 0.7924, p < 0.0001). The domain correlations were positive because better scores are indicated by lower BASDAI/BASFI scores and lower EQ-5D domain level responses. From a qualitative perspective, the mobility, usual activities, and self-care domains on the EQ-5D-5L would appear to look the most similar/most closely related to the BASFI 10 questions. For the BASDAI 10 questions the pain and discomfort EQ-5D-5L domain look the most similar to each other. Notably, neither of the BASDAI/BASFI instruments include questions related to mental health similar to the anxiety and depression domain of the EQ-5D-5L (the lowest correlation for both BASDAI/BASFI).

Table 2 Spearman’s correlation coefficients between EQ-5D-5L (total score and 5 domains), BASDAI, and BASFI scores

Linear model

The best linear model included squared terms as explanatory variables. In terms of model fit (Table 3), the linear model had generally poorer performance, for instance it had higher RMSE and MAE compared to other model specifications, although notably it had the lowest ME and it performed slightly better than the mixture models with two components (see below). The linear model showed characteristic underestimation of the observed mean EQ-5D values at the extremes of the distribution of disease severity in both plots (Fig. 3 for BASDAI/BASFI).

Table 3 Model performance for the response mapping and mixture models (n = 5122)

Response models

We estimated two response mappings to the EQ-5D-5L, using ordered probit (OPROBIT) and generalised ordered probit (GOPROBIT) models. Table 3 presents the model fit statistics. Overall, the ME and RMSE are smaller in the OPROBIT model (including the explanatory variables BASDAI, BASFI, and age plus squared terms) compared to the GOPROBIT model (reduced). It is notable that the GOPROBIT model (including squared terms) generated a large number of negative predictive probabilities for some domain responses, and although the total sum of probabilities across the 5- response levels equalled 1.0, this model specification was considered unreliable and so was not considered further. On the other hand the GOPROBIT model (reduced) has a lower MAE and AIC (but a higher BIC). Figure 2 shows mean predicted versus mean observed values for response mappings using the overall BASDAI/BASFI scores. There is not much to choose between the different response mapping model types/specifications. All of the response mappings appear to produce slightly higher values at higher BASDAI/BASFI levels when patients are in poorer/worse health. On the other hand, all response mappings, to some degree tend to slightly underestimate values at lower BASDAI/BASFI levels as seen by the BASDAI plot. This is also apparent for mid- to mid-upper range BASDA/BASFI levels, as seen by the BASFI plot for scores in the range 5 to 8.

Fig. 2
figure 2

Mean EQ-5D-5L values vs BASDAI score and BASFI score for observed versus predicted data. BASDAI, Bath Ankylosing Spondylitis Disease Activity Index; BASFI, Bath Ankylosing Spondylitis Functional Index; EQ-5D-5L, EuroQol five-dimensional questionnaire. The BADAI and BASFI plots are constructed based on 10 classes/groups (total n = 5122). For the BASDAI plot the number of observations contained in each group from the lowest to highest BASDI score are: 410, 696, 752, 577, 599, 584, 602, 470, 275, and 157. For the BASFI plot the number of observations contained in each group from the lowest to highest BASFI score are: 659, 763, 599, 511, 453, 478, 439, 422, 421, and 377

Adjusted limited dependent variable models

We attempted to estimate ALDVMMs with between two and four components and using BASDAI/BASFI overall scores both within the components and as determinants of component membership. We also explored model specifications modelling the gap/truncation point between full health and the next feasible value (i.e., 0.950) included/excluded. Table 3 presents comparisons of the summary measures of the fit statistics. The model with three components, with the gap between full health and the next feasible value included along with squared terms performed the best when considering AIC and BIC statistics. However, model specifications with three and four components that did not include this gap have lower error measures (in terms of ME, MAE and RMSE) than three component reduced models including this gap. The three and four components ALDVMMs including squared terms (followed by the four components reduced model) with no truncation point also outperforms the best performing response mapping models (OPROBIT including squared terms) with better rankings on MAE, RMSE criteria. To give a visual sense of model fit for the respective models, plots of the estimated/predicted means of the best performing ALDVMM models compared with the observed mean across the range of BASFI and BASDAI severity are shown in Fig. 2. The four component model including squared terms and no truncation point appears to predict the observed data a little better than the four component ALDVMM (reduced and no gap) and the three component model (including squared terms and no gap) at most of the BASDAI/BASFI scores– though all models tend to overestimate values for individuals scoring extremely poor values on the BASDAI/BASFI instrument. All model specifications that formally included the gap between full health and the next possible health state value performed somewhat less well compared to those that did not.

Figure 3 displays the CDF for the best performing mixture model (and the preferred model overall), the ALDVMM-4 (including squared terms) model without a gap.

Fig. 3
figure 3

Cumulative distribution function of observed and simulated EQ-5D-5L index of the preferred 4 component mixture model (+ squared terms, no gap)

Overall, while the simulated data closely aligned to the original data that was distributed over most of the EQ-5D range, the simulated data that were equal to 1 were however unrepresented. This had the impact of a slightly lower estimated mean EQ-5D 0.686 compared to the observed mean of 0.693. The variance was mostly preserved however and was 0.068 in the simulated data versus 0.066 in the original data. This use of simulated data compared with observed data shows that the preferred mapping model can appropriately reflect uncertainty in the majority of utility responses well, however the uncertainty in the upper end of the EQ-5D (responses at full health) is estimated less accurately. Therefore whilst the use of the best ALDVMM mapping models can populate health states for a decision-analytic model with a good degree of accuracy, the algorithm might risk somewhat undervaluing/underestimating EQ-5D values at full health (1.0). This finding is different from previous studies and might in part be due to the smaller number of values equal to 1 found in the observed data. For example, the proportion of observations at full health has been reported in the range 14% to 30% [e.g., 25, 27, 30, 48].

The model fit statistics in Table 3 also suggest that the ALDVMMS (with either three or four components including squared terms, or four-component reduced with no gap) outperform the best performing response mappings using GOPROBIT (reduced) model or OPROBIT (including squared terms) (e.g., lowest RMSE).

The estimated parameters for the best ALDVMM models and response mappings are provided in the Supplementary Materials (Tables 1 and 2). The preferred ALDVMM and best response mapping algorithms estimated in this study can be implemented via Excel and these are provided as a spreadsheet tool in the Supplementary Materials Spreadsheet File 1.

Discussion

There are few published studies in axSpA that provide direct estimates of HRQoL from generic preference-based instruments such as the EQ-5D. Such estimates are critical to provide accurate information relating to the cost-effectiveness of new medicines or other interventions. An alternative solution that is extensively employed is the use of mapping from one measure, such as the BASDAI and BASFI, to a utility-based measure such as the EQ-5D.

The current study provides an easy to apply mapping algorithm for the best performing mixture model (four components and squared terms) which had acceptable goodness-of-fit (AIC/BIC) and precision (MAE, RMSE), allowing its use to predict utilities of the more recently developed EQ-5D-5L from the specific BASDAI/BASFI instruments in patients with AS. The MAE (0.09591), RMSE (0.13319) indicated model ALDVMM-4 (with squared terms and no gap) to provide the best fit of the data, the AIC was however higher than both ALDVMM-3 models that did not formally include this gap (Table 3: − 7215 vs − 7423 and − 7290, respectively). In all models the predicted errors were not uniform across the range of the EQ-5D-5L. Larger errors were generally most apparent for utilities reflecting the poorest health states (Fig. 2 plot of predicted versus observed values).

With the increasing evidence that mapping methods that are developed from linear regression models exhibit inferior statistical properties than those developed from alternative methods such as mixture models [25,26,27,28,29, 33], our study adds to the existing evidence base by comparing the statistical performance of response mapping models with ALDVMM mixture models. Using new primary data from a large longitudinal registry study of axSpA patients in the UK [39], we show that the relationship between EQ-5D-5L and BASDAI/BASFI responses can be effectively estimated using ALDVMM mixture models and response mapping models. Based on statistical fit criteria (Table 3), the response mapping models broadly offered comparable predictive performance to the mixture models, providing a reasonable fit relative to the observed EQ-5D-5L data.

Specifically, however, for the reasons outlined above, we suggest the four-component ALDVMM mixture model (including squared terms) is the preferred model with best overall fit to the EQ-5D-5L data (vs either the three-component with squared terms or four-component reduced models). Other mapping studies have been conducted using BASDAI/BASFI outcomes, however, these focused only on the estimation of EQ-5D-3L from BASDAI/BASFI scores [21, 27, 35] and only one investigated the performance of models other than linear regression using mixture models and response mappings [27].

There are some potential limitations to our study that should be considered. First, it would be preferable to assess the generalisability of the algorithms in another independent dataset [46], but such external data were not available when conducting this study. Further validation of our study results on external data sets could be conducted when such data sets become available.

Second, the dataset consists of observations from the entire UK, but tariffs from England are used [42] for the EQ-5D-5L. Research is ongoing to produce a UK wide value set for the EQ-5D-5L and will address the question of whether preferences of the UK population (i.e., including Scotland, Wales, and Northern Ireland) are consistent with values from England. Moreover, research is ongoing to create a robust EQ-5D-5L value set for use in the UK that NICE will recommend for future use in HTAs. It is therefore important to recognise that future EQ-5D-5L values may be subject to change, and that further research may be required once these values become available [49]. We note that mixture modelling between BASDAI/BASFI and EQ-5D-5L using the current valuation set for England offers a good model fit, but changes to valuation would change the parameters of this mapping model. Therefore, we also draw attention to the potential further usefulness of the response mapping algorithms, which are not dependent on any one country-specific value set.

Third, although the data used in this study span the full range of the BASDAI/BASFI and (majority) of the EQ-5D-5L scores, there are fewer observations at the higher end of the BASDAI/BASFI and EQ-5D-5L as well as the lower end of both instruments, although this is a limitation common to many mapping studies [27]. Fourth, although the sample size used to develop the mapping algorithms was relatively large (n = 5122), it may have affected the response mappings more as they require observations at all five levels of the EQ-5D domains. However, only a very small number of patients were choosing the ‘extreme problems’ level, which could potentially bias the estimation of the parameters and further limit the (response) model performance at these data points.

Weighed against this, in cohort decision models with health states not located at the extreme of poor health, bias from mapping would constitute only a negligible effect on estimated cost-effectiveness [44]. In individual patient-level simulations, it is recommended that uncertainty in the estimated mapping coefficients and their correlations is incorporated through probabilistic sensitivity analysis using the variance–covariance matrices and that individual-level variability is considered using the distributions of error terms – both provided in the excel tool. (and Supplementary Table 3).

Our study has several strengths. First, in addition to the more widely used direct mapping, this study has also conducted indirect response mapping to predict responses to each of the EQ-5D dimensions. A key advantage of this approach is that it allows different EQ-5D value sets to be applied, thus the reported mapping functions can be more widely applied by users from other countries. However, it should be noted that the generalisability of the indirect response mapping functions depends on whether axSpA patients from other countries will have a similar response pattern to patients in the UK. Further external validation is warranted. Second, the data are derived from a non-trial “real-world” sample that is likely to be nationally representative for most patients with axSpA in the UK. Furthermore, the sample size is also bigger than any previous mapping study in this population (and included participants from three nations in the UK-England, Wales, and Scotland instead of only one UK nation –Wales) [27]. Thus, the mapping algorithms developed in this study are likely to be generalisable to other axSpA patients.

The relationship between BASDAI/BASFI and EQ-5D-3L for use in axSpA has been considered in only a limited number of previous studies, most notably by Wailoo et al. 2015 [27], who found that response mapping and mixture models outperformed linear regression. However, to our knowledge no previous mapping study has researched the relationship between BASDAI/BASFI and EQ-5D-5L utilities. Our study is therefore the first that attempts to provide estimates for the calculation of the EQ-5D-5L as a function of BASDAI/BASFI in patients with axSpA when analysts have access only to BASDAI/BASFI scores of axSpA patients.

Conclusions

To our knowledge, this is the first study to develop mapping algorithms from the widely used BASDAI/BASFI measures to EQ-5D-5L utility values in patients with axSpA. The results showed that mixture models, and to a slightly lesser degree, response mapping provided reliable algorithms for predicting EQ-5D-5L utilities from BASDAI/BASFI scores. These algorithms can be used in applied cost-effectiveness analysis in axSpA where EQ-5D-5L is the target outcome of interest.

Further research using mixture models and different datasets, for example using data from national axSpA registries that include the EQ-5D could help to further develop and validate these mapping algorithms in patients with axSpA (by further pooling other larger datasets for instance). Other techniques in the mapping literature such as beta-binomial regression models might also be explored in future research. In addition, the indirect mapping instrument functions reported in this study for the EQ-5D-5L will further facilitate the calculation of EQ-5D-5L utility scores using other country-specific value sets. A user-friendly freely accessible Excel tool has been provided to assist analysis with the implementation of the best performing ALDVMM mapping algorithms and best performing response mapping model (available in the Appendix, Supplemental Material). Although it remains preferable to have health utilities data derived directly from administering the EQ-5D-5L, the mapping algorithms developed in this study can be used to inform the generation of reliable health utility estimates (from BASDAI/BASFI scores) in cost-effectiveness analyses of interventions for axSpA (e.g., clinical studies or to populate model-based economic evaluations), when only responses from the disease specific BASDAI/BASFI instruments have been collected.

References

  1. National Institute for Health and Care Excellence (NICE): Guide to the methods of technology appraisal 2013. Available at: https://www.nice.org.uk/process/pmg9/chapter/foreword. Accessed 26 Jan 2021

  2. Longworth, L., Rowen, D.: NICE DSU technical support document 10: the use of mapping methods to estimate health state utility values. London, NICE. 2011; [Cited 2014 Nov 13]; Available from: http://nicedsu.org.uk/wp-content/uploads/2016/03/TSD-10-mapping-FINAL.pdf. Accessed 26 Jan 2021

  3. Longworth, L., Rowen, D.: Mapping to obtain EQ-5D utility values for use in NICE health technology assessments. Value Health 16, 202–211 (2013)

    Article  Google Scholar 

  4. Tosh, J.C., Longworth, L.J., George, E.: Utility values in National institute for health and clinical excellence (NICE) technology appraisals. Value Health 14(1), 102–109 (2011)

    Article  Google Scholar 

  5. Sieper, J., Braun, J., Rudwaleit, M., Boonen, A., Zink, A.: Ankylosing spondylitis: an overview. Ann. Rheum. Dis. 61, iii8–iii18 (2006)

    Article  Google Scholar 

  6. Özgül, A., Peker, F., Taskaynatan, M.A., Tan, A.K., Dincer, K., Kalyon, T.A.: Effect of ankylosing spondylitis on health-related quality of life and different aspects of social life in young patients. Clin. Rheumatol. 25, 168–174 (2006)

    Article  Google Scholar 

  7. Dean, L.E., Jones, G.T., MacDonald, A.G., Downham, C., Sturrock, R.D., Macfarlane, G.J.: Global prevalence of ankylosing spondylitis. Rheumatology (Oxford) 53(4), 650–657 (2014). https://doi.org/10.1093/rheumatology/ket387

    Article  Google Scholar 

  8. Husain, M.H., Brophy Cooksey, R., et al.: The cost of ankylosing spondylitis to the UK NHS. Rheumatology 53(1), i138 (2014). https://doi.org/10.1093/rheumatology/keu115.005

    Article  Google Scholar 

  9. Cooksey, R., Husain, M.J., Brophy, S., Davies, H., Rahman, M.A., Atkinson, M.D., et al.: The cost of ankylosing spondylitis in the UK using linked routine and patient-reported survey data. PLoS ONE 10(7), e0126105 (2015). https://doi.org/10.1371/journal.pone.0126105

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  10. Blanch, C., Comellas, M., Prada, C., Lizan, L.: Economic burden of ankylosing spondylitis in Europe. A systematic review of the literature. Value Health 19(7), A541–A542 (2016)

    Article  Google Scholar 

  11. Macfarlane, G.J., Shim, J., Jones, G.T., Walker-Bone, K., Pathan, E.M., Dean, L.E.: Identifying persons with axial spondyloarthritis at risk of poor work outcome: results from the British society for rheumatology biologics register. J. Rheumatol. 46(2), 145–152 (2018)

    Article  Google Scholar 

  12. Gorman, J.D., Sack, K.E., David, J.C.: Treatment of ankylosing spondylitis by inhibition of tumour necrosis factor α. N. Engl. J. Med. 346, 1349–1356 (2001)

    Article  Google Scholar 

  13. Brophy, S., Davies, H., Dennis, M.S., et al.: Fatigue in ankylosing spondylitis: treatment should focus on pain management. Sem. Arthritis Rheum. 42, 361–367 (2013)

    Article  Google Scholar 

  14. Shim, J., Jones, G.T., Pathan, E.M.I., Macfarlane, G.J.: Impact of biological therapy on work outcomes in patients with axial spondyloarthritis: results from the British society for rheumatology biologics register (BSRBR-AS) and meta-analysis. Ann. Rheum. Dis. 77(11), 1578–1584 (2018)

    Article  Google Scholar 

  15. Shim, J., Dean, L.E., Karabayas, M., Jones, G.T., Macfarlane, G.J., Basu, N.: Quantifying and predicting the effect of anti-TNF therapy on axSpA-related fatigue: results from the BSRBR-AS registry and meta-analysis. Rheumatology 59(11), 3408–3414 (2020)

    CAS  Article  Google Scholar 

  16. Macfarlane, G.J., Rotariu, O., Jones, G.T., Pathan, E., Dean, L.E.: Determining factors relating to poor quality of life in patients with axial spondylitis: results from the British society for rheumatology biologics register (BSRBR-AS). Ann. Rheum. Disease 79(2), 202–208 (2020)

    CAS  Article  Google Scholar 

  17. Garret, S., Jenkinson, T., Kennedy, L.G., Whitelock, H., Gaisfor, P., Calin, A.: A new approach to defining disease status in ankylosing spondylitis. The bath ankylosing spondylitis disease activity index. J. Rheumatol. 21, 2286–2291 (1994)

    Google Scholar 

  18. Calin, A., Garrett, S., Whitelock, J., et al.: A new approach to defining functional ability in ankylosing spondylitis: the development of the bath ankylosing spondylitis functional index. J. Rheumatol. 21, 2281–2285 (1994)

    CAS  PubMed  Google Scholar 

  19. Corbett, M., et al.: Tumour necrosis factor-α inhibitors for ankylosing spondylitis and non-radiographic axial spondyloarthritis: a systematic review and economic evaluation. Health Technol. Assess. 20(9), 1 (2016)

    Article  Google Scholar 

  20. Botteman, M.F., Hay, J.W., Luo, M.P., et al.: The cost-effectiveness of etanercept in patients with severe ankylosing spondylitis in the UK. Rheumatology 46, 1320–1328 (2007)

    CAS  Article  Google Scholar 

  21. Ara, R.M., Reynolds, A.V., Conway, P.: The cost-effectiveness of etanercept in patients with severe ankylosing spondylitis in the UK. Rheumatology 46(8), 1338–1344 (2007)

    CAS  Article  Google Scholar 

  22. Kobelt, G., Sobocki, P., Sieper, J., Branu, J.: Comparison of the cost-effectiveness of infliximab in the treatment of ankylosing spondylitis in the United Kingdom based on two different clinical trials. Int. J. Technol. Assess. Health Care 23, 368–375 (2007)

    Article  Google Scholar 

  23. Neilson, A.R., Sieper, J., Deeg, M.: Cost-effectiveness of etanercept in patients with severe ankylosing spondylitis in Germany. Rheumatology (Oxford) 49(11), 2122–2134 (2010)

    Article  Google Scholar 

  24. Armstrong, N., Joore, M., van Asselt, T., et al.: Golimumab for the treatment of ankylosing spondylitis: a NICE single technology appraisal. Pharmacoeconomics 31, 415–425 (2013)

    Article  Google Scholar 

  25. Gray, L.A., Hernández Alava, M., Wailoo, A.J.: Development of methods for the mapping of utilities using mixture models: mapping the AQLQ-S to the EQ-5D-5L and the HUI3 in patients with asthma. Value Health 21(6), 748–757 (2018). https://doi.org/10.1016/j.jval.2017.09.017. (Epub 2017 Dec 14)

    Article  PubMed  PubMed Central  Google Scholar 

  26. Mukuria, C., Rowen, D., Harnam, S., Rawdin, A., Wong, R., Ara, R., Brazier, J.: An updated systematic review of studies mapping (or cross-walking) measures of health-related quality of life to generic preference-based measures to generated utility values. Appl. Health Econ. Health Policy 17(3), 295–313 (2019). https://doi.org/10.1007/s40258-019-00467-6

    Article  PubMed  Google Scholar 

  27. Wailoo, A., Hernandez, M., Phillips, C., Brophy, S., Siebert, S.: Modelling health state utility values in ankylosing spondylitis. Value Health 18(4), 425–431 (2015)

    Article  Google Scholar 

  28. Hernández Alava, M., Wailoo, A.J., Ara, R.: Tails from the peak district: adjusted limited dependent variable mixture models of EQ-5D questionnaire health state utility values. Value Health 15(3), 550–561 (2012)

    Article  Google Scholar 

  29. Hernández Alava, M., Wailoo, A.J., Ara, R.: A comparison of direct and indirect methods for the estimation of health utilities from clinical outcomes. Med. Decis. Making 34, 919–930 (2013)

    Article  Google Scholar 

  30. Hernández Alava, M., Wailoo, A., Pudney, S., Gray, L., Manca, A.: Mapping clinical outcomes to generic preference-based outcome measures: development and comparison of methods. Health Technol. Assess. 24(34), 1 (2020)

    Article  Google Scholar 

  31. Hernández Alava, M., Wailoo, A., Wolfe, F., Michaud, K.: The relationship between EQ-5D, HAQ and pain in patients with rheumatoid arthritis. Rheumatology 52(5), 944–950 (2013)

    Article  Google Scholar 

  32. Hernández-Alava, M., Pudney, S.: Econometric modelling of multiple self-reports of health states: the switch from EQ-5D-3L to EQ-5D-5L in evaluating drug therapies for rheumatoid arthritis. J. Health Econ. 55, 139–152 (2017). https://doi.org/10.1016/j.jhealeco.2017.06.013. (Epub 2017 Jul 4)

    Article  PubMed  PubMed Central  Google Scholar 

  33. Ward Fuller, G., Hernandez, M., Pallot, D., Lecky, F., Stevenson, M., Gabbe, B.: Health state preference weights for the glasgow outcome scale following traumatic brain injury: a systematic review and mapping study. Value Health 20(1), 141–151 (2017). https://doi.org/10.1016/j.jval.2016.09.2398. (Epub 2016 Dec 28)

    Article  PubMed  PubMed Central  Google Scholar 

  34. Dakin, H., Abel, L., Burns, R., Yang, Y.: Review and critical appraisal of studies mapping from quality of life or clinical measures to EQ-5D: an online database and application of the MAPS statement. Health Qual. Life Outcomes 16, 31 (2018). https://doi.org/10.1186/s12955-018-0857-3

    Article  PubMed  PubMed Central  Google Scholar 

  35. Mlcoch, T., Sedova, L., Stolfa, J., et al.: Mapping the relationship between clinical and quality-of-life outcomes in patients with ankylosing spondylitis. Expert Rev. Pharmacoecon. Outcomes Res. 17(2), 203–211 (2017)

    Article  Google Scholar 

  36. Lamu, A.N.: Does linear equating improve prediction in mapping? Crosswalking MacNew onto EQ-5D-5L value sets. Eur. J. Health Econ. 21(6), 903–915 (2020). https://doi.org/10.1007/s10198-020-01183-y. (Epub 2020 Apr 16. PMID: 32300999; PMCID: PMC7366565)

    Article  PubMed  PubMed Central  Google Scholar 

  37. Wijnen, B.F.M., Mosweu, I., Majoie, M.H.J.M., Ridsdale, L., de Kinderen, R.J.A., Evers, S.M.A.A., McCrone, P.: A comparison of the responsiveness of EQ-5D-5L and the QOLIE-31P and mapping of QOLIE-31P to EQ-5D-5L in epilepsy. Eur. J. Health Econ. 19(6), 861–870 (2018). https://doi.org/10.1007/s10198-017-0928-0. (Epub 2017 Sep 4. PMID: 28871490; PMCID: PMC6008365)

    Article  PubMed  Google Scholar 

  38. Moore, A., Young, C.A., Hughes, D.A.: Mapping ALSFRS-R and ALSUI to EQ-5D in patients with motor neuron disease. Value Health 21(11), 1322–1329 (2018). https://doi.org/10.1016/j.jval.2018.05.005. (Epub 2018 Jul 26 PMID: 30442280)

    Article  PubMed  Google Scholar 

  39. Macfarlane, G.J., Barnish, M.S., Jones, E.A., et al.: The British society for rheumatology biologics register in ankylosing spondylitis (BSRBR-AS) study: protocol for a prospective cohort study of the long-term safety and quality of life outcomes of biologic treatment. BMC 16, 347 (2015)

    Google Scholar 

  40. EuroQol Group: A new facility for the measurement of health-related quality of life. Health Policy 16, 199–208 (1990)

    Article  Google Scholar 

  41. Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., et al.: Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual. Life Res. 20(10), 1727–1736 (2011)

    CAS  Article  Google Scholar 

  42. Devlin, N.J., Shah, K.K., Feng, Y., Mulhern, B., van Hout, B.: Valuing health-related quality of life: an EQ-5D-5L value set for England. Health Econ. 27(1), 7–22 (2018)

    Article  Google Scholar 

  43. Round, J., Hawton, A.: Statistical alchemy: conceptual validity and mapping to generate health state utility values. PharmacoEconomics Open (2017). https://doi.org/10.1007/s41669-017-0027-2

    Article  PubMed  PubMed Central  Google Scholar 

  44. Wailoo, A.J., Hernandez-Alava, M., Manca, A., Mejia, A., Ray, J., Crawford, B., Botteman, M., Busschbach, J.: Mapping to estimate health-state utility from non–preference-based outcome measures: an ISPOR good practices for outcomes research taskforce report. Value Health 20, 18–27 (2017)

    Article  Google Scholar 

  45. Ara, R., Rowen, D., Mukuria, C.: The use of mapping to estimate health state utility values. Pharmacoeconomics 35(S1), 57–66 (2017)

    Article  Google Scholar 

  46. Petrou, S., Rivero-Arias, O., Dakin, H., Longworth, L., Oppe, M., Froud, R., Gray, A.: The MAPS reporting statement for studies mapping onto generic preference-based outcome measures: explanation and elaboration. Pharmacoeconomics 33(10), 993–1011 (2015)

    Article  Google Scholar 

  47. Hernández Alava. M., Wailoo. A: ALDVMM: a command for fitting adjusted limited dependent variable mixture models to EQ-5D. The Stata Journal 2015. https://www.sheffield.ac.uk/polopoly_fs/1.464135!/file/ALDVMM_forthcoming_Stata_Journal.pdf. Accessed 26 Jan 2021

  48. Khan, I., Morris, S., Pashayan, N., Matata, B., Bashir, Z., Maguirre, J.: Comparing the mapping between EQ-5D-5L, EQ-5D-3L and the EORTC-QLQ-C30 in non-small cell lung cancer patients. Health Qual. Life Outcomes 12(14), 60 (2016). https://doi.org/10.1186/s12955-016-0455-1

    Article  Google Scholar 

  49. National Institute for Health and Care Excellence (NICE). Position statement of the use of the EQ-5D-5L value set for England (updated October 2019). https://www.nice.org.uk/about/what-we-do/our-programmes/nice-guidance/technology-appraisal-guidance/eq-5d-5l. Accessed 26 Jan 2021

Download references

Acknowledgements

We are grateful to the staff of the British Society for Rheumatology Biologics Register in Axial Spondyloarthritis. Claudia Zabke, Maureen Heddle, Nafeesa Nazlee and Barry Morris, and to the recruiting staff at the clinical centres, details of which are available at: https://www.abdn.ac.uk/iahs/research/epidemiology/spondyloarthritis.php#panel1011.

Funding

The British Society for Rheumatology Biologics Register in Ankylosing. Spondylitis (BSRBR-AS) is funded by the British Society for Rheumatology (BSR), which in turn has received funding from the manufacturers of the biologic therapies included in the study (Abbvie, Pfizer and UCB). Pharmaceutical companies providing funds to BSR do not have a role in the oversight of the study, but they do receive advance notice of publications on which they can comment. They do not have access to the data collected but can request analyses of the data, for which additional funds are provided.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aileen R. Neilson.

Ethics declarations

Precis

Mixture models and response mapping can be used to crosswalk between BASDAI/BASFI and EQ-5D-5L to provide inputs for applied cost-effectiveness studies evaluating treatments in AxSpA.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 1029 KB)

Supplementary file2 (XLSX 262 KB)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Neilson, A.R., Jones, G.T., Macfarlane, G.J. et al. Generating EQ-5D-5L health utility scores from BASDAI and BASFI: a mapping study in patients with axial spondyloarthritis using longitudinal UK registry data. Eur J Health Econ (2022). https://doi.org/10.1007/s10198-022-01429-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10198-022-01429-x

Keywords

  • Mixture models
  • Utility mapping
  • Response mapping
  • EQ-5D-5L
  • BASDAI/BASFI
  • Axial spondyloarthritis