Abstract
Objective
This article presents alternative parental health spillover quantification methods in the context of a randomised controlled trial comparing family therapy with treatment as usual as an intervention for self-harming adolescents, and discusses the practical limitations of those methods.
Methods
The trial followed a sample of 754 participants aged 11–17 years. Health utilities are measured using answers to the EuroQoL 5 Dimensions 3 Levels (EQ-5D-3L) for the adolescent and the Health Utility Index (HUI2) for one parent at baseline, 6 and 12 months. We use regression analyses to evaluate the association between the parent’s and adolescent’s health utilities as part of an explanatory regression model including health-related and demographic characteristics of both the adolescent and the parent. We then measure cost-effectiveness over a 12-month period as mean incremental cost-effectiveness ratios using various spillover quantification methods. We propose an original quantification based on the use of a household welfare function along with an equivalence scale to generate a health gain within the family to be added to the adolescent’s quality-adjusted life-year gain.
Results
We find that the parent’s health utility increased over the duration of the trial and is significantly and positively associated with adolescent’s health utility at 6 and 12 months but not at baseline. When considering the adolescent’s health gain only, the incremental cost-effectiveness ratio is £40,453 per quality-adjusted life-year. When including the health spillover to one parent, the incremental cost-effectiveness ratio estimates range from £27,167 per quality-adjusted life-year to £40,838 per quality-adjusted life-year and can be a dominated option depending on the quantification method used.
Conclusion
According to the health spillover quantification method considered, the incremental cost-effectiveness ratios vary from within the National Institute for Health and Care Excellence (NICE) cost-effectiveness threshold range to not being cost-effective.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Parental health spillover varies with treatment arms and follow-up points, and is independent from the adolescent’s health improvement. |
Health spillover can be measured using a household welfare function along with an equivalence scale to generate a health gain within the family to be added to the patient’s quality-adjusted life-year gain. |
According to the health spillover quantification method considered, the incremental cost-effectiveness ratio varies from being cost-effective to not being cost-effective. |
1 Introduction
Self-harm is commonly defined in the UK and Europe as any form of non-fatal self-poisoning or self-injury (such as cutting, taking an overdose, hanging, self-strangulation, jumping from a height and running into traffic), regardless of the motivation or degree of intention to die. This definition would include US definitions of non-suicidal self-injury and suicidal behaviour. Self-harm in adolescents is a major public health issue with one in ten adolescents self-harming each year [1]. Individuals with mental disorders are heavy users of public health services and require emotional support and care from their family [2, 3]. Their disorders are likely to affect other family members’ health and own healthcare needs, especially because individuals with mental health conditions face elevated rates of all-cause mortality and this places a huge burden of costs and life-years lost on the family and the community [4].
It appears that the magnitude of spillovers on the health of other family members is the greatest in parents of ill children [5, 6]. Beyond the effect of caring for an ill child on parents’ health [7], treatments that are provided to a self-harming child may have various spillover effects for the family. Indeed, psychotherapeutic treatments such as family-based therapies are often used with self-harming adolescents; they rely on individuals’ relational network, involve parents, caregivers, brothers and sisters, or other close relatives and friends in the therapies to improve clinical outcomes [8], and typically aim at maximizing cohesion, attachment and support while moderating parental control [9]. Therapy sessions do not necessarily include all family members, but it is expected that they will have an impact beyond the identified patient.
Some prior economic evaluations of psychotherapeutic interventions in young people have examined the impact of the therapy on the adolescent/child patient and on relatives participating in the therapy. These studies collected parents or carers’ outcomes and used them as additional outcomes of interest in a cost-effectiveness analysis (CEA) [10,11,12], whilst only two studies combined child and parents’ outcomes. Bodden et al. [13] used a compound summary of anxiety-specific scores of the child, mother and father, as part of the sensitivity analyses. Their analysis measured the cost-effectiveness per anxiety-free family by including the costs related to the child and other family members’ anxiety as self-reported in cost diaries. Cottrell et al. [14] used the same data as this article over an 18-month follow-up and aggregated quality-adjusted life-years (QALYs) of the adolescent and one parent as a sum in a sensitivity analysis. Their application relied on the strong assumption that QALYs can be summed across individuals. This assumption has been used in other studies in child health [15] and is consistent with research showing benefits to other family members involved in mental health family treatment [16, 17]. However, such considerations require a more thorough discussion of the interdependence between the utility functions of the adolescent and the parent, and the most appropriate method to include the overall health benefits.
The National Institute for Health and Care Excellence (NICE) reference case underlines that the perspective on outcomes considers “all direct health effects, whether for patients or, when relevant, carers” [18]; however, there is no consensus on how these health effects should be measured and valued. Wittenberg and Posser [19] offered a summary of the evidence on the measurement and incorporation of health spillover of illness on family members or caregivers across health conditions, as a disutility. In their review, methods to measure spillovers included three different types: (1) a direct measure of disutility of family members; (2) a relative measure of family members’ utility with a comparison to a control group; or (3) an estimation of the utility of family members in a hypothetical scenario in which the patient is healthy or does not require caregiving.
In empirical economic evaluation studies, health spillovers have been included either as accrued health benefits [20,21,22] or as an estimated multiplier parameter, which adjusts the patient’s health gain with a spillover for the rest of a wider network (including parents, carers, spouses and other relevant individuals) [23, 24]. Whilst the first method uses a health-related quality of life (HRQoL) questionnaire and directly elicited utilities, the multiplier effect is based on a regression model using observational or primary data collection and consists of two multiplier effects.
In this article, we use data from a multi-centre, individually randomised controlled trial comparing family therapy (FT) with treatment as usual (TAU) as an intervention for self-harming adolescents aged 11–17 years [25] as a case study. Both the adolescent and one parentFootnote 1 reported their HRQoL as part of the trial across repeated follow-up points. We undertake a within-trial CEA incorporating parental health spillover effects using alternative quantification methods. We add to the growing literature in three ways. First, we investigate the association between the health utility of the parent and a self-harming adolescent as part of an explanatory regression model using the preference-based HRQoL scores of both the adolescent and one parent. Second, we present a comparative analysis of alternative spillover quantification methods as part of an economic evaluation, bringing together the dyadic and the regression-based perspectives. Finally, we discuss how health spillovers could be adjusted including benefits to the rest of the family using an equivalence scale (ES) to adjust parental health gain.
2 Self-Harm Intervention: Family Therapy (SHIFT) Trial Case Study
The self-harm intervention: family therapy (SHIFT) study was a randomised controlled trial conducted in local child and adolescent mental health services in Yorkshire, Greater Manchester and London for adolescents aged 11–17 years who had self-harmed twice. Participants were randomly allocated to receive FT or TAU. The objective of the trial was to assess whether FT would reduce the number of times the adolescents attended hospital with further self-harm. The trial results are reported elsewhere [14].
Personal characteristics were collected at baseline including the adolescent’s sex, age, and type and number of self-harm episodes, as well as the sex and age of their parent. Additional information was collected on the adolescent’s mental health using the Hopelessness Scale for Children [26], the parent’s emotion toward the adolescent using the Family Questionnaire [27], the parent’s viewpoint on the family atmosphere through the McMaster Family Assessment Device [28] and the parents’ General Health Questionnaire (GHQ-12) [29]. All these measurements are defined in Table 1. The adolescent’s HRQoL was measured by the EuroQoL 5 Dimensions 3 Levels (EQ-5D-3L) [30] whilst the parent’s HRQol was determined by the Health Utility Index (HUI2) [31, 32]. The original research proposal considered HUI2 as the HRQoL measure for both the parent and the adolescent following the NICE guidelines at the time [33, 34]. However, we carried out a pilot study [35] on a sample of 49 adolescents aged 11–18 years to test the ability of children to deal with the concepts and language used in the EQ-5D-3L and HUI2. We found that EQ-5D-3L had the least amount of missing data and presented limited problematic wording for that age group; therefore, the EQ-5D-3L was eventually used to measure the HRQoL of adolescents in the trial. However, the parents’ HRQoL instrument was not changed.
An adolescent’s responses to the EQ-5D-3L were converted into health-state utility scores using national tariff values [36]. Similarly, a parent’s responses to HUI2 were converted into health-state utility values [32, 37]. The area under the curve approach was used to calculate QALYs for the adolescent and the parent.
Resource use of health services was self-reported by the adolescent and/or his or her parent. Accident and emergency visits and inpatient stays of the adolescent were available from National Health Service digital records. Resource use was combined with national unit costs distinguishing, where possible, by a self-harm and not self-harm-related event leading to hospitalisation [38]. Psychotropic medication costs were calculated using trial medication records. The intervention costs were calculated separately for each treatment arm using information on the type and duration of the therapies sessions available from the trial records [14, 39].
Eight hundred and thirty-two adolescents and their parents were recruited in the trial (417 in TAU and 415 in FT). This article focuses on the first 12-month follow-up, thus discounting is not required. Missing utility scores and total health and hospital services costs at 6 and 12 months were imputed using multiple imputations via chained equations [40,41,42]. Imputations were based on a number of demographic and clinical predictors; the process is described elsewhere [39]. Missing utility (4%) and clinical scores (3%) at baseline were not imputed. The sample used in the main analysis is 731 adolescents and their parent (359 in TAU and 372 in FT). As part of the sensitivity analysis, the analysis was also carried out on the complete case sample; the sample reduced to 206 adolescents and their parent (73 in TAU and 133 in FT).
3 Methods
3.1 Association Between a Parent’s and a Self-Harming Adolescent’s Health
We first modelled the utility of the parent as a function of the adolescent’s HRQoL (utility) in the same period controlling for a number of adolescent and parent characteristics. There is no reason to believe that this association remains consistent over time; therefore, our approach extends prior research [7, 23] by investigating the relationship empirically at multiple follow-up points in the data as follows:
where Hit denotes the parent’s i health-related quality of life measured by the HUI2 index score at time t = 0, 1, 2 for baseline, 6 and 12 months; Hjt denotes the adolescent’s j HRQoL at time t measured by the overall EQ-5D-3L index score; Zj0 is a vector of baseline characteristics of the adolescent such as age, sex, type of self-harm event and total number of self-harm events; Ci0 is a vector of baseline characteristics of the parent such as sex and mental health measured by the GHQ-12; αt is the intercept, \(\beta_{1}^{t} , \ldots , \beta_{3}^{t}\) are the slope parameters and ɛit is the error term with \(\varepsilon_{i}^{t} \sim N(0,1)\). The distribution of the utility of the parent is skewed to the left, thus we estimate all regression models using Tobit models.
The estimated coefficients were similar to those from the ordinary least-squares regressions both in magnitude and sign. We initially ran Model 1 including demographic controls for both the adolescent (age, sex) and the parent (age). To account for the heterogeneity observed in adolescents’ parents, we subsequently ran Model 2 controlling for other adolescent characteristics (Hopelessness Scale for Children score, type of self-harm) and family characteristics from the parent’s perspective (Family Questionnaire, McMaster Family Assessment Device) as well as the parent’s GHQ-12. We supplemented this simplistic association analysis with a more causal understanding of the impact of a positive change in the adolescent’s health over time on a parent’s HRQoL in line with Bhadhuri et al. [43]. We included a binary variable, taking the value 1 if the adolescent’s EQ-5D-3L score improved between baseline and follow-up, but this parameter was not significant and did not impact on the results.Footnote 2
3.2 Parental Health Spillover in Cost-Effectiveness Analysis: Five Alternative Quantifications
The base-case CEA considers the incremental costs and QALYs associated with FT vs. TAU as an intervention for self-harming adolescents. We are interested in quantifying the health spillover effects to the parent in the CEA, which can be used as an extra QALY gain inflating the adolescent’s QALY gain. Using the regression model presented in Eq. (1) as a starting point, we suggest four alternative quantification methods to evaluate parental health spillover. We also consider a fifth quantification with a direct measurement of parental QALY gain using answers to the HUI2 index.
3.2.1 Relative Health Spillover (Quantification 1)
The estimated parameter \(\widehat{{\beta_{1}^{t} }}\) in Eq. (1) can be used to extract a spillover coefficient of an adolescent’s health utility on parents. Assuming policy makers are interested in accounting for broad health benefits independently of the treatment arm, the parameters \(\widehat{{\beta_{1}^{0} }}, \widehat{{\beta_{1}^{1} }}\) and \(\widehat{{\beta_{1}^{2} }}\) represent a utility gain for the parent at each time point, which can be transformed into a QALY gain using the area under the curve approach as follows:
If the relationship between the adolescent’s and parent’s HRQoL remains constant over time, the parameter \(\widehat{{\beta_{1}^{t} }}\) represents the full QALY gain, which is similar to what Al-Janabi et al. [24] called relative spillover.
3.2.2 Relative Health Spillover Per Treatment Arm (Quantification 2)
One might suggest that we should also account for the heterogeneity in the parental health spillover according to the treatment received, especially because parents are directly involved in the FT arm, but not systematically involved in TAU.Footnote 3 In this case, the parameter \(\widehat{{\beta_{1}^{t} }}\) will also vary by treatment arm. Let us consider the estimated parameter \(\widehat{{\beta_{1}^{t,FT} }}\), where \(FT = 0\) when Eq. (1) is run on the sample of adolescents receiving TAU and \(FT = 1\) when it is run on those receiving FT. Three estimated health spillover coefficients (one for each time point) within each treatment arm can be used to quantify a utility gain for the parent, and then transformed into a QALY gain as follows:
3.2.3 Absolute Health Spillover (Quantification 3)
Considering the primary outcome of the study was reducing repetitions of self-harm over 12 months, one could argue that measuring spillover coefficients according to the final primary outcome provides an absolute health spillover for the parent. Contrary to Quantification 1, Eq. (1) is now run separately on the sub-sample of adolescents who did not have a repeated self-harm at 12 months and on those who did self-harm again. The two sets of estimated health spillover coefficients \(\widehat{{\beta_{1}^{t,SH} }} {\text{with }}SH = \{ 0,1\}\) are used to generate an absolute QALY gain for the parent as follows:
3.2.4 Absolute Global Health Spillover Per Treatment Arm (Quantification 4)
The absolute QALY gain for the parent could additionally account for the heterogeneity in health spillover according to treatment. The health spillover is measured using the estimated coefficient \(\widehat{{\beta_{1}^{t,SH,FT} }}\) estimating Eq. (1) on four different sub-samples of adolescents.
3.2.5 Additive Accrued Health Benefits (Quantification 5)
Using prior empirical studies, [20,21,22] health spillover could also be measured using an additive approach where the QALY gain of each individual in the dyad adolescent/parent is independently calculated and then the two QALY gains are summed. Our case study uses two different HRQoL instruments for the adolescent and the parent. If HUIt represents the parent’s health state utility value at each time point, parent’s QALYs are calculated as follows:
It is worthwhile to note that we assume that the QALYs as generated from HUI2 or EQ-5D-3L are of the same nature and meaning, and can be summed even if they are generated for two different individuals and produced from different instruments. This assumption follows from the foundation of resource allocation decisions in health according to which QALY provides an equal valuation between individuals and healthcare interventions of health improvement, independently of the HRQoL instrument being used to measure quality of life.
3.3 Parental Health Spillovers in Cost-Effectiveness Analysis: A New Perspective
In addition to all possible quantification methods to account for parental health spillover outlined in the previous section, we propose an additional method. While in the context of the economic evaluation of meningitis vaccination, Al-Janabi et al. [23] proposed a unique health spillover estimate that was applied to each family member affected or a health spillover estimate according to their proximity to the patient, we believe that this would not be appropriate in our case study. Three arguments motivate our viewpoint.
First, a single utility value would deny the heterogeneity observed in parents’ characteristics at baseline and their potential to benefit over the duration of the study according to their level of engagement in the treatment, whether this is FT or TAU. From a clinical viewpoint, it would be expected that FT has an impact on other members of the family irrespective of whether those members attended the therapy sessions or whether there was any change in the self-harming adolescent. If therapy leads to those attending, behaving or communicating differently, this will inevitably impact others they relate to. The magnitude and even the direction of such impacts will vary from one family member to another, but cannot be ignored. Second, the treatment arm itself might impact on the parent’s health independently from the adolescent’s health improvement; in the SHIFT trial, for a number of secondary outcomes, caregivers reported significantly better outcomes than the adolescents [14]. Third, as part of a trial, several repeated observations of health utilities are available and it appears important to account for all the available repeated information when quantifying spillover.
These arguments would lead us to consider the additive approach (where the QALY gain of each individual in the dyad adolescent/parent is independently calculated) appealing. At the same time, it is important to ensure that such aggregation does not lead to a decision that deteriorates the health of the adolescent, or more generally, of the patient in the first place. There are clear value judgements about the priority assigned to the identified patient, who is judged the most important individual to benefit from a treatment, while the inclusion of health spillover effects for other individuals are of secondary purpose.
For this reason, we propose that health gains are aggregated at the household level if and only if the QALY gain for the patient is positive or equal to zero. When the QALY gain for the patient is positive, we need to identify a means of adjusting for the parental health spillover so that the patient’s health gain remains a priority for the healthcare decisions to be made. The concept of an equivalence scale (ES) as we will refer to from now on, has been used in economics to measure social welfare and adjusts the income of all household members accounting for the size of the household and the age of its members [44,45,46]. In our context, an ES would allow the adjustment of all health gains for the rest of the household as an additional individual equivalent QALY or utility gain where all the household members (including the patient) are accounted for. The ES transforms a distribution of observed QALY gains across heterogeneous household members into a household health gain. This adjusted health spillover can then simply be summed to the QALY gain of the patient in the CEA.
Following Buhmann et al. [44], let us consider that Q measures the adjusted health spillover as follows:
where hr equals the health spillover for each family relative r, R is the number of family relatives with an observed QALY or utility gain and a is the elasticity of the ES rate, which varies between 0 (when the health spillover is unadjusted and equivalent to a simple sum of the QALY gain available) and 1 (when a per capita QALY is used). The value of a is defined according to the importance given to the QALY gain of the family members beyond the patient (e.g. if a = 0, the family members are as important as the patient and this would be equivalent to quantification 5). In our alternative specifications, we consider five examples of quantification of health spillover using an ES where \(a = \left\{ {0, 0.3, 0.5, 0.8, 1} \right\}\).
4 Results
4.1 Regression Models
Descriptive statistics are presented in Table 2. At baseline, more than two thirds of the adolescents were female with about three self-harm episodes over the duration of the trial. Self-harm was caused by self-injury for over 70% of the adolescents with more than 50% reporting some problems with anxiety/depression. For parents, 86% were mothers with an average age of 42 years (see Table 3). Parent’s average GHQ-12 was 8.52 (standard deviation 5.38), which is within the distressed range (4–12) but lower than the level of psychological distress observed in a sample of caregivers of a dependent relative [47].
Table 4 shows the mean utility scores for adolescents and their parent at baseline, 6 and 12 months, overall and by treatment arm. For the adolescents, utility scores increase monotonically over the 12 months and regardless of the treatment arm. Differences in utility scores between arms were significant at 6 and 12 months favouring FT. The difference from baseline appears to be slightly larger in FT than in TAU (on average 0.145 vs. 0.095). The parent’s utility also shows an increase in the overall HUI2 score at 6 and 12 months from baseline; this increase however is much smaller than for the adolescent (on average 0.045 vs. 0.12) and is not significant when distinguished by treatment arm.
Table 5 presents the Tobit regression results of the parent’s HRQoL; the association between the parent’s and adolescent’s health varies across time points and model specifications. We find a significant and positive association with the parent’s health at 6 months and 12 months in Model 2 while in Model 1, the parent’s health is positively associated with the adolescent’s HRQoL at 6 months only. This is in line with prior studies on the experience of parents’ caregiving for an ill child [5, 7, 48], and carers of people with mental health disorders [3].
The parent’s HRQoL at every time point also appears to be negatively associated with a higher score of emotion within the family, of poor family functioning and of psychological distress as measured by GHQ-12, all three measured at baseline. The strong association between a parent’s utility and GHQ-12 has also been shown in other studies [49]. Furthermore, parent’s health is positively and significantly associated with an adolescent’s higher score of hopelessness; however, this association substantially reduces in magnitude and significance over time.
4.2 Spillover Effects in Cost-Effectiveness Analysis
Table 6 presents the incremental cost-effectiveness ratios (ICERs) and their respective probabilities of cost-effectiveness using the base-case analysis when only the adolescent’s QALY gain is considered along with the five regression-based alternative spillover quantificationsFootnote 4 and the ES-based spillover quantification with five alternative elasticity values. Costs used in the analysis are summarised in Table 10 of the “Appendix”. Because we did not collect healthcare costs for the parent, we note that the costs for each ICER are strictly identical and it is only the level of QALY gain that varies.
Results from the base-case analysis indicate that adolescents in FT incurred £1207 higher costs on average and gained 0.030 extra QALYs than the adolescents in TAU, which is equivalent to an extra 10.95 days of perfect health annually. The ICER from this analysis (£40,453 per QALY) is above the recommended threshold range specified for NICE decision making in England and Wales (£20,000–£30,000 per QALY gain), indicating that FT is unlikely to be cost-effective. When considering the relative parental health spillover independently of the treatment arm using quantification 1, the ICER is almost identical to the one obtained from the base-case analysis. However, when accounting for the direct involvement of the parents in the FT arm (quantification 2), parents and adolescents continue to incur higher costs on average but with 24.5 fewer days of perfect health (loss of 0.067 QALYs annually) than those in TAU and therefore indicating that FT is dominated by TAU.
The ICER remains above the nationally recommended threshold when we control for the absolute parental health spillover using the number of repeated self-harm events at 12 months (£40,838), implying that FT is not cost effective. If we further control for any heterogeneity in the absolute parental health spillover, FT is dominated by TAU with adolescents and parents in the FT arm incurring 54.8 fewer days of perfect health (loss of 0.150 QALYs annually) than those in the TAU arm. Any of the regression-based quantifications indicate that FT is unlikely to be cost effective. However, the ICER reduces to £27,167 per QALY when we simply sum the adolescent’s and parent’s QALYs (quantification 5), demonstrating a potential for FT to bring 16.1 extra days at full health annually for both the adolescent and the parent and a value within the NICE threshold range.
As expected, quantification 5 is equivalent to the quantification with an ES using an elasticity of a = 0. The value of the elasticity a directly impacts on the average QALY gains, and the higher the elasticity, the lower the cumulated QALY gain and thus the higher the ICER. For smaller values of the elasticity a (less than 0.5), the quantifications using an ES show an ICER within the NICE cost-effectiveness range. The probability of FT to be cost effective is higher when using an ES to quantify spillover than with regression-based spillover quantifications; at £20,000 it is between 16 and 28% with an ES vs. 0–7% with regressions. At £30,000, it respectively reaches 43–54% vs. 0–28%.
It is important to note that with any quantification method, both cost differences between FT and TAU and QALY differences are significant. The same analyses were performed on the complete case sample to test the sensitivity of the results to missing data imputations (see Table 11 of the “Appendix”). The ICER estimations for each spillover quantification are all larger (between £34,071 and £45,842) with broader standard deviations for both costs and QALYs. It is remarkable that the differences between quantifications present the same pattern as the main analysis.
5 Discussion
We showed that a parent’s HRQoL is associated with the health of a self-harming adolescent. We investigated how health spillover for the parent could be included in CEA using alternative quantifications based on estimated coefficients and QALY valuations. Sensitivity analyses revealed that the valuation technique had a considerable impact on the magnitude of the QALY and could change the inference about the most cost-effective alternative in a trial. We made two propositions in this article. Proposition 1 suggests that health gains are only aggregated at the household level when the QALY gain for the patient is positive or equal to zero. Proposition 2 suggests the use of an ES to convert a distribution of observed health spillover across other household members into an extra health gain to be added to the patient’s QALY gain. We illustrated the use of an ES with a set of alternative elasticity values. There are several advantages with the use of an ES. First, an ES has been widely used in the literature to measure household social welfare [44,45,46]. Second, health spillover measured either as a QALY gain from a utility score or a utility parameter generated from a regression model could be summed and transformed into an extra health gain using the ES. Third, the ES adapts to data availability and thus every family relative with observed health outcomes can be included. Finally, one could transform easily the ES to account for family members’ proximity to the patient including an individual weight in the same way it is achieved with income equivalence scales.Footnote 5 This methodological proposition will require further scrutiny in future research.
5.1 Limitations
Our study presents limitations. The trial study used two different HRQoL instruments to measure the adolescent and the parent’s quality of life. For the purpose of the spillover quantification, we assumed that utilities and QALYs generated from two different generic measures were of the same nature and meaning and could be combined. However, these two measures are quite different in descriptive content and in valuation technique. While the EQ-5D covers dimensions of physical, mental and general health and is valued with Time Trade-Off, HUI2 additionally considers impairments in vision, hearing, and dexterity and is valued using standard gamble and visual analogue scaling. Research has shown a moderate level of agreement between HRQoL measures in various condition-specific groups [50,51,52,53]. The assumption according to which the two preference-based measures can be combined in our spillover quantifications could potentially be biased. For example, if EQ-5D-3L tends to provide lower mean utility estimates than HUI2, this would imply for our study that quantification 5 and the ES quantification with a = 0 lead to an aggregation of health gains where the parent’s QALY gain from the intervention is relatively higher than for the adolescent’s (patient’s) QALY gain, and thus the patient is not the main beneficiary (though respecting proposition 1 ensures that the patient is the priority for the healthcare decision making). In this context, head-to-head comparisons between preference-based HRQoL instruments will be useful to develop potential measurement corrections to ensure comparability between utilities and QALYs when measuring health spillover.
Methodologically, the reverse correlation with a focus on the impact of a parent’s health on an adolescent’s health could have been of interest to study. Moreover, several authors [13, 17, 54] have argued that potential healthcare cost savings are transferred to others when treating one family member using family-based psychotherapy; it would be ideal to include the healthcare resource use of the parent had they been available in the data.
Conceptually, we investigated how social externalities such as the health effects on other individuals could be introduced into the framework of a CEA; to some extent, this questions whether a cost-utility analysis is appropriate or whether a cost-benefit analysis with distributional weights should be considered. We did not enter into this debate and assumed that a cost-utility analysis would remain the preferred method for the health spillover quantification [55].
Admittedly, our proposition to rely on an ES is a pragmatic choice. The adoption of a unique scale that would be identical for any CEA would have the advantage of facilitating the generation of evidence that is comparable between individuals and between cost-utility analyses.
6 Conclusions
There is no consensus on how health spillover of illness on family members or caregivers should be measured and valued for cost-effectiveness analyses. A household welfare function along with an equivalence scale could be used to adjust health spillovers and generate a health gain within the family to be added to the patient’s QALY gain.
Change history
19 February 2019
The Open Access license, which previously read:
Notes
The study collected data on the main caregiver, who was either the mother (86%) or the father (11%), thus we loosely use the term parent in this article.
Results available upon request.
TAU included supportive therapy/counselling (25.1%), cognitive-behavioural therapy (17.4%), family work (11.5%), formal systemic FT (10.7%) and various other therapies.
Quantification 1 is based on the Tobit regression results presented in Table 5. Quantification 2 is based on the Tobit regression results presented in Table 7 of the “Appendix”. Quantification 3 is based on the Tobit regression results presented in Table 8 of the “Appendix”. Quantification 4 is based on the Tobit regression results presented in Table 9 of the “Appendix”.
See Table (p. 2) in the OECD note on ESs available here URL: http://www.oecd.org/eco/growth/OECD-Note-EquivalenceScales.pdf (consulted June 2018).
References
Evans E, Hawton K, Rodham K. In what ways are adolescents who engage in self-harm or experience thoughts of self-harm different in terms of help-seeking, communication and coping strategies? J Adolesc. 2005;28(4):573–87.
Grad J, Sainsbury P. Mental illness and the family. Lancet. 1963;1(7280):544–7.
Shah AJ, Wadoo O, Latoo J. Quality of life for parents of children with autism spectrum disorders. Br J Med Pract. 2010;3(3):327.
McCrone P, Dhanasiri S, Patel A, Knapp M, Lawton-Smith S. Paying the price: the cost of mental health in England to 2026. London: The King’s Fund; 2008.
Wittenberg E, Saada A, Posser LA. How illness affects family members: a qualitative interview survey. Patient. 2013;6:257–68.
Lavelle TA, Wittenberg E, Lamarand K, Posser LA. Variation in the spillover effects of illness on parents, spouses, and children of the chronically ill. Appl Health Econ Health Policy. 2014;12:117–24.
Kuhlthau K, Payakachat N, Delahaye J, Hurson J, Pyne JM, Kovacs E, et al. Quality of life for parents of children with autism spectrum disorders. Res Autism Spectr Disord. 2014;8:1339–50.
Stratton P. Report On The Evidence Base Of Systemic Family Therapy. Association for Family Therapy, UK
Fortune S, Cottrell D, Fife S. Family factors associated with adolescent self-harm: a narrative review. J Fam Ther. 2016;38(2):226–56.
Byford S, Harrington R, Torgerson D, Kerfoot M, Dyer E, Harrington V, et al. Cost-effectiveness analysis of a home-based social work intervention for children and adolescents who have deliberately poisoned themselves: results of a randomised controlled trial. Br J Psychiatry. 1999;174:56–62.
Goldfield G, Epstein L, Kilanowski C, Paluch R, Kogut-Bossler B. Cost-effectiveness of group and mixed family-based treatment for childhood obesity. Int J Obesity. 2001;25(12):1843–9.
Flores G, Bridon C, Torres S, Perez R, Walter T, Brotanek J, et al. Improving asthma outcomes in minority children: a randomized, controlled trial of parent mentors. Pediatrics. 2009;124(6):1522–32.
Bodden DH, Dirksen CD, Bogels SM, Nauta MH, De Haan E, Ringrose J, et al. Costs and cost-effectiveness of family CBT versus individual CBT in clinically anxious children. Clin Child Psychol Psychiatry. 2008;13(4):543–64.
Cottrell D, Wright-Hughes A, Collinson M, Boston P, Eisler I, Fortune S, et al. Effectiveness and cost-effectiveness of systemic family therapy compared with treatment as usual for young people after self-harm: a pragmatic randomised controlled trial. Lancet Psychiatry. 2018;5(3):203–16.
Griebsch I, Coast J, Brown J. Quality-adjusted life-years lack quality in pediatric care: a critical review of published cost-utility studies in child health. Pediatrics. 2005;115(5):e600–14.
Fals-Stewart W, O’Farrell TJ, Birchler GR, Cordova J, Kelley ML. Behavioral couples therapy for alcoholism and drug abuse: where we’ve been, where we are, and where we’re going. J Cogn Psychother. 2005;19(3):229–46.
Crane D. Does family therapy reduce health care costs for more than the identified patient? Clin Child Psychol Psychiatry. 2011;16(1):3–4.
NICE. Guide to the methods of technology appraisal. Process and methods guides. London: NICE; 2013. p. 102.
Wittenberg E, Posser LA. Disutility of illness for caregivers and families: a systematic review of the literature. Pharmacoeconomics. 2013;31:489–500.
Meeuwsen E, Melis R, van der Aa G, Goluke-Willemse G, de Leest B, van Raak F, et al. Cost-effectiveness of one year dementia follow-up care by memory clinics or general practitioners: economic evaluation of a randomised controlled trial. PLoS One. 2013;8(11):1–7.
Søgaard R, Sørensen J, Waldorff FB, Eckermann A, Buss DV, Phung KTT, et al. Early psychosocial intervention in Alzheimer’s disease: cost utility evaluation alongside the Danish Alzheimer’s Intervention Study (DAISY). BMJ Open. 2014;4:e004105.
Sturkenboom IHWM, Hendriks JCM, Graff MJL, Adang EMM, Munneke M, Nijhuis-van der Sanden MWG, et al. Economic evaluation of occupational therapy in Parkinson’s disease: a randomized controlled trial. Move Disord. 2015;30(8):1059–67.
Al-Janabi H, Exel VJ, Brouwer W, Coast J. A framework for including family health spillovers in economic evaluation. Med Decis Mak. 2016;36(2):176–86.
Al-Janabi H, Exel VJ, Brouwer W, Trotter C, Glennie L, Hannigan L, et al. Measuring health spillovers for economic evaluation: a case study in meningitis. Health Econ. 2016;25:1529–44.
Wright-Hughes A, Graham E, Farrin A, Collinson M, Boston P, Eisler I, et al. Self-Harm Intervention: Family Therapy (SHIFT), a study protocol for a randomised controlled trial of family therapy versus treatment as usual for young people seen after a second or subsequent episode of self-harm. Trials. 2015;16(1):501.
Kazdin AE, Rodgers A, Colbus D. The hopelessness scale for children: psychometric characteristics and concurrent validity. J Consult Clin Psychol. 1986;54(2):241.
Wiedemann G, Rayki O, Feinstein E, Hahlweg K. The Family Questionnaire: development and validation of a new self-report scale for assessing expressed emotion. Psych Res. 2002;109(3):265–79.
Miller IW, Epstein NB, Bishop DS, Keitner GI. The McMaster family assessment device: reliability and validity. J Marital Fam Ther. 1985;11(4):345–56.
Goldberg D. General Health Questionnaire (GHQ-12). Windsor: Nfer-Nelson; 1992.
EuroQoL Group. EuroQoL: a new facility for the measurement of health related quality of life. Health Policy. 1990;16:199–208.
Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI®): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1(1):1.
Feeny D, Furlong W, Boyle M, Torrance GW. Multi-attribute health status classification systems: Health Utilities Index. Pharmacoeconomics. 1995;7(6):490–502.
Thorrington D, Eames K. Measuring health utilities in children and adolescents: a systematic review of the literature. PLoS One. 2015;10(8):e0135672.
Adlard N, Kinghorn P, Frew E. Is the UK NICE “reference case” influencing the practice of pediatric quality-adjusted life-year measurement within economic evaluations? Value Health. 2014;17:454–61.
Oluboyede Y, Tubeuf S, McCabe C. Measuring health outcomes of adolescents: report from a pilot study. Eur J Health Econ. 2013;14(1):11–9.
Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.
McCabe C, Stevens K, Roberts J, Brazier J. Health state values for the HUI2 descriptive system: results from a UK Survey. Health Econ. 2005;14(3):231–44.
Curtis L. Unit costs of health and social care. 2014. Canterbury, Kent: Personal Social Services Research Unit; 2014. http://www.pssru.ac.uk/project-pages/unit-costs/2014. Accessed 27 Aug 2018.
Cottrell D, Wright-Hughes A, Collinson M, Boston P, Eisler I, Fortune S, et al. A pragmatic randomised controlled trial and economic evaluation of family therapy versus treatment as usual for young people seen after second or subsequent episodes of self-harm: the Self-Harm Intervention-Family Therapy (SHIFT) trial. Health Technol Assess. 2018;22(12):1–222.
Little RJ, Rubin DB. Single imputation methods. In: Little RJ, Rubin DB, editors. Statistical analysis with missing data. 2nd ed. New York: John Wiley & Sons; 2002. p. 59–74.
Rubin DB. The calculation of posterior distributions by data augmentation. Comment: A noniterative sampling/importance resampling alternative to the data augmentation algorithm for creating a few imputations when fractions of missing information are modest: the SIR algorithm. J Am Stat Assoc. 1987;82(398):543–6.
Schafer JL. Analysis of incomplete multivariate data. London: CRC Press; 1997.
Bhadhuri A, Jowett S, Jolly K, Al-Janabi H. A comparison of the validity and responsiveness of the EQ-5D-5L and SF-6D for measuring health spillovers: a study of the family impact of meningitis. Med Decis Mak. 2017;37(8):882–93.
Buhmann B, Rainwater L, Guenther S, Timothy S. Equivalence scales, well-being, inequality, and poverty: sensitivity estimates across ten countries using the Luxembourg Income Study (LIS) database. Rev Income Wealth. 1988;34(2):115–42.
Chanfreau J, Burchardt T. Equivalence scales: rationales, uses and assumptions. Edinburgh: Scottish Government, 2008. http://www.scotland.gov.uk/Resource/Doc/933/0079961.pdf
Anyaegbu G. Using the OECD equivalence scale in taxes and benefits analysis. Econ Labour Market Rev. 2010;4:49–54.
Cuellar-Flores I, Sanchez-Lopez MP, Liminana-Gras RM, Colodro-Conde L. The GHQ-12 for the assessment of psychological distress of family caregivers. Behav Med. 2014;40(2):65–70.
Klassen A, Raina P, Reineking S, Dix D, Pritchard S, O’Donnell M. Developing a literature base to understand the caregiving experience of parents of children with cancer: a systematic review of factors related to parental health and well-being. Support Care Cancer. 2007;15:807–18.
Lindkvist M, Feldman I. Assessing outcomes for cost-utility analysis in mental health interventions: mapping mental health specific outcome measure GHQ-12 onto EQ-5D-3L. Health Qual Life Outcomes. 2016;14(134):1–9.
Barton GR, Bankart J, Davis AC, Summerfield QA. Comparing utility scores before and after hearing-aid provision: results according to the EQ-5D, HUI3 and SF-6D. Appl Health Econ Health Policy. 2004;3(2):103–5.
Marra CA, Woolcott JC, Kopec JA, et al. A comparison of generic, indirect utility measures (the HUI2, HUI3, SF-6D, and the EQ-5D) and disease-specific instruments (the RAQoL and the HAQ) in rheumatoid arthritis. Soc Sci Med. 2005;60(7):1571–82.
McDonough CM, Grove MR, Tosteson TD, Lurie JD, Hilibrand AS, Tosteson AN. Comparison of EQ-5D, HUI, and SF-36-derived societal health state values among spine patient outcomes research trial (SPORT) participants. Qual Life Res. 2005;14(5):1321–32.
Polinder S, Haagsma JA, Bonsel G, Essink-Bot ML, Toet H, van Beeck EF. The measurement of long-term health-related quality of life after injury: comparison of EQ-5D and the health utilities index. Inj Prev. 2010;16(3):147–53.
Fals-Stewart W, Yates BT, Klostermann K. Assessing the costs, benefits, cost-benefit ratio, and cost-effectiveness of marital and family treatments: why we should and how we can. J Fam Psychol. 2005;19(1):28–39.
Labelle RJ, Hurley JE. Implications of basing health-care resources allocations on cost-utility analysis in the presence of externalities. J Health Econ. 1992;11:259–77.
Ng ESW, Grieve R, Carpenter JR. Two-stage nonparametric bootstrap sampling with shrinkage correction for clustered data. Stata J. 2013;13(1):141–64.
Acknowledgements
We are grateful to Bryony Dawkins, John O’Dwyer, Laetitia Schmitt, Paula Boston, and participants to the LAGV International Conference in Public Economics in Aix en Provence in June and the EuHEA conference in Maastricht in 2018 for comments and feedback on an earlier version of this article. Two anonymous reviewers and the editors provided us with rich comments that helped improve the article. We thank Josephine Aikpitanyi for her help with literature references.
Author information
Authors and Affiliations
Contributions
ST designed the trial health economics analysis and ECS led the analysis. ST and ECS developed the framework for this research article and equally contributed in writing. DC was PI of the SHIFT trial and provided a clinical insight for the research. ST is the overall guarantor of the research in this article.
Corresponding author
Ethics declarations
Funding
This research work was undertaken as part of the National Institute for Health Research Health Technology Assessment programme (project number: 07/33). The views expressed in this publication are those of the authors and do not necessarily reflect those of the HTA programme, NIHR, NHS, or the Department of Health. Study registration: ISRCTN 59793150.
Conflict of interest
Sandy Tubeuf received funding from NIHR HTA (Grant no. 07/33/01) including support for travel conference presentation. Eirini-Christina Saloniki received funding from NIHR HTA (Grant no. 07/33/01) including support for travel and conference presentation. David Cottrell received funding from NIHR HTA (Grant no. 07/33/01) including travel costs for data collection and to meetings to present results.
Data availability
Regarding research data, the principal investigator of the SHIFT study has agreed with the NIHR that data would not be made freely available in a repository and interested third parties can apply to the trial team for access to the Clinical Trials Research Unit, University of Leeds, Leeds LS2 9JT, UK.
Additional information
The original version of this article was revised due to Open Access License conversion from CC-BY-NC TO CC-BY.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Tubeuf, S., Saloniki, EC. & Cottrell, D. Parental Health Spillover in Cost-Effectiveness Analysis: Evidence from Self-Harming Adolescents in England. PharmacoEconomics 37, 513–530 (2019). https://doi.org/10.1007/s40273-018-0722-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40273-018-0722-6