Abstract
Purpose
To systematically assess patterns and temporal changes in the measurement and valuation of childhood health utilities and associations between methodological factors.
Methods
Studies reporting childhood health utilities using direct or indirect valuation methods, published by June 2017, were identified through PubMed, Embase, Web of Science, PsycINFO, EconLit, CINAHL, Cochrane Library and PEDE. The following were explored: patterns in tariff application; linear trends in numbers of studies/samples and paediatric cost–utility analyses (CUAs) and associations between them; changes in proportions of studies/samples within characteristic-based categories over pre-specified periods; impact of National Institute for Health and Care Excellence (NICE) guidance on primary UK research and associations between valuation method, age and methodological factors.
Results
335 studies with 3974 samples covering all ICD-10 chapters, 23 valuation methods, 12 respondent types and 42 countries were identified by systematic review. 34.0% of samples using indirect methods compatible with childhood applied childhood-derived tariffs. There was no association between numbers of studies/samples and numbers of CUAs. Compared to 1990–2008, 2009–June 2017 saw a significant fall in the proportion of studies using case series; significant compositional changes across ICD-10 chapters and significantly higher sample proportions using childhood-specific and adult-specific indirect valuation methods, and based on pre-adolescents, self-assessment, self-administration and experienced health states. NICE guidance was weakly effective in promoting reference methods. Associations between valuation method, age and methodological factors were significant.
Conclusion
1990–2017 witnessed significant changes in primary research on childhood health utilities. Health technology assessment agencies should note the equivocal effect of methodological guidance on primary research.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Sustained health budget constraints necessitate the comparison of alternative programmes and interventions in terms of costs and consequences [1]. Cost–utility analysis (CUA) remains the preferred form of economic evaluation aimed at informing the allocation of finite resources for decision-making agencies around the world [2,3,4,5,6]. In CUA, the quality-adjusted life-year (QALY) is the preferred measure of health outcome where the QALY combines preference-based health-related quality of life (HRQoL) outcomes, or health utility values, associated with health states, with the length of time in those states [7]. The generic nature of health utilities (and thus QALYs) allows comparison of healthcare interventions across disparate health conditions and populations. Health utilities are indexed on a cardinal scale where 0 represents death and 1 represents perfect health [1].
Valuation methods for utility assessment can be divided into two broad categories: direct and indirect. Direct methods combine the valuation and measurement process into a single step, and include the standard gamble (SG) technique and the time trade-off (TTO) approach [1]. The visual analogue scale (VAS) is another direct valuation method, although considered by some economists not to be a health utility measurement approach since the valuation procedure is not choice based and does not involve decision making under uncertainty [8]. Indirect valuation methods use multi-attribute utility instruments (MAUIs) such as the EQ-5D [9], Health Utilities Index (HUI) [10], SF-6D [11], Quality of Well-Being Scale (QWB) [12] and Assessment of Quality of Life (AQoL or AQoL-5D) [13]. MAUIs ask respondents to describe their health state using a health status classification system containing several dimensions, each with multiple levels. Algorithms, or tariff sets, elicited from representative populations using direct valuation methods such as the TTO, are then applied to convert responses into health utility values.
Unique methodological challenges arise when utility assessments are conducted for childhood (age < 18 years) health conditions or states [14, 15]. For example, infants (age < 2 years), as well as pre-adolescents (age < 12 years) and adolescents (age ≥ 12 and < 18 years) with developmental delays or cognitive deficits arising from neurodevelopmental disorders, lack comprehension to complete direct or indirect valuation methods, thus requiring proxy assessment. Moreover, bio-psychosocial development during childhood means that dimensions relevant to HRQoL change rapidly by age [16]. This means that classification systems embedded into adult-specific MAUIs (targeted at those aged ≥ 18 years), such as the EQ-5D and SF-6D, may not incorporate health dimensions relevant to developmental stages through childhood. MAUIs with childhood-specific classification systems have been developed to meet this challenge, including the EQ-5D-Y (Youth) [17], 16-Dimensional Health-Related Measure (16D) [18], 17-Dimensional Health-Related Measure (17D) [19], AQoL-6D [20] and Child Health Utility 9-Dimensions (CHU9D) [21]. Moreover, several MAUIs, such as the HUI2, HUI3 and QWB, have classification systems compatible with both adult and childhood health states. Many measures with classification systems designed specifically for or compatible with childhood, such as the EQ-5D-Y, HUI3 and QWB, rely on tariffs derived from adult populations. Thus, another methodological concern relates to potential differences between children and adults in how they value health states contained within MAUIs [22].
There has been increasing recognition of these methodological challenges in international health technology assessment (HTA) guidelines. The 2013 National Institute for Health and Care Excellence (NICE) methods guidance recognised that its preferred measure, the EQ-5D, lacked a classification system designed for use in children and recommended use of the EQ-5D-Y for children aged 7–12 years, although no separate tariff set for this measure existed [2]. The 2016s US Panel on Cost-effectiveness in Health and Medicine acknowledged the challenges surrounding childhood utility measurement and discussed the relative advantages of alternative instruments, including HUI2/3, EQ-5D-Y and CHU9D, but without recommending a preferred approach [6]. Despite these developments, adult-specific health utilities are still frequently applied to childhood health states within economic evaluations. Montgomery and Kusel [23] reviewed all NICE health technology appraisals in England until June 2015 and identified 29 submissions directly related to paediatric health, only six of which applied childhood-specific utilities. It is generally unclear how developments of national HTA guidelines have influenced priorities and designs, including choice of valuation methods, in primary assessments of childhood health utilities.
In line with the preference of several HTA agencies, CUA is now the leading analytic approach for economic evaluation of health interventions targeting children, with the number of CUAs overtaking that of cost-effectiveness analyses (CEAs) contained in the Paediatric Economic Database Evaluation (PEDE) in 2009 [24]. Although health utility data constitute vital inputs into CUAs, it is rare for analysts to estimate utility values using primary research methods unless the economic evaluation is conducted alongside a prospectively designed study with individual-level data [25]. Decision-analytic models typically contain several health states of interest that require sourcing of utility estimates from primary studies or systematic reviews. In such cases, the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guideline [26] recommends that analysts identify and extract health utilities from multiple sources in the published literature and synthesise if appropriate.
Catalogues and reviews of health utility values for childhood populations are available, but have largely focussed on a relatively small number of conditions, such as acute lymphoblastic leukaemia [27, 28], asthma [29], neurodisability [30] and childhood obesity [31], or on a single valuation source, such as EQ-5D [32], HUI3 [33] and SG [34]. The PEDE project is an alternative source of childhood health utility values and contains 2112 values from 857 CUAs in paediatric populations published between 1980 and 2016 [35]. However, only 8.5% (n = 73) of these CUAs conducted primary estimation of utility values [36]. Furthermore, published CUAs represent only one source of childhood health utility values.
This paper addresses three aims against a backdrop of rapid development of measurement approaches and methods guidance in this area. First, it systematically describes the patterns of primary studies and samples measuring childhood health utilities, by study design and sample characteristics, as well as patterns in the source of tariffs when MAUIs compatible with or specific to children are used. Second, linear trends in the numbers of studies and samples, their associations with the number of paediatric CUAs and changes in proportions of studies and samples before and after key transition timepoints are explored. Third, associations between valuation methods and sample age and other methodological factors are explored.
Methods
Systematic review
The systematic review followed PRISMA guidelines [37] and covered all studies published by 30th June 2017. The search strategy (Supplementary Material Table S1), inclusion and exclusion criteria and databases included—PubMed, Embase of OVID Medline, Web of Science, PsycINFO, Cochrane Library, CINAHL and EconLit—were based on the study by Kwon and colleagues [38], which covered a period up to 31 December 2015 and focused only on static descriptions of included studies and samples alongside a meta-regression of childhood utility values. The search strategy was developed and piloted prior to implementation and included an intersection of health utility, valuation method and childhood search terms. Non-English language articles were excluded. The PEDE database was also searched to identify CUAs published between 1980 and 2016 that incorporated primary estimation of health utilities.
Articles that met the inclusion criteria were English language primary studies reporting health utilities for childhood populations or for childhood conditions or descriptors using direct or indirect valuation methods. Two reviewers (JK and SWK) independently assessed titles and abstracts. Articles with two approvals proceeded to the next stage; those with one were referred to a third reviewer (SP) for arbitration. At the second stage, the same primary reviewers analysed full-text articles with disagreements referred to the third reviewer. Conference abstracts were included if they reported original health utilities. Studies reporting primary VAS values were included despite disagreement about their validity for QALY construction [39].
Data extraction
From each study that met the inclusion criteria, the variables listed in Supplementary Material Table S2 were extracted using a proforma. These included bibliographic details, study design, study setting, valuation method, tariff applied to MAUIs (including source population and valuation method), respondent type, administration mode, sample target age(s), whether the health state was experienced or hypothetical, sample size and geographic setting. An International Classification of Diseases 10th revision (ICD-10) code was allocated to each sample according to the health condition studied.
Descriptive analyses
The distribution of mean and median utility and VAS (rescaled to 0–1) scores extracted from included samples was calculated. The number of studies and samples by publication year was estimated together with the annual number of CUAs included in the PEDE database. Valuation methods applied to studies within each ICD-10 chapter were described. The numbers of samples by respondent type, administration mode, target age(s) of sample and geographical factors (including continent of origin and national income levels, with income classification taken from the World Bank [40]) were estimated. Study designs and valuation methods were grouped into key categories. For application of MAUIs that are compatible with or specific to childhood populations, the tariffs applied and sources of their values (age group and setting/nationality) and valuation method (e.g. VAS, SG, TTO) were described by MAUI.
Statistical analyses
Linear regression tested for linear trends in numbers of PEDE-based CUAs, utility studies and utility samples by year of publication. Controlling for these annual trends, associations between number of PEDE-based CUAs and number of utility studies and samples were also estimated. We tested the hypothesis that there were significant changes to the composition of childhood utility data categorised by study- and sample-level characteristics, including study design, health condition, valuation method, age of target population, respondent type, administration mode and valuation of hypothetical health states. Tests of proportions, at the 95% confidence level, were used to assess whether the proportion in each category of study- and sample-level characteristic changed significantly before and after a pre-specified transition point of 2009, which was when CUAs became the prominent analytic approach for paediatric economic evaluations within the PEDE database [24]. In a separate analysis involving only UK studies and samples, 2013 was specified as a transition point when NICE identified EQ-5D-Y as its reference instrument for utility assessment in children aged 7–12 years, while reaffirming EQ-5D as its reference instrument for those aged 13 years and over [2]. The hypothesis was that the guidance had a significant effect on the design of UK-based primary studies marked by a greater proportion of samples using the EQ-5D-Y for pre-adolescent populations (age < 12 years) and smaller proportions using non-reference direct or indirect valuation methods. Finally, two-way Pearson’s Chi-square tests were used at the 95% confidence level to assess the associations between valuation method and sample age, respondent type, administration mode and valuation of hypothetical health states. The hypothesis tested was that there are significant associations between methodological factors selected by researchers.
Results
Systematic review
Figure 1 presents the PRISMA flow diagram for the systematic review. The main reasons for exclusion were secondary studies using decision-analytic models, previous systematic reviews (which were kept for manual searching), targeting of adult populations and focus on non-preference-based health outcome measures. A total of 274 articles were included for data extraction. Manual searching yielded 45 further articles, whilst a search of PEDE yielded a further 16 articles. In total, data were extracted from 335 articles, which are summarised by health condition, intervention type (where applicable), country of study population, valuation method, respondent type, administration mode and age of target population in Supplementary Material Table S3.
Descriptive analyses
Distribution of sample means and medians
Descriptive statistics for health utilities were extracted from 3974 samples contained within the 335 studies. The majority of studies (306 out of 335) contained two or more samples delineated by health condition/state, sociodemographic factors (e.g. gender, age) or methodological factors. Figure 2a depicts the frequency distribution of 3573 mean utility and VAS scores (excluding 191 samples, which only reported mean change in utility scores or regression coefficients) with each bar stratified by valuation method, while Fig. 2b does so for 870 median utility and VAS scores (some samples report both mean and median scores). The difference in distributional characteristics between mean and median scores is visible, with the negative skew much greater in median scores. Among samples reporting mean scores, 0.34% (12 out of 3573) demonstrated the ceiling effect, namely a mean score of 1. The corresponding proportion was 7.36% (64 out of 870) among samples reporting median scores. From visual inspection, there appears to be greater concentrations of trade-off-based direct valuation methods (TTO, SG and their variants) at the upper end of both mean and median utility score ranges. Trade-off-based direct valuation methods comprised 17.9% of all samples generating mean utility scores higher than 0.800, but 10.5% of all samples with mean scores ≤ 0.800. The corresponding proportions were 33.0% and 14.0% for all median utility scores higher than 0.800 and ≤ 0.800, respectively.
Distribution of samples by health condition and valuation method
Table 1 summarises the distribution of included samples by ICD-10 chapter. All ICD-10 chapters relevant to childhood health were covered by samples included in the systematic review. The ICD-10 mental and behavioural disorders chapter contained the highest number of samples (n = 698), followed by general childhood population health (n = 501) and cancer (n = 442). Across all ICD-10 chapters, 180 unique ICD-10 codes were used to label samples.
Twenty-three unique valuation methods were identified. These were grouped into six key categories: (i) VAS—EQ-5D VAS (number of samples = 348; 8.8%), EQ-5D-Y VAS (n = 232; 5.8%) and stand-alone VAS (n = 252; 6.3%); (ii) trade-off-based direct valuation methods—TTO (n = 171; 4.3%), SG (n = 227; 5.7%), chained gamble and adjusted SG (n = 143; 3.6%); (iii) adult-specific MAUIs—EQ-5D (n = 424; 10.7%), SF-6D (n = 34; 0.9%), AQoL-5D (n = 16; 0.4%) and 15D (n = 2; 0.05%); (iv) MAUIs compatible with both childhood and adult populations—QWB (n = 224; 5.6%), HUI2 (n = 482; 12.1%), HUI3 (n = 822; 20.7%), modified HUI (10-dimension variant of HUI [41], HUI3 with ‘worst imaginable health’ as 0 instead of death [42]; n = 8; 0.2%) and ABC-UI (Aberrant Behaviour Checklist Utility Index) [43] (n = 1; 0.03%); (v) childhood-specific MAUIs—EQ-5D-Y (n = 108; 2.7%), CHU9D (n = 231; 5.8%), 16D (n = 73; 1.8%), 17D (n = 39; 1.0%), AQoL-6D (n = 50; 1.3%), PAHOM (Pediatric Asthma Health Outcome Measure) [44] (n = 69; 1.7%) and CH-6D (Child Health-6 Dimensions) [45] (n = 3; 0.08%);and (vi) mapping non-preference-based clinical measures to utility indices [46,47,48,49,50] (n = 15; 0.4%).
Table 1 describes the three most frequently used valuation methods by ICD-10 chapter. HUI2 or HUI3 was used by 89.1% of cancer samples, which is consistent with these measures originally being developed for paediatric cancer patients and survivors [51, 52]. Childhood-specific MAUIs represented the most frequently used valuation method for only 3 out of 20 chapters: CHU9D (27.4% for general health), PAHOM (35.8% for respiratory system disorders) and 16D/17D (20.0% for digestive system disorders). MAUIs compatible with childhood and adult populations were the most frequently used methods for eight chapters: HUI2 for chapter 2, HUI3 for Chaps. 6, 8, 16, 17 and combined chronic diseases and QWB for chapter 19.
Distribution of samples by methodological factors, age and geographical setting
Table 2 presents the number of study samples by respondent type, administration mode, target age of children and geographical setting. Thirty-seven percent of samples (n = 1498) used self-assessment by children. A total of 456 samples (11.5%) allowed children to generate responses together with proxies. The remainder of the samples relied on proxy assessment, most commonly by parents (n = 1091; 27.5%). Administration modes fell broadly into two categories: (i) self-administered surveys in school or clinical settings, by mail, online or by Delphi elicitation of clinicians [53]; and (ii) interview-administered surveys by face-to-face meeting or by telephone. Target age groups spanned the whole age spectrum of childhood. Six percent of samples contained infants (aged < 2 years), while some samples (n = 41) had a minimum age of 18 years even though they specified adolescents as the target group. A significant proportion of samples (14.4%) did not report any information on age. As for geographical setting, the skew towards high-income countries was clear (91.6%). The US produced the highest number of samples (n = 970; 24.4%) followed by Canada (n = 674; 17.0%) and the UK (n = 634; 16.0%).
MAUIs and tariff application
Table 3 lists the tariffs that were used in applications of MAUIs compatible with or specific to childhood populations and their valuation populations and methods. All 16D and 17D samples that provided information applied tariffs derived from children or their proxies (Finnish schoolchildren aged 12–16 years using VAS [19] for 16D or their proxies (Finnish parents of children aged 8–11 years) using VAS [20] for 17D). For AQoL-6D, 72.0% of samples applied adolescent-derived tariffs [54], while 28.0% applied the general adult-derived tariff [55]. Adolescent-derived tariffs [56, 57] were used in 46.3% of CHU9D samples and general adult-derived tariffs [58] in 52.8%. Only a single EQ-5D-Y sample applied childhood-derived tariffs [59], while 78.7% of samples applied general adult-derived tariffs from 10 countries [60,61,62,63,64,65,66,67]. Overall, 54.3% of samples using childhood-specific MAUIs applied childhood-derived tariffs, 40.0% applied adult-derived tariffs and 5.7% gave no information on underpinning tariffs. For MAUIs compatible with both childhood and adult populations, 26.4% of samples applied childhood-derived tariffs, while 67.5% applied adult-derived tariffs. HUI2 offers both childhood- [68,69,70] and adult-derived [71] tariffs, while the HUI3, QWB and ABC-UI only offer adult-derived tariffs [72,73,74].
Statistical analyses
Linear trend in utility studies and samples and PEDE CUAs
Figure 3 jointly depicts trends in number of utility studies and samples and number of paediatric CUAs in the PEDE database. It also marks out years 2009 and 2013, which are the transition timepoints for the two separate periodic changes analysed below. The upward trends in all three groups are visible and confirmed by statistical tests for linear trend. The coefficients for year of publication were 1.15 (95% confidence interval: 0.96 to 1.36; P < 0.001) for number of utility studies, 12.70 (95% CI 9.32 to 16.08; P < 0.001) for number of utility samples and 3.63 (95% CI 3.01 to 4.25; P < 0.001) for number of PEDE CUAs. The number of utility studies increased at a steady rate across the whole review period, while the numbers of utility samples and PEDE CUAs increased markedly in the late 2000s.
Association between PEDE CUAs and utility studies and samples
Linear regression of the number of utility studies on number of CUAs, controlling for linear time trend, showed no association (coefficient on CUAs: 0.114; standard error 0.763; P value: 0.097). There was similarly no association between number of utility samples and number of CUAs (coefficient: 0.624; SE: 1.189; P value: 0.605). No associations were similarly found between proportion of paediatric economic evaluations that were CUAs and the number of primary utility studies and samples.
Periodic change in composition of utility studies and samples
Table 4 summarises the numbers of studies and samples by categories of study design, health condition, valuation method, target age, respondent type, administration mode and valuation of hypothetical health state. Supplementary Materials Tables S4-S7 present the results across 5-year publication intervals. Comparisons between two broader periods, 1990–2008 and 2009–June 2017, saw a significant decline in the proportion of patient case series (10.2% point decrease; P = 0.013).
In terms of health condition, comparisons between the two periods revealed significant changes in proportion of samples in all ICD-10 chapters except musculoskeletal system disorders. Categories that saw the greatest change were cancer (18.7% point decrease; P < 0.001), general health (15.1% point increase; P < 0.001), mental and behavioural disorders (12.1% point increase; P < 0.001) and injury (11.4% point decrease; P < 0.001).
There were equally significant changes for valuation method, respondent type, administration mode and valuation of hypothetical health states. For valuation method, childhood-specific MAUIs saw the greatest increase (15.6% point increase; P < 0.001) whilst trade-off-based direct valuation methods saw the greatest decrease (15.7% point decrease; P < 0.001). However, there was also a significant increase in the use of adult-specific MAUIs (4.5% point increase; P < 0.001) and VAS approaches (7.4% point increase; P < 0.001). MAUIs compatible with both childhood and adult populations experienced a significant decrease in use (12.0% point decrease; P < 0.001). There was a significant shift towards self-assessment of health status by children (24.0% point increase; P < 0.001), and the use of self-administered surveys in school and clinic settings (29.9% point increase; P < 0.001). Similarly, there was a significant increase in the number of samples valuing experienced rather than hypothetical health states (16.8% point increase; P < 0.001). As for age of target population, there was a significant shift in focus to pre-adolescent populations (4.2% point increase; P = 0.011) and a significant fall in the proportion of samples failing to provide information on age (7.1% point decrease; P < 0.001).
Influence of HTA guidance on primary samples
Table 5 presents similar tests of proportions comparing two periods, 1990–2012 (before the publication of the 2013 NICE HTA guidance) and 2013–June 2017, in 355 UK samples containing pre-adolescents (mean/median or minimum age 12 or below) and 207 UK samples not containing pre-adolescents. Samples containing pre-adolescents increased significantly as a proportion of all samples from 45.0% in 1990–2012 to 85.1% in 2013–June 2017 (40.1% point increase; P < 0.001). Seventy-two samples in 1990–2012 did not report age of target population compared to none in 2013–June 2017. The evidence supporting our hypothesis that publication of the NICE guidance would increase the use of reference instruments in relevant age groups and reduce the use of non-reference instruments was mixed. For samples containing pre-adolescents, the use of EQ-5D-Y increased from 3.9% of samples in 1990–2012 to 16.9% in 2013–June 2017 (13.0% point increase; P < 0.001). Moreover, the use of the non-reference HUI2/3 and trade-off-based instruments fell from 75.4% and 5.8% of samples, respectively, in 1990–2012 to no samples in 2013–June 2017. However, the use of EQ-5D also increased from 11.1 to 32.4% (21.3% point increase; P < 0.001), while the uses of the non-reference CHU9D (34.5% point increase; P < 0.001) and VAS approaches (12.3% point increase; P < 0.001) both increased.
Associations between methodological factors
Table 6 displays the association between valuation method, target age and three other methodological factors—respondent type, administration mode and valuation of hypothetical health states. In all four tests, there is significant evidence to reject the null hypothesis of no association, with P values all less than 0.001. Results suggest that VAS approaches are more likely to be used in pre-adolescent samples and to be assessed by children themselves using self-administered surveys. However, VAS approaches are also more likely to be used to assess hypothetical rather than experienced health states. Trade-off-based direct valuation methods are more likely to be used in older adolescent samples and/or involve proxy assessment. They are also more likely to be administered by interview and for assessing hypothetical health states. The associative patterns varied for the three categories of MAUIs. Adult-specific MAUIs were more likely to be used in adolescent samples, while MAUIs compatible with or specific to childhood populations were both more likely to be used in pre-adolescent samples. Adult-specific MAUIs were more likely to involve self-assessment by children, and MAUIs compatible with both populations more likely to involve proxy assessment. All MAUI categories were more likely to be self-administered than interviewer-administered and be used to assess experienced rather than hypothetical health states.
Discussion
This study represents the most comprehensive systematic review of primary studies reporting health utilities for childhood conditions, covering all studies published up to 30 June 2017. All ICD-10 chapters relevant to childhood health, 23 valuation methods, all childhood ages, 12 respondent types, 8 administration modes and 42 country settings were observed across 3974 samples from 335 studies. There were strong upward linear trends in numbers of utility studies and samples and PEDE CUAs. There was no statistically significant association between numbers of PEDE CUAs and utility studies and samples after controlling for linear trend. Adopting year 2009 (when CUA became the prominent analytic approach for paediatric economic evaluations [24]) as a key transition point, the study found evidence of significant changes in composition of primary samples across health condition, valuation method and other methodological factors. There was also evidence of more refined approaches in primary utility research as reflected by greater pre-adolescent population coverage, target age reporting and valuation of experienced health states. For a subset of UK samples and using the year 2013 as a transition point (when NICE HTA guidance [2] was published), there was weak evidence that primary utility research adhered to national guidance. Finally, tests of association found that sample age, respondent type, administration mode and valuation of hypothetical health state varied significantly by valuation method.
Previous systematic reviews of primary studies assessing childhood health utilities have largely focused on specific diseases [27,28,29,30,31] or valuation methods [32]. Reviews that assembled data across heterogenous childhood health conditions, valuation methods and other methodological factors are few. A review by Tarride and colleagues [54] included 77 studies measuring utilities published before 2008, but limited its scope to asthma, cancer, combined chronic diseases, diabetes and skin disease and to a limited number of valuation methods, namely HUI, EQ-5D, SG and TTO. Temporal patterns in included studies and samples were not explored. A review by Thorrington and Eames [55] included 90 studies published in 1994–2013 measuring childhood health utilities using direct or indirect valuation methods. Temporal patterns in the data led to similar findings to this review: adult-specific valuation methods increased in use despite the availability of childhood-specific measures, whilst childhood-derived tariffs were seldom applied. However, the data were not categorised by health condition or age of sample, and statistical tests were not performed to evaluate the variations over time or associations between factors. Finally, a review by Kwon and colleagues [38] used the same search strategy to identify 272 studies published by 31 December 2015, thus overlapping significantly in data sources with this study. However, their descriptive and statistical analyses focused on non-temporal patterns in studies and samples and on associations between mean utility values and health conditions and methodological factors through meta-regression. Moreover, no comparison was made to PEDE CUAs, whilst the impact of HTA methods guidance on primary research was not assessed.
To our knowledge, this review is the first to summarise the distribution of all mean and median utility scores relevant to childhood health. The results show a clear disparity in distributional features between alternative central statistics of mean and median utilities. The ceiling effect, known to be significant in distributions of individual-level utility data [56], was visible in the distribution of medians but small in that of means. Negative skew in individual-level utility would produce downward adjustment of means relative to medians, and this is likely reflected in the less pronounced ceiling effect in the distribution of means. Caution is thus warranted when using aggregate or pooled outcomes in economic evaluations since they contain heterogeneous distributional features depending on central statistic chosen, which may also differ from the distribution of individual-level data [57]. The distributional skew also varied by valuation method, with means and medians from trade-off-based direct valuation methods (TTO, SG and variants) concentrated at the upper end of the utility range. This is consistent with several meta-regression studies [58,59,60,61] on health utilities for diverse conditions, which also show higher utilities from TTO and SG than from other valuation approaches, potentially due to biases in making trade-offs such as loss and risk aversions [62].
The review is also the first to categorise all primary samples by ICD-10 chapter and code and document their compositional changes over time. Ascertaining how well the distribution of utility samples by ICD-10 chapter reflects prevalence of health needs in children is of interest. Were and colleagues [63] noted transitions in childhood morbidity patterns from infectious diseases to congenital anomalies, injuries and non-communicable diseases, including obesity, diabetes, cancer and respiratory diseases, while Laski and colleagues [64] highlighted mental health as an emerging priority for adolescent populations. These observations are reflected in our review data: the proportion of samples for infectious diseases fell across two primary time periods, 1990–2008 and 2009–June 2017, while the proportions for endocrine, nutritional and metabolic disorders, mental and behavioural disorders, respiratory system disorders and congenital malformations increased significantly, although those for cancer and injuries fell. The distribution of samples by health condition can also be compared to the focus of paediatric CUAs. Although the latter may reflect policy interest more than underlying health needs, collection of primary data should support such secondary research. The report by Sullivan and Ungar [65] catalogued the distribution of paediatric CUAs by ICD-9/10 chapter. Infectious diseases remained the dominant topic, accounting for 40.6% of all paediatric CUAs between 1980 and 2013. This was followed by nervous system disorders (8.9%), respiratory system disorders (7.8%) and diseases of the blood (5.9%). This contrasts with our observations for utility data, with the above categories only accounting for 4.9%, 2.9%, 4.8% and 2.1% of samples, respectively. Mental health accounted for the largest share of utility samples (17.6%) but just 4.3% of paediatric CUAs. The lack of concordance is consistent with the lack of association found between the number of paediatric CUAs and numbers of utility studies and samples, controlling for linear trend. Future studies should assess the extent to which primary utility data facilitate CUAs and the extent to which CUAs motivate primary utility research.
Another contribution of the review is documenting the change in patterns of valuation method over time. A clear pattern was visible in the movement away from trade-off-based direct valuation methods towards MAUIs that require only simple responses on a classification system and separate valuations using tariffs derived from representative populations. The proportion of samples using trade-off-based direct valuation methods fell from 23.7% in 1990–2008 to 8.0% in 2009–June 2017, whereas the proportion of samples using MAUIs of any type increased from 59.9% in 1990–2008 to 67.9% in 2009–June 2017. This perhaps reflects the concern over feasibility of applying cognitively demanding assessments in children [15], as well as the increasing number of national guidelines that recommend MAUIs over direct valuation methods [2,3,4,5,6]. The most significant growth occurred for childhood-specific MAUIs, which increased from 4.4% of samples in 1990–2008 to 20.0% in 2009–June 2017. Tests of association also showed that childhood-specific MAUIs were more likely to be self-assessed, self-administered and focussed on experienced health states. The question remains as to whether this represents an unambiguous improvement in childhood health utility assessment. Childhood-specific MAUIs have psychometric properties suited to children [15,16,17,18,19] and are recommended by some decision-making bodies [2, 6]. However, this raises a concern over comparability of their utilities to those of adult-specific MAUIs, particularly when used as inputs into life-course decision models. Moreover, a review of childhood-specific MAUIs found no study that maps across childhood- and adult-specific utilities [22].
The above concern over comparability may explain the finding that the publication of HTA guidance by NICE had a mixed effect on primary utility assessments. In the UK samples containing pre-adolescent populations, the proportion using the adult-specific EQ-5D increased by more than the proportion using the childhood-specific EQ-5D-Y after the guidance publication in 2013. Adlard and colleagues [66], after reviewing 43 paediatric CUAs set in the UK and published between 2004 and 2010, noted the paucity of childhood-specific utility data, and recommended increased funding for primary research that would follow NICE guidance. There is only weak evidence that this has occurred since 2013. It is conceivable that NICE guidance may have encouraged the use of an adult-specific reference instrument (i.e. EQ-5D) in both primary and secondary research, particularly for life-course models that prioritise comparability of utility scores over the whole age spectrum.
This study also catalogues all tariffs applied to MAUI-based studies, the population from whom they were derived and their valuation method. Around one-quarter (23.7%) of samples using MAUIs provided no information on the tariff applied, and this proportion increased from 19.2% in 1990–2008 to 26.0% in 2009–June 2017. Among samples that used MAUIs compatible with or specific to childhood populations, 60.0% applied adult-derived tariffs, and this proportion increased from 50.3% in 1990–2008 to 64.6% in 2009–June 2017. Only one sample using the EQ-5D-Y applied childhood-derived tariffs, while none was available for the HUI3. However, it is difficult to conclude that application of childhood-derived tariffs is more appropriate than adult-derived tariffs even for MAUIs compatible with or specific to childhood populations. Children are not autonomous legal, social and economic agents and do not bear the burden of financing public healthcare. Hence their preferences, even when conflicting with those of the general adult public, may arguably be of less importance. That said, analysts should recognise that applications of childhood and adult-derived tariffs may produce enough variation in utility values to alter policy decisions [67]. They should therefore include utility values from both tariffs where they are available in sensitivity analysis to observe the impact of alternative tariff populations.
One potential-related research area is assessing the quality of utility research and its improvement over the review period. However, the tests of association between sample-level characteristics showed that choice in one methodological area (e.g. use of proxy assessment) was strongly associated with other methodological choices (e.g. use of cognitively challenging trade-off-based method) and target population age, which makes it challenging to assess quality and its improvement in terms of methodological choices (e.g. the proportion of samples using proxy assessment). This is more so in the absence (to our knowledge) of any validated quality assessment tool for primary utility studies. That said, the increase in the proportion of samples reporting target population age over the review period was an unambiguous improvement, as was the decrease in the proportion of samples valuing hypothetical health states that may result in significant overestimation of disease burden relative to valuation of experienced health states in childhood [38]. There were also areas of concern. First, there was a lack of studies and samples set in lower and middle-income countries (LMICs). Only 8.2% of samples were from LMICs, consistent with the paucity of paediatric CUAs in LMICs, despite their substantially higher paediatric disease burdens [68, 91]. Among LMIC samples, 28.4% used VAS measures despite concerns over their validity for QALY construction [39], a proportion higher than for all samples (20.9%). Second, among the samples using MAUIs, 48.5% applied tariffs derived from populations foreign to the primary study setting, though the proportion fell from 51.7% in 1990–2008 to 46.9% in 2009–June 2017. Among LMIC samples that used MAUIs, this proportion was 75.5%. Clearly, there is a pressing need for more national tariff derivation studies, and for more accurate reporting of tariff information in publications.
There are several limitations to the study. First, some eligible studies may have been missed during the systematic review process, even though the search strategies were extensively piloted to maximise sensitivity. Second, several studies did not report or did not clearly specify important covariates, such as age and comorbidities, which may affect utility values. Third, the broad criteria for selection of valuation methods resulted in inclusion of modified forms of methods (e.g. for TTO, SG and HUI) and preference-based disease-specific instruments (e.g. PAHOM and ABC-UI), which complicated between-method comparisons. Fourth, the choice of 2009 as a transition point for all studies and samples was not based on potential causal or associative mechanisms determining the design and volume of primary utility research. Finally, cross-tabulations between methodological factors were limited to two-way Chi-square tests for association, and further research should consider application of multivariate regressions.
Conclusion
This systematic review reveals significant growth in both volume and diversity of childhood utility studies over the past three decades. HTA agencies should note the weak adherence to guidance concerning the use of reference case valuation methods by primary studies. There is a need for studies that derive tariffs in settings relevant to primary utility collection. Geographic coverage of utility assessment is heavily skewed to high-income countries, and further research in LMICs is pressing.
References
Drummond, M. F., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press.
NICE (2013). Guide to the methods of technology appraisal 2013.
SMC (2017). Working with SMC—A guide for manufacturers.
CADTH (2017). Guidelines for the economic evaluation of health technologies: Canada 4th Edition.
PBAC (2015). Guidelines for preparing submissions to the Pharmaceutical Benefits Advisory Committee (Version 4.5).
Neumann, P. J., Sanders, G. D., Russell, L. B., Siegel, J. E., & Ganiats, T. G. (2016). Cost-effectiveness in health and medicine. Oxford: Oxford University Press.
Torrance, G. W., & Feeny, D. (1989). Utilities and quality-adjusted life years. International Journal of Technology Assessment in Health Care, 5(4), 559–575.
Dolan, P., Gudex, C., Kind, P., & Williams, A. (1996). Valuing health states: A comparison of methods. Journal of Health Economics, 15(2), 209–231.
Brooks, R. (1996). EuroQol: The current state of play. Health Policy, 37(1), 53–72.
Torrance, G. W., Furlong, W., Feeny, D., & Boyle, M. (1995). Multi-attribute preference functions. Health Utilities Index. Pharmacoeconomics, 7(6), 503–520.
Brazier, J., Roberts, J., & Deverill, M. (2002). The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics, 21(2), 271–292.
Kaplan, R. M., Bush, J. W., & Berry, C. C. (1976). Health status: Types of validity and the index of well-being. Health Services Research, 11(4), 478–507.
Hawthorne, G., Richardson, J., & Osborne, R. (1999). The Assessment of Quality of Life (AQoL) instrument: A psychometric measure of health-related quality of life. Quality of Life Research, 8(3), 209–224.
Ungar, W., & Gerber, A. (2010). The uniqueness of child health and challenges to measuring costs and consequences. Economic Evaluation in Child Health, 3–32.
Ungar, W. J. (2011). Challenges in health state valuation in paediatric economic evaluation: Are QALYs contraindicated? Pharmacoeconomics, 29(8), 641–652. https://doi.org/10.2165/11591570.
Petrou, S. (2003). Methodological issues raised by preference-based approaches to measuring the health status of children. Health Economics, 12(8), 697–702. https://doi.org/10.1002/hec.775.
Ravens-Sieberer, U., Wille, N., Badia, X., Bonsel, G., Burstrom, K., Cavrini, G., et al. (2010). Feasibility, reliability, and validity of the EQ-5D-Y: Results from a multinational study. Quality of Life Research, 19(6), 887–897. https://doi.org/10.1007/s11136-010-9649-x.
Apajasalo, M., Sintonen, H., Holmberg, C., Sinkkonen, J., Aalberg, V., Pihko, H., et al. (1996). Quality of life in early adolescence: A sixteen-dimensional health-related measure (16D). Quality of Life Research, 5(2), 205–211.
Apajasalo, M., Rautonen, J., Holmberg, C., Sinkkonen, J., Aalberg, V., Pihko, H., et al. (1996). Quality of life in pre-adolescence: A 17-dimensional health-related measure (17D). Quality of Life Research, 5(6), 532–538.
Richardson, J. R., Peacock, S. J., Hawthorne, G., Iezzi, A., Elsworth, G., & Day, N. A. (2012). Construction of the descriptive system for the Assessment of Quality of Life AQoL-6D utility instrument. Health Qual Life Outcomes, 10, 38. https://doi.org/10.1186/1477-7525-10-38.
Stevens, K. J. (2010). Working with children to develop dimensions for a preference-based, generic, pediatric, health-related quality-of-life measure. Qualitative Health Research, 20(3), 340–351. https://doi.org/10.1177/1049732309358328.
Chen, G., & Ratcliffe, J. (2015). A review of the development and application of generic multi-attribute utility instruments for paediatric populations. Pharmacoeconomics, 33(10), 1013–1028. https://doi.org/10.1007/s40273-015-0286-7.
Montgomery, S. M., & Kusel, J. (2016). The prevalence of child-specific utilities in NICE appraisals for paediatric indications: Rise of the economic orphans? Expert Review of Pharmacoeconomics & Outcomes Research, 16(3), 347–350. https://doi.org/10.1080/14737167.2016.1179116.
Sullivan, S. M., Tsiplova, K., & Ungar, W. J. (2016). A scoping review of pediatric economic evaluation 1980–2014: Do trends over time reflect changing priorities in evaluation methods and childhood disease? Expert Review of Pharmacoeconomics & Outcomes Research, 16(5), 599–607.
Kromm, S. K., Bethell, J., Kraglund, F., Edwards, S. A., Laporte, A., Coyte, P. C., et al. (2012). Characteristics and quality of pediatric cost-utility analyses. Quality of Life Research, 21(8), 1315–1325. https://doi.org/10.1007/s11136-011-0049-7.
Weinstein, M. C., O’Brien, B., Hornberger, J., Jackson, J., Johannesson, M., McCabe, C., et al. (2003). Principles of good practice for decision analytic modeling in health-care evaluation: Report of the ISPOR Task Force on Good Research Practices–Modeling Studies. Value Health, 6(1), 9–17.
van Litsenburg, R. R., Kunst, A., Huisman, J., Ket, J. C., Kaspers, G. J., & Gemke, R. J. (2014). Health status utilities in pediatrics: A systematic review of acute lymphoblastic leukemia. Medical Decision Making, 34(1), 21–32. https://doi.org/10.1177/0272989X13497263.
Pickard, A. S., Topfer, L. A., & Feeny, D. H. (2004). A structured review of studies on health-related quality of life and economic evaluation in pediatric acute lymphoblastic leukemia. JNCI Monographs 33, 102–125, https://doi.org/10.1093/jncimonographs/lgh002.
Kua, W. S., & Davis, S. (2016). Systematic review of health state utilities in children with asthma. Value in Health, 19(7), A557–A557. https://doi.org/10.1016/j.jval.2016.09.1218.
Janssens, A., Rogers, M., Gumm, R., Jenkinson, C., Tennant, A., Logan, S., et al. (2016). Measurement properties of multidimensional patient-reported outcome measures in neurodisability: A systematic review of evaluation studies. Developmental Medicine & Child Neurology, 58(5), 437–451. https://doi.org/10.1111/dmcn.12982.
Brown, V., Tan, E. J., Hayes, A. J., Petrou, S., & Moodie, M. L. (2018). Utility values for childhood obesity interventions: A systematic review and meta-analysis of the evidence for use in economic evaluation. Obesity Reviews, 19(7), 905–916. https://doi.org/10.1111/obr.12672.
Noyes, J., & Edwards, R. T. (2011). EQ-5D for the assessment of health-related quality of life and resource allocation in children: A systematic methodological review. Value Health, 14(8), 1117–1129. https://doi.org/10.1016/j.jval.2011.07.011.
Mittmann, N., Trakas, K., Risebrough, N., & Liu, B. A. (1999). Utility scores for chronic conditions in a community-dwelling population. Pharmacoeconomics, 15(4), 369–376.
Carroll, A. E., & Downs, S. M. (2009). Improving decision analyses: Parent preferences (utility values) for pediatric health outcomes. The Journal of Pediatrics, 155(1), 21–25. https://doi.org/10.1016/j.jpeds.2009.01.040.
Ungar, W. J., & Santos, M. T. (2003). The pediatric economic database evaluation (PEDE) project: Establishing a database to study trends in pediatric economic evaluation. Medical Care, 41(10), 1142–1152. https://doi.org/10.1097/01.MLR.0000088451.56688.65.
Ungar, W. J. (2016). The pediatric economic database evaluation (PEDE) project. Toronto: The Hospital for Sick Children.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264–269, W264.
Kwon, J., Kim, S. W., Ungar, W. J., Tsiplova, K., Madan, J., & Petrou, S. (2018). A systematic review and meta-analysis of childhood health utilities. Medical Decision Making, 38(3), 277–305. https://doi.org/10.1177/0272989x17732990.
Parkin, D., & Devlin, N. (2006). Is there a case for using visual analogue scale valuations in cost-utility analysis? Health Economics, 15(7), 653–664. https://doi.org/10.1002/hec.1086.
WorldBank (2018). Low & middle income countries.
Juniper, E. F., Guyatt, G. H., Feeny, D. H., Griffith, L. E., & Ferrie, P. J. (1997). Minimum skills required by children to complete health-related quality of life instruments for asthma: Comparison of measurement properties. European Respiratory Journal, 10(10), 2285–2294. https://doi.org/10.1183/09031936.97.10102285.
Oostenbrink, R., HA, A. M., & Essink-Bot, M. L. (2002). The EQ-5D and the Health Utilities Index for permanent sequelae after meningitis: A head-to-head comparison. Journal of Clinical Epidemiology, 55(8), 791–799.
Raspa, M., Sacco, P., Candrilli, S. D., Bishop, E., & Petrillo, J. (2016). Validity of a condition specific outcome measure for fragile X syndrome: The Aberrant Behaviour Checklist-utility index. Journal of Intellectual Disability Research, 60(9), 844–855. https://doi.org/10.1111/jir.12264.
Chiou, C. F., Weaver, M. R., Bell, M. A., Lee, T. A., & Krieger, J. W. (2005). Development of the multi-attribute Pediatric Asthma Health Outcome Measure (PAHOM). International Journal for Quality in Health Care, 17(1), 23–30. https://doi.org/10.1093/intqhc/mzh086.
Kang, E. (2016). Validity of child health-6 dimension(Ch-6d) for adolescents. Value in Health, 19(7), A854–A854. https://doi.org/10.1016/j.jval.2016.08.458.
Lynch, F. L., Hornbrook, M., Clarke, G. N., Perrin, N., Polen, M. R., O’Connor, E., et al. (2005). Cost-effectiveness of an intervention to prevent depression in at-risk teens. Archives of General Psychiatry, 62(11), 1241–1248. https://doi.org/10.1001/archpsyc.62.11.1241.
Domino, M. E., Burns, B. J., Silva, S. G., Kratochvil, C. J., Vitiello, B., Reinecke, M. A., et al. (2008). Cost-effectiveness of treatments for adolescent depression: Results from TADS. The American Journal of Psychiatry, 165(5), 588–596. https://doi.org/10.1176/appi.ajp.2008.07101610.
Domino, M. E., Foster, E. M., Vitiello, B., Kratochvil, C. J., Burns, B. J., Silva, S. G., et al. (2009). Relative cost-effectiveness of treatments for adolescent depression: 36-week results from the TADS randomized trial. Journal of the American Academy of Child and Adolescent Psychiatry, 48(7), 711–720. https://doi.org/10.1097/CHI.0b013e3181a2b319.
McBain, R. K., Salhi, C., Hann, K., Salomon, J. A., Kim, J. J., & Betancourt, T. S. (2016). Costs and cost-effectiveness of a mental health intervention for war-affected young persons: decision analysis based on a randomized controlled trial. Health Policy and Planning, 31(4), 415–424. https://doi.org/10.1093/heapol/czv078.
Hartman, J. D., Craig, B. M., Blackburn, C., & Simmons, V. (2016). The Association between Maternal Smoking during Pregnancy and Child Quality-Adjusted Life Years. Value in Health, 19(3), A117–A117. https://doi.org/10.1016/j.jval.2016.03.463.
Barr, R. D., Furlong, W., Dawson, S., Whitton, A. C., Strautmanis, I., Pai, M., et al. (1993). An assessment of global health status in survivors of acute lymphoblastic leukemia in childhood. The American Journal of Pediatric Hematology/Oncology, 15(3), 284–290.
Barr, R., Pai, M., Weitzman, S., Feeny, D., Furlong, W., Rosenbaum, P., et al. (1994). A multiattribute approach to health-status measurement and clinical management illustrated by an application to brain-tumors in childhood. International Journal of Oncology, 4(3), 639–648.
Lee, D., Gladwell, D., Batty, A. J., Brereton, N., & Tate, E. (2013). The cost effectiveness of licensed oromucosal midazolam (Buccolam((R))) for the treatment of children experiencing acute epileptic seizures: An approach when trial evidence is limited. Pediatric Drugs, 15(2), 151–162. https://doi.org/10.1007/s40272-013-0009-5.
Tarride, J. E., Burke, N., Bischof, M., Hopkins, R. B., Goeree, L., Campbell, K., et al. (2010). A review of health utilities across conditions common in paediatric and adult populations. Health and Quality of Life Outcomes, 8, 12. https://doi.org/10.1186/1477-7525-8-12.
Thorrington, D., & Eames, K. (2015). Measuring health utilities in children and adolescents: A systematic review of the literature. PLoS ONE, 10(8), e0135672. https://doi.org/10.1371/journal.pone.0135672.
Brazier, J., Roberts, J., Tsuchiya, A., & Busschbach, J. (2004). A comparison of the EQ-5D and SF-6D across seven patient groups. Health Economics, 13(9), 873–884. https://doi.org/10.1002/hec.866.
Petrou, S., Kwon, J., & Madan, J. (2018). A practical guide to conducting a systematic review and meta-analysis of health state utility values. Pharmacoeconomics. https://doi.org/10.1007/s40273-018-0670-1.
Peasgood, T., Ward, S. E., & Brazier, J. (2010). Health-state utility values in breast cancer. Expert Review of Pharmacoeconomics & Outcomes Research, 10(5), 553–566.
McLernon, D., Dillon, J., & Donnan, P. (2006). Health-state utilities in liver disease: A systematic review and meta-analysis. Value in Health, 9(6), A245–A246.
Wyld, M., Morton, R. L., Hayen, A., Howard, K., & Webster, A. C. (2012). A systematic review and meta-analysis of utility-based quality of life in chronic kidney disease treatments. PLoS Medicine, 9(9), e1001307.
Bremner, K. E., Chong, C. A., Tomlinson, G., Alibhai, S. M., & Krahn, M. D. (2007). A review and meta-analysis of prostate cancer utilities. Medical Decision Making, 27(3), 288–298.
Van Osch, S. M., Wakker, P. P., Van Den Hout, W. B., & Stiggelbout, A. M. (2004). Correcting biases in standard gamble and time tradeoff utilities. Medical Decision Making, 24(5), 511–517.
Were, W. M., Daelmans, B., Bhutta, Z., Duke, T., Bahl, R., Boschi-Pinto, C., et al. (2015). Children’s health priorities and interventions. BMJ, 351, h4300.
Laski, L., & Expert Consultative Group for Every Woman Every Child on Adolescent (2015). Realising the health and wellbeing of adolescents. BMJ, 351, h4119. https://doi.org/10.1136/bmj.h4119.
Sullivan, S. M., & Ungar, W. J. (2016). Will the growth spurt continue? Trends in child health economic evaluation: 1980 to 2013.
Adlard, N., Kinghorn, P., & Frew, E. (2014). Is the UK NICE “Reference Case” influencing the practice of pediatric quality-adjusted life-year measurement within economic evaluations? Value in Health, 17(4), 454–461.
Ratcliffe, J., Stevens, K., Flynn, T., Brazier, J., & Sawyer, M. G. (2012). Whose values in health? An empirical comparison of the application of adolescent and adult values for the CHU-9D and AQOL-6D in the Australian adolescent general population. Value in Health, 15(5), 730–736.
Ungar, W. J., & Zur, R. M. (2015). Health economic evaluation for improving child health in low-and middle-income countries. In Optimizing treatment for children in the developing world (pp. 213–224). Berlin: Springer.
Moodie, M., Richardson, J., Rankin, B., Iezzi, A., & Sinha, K. (2010). Predicting time trade-off health state valuations of adolescents in four Pacific countries using the Assessment of Quality-of-Life (AQoL-6D) instrument. Value Health, 13(8), 1014–1027. https://doi.org/10.1111/j.1524-4733.2010.00780.x.
Richardson, J., Atherton Day, N., Peacock, S., & Iezzi, A. (2004). Measurement of the quality of life for economic evaluation and the Assessment of Quality of Life (AQoL) Mark 2 instrument. Australian Economic Review, 37(1), 62–88.
Ratcliffe, J., Flynn, T., Terlich, F., Stevens, K., Brazier, J., & Sawyer, M. (2012). Developing adolescent-specific health state values for economic evaluation: an application of profile case best-worst scaling to the Child Health Utility 9D. Pharmacoeconomics, 30(8), 713–727. https://doi.org/10.2165/11597900-000000000-00000.
Ratcliffe, J., Huynh, E., Chen, G., Stevens, K., Swait, J., Brazier, J., et al. (2016). Valuing the Child Health Utility 9D: Using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Social Science & Medicine, 157, 48–59. https://doi.org/10.1016/j.socscimed.2016.03.042.
Stevens, K., Brazier, J., McKenna, S., Doward, L., & Cork, M. (2005). The development of a preference-based measure of health in children with atopic dermatitis. British Journal of Dermatology, 153(2), 372–377.
Wu, X., Ohinmaa, A., Johnson, J., & Veugelers, P. (2014). Assessment of children’s own health status using visual analogue scale and descriptive system of the EQ-5D-Y: Linkage between two systems. Quality of Life Research, 23(2), 393–402.
Dolan, P. (1997). Modeling valuations for EuroQol health states. Medical Care, 35(11), 1095–1108.
Lamers, L. M., Stalmeier, P. F., McDonnell, J., Krabbe, P. F., & van Busschbach, J. J. (2005). [Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff]. Ned Tijdschr Geneeskd, 149(28), 1574–1578.
Oppe, M., Devlin, N. J., & Szende, A. (2007). EQ-5D value sets: Inventory, comparative review and user guide. Berlin: Springer.
Viney, R., Norman, R., King, M. T., Cronin, P., Street, D. J., Knox, S., et al. (2011). Time trade-off derived EQ-5D weights for Australia. Value Health, 14(6), 928–936. https://doi.org/10.1016/j.jval.2011.04.009.
Chevalier, J., & de Pouvourville, G. (2013). Valuing EQ-5D using Time Trade-Off in France. European Journal of Health Economics, 14(1), 57–66. https://doi.org/10.1007/s10198-011-0351-x.
Burström, K., Sun, S., Gerdtham, U.-G., Henriksson, M., Johannesson, M., Levin, L., et al. (2014). Swedish experience-based value sets for EQ-5D health states. Quality of Life Research, 23(2), 431–442.
Greiner, W., Weijnen, T., Nieuwenhuizen, M., Oppe, S., Badia, X., Busschbach, J., et al. (2003). A single European currency for EQ-5D health states. Results from a six-country study. European Journal of Health Economics, 4(3), 222–231. https://doi.org/10.1007/s10198-003-0182-5.
Shaw, J. W., Johnson, J. A., & Coons, S. J. (2005). US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Medical Care, 43(3), 203–220.
Gerald, J. K., McClure, L. A., Harrington, K. F., Moore, T., Hernandez-Martinez, A. C., & Gerald, L. B. (2012). Measurement characteristics of the pediatric asthma health outcome measure. Journal of Asthma, 49(3), 260–266. https://doi.org/10.3109/02770903.2012.656863.
Torrance, G. W., Feeny, D. H., Furlong, W. J., Barr, R. D., Zhang, Y., & Wang, Q. (1996). Multiattribute utility function for a comprehensive health status classification system: Health Utilities Index Mark 2. Medical Care, 34, 702–722.
Cadman, D., Goldsmith, C., Torrance, G., Boyle, M., & Furlong, W. (1986). Development of a health status index for Ontario children. Final Report to the Ontario Ministry of Health on Research Grant DM, 648, 00633.
Wang, Q. N., Furlong, W., Feeny, D., Torrance, G., & Barr, R. (2002). How robust is the Health Utilities Index Mark 2 utility function? Medical Decision Making, 22(4), 350–358. https://doi.org/10.1177/027298902400448911.
McCabe, C. J., Stevens, K. J., & Brazier, J. E. (2005). Utility scores for the health utilities index mark 2—An empirical assessment of alternative mapping functions. Medical Care, 43(6), 627–635. https://doi.org/10.1097/01.mlr.0000163666.00471.8e.
Feeny, D., Furlong, W., Torrance, G. W., Goldsmith, C. H., Zhu, Z., DePauw, S., et al. (2002). Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care, 40(2), 113–128.
Kaplan, R. M., Anderson, J. P., Wu, A. W., Mathews, W. C., Kozin, F., & Orenstein, D. (1989). The Quality of Well-being Scale. Applications in AIDS, cystic fibrosis, and arthritis. Medical Care, 27(3 Suppl), S27–S43.
Kerr, C., Breheny, K., Lloyd, A., Brazier, J., Bailey, D. B. Jr., Berry-Kravis, E., et al. (2015). Developing a utility index for the Aberrant Behavior Checklist (ABC-C) for fragile X syndrome. Quality of Life Research, 24(2), 305–314. https://doi.org/10.1007/s11136-014-0759-8.
Ungar, W. (2007). Paediatric health economic evaluations: a world view. Healthcare Quarterly, 10(1), 134–140. 142 – 135; discussion 145 – 136.
Acknowledgements
We would like to thank Samantha Johnson for her assistance with the development and piloting of the literature search strategies. The Warwick Clinical Trials Unit, University of Warwick, benefited from facilities funded through the Birmingham Science City Translational Medicine Clinical Research and Infrastructure Trials Platform, with support from Advantage West Midlands. The views contained within this paper are those of the authors and not necessarily of the funders.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Mr Joseph Kwon, Dr Sungwook Kim, Dr Wendy J. Ungar, Ms Kate Tsiplova, Dr Jason Madan and Dr Stavros Petrou declares that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
11136_2019_2121_MOESM1_ESM.docx
Supplementary material 1 ONLINE RESOURCE Excel database containing information on all 3,974 sub-samples of health utilities and descriptors can be found online at http://childhoodutilities.wordpress.com. The website also contains the detailed search strategy and a guidance note for Excel navigation. (DOCX 162 KB)
Rights and permissions
OpenAccess This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Kwon, J., Kim, S.W., Ungar, W.J. et al. Patterns, trends and methodological associations in the measurement and valuation of childhood health utilities. Qual Life Res 28, 1705–1724 (2019). https://doi.org/10.1007/s11136-019-02121-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-019-02121-z