Skip to main content
Download PDF

Perspective and Costing in Cost-Effectiveness Analysis, 1974–2018

PharmacoEconomics volume 38, pages 1135–1145 (2020)Cite this article

A Correction to this article was published on 21 October 2020

This article has been updated

Abstract

Objective

Our objective was to examine perspective and costing approaches used in cost-effectiveness analyses (CEAs) and the distribution of reported incremental cost-effectiveness ratios (ICERs).

Methods

We analyzed the Tufts Medical Center’s CEA and Global Health CEA registries, containing 6907 cost-per-quality-adjusted-life-year (QALY) and 698 cost-per-disability-adjusted-life-year (DALY) studies published through 2018. We examined how often published CEAs included non-health consequences and their impact on ICERs. We also reviewed 45 country-specific guidelines to examine recommended analytic perspectives.

Results

Study authors often mis-specified or did not clearly state the perspective used. After re-classification by registry reviewers, a healthcare sector or payer perspective was most prevalent (74%). CEAs rarely included unrelated medical costs and impacts on non-healthcare sectors. The most common non-health consequence included was productivity loss in the cost-per-QALY studies (12%) and patient transportation in the cost-per-DALY studies (21%). Of 19,946 cost-per-QALY ratios, the median ICER was $US26,000/QALY (interquartile range [IQR] 2900–110,000), and 18% were cost saving and QALY increasing. Of 5572 cost-per-DALY ratios, the median ICER was $US430/DALY (IQR 67–3400), and 8% were cost saving and DALY averting. Based on 16 cost-per-QALY studies (2017–2018) reporting 68 ICERs from both the healthcare sector and societal perspectives, the median ICER from a societal perspective ($US22,710/QALY [IQR 11,991–49,603]) was more favorable than from a healthcare sector perspective ($US30,402/QALY [IQR 10,486–77,179]). Most governmental guidelines (67%) recommended either a healthcare sector or a payer perspective.

Conclusion

Researchers should justify and be transparent about their choice of perspective and costing approaches. The use of the impact inventory and reporting of disaggregate outcomes can reduce inconsistencies and confusion.

FormalPara Key Points for Decision Makers
The analytic perspective assumed in cost-effectiveness analysis determines which costs and benefits are included. Despite its importance, study authors often mis-specified or did not clearly state the perspective used.
When a societal perspective was used, authors often did not apply it as broadly as intended. Only a few non-health consequences, such as productivity or transportation, were considered, whereas broader non-healthcare sector impacts were seldom examined.
The use of a healthcare payer or a healthcare sector perspective persists in most published studies and national guidelines because “relevant” non-health benefits and costs are often difficult to define and may depend on the context. The consistent use of the impact inventory and reporting of disaggregate outcomes can help reduce discrepancies across analyses capturing non-health consequences.

Background

Practice guidelines for cost-effectiveness analysis (CEAs) emphasize the importance of the analytic perspective assumed in the analysis because it determines which costs and benefits are included [1,2,3,4]. The perspective may reflect a patient, a specific payer (public or private), the entire healthcare sector, or all of society. The choice of perspective and included cost components may have a substantial impact on the cost-effectiveness of interventions and, consequently, policy and resource allocation decision making [5,6,7].

Ideally, the relevant audience—i.e., the population “on whose behalf are decisions made”—influences the choice of perspective [8]. Practice guidelines that endorse a broader societal perspective argue that considering everyone affected and counting all benefits and costs, regardless of who gains or loses, can provide the basis for fair decisions in the public interest [1, 8, 9]. A societal perspective means that all resources (both health related and not) associated with the intervention should be identified, measured, and valued. Some guidelines, such as the Original Panel on Cost-Effectiveness in Health and Medicine in 1996 [8], have suggested the use of a societal perspective as a reference case analysis to encourage comparability and consistency of the analytic perspective across CEAs.

However, since publication of the Original Panel’s guideline, awareness of challenges in how to implement a “societal” perspective has grown. Recognizing practical difficulties and the revealed preferences of some policy makers to support narrower perspectives, the Second Panel on Cost-Effectiveness in Health and Medicine revised the original guidelines in 2016. A major change in the Second Panel’s guideline includes two reference case analyses, from both a healthcare sector and a societal perspective [10]. Along with the recommendation, the Second Panel advises the use of an “impact inventory” to help standardize practice and reduce confusion. The impact inventory is a structured table listing an intervention’s health and non-health consequences, including those falling outside the formal healthcare sector. Although the Second Panel’s updated recommendation for the inclusion of an impact inventory was published in 2016, to our knowledge, its impact on practice has not yet been evaluated.

Understanding past and current practices can shed light on the gap between guideline recommendations and actual behavior and provide future directions for improvement. Although a few studies have documented variations in perspective used and costing approaches [11,12,13], the number of published CEAs has increased substantially in recent years, and many countries have formally adopted a health technology assessment (HTA) process [14]. We sought to examine the use of perspective and costing approaches, including the use of multiple perspectives and the impact inventory, in published CEAs through 2018 and their impact on reported incremental cost-effectiveness ratios (ICERs). In addition, we reviewed 45 country-specific guidelines to examine recommended analytic perspectives in HTA.

Methods

Working Definitions

In this paper, we avoid the widespread notions of “direct” and “indirect” costs as it is often difficult to differentiate between direct and indirect consequences of disease and its treatment. Also, a range of possible consequences could be deemed “direct” depending on the perspective of the analysis (e.g., all non-health consequences that influence public welfare can be considered “direct” from a societal perspective) [15]. Instead, we use the term “non-health consequence” to capture both medical and non-medical resources consumed. The non-health consequences include patient time, transportation costs, caregiver time, productivity, and other non-healthcare sector impacts on education, criminal justice, housing, and environment. Based on this categorization, we applied the following definition of analytic perspectives:


Healthcare payer: This perspective includes only those monetary costs (e.g., treatment costs and other health service resource use associated with disease management) incurred by a (typically third party) healthcare payer (e.g., Medicare/Medicaid, British national health service, a health maintenance organization, etc.).


Healthcare sector: This perspective is similar to the healthcare payer perspective but accounts for all monetary costs of healthcare, regardless of who bears the cost. A key distinction between the healthcare sector and healthcare payer perspectives is that the healthcare sector perspective includes patients’ out-of-pocket costs.


Limited societal: This perspective accounts for cost components beyond those captured by the healthcare sector perspective, including patient time, patient transportation, unpaid caregiver time, and productivity loss. It excludes spillover impacts affecting sectors other than healthcare, such as education.


Societal: A societal perspective is broader than the limited societal perspective. It represents the overall public interest by including all resources that could be used for other purposes. The analysis accounts for cost impacts affecting at least one of these other sectors, such as the environment, education, or the justice system.


Not stated/could not be determined: This designation indicates that the authors did not provide sufficient information for us to determine the type of costs or benefits included in the analysis.

Data

We analyzed data from the Tufts Medical Center’s CEA Registry (a database of cost-per-quality-adjusted-life-year [QALY] studies; available at www.cearegistry.org) and the Global Health CEA (GHCEA) registry (an open-access database of cost-per-disability-adjusted-life-year [DALY] studies; available at www.ghcearegistry.org). Both registries contain information from English-language, PubMed-indexed original CEAs (i.e., excluding reviews, editorials, or methodological articles) from 1974 through 2018, which report at least one cost-per-QALY gained or cost-per-DALY averted ratio, including interventions with cost-saving (i.e., dominant) or dominated ratios. We identified 6907 cost-per-QALY and 698 cost-per-DALY studies, reporting 19,946 and 5572 intervention-specific ICERs, respectively. All of the ratios available in the registries were converted to $US, year 2018 values based on currency conversions [16] and inflation adjustments using the consumer price index [17].

Both registries applied structured and standardized data collection processes to ensure the consistency and quality of the data. Methodological details are available elsewhere [18, 19], including the registry website, but we briefly summarized the process. After an initial literature search, at least two registry reviewers independently conduct abstract screening to determine eligibility for the full review. Among articles selected for the full review, each reviewer used a prespecified data collection form to extract information on a wide range of variables, including author affiliation, study country, study sponsorship, intervention, comparator(s), target population, perspective, time horizon, discounting rate, cost-effectiveness ratios, etc.[20]. Throughout the process, the reviewers engaged in a consensus discussion to address any discrepancies before moving onto the next step.

Main Analyses

We first investigated the use of perspective and its changes over time among cost-per-QALY and cost-per-DALY studies, including any discrepancies between the perspective reported by the study authors and the perspective used in the analysis, as determined by our registry reviewers. Registry reviewers extracted information pertaining to the analytic perspective stated by authors, and two trained reviewers reclassified the perspective based on their assessment of the presented analysis and cost components included. For example, if an author stated that the analysis used the societal perspective but did not describe the inclusion in the analysis of any spillover costs affecting other sectors (e.g., education, housing, judicial), then the reviewer designated the actual perspective as limited societal. For comparative analyses, we excluded papers for which the perspective was not stated/could not be determined and aggregated the remaining papers into either societal/limited societal or healthcare sector/payer.

We also examined how often published CEAs included cost components beyond those traditionally included in an analysis from a healthcare sector perspective. Due to changes in the data collection methodology for the CEA registry [20], we were only able to obtain information on specific cost components included in cost-per-QALY articles published since 2013 (N = 2839 of 6907). On the other hand, we retained that information for all 698 cost-per-DALY studies in the GHCEA registry.

We compared cost components included in cost-per-QALY versus cost-per-DALY studies and then investigated how the choice of the analytic perspective influences the reported ICERs across different intervention types and study sponsors. To further examine the association between the inclusion of cost components and reported ICER values, we analyzed a subset of cost-per-QALY studies (those published in 2017–2018) and cost-per-DALY studies that reported cost-effectiveness ratios from both a healthcare sector and a societal perspective. Using ratios drawn from the same study makes it possible to isolate the impact of altering the perspective while holding all other aspects of the CEA unchanged. Additionally, we examined the inclusion of the impact inventory, which is recommended by the Second Panel.

Secondary Analysis of the National Health Technology Assessment (HTA) Guidelines

We also reviewed 45 national, country-specific guidelines governing economic evaluation or HTA to examine differences in recommended analytic perspectives across countries. We identified the national guidelines from a literature search, online databases, and published reviews of HTA guidelines [21,22,23,24,25,26,27]. We classified the recommended perspectives based on the cost components recommended for inclusion and from the guideline perspective statements. In some cases, although the guidelines recommended a healthcare sector perspective, they only accounted for healthcare payer costs, and we reclassified them as describing a healthcare payer perspective. Additionally, among the top five countries with most CEAs produced (the USA, the UK, Canada, Netherlands, and Australia), we examined differences in the proportions using the societal perspective and its consistency with the national guidelines.

Results

Main Analysis 1: Perspective Used and Costing Approaches

Study authors often mis-specified the perspective used, and 20% of CEAs (both cost-per-QALY and cost-per-DALY studies) did not clearly state the study perspective. After the registry reviewers reclassified the study perspective based on types of costs or benefits evaluated, the study perspective was unable to be determined in only 7% of CEAs. Based on the perspective as determined by registry reviewers, published CEAs most often used a healthcare sector perspective (75% of cost-per-QALY studies and 65% of cost-per-DALY studies). Our data indicate that cost-per-QALY study authors reported a societal/limited societal perspective more frequently than it was actually used, as determined by registry reviewers. In contrast, cost-per-DALY study authors tended to underreport the use of a societal/limited societal perspective by mis-specifying it as a healthcare sector perspective (Table 1). While the use of the healthcare perspective in cost-per-QALY studies has increased over the past decade (Fig. 1), the perspective used in cost-per-DALY studies has not changed significantly over time (Electronic Supplementary Material [ESM] A: Table A and Fig. A).

Table 1 Perspective used in published cost-effectiveness analyses, 1974–2018 (N = 6907)
Full size table
Fig. 1
figure 1

Trends in analytic perspectives used in cost-per-QALY studies: 1974–2018 (N = 6,907). With relatively small number of cost-per-QALY studies published prior to 1990 (n = 18, 0.3%), the Figure shows the data points since 1990. A similar figure for cost-per-DALY studies is available in the Online Supplement Figure A

Full size image

Although most studies included immediate medical costs associated with the intervention, less than half included future medical costs related to the intervention (Fig. 2). While future unrelated medical cost data were not available in the cost-per-QALY registry, cost-per-DALY studies rarely included future unrelated medical costs (i.e., background medical costs of treating conditions in added years of life). Cost-per-DALY studies were more likely to include at least one cost component outside of the healthcare sector (36 vs. 10% cost-per-QALY studies). The most commonly included non-health consequence was productivity (12%) in cost-per-QALY studies and patient transportation (21%) in cost-per-DALY studies. Published CEAs rarely examined impacts affecting other non-healthcare sectors, such as criminal justice, education, and housing (2% among cost-per-QALY studies, and 5% among cost-per-DALY studies).

Fig. 2
figure 2

Cost components included in published cost-effectiveness analyses. *Future unrelated medical cost data was not available for cost-per-QALY studies. Due to the changes in the data collection methodology, we were only able to obtain cost components included in cost-per-QALY literature published since 2013 (N = 2,839 out of 6,907)

Full size image

Main Analysis 2: Association Between Study Characteristics and Incremental Cost-Effectiveness Ratio

Of 19,946 cost-per-QALY ratios in our sample, the median ICER was $US26,000/QALY (interquartile range [IQR] 2900–110,000), and 18% of ratios were cost saving and QALY increasing. Of 5572 cost-per-DALY ratios, the median ICER was $US430/DALY (IQR 67–3400), and 8% of ratios were cost saving and DALY averting. Pharmaceuticals were the most common intervention type examined in both types of studies, followed by immunizations (29.7%) and health education (26.3%) among cost-per-DALY studies, and medical or surgical procedures (19.4%) and care delivery (8.2%) among cost-per-QALY studies.

Overall, among cost-per-QALY ratios calculated from a healthcare sector perspective (76%), the median ICER was $US25,000/QALY (IQR 3100–100,000); the corresponding median ICER among the ratios calculated from a societal perspective was $US30,000/QALY (IQR 2300–150,000). Among cost-per-DALY ratios calculated from a healthcare sector perspective (74%), the median was $US460/DALY (IQR 74–3500); it was $US345/DALY (IQR 51–2700) in societal perspective analyses (ESM A: Table B and Fig. B).

In the cost-per-QALY literature, drug and device industry-sponsored studies consistently reported lower median ICERs than non-industry-sponsored studies from both perspectives (i.e., $US18,000 vs. 31,000/QALY from a healthcare sector perspective and $US27,000 vs. 36,000/QALY from a societal perspective). We found a paucity of cost-per-DALY ratios from industry-sponsored studies (4%, n = 197), and none of the industry-sponsored cost-per-DALY ratios reported that the interventions were “dominated” (i.e., less effective and more costly than its comparator; ESM A: Tables C and D).

Main Analysis 3: The Use of Impact Inventory and Multiple Perspectives

For the years 2017–2018, we identified 11 cost-per-QALY studies (1.0%) that included the impact inventory table (we did not collect this information among cost-per-DALY studies). Nine of 11 studies came from the USA (n = 5) or the UK (n = 4), from which at least one member of the Second Panel came. Two other studies were from Ireland and Switzerland.

We found that 16 cost-per-QALY studies (1.4%) reported a total of 68 cost-per-QALY ratios from a healthcare sector and a societal perspective (34 ratios from each perspective), and five cost-per-DALY studies (0.7%) reported a total of 72 cost-per-DALY ratios (36 ratios from each perspective). Seven of 16 cost-per-QALY studies reported one ratio from each perspective [28,29,30,31,32,33,34], whereas two studies reported five and six intervention-specific ratios from each perspective, respectively [35, 36]. Four of five cost-per-DALY studies reported one or two ratios from each perspective [37,38,39,40], and one multicountry study reported 31 ratios from each perspective [41].

The studies that reported ratios from both perspectives had lower (more favorable) median ICERs from a societal perspective ($US22,710/QALY [IQR 11,991–49,603] and $US804/DALY [IQR {cost saving}–3277) than from a healthcare sector perspective ($US30,402/QALY [IQR 10,486–77,179] and $US5119/DALY [IQR 3186–5607]). Due to expensive treatments relative to the non-health benefits, three studies that included specific non-health consequences, such as productivity or caregiver cost, reported higher median ICERs than those from 16 studies that used a healthcare sector perspective (Fig. 3). However, within these studies [31, 42, 43], the median ICER from a societal perspective was substantially lower than that from a healthcare perspective ($US42,745 vs. 123,514/QALY, respectively).

Fig. 3
figure 3

Incremental cost-effectiveness ratios by the inclusion of non-health components. Note: The size of the circle represents the volume of included studies for each perspective non-health components. For studies that included each cost component, the center of the circle denotes the median incremental cost-effectiveness ratios (ICER) while the lines extend to the 25th and 75th percentiles, the inter-quartile range (IQR). Due to the wide IQR of some ICERs, Lines extending to the x-axis represent interventions that were cost-saving at the 25th percentile. None of the cost-per-DALY studies included productivity or non-healthcare sector costs

Full size image

Secondary Analysis: Recommended Perspectives by National Guidelines on HTA

Most government guidelines (67%) recommend either a healthcare payer or healthcare sector perspective as the reference perspective (Fig. 4 and ESM A, Table E). Eighteen countries (40%) endorse the healthcare payer perspective with supplementary use of a broader societal or another perspective, and three additional countries (i.e., Israel, New Zealand, and Scotland; 7%) recommend using only a healthcare payer perspective. A societal perspective, with or without a supplementary perspective, is the primary analytic perspective in 12 countries (27%). Three of the reviewed countries (Indonesia, Italy, and Spain; 7%) recommend consideration of both societal and healthcare payer perspectives. For the subanalysis of the most recently published or updated guidelines in the past 5 years, the proportion of guidelines recommending a healthcare payer or healthcare sector perspective was higher than the overall rate of 67% (30 of 45 guidelines published in 1998–2019) at 71% (15 of 21 guidelines published in 2015–2019; ESM A: Table E, and ESM B).

Fig. 4
figure 4

available at https://pngimg.com/imgs/miscellaneous/world_map/

Recommended perspectives across 45 national guidelines on health technology assessment. Note: The Figure used the world map frame

Full size image

Our country-specific analysis showed that the proportion of cost-per-QALY studies for the Netherlands from a societal perspective was 49% (232 of 476), almost three times higher than the average among the entire cost-per-QALY literature (16.9%). Among the top five CEA-producing countries, the Netherlands was the only one that recommended a societal perspective, whereas the UK, Canada, and Australia recommended a narrower (national healthcare payer or healthcare sector) perspective. Only 14% (99 of 519) and 10% (118 of 1225) of Australia- and UK-based cost-per-QALY studies were conducted from a societal perspective, respectively (ESM A: Fig. C).

Discussion

Using an updated database of published CEA, we found that key study attributes—including perspective and cost components considered—varied substantially across types of evaluation and setting. In particular, we found a considerable discrepancy between the author’s stated perspective and our reviewers’ judgments about the perspective used. It appears that some researchers are unclear on what cost components should be included in a CEA conducted from a societal perspective. When analysts did use a societal perspective, they often did not apply it as broadly as the Second Panel and other experts intended. Only a few non-health consequences related to the intervention—for example, productivity or transportation—were considered, whereas broader non-healthcare sector impacts—for example, those affecting the criminal justice system or education—were seldom examined.

We also found substantial variation among reported cost-effectiveness ratios by study characteristics and costing approaches. Specifically, the analysis of the subset of cost-per-QALY and cost-per-DALY studies that included multiple perspectives found that the inclusion of broader non-health consequences generally resulted in lower (more favorable) cost-effectiveness ratios. For example, pharmacotherapy for patients with alcohol use disorder becomes more cost-effective when improved outcomes that go beyond the healthcare sector, such as improved productivity or reduced alcohol-related motor vehicle accidents, are accounted for [44]. However, this may not always be the case as the inclusion of non-health consequences can sometimes result in less favorable cost-effectiveness ratios (e.g., the early discharge of patients from hospitals can lead to higher informal caregiver costs and thus less favorable cost effectiveness).

However, the use of a healthcare payer or a healthcare sector perspective persists in most published studies and national guidelines. By taking a narrower perspective, some aspects of societal value elements can be omitted, and, possibly, decisions based on such analysis may not optimize overall welfare. In practice, as our analysis indicated inconsistent and incomplete inclusion of non-health consequences across CEAs, normative questions about how to define “relevant” non-health benefits and costs are often difficult to answer and may depend on the context. As Culyer et al. [21] noted, “the perspective will usually be context-dependent, with the context determining the appropriate perspective.”

Without knowing the context of the decision being made, researchers may continue to struggle to implement a broader societal perspective. A step forward would be to increase the use of an impact inventory, as this can ensure that all of the standardized consequences of interventions, including those falling outside the formal healthcare sector, are considered regularly and comprehensively [14]. Despite a low uptake of the impact inventory in the first 2 years since the Second Panel’s recommendation, the trend is upward (0.7% in 2017, 1.4% in 2018, and 2.7% in 2019 [based on partial 2019 data]), and the Institute for Clinical and Economic Review included it as part of its evidence assessments [45]. Widespread use of the impact inventory would provide the relevant information in a comprehensive, consistent, and transparent manner to guide decision makers with different preferences with regard to what should be included in a technology assessment. For example, a recent commentary provided a modified impact inventory to list a set of key health and social consequences to consider when evaluating the cost effectiveness of policy responses for coronavirus disease 2019 (COVID-19) [46].

Although relevant non-health consequences can be identified, how to measure and value these consequences poses challenges. Researchers have pointed to a few methodological questions involved in costing, such as whether estimated costs should explicitly account for lost productivity from morbidity, whether such effects are already captured in measuring QALYs, or whether analysts should capture unrelated downstream costs (e.g., future unrelated medical costs and non-health consumptions during the extended life-years) [47,48,49,50,51,52]. In addition, analytic difficulties—including the lack of available data (e.g., on informal caregiver time or non-labor market productivity) [53]—have impeded the widespread implementation of a societal perspective in practice. Developing a country-specific cost catalog for non-health consequences (e.g., criminal justice system resource use, hourly wages, and annual non-health consumption) can help standardize and promote CEAs from a societal perspective [54].

Our study documented the lack of inclusion of informal caregiver time (i.e., spillover costs). However, an important health consequence—spillover health effects on family members and informal caregivers of patients, which might be considered irrespective of the perspective chosen—is also often omitted [55]. For example, CEAs of interventions for Alzheimer’s disease or a pediatric population are more likely to include both types of spillover effects than the overall literature, but spillover health effects were considered substantially less often than spillover costs [56, 57]. Recent advances in methodology and applications for measuring and valuing spillover effects have provided a set of useful resources for analysts to incorporate the spillover effects into CEAs from both a healthcare sector and a societal perspective [58].

Our analyses have some limitations. The CEA and GHCEA registries catalog only English-language, published cost-per-QALY-gained and cost-per-DALY-averted studies and do not capture the gray literature (e.g., HTA reports that may not be disseminated in regularly published, indexed journals) or other databases. Still, one study found that our registry databases reached 95% of published cost-per-QALY or cost-per-DALY literature [59]. In addition, the classification of the analytic perspective and costing approach involves reviewer judgment based on the available information (e.g., whether the stated perspective was matched with cost components presented). Despite our efforts to reduce discrepancies by holding consensus meetings with at least two reviewers, others may render different judgments.

In the analysis of the national HTA guidelines, although we performed a detailed scoping literature search to identify the most recent country-specific recommendations, our search may have failed to identify updated versions of some of the recommendations. In addition, some of the guidelines provided scarce information about the recommended perspective. In these cases, we either used the perspective stated in the guideline or categorized the perspective based on the limited information provided.

Conclusion

The choice of analytic perspective and cost components to include in a health economic evaluation can have an important impact on value assessment. Researchers and analysts should be transparent about their choices. Revised guidelines by the Second Panel, including the use of the impact inventory and reporting of disaggregated outcomes, can help reduce inconsistencies across analyses and the attendant confusion.

Data Availability

The data used in our analysis are publicly accessible through Tufts Medical Center’s CEA registry (restricted public access), the GHCEA registry (open access), and country-specific guidelines (available online). The specific analytic datasets are available from the corresponding author upon reasonable request.

Change history

  • 21 October 2020

    The article Perspective and��Costing in��Cost-Effectiveness Analysis.

References

  1. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015.

    Google Scholar 

  2. Garrison LP Jr, Pauly MV, Willke RJ, Neumann PJ. An overview of value, perspective, and decision context-A health economics approach: an ISPOR special task force report [2]. Value Health. 2018;21(2):124–30.

    PubMed  Google Scholar 

  3. Wilkinson T, Sculpher MJ, Claxton K, Revill P, Briggs A, Cairns JA, et al. The International decision support initiative reference case for economic evaluation: an aid to thought. Value Health. 2016;19(8):921–8.

    PubMed  Google Scholar 

  4. Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine. New York: Oxford University Press; 2017.

    Google Scholar 

  5. Johannesson M, Meltzer D, O'Conor RM. Incorporating future costs in medical cost-effectiveness analysis: implications for the cost-effectiveness of the treatment of hypertension. Med Decis Making. 1997;17(4):382–9.

    CAS  PubMed  Google Scholar 

  6. Krol M, Papenburg J, Koopmanschap M, Brouwer W. Do productivity costs matter? The impact of including productivity costs on the incremental costs of interventions targeted at depressive disorders. Pharmacoeconomics. 2011;29(7):601–19.

    PubMed  Google Scholar 

  7. Krol M, Papenburg J, van Exel J. Does including informal care in economic evaluations matter? A systematic review of inclusion and impact of informal care in cost-effectiveness studies. Pharmacoeconomics. 2015;33(2):123–35.

    PubMed  Google Scholar 

  8. Weinstein MC, Russell LB, Gold MR, Siegel JE. Cost-effectiveness in health and medicine. Oxford: Oxford University Press; 1996.

    Google Scholar 

  9. Russell LB, Fryback DG, Sonnenberg FA. Is the societal perspective in cost-effectiveness analysis useful for decision makers? Jt Comm J Qual Improv. 1999;25(9):447–54.

    CAS  PubMed  Google Scholar 

  10. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103.

    PubMed  Google Scholar 

  11. Neumann PJ. Costing and perspective in published cost-effectiveness analysis. Med Care. 2009;47(7 Suppl 1):S28–32.

    PubMed  Google Scholar 

  12. Adam T, Koopmanschap MA, Evans DB. Cost-effectiveness analysis: can we reduce variability in costing methods? Int J Technol Assess Health Care. 2003;19(2):407–20.

    PubMed  Google Scholar 

  13. Stone PW, Chapman RH, Sandberg EA, Liljas B, Neumann PJ. Measuring costs in cost-utility analyses. Variations in the literature. Int J Technol Assess Health Care. 2000;16(1):111–24.

    CAS  PubMed  Google Scholar 

  14. Mapping of HTA methodologies in EU and Norway [Internet]. European Commission. 2018. Available from: https://op.europa.eu/en/publication-detail/-/publication/4d364ea4-113a-11e8-9253-01aa75ed71a1/language-en/format-PDF/source-117287134#.

  15. Basu A. Estimating costs and valuations of non-health benefits in cost-effectiveness analysis. Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG, editors. New York: Oxford University Press; 2017.

  16. Foreign Exchange Rates [Internet]. 2020. Available from: https://www.federalreserve.gov/releases/H10/Hist/default.htm.

  17. Historical Consumer Price Index for All Urban Consumers (CPI-U) [Internet]. 2019. Available from: https://www.bls.gov/cpi/tables/supplemental-files/historical-cpi-u-201901.pdf.

  18. Neumann PJ, Thorat T, Zhong Y, Anderson J, Farquhar M, Salem M, et al. A systematic review of cost-effectiveness studies reporting cost-per-DALY averted. PLoS ONE. 2016;11(12):e0168512.

    PubMed  PubMed Central  Google Scholar 

  19. Neumann PJ, Thorat T, Shi J, Saret CJ, Cohen JT. The changing face of the cost-utility literature, 1990–2012. Value Health. 2015;18(2):271–7.

    PubMed  Google Scholar 

  20. CEA Registry Data Dictionary [Internet]. 2020. Available from: https://healtheconomicsdev.tuftsmedicalcenter.org/cear2/search/search.aspx.

  21. Culyer A, Chalkidou K, Teerawattananon Y, Santatiwongchai B. Rival perspectives in health technology assessment and other economic evaluations for investing in global and national health. Who decides? Who pays? F1000Res. 2018;7:72.

    PubMed  PubMed Central  Google Scholar 

  22. van Lier LI, Bosmans JE, van Hout HPJ, Mokkink LB, van den Hout WB, de Wit GA, et al. Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study. Eur J Health Econ. 2018;19(7):993–1008.

    PubMed  Google Scholar 

  23. Pharmacoeconomic Guidelines Around The World [Internet]. 2020. Available from: https://tools.ispor.org/peguidelines/.

  24. Methods for health economic evaluations : A guideline based on current practices in Europe [Internet]. 2015. Available from: https://www.eunethta.eu/wp-content/uploads/2018/03/Methods_for_health_economic_evaluations.pdf.

  25. Health Intervention and Technology Assessment Program (HITAP). the Guide to Health Economic Analysis and Research (GEAR) 2020 [Available from: https://www.gear4health.com/.

  26. van Dongen JM, El Alili M, Varga AN, Guevara Morel AE, Jornada Ben A, Khorrami M, et al. What do national pharmacoeconomic guidelines recommend regarding the statistical analysis of trial-based economic evaluations? Expert Rev Pharmacoecon Outcomes Res. 2019;1:1–11.

    Google Scholar 

  27. EunetHta Joint Action Work Package Subgroup, Heintz E, Gerber-Grote A, Ghabri S, Hamers FF, Rupel VP, et al. Is There a European View on Health Economic Evaluations? Results from a Synopsis of Methodological Guidelines Used in the EUnetHTA Partner Countries. Pharmacoeconomics. 2016;34(1):59–76.

  28. Moran D, Shrime MG, Nang S, Vycheth I, Vuthy D, Hong R, et al. Cost-effectiveness of craniotomy for epidural hematomas at a major government hospital in Cambodia. World J Surg. 2017;41(9):2215–23.

    PubMed  Google Scholar 

  29. Padula WV, Phelps CE, Moran D, Earley C. Allocating provider resources to diagnose and treat restless legs syndrome: a cost-utility analysis. Sleep Med. 2017;38:44–9.

    PubMed  Google Scholar 

  30. Hayajneh WA, Daniels VJ, James CK, Kanibir MN, Pilsbury M, Marks M, et al. Public health impact and cost effectiveness of routine childhood vaccination for hepatitis a in Jordan: a dynamic model approach. BMC Infect Dis. 2018;18(1):119.

    PubMed  PubMed Central  Google Scholar 

  31. Raje N, Roodman GD, Willenbacher W, Shimizu K, Garcia-Sanz R, Terpos E, et al. A cost-effectiveness analysis of denosumab for the prevention of skeletal-related events in patients with multiple myeloma in the United States of America. J Med Econ. 2018;21(5):525–36.

    PubMed  Google Scholar 

  32. Wolff E, Elfstrom KM, Haugen Cange H, Larsson S, Englund H, Sparen P, et al. Cost-effectiveness of sex-neutral HPV-vaccination in Sweden, accounting for herd-immunity and sexual behaviour. Vaccine. 2018;36(34):5160–5.

    PubMed  Google Scholar 

  33. Sher DJ, Tishler RB, Pham NL, Punglia RS. Cost-effectiveness analysis of intensity modulated radiation therapy versus proton therapy for oropharyngeal squamous cell carcinoma. Int J Radiat Oncol Biol Phys. 2018;101(4):875–82.

    PubMed  Google Scholar 

  34. Cobiac LJ, Mizdrak A, Wilson N. Cost-effectiveness of raising alcohol excise taxes to reduce the injury burden of road traffic crashes. Inj Prev. 2019;25(5):421–7.

    PubMed  Google Scholar 

  35. Kim SY, Nguyen C, Russell LB, Tomczyk S, Abdul-Hakeem F, Schrag SJ, et al. Cost-effectiveness of a potential group B streptococcal vaccine for pregnant women in the United States. Vaccine. 2017;35(45):6238–47.

    PubMed  Google Scholar 

  36. Mennini FS, Bini C, Marcellusi A, Rinaldi A, Franco E. Cost-effectiveness of switching from trivalent to quadrivalent inactivated influenza vaccines for the at-risk population in Italy. Hum Vaccin Immunother. 2018;14(8):1867–73.

    PubMed  PubMed Central  Google Scholar 

  37. Cobiac L, Vos T, Veerman L. Cost-effectiveness of weight watchers and the lighten up to a healthy lifestyle program. Aust N Z J Public Health. 2010;34(3):240–7.

    PubMed  Google Scholar 

  38. Muangchana C, Riewpaiboon A, Jiamsiri S, Thamapornpilas P, Warinsatian P. Economic analysis for evidence-based policy-making on a national immunization program: a case of rotavirus vaccine in Thailand. Vaccine. 2012;30(18):2839–47.

    PubMed  Google Scholar 

  39. Sigei C, Odaga J, Mvundura M, Madrid Y, Clark AD, Kenya ProVac Technical Working G, et al. Cost-effectiveness of rotavirus vaccination in Kenya and Uganda. Vaccine. 2015;33 Suppl 1:109–18.

  40. Sarker AR, Sultana M, Mahumud RA, Van Der Meer R, Morton A. Cost-effectiveness analysis of introducing universal childhood rotavirus vaccination in Bangladesh. Hum Vaccin Immunother. 2018;14(1):189–98.

    PubMed  Google Scholar 

  41. Zeng W, Halasa-Rappel YA, Baurin N, Coudeville L, Shepard DS. Cost-effectiveness of dengue vaccination in ten endemic countries. Vaccine. 2018;36(3):413–20.

    PubMed  Google Scholar 

  42. Rajan PV, Qudsi RA, Dyer GSM, Losina E. The cost-effectiveness of surgical fixation of distal radial fractures: a computer model-based evaluation of three operative modalities. J Bone Joint Surg Am. 2018;100(3):e13.

    PubMed  PubMed Central  Google Scholar 

  43. Kantito S, Saokaew S, Yamwong S, Vathesatogkit P, Katekao W, Sritara P, et al. Cost-effectiveness analysis of patient self-testing therapy of oral anticoagulation. J Thromb Thrombolysis. 2018;45(2):281–90.

    PubMed  Google Scholar 

  44. Kim DD, Basu A, Duffy SQ, Zarkin GA. Worked Example 1: the cost-effectiveness of treatment for individuals with alcohol use disorders: a reference case analysis. In: Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG, editors. Cost-effectiveness in Health and Medicine, vol. 2. New York: Oxford University Press; 2017. p. 385–430.

    Google Scholar 

  45. Institute for Clinical and Economic Review. 2020–2023 Value Assessment Framework2020. Available from: https://icer-review.org/wp-content/uploads/2019/05/ICER_2020_2023_VAF_013120-4.pdf.

  46. Kim DD, Neumann PJ. Analyzing the cost effectiveness of policy responses for COVID-19: the importance of capturing social consequences. Med Decis Making. 2020;40(3):251–3.

    PubMed  Google Scholar 

  47. Meltzer D, Johannesson M. Inconsistencies in the "societal perspective" on costs of the panel on cost-effectiveness in health and medicine. Med Decis Making. 1999;19(4):371–7.

    CAS  PubMed  Google Scholar 

  48. Brouwer WB, Koopmanschap MA, Rutten FF. Productivity costs in cost-effectiveness analysis: numerator or denominator: a further discussion. Health Econ. 1997;6(5):511–4.

    CAS  PubMed  Google Scholar 

  49. Meltzer D. Accounting for future costs in medical cost-effectiveness analysis. J Health Econ. 1997;16(1):33–64.

    CAS  PubMed  Google Scholar 

  50. Nyman JA. Cost recommendations in the second edition of cost-effectiveness in health and medicine: a review. MDM Policy Pract. 2018;3(1): 62.

  51. Nyman JA. Should the consumption of survivors be included as a cost in cost–utility analysis? Health Econ. 2004;13(5):417–27.

    PubMed  Google Scholar 

  52. Russell LB. Completing costs: patients' time. Med Care. 2009;47(7 Suppl 1):S89–93.

    PubMed  Google Scholar 

  53. Grosse SD, Pike J, Soelaeman R, Tilford JM. Quantifying family spillover effects in economic evaluations: measurement and valuation of informal care time. Pharmacoeconomics. 2019;37(4):461–73.

    PubMed  PubMed Central  Google Scholar 

  54. Neumann PJ, Kim DD, Trikalinos TA, Sculpher MJ, Salomon JA, Prosser LA, et al. Future directions for cost-effectiveness analyses in health and medicine. Med Decis Making. 2018;38(7):767–77.

    PubMed  Google Scholar 

  55. Brouwer WBF. The inclusion of spillover effects in economic evaluations: not an optional extra. Pharmacoeconomics. 2019;37(4):451–6.

    PubMed  Google Scholar 

  56. Lin PJ, D'Cruz B, Leech AA, Neumann PJ, Sanon Aigbogun M, Oberdhan D, et al. Family and caregiver spillover effects in cost-utility analyses of Alzheimer's disease interventions. Pharmacoeconomics. 2019;37(4):597–608.

    PubMed  Google Scholar 

  57. Lavelle TA, D'Cruz BN, Mohit B, Ungar WJ, Prosser LA, Tsiplova K, et al. Family spillover effects in pediatric cost-utility analyses. Appl Health Econ Health Policy. 2019;17(2):163–74.

    PubMed  Google Scholar 

  58. Prosser LA, Wittenberg E. Advances in methods and novel applications for measuring family spillover effects of illness. Pharmacoeconomics. 2019;37(4):447–50.

    PubMed  Google Scholar 

  59. Panzer AD, Emerson JG, D'Cruz B, Patel A, Dabak S, Isaranuwatchai W, et al. Growth and capacity for cost-effectiveness analysis in Africa. Health Econ. 2020.

Download references

Funding

This work was supported by the Center for Enhanced Value Assessment at the Center for the Evaluation of Value and Risk in Health, Tufts Medical Center, funded by the PhRMA Foundation Center of Excellence in Value Assessment Award. The development and maintenance of the GHCEA registry is supported by the Bill and Melinda Gates Foundation, grant number OPP1171680. The funders had no role in study design, data collection, analysis or interpretation, preparation, review, or approval of the manuscript.

Author information

Authors and Affiliations

  1. Center for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, 800 Washington St, Box 063, Boston, MA, 02111, USA

    David D. Kim, Madison C. Silver, Joshua T. Cohen, Daniel A. Ollendorf & Peter J. Neumann

  2. Department of Medicine, Tufts University School of Medicine, Boston, MA, USA

    David D. Kim, Joshua T. Cohen, Daniel A. Ollendorf & Peter J. Neumann

  3. Department of Health Management and Health Economics, University of Oslo, Oslo, Norway

    Natalia Kunst

  4. Cancer Outcomes, Public Policy and Effectiveness Research (COPPER) Center, Yale University School of Medicine, New Haven, CT, USA

    Natalia Kunst

  5. LINK Medical Research, Oslo, Norway

    Natalia Kunst

Authors
  1. David D. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Madison C. Silver
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Natalia Kunst
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joshua T. Cohen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daniel A. Ollendorf
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Peter J. Neumann
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DDK and PJN conceived and designed the study, and PJN secured funding for this study. DDK, MCS, and NK were responsible for conducting empirical analyses. DDK wrote the initial manuscript and acted as an overall guarantor for the overall content of this article. All authors elaborated on, discussed, and approved the final version of the manuscript submitted for publication.

Corresponding author

Correspondence to David D. Kim.

Ethics declarations

Conflicts of interest

DDK, MCS, JTC, DAO, and PJN are employees of the Center for the Evaluation of Value and Risk in Health at Tufts Medical Center, which maintains the CEA Registry and the GHCEA registry used as data sources for this study. The CEA registry is supported by subscription revenue from pharmaceutical and device companies, academic institutions, and government agencies. The GHCEA registry is supported by a grant from the Bill and Melinda Gates Foundation. NK was funded by the Research Council of Norway and LINK Medical Research (grant numbers 276146 and 304034) and has received personal fees for speaking from Thermo Fisher Scientific, outside of the submitted work. JTC has received grants for work conducted on behalf of Amgen, Biogen, and Janssen Pharmaceuticals and has lectured on the use of simulation for Pfizer. JTC has also consulted for AbbVie, Precision Health Economics, Sage Therapeutics, and Sarepta, outside of the submitted work. PJN has held one-time roles on the advisory boards on health economics topics for Avexis, AbbVie, Research Triangle Institute, Merck, Genentech, Bluebird Bio, and Novo Nordisk. PJN serves on the advisory board for the Congressional Budget Office and has consulted for Precision Health Economics, outside of the submitted work.

Additional information

The original version of this article was revised due to a retrospective Open Access order.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 424 kb)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kim, D.D., Silver, M.C., Kunst, N. et al. Perspective and Costing in Cost-Effectiveness Analysis, 1974–2018. PharmacoEconomics 38, 1135–1145 (2020). https://doi.org/10.1007/s40273-020-00942-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-020-00942-2