Do Research Groups Align on an Intervention’s Value? Concordance of Cost-Effectiveness Findings Between the Institute for Clinical and Economic Review and Other Health System Stakeholders
The Institute for Clinical and Economic Review (ICER) employs fixed cost-effectiveness (CE) thresholds that guide their appraisal of an intervention’s long-term economic value. Given ICER’s rising influence in the healthcare field, we undertook an assessment of the concordance of ICER’s CE findings to the published CE findings from other research groups (i.e., “non-ICER” researchers including life science manufacturers, academics, and government institutions). Disease areas and pharmaceutical interventions for comparison were determined based on ICER evaluations conducted from 1 January 2015 to 31 December 2017. A targeted literature search was conducted for non-ICER CE publications using PubMed. Studies had to be conducted from the US setting, include the same disease characteristics (e.g., disease severity; treatment history), incorporate the same pharmaceutical interventions and comparison groups, and present incremental costs per quality-adjusted life-year (QALY) gained from the healthcare sector or payer perspective. Discordance was measured as the proportion of unique interventions that would have had more favorable valuations (i.e., low, intermediate, high value-for-money) if the CE findings from other research groups had been used for decision making instead of ICER’s findings. More favorable valuations were defined as transitioning from low value (as determined by ICER) to intermediate or high value (as determined by other researchers) and from intermediate value (as determined by ICER) to high value (as determined by other researchers). Among the 13 non-ICER studies meeting inclusion criteria, six disease areas and 14 interventions were assessed. Of the 14 interventions, a more favorable valuation would have been recommended for ten therapies if the CE ratios from other research groups had been used for decision making instead of ICER’s findings, representing a 71.4% (10/14) discordance rate. Moreover, these discrepancies were found in each of the evaluated disease areas, with the largest number of discordant valuations found in rheumatoid arthritis (five out of six interventions were discordant) followed by one valuation each in multiple sclerosis (one out of three), non-small cell lung cancer (one out of two), multiple myeloma (one out of one), high cholesterol (one out of one), and congestive heart failure (one out of one). Our findings indicate high discordance when comparing ICER’s appraisals to the CE findings of non-ICER researchers. To understand the value of new interventions, the totality of evidence on the CE of an intervention—including results from ICER and non-ICER modeling efforts—should be considered when making coverage and reimbursement decisions.
All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by Matthew Sussman, Jeffrey C. Yu, and Joseph Menzin. The first draft of the manuscript was written by Matthew Sussman and Jeffrey C. Yu and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Compliance with Ethical Standards
This study received no external funding.
Conflict of interest
Matthew Sussman, Jeffrey C. Yu, and Joseph Menzin declare no conflicts of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
- 1.CVS Health. Current and new approaches to making drugs more affordable. Updated August 2018. https://cvshealth.com/sites/default/files/cvs-health-current-and-new-approaches-to-making-drugs-more-affordable.pdf. Accessed 16 Feb 2019.
- 2.Institute for Clinical and Economic Review. The Institute for Clinical and Economic Review to Collaborate with the Department of Veteran Affairs’ Pharmacy Benefits Management Services Office. Updated June 27, 2017. https://icer-review.org/announcements/va-release/. Accessed 16 Feb 2019.
- 3.Robinson JC. Amgen Cuts Repatha’s Price By 60% Will Value-based Pricing Support Value-based Patient Access? Health Affairs. Updated November 28, 2018. https://www.healthaffairs.org/do/10.1377/hblog20181127.943927/full/. Accessed 16 Feb 2019.
- 4.Institute for Clinical and Economic Review. PCSK9 inhibitors for treatment of high cholesterol: effectiveness, value, and value-based price benchmarks. https://icer-review.org/material/high-cholesterol-final-report/. Accessed 20 Nov 2019.
- 5.Institute for Clinical and Economic Review. About. https://icer-review.org/about/. Accessed 16 Feb 2019.
- 6.Institute for Clinical and Economic Review. Final value assessment framework for 2017–2019. https://icer-review.org/final-vaf-2017-2019/. Accessed 16 Feb 2019.
- 7.Dubois, RW. From the Editorial Board: Robert W. Dubois, MD, PhD. Am J Manag Care. 2019;25(7):302. https://www.ajmc.com/journals/issue/2019/2019-vol25-n7/from-the-editorial-board-robert-w-dubois-md-phd. Accessed 15 Aug 2019.
- 8.Center for the Evaluation of Value and Risk in Health. CEA Registry. https://cevr.tuftsmedicalcenter.org/databases/cea-registry. Accessed 25 Mar 2019.
- 9.Institute for Clinical and Economic Review. Calcitonin gene-related peptide (CGRP) inhibitors as preventive treatments for patients with episodic or chronic migraine: effectiveness and value. https://icer-review.org/material/cgrp-final-report/. Accessed 20 Nov 2019.
- 11.Institute for Clinical and Economic Review. Targeted immune modulators for rheumatoid arthritis: effectiveness & value. https://icer-review.org/material/ra-final-report/. Accessed 20 Nov 2019.
- 12.Institute for Clinical and Economic Review. Disease-modifying therapies for relapsing-remitting and primary-progressive multiple sclerosis: effectiveness & value. https://icer-review.org/material/ms-final-report/. Accessed 20 Nov 2019.
- 13.Institute for Clinical and Economic Review. Treatment options for advanced non-small cell lung cancer: effectiveness, value, and value-based price benchmarks. https://icer-review.org/material/nsclc-final-report/. Accessed 20 Nov 2019.
- 14.Institute for Clinical and Economic Review. Treatment options for relapsed or refractory multiple myeloma: effectiveness, value, and value-based price benchmarks. https://icer-review.org/material/mm-final-report/. Accessed 20 Nov 2019.
- 15.Institute for Clinical and Economic Review. CardioMEMS HF System (St. Jude Medical, Inc.) and sacubitril/valsartan (Entresto, Novartis AG) for management of congestive heart failure: effectiveness, value, and value-based price benchmarks. https://icer-review.org/material/chf_final_report/. Accessed 20 Nov 2019.
- 30.Science & Innovation Theater. (2019). ICER: payer perspectives on the use and usage of ICER reports [PowerPoint slides]. https://www.amcp.org/Resource-Center/formulary-utilization-management/icer-payer-perspectives-use-and-usage-icer-reports.
- 32.Norris P, Herxheimer A, Lexchin J, Mansfield P. Drug promotion: what we know, what we have yet to learn. World Health Organization and Health Action International; 2005.Google Scholar