Abstract
Several commentators have identified the lack of generalisability and transferability of economic evaluation results. The aims of this study were: (a) to develop a checklist to assess the level of generalisability and transferability of economic evaluations; (b) to assess the generalisability and transferability of economic evaluations between the UK and France using the checklist; (c) to identify reasons for any lack of transferability and generalisability; (d) to assess how the transferability and generalisability of economic evaluations can be improved; and (e) to outline ways in which databases of economic evaluations and journals can assist in this area. The checklist was developed using previous work and the templates of the NHS EED and CODECS databases. A sub-checklist of essential items was then derived. Validation of the two checklists was undertaken with Health Economists participating in the EURONHEED project. Economic evaluations involving the UK and France were then located and assessed using the checklist. A summary score for each study was calculated based on the percentage of correctly reported (applicable) points, and the results in the empirical analysis compared to identify differences. The extended checklist includes 42 items, and the sub-checklist 16 items. Twenty-five economic evaluations met the inclusion criteria for the empirical analysis. In the extended checklist the mean score was 66.9±13.6%. The results for the sub-checklist were very similar. The analysis revealed that costing, assessments of generalisability by the author(s), assessment of data variability, discounting, study population, and the reporting of effectiveness are areas that need more attention. Differences in cost-effectiveness results are often accounted for by price or organisational differences. The developed checklists are useful in assessing the generalisability and transferability of economic evaluations. In order to improve the generalisability and transferability of economic evaluations authors need to be more explicit and detailed in describing and reporting their studies. If they are to provide added value to their users, international databases of economic evaluations should systematically assess the generalisability and transferability of studies. Further research is in progress on producing a weighted version of the checklist.
Similar content being viewed by others
References
Ament A et al. (2000) Cost-effectiveness of pneumococcal vaccination of older people: a study in 5 western European countries. Clin Infect Dis 31:444–450
Arikian S et al. (1994) A multinational pharmacoeconomic analysis of oral therapies for onychomycosis. The Onychomycosis Study Group. Br J Dermatol 130 [Suppl 43]:35–44
Barbieri M et al. (2005) Variability of cost-effectiveness estimates for pharmaceuticals in western Europe: lessons for inferring generalisability. Value Health 8:10–23
Berger K et al. (1998) Cost-effectiveness analysis of paclitaxel and cisplatin versus cyclophosphamide and cisplatin as first-line therapy in advanced ovarian cancer. A European perspective. Eur J Cancer 34:1894–1901
Borghi J, Guest J (2000) Economic impact of using mirtazapine compared to amitriptyline and fluoxetine in the treatment of moderate and severe depression in the UK. Eur Psychiatry 1:378–387
Boulenger S, Nixon J, Rice S, Ulmann P, Drummond M (2004) Guidelines for completing the EURONHEED transferability checklist. EURONHEED working paper
Brown M et al. (2000) Cost-effectiveness of mirtazapine relative to fluoxetine in the treatment of moderate and severe depression in France. Eur J Psychiatry 14:15–25
Chiou CF et al. (2003) Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care 41:32–44
CIBIS (2001) Reduced costs with bisoprolol treatment for heart failure. An economic analysis of the second Cardiac Insufficency Bisoprolol Study (CIBIS-II). Eur Heart J 22:1021–1031
Collège des Economistes de la Santé (2003) Methodological guide on the economic evaluation of health care interventions. Collège des Économistes de la Santé: Paris
Drummond M et al. (1992) Issues in the cross-national assessment of health technology. Int J Technol Assess Health Care 8:671–682
Drummond MF et al. (1997) Methods for the economic evaluation of health care programmes. Oxford University Press: Oxford
Einarson T et al. (1997) Multinational pharmacoeconomic analysis of topical and oral therapies for onychomycosis. J Dermatol Treat 8:229–235
Grover S et al. (2001) How cost-effective is the treatment of dyslipidemia in patients with diabetes but without cardiovascular disease? Diabetes Care 24:45–50
Heaney D et al. (2000) Cost minimization analysis of antiepileptic drugs in newly diagnosed epilepsy in 12 European countries. Epilepsia 41:S37–S44
Henderson R, Brown R (1999) The costs of routine eptifibatide use in acute coronary syndromes in western Europe: an economic substudy of the PURSUIT trial. Eur Heart J 1:N35–N41
Hoffman et al. (2002) Do decision-makers find economic evaluations useful? Results of recent focus group research in the UK. Value Health 5:71–78
Hutton J et al. (1996) A new decision model for cost-utility comparisons of chemotherapy in recurrent metastatic breast cancer. Pharmacoeconomics 9:S8–S22
Iveson T et al. (1999) Irinotecan in second-line treatment of metastatic colorectal cancer: improved survival and cost-effect compared with infusional 5-FU. Eur J Cancer 35:1796–1804
Jansen et al. (1997) Economic evaluation of meloxicam (7.5 mg) versus sustained release diclofenac (100 mg) treatment for osteoarthritis: a cross-national assessment for France, Italy and the UK. Br J Med Econ 11:9–22
Jonsson B et al. (1996) Cost-effectiveness of cholesterol lowering. Results from the Scandinavian Simvastatin Survival Study (4S). Eur Heart J 17:1001–1007
Kobelt G, Jonsson L (1999) Modeling cost of treatment with new topical treatments for glaucoma. Int J Technol Assess Health Care 15:207–219
Launois R et al. (1996) A cost-utility analysis of second-line chemotherapy in metastatic breast cancer. Docetaxel versus paclitaxel versus vinorelbine. Pharmacoeconomics 10:504–521
Leese B et al. (1992) A comparison of the costs and benefits of recombinant human erythropoietin (Epoetin) in the treatment of chronic renal failure in 5 European countries. Pharmacoeconomics 1:346–356
Levy P et al. (1998) A cost-minimization of heart failure therapy with bisoprolol in the French setting: an analysis from CIBIS trial data. Cardiac Insufficiency Bisoprolol Study. Cardiovasc Drugs Ther 12:301–305
Levy-Piedbois C et al. (2000) Cost-effectiveness of second-line treatment with irinotecan or infusional 5-fluorouracil in metastatic colorectal cancer. Ann Oncol 11:157–161
Lindgren P et al. (2002) Cost-effectiveness analysis of exemestane compared with megestrol in advanced breast cancer: a model for Europe and Australia. Pharmacoeconomics 20:101–108
Malek M et al. (1999) A cost minimisation analysis of cardiac failure treatment in the UK using CIBIS trial data. Cardiac Insufficiency Bisoprolol Study. Int J Clin Pract 53:19–23
Menzin J et al. (1996) A multinational economic evaluation of rhDNase in the treatment of cystic fibrosis. Int J Technol Assess Health Care 12:52–61
NHS Centre for Reviews and Dissemination (2001) Improving access to cost-effectiveness information for health care decision making: the NHS Economic Evaluation Database. University of York; York
Nixon J, Pang (2000) Economic evaluations in Japan: a review of published studies, methodological issues and practice. In: Kondo S, Futura K (eds) PSAM5. Universal Academy: Tokyo
Peeters P et al. (1998) Economic evaluation of Neoral versus Sandimmune maintenance therapy for de novo liver transplant patients: results from an international randomized controlled trial. Milton Study Group. Transplant Proc 30:1838–1842
Simpson K et al. (1994) Cost effectiveness of antiviral treatment with zalcitabine plus zidovudine for AIDS patients with CD4+ counts less than 300/microliters in 5 European countries. Pharmacoeconomics 6:553–562
Spath HM et al. (1999) Analysis of the eligibility of published economic evaluations to a given health care system. Health Policy 49:161–177
Stalhammar N et al. (1999) Cost effectiveness of omeprazole and ranitidine in intermittent treatment of symptomatic gastro-oesophageal reflux disease. Pharmacoeconomics 16:483–497
Welte R, Feenstra T, Jager H, Leidl R (2004) A decision chart for assessing and improving the transferability of economic evaluation results between countries. Pharmacoeconomics 22:857–876
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
A detailed comparison of the studies included in this analysis is presented in tabular form in Table 4.
Rights and permissions
About this article
Cite this article
Boulenger, S., Nixon, J., Drummond, M. et al. Can economic evaluations be made more transferable?. Eur J Health Econ 6, 334–346 (2005). https://doi.org/10.1007/s10198-005-0322-1
Issue Date:
DOI: https://doi.org/10.1007/s10198-005-0322-1