Skip to main content
Log in

Can economic evaluations be made more transferable?

  • Original Papers
  • Published:
The European Journal of Health Economics Aims and scope Submit manuscript

Abstract

Several commentators have identified the lack of generalisability and transferability of economic evaluation results. The aims of this study were: (a) to develop a checklist to assess the level of generalisability and transferability of economic evaluations; (b) to assess the generalisability and transferability of economic evaluations between the UK and France using the checklist; (c) to identify reasons for any lack of transferability and generalisability; (d) to assess how the transferability and generalisability of economic evaluations can be improved; and (e) to outline ways in which databases of economic evaluations and journals can assist in this area. The checklist was developed using previous work and the templates of the NHS EED and CODECS databases. A sub-checklist of essential items was then derived. Validation of the two checklists was undertaken with Health Economists participating in the EURONHEED project. Economic evaluations involving the UK and France were then located and assessed using the checklist. A summary score for each study was calculated based on the percentage of correctly reported (applicable) points, and the results in the empirical analysis compared to identify differences. The extended checklist includes 42 items, and the sub-checklist 16 items. Twenty-five economic evaluations met the inclusion criteria for the empirical analysis. In the extended checklist the mean score was 66.9±13.6%. The results for the sub-checklist were very similar. The analysis revealed that costing, assessments of generalisability by the author(s), assessment of data variability, discounting, study population, and the reporting of effectiveness are areas that need more attention. Differences in cost-effectiveness results are often accounted for by price or organisational differences. The developed checklists are useful in assessing the generalisability and transferability of economic evaluations. In order to improve the generalisability and transferability of economic evaluations authors need to be more explicit and detailed in describing and reporting their studies. If they are to provide added value to their users, international databases of economic evaluations should systematically assess the generalisability and transferability of studies. Further research is in progress on producing a weighted version of the checklist.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ament A et al. (2000) Cost-effectiveness of pneumococcal vaccination of older people: a study in 5 western European countries. Clin Infect Dis 31:444–450

    Article  PubMed  Google Scholar 

  2. Arikian S et al. (1994) A multinational pharmacoeconomic analysis of oral therapies for onychomycosis. The Onychomycosis Study Group. Br J Dermatol 130 [Suppl 43]:35–44

  3. Barbieri M et al. (2005) Variability of cost-effectiveness estimates for pharmaceuticals in western Europe: lessons for inferring generalisability. Value Health 8:10–23

    Article  PubMed  Google Scholar 

  4. Berger K et al. (1998) Cost-effectiveness analysis of paclitaxel and cisplatin versus cyclophosphamide and cisplatin as first-line therapy in advanced ovarian cancer. A European perspective. Eur J Cancer 34:1894–1901

    Article  PubMed  Google Scholar 

  5. Borghi J, Guest J (2000) Economic impact of using mirtazapine compared to amitriptyline and fluoxetine in the treatment of moderate and severe depression in the UK. Eur Psychiatry 1:378–387

    Article  Google Scholar 

  6. Boulenger S, Nixon J, Rice S, Ulmann P, Drummond M (2004) Guidelines for completing the EURONHEED transferability checklist. EURONHEED working paper

  7. Brown M et al. (2000) Cost-effectiveness of mirtazapine relative to fluoxetine in the treatment of moderate and severe depression in France. Eur J Psychiatry 14:15–25

    Google Scholar 

  8. Chiou CF et al. (2003) Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care 41:32–44

    Article  PubMed  Google Scholar 

  9. CIBIS (2001) Reduced costs with bisoprolol treatment for heart failure. An economic analysis of the second Cardiac Insufficency Bisoprolol Study (CIBIS-II). Eur Heart J 22:1021–1031

    Article  PubMed  Google Scholar 

  10. Collège des Economistes de la Santé (2003) Methodological guide on the economic evaluation of health care interventions. Collège des Économistes de la Santé: Paris

  11. Drummond M et al. (1992) Issues in the cross-national assessment of health technology. Int J Technol Assess Health Care 8:671–682

    PubMed  Google Scholar 

  12. Drummond MF et al. (1997) Methods for the economic evaluation of health care programmes. Oxford University Press: Oxford

    Google Scholar 

  13. Einarson T et al. (1997) Multinational pharmacoeconomic analysis of topical and oral therapies for onychomycosis. J Dermatol Treat 8:229–235

    Google Scholar 

  14. Grover S et al. (2001) How cost-effective is the treatment of dyslipidemia in patients with diabetes but without cardiovascular disease? Diabetes Care 24:45–50

    PubMed  Google Scholar 

  15. Heaney D et al. (2000) Cost minimization analysis of antiepileptic drugs in newly diagnosed epilepsy in 12 European countries. Epilepsia 41:S37–S44

    Google Scholar 

  16. Henderson R, Brown R (1999) The costs of routine eptifibatide use in acute coronary syndromes in western Europe: an economic substudy of the PURSUIT trial. Eur Heart J 1:N35–N41

    Google Scholar 

  17. Hoffman et al. (2002) Do decision-makers find economic evaluations useful? Results of recent focus group research in the UK. Value Health 5:71–78

    Article  PubMed  Google Scholar 

  18. Hutton J et al. (1996) A new decision model for cost-utility comparisons of chemotherapy in recurrent metastatic breast cancer. Pharmacoeconomics 9:S8–S22

    Google Scholar 

  19. Iveson T et al. (1999) Irinotecan in second-line treatment of metastatic colorectal cancer: improved survival and cost-effect compared with infusional 5-FU. Eur J Cancer 35:1796–1804

    Article  PubMed  Google Scholar 

  20. Jansen et al. (1997) Economic evaluation of meloxicam (7.5 mg) versus sustained release diclofenac (100 mg) treatment for osteoarthritis: a cross-national assessment for France, Italy and the UK. Br J Med Econ 11:9–22

    Google Scholar 

  21. Jonsson B et al. (1996) Cost-effectiveness of cholesterol lowering. Results from the Scandinavian Simvastatin Survival Study (4S). Eur Heart J 17:1001–1007

    PubMed  Google Scholar 

  22. Kobelt G, Jonsson L (1999) Modeling cost of treatment with new topical treatments for glaucoma. Int J Technol Assess Health Care 15:207–219

    Article  PubMed  Google Scholar 

  23. Launois R et al. (1996) A cost-utility analysis of second-line chemotherapy in metastatic breast cancer. Docetaxel versus paclitaxel versus vinorelbine. Pharmacoeconomics 10:504–521

    PubMed  Google Scholar 

  24. Leese B et al. (1992) A comparison of the costs and benefits of recombinant human erythropoietin (Epoetin) in the treatment of chronic renal failure in 5 European countries. Pharmacoeconomics 1:346–356

    PubMed  Google Scholar 

  25. Levy P et al. (1998) A cost-minimization of heart failure therapy with bisoprolol in the French setting: an analysis from CIBIS trial data. Cardiac Insufficiency Bisoprolol Study. Cardiovasc Drugs Ther 12:301–305

    Article  PubMed  Google Scholar 

  26. Levy-Piedbois C et al. (2000) Cost-effectiveness of second-line treatment with irinotecan or infusional 5-fluorouracil in metastatic colorectal cancer. Ann Oncol 11:157–161

    Article  PubMed  Google Scholar 

  27. Lindgren P et al. (2002) Cost-effectiveness analysis of exemestane compared with megestrol in advanced breast cancer: a model for Europe and Australia. Pharmacoeconomics 20:101–108

    PubMed  Google Scholar 

  28. Malek M et al. (1999) A cost minimisation analysis of cardiac failure treatment in the UK using CIBIS trial data. Cardiac Insufficiency Bisoprolol Study. Int J Clin Pract 53:19–23

    PubMed  Google Scholar 

  29. Menzin J et al. (1996) A multinational economic evaluation of rhDNase in the treatment of cystic fibrosis. Int J Technol Assess Health Care 12:52–61

    PubMed  Google Scholar 

  30. NHS Centre for Reviews and Dissemination (2001) Improving access to cost-effectiveness information for health care decision making: the NHS Economic Evaluation Database. University of York; York

  31. Nixon J, Pang (2000) Economic evaluations in Japan: a review of published studies, methodological issues and practice. In: Kondo S, Futura K (eds) PSAM5. Universal Academy: Tokyo

    Google Scholar 

  32. Peeters P et al. (1998) Economic evaluation of Neoral versus Sandimmune maintenance therapy for de novo liver transplant patients: results from an international randomized controlled trial. Milton Study Group. Transplant Proc 30:1838–1842

    Article  PubMed  Google Scholar 

  33. Simpson K et al. (1994) Cost effectiveness of antiviral treatment with zalcitabine plus zidovudine for AIDS patients with CD4+ counts less than 300/microliters in 5 European countries. Pharmacoeconomics 6:553–562

    PubMed  Google Scholar 

  34. Spath HM et al. (1999) Analysis of the eligibility of published economic evaluations to a given health care system. Health Policy 49:161–177

    Article  PubMed  Google Scholar 

  35. Stalhammar N et al. (1999) Cost effectiveness of omeprazole and ranitidine in intermittent treatment of symptomatic gastro-oesophageal reflux disease. Pharmacoeconomics 16:483–497

    PubMed  Google Scholar 

  36. Welte R, Feenstra T, Jager H, Leidl R (2004) A decision chart for assessing and improving the transferability of economic evaluation results between countries. Pharmacoeconomics 22:857–876

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John Nixon.

Appendix

Appendix

A detailed comparison of the studies included in this analysis is presented in tabular form in Table 4.

Table 4 Converted results, sources of difference and checklist scores (MS multi-country study with cost valuations for both the UK and France, MS1-UK, MS1-F multi-country economic evaluation in which the costing was performed for only one country, either the UK or France, MS-P multi-country study for which costing was based on pooled data from a number of countries that included both the UK and France, SC-UK, SC-F independent study carried out in either the UK or France but on the same health technology, QALY quality-adjusted life-years, NSAIDs nonsteroidal anti-inflammatory drugs, NG not given)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Boulenger, S., Nixon, J., Drummond, M. et al. Can economic evaluations be made more transferable?. Eur J Health Econ 6, 334–346 (2005). https://doi.org/10.1007/s10198-005-0322-1

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10198-005-0322-1

Keywords

Navigation