Testing the Validity of Cost-Effectiveness Models
- First Online:
A growing body of recent work has identified several problems with economic evaluations undertaken alongside controlled trials that can have potentially serious impacts on the ability of decision makers to draw valid conclusions. At the same time, the use of cost-effectiveness models has been drawn into question, due to the alleged arbitrary nature of their construction. This has led researchers to try and identify ways of improving the quality of cost-effectiveness models through identifying ‘best practice’, producing guidelines for peer review and identifying tests of validity.
This paper investigates the issue of testing the validity of cost-effectiveness models or, perhaps more appropriately, whether it is possible to objectively measure the quality of a cost-effectiveness model. A review of the literature shows that there is much confusion over the different aspects of modelling that should be assessed in respect to model quality, and how this should be done.
We develop a framework for assessing model quality in terms of: (i) the structure of the model; (ii) the inputs of the model; (iii) the results of the model; and (iv) the value of the model to the decision maker. Quality assessment is investigated within this framework, and it is argued that it is doubtful that a set of objective tests of validity will ever be produced, or indeed that such an approach would be desirable. The lack of any clearly definable and objective tests of validity means that the other parts of the evaluation process need to be given greater emphasis. Quality assurance forms a small part of a broader process and is best implemented in the form of good practice guidelines. A set of key guidelines are presented.
- 2.O’Brien B. Economic evaluation of pharmaceuticals: Frankenstein’s monster or vampire of trials? Med Care 1996; 34 (12): DS99–108Google Scholar
- 15.Eddy D. Technology assessment: the role of mathematical modelling. In: Mosteller F, editor. Assessing medical technologies. Washington, DC: National Academy Press, 1985: 144–60Google Scholar
- 17.Mandelblatt JS, Fryback DG, Weinstein MC, et al. Assessing the effectiveness of health interventions. In: Gold MR, Siegel JE, Russell LB, et al., editors. Cost-effectiveness analysis in health and medicine. New York (NY): Oxford University Press, 1996: 135–64Google Scholar
- 18.Sonnenberg FA, Roberts MS, Tsevat J, et al. Toward a peer review process for medical decision analysis models. Med Care 1994; 32 (7): JS52–64Google Scholar
- 23.Rittenhouse B. Use of models in economic evaluations of medicines and other technologies. London: Office of Health Economics, 1996Google Scholar
- 29.Schulpher M, Drummond M, Buxton M. The iterative use of economic evaluation as part of the process of health technology assessment. J Health Serv Res Policy 1997; 2 (1): 26–30Google Scholar