Estimating the expected value of partial perfect information: a review of methods
- 323 Downloads
Value of information analysis provides a framework for the analysis of uncertainty within economic analysis by focussing on the value of obtaining further information to reduce uncertainty. The mathematical definition of the expected value of perfect information (EVPI) is fixed, though there are different methods in the literature for its estimation. In this paper these methods are explored and compared.
Analysis was conducted using a disease model for Parkinson’s disease. Five methods for estimating partial EVPIs (EVPPIs) were used: a single Monte Carlo simulation (MCS) method, the unit normal loss integral (UNLI) method, a two-stage method using MCS, a two-stage method using MCS and quadrature and a difference method requiring two MCS. EVPPI was estimated for each individual parameter in the model as well as for three groups of parameters (transition probabilities, costs and utilities).
Using 5,000 replications, four methods returned similar results for EVPPIs. With 5 million replications, results were near identical. However, the difference method repeatedly gave estimates substantially different to the other methods.
The difference method is not rooted in the mathematical definition of EVPI and is clearly an inappropriate method for estimating EVPPI. The single MCS and UNLI methods were the least complex methods to use, but are restricted in their appropriateness. The two-stage MCS and quadrature-based methods are complex and time consuming. Thus, where appropriate, EVPPI should be estimated using either the single MCS or UNLI method. However, where neither of these methods is appropriate, either of the two-stage MCS and quadrature methods should be used.
KeywordsEconomic evaluation Value of information Uncertainty
- 5.Chilcott, J., Brennan, A., Booth, A., Karnon, J., Tappenden, P.: The role of modelling in prioritising and planning clinical trials. Health. Technol. Assess. 7, 1–125 (2003)Google Scholar
- 6.Brennan, A.B., Chilcott, J.B., Kharroubi, S., O’Hagan, A.: Calculating expected value of perfect information: resolution of conflicting methods via a two level Monte Carlo approach. In: Proceedings of the 24th Annual Meeting of SMDM, Washington (2002)Google Scholar
- 7.Brennan, A.B., Chilcott, J.B., Kharroubi, S., O’Hagan, A.: A two level Monte Carlo approach to calculation expected value of sample information: how to value a research design. In: Proceedings of the 24th Annual Meeting of SMDM, Washington (2002)Google Scholar
- 9.Coyle, D., Barbeau, M., Baladi, J.F.: Bayesian economic analysis of treatment with entacapone for Parkinson’s disease patients in Canada. In: Proceedings of the Society of Medical Decision Making, Philadelphia (2001)Google Scholar
- 11.Fenwick, E., Claxton, K., Sculpher, M., Briggs, A.: Improving the efficiency and relevance of health technology assessment: the role of iterative decision analytic modelling. CHE Discussion Paper 179. University of York, York (2000)Google Scholar
- 12.Coyle, D., Barbeau, M., Guttman, M., Baladi, J.F.: The economic evaluation of pharmacotherapies for Parkinson’s disease treatment. Parkinsonism. Relat. Disord. 9, 301–307 (2003)Google Scholar
- 14.Claxton, K., Fenwick, E., Sculpher, M.J.: Decision making with uncertainty. In: Jones A (ed.) Companion to Health Economics, Edward Elgar (2006)Google Scholar
- 15.Oakley, J.: Value of information for complex cost-effectiveness models. Research Report No. 533/02 Department of Probability and Statistics, University of Sheffield (2002)Google Scholar