The precision of health state valuation by members of the general public using the standard gamble
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Precision is a recognised requirement of patient-reported outcome measures but no previous studies of the precision of methods for obtaining health state values from the general public, based on specific health state descriptions or vignettes, have been carried out. The methodological requirements of policy makers internationally is driving growth in the use of methods to obtain utilities from the general public to inform cost per quality-adjusted life-year (QALY) analyses of health technologies being considered for adoption by health systems.
The precision of five comparisons of the outcomes of treatments, based on health state descriptions, was assessed against the results of clinical trials which showed a statistically and clinically significant improvement using an internet panel of members of the UK general public. Health states were developed to depict the baseline and post-treatment states from these exemplar clinical trials. Preferences for health states were obtained using bottom-up titrated standard gamble over the internet, and differences between summary health state values corresponding to the treatment and comparator groups within each exemplar study were compared. Results are considered in the context of various estimates for the minimally important difference in utility values.
Participation among members of the internet panel in the five exemplars ranged from 27 to 59. In four of the five exemplars, the utility-based estimates of treatment benefit showed significant differences between groups and were greater than an assumed minimally important difference of 0.1. Mean utility differences between groups were: 0.23 (computerised cognitive behavioural therapy for depression, P < 0.001), 0.11 (hip resurfacing for hip osteoarthritis, P < 0.001), 0.0005 (cognitive behavioural therapy for insomnia, P = 0.98), 0.15 (pulmonary rehabilitation for COPD, P < 0.001) and 0.11 (infliximab for Crohn’s disease, P < 0.001). The confidence intervals around the estimates of utility-based treatment effect in three of the five examples did not exclude the possibility of a difference smaller than a minimally important difference of 0.1. Recent empirical evidence suggests a lower minimally important difference (0.03) may be more appropriate, in which case our results provide further reassurance of preservation of precision in health state description and valuation.
The precision of estimates of treatment effects based on preference data obtained from disease-specific measurements in clinically significant studies of health technologies was acceptable using an internet-based panel of members of the general public and the standard gamble. Definition of the minimally important difference in utility estimates is required to adequately assess precision and should be the subject of further research.
- Fitzpatrick, R., Davey, C., Buxton, M., & Jones, D. (1998). Evaluating patient based outcome measures for use in clinical trials. Health Technology Assessment, 2(14), i–iv.
- Kessler, RC, Mroczek, DK (1995) Measuring the effects of medical interventions. Medical Care 33: pp. AS109-AS119
- Stewart, AL (1992) Conceptual and methodologic issues in defining quality of life: State of the art. Progress in Cardiovascular Nursing 7: pp. 3-11
- Testa, MA, Simonson, DC (1996) Assessment of quality-of-life outcomes. The New England Journal of Medicine 334: pp. 835-840 CrossRef
- Dolan, P (1997) Modeling valuations for EuroQol health states. Medical Care 35: pp. 1095-1108 CrossRef
- McCabe, C, Stevens, K, Brazier, J (2005) Utility scores for the HUI2: An empirical comparison of alternative mapping functions. Medical Care 43: pp. 627-635 CrossRef
- Stein, K., Dyer, M., Crabb, T., Milne, R., Round, A., Ratcliffe, J., & Brazier, J. (2006). An internet “value of health” panel: Recruitment, participation and compliance. Health and Quality of Life Outcomes, 4, 90.
- Lenert, LA, Cher, DJ, Goldstein, MK, Bergen, MR, Garber, A (1998) The effect of search procedures on utility elicitations. Medical Decision Making 18: pp. 76-83 CrossRef
- Dolan, P, Gudex, C, Kind, P, Williams, A (1996) Valuing health states: A comparison of methods. Journal of Health Economics 15: pp. 209-231 CrossRef
- Dolan, P, Sutton, M (1997) Mapping visual analogue scale health state valuations onto standard gamble and time trade-off values. Social Science and Medicine 44: pp. 1519-1530 CrossRef
- Hammerschmidt, T, Zeitler, H-P, Gulich, M, Leidl, R (2004) A comparison of different strategies to collect standard gamble utilities. Medical Decision Making 24: pp. 493-503 CrossRef
- Brazier, J., & Dolan, P. (2005). Evidence of preference construction in a comparison of variants of the standard gamble method. Health Economics and Decision Science Section Discussion Papers, University of Sheffield.
- Lenert, L. A., & Sturley, A. E. (2002). Use of the internet to study the utility values of the public. In AMIA annual symposium proceedings (pp. 440–444).
- Selmi, PM, Klein, MH, Greist, JH, Sorrell, SP, Erdman, HP (1990) Computer-administered cognitive-behavioral therapy for depression. The American Journal of Psychiatry 147: pp. 51-56
- Beck, AT, Rial, WY, Rickels, K (1974) Short form of depression inventory: Cross-validation. Psychological Reports 34: pp. 1184-1186
- McMinn, D, Treacy, R, Lin, K, Pynsent, P (1996) Metal on metal surface replacement of the hip. Clinical Orthopaedics and Related Research 329: pp. 89S-98S CrossRef
- Vale, L., Wyness, L., McCormack, K., McKenzie, L., Brazelli, M., & Stearns, S. (2001). Systematic review of the effectiveness and cost effectiveness of metal on metal hip resurfacing for treatment of hip disease. Health Services Research Unit, University of Aberdeen.
- Morgan, K, Dixon, S, Mathers, N, Thompson, J, Tomeny, M (2004) Psychological treatment for insomnia in the regulation of long-term hypnotic drug use. Health Technology Assessment 8: pp. 1-94
- Buysse, BJ, Reynolds, CF, Monk, TH, Berman, SR, Kupfer, DJ (1989) The Pittsburgh Sleep Quality Index for psychiatric practice and research. Psychiatry Research 28: pp. 193-213 CrossRef
- Man, WD, Polkey, MI, Donaldson, N, Gray, BJ, Moxham, J (2004) Community pulmonary rehabilitation after hospitalisation for acute exacerbations of chronic obstructive pulmonary disease: Randomised controlled study. BMJ (Clinical Research Ed.) 329: pp. 1209 CrossRef
- Lacasse, Y, Wong, E, Guyatt, G (1974) A systematic overview of the measurement properties of the chronic respiratory questionnaire. Canadian Respiratory Journal 4: pp. 131-139
- Guyatt, G, Mitchell, A, Irvine, EJ, Singer, J, Williams, N, Goodacre, R, Tompkins, C (1989) A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology 96: pp. 804-810
- Hanauer, SB, Feagan, BG, Lichtenstein, GR, Mayer, LF, Schreiber, S, Colombel, JF, Rachmilewitz, D, Wolf, DC, Olson, A, Bao, W, Rutgeerts, P (2002) Maintenance infliximab for Crohn’s disease: The ACCENT I randomised trial. Lancet 359: pp. 1541-1549 CrossRef
- Stein, K, Milne, R Health technology assessment. In: Baker, M, Kirk, S eds. (1998) Research and development in the NHS. Radcliffe Medical, Oxford
- Williams, A. (1995). The measurement and valuation of health: A chronicle. University of York, York.
- Garside, R, Stein, K, Castelnuovo, E, Pitt, M, Aschcroft, D, Dimmock, P, Payne, L (2005) The effectiveness and cost-effectiveness of pimecrolimus and tacrolimus for atopic eczema: A systematic review and economic evaluation. Health Technology Assessment 9: pp. 1-264
- Juniper, EF, Guyatt, G, Willan, A, Griffith, L (1994) Determining the minimal clinically important change in a disease-specific quality of life questionnaire. Journal of Clinical Epidemiology 47: pp. 81-87 CrossRef
- Barrett, B, Brown, D, Mundt, M, Brown, R (2005) Sufficiently important difference: Expanding the framework of clinical significance. Medical Decision Making 25: pp. 250-261 CrossRef
- Brozek, J., Guyatt, G. H., & Schunemann, H. (2006). How a well-grounded minimal important difference can enhance transparency of labelling claims and improve interpretation of a patient reported outcome measure. Health and Quality of Life Outcomes, 4, 69.
- Brazier, J, Roberts, J, Deverill, M (2002) The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics 21: pp. 292 CrossRef
- Kulkarni, AV (2006) Distribution-based and anchor-based approaches provided different interpretability estimates for the Hydrocephalus Outcome Questionnaire. Journal of Clinical Epidemiology 59: pp. 176-184 CrossRef
- The precision of health state valuation by members of the general public using the standard gamble
Quality of Life Research
Volume 18, Issue 4 , pp 509-518
- Cover Date
- Print ISSN
- Online ISSN
- Springer Netherlands
- Additional Links
- Industry Sectors
- Author Affiliations
- 1. Peninsula Technology Assessment Group, Peninsula Medical School, University of Exeter, Exeter, UK
- 2. University of Southampton, Southampton, UK
- 3. University of Sheffield, Sheffield, UK