Quality of Life Research

, Volume 14, Issue 2, pp 285–295 | Cite as

Estimating clinically significant differences in quality of life outcomes

  • Kathleen W. Wyrwich
  • Monika Bullinger
  • Neil Aaronson
  • Ron D. Hays
  • Donald L. Patrick
  • Tara Symonds
Article

Abstract

Objective: This report extracts important considerations for determining and applying clinically significant differences in quality of life (QOL) measures from six published articles written by 30 international experts in the field of QOL assessment and evaluation. The original six articles were presented at the Symposium on Clinical Significance of Quality of Life Measures in Cancer Patients at the Mayo Clinic in April 2002 and subsequently were published in Mayo Clinic Proceedings. Principal findings: Specific examples and formulas are given for anchor-based methods, as well as distribution-based methods that correspond to known or relevant anchors to determine important differences in QOL measures. Important prerequisites for clinical significance associated with instrument selection, responsiveness, and the reporting of QOL trial results are provided. We also discuss estimating the number needed to treat (NNT) relative to clinically significant thresholds. Finally, we provide a rationale for applying group-derived standards to individual assessments. Conclusions: While no single method for determining clinical significance is unilaterally endorsed, the investigation and full reporting of multiple methods for establishing clinically significant change levels for a QOL measure, and greater direct involvement of clinicians in clinical significance studies are strongly encouraged.

Keywords

Clinically important change Clinical significance Minimally important difference Quality of life 

Abbreviations

CTT

classical test theory

MID

minimal important difference

NNT

number needed to treat

QOL

quality of life

SEM

standard error of measurement

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sloan, J, Cella, D, Frost, M,  et al. 2002Assessing clinical significance in measuring oncology patient quality of life: Introduction to the symposium, content overview, and definition of terms.Mayo Clinic Proc77367370Google Scholar
  2. Cella, D, Bullinger, M, Scott, C,  et al. 2002Group vs. individual approaches to understanding the clinical significance of differences or changes in quality of life.Mayo Clinic Proc77384392Google Scholar
  3. Frost, M, Bonomi, A, Ferrans, C,  et al. 2002Patient, clinician, and population perspectives on determining the clinical significance of quality-of-life scores.Mayo Clinic Proc77488494Google Scholar
  4. Guyatt, G, Osoba, D, Wu, A,  et al. 2002Methods to explain the clinical significance of health status measures.Mayo Clinic Proc77371383Google Scholar
  5. Sprangers, M, Moinpour, C, Moynihan, T,  et al. 2002Assessing meaningful change in quality of life over time: A users’ guide for clinicians.Mayo Clinic Proc77561571Google Scholar
  6. Symonds, T, Berzon, R, Marquis, P,  et al. 2002The clinical significance of quality-of-life results: Practical considerations for specific audiences.Mayo Clinic Proc77572583Google Scholar
  7. Osoba, D. 2002Taxonomy of the uses of health-related quality-of-life instruments in cancer care and the clinical meaningfulness of the results.Med Care40(6 suppl)III-31III-38Google Scholar
  8. Wyrwich, K, Wolinsky, F 2000Identifying meaningful intra-individual change standards for health-related quality of life measures.J Eval Clin Practice63949Google Scholar
  9. Lydick, E, Epstein, R 1993Interpretation of quality of life changes.Qual Life Res2221226CrossRefPubMedGoogle Scholar
  10. Ware, JJ, Keller, S 1996

    Interpreting general health measures.

    Spilker, B eds. Quality of Life and Pharmacoeconomics in Clinical Trials.Lippincott-Raven PublishersPhiladelphia, PA445460
    Google Scholar
  11. Kravitz, R, Greenfield, S, Rogers, W,  et al. 1992Differences in the mix of patients among medical specialities and systems of care: Results from the medical outcomes study.J Am Med Assoc26716171623Google Scholar
  12. King, M 1996The interpretation of scores from the EORTC quality of life questionnaire QLQ-C30.Qual Life Res5555567PubMedGoogle Scholar
  13. Nilsdotter, AK, Lohmander, LS 2003Patient relevant outcomes after total hip replacement. A comparison between different surgical techniques.Health Qual Life Outcomes121Google Scholar
  14. Patrick, D, Martin, M, Bushnell, D,  et al. 1999Quality of life of women with urinary incontinence: Further development of the incontinence quality of life instrument (I-QOL).Uro-logy537176Google Scholar
  15. Jowett, S, Seal, C, Barton, R,  et al. 2001The Short Inflammatory Bowel Disease Questionnaire is reliable and responsive to clinically important change in ulcerative colitis.Am J Gasteroenterol9629212928Google Scholar
  16. Patrick, D, Gagnon, D, Zagari, M,  et al. 2003Assessing the clinical significance of health-related quality of life (HrQOL) improvements in anaemic cancer patients receiving epoetin alfa.Eur J Cancer39335345CrossRefPubMedGoogle Scholar
  17. Cella, D, Eton, D, Fairclough, D,  et al. 2002What is clinically meaningful change (CMC) on the Functional Assessment of Cancer Therapy–Lung (FACT-L) questionnaire?. An analysis of data from ECOG 5592.J Clin Epidemiol55286295Google Scholar
  18. Kosinski, M,  et al. 2000Determining minimally important changes in generic and disease-specific health-related quality of life questionnaires in clinical trials of rheumatoid arthritis.Arthritis Rheum4314781487CrossRefPubMedGoogle Scholar
  19. Barber, B, Santanello, N, Epstein, R 1996Impact of the global on patient perceivable change in an asthma-specific QOL instrument.Qual Life Res5115122Google Scholar
  20. Jaeschke, R, Singer, J, Guyatt, G 1989Measurement of health status: Ascertaining the minimal clinically important difference.Control Clin Trials10407415Google Scholar
  21. Osoba, D, Rodriques, G, Myles, J,  et al. 1998Interpreting the significance of changes in health-related quality-of-life scores.J Clin Oncol16139144PubMedGoogle Scholar
  22. Redelmeier, D, Guyatt, G, Goldstein, R 1996Assessing the minimal important difference in symptoms: A comparison of two techniques.J Clin Epidemiol4912151219Google Scholar
  23. Redelmeier, D, Goldstein, R, Min, S,  et al. 1996Spirometry and dyspnea in patients with COPD.Chest10911631168Google Scholar
  24. Norman, G, Stratford, P, Regehr, G 1997Methodological problems in the retrospective computation of responsiveness to change: The lessons of Cronbach.J Clin Epidemiol50869879Google Scholar
  25. Wyrwich, K 2002Statistical interpretation of HRQoL changes in COPD: Development of the MCID standards and related approaches.Eur Respir Rev1294103Google Scholar
  26. Sloan, J,  et al. 2003Practical guidelines for assessing the clinical significance of health-related quality of life changes within clinical trials.Drug Inf J372331Google Scholar
  27. Cohen, J 1977Statistical Power Analysis for the Behavioral SciencesAcademic PressNew Yorkp. 8.Google Scholar
  28. Cohen, J 1988Statistical Power Analysis for the Behavioral Sciences.Lawrence Erlbaum AssociatesHillsdaleGoogle Scholar
  29. Anastasi, A, Urbina, S 1997Psychological Testing7Prentice-HallUpper Saddle River, NJGoogle Scholar
  30. Nunnally, J, Bernstein, I 1994Psychometric TheoryMcGraw HillNew YorkGoogle Scholar
  31. Wyrwich, K, Nienaber, N, Tierney, W,  et al. 1999Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life.Med Care37469478Google Scholar
  32. Wyrwich, K, Tierney, W, Wolinsky, F 1999Further evidence supporting a SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life.J Clin Epidemiol52861873Google Scholar
  33. Wyrwich, K, Tierney, W, Wolinsky, F 2002Using the standard error of measurement to identify important intra-individual change on the Asthma Quality of Life Questionnaire.Qual Life Res1117Google Scholar
  34. Donaldson, G, Moinpour, C 2002Individual differences in quality-of-life treatment response.Med Care40(6 Suppl)III3953Google Scholar
  35. Norman, G, Sloan, J, Wyrwich, K 2003Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation.Med Care41582592Google Scholar
  36. Miller, G 1956The magic number seven plus or minus two: Some limits on our capacity for processing information.Psycholog Rev638197Google Scholar
  37. McHorney, C, Tarlov, A 1995Individual-patient monitoring in clinical practice: Are available health status surveys adequate?Qual Life Res4293307PubMedGoogle Scholar
  38. Revicki, D, Osoba, D, Fairclough, D,  et al. 2000Recommendations on health-related quality of life research to support labeling and promotional claims in the United States.Qual Life Res9887900CrossRefGoogle Scholar
  39. Hays, R, Hadorn, D 1992Responsiveness to change: An aspect of validity, not a separate dimension.Qual Life Res17375Google Scholar
  40. Husted, J, Cook, R, Farewell, V,  et al. 2000Methods for assessing responsiveness: A critical review and recommendations.J Clin Epidemiol53459468Google Scholar
  41. Deyo, R, Centor, R 1986Assessing the responsiveness of functional scales to clinical change: An analogy to diagnostic test performance.J Chron Dis1897906Google Scholar
  42. Kazis, L, Anderson, J, Meenan, R 1989Effect sizes for interpreting changes in health status.Med Care27S178S189Google Scholar
  43. Deyo, R, Diehr, P, Patrick, D 1991Reproducibility and responsiveness of health status measures.Control Clin Trials12142S158SPubMedGoogle Scholar
  44. Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, 1998.Google Scholar
  45. Bombardier, C, Raboud, J 1992A comparison of health-related quality-of-life measures for rheumatoid arthritis research.Control Clin Trials12243S256SGoogle Scholar
  46. Katz, J,  et al. 1992Comparative measurement sensitivity of short and longer health status instruments.Med Care30917925Google Scholar
  47. Guyatt, G, Walter, S, Norman, G 1987Measuring change over time: Assessing the usefulness of evaluative instruments.J Clin Epidemiol40171178Google Scholar
  48. Guyatt, G, Kirshner, B, Jaeschke, R 1992Measuring health status: What are the necessary measurement properties?J Clin Epidemiol4513411345Google Scholar
  49. Liang, M,  et al. 1985Comparative measurement efficiency and sensitivity of five health status instruments for arthritis research.Arthritis Rheum28542547Google Scholar
  50. Baker, D, Hays, R, Brook, R 1997Understanding changes in health status: Is the floor phenomenon merely the last step of the staircase?Med Care35115Google Scholar
  51. Liang, M 2000Longitudinal construct validity: Establishment of clinical meaning in patient evaluative instruments.Med Care38(9 suppl)II84II90Google Scholar
  52. Lydick, E 2000Approaches to the interpretation of quality-of-life scales.Medical Care38(9 suppl)II180II183Google Scholar
  53. Bindman, A 1990The floor phenomenon.Med Care2811421152Google Scholar
  54. Fayers, P, Machin, D 2000Quality of Life Assessment, Analysis and Interpretation.John Wiley & SonsChichester, UKGoogle Scholar
  55. Nayfield, S, Ganz, P, Moinpour, C,  et al. 1992Report from a National Cancer Institute (USA) workshop on quality of life assessment in cancer clinical trials.Qual Life Res1203210Google Scholar
  56. Walter, S 2001Number needed to treat (NNT): Estimation of a measure of clinical benefit.Statist Med2039473962Google Scholar
  57. Juniper, E, Guyatt, G, Willan, A,  et al. 1994Determining a minimal important change in a disease-specific quality of life questionnaire.J Clin Epidemiol478187Google Scholar
  58. Guyatt, G,  et al. 1998Interpreting treatment effects in randomised trials.BMJ316690693Google Scholar
  59. Norman G, Sridhar F, Guyatt G, et al. The relation of distribuation- and anchor-based approaches in interpretation of changes in health related quality of life. Med Care 2001.Google Scholar

Copyright information

© Springer 2005

Authors and Affiliations

  • Kathleen W. Wyrwich
    • 1
  • Monika Bullinger
    • 2
  • Neil Aaronson
    • 3
  • Ron D. Hays
    • 4
  • Donald L. Patrick
    • 5
  • Tara Symonds
    • 6
  1. 1.Saint Louis UniversitySt. LouisUSA
  2. 2.Department of Medical PsychologyUniversity Clinics EppendorfHamburgGermany
  3. 3.Division of Psychosocial ResearchThe Netherlands Cancer InstituteAmsterdamThe Netherlands
  4. 4.UCLA School of Medicine, RANDLos Angeles, Santa MonicaUSA
  5. 5.Departments of Health Services and EpidemiologyUniversity of WashingtonSeattleUSA
  6. 6.Outcomes Research DepartmentPfizer Ltd.KentUK

Personalised recommendations