Advertisement

Quality of Life Research

, Volume 10, Issue 7, pp 579–585 | Cite as

Why are we weighting? The role of importance ratings in quality of life measurement

  • Tom Trauer
  • Andrew Mackinnon
Article

Abstract

Many Quality of Life (QoL) instruments ask respondents to rate a number of life domains in terms of satisfaction and personal importance, and derive weighted satisfaction scores by multiplying the two ratings. This paper demonstrates that this practice is both undesirable and unnecessary. QoL domains are selected on the basis of their inherent importance, rendering separate importance rating partially redundant. Weighted scores present difficulties in interpretation. Further, we show that multiplicative composites have undesirable psychometric properties. There is evidence that multiplicative composites have little or no advantage over unweighted ratings in correlational or predictive studies. Apart from the face validity and the intuitive appeal of multiplying satisfaction ratings by importance ratings, there appear to be no sound reasons for doing so, and several good reasons not to do so.

Importance ratings Multiplicative composites Quality of life Satisfaction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Diener E. Subjective well-being. Psychol Bull 1984; 95: 542–575.PubMedCrossRefGoogle Scholar
  2. 2.
    Ferrans CE, Powers MJ. Quality of life index: Development and psychometric properties. Adv Nursing Sci 1985; 8(1): 15–24.Google Scholar
  3. 3.
    Becker M, Diamond R, Sainfort F. A new patient focused index for measuring quality of life in persons with severe and persistent mental illness. Qual Life Res 1993; 2: 239–251.PubMedCrossRefGoogle Scholar
  4. 4.
    Frisch MB. The quality of life inventory: A cognitive-behavioral tool for complete problem assessment, treatment planning, and outcome evaluation. The Behav Therap 1993; 16(2): 42–45.Google Scholar
  5. 5.
    Cummins RA, McCabe MP, Romeo Y, Gullone E. The Comprehensive quality of life scale (ComQol): Instrument development and psychometric evaluation on college staff and students. Edu Psychol Measur 1994; 54(2): 372–382.Google Scholar
  6. 6.
    Gill TM, Feinstein AR. A critical appraisal of the quality of quality-of-life measurements. JAMA 1994; 272(8): 619–626.PubMedCrossRefGoogle Scholar
  7. 7.
    Frisch MB, Cornell J, Villanueva M, Retzlaff PJ. Clinical validation of the quality of life inventory: A measure of life satisfaction for use in treatment planning and outcome assessment. Psychol Assess 1992; 4(1): 92–101.CrossRefGoogle Scholar
  8. 8.
    Oliver N, Holloway F, Carson J. Deconstructing quality of life. J Mental Health 1995; 4: 1–4.CrossRefGoogle Scholar
  9. 9.
    Cummins RA. Assessing quality of life. In: Brown RI (ed), Quality of Life for Handicapped People, London: Chapman & Hall, 1995.Google Scholar
  10. 10.
    Lehman AF, Ward NC, Linn LS. Chronic mental patients: The quality of life issue. Am J Psychiatry 1982; 139(10): 1271–1276.PubMedGoogle Scholar
  11. 11.
    Juniper EF, Guyatt GH, Jaeschke R. How to develop and validate a new health-related quality of life instrument. In: Spilker B (ed), Quality of Life and Pharmacoeconomics in Clinical Trials. Philadelphia: Lippincott-Raven, 1996: 49–56.Google Scholar
  12. 12.
    Andrews FM, Withey SB. Social Indicators of Well-being: Americans' Perceptions of Life Quality. New York: Plenum Press, 1976.Google Scholar
  13. 13.
    Campbell A, Converse PE, Rodgers WL. The Quality of American Life. New York: Russell Sage Foundation, 1976.Google Scholar
  14. 14.
    Grayson DA. Limitations on the use of scales in psychiatric research. Australian New Zealand J Psychiatry 1998; 22: 99–108.CrossRefGoogle Scholar
  15. 15.
    Brief AP, Butcher AH, George JM, Link KE. Integrating bottom-up and top-down theories of subjective well-being: The case of health. J Pers Soc Psy 1993; 64(4): 646–653.CrossRefGoogle Scholar
  16. 16.
    Gulliksen H. The Theory of Mental Tests. New York: Wiley, 1950.Google Scholar
  17. 17.
    Hambleton RK, Swaminathan H. Item Response Theory. Dordrecht: Kluwer Nijhoff, 1985.Google Scholar
  18. 18.
    Van Schuur WH, Kiers HAL. Why factor analysis often is the incorrect model for analyzing bipolar concepts, and what model to use instead. Appl Psychol Measur 1994; 18(2): 97–110.Google Scholar
  19. 19.
    Schmidt FL. Implications of a measurement problem for expectancy theory research. Org Behav Human Perform 1973; 10: 243–251.CrossRefGoogle Scholar
  20. 20.
    Stevens SS. On the psychophysical law. Psychol Rev 1957; 64: 153–181.PubMedCrossRefGoogle Scholar
  21. 21.
    Evans MG. The problem of analyzing multiplicative composites: Interactions revisited. Am Psychol 1991; 46(1): 6–15.CrossRefGoogle Scholar
  22. 22.
    Waters LK, Roach D. Comparison of unweighted and importance-weighted job satisfaction measures for three samples of female office workers. Psychological Rep 1971; 28(3): 779–782.Google Scholar
  23. 23.
    Jones BT, McMahon J. A comparison of positive and negative alcohol expectancy and value and their multiplicative composite as predictors of post-treatment abstinence survivorship. Addiction 1996; 91(1): 89–99.PubMedCrossRefGoogle Scholar
  24. 24.
    Cohen J. Things I have learned (so far). Am Psychol 1990; 45(12): 1304–1312.CrossRefGoogle Scholar
  25. 25.
    Einhorn HJ, Hogarth RM. Unit weighting schemes for decision making. Organizational Behav Human Dec Proc 1975; 13(2): 171–192.CrossRefGoogle Scholar
  26. 26.
    Skinner HA. A multivariate evaluation of the MAST. J Studies Alcohol 1979; 40(9): 831–844.Google Scholar
  27. 27.
    Thacker JW, Fields MW, Tetrick LE. The factor structure of union commitment: An application of confirmatory factor analysis. J App Psy 1989; 74(2): 228–232.CrossRefGoogle Scholar
  28. 28.
    Nunnally JC. Psychometric Theory. New York: McGraw-Hill, 1967.Google Scholar
  29. 29.
    Oishi S, Diener E, Suh E, Lucas RE. Value as a moderator in subjective well-being. J Personal 1999; 67(1): 157–184.CrossRefGoogle Scholar
  30. 30.
    Rejeski WJ, Martin KA, Miller ME, Ettinger WHJ, Rapp S. Perceived importance and satisfaction with physical function in patients with knee osteoarthritis. Ann Behav Med 1998; 20(2): 141–148.PubMedCrossRefGoogle Scholar
  31. 31.
    Martin KA, Rejeski WJ, Miller ME, James MK, Ettinger WHJ, Messier SP. Validation of the PASE in older adults with knee pain and physical disability. Med Sci Sports Exer 1999; 31(5): 627–633.CrossRefGoogle Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Tom Trauer
    • 1
  • Andrew Mackinnon
    • 1
  1. 1.Mental health research instituteparkvilleAustralia

Personalised recommendations