Abstract
Objective
The purpose of this paper is to summarize the best evidence regarding the impact of providing patient-reported outcomes (PRO) information to health care professionals in daily clinical practice.
Methods
Systematic review of randomized clinical trials (Medline, Cochrane Library; reference lists of previous systematic reviews; and requests to authors and experts in the field).
Results
Out of 1,861 identified references published between 1978 and 2007, 34 articles corresponding to 28 original studies proved eligible. Most trials (19) were conducted in primary care settings performed in the USA (21) and assessed adult patients (25). Information provided to professionals included generic health status (10), mental health (14), and other (6). Most studies suffered from methodologic limitations, including analysis that did not correspond with the unit of allocation. In most trials, the impact of PRO was limited. Fifteen of 23 studies (65%) measuring process of care observed at least one significant result favoring the intervention, as did eight of 17 (47%) that measured outcomes of care.
Conclusions
Methodological concerns limit the strength of inference regarding the impact of providing PRO information to clinicians. Results suggest great heterogeneity of impact; contexts and interventions that will yield important benefits remain to be clearly defined.
Similar content being viewed by others
Abbreviations
- PRO:
-
Patient-reported outcomes
- RCTs:
-
Randomized control trials
References
Food and Dug Administration (2006). Draft guidance for industry on patient-reported outcome measures: Use in medicinal product development to support labeling claims. Federal Register, 71, 5862–5863.
Greenhalgh, J., & Meadows, K. (1999). The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: A literature review. Journal of Evaluation in Clinical Practice, 5, 401–416.
Espallargues, M., Valderas, J. M., & Alonso, J. (2000). Provision of feedback on perceived health status to health care professionals: A systematic review of its impact. Medical Care, 38, 175–186.
McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges. Annual Review of Public Health, 20, 309–335.
Lohr, K. N. (1992). Applications of health status assessment measures in clinical practice. Overview of the third conference on advances in health status assessment. Medical Care, 30, MS1–MS14.
Rothwell, P. M., McDowell, Z., Wong, C. K., & Dorman, P. J. (1997). Doctors and patient don’t agree: Cross sectional study of patients’ and doctors’ perceptions and assessments of disability in multiple sclerosis. British Medical Journal, 314, 1580–1583.
Stimson, G. V. (1974). Obeying doctor’s orders: A view from the other side. Social Science & Medicine, 8(2), 97–104.
Deyo, R. A., & Carter, W. B. (1992). Strategies for improving and expanding the application of health status measures in clinical settings. A researcher-developer viewpoint. Medical Care, 30(5 Suppl), MS176–MS186.
Deyo, R. A., & Patrick, D. L. (1989). Barriers to the use of health status measures in clinical investigation, patient care, and policy research. Medical Care, 27, S254–S267.
Morris, J., Perez, D., & McNoe, B. (1998). The use of quality of life data in clinical practice. Quality of Life Research, 7, 85–91.
Meadows, K. A., Rogers, D., & Greene, T. (1998a). Attitudes to the use of health outcome questionnaires in the routine care of patients with diabetes: A survey of general practitioners and practice nurses. The British Journal of General Practice, 48, 1555–1559.
Hahn, E. A., Cella, D., Chassany, O., Fairclough, D. L., Wong, G. Y., & Hays, R. D. (2007). Clinical Significance Consensus Meeting Group. Precision of health-related quality-of-life data compared with other clinical measures. Mayo Clinic Proceedings, 82(10), 1244–1254.
Fitzpatrick, R., Fletcher, A., Gore, S., Jones, D., Spiegelhalter, D., & Cox, D. (1992). Quality of Life measures in health care. I: Applications and issues in assessment. British Medical Journal, 305, 1074–1077.
Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routine administered questionnaires for depression and anxiety: Systematic review. British Medical Journal, 322, 406–409.
Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002). Routine administration of Health Related Quality of Life (HRQoL) and needs assessments instruments to improve psychological outcome—a systematic review. Psychological Medicine, 32, 1345–1356.
von Elm, E., Poglia, G., Walder, B., & Tramèr, M. R. (2004). Different patterns of duplicate publication. An analysis of articles used in systematic reviews. The Journal of the American Medical Association, 291, 974–980.
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J., Gavaghan, D. J., et al. (1996). Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Controlled Clinical Trials, 17(1), 1–12.
Valderas, J. M., Rue, M., Guyatt, G., & Alonso, J. (2005). Systematic Use of Quality of Life Measures in the Clinical Practice Working Group. The impact of the VF-14 index, a perceived visual function measure, in the routine management of cataract patients. Quality of Life Research, 14(7), 1743–1753.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
Kraemer, H. C. (1992). Measurement of reliability for categorical data in medical research. Statistical Methods in Medical Research, 1(2), 183–99. Review.
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient reported outcome measures on routine practice: a structured review. Journal of Evaluation in Clinical Practice, 12(5), 559–568.
Brody, D. S., Lerman, C. E., Wolfson, H. G., & Caputo, G. C. (1990). Improvement in physicians’ counseling of patients with mental health problems. Archives of Internal Medicine, 150, 993–998.
Calkins, D. R., Rubenstein, L. V., Cleary, P. D., Davies, A. R., Jette, A. M., Fink, A., et al. (1994). Functional disability screening of ambulatory patients: A randomized controlled trial in a hospital-based group practice. Journal of General Internal Medicine, 9(10), 590–592.
Yager, J., & Linn, L. S. (1981). Physician-patient agreement about depression: Notation in medical records. General Hospital Psychiatry, 3, 271–276.
German, P. S., Shapiro, S., Skinner, E. A., Von Korff, M., Klein, L. E., Turner, R. W., et al. (1987). Detection and management of mental health problems of older patients by primary care providers. Journal of the American Medical Association, 257, 489–493.
Dailey, Y. M., Humphris, G. M., & Lennon, M. A. (2002). Reducing patients’ state anxiety in general dental practice: A randomized controlled trial. Journal of Dental Research, 81(5), 319–322.
Detmar, S. B., Muller, M. J., Schornagel, J. H., Wever, L. D.V., & Aaronson, N. K. (2002). Health related quality of life assessments and patient physician communication: A randomized controlled trial. The Journal of the American Medical Association, 228(23), 3027–3034.
Dowrick, C. (1995). Does testing for depression influence diagnosis or management by general practitioners? Family Practice, 12, 461–465.
Dowrick, C., & Buchan, I. (1995). Twelve month outcome of depression in general practice: Does detection or disclosure make a difference? British Medical Journal, 311, 1274–1276.
Shapiro, S., German, P. S., Skinner, E. A., et al. (1987). An experiment to change detection and management of mental morbidity in primary care. Medical Care, 25, 327–339.
Goldsmith, G., & Brodwick, M. (1989). Assessing the functional status of older patients with chronic illness. Family Medicine, 21, 38–41.
Hoeper, E. W., Nycz, G. R., Kessler, L. G., Burke, J. D. Jr., & Pierce, W. E. (1984). The usefulness of screening for mental illness. Lancet, 1, 33–35.
Kazis, L. E., Callahan, L. F., Meenan, R. F., & Pincus, T. (1990). Health status reports in the care of patients with rheumatoid arthritis. Journal of Clinical Epidemiology, 43, 1243–1253.
Linn, L. S., & Yager, J. (1980). The effect of screening, sensitization and feedback on notation of depression. Journal of Medical Education, 55, 942.
Magruder-Habib, K., Zung, W. W.K., & Feussner, J. R. (1990). Improving physicians’ recognition and treatment of depression in general medical care. Results from a randomized clinical trial. Medical Care, 28, 239–250.
Mathias, S. D., Fifer, S. K., Mazonson, P. D., Lubeck, D. P., Buesching, D. P., & Patrick, D. L. (1994). Necessary but not sufficient: the effect of screening and feedback on outcomes of primary care patients with untreated anxiety. Journal of General Internal Medicine, 9, 606–615.
Mazonson, P. D., Mathias, S. D., Fifer, S. K., Buesching, D. P., Malek, P., & Patrick, D. L. (1996). The mental health patient profile: Does it change primary care physicians’ practice patterns? The Journal of the American Board of Family Practice, 9, 336–345.
McCusker, J., Verdon, J., Tousignant, P., de Courval, L. P., Dendukuri, N., & Belzile, E. (2001). Rapid emergency department intervention for older people reduces risk of functional decline: Results of a multicenter randomized trial. Journal of the American Geriatrics Society, 49(10), 1272–1281.
McCusker, J., Dendukuri, N., Tousignant, P., Verdon, J., Poulin de Courval, J., & Belzile, E. (2003). Rapid two-stage emergency department intervention for seniors: impact on continuity of care. Academic Emergency Medicine, 10(3), 233–243.
Moore, J. T., Silimperi, D. R., & Bobula, J. A. (1978). Recognition of depression by family medicine residents: The impact of screening. The Journal of Family Practice, 7, 509–513.
Rand, E. H., Badger, L. W., & Coggins, D. R. (1988). Toward a resolution of contradictions. Utility of feedback from the GHQ. General Hospital Psychiatry, 10, 189–196.
Zung, W. W. K., Magill, M., Moore, J. T., & George, D. T. (1983). Recognition and treatment of depression in a family medicine practice. The Journal of Clinical Psychiatry, 44, 3–6.
Rubenstein, L. V., McCoy, J. M., Cope, D. W., Barrett, P. A., Hirsch, S. H., Messer, K. S., et al. (1995). Improving patient quality of life with feedback to physicians about functional status. Journal of General Internal Medicine, 10(11), 607–614.
Saitz, R., Horton, N. J., Sullivan, L. M., Moskowitz, M. A., & Samet, J. H. (2003). Addressing alcohol problems in primary care: A cluster randomized, controlled trial of a systems intervention. The screening and intervention in primary care (SIP) study. Annals of Internal Medicine, 138(5), 372–382.
Smith, P. (1998). The role of the general health questionnaire in general practice consultations. The British Journal of General Practice, 48(434), 1565–1569.
Velikova, G., Booth, L., Smith, A. B., Brown, P. M., Lynch, P., Brown, J. M., & Selby, P. J. (2004). Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. Journal of Clinical Oncology, 22(4), 714–724.
Wagner, A. K., Ehrenberg, B. L., Tran, T. A., Bungay, K. M., Cynn, D. J., & Rogers, W. H. (1997). Patient-based health status measurement in clinical practice: A study of its impact on epilepsy patients’ care. Quality of Life Research, 6, 329–341.
Wasson, J., Hays, R., Rubenstein, L., Nelson, E., Leaning, J., Johnson, D., et al. (1992). The short-term effect of patient health status assessment in a health maintenance organization. Quality of Life Research, 1(2), 99–106.
Wasson, J. H., Stukel, T. A., Weiss, J. E., Hays, R. D., Jette, A. M., & Nelson, E. C. (1999). A randomized trial of the use of patient self-assessment data to improve community practices. Effective Clinical Practice, 2(1), 1–10.
White, P., Atherton, A., Hewett, G., & Howells, K. (1995). Using information from asthma patients: A trial of information feedback in primary care. British Medical Journal, 311(7012), 1065–1069.
Whooley, M. A., Stone, B., & Soghikian, K. (2000). Randomized trial of case-finding for depression in elderly primary care patients. Journal of General Internal Medicine, 15(5), 293–300.
Williams, J. W. Jr., Mulrow, C. D., Kroenke, K., Dhanda, R., Badgett, R. G., Omori, D., et al. (1999). Case-finding for depression in primary care: A randomized trial. The American Journal of Medicine, 106(1), 36–43.
Kramer, M. S., & Feinstein, A. R. (1981). Clinical biostatistics LIV. The biostatistics of concordance. Clinical Pharmacology and Therapeutics, 29, 111–123.
Clarke, M., & Oxman, A. D. (Eds.) (2003). Cochrane Reviewers’ Handbook 4.2.0 [updated March 2003]. In: The Cochrane Library, Issue 2. Oxford: Update Software. Updated quarterly.
Puhan, M. A., Soesilo, I., Guyatt, G. H., & Schunemann, H. J. (2006). Combining scores from different patient reported outcome measures in meta-analyses: When is it justified? Health and Quality of Life Outcomes, 4, 94.
Goodman, S. N. (1998). Multiple comparisons, explained. American Journal of Epidemiology, 147(9), 807–812; discussion 815.
Moye, L. A. (2000). Alpha calculus in clinical trials: Considerations and commentary for the new millennium. Statistics in Medicine, 19(6), 767–779.
Rubenstein, L. V., Calkins, D. R., Young, R. T., Cleary, P. D., Fink, A., Kosecoff, J., et al. (1989). Improving patient function: A randomized trial of functional disability screening. Annals of Internal Medicine, 111(10), 836–842.
Valderas, J. M., Alonso, J., Valderas, J. M., Alonso, J., Prieto, L., Espallargues, M., & Castells, X. (2004). Content-based interpretation aids for health-related quality of life measures in clinical practice. An example for the visual function index (VF-14). Quality of Life Research, 13(1), 35–44.
Rebollo, P., Valderas, J. M., & Ortega, F. (2005). Progress in Spain of the described barriers to the use of perceived health status measures in the clinical practice. Medicina Clínica, 125(18), 703–705.
Greenhalgh, J., Long, A. F., & Flynn, R. (2005). The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory? Social Science & Medicine, 60(4), 833–843.
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007). How quickly do systematic reviews go out of date? A survival analysis. Annals of Internal Medicine, 147(4), 224–233.
Callahan, C. M., Hendrie, H. C., Dittus, R. S., Brater, D. C., Hui, S. L., & Tierney, W. M. (1994). Improving treatment of late life depression in primary care: A randomized clinical trial. Journal of the American Geriatrics Society, 42(8), 839–846.
Callahan, C. M., Dittus, R. S., & Tierney, W. M. (1996). Primary care physicians’ medical decision making for late-life depression. Journal of General Internal Medicine, 11, 218–219.
Acknowledgements
This work was supported in part by: Ministerio de Educación, Cultura y Deporte (SAB2001-0088); the Spanish Public Health Network (RCESP) “Investigación en Epidemiología y Salud Pública: Determinantes, Mecanismos, Métodos y Políticas” (Exp. C03/09), and the Instituto de Salud Carlos III: Red de Investigación Cooperativa IRYSS (Exp. G03/202), and Ayudas para contratos de Profesionales Post MIR (Exp. CM0300118). A preliminary report of this work was presented at the Annual Conference of the International Society for Quality of Life Research in Hong Kong, China (2004).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Valderas, J.M., Kotzeva, A., Espallargues, M. et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res 17, 179–193 (2008). https://doi.org/10.1007/s11136-007-9295-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-007-9295-0