Quality of Life Research

, Volume 25, Issue 2, pp 293–302 | Cite as

Content validity of Patient-Reported Outcomes Measurement Information System (PROMIS) items in the context of HIV clinical care

  • Todd C. Edwards
  • Rob J. Fredericksen
  • Heidi M. Crane
  • Paul K. Crane
  • Mari M. Kitahata
  • William C. Mathews
  • Kenneth H. Mayer
  • Leo S. Morales
  • Michael J. Mugavero
  • Rosa Solorio
  • Frances M. Yang
  • Donald L. Patrick



To assess content validity and patient and provider prioritization of Patient-Reported Outcomes Measurement Information System (PROMIS) depression, anxiety, fatigue, and alcohol use items in the context of clinical care for people living with HIV (PLWH), and to develop and assess new items as needed.


We conducted concept elicitation interviews (n = 161), item pool matching, prioritization focus groups (n = 227 participants), and cognitive interviews (n = 48) with English-speaking (~75 %) and Spanish-speaking (~25 %) PLWH from clinical sites in Seattle, San Diego, Birmingham, and Boston. For each domain we also conducted item review and prioritization with two HIV provider panels of 3–8 members each.


Among items most highly prioritized by PLWH and providers were those that included information regarding personal impacts of the concept being assessed, in addition to severity level. Items that addressed impact were considered most actionable for clinical care. We developed additional items addressing this. For depression we developed items related to suicide and other forms of self-harm, and for all domains we developed items addressing impacts PLWH and/or providers indicated were particularly relevant to clinical care. Across the 4 domains, 16 new items were retained for further psychometric testing.


PLWH and providers had priorities for what they believed providers should know to provide optimal care for PLWH. Incorporation of these priorities into clinical assessments used in clinical care of PLWH may facilitate patient-centered care.


HIV Clinical practice Patient-centered outcomes PROMIS 


  1. 1.
    Jensen, R. E., Rothrock, N. E., DeWitt, E. M., et al. (2015). The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Medical Care, 53, 153–159.CrossRefPubMedGoogle Scholar
  2. 2.
    Kozak, M. S., Mugavero, M. J., Ye, J., et al. (2012). Patient reported outcomes in routine care: Advancing data capture for HIV cohort research. Clinical Infectious Diseases, 54, 141–147.PubMedCentralCrossRefPubMedGoogle Scholar
  3. 3.
    Snyder, C. F., Aaronson, N. K., Choucair, A. K., et al. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Quality of Life Research, 21, 1305–1314.CrossRefPubMedGoogle Scholar
  4. 4.
    Haroutiunian, S., Donaldson, G., Yu, J., & Lipman, A. G. (2012). Development and validation of shortened, restructured Treatment Outcomes in Pain Survey instrument (the S-TOPS) for assessment of individual pain patients’ health-related quality of life. Pain, 153, 1593–1601.CrossRefPubMedGoogle Scholar
  5. 5.
    Brubaker, L., Khullar, V., Piault, E., et al. (2011). Goal attainment scaling in patients with lower urinary tract symptoms: Development and pilot testing of the Self-Assessment Goal Achievement (SAGA) questionnaire. International Urogynecology Journal, 22, 937–946.CrossRefPubMedGoogle Scholar
  6. 6.
    Mannion, A. F., Caporaso, F., Pulkovski, N., & Sprott, H. (2010). Goal attainment scaling as a measure of treatment success after physiotherapy for chronic low back pain. Rheumatology, 49, 1734–1738.CrossRefPubMedGoogle Scholar
  7. 7.
    Lohr, K. N., & Zebrack, B. J. (2009). Using patient-reported outcomes in clinical practice: Challenges and opportunities. Quality of Life Research, 18, 99–107.CrossRefPubMedGoogle Scholar
  8. 8.
    Donaldson, G. (2008). Patient-reported outcomes and the mandate of measurement. Quality of Life Research, 17, 1303–1313.CrossRefPubMedGoogle Scholar
  9. 9.
    Fredericksen, R., Edwards, T. C., Crawford, P. et al. (in press) Patient and provider priorities for self-reported domains of clinical care. AIDS Care.Google Scholar
  10. 10.
    Magasi, S., Ryan, G., Revicki, D., et al. (2012). Content validity of patient-reported outcome measures: Perspectives from a PROMIS meeting. Quality of Life Research, 21, 739–746.CrossRefPubMedGoogle Scholar
  11. 11.
    Fredericksen, R. J., Crane, P. K., Tufano, J., et al. (2012). Integrating a web-based patient assessment into primary care for HIV-infected adults. Journal of AIDS and HIV Research, 4, 47–55.PubMedCentralCrossRefPubMedGoogle Scholar
  12. 12.
    Lawrence, S. T., Willig, J. H., Crane, H. M., et al. (2010). Routine, self-administered, touch-screen, computer-based suicidal ideation assessment linked to automated response team notification in an HIV primary care setting. Clinical Infectious Diseases, 50, 1165–1173.PubMedCentralCrossRefPubMedGoogle Scholar
  13. 13.
    Bradley, K. A., Bush, K. R., Epler, A. J., et al. (2003). Two brief alcohol-screening tests From the Alcohol Use Disorders Identification Test (AUDIT): Validation in a female Veterans Affairs patient population. Archives of Internal Medicine, 163, 821–829.CrossRefPubMedGoogle Scholar
  14. 14.
    Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.PubMedCentralCrossRefPubMedGoogle Scholar
  15. 15.
    Justice, A. C., Holmes, W., Gifford, A. L., et al. (2001). Development and validation of a self-completed HIV symptom index. Journal of Clinical Epidemiology, 54(Suppl 1), S77–S90.CrossRefPubMedGoogle Scholar
  16. 16.
    Spitzer, R. L., Kroenke, K., & Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 282, 1737–1744.CrossRefPubMedGoogle Scholar
  17. 17.
    Bush, K., Kivlahan, D. R., McDonell, M. B., Fihn, S. D., & Bradley, K. A. (1998). The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Archives of Internal Medicine, 158, 1789–1795.CrossRefPubMedGoogle Scholar
  18. 18.
    DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45, S12–S21.PubMedCentralCrossRefPubMedGoogle Scholar
  19. 19.
    Brislin, R. W. (1986). Chapter 5: The wording and translation of research instruments. In W. J. Lonner & J. W. Berry (Eds.), Field methods in cross-cultural research (pp. 137–164). London: Sage Publications.Google Scholar
  20. 20.
    Eremenco, S. L., Cella, D., & Arnold, B. J. (2005). A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Evaluation and the Health Professions, 28, 212–232.CrossRefPubMedGoogle Scholar
  21. 21.
    Fowler, F. J. (1993). Survey research methods. Newbury Park, CA: Sage.Google Scholar
  22. 22.
    Jabine, T. B. (1984). Cognitive aspects of survey methodology: Building a bridge between disciplines. Report of the Advanced Research Seminar on Cognitive Aspects of Survey Methodology. National Academies.Google Scholar
  23. 23.
    Willis, G. B. (1999). Cognitive interviewing: A “how to” guide. Research Triangle Park, NC: Research Triangle Institute.Google Scholar
  24. 24.
    Harley, C., Takeuchi, E., Taylor, S., et al. (2012). A mixed methods approach to adapting health-related quality of life measures for use in routine oncology clinical practice. Quality of Life Research, 21, 389–403.CrossRefPubMedGoogle Scholar
  25. 25.
    Snyder, C. F., Jensen, R. E., Geller, G., Carducci, M. A., & Wu, A. W. (2010). Relevant content for a patient-reported outcomes questionnaire for use in oncology clinical practice: Putting doctors and patients on the same page. Quality of Life Research, 19, 1045–1055.CrossRefPubMedGoogle Scholar
  26. 26.
    Greenhalgh, J. (2009). The applications of PROs in clinical practice: What are they, do they work, and why? Quality of Life Research, 18, 115–123.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Todd C. Edwards
    • 1
  • Rob J. Fredericksen
    • 2
  • Heidi M. Crane
    • 2
  • Paul K. Crane
    • 2
  • Mari M. Kitahata
    • 2
  • William C. Mathews
    • 3
  • Kenneth H. Mayer
    • 4
  • Leo S. Morales
    • 1
  • Michael J. Mugavero
    • 5
  • Rosa Solorio
    • 1
  • Frances M. Yang
    • 6
  • Donald L. Patrick
    • 1
  1. 1.Department of Health Services, School of Public HealthUniversity of WashingtonSeattleUSA
  2. 2.Harborview Madison Clinic, School of MedicineUniversity of WashingtonSeattleUSA
  3. 3.Owen ClinicUniversity of California – San DiegoSan DiegoUSA
  4. 4.The Fenway Institute, School of Public HealthHarvard UniversityBostonUSA
  5. 5.1917 ClinicUniversity of Alabama – BirminghamBirminghamUSA
  6. 6.Georgia Regents UniversityAugustaUSA

Personalised recommendations