Skip to main content

Advertisement

SpringerLink
Log in

The three-item patient-reported instrument for retrospective adherence in resource constrained settings: reliability, validity and potential utility

  • Published:
Journal of Behavioral Medicine Aims and scope Submit manuscript

Abstract

Introduction: Patient-report instruments remain the most feasible and sustainable approaches for monitoring medication adherence in clinical settings. However, questions of their reliability and validity persist. Studies suggest that the 3-item instrument for retrospective adherence (IRA) developed by Wilson et al. offers a viable option for clinically monitoring medication adherence. Here we report the reliability and validity of the IRA among patients recruited from community-based HIV clinics and antiretroviral therapy (ART) dispensaries in a resource constrained township in Cape Town, South Africa. Methods: Women (n = 794) and men (n = 228) receiving ART completed the IRA at three time points: (a) in a face-to-face administration at enrollment (b) in1-week phone interview and (c) 1-month phone interview. Participants also provided contemporaneous blood samples for HIV viral load testing as a clinical outcome and unannounced phone-based pill counts as an objective assessment of ART adherence. Results: The IRA was internally consistent and showed evidence of time stability. The IRA also demonstrated validity with respect to pill count adherence, correlates of adherence, and HIV viral load. Response operating curve analysis yielded an area under the curve of 0.646, using 75% adherence as the cut-off, with 0.637 sensitivity and 0.567 specificity. Conclusions: The IRA demonstrated reliability, construct validity and criterion validity in a resource constrained setting, supporting use of the IRA in research and clinical care.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Data Availability

Data are retained by the authors and available upon reasonable request.

References

  • Bangsberg, D. R., Hecht, F. M., Charlebois, E. D., Chesney, M., & Moss, A. (2001). Comparing objective measures of adherence to HIV antiretroviral therapy: Electronic medication monitors and unannounced pill counts. AIDS and Behavior, 5, 275–281.

    Article  Google Scholar 

  • Bangsberg, D. R., Charlebois, E. D., Grant, R. M., Holodniy, M., Deeks, S. G., Perry, S., et al. (2003). High levels of adherence do not prevent accumulation of HIV drug resistance mutations. Aids (London, England), 17(13), 1925–1932.

    Article  PubMed  Google Scholar 

  • Bangsberg, D. R., Acosta, E. P., Gupta, R., Guzman, D., Riley, E. D., Harrigan, P. R., et al. (2006). Adherence-resistance relationships for protease and non-nucleoside reverse transcriptase inhibitors explained by virological fitness. Aids (London, England), 20(2), 223–231.

    Article  CAS  PubMed  Google Scholar 

  • Bonner, K., Mezochow, A., Roberts, T., Ford, N., & Cohn, J. (2013). Viral load monitoring as a tool to reinforce adherence: A systematic review. Journal Of Acquired Immune Deficiency Syndromes, 64(1), 74–78.

    Article  PubMed  Google Scholar 

  • Bucek, A., Raymond, J., Leu, C. S., Warne, P., Abrams, E. J., Dolezal, C., et al. (2020). Preliminary validation of an Unannounced Telephone Pill Count Protocol to measure Medication Adherence among Young adults with Perinatal HIV infection. Journal Of The Association Of Nurses In Aids Care, 31(1), 35–41.

    Article  Google Scholar 

  • DiClemente-Bosco, K., Weber, A. Z., Harrison, A., Tsawe, N., Rini, Z., Brittain, K., et al. (2022). Empowerment in pregnancy: ART adherence among women living with HIV in Cape Town, South Africa. Social Science And Medicine, 296, 114738.

    Article  PubMed  Google Scholar 

  • Finitsis, D. J., Pellowski, J. A., Huedo-Medina, T. B., Fox, M. C., & Kalichman, S. C. (2016). Visual analogue scale (VAS) measurement of antiretroviral adherence in people living with HIV (PLWH): A meta-analysis. Journal Of Behavioral Medicine, 39(6), 1043–1055.

    Article  PubMed  Google Scholar 

  • Hahn, J. A., Fatch, R., Wanyenze, R. K., Baveewo, S., Kamya, M. R., Bangsberg, D. R., et al. (2014). Decreases in self-reported alcohol consumption following HIV counseling and testing at Mulago Hospital, Kampala, Uganda. Bmc Infectious Diseases, 14, 403.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Amaral, C. M., Stearns, H. L., White, D., Flanagan, J. A., Pope, H., et al. (2007). Adherence to antiretroviral therapy assessed by unannounced pill counts conducted by telephone. Journal of General Internal Medicine, 22, 1003–1006.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Amaral, C. M., Cherry, C., Flanagan, J., Pope, H., Eaton, L., et al. (2008a). Monitoring medication adherence by unannounced pill counts conducted by telephone: Reliability and criterion-related validity. HIV Clin Trials, 9(5), 298–308.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Amaral, C. M., Cherry, C., Flanagan, J. A., Pope, H., Eaton, L., et al. (2008b). Monitoring antiretroviral adherence by unannounced pill counts conducted by telephone: Reliability and criterion-related validity. HIV Clinical Trials, 9, 298–308.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Amaral, C., Swetsze, C., Eaton, L., Kalichman, M. O., Cherry, C., et al. (2010). Monthly unannounced pill counts for monitoring HIV treatment adherence: Tests for self-monitoring and reactivity effects. HIV Clin Trials, 11(6), 325–331.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Cherry, C., Kalichman, M. O., Amaral, C. M., White, D., Pope, H., et al. (2011). Integrated behavioral intervention to improve HIV/AIDS treatment adherence and reduce HIV transmission. American Journal Of Public Health, 101(3), 531–538.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kalichman, S. C., Kalichman, M. O., Cherry, C., Eaton, L. A., Cruess, D., & Schinazi, R. F. (2016). Randomized factorial trial of phone-delivered support counseling and Daily text message reminders for HIV Treatment Adherence. Journal Of Acquired Immune Deficiency Syndromes, 73(1), 47–54.

    Article  PubMed  Google Scholar 

  • Kalichman, S. C., Katner, H., Eaton, L. A., Hill, M., Ewing, W., & Kalichman, M. O. (2021). Randomized Community Trial comparing Telephone versus Clinic-Based behavioral health counseling for people living with HIV in a rural setting. Journal of Rural Health.

  • Marshall, B. D. L., Tate, J. P., McGinnis, K. A., Bryant, K. J., Cook, R. L., Edelman, E. J., et al. (2017). Long-term alcohol use patterns and HIV disease severity. Aids (London, England), 31(9), 1313–1321.

    Article  PubMed  Google Scholar 

  • Mason, M., Cho, Y., Rayo, J., Gong, Y., Harris, M., & Jiang, Y. (2022). Technologies for Medication Adherence Monitoring and Technology Assessment Criteria: Narrative Review. JMIR Mhealth Uhealth, 10(3), e35157.

    Article  PubMed  PubMed Central  Google Scholar 

  • Nguyen, T. M., La Caze, A., & Cottrell, N. (2014). What are validated self-report adherence scales really measuring?: A systematic review. British Journal Of Clinical Pharmacology, 77(3), 427–445.

    Article  PubMed  PubMed Central  Google Scholar 

  • Phillips, T., Brittain, K., Mellins, C. A., Zerbe, A., Remien, R. H., Abrams, E. J., et al. (2017). A self-reported adherence measure to screen for elevated HIV viral load in pregnant and Postpartum Women on antiretroviral therapy. Aids And Behavior, 21(2), 450–461.

    Article  PubMed  PubMed Central  Google Scholar 

  • Phillips, T. K., Wilson, I. B., Brittain, K., Zerbe, A., Mellins, C. A., Remien, R. H., et al. (2019). Decreases in self-reported ART adherence predict HIV Viremia among pregnant and Postpartum South African Women. Journal Of Acquired Immune Deficiency Syndromes, 80(3), 247–254.

    Article  CAS  PubMed  Google Scholar 

  • Radloff, L. S., The, C. E. S. D., & Scale (1977). A self-report depression scale for research in the general population. Applied Psych Measurement, 1, 385–401.

    Article  Google Scholar 

  • Simoni, J. M., Kurth, A. E., Pearson, C. R., Pantalone, D. W., Merrill, J. O., & Frick, P. A. (2006a). Self-report measures of antiretroviral therapy adherence: A review with recommendations for HIV research and clinical management. Aids And Behavior, 10(3), 227–245.

    Article  PubMed  PubMed Central  Google Scholar 

  • Simoni, J., Kurth, A. E., Pearson, C., Pantalone, D. W., Merrill, J., & Frick, P. (2006b). Self-report measures of antiretroviral therapy adherence: A review with recommendations for HIV Research and Clinical Management. AIDS Behavior, 10, 227–331.

    Article  PubMed  Google Scholar 

  • Spinelli, M. A., Haberer, J. E., Chai, P. R., Castillo-Mancilla, J., Anderson, P. L., & Gandhi, M. (2020). Approaches to objectively measure antiretroviral medication adherence and drive adherence interventions. Current Hiv/Aids Reports, 17(4), 301–314.

    Article  PubMed  PubMed Central  Google Scholar 

  • Trief, P. M., Kalichman, S. C., Wang, D., Drews, K. L., Anderson, B. J., Bulger, J. D., et al. (2022). Medication adherence in young adults with youth-onset type 2 diabetes: iCount, an observational study. Diabetes Research And Clinical Practice, 184, 109216.

    Article  PubMed  Google Scholar 

  • Uthman, O. A., Magidson, J. F., Safren, S. A., & Nachega, J. B. (2014). Depression and adherence to antiretroviral therapy in low-, middle- and high-income countries: A systematic review and meta-analysis. Current Hiv/Aids Reports, 11(3), 291–307.

    Article  PubMed  PubMed Central  Google Scholar 

  • Velloza, J., Kemp, C. G., Aunon, F. M., Ramaiya, M. K., Creegan, E., & Simoni, J. M. (2020). Alcohol use and antiretroviral therapy non-adherence among adults living with HIV/AIDS in Sub-Saharan Africa: A systematic review and Meta-analysis. Aids And Behavior, 24(6), 1727–1742.

    Article  PubMed  PubMed Central  Google Scholar 

  • Whiteley, L. B., Olsen, E. M., Haubrick, K. K., Odoom, E., Tarantino, N., & Brown, L. K. (2021). A review of interventions to enhance HIV Medication Adherence. Current Hiv/Aids Reports, 18(5), 443–457.

    Article  PubMed  Google Scholar 

  • Williams, E. C., McGinnis, K. A., Rubinsky, A. D., Matson, T. E., Bobb, J. F., Lapham, G. T., et al. (2021). Alcohol use and antiretroviral adherence among patients living with HIV: Is change in Alcohol Use Associated with Change in Adherence? Aids And Behavior, 25(1), 203–214.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wilson, I. B., Fowler, F. J. Jr., Cosenza, C. A., Michaud, J., Bentkover, J., Rana, A., et al. (2014). Cognitive and field testing of a new set of medication adherence self-report items for HIV care. Aids And Behavior, 18(12), 2349–2358.

    Article  PubMed  Google Scholar 

  • Wilson, I. B., Lee, Y., Michaud, J., Fowler, F. J. Jr., & Rogers, W. H. (2016). Validation of a New Three-Item Self-Report measure for Medication Adherence. Aids And Behavior, 20(11), 2700–2708.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wilson, I. B., Tie, Y., Padilla, M., Rogers, W. H., & Beer, L. (2020). Performance of a short, self-report adherence scale in a probability sample of persons using HIV antiretroviral therapy in the United States. Aids (London, England), 34(15), 2239–2247.

    Article  PubMed  Google Scholar 

  • Woolf-King, S. E., Sheinfil, A. Z., Ramos, J., Foley, J. D., Moskal, D., Firkey, M., et al. (2022). A conceptual model of alcohol use and adherence to antiretroviral therapy: Systematic review and theoretical implications for mechanisms of action. Health Psychol Rev, 16(1), 104–133.

    Article  PubMed  Google Scholar 

Download references

Funding

This work was supported by the National Institute of Mental Health (NIMH) Grant R01MH19913.

Author information

Authors and Affiliations

  1. Institute for Collaboration on Health, Intervention, and Policy, University of Connecticut, 406 Babbidge Road, Storrs, CT, 06269, USA

    Seth C. Kalichman, Ellen Banas, Bruno Shkembi & Moira Kalichman

  2. Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa

    Ellen Banas & Catherine Mathews

Authors
  1. Seth C. Kalichman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ellen Banas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bruno Shkembi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Moira Kalichman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Catherine Mathews
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seth C. Kalichman.

Ethics declarations

Competing interests

The Authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalichman, S.C., Banas, E., Shkembi, B. et al. The three-item patient-reported instrument for retrospective adherence in resource constrained settings: reliability, validity and potential utility. J Behav Med 47, 135–143 (2024). https://doi.org/10.1007/s10865-023-00438-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10865-023-00438-2

Keywords

Search

Navigation