Abstract
CD4 cell count and viral load are the most widely used markers of Human Immunodeficiency Virus (HIV). Obtaining accurate measures of these laboratory markers can be challenging. The purpose of this study was to assess the reliability and validity of self-reported and abstracted paper medical record CD4 counts, viral load, and outpatient visits using electronic data as the gold standard. We sampled a subgroup of 114 HIV-infected individuals in Los Angeles from a larger multi-site study for whom we could confirm outpatient visits and CD4 count and viral load data through electronic data. Agreement between electronic and paper record abstractions was approximately 90% for CD4 count (kappa = 0.85; P < 0.001), 78% for viral load (kappa = 0.56; P < 0.001), and 62% for visits (kappa = 0.02; P = 0.36). Agreement between electronic and self-reported measures was 80% for CD4 count (kappa = 0.71; P < 0.001), 77% for viral load (kappa = 0.54; P < 0.001), and 62% for visits (kappa = 0.13; P < 0.05). Using electronic data as the gold standard, we found that the accuracy of self-report was as good as paper record abstraction regarding viral load levels and visits, and only slightly lower for CD4 count. Despite limited generalizability, these findings are important because they suggest that the accuracy of clinical information collected by self-report and paper medical records are similar and raise questions about whether conducting abstractions of paper medical records is worthwhile, especially if it increases the costs of data collection.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andersen, R.M., Kasper, J., Frankel, M.R.: Total Survey Error: Application to Improve Health Surveys. Jossey Bass, San Francisco (1979)
Bozzette, S.A., Berry, S.H., Duan, N., et al.: The care of HIV-infected adults in the United States. N. Engl. J. Med. 339, 1897–1904 (1998)
Centers for Disease Control and Prevention: Guidelines for laboratory test result reporting of human immunodeficiency virus type I ribonucleic acid determination. MMWR 50(RR20), 1–12 (2001)
Cunningham, W.E., Rana, H.M., Shapiro, M.F., et al.: Reliability and validity of self-report CD4 counts in persons hospitalized with HIV disease. J. Clin. Epidemiol. 50(7), 829–835 (1997)
Cunningham, W.E., Andersen, R.M., Katz, M.H.: The impact of competing needs for basic subsistence on access to medical care for persons with HIV care in the United States. Med. Care 37, 1270–1281 (1999)
Cunningham, W.E., Sohler, N., Tobias, C., et al.: Health services utilization for people with HIV infection: comparison of a population targeted for outreach with the US population in care. Med. Care 44(11), 1038–1047 (2006)
Cunningham, C.O., Xuan, L., Ramsey, K., et al.: A comparison of HIV health services utilization measures in a marginalized population. Med. Care 45(3), 264–268 (2007)
Deeks, S.G., Smith, M., Holodnly, M., et al.: HIV-1 protease inhibitors: a review for clinicians. JAMA 277, 145–153 (1997)
Efron, B., Tibshiriani, R.J.: An Introduction to the Bootstrap. Chapman & Hall, New York, NY (1993)
Fleiss, J.L.: Statistical Methods for Rates and Proportions, 2nd edn. John Wiley & Sonsm, New York, NY (1981)
Hessol, N.A., Schwartz, S., Ameli, N., et al.: Accuracy of self-reports of Acquired Immunodeficiency Syndrome and Acquired Immunodeficiency Syndrome-related condition in women. Am. J. Epidemiol. 153(11), 1128–1133 (2001)
Ho, D.D.: Therapy of HIV infections: problems and prospects. Bull. N.Y. Acad. Med. 73, 37–46 (1996)
Kalichman, S.C., Rompa, D., Cage, M.: Reliability and validity of self-reported CD4 lymphocyte count and viral load test results in people living with HIV/AIDS. Int. J. STD AIDS 11, 579–585 (2000)
Law, M.G., Hurley, S.F., Carlin, J.B., et al.: A comparison of patient interview data with pharmacy and medical records for patients with Acquired Immunodeficiency Syndrome and Human Immunodeficiency Virus infection. J. Clin. Epidemiol. 49(9), 997–1002 (1996)
Luck, J., Peabody, J.W., Dresselhaus, T.R., et al.: How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. Am. J. Med. 108, 642–649 (2000)
Morales, L.S., Cunningham, W.E., Galvan, F.H., et al.: Sociodemographic differences in access to care among Hispanic patients who are HIV infected in the United States. Am. J. Public Health 94, 1–4 (2004)
Opravil, M.B., Ledergerber, B., Furrer, H., et al.: Clinical efficacy of early initiation of HAART in patients with asymptomatic HIV infection and CD4 cell count > 350 × 106/l. AIDS 16(10), 1371–1381 (2002)
Phillips, A.N., Staszewski, Weber, R., et al.: HIV viral load response to antiretroviral therapy according to the CD4 cell count and viral load. JAMA 286(20), 2560–2567 (2001)
Rajabiun, S., Cabral, H., Tobias, C., Relf, M.: Program design and evaluation strategies for the Special Projects of National Significance Outreach Initiative. AIDS Patient Care STDS 21(1), S9–S19 (2007)
Sande, M.A., Volberding, P.A.: The Medical Management of AIDS, 5th edn. WB Saunders, Philadelphia (1997)
Shapiro, M.F., Morton, S.C., McCaffrey, D.F., et al.: Variations in the care of HIV infected adults in the United States: results from the HIV cost and services utilization study. JAMA 28, 2305–2315 (1999)
Sudman, S., Bradburn, N.M.: Response Effects in Surveys. Adeline, Hawthorne (1974)
Acknowledgments
Support for this study was provided by grant # H97HA00203 from the Health Resources and Services Administrations (HRSA), Special Projects of National Significance (SPNS) Program. Dr. Cunningham also received partial support from the NIMH (R-01 # MH69087), the UCLA-Drew Project Export, NIH, National Center on Minority Health & Health Disparities (P20-MD000182), the UCLA Center for Health Improvement in Minority Elders/Resource Centers for Minority Aging Research, NIH, National Institute of Aging (AG-02-1684), and the NIH/NIMH (P30 MH05810). Dr. Mohanty received support from the UCLA/DREW Project EXPORT, NCMHD, P20MD000148/P20MD000182
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kinsler, J.J., Cunningham, W.E., Mohanty, S. et al. Are medical records a more reliable and valid source of CD4 count, viral load, and outpatient visit data than self-reports? A comparison with electronic medical records as the gold standard. Health Serv Outcomes Res Method 8, 187–200 (2008). https://doi.org/10.1007/s10742-008-0036-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10742-008-0036-9