Journal of General Internal Medicine

, Volume 15, Issue 11, pp 782–788

Measuring compliance with preventive care guidelines

Standardized patients, clinical vignettes, and the medical record
  • Timothy R. Dresselhaus
  • John W. Peabody
  • Martin Lee
  • Ming Ming Wang
  • Jeff Luck
Original Articles

DOI: 10.1046/j.1525-1497.2000.91007.x

Cite this article as:
Dresselhaus, T.R., Peabody, J.W., Lee, M. et al. J GEN INTERN MED (2000) 15: 782. doi:10.1046/j.1525-1497.2000.91007.x

Abstract

OBJECTIVE: To determine how accurately preventive care reported in the medical record reflects actual physician practice or competence.

DESIGN: Scoring criteria based on national guidelines were developed for 7 separate items of preventive care. The preventive care provided by randomly selected physicians was measured prospectively for each of the 7 items. Three measurement methods were used for comparison: (1) the abstracted medical record from a standardized patient (SP) visit; (2) explicit reports of physician practice during those visits from the SPs, who were actors trained to present undetected as patients; and (3) physician responses to written case scenarios (vignettes) identical to the SP presentations.

SETTING: The general medicine primary care clinics of two university-affiliated VA medical centers.

PARTICIPANTS: Twenty randomly selected physicians (10 at each site) from among eligible second- and third-year general internal medicine residents and attending physicians.

MEASUREMENTS AND MAIN RESULTS: Physicians saw 160 SPs (8 cases × 20 physicians). We calculated the percentage of visits in which each prevention item was recorded in the chart, determined the marginal percentage improvement of SP checklists and vignettes over chart abstraction alone, and compared the three methods using an analysis-of-variance model. We found that chart abstraction underestimated overall prevention compliance by 16% (P < .01) compared with SP checklists. Chart abstraction scores were lower than SP checklists for all seven items and lower than vignettes for four items. The marginal percentage improvement of SP checklists and vignettes to performance as measured by chart abstraction was significant for all seven prevention items and raised the overall prevention scores from 46% to 72% (P < .0001).

CONCLUSIONS: These data indicate that physicians perform more preventive care than they report in the medical record. Thus, benchmarks of preventive care by individual physicians and institutions that rely solely on the medical record may be misleading, at best.

Key words

compliancepreventive care guidelinesphysician practice

Copyright information

© Society of General Internal Medicine 2000

Authors and Affiliations

  • Timothy R. Dresselhaus
    • 1
    • 2
  • John W. Peabody
    • 3
    • 4
    • 5
    • 6
    • 7
    • 8
    • 9
    • 10
    • 11
  • Martin Lee
    • 12
    • 8
    • 9
    • 10
  • Ming Ming Wang
    • 12
  • Jeff Luck
    • 12
    • 10
    • 11
  1. 1.the Veterans Affairs San Diego Healthcare SystemSan Diego
  2. 2.University of California, San Diego, School of MedicineSan Diego
  3. 3.the San Francisco Veterans Affairs Medical CenterSan Francisco
  4. 4.the University of CaliforniaSan Francisco
  5. 5.School of MedicineSan Francisco
  6. 6.the Veterans Affairs Center for the Study of Healthcare Provider BehaviorSepulveda
  7. 7.the University of CaliforniaLos Angeles
  8. 8.Schools of MedicineLos Angeles
  9. 9.Public HealthLos Angeles
  10. 10.RANDSanta Monica
  11. 11.the Veterans Affairs Greater Los Angeles Healthcare SystemLos Angeles
  12. 12.Institute for Global HealthSan Francisco