Objective:To evaluate the effectiveness of a process whereby a faculty-resident committee annually audits outpatient record keeping and preventive care practices and provides feedback to resident physicians.
Design:Pre- and postfeedback audits with interventions and observations repeated over six consecutive academic years.
Setting:The adult primary care practice of housestaff in a university-affiliated hospital.
Subjects:All 139 physicians in an internal medicine residency program from 1981–82 through 1986–87, of whom 37 were present for three consecutive years.
Intervention:Each year, residents were given individualized, detailed, typewritten feedback based on audits of their outpatient records.
Measurements and main results:Each resident physician had a minimum of four (mean 5.2) outpatient records per year audited against standards for record-keeping practices and the provision of preventive care. Overall performance scores for each resident audit improved from a mean of 39.7±12.3 (SD) in 1981–82 to a mean of 58.5±14.1 (SD) in 1986–87 (possible range 0 to 100, observed range 9.4 to 86.6). The overall performance scores of individual residents, who received two cycles of feedback, improved an average of 11.5 (95% confidence limits 7.6, 15.3), from a mean of 48.4±11.4 (SD) during their first year of residency to 59.8±13.9 (SD) during their third year. General (primary care) and traditional-track residents improved at similar rates, although mean performance scores were consistently higher for general than for traditional-track residents. Analysis of variance revealed that all changes and differences were statistically significant.
Conclusions:An ongoing chart audit and feedback system can be associated with improvements both in the performance of individual residents and in the long-term performance of a residency program.
medical audit feedback primary health care internship and residency medical records
Frame PC, Kowulich BA, Llewellyn AM. Improving physician compliance with a health maintenance protocol. J Fam Pract. 1984;19:341–4.PubMedGoogle Scholar
Lau RR, Williams HS, Williams LC, Ware JE, Brook RH. Psychosocial problems in chronically ill children: physician concern, patient satisfaction, and the validity of medical records. J Comm Health. 1982;7:250–61.CrossRefGoogle Scholar
Moran MT, Wiser TH, Nada J, Gross H. Measuring medical residents’ chart documentation practices. J Med Educ. 1988;63:860–5.Google Scholar
Zuckerman AE, Starfield B, Hochreiter C, Kovasznay B. Validating the content of pediatric medical records by means of tape-recording doctor-patient encounters. Pediatrics. 1975;56:407–11.PubMedGoogle Scholar
Brook RH, Fink A, Kosecoff J, et al. Educating physicians and treating patients in the ambulatory setting: where are we going and how will we know when we arrive? Ann Intern Med. 1987;107:392–8.PubMedGoogle Scholar
Cheney C, Ramsdell JW. Effect of medical record checklists on implementation of periodic health measures. Am J Med. 1987;83:129–36.PubMedCrossRefGoogle Scholar
Davidson RA, Fletcher SW, Retchins DVHS. A nurse-initiated reminder system for the periodic health examination. Arch Intern Med. 1984;144:2167–70.PubMedCrossRefGoogle Scholar
Dietrich AJ, Goldberg H. Preventive content of adult primary care: do generalists and subspecialists differ? Am J Public Health. 1984;74:223–7.PubMedGoogle Scholar
Fleming DM, Lawrence MSTA. Impact of audit on preventive measures. Br Med J. 1983;287:1852–4.Google Scholar
Korn JE, Schlossberg LA, Rich EC. Improved preventive care following an intervention during an ambulatory care rotation: carryover to a second setting. J Gen Intern Med. 1988;3:156–60.PubMedGoogle Scholar
Lurie N, Manning WG, Peterson C, Goldberg GA, Phelps CA, Lillard L. Preventive care: do we practice what we preach? Am J Public Health. 1987;77:801–4.PubMedGoogle Scholar
McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record: a two-year randomized trial. Ann Intern Med. 1984;100:130–8.PubMedGoogle Scholar
Davis JE, Meyer DL, Love RR. Cancer prevention activities in primary care group practice: physician estimates, physician performance, and the structure of practice. Submitted Med. Care.Google Scholar
Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Med Care. 1986;24:659–66.PubMedCrossRefGoogle Scholar
Winickoff RN, Coltin K, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984;22:527–34.PubMedCrossRefGoogle Scholar
Duggan AK. Analysis of the concordance between provider performance and recording [dissertation]. Baltimore, MD: The Johns Hopkins University, 1985.Google Scholar
Martin AR, Wolfe MA, Thibodeau LA, Dzau V, Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980;303:1330–6.PubMedCrossRefGoogle Scholar
Sanazaro PJ, Worth RM. Concurrent quality assurance in hospital care: report of a study by private initiative in PSRO. N Engl J Med. 1978;298:1171–7.PubMedCrossRefGoogle Scholar
Bennett SE, Goodson JD, Izem E, et al. Comparing ambulatory care practices of primary care and traditional medicine residents. Med Care. 1985;23:816–22.PubMedCrossRefGoogle Scholar
Ramsdell JW, Berry CC. Evaluation of general and traditional internal medicine residents utilizing a medical records audit based on educational objectives. Med Care. 1983;21:1144–53.PubMedCrossRefGoogle Scholar
Makuc DM, Fried IM, Kleinman JC. National trends in the use of preventive health care by women. Am J Public Health. 1989;79:21–6.PubMedCrossRefGoogle Scholar
Dickie GL, Bass MJ. Improving problem oriented medical records through self-audit. J Fam Pract. 1980;10:487–90.PubMedGoogle Scholar
Barker LR, Starfield B, Gross RJ, Kern DE, Levine D, Fishelman P. Recognition of information and coordination of ambulatory care by medical residents. Med Care. 1989;27(5):558–62.PubMedCrossRefGoogle Scholar
Pinkerton RE, Tinanoff N, Williams JL, Tapp JT. Resident physician performance in a continuing education format: does newly acquired knowledge improve patient care? JAMA. 1980;244:2183–5.PubMedCrossRefGoogle Scholar
Goldenberg K. Periodic health examination: comparison of residency programs and national recommendations. J Gen Intern Med. 1986;1:282–6.PubMedCrossRefGoogle Scholar