The State of Evaluation in Internal Medicine Residency
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations.
To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation.
All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM).
Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods.
The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods.
Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high.
- Accreditation Council for Graduate Medical Education (ACGME). Outcome Project. <http://www.acgme.org/outcome/project/proHome.asp>. Accessed January 20, 2008.
- Accreditation Council for Graduate Medical Education (ACGME). Outcomes Project Toolbox of Assessment Methods <http://www.acgme.org/outcome/assess/toolbox.asp>. Accessed January 20, 2008.
- Hassett, JM, Zinnerstrom, K, Nawotniak, RH, Schimpfhauser, F, Dayton, MT (2006) Utilization of standardized patients to evaluate clinical and interpersonal skills of surgical residents. Surgery 140: pp. 633-9 CrossRef
- Kligler, B, Koithan, M, Maizes, V (2007) Competency-based evaluation tools for integrative medicine training in family medicine residency: a pilot study. BMC Med Educ 7: pp. 7 CrossRef
- Lynch, DC, Swing, SR, Horowitz, SD, Holt, K, Messer, JV (2004) Assessing practice-based learning and improvement. Teach Learn Med 16: pp. 85-92 CrossRef
- Ottestad, E, Boulet, JR, Lighthall, GK (2007) Evaluating the management of septic shock using patient simulation. Clinical investigations. Crit Care Med 35: pp. 769-75 CrossRef
- Wallenstein, JN, Ander, DS (2007) Use of an Advanced Skills OSCE to evaluate core competencies in an emergency medicine clerkship. Acad Emerg Med 14: pp. 215 CrossRef
- Bland, JM, Altman, DG (1995) Multiple significance tests: the Bonferroni method. BMJ 310: pp. 170
- Blumenthal, D, Gokhale, M, Campbell, EG (2001) Preparedness for clinical practice: reports of graduating residents at academic health centers. JAMA 286: pp. 1027-34 CrossRef
- Accreditation Council for Graduate Medical Education/American Board of Medical Sepecialties Joint Initiative. Attachment/Toolbox of Assessment Methods Version 1.1, September 2000 <http://www.acgme.org/Outcome/assess/ToolTable.pdf>. Accessed January 20, 2008.
- Gray, JD (1996 Jan) Global rating scales in residency education. Acad Med 71: pp. S55-63 CrossRef
- Ringsted, C, Østergaard, D, Ravn, L, Pedersen, JA, Berlac, PA, Van Der Vleuten, CPM (2003) A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills. Med Teach 25: pp. 654-8 CrossRef
- Silber, CG, Nasca, TJ, Paskin, DL, Eiger, G, Robeson, M, Veloski, JJ (2004) Do global rating forms enable program directors to assess the ACGME competencies?. Acad Med 79: pp. 549-56 CrossRef
- Swing, SR (2002) Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med 9: pp. 1278 CrossRef
- Gordon, P, Tomasa, L, Kerwin, J (2004) ACGME Outcomes Project: selling our expertise. Fam Med 36: pp. 164-7
- Goroll, AH, Sirio, C, Duffy, FD (2004) A new model for accreditation of residency programs in internal medicine. Ann Intern Med 140: pp. 902-9
- The State of Evaluation in Internal Medicine Residency
Journal of General Internal Medicine
Volume 23, Issue 7 , pp 1010-1015
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- graduate medical education
- Industry Sectors
- Author Affiliations
- 1. Department of Medicine and Office of Graduate Medical Education, North Shore University Hospital, Manhasset, NY, USA
- 4. Office of Graduate Medical Education, North Shore University Hospital, Manhasset, NY, USA
- 2. American Board of Internal Medicine, Philadelphia, PA, USA
- 3. University of Missouri-Kansas City, Kansas City, MO, USA