The State of Evaluation in Internal Medicine Residency
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations.
To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation.
All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM).
Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods.
The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods.
Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high.
- Accreditation Council for Graduate Medical Education (ACGME). Outcome Project. <http://www.acgme.org/outcome/project/proHome.asp>. Accessed January 20, 2008.
- Accreditation Council for Graduate Medical Education (ACGME). Outcomes Project Toolbox of Assessment Methods <http://www.acgme.org/outcome/assess/toolbox.asp>. Accessed January 20, 2008.
- Hassett JM , Zinnerstrom K , Nawotniak RH , Schimpfhauser F , Dayton MT. Utilization of standardized patients to evaluate clinical and interpersonal skills of surgical residents. Surgery. 2006;140(4):633–9. CrossRef
- Kligler B , Koithan M , Maizes V , et al. Competency-based evaluation tools for integrative medicine training in family medicine residency: a pilot study. BMC Med Educ. 2007;7(1):7. CrossRef
- Lynch DC , Swing SR , Horowitz SD , Holt K , Messer JV. Assessing practice-based learning and improvement. Teach Learn Med. 2004;16(1):85–92. CrossRef
- Ottestad E , Boulet JR , Lighthall GK. Evaluating the management of septic shock using patient simulation. Clinical investigations. Crit Care Med. 2007;35(3):769–75. CrossRef
- Wallenstein JN , Ander DS. Use of an Advanced Skills OSCE to evaluate core competencies in an emergency medicine clerkship. Acad Emerg Med. 2007;14(5S):215. CrossRef
- Bland JM , Altman DG. Multiple significance tests: the Bonferroni method. BMJ. 1995;310(6973):170.
- Blumenthal D , Gokhale M , Campbell EG , et al. Preparedness for clinical practice: reports of graduating residents at academic health centers. JAMA. 2001;286:1027–34. CrossRef
- Accreditation Council for Graduate Medical Education/American Board of Medical Sepecialties Joint Initiative. Attachment/Toolbox of Assessment Methods Version 1.1, September 2000 <http://www.acgme.org/Outcome/assess/ToolTable.pdf>. Accessed January 20, 2008.
- Gray JD. Global rating scales in residency education. Acad Med. 1996 Jan;71(1 Suppl):S55–63. CrossRef
- Ringsted C , Østergaard D , Ravn L , Pedersen JA , Berlac PA , Van Der Vleuten CPM. A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills. Med Teach. 2003;25(6):654–8. CrossRef
- Silber CG , Nasca TJ , Paskin DL , Eiger G , Robeson M , Veloski JJ. Do global rating forms enable program directors to assess the ACGME competencies? Acad Med. 2004;79(6):549–56. CrossRef
- Swing SR. Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med. 2002;9(11):1278. CrossRef
- Gordon P , Tomasa L , Kerwin J. ACGME Outcomes Project: selling our expertise. Fam Med. 2004;36(3):164–7.
- Goroll AH , Sirio C , Duffy FD , et al. A new model for accreditation of residency programs in internal medicine. Ann Intern Med. 2004;140(11):902–9.
- The State of Evaluation in Internal Medicine Residency
Journal of General Internal Medicine
Volume 23, Issue 7 , pp 1010-1015
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- graduate medical education
- Industry Sectors
- Author Affiliations
- 1. Department of Medicine and Office of Graduate Medical Education, North Shore University Hospital, Manhasset, NY, USA
- 4. Office of Graduate Medical Education, North Shore University Hospital, Manhasset, NY, USA
- 2. American Board of Internal Medicine, Philadelphia, PA, USA
- 3. University of Missouri-Kansas City, Kansas City, MO, USA