Identifying Medical Students Likely to Exhibit Poor Professionalism and Knowledge During Internship
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Identifying medical students who will perform poorly during residency is difficult.
Determine whether commonly available data predicts low performance ratings during internship by residency program directors.
Prospective cohort involving medical school data from graduates of the Uniformed Services University (USU), surveys about experiences at USU, and ratings of their performance during internship by their program directors.
Uniformed Services University.
One thousand sixty-nine graduates between 1993 and 2002.
MAIN OUTCOME MEASURE(S)
Residency program directors completed an 18-item survey assessing intern performance. Factor analysis of these items collapsed to 2 domains: knowledge and professionalism. These domains were scored and performance dichotomized at the 10th percentile.
Many variables showed a univariate relationship with ratings in the bottom 10% of both domains. Multivariable logistic regression modeling revealed that grades earned during the third year predicted low ratings in both knowledge (odds ratio [OR] = 4.9; 95%CI = 2.7–9.2) and professionalism (OR = 7.3; 95%CI = 4.1–13.0). USMLE step 1 scores (OR = 1.03; 95%CI = 1.01–1.05) predicted knowledge but not professionalism. The remaining variables were not independently predictive of performance ratings. The predictive ability for the knowledge and professionalism models was modest (respective area under ROC curves = 0.735 and 0.725).
A strong association exists between the third year GPA and internship ratings by program directors in professionalism and knowledge. In combination with third year grades, either the USMLE step 1 or step 2 scores predict poor knowledge ratings. Despite a wealth of available markers and a large data set, predicting poor performance during internship remains difficult.
- Principles of good medical education and training. Postgraduate Medical Education and Training Board. General Medical Council; 2005. http://www.gmc-uk.org/education/publications/gui_principles_final_1.0.pdf. Accessed February 25, 2007.
- Hamdy H, Prasad K, Anderson MB, et al. BEME systematic review: predictive values of measurements obtained in medical schools and future performance in medical practice. Med Teach. 2006;28(2):103–16. CrossRef
- Durning SJ, Cation LJ, Jackson JL. The reliability and validity of the American Board of Internal Medicine Monthly Evaluation Form. Acad Med. 2003;78(11):1175–82. CrossRef
- Huff KL, Koenig JA, Treptau MM, Sireci SG. Validity of MCAT scores for predicting clerkship performance of medical students grouped by sex and ethnicity. Acad Med. 1999;74(10 Suppl):S41–4. CrossRef
- Julian ER. Validity of the Medical College Admission Test for predicting medical school performance. Acad Med. 2005;80(10):910–7. CrossRef
- Silver B, Hodgson CS. Evaluating GPAs and MCAT scores as predictors of NBME I and clerkship performances based on students’ data from one undergraduate institution. Acad Med. 1997;72(5):394–6. CrossRef
- Andriole DA, Jeffe DB, Whelan AJ. What predicts surgical internship performance? Am J Surg. 2004;188(2):161–4. CrossRef
- Durning SJ, Pangaro LN, Lawrence LL, Waechter D, McManigle J, Jackson JL. The feasibility, reliability, and validity of a program director’s (supervisor’s) evaluation form for medical school graduates. Acad Med. 2005;80(10):964–8. CrossRef
- Hosmer D, Lemeshow S. Applied Logistic Regression. New York, NY: Wiley; 2000.
- Papadakis MA, Hodgson CS, Teherani A, Kohatsu ND. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Acad Med. 2004;79(3):244–9. CrossRef
- Papadakis MA, Loeser H, Healy K. Early detection and evaluation of professionalism deficiencies in medical students: one school’s approach. Acad Med. 2001;76(11):1100–6. CrossRef
- Papadakis MA, Teherani A, Banach MA, et al. Disciplinary action by medical boards and prior behavior in medical school. N Engl J Med. 2005;353(25):2673–82. CrossRef
- Identifying Medical Students Likely to Exhibit Poor Professionalism and Knowledge During Internship
Journal of General Internal Medicine
Volume 22, Issue 12 , pp 1711-1717
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- medical education
- Industry Sectors