Abstract
Objective: The goal of this study was to measure the predictive value of applicant evaluations for a psychiatry residency in terms of the subsequent performance of those who matriculated in the program. Method: The match lists for resident cohorts beginning their course of training over 4 years were divided into thirds, which served as our primary, preresidency measure of expected performance. The preresidency applicant evaluations of those residents who entered were compared to their postresidency evaluations. Results: There was no significant association between preresidency selection evaluations and postresidency final evaluations in any of the four cohorts of trainees. Conclusions: The overall results of this study of four cohorts of residents indicate only a small, nonsignificant association between pre- and postresidency evaluations. Further efforts to predict residency performance in applicants may help identify those trainees who might benefit from additional monitoring and supervision.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Koster T, De Graaf R, Meinders AE: Selection for the internal medicine residency programme in the Leiden region. Neth J Med 2002; 60: 33–36
Wilkinson TJ, Harris P: The transition out of medical school: a qualitative study of descriptions of borderline trainee interns. Med Educ 2002; 36: 466–471
Hemaida RS, Kalb E: Using the analytical hierarchy process for the selection of first-year family practice residents. Hosp Top 2001; 79: 11–15
Wagoner NE, Suriano R: Program directors’ responses to a survey on variables used to select residents in a time of change. Acad Med 1999; 74: 51–58
National Resident Matching Program 2004 Match Data. Available at http://www.nrmp.org/res_match/data_tables.html. Accessed 1/19/05
Alexander GL, Davis WK, Yan AC, et al: Following medical school graduates into practice: residency directors’ assessments after the first year of residency. Acad Med 2000; 75 (October suppl): S15–S17
Bell JG, Kanellitsas I, Shaffer L: Selection of obstetrics and gynecology residents on the basis of medical school performance. Am J Obstet Gynecol 2002; 186: 1091–1094
Awad SS, Liscum KR, Aoki N, et al: Does the subjective evaluation of medical student surgical knowledge correlate with written and oral exam performance? J Surg Res 2002; 104: 36–39
Gilbart MK, Cusimano MD, Regehr G: Evaluating surgical resident selection procedures. Am J Surg 2000; 181: 221–225
Dirschl DR: Scoring of orthopaedic residency applicants: Is a scoring system reliable? Clin Orthop 2002; 399: 260–264
Miles WS, Shaw V, Risucci D: The role of blinded interviews in the assessment of surgical residency candidates. Am J Surg 2001; 182: 143–146
Smilen SW, Funai EF, Bianco AT: Residency selection: should interviewers be given applicants’ board scores? Am J Obstet Gynecol 2001; 184: 508–513
Edmond M, Roberson M, Hasan N: The dishonest dean’s letter: an analysis of 532 dean’s letters from 99 U.S. medical schools. Acad Med 1999; 74: 1033–1035
Dale JA, Schmitt CM, Crosby LA: Misrepresentation of research criteria by orthopaedic residency applicants. J Bone Joint Surg Am 1999; 81: 1679–1681
Baker DR, Jackson VP: Misrepresentation of publications by radiology residency applicants. Acad Radiol 2000; 7: 727–729
Grover M, Dharamshi F, Goveia C: Deception by applicants to family practice residencies. Fam Med 2001; 33: 441–446
Edmond MB, Deschenes JL, Eckler M, et al: Racial bias in using USMLE Step 1 scores to grant internal medicine residency interviews. Acad Med 2001; 76: 1253–1256
Rao NR, Meinzer AE, Primavera LH, et al: Psychiatry residency selection criteria for American and foreign medical graduates: a comparative study. Acad Psychiatry 1991; 15: 69–79
Rodenhauser P, Smith CJ, Markert RJ: Gender influences on specialists’ ratings of residency program candidates. Acad Psychiatry 1992; 16: 134–140
Scherl SA, Levely N, Simon MA: Initial review of electronic residency application service charts by orthopaedic residency faculty members. Does applicant gender matter? J Bone Joint Surg Am 2001; 83-A: 65–70
Self DJ, Baldwin DC: Should moral reasoning serve as a criterion for student and resident selection? Clin Orthop 2000, 378: 115–123
Kassebaum DG, Eaglen RH: Shortcomings in the evaluation of students’ clinical skills and behavior in medical school. Acad Med 1999; 74: 841–849
White AA: Resident selection: are we putting the cart before the horse? Clin Orthop 2002; 399: 255–259
Yudkowsky R, Elliott R, Schwartz A: Two perspectives on the indicators of quality in psychiatry residencies: program directors’ and residents’. Acad Med 2002; 77: 57–64
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dawkins, K., Ekstrom, R.D., Maltbie, A. et al. The Relationship Between Psychiatry Residency Applicant Evaluations and Subsequent Residency Performance. Acad Psychiatry 29, 69–75 (2005). https://doi.org/10.1176/appi.ap.29.1.69
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.29.1.69