Abstract
Background and purpose:
Data supporting the predictive validity of the medical school admission interview are mixed. This study tested the hypothesis that the admission interview is predictive of interpersonal interactions between medical students and standardized patients.
Method:
We determined correlations between admission interview scores and performance on a senior-year Clinical Practice Examination piloting US National Board of Medical Examiners stations. We also completed regression analyses controlling for undergraduate academic performance, gender and ethnicity. Outcome measures included an Interpersonal Skills score and a separate Overall Checklist performance score, completed by standardized patients.
Results:
The applicant interview had limited but statistically significant correlation with the Interpersonal Skills (r = 0.15; p < 0.05) score. The applicant interview had a correlation of 0.13 with the Overall Checklist score (p = .056). In linear regression models, the applicant interview had limited but statistically significant correlations with the Interpersonal Skills score and the Overall Checklist score.
Conclusion:
As practiced at this medical school, the admission interview has limited predictive validity for future interactions with standardized patients. More comprehensive assessment of interpersonal skills during the medical school selection process will be needed in order to better select matriculants with desirable interpersonal skills.
Similar content being viewed by others
References
Albanese M.A., Snow M., Skochelak S., Huggett K., Farrell P.M. (2003). Matriculating student perceptions of changes to the admissions interview process at the University of Wisconsin Medical School: a prospective, controlled comparison Wisconsin Medical Journal 102: 30–33
Basco W.T., Jr Gilbert G.E., Chessman A.W., Blue A.V (2000). The ability of a medical school admission process to predict clinical performance and patients’ satisfaction Academic Medicine 75: 743–747
Boulet J.R., Ben David M.F., Ziv A., Burdick W.P., Curtis M., Peitzman S. et al (1998). Using standardized patients to assess the interpersonal skills of physicians Academic Medicine 73: S94–S96
DeVaul R.A., Jervey F., Chappell J.A., Caver P., Short B., O’Keefe S. (1987). Medical school performance of initially rejected students The Journal of American Medical Association 257: 47–51
Edwards J.C. Johnson E.K. Molidor J.B. (1990). The interview in the admission process Academic Medicine 65: 167–177
Elam C.L. Haist S.A. Blue A.V. Brigham N.L. (1997). The relationship of students’ admission interview ratings to their performances in a medical-interviewing course Academic Medicine 72: 919–920
Elam C.L. Haist S.A. Blue A.V. Brigham N.L. (1997). The relationship of students’ admission interview ratings to their performances in a medical-interviewing course Academic Medicine 72: 919–920
Eva K.W. Reiter H.I. Rosenfeld J. Norman G.R. (2004). The ability of the multiple mini-interview to predict preclerkship performance in medical school Academic Medicine 79: S40–S42
Gough H.G., Hall W.B. (1975). The prediction of academic and clinical performance in medical school Research in Higher Education 3: 301–314
Johnson E.K., Edwards J.C. (1991). Current practices in admission interviews at US medical schools Academic Medicine 66: 408–412
Keen A.J., Klein S., Alexander D.A. (2003). Assessing the communication skills of doctors in training: reliability and sources of error Advances in Health Science Education Theory and Practice 8: 5–16
Kreiter C.D., Yin P., Solow C., Brennan R.L. (2004). Investigating the reliability of the medical school admissions interview Advances in Health Science Education Theory and Practice 9: 147–159
Kulatunga-Moruzi C., Norman G.R. (2002). Validity of admissions measures in predicting performance outcomes: the contribution of cognitive and non-cognitive dimensions Teaching and Learning in Medicine 14: 34–42
Medical School Profile System (2003). Liaison Committee on Medical Education Questionnaire (Part II) Association of American Medical Colleges
Meredith K.E., Dunlap M.R., Baker H.H. (1982). Subjective and objective admissions factors as predictors of clinical clerkship performance Journal of Medical Education 57: 743–751
Milstein R.M., Wilkinson L., Burrow G.N., Kessen W. (1981). Admission decisions and performance during medical school Journal of Medical Education 56: 77–82
Mitchell K.J. (1990). Traditional predictors of performance in medical school Academic Medicine 65: 149–158
National Board of Medical Examiners (2005). The United States Medical Licensing Examination: 2005 Step 2 CS Content Description and General Information Booklet. Federation of State Medical Boards of the United States, Inc., and the National Board of Medical Examiners (On-line). Available: http://www.usmle.org/step2/Step2CS/Step2CS2005GI/TOC.asp
Norman G. (2004). The morality of medical school admissions Advances in Health Science Education Theory and Practice 9: 79–82
Patrick L.E., Altmaier E.M., Kuperman S., Ugolini K. (2001). A structured interview for medical school admission, Phase 1: initial procedures and results Academic Medicine 76: 66–71
Powis D.A., Neame R.L., Bristow T., Murphy L.B. (1988). The objective structured interview for medical student selection British Medical Journal (Clinical Research Education) 296: 765–768
Powis D.A., Waring T.C., Bristow T., O’Connell D.L. (1992). The structured interview as a tool for predicting premature withdrawal from medical school Australian and New Zealand Journal of Medicine 22: 692–698
Price P.B., Lewis E.G. Loughmiller G.C., Nelson D.E., Murray S.L., Taylor C.W. (1971). Attributes of a good practicing physician Journal of Medical Education 46: 229–237
Reznick R.K., Blackmore D., Cohen R., Baumber J., Rothman A., Smee S. et al (1993). An objective structured clinical examination for the licentiate of the Medical Council of Canada: from research to reality Academic Medicine 68: S4–S6
Sade R.M., Stroud M.R., Levine J.H., Fleming G.A. (1985). Criteria for selection of future physicians Annals of Surgery 201: 225–230
Smith S.R. (1991). Medical school and residency performances of students admitted with and without an admission interview Academic Medicine 66: 474–476
Swartz M.H. Colliver J.A. (1996). Using standardized patients for assessing clinical performance: an overview The Mount Sinai Journal of Medicine 63: 241–249
Taylor T.C. (1990). The interview: one more life? Academic Medicine 65: 177–178
Van Susterin T.J., Suter E., Romrell L.J., Lanier L., Hatch R.L. (1999). Do interviews really play an important role in the medical school selection decision? Teaching and Learning in Medicine 11: 66–74
Acknowledgements
The authors would like to acknowledge the extensive work by the Clinical Practice Examination Committee consisting of Amy Blue, Elizabeth (Skeet) Bradley, Victor Del Bene, Edwin Brown, Maura Carey, Alexander Chessman, David Garr, Gregory Gilbert, Carol Lancaster, and Carol Woody. Funding for Dr. Basco’s and Mr. Gilbert’s efforts for this project were provided by the Robert Wood Johnson Foundation Generalist Physician Faculty Scholars Program (#039179).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Basco , W.T., Lancaster, C.J., Gilbert, G.E. et al. Medical School Application Interview Score Has Limited Predictive Validity for Performance on a Fourth Year Clinical Practice Examination. Adv in Health Sci Educ 13, 151–162 (2008). https://doi.org/10.1007/s10459-006-9031-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-006-9031-5