Abstract
Purpose: Determining the valid andfair use of the interview for medical schooladmissions is contingent upon a demonstrationof the reproducibility of interview scores. This study seeks to establish thegeneralizability of interview scores, firstassessing the existing research evidence, andthen analyzing data from a non-experimentalindependent replications research design.Methods: Multivariate andunivariate generalizability analyses areconducted using data from a structuredinterview obtained from a population of medicalschool applicants over two years.Results: The existing literaturedoes not provide sufficient evidence regardinginterview reliability. In this study,interview scores derived from a standardizedinterview were found to display low to moderatelevels of reliability. Interview scores do notappear to possess the level of precision foundwith other measures commonly used to facilitateadmissions decisions.Discussion/Conclusion: Given theresults obtained, the fairness of using theinterview as a highly influential component ofthe admission process is called into question. Methods for using interview data in apsychometrically defensible fashion arediscussed. Specifically, attention to decisionreliability provides guidance on how interviewscores can best be integrated into theadmissions process.
Similar content being viewed by others
References
American Educational Research Association, American Psychological Association, & National Council on Measure in Education (1999). Standards for Educational and Psychological Testin. American Educational Research Association, Washington, DC.
Albanese M.A., Snow M.H., Skochelak S.E., Huggett K.N., Ferrell P.M. (2003). Assessing Personal Aualities in Medical School Admissions. Acad. Med. 78: 313–321.
Billimore D.W. (1992). Selection Interviewing for Medical School Admission. Medical Education 26: 347–349.
Brennan, R.L. (2001). Generalizability Theory. Springer Verlag, New York.
Carrothers R.M., Gregory S.W., Gallagher T.J. (2000). Measuring Emotional Intelligence of Medical School Applicants. Acad. Med. 75(5): 456–462.
Collins J.P., White G.R., Petrie K.J., Willoughby E.W. (1995). A Structured Panel Interview and Group Exercise in the Selection of Medical Students. Medical Education 29: 332–336.
Edwards J.C., Johnson E.K., Molidor J.B. (1990). The Interview in the Admission Process. Acad. Med. 65: 167–177.
Eva K.W., Rosenfeld J., Reiter H.I., Norman G.R. (2004). An Admissions OSCE: The Multiple Mini-interview. Medical Education, in press.
Johnson E.K., Edwards J.C. (1991). Current Practices in Admission Interviews at U.S. Medical Schools. Academic Medicine7: 408–412.
Harasym P.H., Woloschuk W., Mandin H., Brundin-Mather R. (1996). Reliability and Validity of Interviewers’ Judgments of Medical School Candidates. Acad. Med. 71: S40–S42.
Kulatunga-Moruzi C., Norman G.R. (2002). Validity of Admission Measures in Predicting Performance Outcomes: The Contribution of Cognitive and Non-cognitive Dimensions. Teaching and Learning in Medicine 14(1): 34–42.
Nayer M. (1992). Admission Criteria for Entrance to Physiotherapy Schools: How to Choose among Many Applicants. Physiotherapy Canada 44: 41–46.
Patrick L.E., Altmaier E.M., Kuperman S., Ugolini K. (2001). A Structure Interview for Medical School Admissions, Phase 1: Initial Procedure and Results. Acad. Med. 76(1).
Puryear H.G., Lewis L.A. (1981). Description of the Interview Process in Selecting Students for Admission to U.S. Medical Schools. J. Med. Education. 56: 881–885.
Salvatori P. (2001). Reliability and Validity of Admissions Tools Used to Select Students for the Health Professions. Advances in Health Science Education6: 159–175.
Shaw D.L., Martz D.M., Lancaster C.J., Sade R.M. (1995). Influence of Medical School Applicant's Demographic and Cognitive Characterisitics on Interviewers’ Ratings of Noncognitive Traits. Acad. Med. 70(6): 532–536.
Tutton P.J.M. (1993). Medical School Entrants: Semi-Structured Interview Ratings, Prior Scholastic Achievement and Personality Profiles. Medical Eduaction 27: 328–336.
VanSusteren T.J., Suter E., Romrell L.J., Lanier L., Hatch R.L. (1999). Do Interviews Really Play an Important role in the Medical School Selection Decision? Teaching and Learning in Medicine 11(2): 66–74.
Rights and permissions
About this article
Cite this article
Kreiter, C.D., Yin, P., Solow, C. et al. Investigating the Reliability of the Medical School Admissions Interview. Adv Health Sci Educ Theory Pract 9, 147–159 (2004). https://doi.org/10.1023/B:AHSE.0000027464.22411.0f
Issue Date:
DOI: https://doi.org/10.1023/B:AHSE.0000027464.22411.0f