Advances in Health Sciences Education

, Volume 9, Issue 2, pp 147–159 | Cite as

Investigating the Reliability of the Medical School Admissions Interview

  • Clarence D. Kreiter
  • Ping Yin
  • Catherine Solow
  • Robert L. Brennan


Purpose: Determining the valid andfair use of the interview for medical schooladmissions is contingent upon a demonstrationof the reproducibility of interview scores. This study seeks to establish thegeneralizability of interview scores, firstassessing the existing research evidence, andthen analyzing data from a non-experimentalindependent replications research design.Methods: Multivariate andunivariate generalizability analyses areconducted using data from a structuredinterview obtained from a population of medicalschool applicants over two years.Results: The existing literaturedoes not provide sufficient evidence regardinginterview reliability. In this study,interview scores derived from a standardizedinterview were found to display low to moderatelevels of reliability. Interview scores do notappear to possess the level of precision foundwith other measures commonly used to facilitateadmissions decisions.Discussion/Conclusion: Given theresults obtained, the fairness of using theinterview as a highly influential component ofthe admission process is called into question. Methods for using interview data in apsychometrically defensible fashion arediscussed. Specifically, attention to decisionreliability provides guidance on how interviewscores can best be integrated into theadmissions process.

generalizability Medical School admission interview reliability 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. American Educational Research Association, American Psychological Association, & National Council on Measure in Education (1999). Standards for Educational and Psychological Testin. American Educational Research Association, Washington, DC.Google Scholar
  2. Albanese M.A., Snow M.H., Skochelak S.E., Huggett K.N., Ferrell P.M. (2003). Assessing Personal Aualities in Medical School Admissions. Acad. Med. 78: 313–321.Google Scholar
  3. Billimore D.W. (1992). Selection Interviewing for Medical School Admission. Medical Education 26: 347–349.Google Scholar
  4. Brennan, R.L. (2001). Generalizability Theory. Springer Verlag, New York.Google Scholar
  5. Carrothers R.M., Gregory S.W., Gallagher T.J. (2000). Measuring Emotional Intelligence of Medical School Applicants. Acad. Med. 75(5): 456–462.Google Scholar
  6. Collins J.P., White G.R., Petrie K.J., Willoughby E.W. (1995). A Structured Panel Interview and Group Exercise in the Selection of Medical Students. Medical Education 29: 332–336.Google Scholar
  7. Edwards J.C., Johnson E.K., Molidor J.B. (1990). The Interview in the Admission Process. Acad. Med. 65: 167–177.Google Scholar
  8. Eva K.W., Rosenfeld J., Reiter H.I., Norman G.R. (2004). An Admissions OSCE: The Multiple Mini-interview. Medical Education, in press.Google Scholar
  9. Johnson E.K., Edwards J.C. (1991). Current Practices in Admission Interviews at U.S. Medical Schools. Academic Medicine7: 408–412.Google Scholar
  10. Harasym P.H., Woloschuk W., Mandin H., Brundin-Mather R. (1996). Reliability and Validity of Interviewers’ Judgments of Medical School Candidates. Acad. Med. 71: S40–S42.Google Scholar
  11. Kulatunga-Moruzi C., Norman G.R. (2002). Validity of Admission Measures in Predicting Performance Outcomes: The Contribution of Cognitive and Non-cognitive Dimensions. Teaching and Learning in Medicine 14(1): 34–42.Google Scholar
  12. Nayer M. (1992). Admission Criteria for Entrance to Physiotherapy Schools: How to Choose among Many Applicants. Physiotherapy Canada 44: 41–46.Google Scholar
  13. Patrick L.E., Altmaier E.M., Kuperman S., Ugolini K. (2001). A Structure Interview for Medical School Admissions, Phase 1: Initial Procedure and Results. Acad. Med. 76(1).Google Scholar
  14. Puryear H.G., Lewis L.A. (1981). Description of the Interview Process in Selecting Students for Admission to U.S. Medical Schools. J. Med. Education. 56: 881–885.Google Scholar
  15. Salvatori P. (2001). Reliability and Validity of Admissions Tools Used to Select Students for the Health Professions. Advances in Health Science Education6: 159–175.Google Scholar
  16. Shaw D.L., Martz D.M., Lancaster C.J., Sade R.M. (1995). Influence of Medical School Applicant's Demographic and Cognitive Characterisitics on Interviewers’ Ratings of Noncognitive Traits. Acad. Med. 70(6): 532–536.Google Scholar
  17. Tutton P.J.M. (1993). Medical School Entrants: Semi-Structured Interview Ratings, Prior Scholastic Achievement and Personality Profiles. Medical Eduaction 27: 328–336.Google Scholar
  18. VanSusteren T.J., Suter E., Romrell L.J., Lanier L., Hatch R.L. (1999). Do Interviews Really Play an Important role in the Medical School Selection Decision? Teaching and Learning in Medicine 11(2): 66–74.Google Scholar

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Clarence D. Kreiter
  • Ping Yin
  • Catherine Solow
  • Robert L. Brennan

There are no affiliations available

Personalised recommendations