Skip to main content

Psychometric properties of the multiple mini-interview used for medical admissions: findings from generalizability and Rasch analyses

Advances in Health Sciences Education volume 19, pages 71–84 (2014)Cite this article

Abstract

The multiple mini-interview (MMI) has become an increasingly popular admissions method for selecting prospective students into professional programs (e.g., medical school). The MMI uses a series of short, labour intensive simulation stations and scenario interviews to more effectively assess applicants’ non-cognitive qualities such as empathy, critical thinking, integrity, and communication. MMI data from 455 medical school applicants were analyzed using: (1) Generalizability Theory to estimate the generalizability of the MMI and identify sources of error; and (2) the Many-Facet Rasch Model, to identify misfitting examinees, items and raters. Consistent with previous research, our results support the reliability of MMI process. However, it appears that the non-cognitive qualities are not being measured as unique constructs across stations.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1

References

  • Arnold, L. (2002). Assessing professional behavior: Yesterday, today, and tomorrow. Academic Medicine, 77(6), 502–515.

    Article  Google Scholar 

  • Brennan, R. L. (2001). Generalizability theory. New York, NY: Springer.

    Book  Google Scholar 

  • Crick, J. E., & Brennan, R. L. (1983). Manual for GENOVA: A generalized analysis of variance system (American College Testing Technical Bulletin No. 43). Iowa City, IA: ACT.

  • Dodson, M., Crotty, B., Prideaux, D., Carne, R., Ward, A., & de Leeuw, E. (2009). The multiple mini-interview: How long is long enough? Medical Education, 43(2), 168–174.

    Article  Google Scholar 

  • Eva, K. W., Reiter, H. I., Rosenfeld, J., & Norman, G. R. (2004). An admissions OSCE: the multiple mini-interview. Medical Education, 38, 314–326.

    Article  Google Scholar 

  • Fox, C. M., & Jones, J. A. (1998). Uses of Rasch modeling in counselling psychology research. Journal of Counseling Psychology, 45(1), 30–45.

    Article  Google Scholar 

  • Harden, R. M., & Gleeson, F. A. (1979). Assessment of clinical competence using an objective structured clinical examination (OSCE). Medical Education, 13(1), 41–54.

    Article  Google Scholar 

  • Linacre, J. M. (1989). Many-facet Rasch measurement. Chicago: MESA.

    Google Scholar 

  • Linacre, J. M. (1995). Categorical misfit statistics. Rasch Measurement Transactions, 9(3), 450.

    Google Scholar 

  • Linacre, J. M. (2010). Rasch measurement: Core topics. Retrieved from http://courses.statistics.com/index.php3.

  • Linacre, J. M. (2011). Facets computer program for many-facet Rasch measurement, version 3.68.1. Beaverton, OR: Winsteps.com.

  • Lunz, M. E., Wright, B. D., & Linacre, J. M. (1990). Measuring the impact of judge severity on examination scores. Applied Measurement in Education, 3(4), 331–345.

    Article  Google Scholar 

  • Reiter, H. I., Eva, K. W., Rosenfeld, J., & Norman, G. R. (2007). Multiple mini-interview predicts for clinical clerkship performance? National licensure examination performance. Medical Education, 41(4), 378–384.

    Article  Google Scholar 

  • Roberts, C., Walton, M., Rothnie, I., Crossley, J., Lyon, P., Kumar, K., et al. (2008). Factors affecting the utility of the multiple mini-interview in selecting candidates for graduate-entry medical school. Medical Education, 42, 396–404.

    Article  Google Scholar 

  • Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage Publications.

    Google Scholar 

  • Thorndike, R. M. (2005). Measurement and evaluation in psychology and education (7th ed.). Upper Saddle River, NJ: Pearson.

    Google Scholar 

  • Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006). Reliability coefficients and generalizability theory. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 81–124). Dordrecht: Elsevier.

    Google Scholar 

  • Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.

    Google Scholar 

Download references

Author information

Affiliations

  1. Faculty of Education, Queen’s University, Kingston, Ontario, Canada

    Stefanie S. Sebok, King Luu & Don A. Klinger

Authors
  1. Stefanie S. Sebok
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. King Luu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Don A. Klinger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefanie S. Sebok.

Appendix

Appendix

See Table 6.

Table 6 List of items (attributes) for MMI stations
Full size table

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Sebok, S.S., Luu, K. & Klinger, D.A. Psychometric properties of the multiple mini-interview used for medical admissions: findings from generalizability and Rasch analyses. Adv in Health Sci Educ 19, 71–84 (2014). https://doi.org/10.1007/s10459-013-9463-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-013-9463-7

Keywords

  • Multiple mini-interview
  • Medical admissions
  • Rasch measurement
  • G theory