Abstract
In 2001, Dr Jordan Cohen, President of the AAMC, called for medical schools to consider using an Medical College Admission Test (MCAT) threshold to eliminate high-risk applicants from consideration and then to use non-academic qualifications for further consideration. This approach would seem to be consistent with the recent Supreme Court ruling on the University of Michigan admissions cases. Research to support a threshold approach has been reported in many different ways, making comparability problematic. This study examines an assortment of statistical indices that have been used to determine thresholds in undergraduate science grade point average (USGPA) and MCAT sub-scores and total sum and compares them in terms of their sensitivity and specificity for determining Medical Licensing Exam (USMLE Step 1) first time failure. Data for medical school entering classes of 1992–1998 (N=752) from a large Midwestern medical school are used to determine the set of statistics that provide the most useful information for this purpose. The results support plots of risk differences, odds-ratios, sensitivity and specificity for setting cut-scores.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
InstitutionalAuthorNameAmerican Educational Research Association American Psychological Association, National Council on Measurement in Education (1999) Standards for Educational and Psychological Testing American Educational Research Association Washington, DC
M.A. Albanese P. Farrell J. Barnet (1999) Sensitivity and specificity of using GPA and MCAT cutoffs for medical school admissions decisions Proceedings of the 38th Annual Research in Medical Education Conference Washington, DC, USA.
J. Cohen (2001) Facing the future President’s Address Proceedings of the 112th Annual Meeting of the Association of American Medical Colleges Washington, DC, USA
M. Hojat J.J. Veloski C. Zeleznik (1985) ArticleTitlePredictive validity of the MCAT for students with two sets of scores Journal of Medical Education 60 911–918 Occurrence Handle4068015
M. Hojat J. Gonnella J. Erdmann J. Veloske (1997) ArticleTitleThe fate of medical students with different levels of knowledge: are the basic medical sciences relevant to physician competence? Advances in Health Sciences Education 1 179–196 Occurrence Handle10.1023/A:1018383708357
K. Mitchell (1990) ArticleTitleTraditional predictors of performance in medical school Acadamic Medicine 65 IssueID3 149–158
Mootz W.C., Galofre, A. (2002). Factors predictive of USMLE Step 1 failure: A report to the curricuum oversight committee. Saint Louis University School of Medicine. June 25, 2002. Poster presented at the Ottawa Conference, Ottawa, CA.
Tekian A. (1999). Personal communication.
J.B. Vancouver M.A. Reinhart D.J. Solomon J.J. Haf (1990) ArticleTitleTesting for validity and bias in the use of GPA and the MCAT in the selection of medical school students Academic Medicine 65 694–696 Occurrence Handle2102099
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Albanese, M.A., Farrell, P. & Dottl, S. Statistical Criteria for Setting Thresholds in Medical School Admissions. Adv Health Sci Educ Theory Pract 10, 89–103 (2005). https://doi.org/10.1007/s10459-004-1122-6
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10459-004-1122-6