Skip to main content

Residency applicants misinterpret their United States Medical Licensing Exam Scores

Abstract

Proper interpretation of the results of the United States Medical Licensing Exam (USMLE) is important for program directors, residents, and faculty who advise applicants about applying for residency positions. We suspected that applicants often misinterpreted their performance in relationship to others who took the same examination. In 2005, 54 consecutive applicants to the University of Tennessee, College of Medicine internal medicine residency program were asked to complete a brief survey about their performance on Parts 1 and 2 of the USMLE exam. When asked what percentile their Part I score represented, slightly over one in ten were unsure or did not know, and nearly three out of five wrote in their two-digit score. Of the 15 who wrote in another number, only a third were within ten percentile points of their estimated percentile. Similar results were seen for Part II. A higher percentage of international medical graduates (IMGs) than U.S. applicants responded to the percentile question with their two-digit scores (79% vs. 50% p = .08). Applicants to residency programs frequently misinterpret their performance on the USMLE compared to their peers. Unless they are high performers, those who misinterpret their two-digit scores as percentiles markedly overestimate their performance. The sponsors of the USMLE should discontinue reporting the two-digit score and consider re-instating the reporting of percentiles.

This is a preview of subscription content, access via your institution.

Fig. 1

References

  • Andriole, D. A., Jeffe, D. B., Hageman, H. L., & Whelan, A. J. (2005). What predicts USMLE Step 3 performance? Academic Medicine, 80, S21–S24.

    Article  Google Scholar 

  • Berner, E. S., Brooks, C. M., & Erdmann, J. B. (1993). Use of the USMLE to select residents. Academic Medicine, 68, 753–759.

    Article  Google Scholar 

  • Bowles, L. T., Melnick, D. E., Nungester, R. J., Golden, G. S., Swanson, D. B., Case, S. M., et al. (2000). Review of the score-reporting policy for the United States Medical Licensing Exam. Academic Medicine, 75, 426–431.

    Article  Google Scholar 

  • Durning, S. J., Pangaro, L. N., Lawrence, L. L., Waechter, D., McManigle, J., & Jackson, J. L. (2005). The feasibility, reliability, and validity of a program director’s (supervisor’s) evaluation form for medical school graduates. Academic Medicine, 80, 964–968.

    Article  Google Scholar 

  • O’Donnell, M. J., Obenshain, S. S., & Erdmann, J. B. (1993). Background essential to the proper use of the results of Step One and Step Two of the USMLE. Academic Medicine, 68, 734–739.

    Article  Google Scholar 

  • Paolo, A. M., & Bonaminio, G. A. (2003). Measuring outcomes of undergraduate medical education: Residency directors’ ratings of first-year residents. Academic Medicine, 78, 90–95.

    Article  Google Scholar 

  • United States Medical Licensing Examination. (n.d.). Retrieved July 26, 2006, from: http://www.usmle.org

Download references

Acknowledgements

The authors wish to acknowledge the valuable assistance of Mr. Benjamin Moffitt, Department of Medicine Research Associate, in the conduct of this project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roger C. Jones.

Appendix

Appendix

Study questionnaire

We are performing a study to better understand how applicants interpret their USMLE scores.

In answering these questions, please consider that a percentile is a unit used to describe a portion of the individuals or events being studied. Suppose the data are arranged by numerical scores, from highest to lowest. A score belongs to the 78th percentile, for example, if it is greater than 78% of the scores but is not greater than 79% of the scores. This procedure divides the scores into 100 percentiles, numbered 0–99th.

Please answer the following:

What was your USMLE Part I score? ______

What percentile does this represent? ______

What was your USMLE Part II score? ______

What percentile does this represent? ______

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Jones, R.C., Desbiens, N.A. Residency applicants misinterpret their United States Medical Licensing Exam Scores. Adv in Health Sci Educ 14, 5–10 (2009). https://doi.org/10.1007/s10459-007-9084-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-007-9084-0

Keywords

  • Graduate medical education
  • Percentile scores
  • Residency application
  • Score interpretation
  • United States Medical Licensing Examination (USMLE)