Skip to main content
SpringerLink
Log in

Medical School Resourcing of USMLE Step 1 Preparation: Questioning the Validity of Step 1

  • Commentary
  • Published:
Medical Science Educator Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

References

  1. Chen DR, Priest KC, Batten JN, Fragoso LE, Reinfield BI, Laitman BM. Student perspectives on the “Step 1 climate” in preclinical medical education. Acad Med. 2019;94(3):302–4.

    Article  Google Scholar 

  2. Prober CG, Kolars JC, First LR, Melnick DE. A plea to reassess the role of United States medical licensing examination step 1 scores in residency selection. Acad Med. 2016;91:12–5.

    Article  Google Scholar 

  3. United States medical licensing examination. What is USMLE? Available at https://www.usmle.org. Accessed January 30, 2019.

  4. Nousianinen MT, Caverzagie KJ, Ferguson PC, Frank JR. On behalf of the ICBME collaborators. Implementing competency-based medical education: what changes in curricular structure and processes are needed? Med Teach. 2017;39(6):594–8.

    Article  Google Scholar 

  5. Lockyer J, Carraccio C, Chan M-K, Hart D, Smee S, Touchie C, et al. On behalf of the ICBME Collaborators. Core principles of assessment in competency-based medical education. Med Teach. 2017;39(6):609–16.

    Article  Google Scholar 

  6. Harris P, Bhanji F, Topps M, Ross S, Lieberman S, Frank JR, et al. On behalf of the ICBME collaborators. Evolving concepts of assessment in a competency-based world. Med Teach. 2017;39(6):603–8.

    Article  Google Scholar 

  7. Wormwald BW, Schoeman S, Somasunderam A, Penn M. Assessment drives learning: an unavoidable truth? Anat Sci Educ. 2009;2:199–204.

    Article  Google Scholar 

  8. United States Medical Licensing Examination. USMLE score interpretation guidelines. Available at https://www.usmle.org. Accessed January 30, 2019.

  9. Manthey DE, Hartman ND, Newmyer A, Gunalda JC, Hiestand BC, Askew KL, et al. Western J Emerg Med. 2017;28(1):105–105-9.

    Article  Google Scholar 

  10. Kumar AD, Shah MK, Maley JH, Evron J, Gyftopoulos A, Miller C. Preparing to take the USMLE step 1: a survey on medical students’ self-reported study habits. Postgrad Med J. 2015;91:257–61.

    Article  Google Scholar 

  11. Rappley MD. The most important question we can ask. 128th annual Association of American Medical Colleges leadership plenary. Available at https://news.aamc.org/research/article/leadership-plenary-2017/. Accessed on January. 2019;30.

  12. American Educational Research Association, American Psychological Association. National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 2014.

  13. Radabaugh CL, Hawkins RE, Welcher CM, Mejicano GC, Aparicio A, Lynne K, et al. Beyond the United States Medical Licensing Examination Score: assessing competence for entering residency. Acad Med. 2019;94(7):983–9.

    Article  Google Scholar 

  14. Trochim WMK. Threats to construct validity. Available at https://socialresearchmethods.net/kb/consthre.php. Accessed on January 30, 2019.

  15. Baños JH, Pepin ME, Van Wagoner N. Class-wide access to commercial step 1 question bank during preclinical organ-based modules: a pilot project. Acad Med. 2018;93(3):486–90.

    Article  Google Scholar 

  16. Giordano C, Hutchinson D, Peppler R. A predictive model for USMLE Step 1 scores. Cureus. 2016;8(9):e769. https://doi.org/10.7759/cureus.769.

    Article  Google Scholar 

  17. Ehrlich A. Acing step 1 isn’t just about intelligence. Accessed January. February 15;2018. Available at https://www.usmlepro.com/single-post/Scoring-260-on-USMLE-step-1, 30:2019.

  18. Kleshinski J, Khuder SA, Shapiro JI, Gold JP. Impact of preadmission variables on USMLE step 1 and step 2 performance. Adv Health Sci Educ. 2009;14:69–78.

    Article  Google Scholar 

  19. Rubright J, Jodoin M, Barone MA. Examining demographics, prior academic performance, and United States licensing examination scores. Acad Med. 2019;94(3):364–70.

    Article  Google Scholar 

  20. Williams TS. Some issues in the standardized testing of minority students. J Educ. 1983;165(2):192–208.

    Article  Google Scholar 

  21. Cook DA, Lineberry M. Consequences validity evidence: evaluating the impact of educational assessments. Acad Med. 2016;91:785–95.

    Article  Google Scholar 

  22. Camargo SL, Herrera AN, Traynor A. Looking for a consensus in the discussion about the concept of validity: a Delphi study. Methodol. 2018;14(4):146–55.

    Google Scholar 

  23. Katsufrakis PJ, Chaudhry HJ. Improving residency selection requires close study and better understanding of stakeholder needs. Acad Med. 2019;94(3):305–8.

    Article  Google Scholar 

  24. Zuckerman SL, Kelly PD, Dewan MC, Morone PJ, Yengo-Kahn AM, Magarik JA, et al. Predicting resident performance from preresidency factors: a systematic review and applicability to neurosurgical training. World Neurosurg. 2018;110:475–84.

    Article  Google Scholar 

  25. Welch TR, Olson BG, Nelsen E, Beck Dallaghan GL, Kennedy GA, Botash A. United States Medical Licensing Examination and American Board of Pediatrics certification examination results: does the residency program contribute to trainee achievement. J Pediatr. 2017;188:270–4.

    Article  Google Scholar 

  26. Cuddy MM, Young A, Gelman A, Swanson DB, Johnson DA, Dillon GF, et al. Exploring the relationships between USMLE performance and disciplinary action in practice: a validity study of score inferences from a licensure examination. Acad Med. 2017;92(12):1780–5.

    Article  Google Scholar 

  27. Gumbert SD, Guzman-Reyes S, Pivalizza EG. Letter to the editor. Acad Med. 2016;91(11):1469.

    Article  Google Scholar 

  28. Gelinne A, Zuckerman S, Benzil D, Grady S, Callas P, Durham. United States medical licensing exam step I score as a predictor of neurosurgical career beyond residency. Neurosurg. 2019; 84:1028–1034.

  29. Haertel EH. Tests, test scores, and constructs. Educ Psychol. 2018;53(3):203–16.

    Article  Google Scholar 

  30. Pereira AG, Woods M, Olson APJ, van den Hoogenhof S, Duffy BL, Englander R. Criterion-based assessment in a norm-based world: how can we move past grades? Acad Med. 2018;93(4):560–4.

    Article  Google Scholar 

  31. Dumas D, McNeish D, Schreiber-Gregory D, Durning SJ, Torre DM. Dynamic measurement in health professions education: rationale, application, and possibilities. Acad Med. 2019;94(9):1323–8.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Office of Medical Education, University of North Carolina School of Medicine, 108 Taylor Hall, CB#7321, Chapel Hill, NC, 27599-7321, USA

    Gary L. Beck Dallaghan, Julie Story Byerley, Neva Howard, William C. Bennett & Kurt O. Gilliland

Authors
  1. Gary L. Beck Dallaghan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julie Story Byerley
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Neva Howard
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. William C. Bennett
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kurt O. Gilliland
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gary L. Beck Dallaghan.

Ethics declarations

Conflict of Interest

The authors have no conflicts of interest to declare.

Ethical Approval

Not applicable.

Informed Consent

Not applicable.

Previous Presentations

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Beck Dallaghan, G.L., Byerley, J.S., Howard, N. et al. Medical School Resourcing of USMLE Step 1 Preparation: Questioning the Validity of Step 1. Med.Sci.Educ. 29, 1141–1145 (2019). https://doi.org/10.1007/s40670-019-00822-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40670-019-00822-1

Search

Navigation