Skip to main content
SpringerLink
Log in

Assessment in Mastery Learning

  • Chapter
  • First Online:
Comprehensive Healthcare Simulation: Mastery Learning in Health Professions Education

Part of the book series: Comprehensive Healthcare Simulation ((CHS))

Abstract

The purpose of assessment in mastery learning is to promote learner improvement. Assessment is a key and indispensable feature of the mastery learning bundle. Mastery learning approaches are linked to the ability to make accurate decisions. Accurate decisions depend on reliable data that have been collected using instruments and methods linked to curriculum learning objectives. This chapter has six sections that reveal the ways that instruction and assessment are inseparable in mastery learning: (a) curriculum and instruction, (b) validity argument, (c) assessment context, (d) assessment measures, (e) data, and (f) decisions. Health professions educators must collect validity evidence regularly to support the validity argument that they are making accurate decisions about learners at each step of assessment design and implementation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Popham WJ. Criterion-referenced measurement. Englewood Cliffs, NJ: Prentice-Hall; 1978.

    Google Scholar 

  2. McGaghie WC. Mastery learning: it is time for medical education to join the 21st century. Acad Med. 2015;90(11):1438–41.

    Article  PubMed  Google Scholar 

  3. Grigorenko EL, Sternberg RJ. Dynamic testing. Psychol Bull. 1998;124(1):75–111.

    Article  Google Scholar 

  4. van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39(3):309–17.

    Article  PubMed  Google Scholar 

  5. Lineberry M, Park YS, Cook DA, Yudkowsky R. Making the case for mastery learning assessments: key issues in validation and justification. Acad Med. 2015;90(11):1445–50.

    Article  PubMed  Google Scholar 

  6. McGaghie WC. Evaluation apprehension and impression management in clinical medical education. Acad Med. 2018;93(5):685–6.

    Article  PubMed  Google Scholar 

  7. Rosenbaum L. Cursed by knowledge—building a culture of psychological safety. N Engl J Med. 2019;380(8):786–90.

    Article  PubMed  Google Scholar 

  8. Richardson L. Writing strategies: reaching diverse audiences, Qualitative research methods series, vol. 21. Newbury Park, CA: Sage Publications; 1990.

    Book  Google Scholar 

  9. Thomas PA, Kern DE, Hughes MT, Chen BY. Curriculum development for medical education: a six-step approach. 3rd ed. Baltimore: Johns Hopkins University Press; 2016.

    Google Scholar 

  10. McGaghie WC, Harris IB. Learning theory foundations of simulation-based mastery learning. Simul Healthc. 2018;13:S15.

    Article  PubMed  Google Scholar 

  11. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10, Suppl):S70–81.

    Article  PubMed  Google Scholar 

  12. Ericsson KA, Whyte J, Ward P. Expert performance in nursing: reviewing research on expertise in nursing within the framework of the expert-performance approach. Adv Nurs Sci. 2007;30(1):E58–71.

    Article  Google Scholar 

  13. Ericsson KA. Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice. Acad Med. 2015;90(11):1471–86.

    Article  PubMed  Google Scholar 

  14. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296:1094–102.

    Article  CAS  PubMed  Google Scholar 

  15. Eva KW, Cunnington JPW, Reiter HI, et al. How can I know what I don’t know? Poor self-assessment in a well-defined domain. Adv Health Sci Educ Theory Pract. 2004;9(3):211–24.

    Article  PubMed  Google Scholar 

  16. Sargeant J, Mann K, van der Vleuten C, Metsemakers J. “Directed” self-assessment: practice and feedback within a social context. J Contin Educ Health Prof. 2008;28:47–54.

    Article  PubMed  Google Scholar 

  17. Bandura A. Guide for constructing self-efficacy scales. In: Pajores P, Urdan T, editors. Self-efficacy beliefs of adolescents. Greenwich, CT: Information Age Publishing; 2006. p. 307–37.

    Google Scholar 

  18. Schuwirth L, Ash J. Assessing tomorrow’s learners: in competency-based education only a radically different holistic method of assessment will work. Six things we could forget. Med Teach. 2013;35:555–9.

    Article  PubMed  Google Scholar 

  19. Hodges B. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 2013;35:564–8.

    Article  PubMed  Google Scholar 

  20. Lockyer J, Carraccio C, Chan M-K, et al. Core principles of assessment in competency-based medical education. Med Teach. 2017;39960:609–16.

    Article  Google Scholar 

  21. Gruppen LD, ten Cate O, Lingard LA, et al. Enhanced requirements for assessment in a competency-based, time variable medical education system. Acad Med. 2018;93:S17–21.

    Article  PubMed  Google Scholar 

  22. O’Brien CL, Sanguino SM, Thomas JX, Green MM. Feasibility and outcomes of implementing a portfolio assessment system alongside a traditional grading system. Acad Med. 2016;91(11):1554–60.

    Article  PubMed  Google Scholar 

  23. Messick S. Standards of validity and the validity of standards in performance assessment. Educ Meas Issues Pract. 1995;14(4):5–8.

    Article  Google Scholar 

  24. Kane MT. Validating the interpretations and uses of test scores. J Educ Meas. 2013;50(1):1–73.

    Article  Google Scholar 

  25. Cook DA, Brydges R, Ginsburg S, Hatala RA. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49(6):560–75.

    Article  PubMed  Google Scholar 

  26. Cook DA, Hatala RA. Validation of educational assessments: a primer for simulation and beyond. Adv Simul. 2016;1(1):31.

    Article  Google Scholar 

  27. Boulet JR, Jeffries PR, Hatala RA, et al. Research regarding methods of assessing learning outcomes. Simul Healthc. 2011;6(Suppl):S48–51.

    Article  PubMed  Google Scholar 

  28. McGaghie WC. Medical education research as translational science. Sci Trans Med. 2010;2:19cm8.

    Article  Google Scholar 

  29. Singh T, Norcini JJ. Workplace-based assessment. In: McGaghie WC, editor. International best practices for evaluation in the health professions. London: Radcliffe Publishing Ltd; 2013.

    Google Scholar 

  30. Laufer S, D’Angelo A-LD, Kwan C, et al. Rescuing the clinical breast examination: advances in classifying technique and assessing physician competency. Ann Surg. 2017;266(6):1069–74.

    Article  PubMed  Google Scholar 

  31. McGaghie WC, Issenberg SB. Simulations in assessment. In: Downing SM, Yudkowsky R, editors. Assessment in health professions education. New York: Routledge; 2009. p. 245–68.

    Google Scholar 

  32. Gordon MS, Issenberg SB. Instructor guide for Harvey the cardiovascular patient simulator. University of Miami Miller School of Medicine, Gordon Center for Research in Medical Education; 2006.

    Google Scholar 

  33. Miller MD, Linn RL, Gronlund NE. Measurement and assessment in teaching. 11th ed. New York: Pearson; 2013.

    Google Scholar 

  34. National Council of State Boards of Nursing. NCLEX – RN Examination: detailed test plan for the National Council licensure examination for registered nurses. Chicago: NCSBN; 2015.

    Google Scholar 

  35. Jurich D, Duhigs LM, Plumb TJ, et al. Performance on the nephrology in-training examination and ABIM nephrology certification examination outcomes. Clin J Am Soc Nephrol. 2018;13(5):710–7.

    Article  PubMed  PubMed Central  Google Scholar 

  36. American Board of Psychiatry and Neurology. Certification examination in child and adolescent psychiatry: 2017 content blueprint and 2017 content outline. Available at: https://www.abpn.com/wp-content/uploads/2016/11/2017_Child_and_Adolescent_Psychiatry_CERT_Conteny_specifications.pdf.

  37. Korea Health Personnel Licensing Examination Institute. Health professional examination guides. Available at: http://www.kuksiwon.or.kr/EngHome?context.aspx?page=sub_2_1&sub=1#.

  38. Gallagher AG, O’Sullivan GC. Fundamentals of surgical simulation. New York: Springer; 2012.

    Book  Google Scholar 

  39. Laufer S, Cohen ER, Kwan C, et al. Sensor technology in assessments of clinical skill (research letter). N Engl J Med. 2015;372(8):784–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Heiman HL, Rasminsky S, Bierman JA, et al. Medical students’ observations, practices, and attitudes regarding electronic health record documentation. Teach Learn Med. 2014;26(1):49–55.

    Article  PubMed  Google Scholar 

  41. Cresswell JW, Plano Clark VL. Designing and conducting mixed methods research. 3rd ed. Thousand Oaks, CA: Sage Publications; 2018.

    Google Scholar 

  42. Jordan M. For the love of the game. New York: Crown Publishers; 1998.

    Google Scholar 

  43. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ. 2004;38:1006–12.

    Article  PubMed  Google Scholar 

  44. Brennan RL. Generalizability theory. Educ Meas Issues Prac. 1992;11(4):27–34.

    Article  Google Scholar 

  45. Barsuk JH, Cohen ER, Wayne DB, et al. A comparison of approaches to mastery learning standard setting. Acad Med. 2018;93(7):1079–84.

    Article  PubMed  Google Scholar 

  46. Govaerts MJB, van der Vleuten CPM, Holmboe ES. Managing tensions in assessment: moving beyond either-or thinking. Med Educ. 2019;53:64–75.

    Article  PubMed  Google Scholar 

  47. Schoenherr JR, Hamstra SJ. Psychometrics and its discontents: an historical perspective on the discourse of the measurement tradition. Adv Health Sci Educ. 2016;21:719–29.

    Article  Google Scholar 

  48. Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53:76–85.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Northwestern University Feinberg School of Medicine, Department of Medical Education, Chicago, IL, USA

    Celia Laird O’Brien

  2. Northwestern University Feinberg School of Medicine, Departments of Pediatrics and Medical Education, Chicago, IL, USA

    Mark Adler

  3. Northwestern University Feinberg School of Medicine, Departments of Medical Education and Preventive Medicine, Chicago, IL, USA

    William C. McGaghie

Authors
  1. Celia Laird O’Brien
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Adler
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. William C. McGaghie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Celia Laird O’Brien .

Editor information

Editors and Affiliations

  1. Northwestern University Feinberg School of Medicine, Departments of Medical Education and Preventive Medicine, Chicago, IL, USA

    William C. McGaghie

  2. Northwestern University Feinberg School of Medicine, Departments of Medicine and Medical Education, Chicago, IL, USA

    Jeffrey H. Barsuk

  3. Northwestern University Feinberg School of Medicine, Departments of Medicine and Medical Education, Chicago, IL, USA

    Diane B. Wayne

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

O’Brien, C.L., Adler, M., McGaghie, W.C. (2020). Assessment in Mastery Learning. In: McGaghie, W., Barsuk, J., Wayne, D. (eds) Comprehensive Healthcare Simulation: Mastery Learning in Health Professions Education. Comprehensive Healthcare Simulation. Springer, Cham. https://doi.org/10.1007/978-3-030-34811-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34811-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34810-6

  • Online ISBN: 978-3-030-34811-3

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation