Advertisement

Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice

  • Diane B. Wayne
  • John Butter
  • Viva J. Siddall
  • Monica J. Fudala
  • Leonard D. Wade
  • Joe Feinglass
  • William C. McGaghie
Original Articles

Abstract

BACKGROUND: Internal medicine residents must be competent in advanced cardiac life support (ACLS) for board certification.

OBJECTIVE: To use a medical simulator to assess postgraduate year 2 (PGY-2) residents’ baseline proficiency in ACLS scenarios and evaluate the impact of an educational intervention grounded in deliberate practice on skill development to mastery standards.

DESIGN: Pretest-posttest design without control group. After baseline evaluation, residents received 4, 2-hour ACLS education sessions using a medical simulator. Residents were then retested. Residents who did not achieve a research-derived minimum passing score (MPS) on each ACLS problem had more deliberate practice and were retested until the MPS was reached.

PARTICIPANTS: Forty-one PGY-2 internal medicine residents in a university-affiliated program.

MEASUREMENTS: Observational checklists based on American Heart Association (AHA) guidelines with interrater and internal consistency reliability estimates; deliberate practice time needed for residents to achieve minimum competency standards; demographics; United States Medical Licensing Examination Step 1 and Step 2 scores; and resident ratings of program quality and utility.

RESULTS: Performance improved significantly after simulator training. All residents met or exceeded the mastery competency standard. The amount of practice time needed to reach the MPS was a powerful (negative) predictor of posttest performance. The education program was rated highly.

CONCLUSIONS: A curriculum featuring deliberate practice dramatically increased the skills of residents in ACLS scenarios. Residents needed different amounts of training time to achieve minimum competency standards. Residents enjoy training, evaluation, and feedback in a simulated clinical environment. This mastery learning program and other competency-based efforts illustrate outcome-based medical education that is now prominent in accreditation reform of residency education.

Key words

mastery learning medical simulation residency education 

References

  1. 1.
    American Board of Internal Medicine. Requirements for certification in internal medicine. Available at: http://www.abim.org/cert/policiesim.shtm#6. Accessed July 7, 2005.Google Scholar
  2. 2.
    Cummins RO, Sanders A, Mancini E, Hazinski MF. In-hospital resuscitation: a statement for healthcare professionals from the American Heart Association Emergency Cardiac Care Committee and the Advanced Cardiac Life Support, Basic Life Support, Pediatric Resuscitation, and Program Administration Subcommittees. Circulation. 1997;95:2211–2.PubMedGoogle Scholar
  3. 3.
    Kaye W, Mancini ME, Rallis SF. Advanced cardiac life support refresher course using standardized objective-based mega code testing. Crit Care Med. 1987;15:55–60.CrossRefPubMedGoogle Scholar
  4. 4.
    O’Steen DS, Kee CC, Minick MP. The retention of advanced cardiac life support knowledge among registered nurses. J Nurs Staff Dev. 1996;12:66–72.PubMedGoogle Scholar
  5. 5.
    Moser DK, Dracup K, Guzy PM, Taylor SE, Breu C. Cardiopulmonary resuscitation skills retention in family members of cardiac patients. Am J Emer Med. 1990;8:498–503.CrossRefGoogle Scholar
  6. 6.
    Makker R, Gray-Siracusa K, Evers M. Evaluation of advanced cardiac life support in a community teaching hospital by use of actual cardiac arrests. Heart Lung. 1995;24:116–20.CrossRefPubMedGoogle Scholar
  7. 7.
    Kaye W. Research on ACLS training—which methods improve skill and knowledge retention? Respir Care. 1995;40:538–46.PubMedGoogle Scholar
  8. 8.
    Peberdy MA, Kaye W, Ornato JP, et al. Cardiopulmonary resuscitation of adults in the hospital: a report of 14,720 cardiac arrests from the National Registry of Cardiopulmonary Resuscitation. Resuscitation. 2003;58:297–308.CrossRefPubMedGoogle Scholar
  9. 9.
    Abella BS, Alvarado JP, Myklebust H, et al. Quality of cardiopulmonary resuscitation during in-hospital cardiac arrest. JAMA. 2005;293:305–10.CrossRefPubMedGoogle Scholar
  10. 10.
    Issenberg SB, McGaghie WC, Hart IR, et al. Simulation technology for health care professional skills training and assessment. JAMA. 1999;282:861–6.CrossRefPubMedGoogle Scholar
  11. 11.
    Dunn WF, ed. Simulators in Critical Care Education and Beyond. Des Plaines, IL: Society of Critical Care Medicine; 2004.Google Scholar
  12. 12.
    Tekian A, McGuire CH, McGaghie WC, eds. Innovative Simulations for Assessing Professional Competence. Chicago: Department of Medical Education, University of Illinois College of Medicine; 1999.Google Scholar
  13. 13.
    Gaba DM. Human work environment and simulators. In: Miller RD, ed. Anesthesia. 5th ed. Philadelphia: Churchill Livingstone; 2000:2613–68.Google Scholar
  14. 14.
    Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(suppl):S70–81.CrossRefPubMedGoogle Scholar
  15. 15.
    Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28.CrossRefPubMedGoogle Scholar
  16. 16.
    Boulet JR, Murray D, Kras J, et al. Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiology. 2003;99:1270–80.CrossRefPubMedGoogle Scholar
  17. 17.
    Issenberg SB, McGaghie WC, Gordon DL, et al. Effectiveness of a cardiology review course for internal medicine residents using simulation technology and deliberate practice. Teach Learn Med. 2002;14:223–8.CrossRefPubMedGoogle Scholar
  18. 18.
    Ewy GA, Felner JM, Juul D, et al. Test of a cardiology patient simulator in fourth-year electives. J Med Educ. 1987;62:738–43.PubMedGoogle Scholar
  19. 19.
    Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance. Ann Surg. 2002;236:458–64.CrossRefPubMedGoogle Scholar
  20. 20.
    Bandura A. Self-Efficacy: The Exercise of Control. New York: W.H. Freeman; 1997.Google Scholar
  21. 21.
    Block JH, ed. Mastery Learning: Theory and Practice. New York: Holt, Rinehart and Winston; 1971.Google Scholar
  22. 22.
    McGaghia WC, Miller GE, Sajid A, Telder TV. Competency-Based Curriculum Development in Medical Education. Public Health Paper No. 68. Geneva, Switzerland: World Health Organization; 1978.Google Scholar
  23. 23.
    Carroll JB. A model of school learning. Teach Coll Rec. 1963;64:723–33.Google Scholar
  24. 24.
    Keller FS. “Good-bye, teacher ….” J Appl Behav Anal. 1968;1:79–89.CrossRefPubMedGoogle Scholar
  25. 25.
    McClelland DC. Testing for competence rather than for “intelligence.” Am Psychol. 1973;28:1–14.CrossRefPubMedGoogle Scholar
  26. 26.
    Bloom BS. Time and learning. Am Psychol. 1974;29:682–8.CrossRefGoogle Scholar
  27. 27.
    Bloom BS. Human Characteristics and School Learning. New York: McGraw-Hill; 1976.Google Scholar
  28. 28.
    Kulik JA, Kulik C-LC, Cohen PA. A meta-analysis of outcome studies of Keller’s personalized system of instruction. Am Psychol. 1979;34:307–18.CrossRefGoogle Scholar
  29. 29.
    Harden RM. Developments in outcome-based education. Med Teach. 2002;24:117–20.CrossRefPubMedGoogle Scholar
  30. 30.
    Goroll AH, Sirio C, Duffy FD, et al. A new model for accreditation of residency programs in internal medicine. Ann Intern Med. 2004;140:902–9.PubMedGoogle Scholar
  31. 31.
    Wayne DB, Butter J, Siddall VJ, et al. Simulation-based training of internal medicine residents in advanced cardiac life support protocols: a randomized trial. Teach Learn Med. 2005;17:210–6.CrossRefPubMedGoogle Scholar
  32. 32.
    Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin; 2002.Google Scholar
  33. 33.
    Cummins RO, ed. ACLS Provider Manual. Dallas: American Heart Association; 2001.Google Scholar
  34. 34.
    McGaghie WC, Renner BR, Kowlowitz V, et al. Development and evaluation of musculoskeletal performance measures for an objective structured clinical examination. Teach Learn Med. 1994;6:59–63.CrossRefGoogle Scholar
  35. 35.
    Stufflebeam DL. The Checklists Development Checklist. Western Michigan University Evaluation Center, July 2000. Available at http://www.wmich.edu/evalctr/checklists/cdc.htm. Accessed 03/15/2005.Google Scholar
  36. 36.
    Wayne DB, Fudala MJ, Butter J, et al. Comparison of two standard setting methods for advanced cardiac life support training. Acad Med. 2005;80(suppl):S63-S66CrossRefPubMedGoogle Scholar
  37. 37.
    Fleiss JL. Statistical Methods for Rates and Proportions. 2nd ed. New York: John Wiley & Sons; 1981.Google Scholar
  38. 38.
    Brennan RL, Prediger DJ. Coefficient kappa: some uses, misuses, and alternatives. Educ Psychol Meas. 1981;41:687–99.CrossRefGoogle Scholar
  39. 39.
    Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:93–104.CrossRefGoogle Scholar
  40. 40.
    Samson GE, Graue ME, Weinstein T, Walberg HJ. Academic and occupational performance: a quantitative synthesis. Am Educ Res J. 1984;21:311–21.Google Scholar
  41. 41.
    Des Jarlias DC, Lyles C, Crepaz N, and the TREND Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94:361–6.CrossRefGoogle Scholar

Copyright information

© Society of General Internal Medicine 2006

Authors and Affiliations

  • Diane B. Wayne
    • 1
  • John Butter
    • 1
  • Viva J. Siddall
    • 2
  • Monica J. Fudala
    • 1
  • Leonard D. Wade
    • 2
  • Joe Feinglass
    • 1
  • William C. McGaghie
    • 3
  1. 1.Department of MedicineNorthwestern University Feinberg School of MedicineChicago
  2. 2.Department of AnesthesiologyNorthwestern University Feinberg School of MedicineChicagoUSA
  3. 3.Office of Medical Education and Faculty DevelopmentNorthwestern University Feinberg School of MedicineChicagoUSA

Personalised recommendations