Surgical Graduate Medical Education Program Accreditation and the Clinical Learning Environment: Patient Safety and Health Care Quality

  • John R. PottsIII
  • Constance K. Haan
  • Kevin B. Weiss


The Accreditation Council for Graduate Medical Education provides accreditation for more than 9000 US residency programs and more than 120,000 residents and fellows. This chapter focuses on the two key activities by which ACGME is seeking to advance the quality of GME around patient safety and health care quality among its programs. The first section of this chapter reviews the evolution of the issue of patient safety and health care quality within its accreditation standards. The second section reviews the rapidly evolving Clinical Learning Environment Review (CLER) program, its formative evaluative design, and how its initial findings are informing the GME community along with their hospital, medical center, and ambulatory care participating sites on how their surgery residents and fellows may better contribute to improving clinical care.


Graduate Medical Education (GME) Postgraduate training Surgical residency requirements Clinical Learning Environment Review (CLER) ACGME (Accreditation Council for Graduate Medical Education) 



The views and opinions expressed in this chapter are those of the authors and do not necessarily reflect the official policy or position of the ACGME.


  1. 1.
    ACGME history. Last accessed 30 Dec 2015.
  2. 2.
  3. 3.
  4. 4.
    Requirements for accreditation of programs. In: ‘81/’82 directory of residency training programs accredited bythe Accreditation Council for Graduate Medical Education. Chicago, IL: American Medical Association; 1981.Google Scholar
  5. 5.
    The essentials of accredited residencies in graduate medical education (Effective: July 1, 1982). In: 1992–1993 directory of graduate medical education programs. Chicago, IL: American Medical Association; 1992.Google Scholar
  6. 6.
    Essentials of accredited residencies in Graduate Medical Education. In: Graduate Medical Education Directory 1994–1995. Chicago, IL: American Medical Association; 1994. P. 14.Google Scholar
  7. 7.
    Essentials of accredited residencies in Graduate Medical Education: Institutional and Program Requirements. In: Graduate Medical Education Directory 1997–1998. Chicago, IL: American Medical Association; 1997. P. 29.Google Scholar
  8. 8.
    ACGME common program requirements effective. 1 July 2002.Google Scholar
  9. 9.
    Philibert I, Barach P. Residents’ hours of work: we need to assess the impact of the new US reforms. BMJ. 2002;325:1184–5.CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    ACGME common program requirements effective. 1 July 2004.Google Scholar
  11. 11.
    ACGME common program requirements effective. 1 July 2007.Google Scholar
  12. 12.
    Nasca TJ, Day SH, Amis ES. The new recommendations on duty hours from the ACGME Task Force. N Engl J Med. 2010;363:e3.CrossRefPubMedGoogle Scholar
  13. 13.
    Ulmer C, Wolman D, Johns M, editors. Resident duty hours: enhancing sleep, supervision, and safety. Washington, DC: National Academies Press; 2008.Google Scholar
  14. 14.
    ACGME common program requirements effective. 1 July 2011.Google Scholar
  15. 15.
    Hesselink G, Schoonhoven L, Barach P, Spijker A, Gademan P, Kalkman C, Liefers J, Vernooij-Dassen M, Wollersheim W. Improving patient handovers from hospital to primary care. A systematic review. Ann Intern Med. 2012;157(6):417–28.CrossRefPubMedGoogle Scholar
  16. 16.
    Sterkenburg A, Barach P, Kalkman C, Ten Cate O. Entrustable educational agents and patient safety. Acad Med. 2010;85:1408–17.CrossRefPubMedGoogle Scholar
  17. 17.
    ACGME requirements for sponsoring institutions. 1 July 2013.Google Scholar
  18. 18.
    Vohra P, Daugherty C, Mohr J, Wen M, Barach P. Housestaff and medical student attitudes towards adverse medical events. JCAHO J Qual Saf. 2007;33:467–76.Google Scholar
  19. 19.
    Accreditation Council for Graduate Medical Education Policies and procedures effective. 1 July 2013. [Subject 16.00].Google Scholar
  20. 20.
    Weiss KB, Wagner R, Nasca TJ. Development, testing, and implementation of the ACGME Clinical Learning Environment Review (CLER) program. J Grad Med Educ. 2012;4:396–8.CrossRefPubMedPubMedCentralGoogle Scholar
  21. 21.
    Cooke NJ, Rosen MA. On teams, teamwork, and team performance: discoveries and developments. Hum Factors. 2008;50(3):540–7.CrossRefPubMedGoogle Scholar
  22. 22.
    Asch DA, Nicholson S, Srinivas S, Herrin J, Epstein AJ. Evaluating obstetrical residency programs using patient outcomes. JAMA. 2009;302(12):1277–83.CrossRefPubMedGoogle Scholar
  23. 23.
    Chen C, Petterson S, Phillips R, Bazemore A, Mullan F. Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries. JAMA. 2014;314:2385–93.CrossRefGoogle Scholar
  24. 24.
    Baker D, Battles J, King H, Salas E, Barach P. The role of teamwork in the professional education of physicians: current status and assessment recommendations. Jt Comm J Qual Patient Saf. 2005;31(4):185–202.CrossRefPubMedGoogle Scholar
  25. 25.
    Lean Enterprise Institute. Principles of lean. Accessed 3 Jan 2016.
  26. 26.
    Barach P, Lipshultz S. The benefits and hazards of publicly reported quality outcomes. Prog Pediatr Cardiol. 2016; 45–9. doi: 10.1016/j.ppedcard.2016.06.001.
  27. 27.
    Sanchez J, Barach P. High reliability organizations and surgical microsystems: re-engineering surgical care. Surg Clin North Am. 2012;92(1):1–14. doi: 10.1016/j.suc.2011.12.005.CrossRefPubMedGoogle Scholar
  28. 28.
    Entin E, Lei F, Barach P. Teamwork skills training for patient safety in the peri-operative environment: a research agenda. Surg Innov. 2006;3:3–13.Google Scholar
  29. 29.
    Wiener E, Kanki B, Helmreich R. Crew resource management. 2nd ed. York, NY: Academic; 2010.Google Scholar
  30. 30.
    Schraagen JM, Schouten A, Smit M, van der Beek D, Van de Ven J, Barach P. A prospective study of paediatric cardiac surgical microsystems: assessing the relationships between non-routine events, teamwork and patient outcomes. BMJ Qual Saf. 2011. doi: 10.1136/bmjqs.2010.048983.PubMedGoogle Scholar
  31. 31.
    Perkins RS, Lehner KA, Armstrong R, Gardiner SK, Karmy-Jones RC, Izenberg SD, Long 3rd WB, Wackym PA. Model for team training using the advanced trauma operative management course: pilot study analysis. J Surg Educ. 2015;72(6):1200–8.CrossRefPubMedGoogle Scholar
  32. 32.
    Reid-Lombardo KM, Glass CC, Marcus SG, Liesinger J, Jones DB, Public Policy and Advocacy Committee of the SSAT. Workforce shortage for general surgeons: results from the Society for Surgery of the Alimentary Track (SSAT) surgeon shortage survey. J Gastrointest Surg. 2014;18(12):2061–73.CrossRefPubMedGoogle Scholar
  33. 33.
    Matthews M, Seguin M, Chowdhury N, Card RT. Generational differences in factors influencing physicians to choose a work location. Rural Remote Health. 2012;12:1864. Accessed 14 April 2016.
  34. 34.
    Barach P. The role of team training and simulation in advanced trauma care. In: Smith C, editor. Trauma care. 2nd ed. New York: Cambridge University Press; 2015. p. 709–23. ISBN-13: 978-1107038264.Google Scholar
  35. 35.
    Barach P. Addressing barriers for change in clinical practice. In: Guidet B, Valentin A, Flaatten H, editors. Quality management in intensive care: a practical guide. Cambridge University Press; 2016. ISBN 978-1-107-50386-1.Google Scholar
  36. 36.
    Weiss KB, Bagian JP. Challenges and opportunities in the six focus areas: CLER National Report of Findings 2016. J Grad Med Educ. 2016;8(2 Suppl 1):25–34.CrossRefPubMedPubMedCentralGoogle Scholar
  37. 37.
    Barach P, Phelps G. Clinical sensemaking: a systematic approach to reduce the impact of normalised deviance in the medical profession. J R Soc Med. 2013;106(10):387–90. doi: 10.1177/0141076813505045.CrossRefPubMedPubMedCentralGoogle Scholar
  38. 38.
    American College of Surgeons. About ACS NSQIP. Accessed 3 Jan 2016.
  39. 39.
    Behrns KE, Ang D, Liu H, Hughes SJ, Creel H, Russin M, Flynn TC. Faculty clinical quality goals drive improvement in University HealthSystem Consortium outcome measures. Am Surg. 2012;78:749–54.Google Scholar
  40. 40.
    Winkley Shroyer AL, Bakaeen F, Shahian DM, Carr BM, Prager RL, Jacobs JP, Ferraris V, Edwards F, Grover FL. The Society of Thoracic Surgeons Adult Cardiac Surgery Database: the driving force for improvement in cardiac surgery. Semin Thorac Cardiovasc Surg. 2015;27:144–51.CrossRefPubMedGoogle Scholar
  41. 41.
    Vener DF, Tirotta CF, Andropoulos D, Barach P. Anaesthetic complications associated with the treatment of patients with congenital cardiac disease: consensus definitions from the Multi-Societal Database Committee for Pediatric and Congenital Heart Disease. Cardiol Young. 2008;18 Suppl 2:271–81.CrossRefPubMedGoogle Scholar
  42. 42.
    Keating NL, Kouri EM, He Y, Freedman RA, Volva R, Zaslavsky AM. Location isn’t everything: proximity, hospital characteristics, choice of hospital, and disparities for breast cancer surgery patients. Health Serv Res. 2016;51:1561–83. doi: 10.1111/1475-6773.12443 [Epub ahead of print].CrossRefPubMedGoogle Scholar
  43. 43.
    Butler PD, Nelson JA, Fischer JP, Wink JD, Chang B, Fosnot J, Wu LC, Serletti JM. Racial and age disparities persist in immediate breast reconstruction: an updated analysis of 48,564 patients from the 2005 to 2011 American College of Surgeons National Surgery Quality Improvement Program data sets. Am J Surg. 2016;212(1):96–101. doi: 10.1016/j.amjsurg.2015.08.025. pii: S0002-9610(15)00555-3. [Epub ahead of print].CrossRefPubMedGoogle Scholar
  44. 44.
    Witt WP, Coffey RM, Lopez-Gonzalez L, Barrett ML, Moore BJ, Andrews RM, Washington RE. Understanding racial and ethnic disparities in postsurgical complications occurring in US hospitals. Health Serv Res. 2016. doi: 10.1111/1475-6773.12475 [Epub ahead of print].PubMedGoogle Scholar
  45. 45.
    Groene RO, Orrego C, Suñol R, Barach P, Groene O. “It’s like two worlds apart”: an analysis of vulnerable patient handover practices at discharge from hospital. BMJ Qual Saf. 2012;0:1–9. doi:10.1136/bmjqs-2012-001174.Google Scholar
  46. 46.
    Wagner R, Koh NJ, Patow C, Newton R, Casey BR, Weiss KB. Detailed Findings from the CLER National Report of Findings 2016. J Grad Med Educ. 2016;8(2 Suppl 1):35–54.CrossRefPubMedPubMedCentralGoogle Scholar
  47. 47.
    Barach P, Small DS. Reporting and preventing medical mishaps: lessons from non-medical near miss reporting systems. Br Med J. 2000;320:753–63.Google Scholar
  48. 48.
    Weiss KB, Bagian JP, Wagner R, Nasca TJ. Introducing the CLER pathways to excellence: a new way of viewing clinical learning environments. J Grad Med Educ. 2014;6:608–9.CrossRefPubMedPubMedCentralGoogle Scholar
  49. 49.
    Levinson DR. Hospital incident reporting systems do not capture most patient harm. Washington, DC: US Department of Health and Human Services, Office of the Inspector General; 2012.Google Scholar
  50. 50.
    National Patient Safety Foundation. RCA2: improving root cause analysis and action to prevent harm. Boston, MA: National Patient Safety Foundation; 2015.Google Scholar
  51. 51.
    AHRQ. The role of the patient in safety. Patient Safety Primer. Accessed 13 Apr 2016.
  52. 52.
    Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161–7.CrossRefPubMedGoogle Scholar
  53. 53.
    Flynn-O’Brien KT, Mandell SP, Eaton EV, Schlever AM, McIntyre LK. Surgery and medicine residents’ perspectives of morbidity and mortality conference: an interdisciplinary approach to improve ACGME core competency compliance. J Surg Educ. 2015;72(6):e258–66.CrossRefPubMedGoogle Scholar
  54. 54.
    VA National Center for Patient Safety. Root cause analysis tools. US Department of Veterans Affairs. Accessed 13 Dec 2015.
  55. 55.
    Johnson J, Barach P. Quality improvement methods to study and improve the process and outcomes of pediatric cardiac surgery. Prog Pediatr Cardiol. 2011;32:147–53.CrossRefGoogle Scholar
  56. 56.
    Berwick D, Boufford J, Delbanco T, Edgman-Levitan S, Griffith D, Neuberger J, Ollenschlaeger G, Picker H, Plamping D, Rockefeller R. Through the patient’s eyes: collaboration between patients and health care professionals. Salzburg Global Seminar, Session 356, May 23–30, 1998, Salzburg, Austria.Google Scholar
  57. 57.
    Barach P, Cantor M. Adverse event disclosure: benefits and drawbacks for patients and clinicians. In: Clarke S, Oakley J, editors. The ethics of auditing and reporting surgeon performance. New York: Cambridge Press; 2007. p. 76–91.Google Scholar
  58. 58.
    Karamichalis J, Barach P, Henaine R, Nido del P, Bacha E. Assessment of surgical competency in pediatric cardiac surgery. Prog Pediatr Cardiol. 2012; 33:115–20. doi:20110.1016/j.ppedcard.2011.12.003.Google Scholar
  59. 59.
    Langley GL, Moen R, Nolan KM, Nolan TW, Norman CL, Provost LP. The improvement guide: a practical approach to enhancing organizational performance. 2nd ed. San Francisco: Jossey-Bass Publishers; 2009. Accessed 13 Dec 2015.Google Scholar
  60. 60.
    Nelson EC, Mohr JJ, Batalden PB, Plume SK. Improving health care, part 1: the clinical value compass. Jt Comm J Qual Improv. 1996;22:243–58.PubMedGoogle Scholar
  61. 61.
    Mohr JJ, Barach P, Cravero JP, Blike GT, Godfrey MM, Batalden PB, Nelson EC. Microsystems in health care: part 6. Designing patient safety in microsystems. Jt Comm J Qual Saf. 2003;29:401–8.CrossRefPubMedGoogle Scholar
  62. 62.
    Kreideit A, Kalkman C, Barach P. Role of handwashing and perioperative infections. Br J Anesth. 2011. doi: 10.1093/bja/aer162.Google Scholar
  63. 63.
    Munday GS, Deveaux P, Roberts H, Fry DE, Polk HC. Impact of implementation of the Surgical Care Improvement Project and future strategies for improving quality in surgery. Am J Surg. 2014;208(5):835–40.CrossRefPubMedGoogle Scholar
  64. 64.
    Scott AV, Stonemetz JL, Wasey JO, Johnson DJ, Rivers RJ, Koch CG, Frank SM. Compliance with Surgical Care Improvement Project for body temperature management (SCIP Inf-10) is associated with improved clinical outcomes. Anesthesiology. 2015;123:116–25.CrossRefPubMedGoogle Scholar
  65. 65.
    The Joint Commission. Sentinel event data—root causes by event type, 2004-3Q2015. Accessed 13 Dec 2015.
  66. 66.
    Lee JI, Cutugno C, Pickering SP, Press MJ, Richardson JE, Unterbrink M, Kelser ME, Evans AT. The patient care circle: a descriptive framework for understanding care transitions. J Hosp Med. 2013;8:619–26.CrossRefPubMedPubMedCentralGoogle Scholar
  67. 67.
    Cassin B, Barach P. Making sense of root cause analysis investigations of surgery-related adverse events. Surg Clin North Am. 2012;92:101–15. doi: 10.1016/j.suc.2011.12.008.CrossRefPubMedGoogle Scholar
  68. 68.
    Toccafondi G, Albolino S, Tartaglia R, Guidi S, Molisso A, Venneri F, Peris A, Pieralli F, Magnelli E, Librenti M, Morelli M, Barach P. The collaborative communication model for patient handover at the interface between high-acuity and low-acuity care. BMJ Qual Saf. 2012. doi: 10.1136/bmjqs-2012-001178.
  69. 69.
    Flink M, Hesselink G, Barach P, Öhlén G, Wollersheim H, Pijneborg L, Hansagi H, Vernooij-Dassen M, Olsson M. The key actor: a qualitative study of patient participation in the handover process in Europe. BMJ Qual Saf. 2012;21 Suppl 1:i89–96. doi: 10.1136/bmjqs-2012-001171. Epub 2012 Oct 30.CrossRefPubMedPubMedCentralGoogle Scholar
  70. 70.
    Steuffert S, Satish U, Barach P. Improving medical care: the use of simulation technology. Simul Gaming. 2001;32:164–71.CrossRefGoogle Scholar
  71. 71.
    Choo KJ, Arora VM, Barach P, Johnson JK, Farnan JM. How do supervising physicians decide to entrust residents with unsupervised tasks? A qualitative analysis. J Hosp Med. 2014;9:169–75. doi: 10.1002/jhm.2150.CrossRefPubMedGoogle Scholar
  72. 72.
    Poulose BK, Ray WA, Arbogast PG, Needleman J, Buerhaus PI, Griffin MR, Abumrad NN, Beauchamp RD, Holzman MD. Resident work hour limits and patient safety. Ann Surg. 2005;241(6):847–56.CrossRefPubMedPubMedCentralGoogle Scholar
  73. 73.
    Shelton J, Kummerow K, Phillips S, Arbogast PG, Griffin M, Holzman MD, Nealong W, Poulose BK. Patient safety in the era of the 80-hour workweek. J Surg Educ. 2014;71:551–9.CrossRefPubMedPubMedCentralGoogle Scholar
  74. 74.
    Yaghoubian A, Kaji AH, Ishaque B, Park J, Rosing DK, Lee S, Stabile BE, deVirgilio C. Acute care surgery performed by sleep deprived residents: are outcomes affected? J Surg Res. 2010;163:192–6.CrossRefPubMedGoogle Scholar
  75. 75.
    Bilimoria KY, Chung JW, Hedges LV, et al. National cluster-randomized trial of duty-hour flexibility in surgical training. N Engl J Med. 2016;374(8):713–27.CrossRefPubMedGoogle Scholar
  76. 76.
    Eckleberry-Hunt J, Lick D, Boura J, Hunt R, Balasubramaniam M, Mulhem E, Fisher C. An exploratory study of resident burnout and wellness. Acad Med. 2009;84:269–77.CrossRefPubMedGoogle Scholar
  77. 77.
    Ishak WW, Lederer S, Mandili C, Nikravesh R, Seligman L, Vasa M, Ogunyemi D, Bernstein CA. Burnout during residency training: a literature review. J Grad Med Educ. 2009;1(2):236–42.CrossRefPubMedPubMedCentralGoogle Scholar
  78. 78.
    Shanafelt TD, Oreskovich MR, Dyrbye LN, Satele DV, Hanks JB, Sloan JA, Balch CM. Avoiding burnout: the personal health habits and wellness practices of US surgeons. Ann Surg. 2012;255(4):625–33.CrossRefPubMedGoogle Scholar
  79. 79.
    Dimou FM, Eckelbarger D, Riall TS. Surgeon burnout: a systematic review. J Am Coll Surg. 2016;222:1230–9. doi: 10.1016/j.jamcollsurg.2016.03.022.CrossRefPubMedGoogle Scholar
  80. 80.
    Dyrbye LN, West CP, Satele D, Boone S, Tan L, Sloan J, Shanafelt TD. Burnout among US medical students, residents, and early career physicians relative to the general US population. Acad Med. 2014;89:443–51.CrossRefPubMedGoogle Scholar
  81. 81.
    Shanafelt TD, Balch CM, Bechamps GJ, Russell T, Dyrbye L, Satele D, Collicott P, Novotny PJ, Sloan J, Freischlag JA. Burnout and career satisfaction among American surgeons. Ann Surg. 2009;250(3):463–71.PubMedGoogle Scholar
  82. 82.
    Shanafelt TD, Boon S, Tan L, Dyrbye LN, Sotile W, Satele D, West CP, Sloan J, Oreskovich MR. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377–85.CrossRefPubMedGoogle Scholar
  83. 83.
    Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory manual. 3rd ed. Palo Alto, CA: Consulting Psychologists Press; 1996.Google Scholar
  84. 84.
    Winlaw D, Large M, Barach P. Leadership, surgeon well-being and other non-technical aspects of pediatric cardiac surgery. Prog Pediatr Cardiol. 2011;2011(32):129–33.CrossRefGoogle Scholar
  85. 85.
    Agency for Healthcare Research and Quality. TeamSTEPPS 2.0 essentials course: team strategies & tools to enhance performance and patient safety. Accessed 3 Jan 2016.
  86. 86.
    Goldsmith M. What got you here won’t get you there: how successful people become even more successful! New York: Hyperion; 2007.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2017

Authors and Affiliations

  • John R. PottsIII
    • 1
  • Constance K. Haan
    • 2
  • Kevin B. Weiss
    • 1
    • 2
    • 3
  1. 1.Division of Accreditation Services, Accreditation Council for Graduate Medical EducationChicagoUSA
  2. 2.Clinical Learning Environment Review (CLER) Program, Accreditation Council for Graduate Medical EducationChicagoUSA
  3. 3.Department of Medicine and Center for Healthcare Studies, Northwestern University Feinberg School of MedicineChicagoUSA

Personalised recommendations