Skip to main content
Log in

Catalyzing System Change: 100 Quality Improvement Projects in 1000 Days

  • Original Research
  • Published:
Journal of General Internal Medicine Aims and scope Submit manuscript
  • 1 Altmetric

Abstract

Background

Health system change requires quality improvement (QI) infrastructure that supports frontline staff implementing sustainable innovations. We created an 8-week rapid-cycle QI training program, Stanford Primary Care-Project Engagement Platform (PC-PEP), open to patient-facing primary care clinicians and staff.

Objective

Examine the feasibility and outcomes of a scalable QI program for busy practicing providers and staff in an academic medical center.

Design

Program evaluation.

Participants

A total of 172 PCPH team members: providers (n = 55), staff (n = 99), and medical learners (n = 18) in the Stanford Division of Primary Care and Population Health (PCPH) clinics, 2018–2021.

Main Measures

We categorized projects by the Institute for Healthcare Improvement’s (IHI) Quintuple Aim (QA): better health, better patient experience, lower cost of care, better care team experience, and improved equity/inclusion. We assessed project progress with a modified version of The Ottawa Hospital Innovation Framework: step 1 (identified root causes), step 2 (designed/tested interventions), step 3 (assessed project outcome), step 4 (met project goal with target group), step 5A (intervention(s) spread within clinic), step 5B (intervention(s) spread to different setting). Participants rated post-participation QI self-efficacy.

Key Results

Within 1000 days, 172 unique participants completed 104 PC-PEP projects. Most projects aimed to improve patient health (55%) or care team experience (23%). Among projects, 9% reached step 1, 8% step 2, 16% step 3, 26% step 4, 21% step 5A, and 20% step 5B. Learner involvement increased likelihood of scholarly products (47% vs 10%). Forty-six of 47 (98%) survey respondents reported improved QI self-efficacy. Medical assistants, more so than physicians, reported feeling acknowledged by the health system for their QI efforts (100% vs 61%).

Conclusions

With appropriate QI infrastructure, scalable QI training models like Stanford PC-PEP can empower frontline workers to create meaningful changes across the IHI QA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author, AS, upon reasonable request.

References

  1. Adler PS, Riley P, Kwon SW, Signer J, Lee B, Satrasala R. Performance Improvement Capability: Keys to Accelerating Performance Improvement in Hospitals. Calif Manage Rev. 2003;45(2):12-33. doi:https://doi.org/10.2307/41166163

    Article  Google Scholar 

  2. Nundy S, Cooper LA, Mate KS. The Quintuple Aim for Health Care Improvement: A New Imperative to Advance Health Equity. JAMA. 2022;327(6):521-522. doi:https://doi.org/10.1001/jama.2021.25181

    Article  PubMed  Google Scholar 

  3. Martinez VA, Betts RK, Scruth EA, et al. The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration. Jt Comm J Qual Patient Saf. 2022;48(8):370-375. doi:https://doi.org/10.1016/j.jcjq.2022.05.005

    Article  PubMed  Google Scholar 

  4. Riveros Perez E, Kerko R, Lever N, White A, Kahf S, Avella-Molano B. Operating room relay strategy for turnover time improvement: a quality improvement project. BMJ Open Qual. 2022;11(3):e001957. doi:https://doi.org/10.1136/bmjoq-2022-001957

    Article  PubMed  PubMed Central  Google Scholar 

  5. Sustaining vs. Disruptive Innovation: What’s the Difference? Business Insights Blog. Published February 3, 2022. Accessed November 4, 2022. https://online.hbs.edu/blog/post/sustaining-vs-disruptive-innovation

  6. Abrahamson V, Jaswal S, Wilson PM. An evaluation of the clinical microsystems approach in general practice quality improvement. Prim Health Care Res Dev. 2020;21:e21. doi:https://doi.org/10.1017/S1463423620000158

    Article  PubMed  PubMed Central  Google Scholar 

  7. Soylu TG, Cuellar AE, Goldberg DG, Kuzel AJ. Engagement of Small to Medium-Sized Primary Care Practices in Quality Improvement Efforts. J Am Board Fam Med. 2021;34(1):40-48. doi:https://doi.org/10.3122/jabfm.2021.01.200153

    Article  PubMed  Google Scholar 

  8. Brandrud AS, Nyen B, Hjortdahl P, et al. Domains associated with successful quality improvement in healthcare – a nationwide case study. BMC Health Serv Res. 2017;17(1):648. doi:https://doi.org/10.1186/s12913-017-2454-2

    Article  PubMed  PubMed Central  Google Scholar 

  9. Hung DY, Harrison MI, Liang SY, Truong QA. Contextual Conditions and Performance Improvement in Primary Care. Qual Manag Health Care. 2019;28(2):70-77. doi:https://doi.org/10.1097/QMH.0000000000000198

    Article  PubMed  Google Scholar 

  10. Knight AW, Dhillon M, Smith C, Johnson J. A quality improvement collaborative to build improvement capacity in regional primary care support organisations. BMJ Open Qual. 2019;8(3):e000684. doi:https://doi.org/10.1136/bmjoq-2019-000684

    Article  PubMed  PubMed Central  Google Scholar 

  11. Mills PD, Weeks WB. Characteristics of Successful Quality Improvement Teams: Lessons from Five Collaborative Projects in the VHA. Jt Comm J Qual Saf. 2004;30(3):152-162. doi:https://doi.org/10.1016/S1549-3741(04)30017-1

    Article  PubMed  Google Scholar 

  12. Kiran T, Ramji N, Derocher MB, Girdhari R, Davie S, Lam-Antoniades M. Ten tips for advancing a culture of improvement in primary care. BMJ Qual Saf. 2019;28(7):582-587. doi:https://doi.org/10.1136/bmjqs-2018-008451

    Article  PubMed  Google Scholar 

  13. Dye ME, Pugh C, Sala C, et al. Developing a Unit-Based Quality Improvement Program in a Large Neonatal ICU. Jt Comm J Qual Patient Saf. 2021;47(10):654-662. doi:https://doi.org/10.1016/j.jcjq.2021.06.003

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hibbert PD, Basedow M, Braithwaite J, Wiles LK, Clay-Williams R, Padbury R. How to sustainably build capacity in quality improvement within a healthcare organisation: a deep-dive, focused qualitative analysis. BMC Health Serv Res. 2021;21(1):588. doi:https://doi.org/10.1186/s12913-021-06598-8

    Article  PubMed  PubMed Central  Google Scholar 

  15. Pandhi N, Jacobson N, Crowder M, Quanbeck A, Hass M, Davis S. Engaging Patients in Primary Care Quality Improvement Initiatives: Facilitators and Barriers. Am J Med Qual. 2020;35(1):52-62. doi:https://doi.org/10.1177/1062860619842938

    Article  PubMed  Google Scholar 

  16. Baron AN, Hemler JR, Sweeney SM, et al. Effects of Practice Turnover on Primary Care Quality Improvement Implementation. Am J Med Qual. 2020;35(1):16-22. doi:https://doi.org/10.1177/1062860619844001

    Article  PubMed  Google Scholar 

  17. Boonyasai RT, Windish DM, Chakraborti C, Feldman LS, Rubin HR, Bass EB. Effectiveness of Teaching Quality Improvement to Clinicians: A Systematic Review. JAMA. 2007;298(9):1023. doi:https://doi.org/10.1001/jama.298.9.1023

    Article  CAS  PubMed  Google Scholar 

  18. Fieldston ES, Jonas JA, Lederman VA, et al. Developing the Capacity for Rapid-Cycle Improvement at a Large Freestanding Children’s Hospital. Hosp Pediatr. 2016;6(8):441-448. doi:https://doi.org/10.1542/hpeds.2015-0239

    Article  PubMed  Google Scholar 

  19. Larson DB, Mickelsen LJ, Garcia K. Realizing Improvement through Team Empowerment (RITE): A Team-based, Project-based Multidisciplinary Improvement Program. Radiogr Rev Publ Radiol Soc N Am Inc. 2016;36(7):2170–2183. doi:https://doi.org/10.1148/rg.2016160136

  20. Larson DB, Kumar S, Mickelsen LJ, Cordova DA, Faust AN. Program for Supporting Frontline Improvement Projects in an Academic Radiology Department. AJR Am J Roentgenol. 2021;217(1):235-244. doi:https://doi.org/10.2214/AJR.20.23421

    Article  PubMed  Google Scholar 

  21. Ahmed S. Integrating DMAIC approach of Lean Six Sigma and theory of constraints toward quality improvement in healthcare. Rev Environ Health. 2019;34(4):427-434. doi:https://doi.org/10.1515/reveh-2019-0003

    Article  PubMed  Google Scholar 

  22. Stanford Medicine Center for Improvement - YouTube. Accessed September 1, 2022. https://www.youtube.com/channel/UCAOLt6khYYc_wcPreIOtd9Q/videos

  23. Hamilton S, Jennings A, Forster AJ. Development and evaluation of a quality improvement framework for healthcare. Int J Qual Health Care. 2020;32(7):456-463. doi:https://doi.org/10.1093/intqhc/mzaa075

    Article  PubMed  PubMed Central  Google Scholar 

  24. Quality Improvement Research Tools. Stanford Medicine Center for Improvement. Accessed August 27, 2023. https://smci.stanford.edu/improvement-research-tools/

  25. Horwitz LI, Kuznetsova M, Jones SA. Creating a Learning Health System through Rapid-Cycle, Randomized Testing. N Engl J Med. 2019;381(12):1175-1179. doi:https://doi.org/10.1056/NEJMsb1900856

    Article  PubMed  Google Scholar 

  26. Bravata DM, Miech EJ, Myers LJ, et al. The Perils of a “My Work Here is Done” perspective: a mixed methods evaluation of sustainment of an evidence-based intervention for transient ischemic attack. BMC Health Serv Res. 2022;22(1):857. doi:https://doi.org/10.1186/s12913-022-08207-8

    Article  PubMed  PubMed Central  Google Scholar 

  27. Babich LP, Charns MP, McIntosh N, et al. Building Systemwide Improvement Capability: Does an Organization’s Strategy for Quality Improvement Matter? Qual Manag Health Care. 2016;25(2):92-101. doi:https://doi.org/10.1097/QMH.0000000000000089

    Article  PubMed  Google Scholar 

  28. Morrow E, Robert G, Maben J, Griffiths P. Implementing large-scale quality improvement: Lessons from The Productive Ward: Releasing Time to CareTM. Int J Health Care Qual Assur. 2012;25:237-253. doi:https://doi.org/10.1108/09526861211221464

    Article  PubMed  Google Scholar 

  29. Flynn R, Hartfield D. An evaluation of a frontline led quality improvement initiative. Leadersh Health Serv Bradf Engl. 2016;29(4):402-414. doi:https://doi.org/10.1108/LHS-11-2015-0039

    Article  PubMed  Google Scholar 

  30. Taylor EF, Peikes D, Genevro J, Meyers D. Creating Capacity for Improvement in Primary Care: The Case for Developing a Quality Improvement Infrastructure. Rockville, MD: Agency for Healthcare Research and Quality; 2013. Available at https://www.ahrq.gov/sites/default/files/publications/files/pcmhqi1.pdf. Accessed October 11, 2023.

  31. Hespe C, Rychetnik L, Peiris D, Harris M. Informing implementation of quality improvement in Australian primary care. BMC Health Serv Res. 2018;18(1):287. doi:https://doi.org/10.1186/s12913-018-3099-5

    Article  PubMed  PubMed Central  Google Scholar 

  32. Fernholm R, Arvidsson E, Wettermark B. Financial incentives linked to quality improvement projects in Swedish primary care: a model for improving quality of care. BMJ Open Qual. 2019;8(2):e000402. doi:https://doi.org/10.1136/bmjoq-2018-000402

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements:

The authors acknowledge the support of the PCPH Division and SHC ambulatory operations leadership for their ongoing support, as well as the engagement, dedication, hard work, and enthusiasm of the Stanford PC-PEP participants.

Funding

This work was supported by the Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amelia Sattler MD.

Ethics declarations

Conflict of Interest:

The authors declare that they do not have a conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 67 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sattler, A., Phadke, A., Mickelsen, J. et al. Catalyzing System Change: 100 Quality Improvement Projects in 1000 Days. J GEN INTERN MED 39, 940–950 (2024). https://doi.org/10.1007/s11606-023-08431-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11606-023-08431-w

KEY WORDS

Navigation