Abstract
Background
Health system change requires quality improvement (QI) infrastructure that supports frontline staff implementing sustainable innovations. We created an 8-week rapid-cycle QI training program, Stanford Primary Care-Project Engagement Platform (PC-PEP), open to patient-facing primary care clinicians and staff.
Objective
Examine the feasibility and outcomes of a scalable QI program for busy practicing providers and staff in an academic medical center.
Design
Program evaluation.
Participants
A total of 172 PCPH team members: providers (n = 55), staff (n = 99), and medical learners (n = 18) in the Stanford Division of Primary Care and Population Health (PCPH) clinics, 2018–2021.
Main Measures
We categorized projects by the Institute for Healthcare Improvement’s (IHI) Quintuple Aim (QA): better health, better patient experience, lower cost of care, better care team experience, and improved equity/inclusion. We assessed project progress with a modified version of The Ottawa Hospital Innovation Framework: step 1 (identified root causes), step 2 (designed/tested interventions), step 3 (assessed project outcome), step 4 (met project goal with target group), step 5A (intervention(s) spread within clinic), step 5B (intervention(s) spread to different setting). Participants rated post-participation QI self-efficacy.
Key Results
Within 1000 days, 172 unique participants completed 104 PC-PEP projects. Most projects aimed to improve patient health (55%) or care team experience (23%). Among projects, 9% reached step 1, 8% step 2, 16% step 3, 26% step 4, 21% step 5A, and 20% step 5B. Learner involvement increased likelihood of scholarly products (47% vs 10%). Forty-six of 47 (98%) survey respondents reported improved QI self-efficacy. Medical assistants, more so than physicians, reported feeling acknowledged by the health system for their QI efforts (100% vs 61%).
Conclusions
With appropriate QI infrastructure, scalable QI training models like Stanford PC-PEP can empower frontline workers to create meaningful changes across the IHI QA.
This is a preview of subscription content, access via your institution.


Data Availability
The data that support the findings of this study are available from the corresponding author, AS, upon reasonable request.
References
Adler PS, Riley P, Kwon SW, Signer J, Lee B, Satrasala R. Performance Improvement Capability: Keys to Accelerating Performance Improvement in Hospitals. Calif Manage Rev. 2003;45(2):12-33. doi:https://doi.org/10.2307/41166163
Nundy S, Cooper LA, Mate KS. The Quintuple Aim for Health Care Improvement: A New Imperative to Advance Health Equity. JAMA. 2022;327(6):521-522. doi:https://doi.org/10.1001/jama.2021.25181
Martinez VA, Betts RK, Scruth EA, et al. The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration. Jt Comm J Qual Patient Saf. 2022;48(8):370-375. doi:https://doi.org/10.1016/j.jcjq.2022.05.005
Riveros Perez E, Kerko R, Lever N, White A, Kahf S, Avella-Molano B. Operating room relay strategy for turnover time improvement: a quality improvement project. BMJ Open Qual. 2022;11(3):e001957. doi:https://doi.org/10.1136/bmjoq-2022-001957
Sustaining vs. Disruptive Innovation: What’s the Difference? Business Insights Blog. Published February 3, 2022. Accessed November 4, 2022. https://online.hbs.edu/blog/post/sustaining-vs-disruptive-innovation
Abrahamson V, Jaswal S, Wilson PM. An evaluation of the clinical microsystems approach in general practice quality improvement. Prim Health Care Res Dev. 2020;21:e21. doi:https://doi.org/10.1017/S1463423620000158
Soylu TG, Cuellar AE, Goldberg DG, Kuzel AJ. Engagement of Small to Medium-Sized Primary Care Practices in Quality Improvement Efforts. J Am Board Fam Med. 2021;34(1):40-48. doi:https://doi.org/10.3122/jabfm.2021.01.200153
Brandrud AS, Nyen B, Hjortdahl P, et al. Domains associated with successful quality improvement in healthcare – a nationwide case study. BMC Health Serv Res. 2017;17(1):648. doi:https://doi.org/10.1186/s12913-017-2454-2
Hung DY, Harrison MI, Liang SY, Truong QA. Contextual Conditions and Performance Improvement in Primary Care. Qual Manag Health Care. 2019;28(2):70-77. doi:https://doi.org/10.1097/QMH.0000000000000198
Knight AW, Dhillon M, Smith C, Johnson J. A quality improvement collaborative to build improvement capacity in regional primary care support organisations. BMJ Open Qual. 2019;8(3):e000684. doi:https://doi.org/10.1136/bmjoq-2019-000684
Mills PD, Weeks WB. Characteristics of Successful Quality Improvement Teams: Lessons from Five Collaborative Projects in the VHA. Jt Comm J Qual Saf. 2004;30(3):152-162. doi:https://doi.org/10.1016/S1549-3741(04)30017-1
Kiran T, Ramji N, Derocher MB, Girdhari R, Davie S, Lam-Antoniades M. Ten tips for advancing a culture of improvement in primary care. BMJ Qual Saf. 2019;28(7):582-587. doi:https://doi.org/10.1136/bmjqs-2018-008451
Dye ME, Pugh C, Sala C, et al. Developing a Unit-Based Quality Improvement Program in a Large Neonatal ICU. Jt Comm J Qual Patient Saf. 2021;47(10):654-662. doi:https://doi.org/10.1016/j.jcjq.2021.06.003
Hibbert PD, Basedow M, Braithwaite J, Wiles LK, Clay-Williams R, Padbury R. How to sustainably build capacity in quality improvement within a healthcare organisation: a deep-dive, focused qualitative analysis. BMC Health Serv Res. 2021;21(1):588. doi:https://doi.org/10.1186/s12913-021-06598-8
Pandhi N, Jacobson N, Crowder M, Quanbeck A, Hass M, Davis S. Engaging Patients in Primary Care Quality Improvement Initiatives: Facilitators and Barriers. Am J Med Qual. 2020;35(1):52-62. doi:https://doi.org/10.1177/1062860619842938
Baron AN, Hemler JR, Sweeney SM, et al. Effects of Practice Turnover on Primary Care Quality Improvement Implementation. Am J Med Qual. 2020;35(1):16-22. doi:https://doi.org/10.1177/1062860619844001
Boonyasai RT, Windish DM, Chakraborti C, Feldman LS, Rubin HR, Bass EB. Effectiveness of Teaching Quality Improvement to Clinicians: A Systematic Review. JAMA. 2007;298(9):1023. doi:https://doi.org/10.1001/jama.298.9.1023
Fieldston ES, Jonas JA, Lederman VA, et al. Developing the Capacity for Rapid-Cycle Improvement at a Large Freestanding Children’s Hospital. Hosp Pediatr. 2016;6(8):441-448. doi:https://doi.org/10.1542/hpeds.2015-0239
Larson DB, Mickelsen LJ, Garcia K. Realizing Improvement through Team Empowerment (RITE): A Team-based, Project-based Multidisciplinary Improvement Program. Radiogr Rev Publ Radiol Soc N Am Inc. 2016;36(7):2170–2183. doi:https://doi.org/10.1148/rg.2016160136
Larson DB, Kumar S, Mickelsen LJ, Cordova DA, Faust AN. Program for Supporting Frontline Improvement Projects in an Academic Radiology Department. AJR Am J Roentgenol. 2021;217(1):235-244. doi:https://doi.org/10.2214/AJR.20.23421
Ahmed S. Integrating DMAIC approach of Lean Six Sigma and theory of constraints toward quality improvement in healthcare. Rev Environ Health. 2019;34(4):427-434. doi:https://doi.org/10.1515/reveh-2019-0003
Stanford Medicine Center for Improvement - YouTube. Accessed September 1, 2022. https://www.youtube.com/channel/UCAOLt6khYYc_wcPreIOtd9Q/videos
Hamilton S, Jennings A, Forster AJ. Development and evaluation of a quality improvement framework for healthcare. Int J Qual Health Care. 2020;32(7):456-463. doi:https://doi.org/10.1093/intqhc/mzaa075
Quality Improvement Research Tools. Stanford Medicine Center for Improvement. Accessed August 27, 2023. https://smci.stanford.edu/improvement-research-tools/
Horwitz LI, Kuznetsova M, Jones SA. Creating a Learning Health System through Rapid-Cycle, Randomized Testing. N Engl J Med. 2019;381(12):1175-1179. doi:https://doi.org/10.1056/NEJMsb1900856
Bravata DM, Miech EJ, Myers LJ, et al. The Perils of a “My Work Here is Done” perspective: a mixed methods evaluation of sustainment of an evidence-based intervention for transient ischemic attack. BMC Health Serv Res. 2022;22(1):857. doi:https://doi.org/10.1186/s12913-022-08207-8
Babich LP, Charns MP, McIntosh N, et al. Building Systemwide Improvement Capability: Does an Organization’s Strategy for Quality Improvement Matter? Qual Manag Health Care. 2016;25(2):92-101. doi:https://doi.org/10.1097/QMH.0000000000000089
Morrow E, Robert G, Maben J, Griffiths P. Implementing large-scale quality improvement: Lessons from The Productive Ward: Releasing Time to CareTM. Int J Health Care Qual Assur. 2012;25:237-253. doi:https://doi.org/10.1108/09526861211221464
Flynn R, Hartfield D. An evaluation of a frontline led quality improvement initiative. Leadersh Health Serv Bradf Engl. 2016;29(4):402-414. doi:https://doi.org/10.1108/LHS-11-2015-0039
Taylor EF, Peikes D, Genevro J, Meyers D. Creating Capacity for Improvement in Primary Care: The Case for Developing a Quality Improvement Infrastructure. Rockville, MD: Agency for Healthcare Research and Quality; 2013. Available at https://www.ahrq.gov/sites/default/files/publications/files/pcmhqi1.pdf. Accessed October 11, 2023.
Hespe C, Rychetnik L, Peiris D, Harris M. Informing implementation of quality improvement in Australian primary care. BMC Health Serv Res. 2018;18(1):287. doi:https://doi.org/10.1186/s12913-018-3099-5
Fernholm R, Arvidsson E, Wettermark B. Financial incentives linked to quality improvement projects in Swedish primary care: a model for improving quality of care. BMJ Open Qual. 2019;8(2):e000402. doi:https://doi.org/10.1136/bmjoq-2018-000402
Acknowledgements:
The authors acknowledge the support of the PCPH Division and SHC ambulatory operations leadership for their ongoing support, as well as the engagement, dedication, hard work, and enthusiasm of the Stanford PC-PEP participants.
Funding
This work was supported by the Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest:
The authors declare that they do not have a conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sattler, A., Phadke, A., Mickelsen, J. et al. Catalyzing System Change: 100 Quality Improvement Projects in 1000 Days. J GEN INTERN MED (2023). https://doi.org/10.1007/s11606-023-08431-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11606-023-08431-w