“I Wish I Knew This Before…”: An Implementation Science Primer and Model to Guide Implementation of Simulation Programs in Medical Education
The present chapter addresses an implementation gap identified in the area of simulation-based medical education, where Programs Directors are struggling with how to successfully implement simulation programs in the absence of best practices to guide their efforts (Kurashima and Hirano 2016). Given the increasing complexity of simulation-based education over the past few decades (Roussin and Weinstock 2017) and the recognized need for best practices for implementation (Kurashima and Hirano 2016), we proposed an Adapted Implementation Model for Simulation (AIM-SIM) to guide institutions in their efforts to implement new simulation programs. AIM-SIM is entirely derived from the existing implementation literature by blending three complementary implementation models (process, determinant and outcome models) and applying them to the simulation context. AIM-SIM includes three main implementation phases: (a) stakeholder engagement and context exploration, (b) pre-implementation planning, and (c) program implementation with monitoring and ongoing evaluation. Our overall goal is to increase implementation capacity in simulation-based medical education by offering a systematic approach to program implementation. As such, AIM-SIM is based on evidence from the emerging field of implementation science, which is increasingly used to optimize program implementation and maximize the desired outcomes.
KeywordsImplementation Simulation programs Simulation Medical education Process evaluation Outcome evaluation Implementation science Consolidated framework for implementation research Quality implementation framework Implementation outcomes framework
- Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2012. p. 281–305. https://doi.org/10.1093/acprof:oso/9780199751877.003.0014.CrossRefGoogle Scholar
- Barwick M, Barac R, Zlotkin S. Evaluation of effective implementation of exclusive breastfeeding in Ethiopia and Mali using the Consolidated Framework for Implementation Research. 2015. http://www.can-mnch.ca/wp-content/uploads/2015/05/EBF-Research-Report-FINAL-July-29-2015.pdf. Accessed 1 June 2017.
- Birken SA, Powell BJ, Shea CM, Haines ER, Kirk MA, Leeman J, Rohweder C, Damschroder L, Presseau J. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci. 2017;12:124. https://doi.org/10.1186/s13012-017-0656/y.CrossRefPubMedPubMedCentralGoogle Scholar
- Blase K, Kiser L, Van Dyke M. The hexagon tool: exploring context. Chapel Hill: National Implementation Research Network, FPG Child Development Institute, University of North Carolina at Chapel Hill; 2013. http://implementation.fpg.unc.edu/sites/implementation.fpg.unc.edu/files/resources/NIRN-Education-TheHexagonTool.pdf. Accessed 7 June 2017.
- Chinman M, Hunter S, Ebener P, Paddock SM, Stillman L, Imm P, Wandersman A. The getting to outcomes demonstration and evaluation: an illustration of the prevention support system. Am J Community Psychol. 2008;41(3-4):206–24. https://doi.org/10.1007/s10464-008-9163-2.CrossRefPubMedPubMedCentralGoogle Scholar
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance. 2008. http://www.mrc.ac.uk/complexinterventionsguidance. Accessed 16 July 2004.
- Cristancho S, Hodgson A, Pachev G, Nagy A, Panton N, Qayumi K. Assessing cognitive & motor performance in minimally invasive surgery (MIS) for training & tool design. Stud Health Technol Inform. 2006;119:108–13. http://web.a.ebscohost.com/ehost/pdfviewer/pdfviewer?sid=0f21d238-1186-4b52-807d-7a420aed4e58%40sessionmgr4007&vid=1&hid=4201PubMedGoogle Scholar
- Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentralGoogle Scholar
- Fixsen DL, Blase K. Implementation: the missing link between research and practice. National Implementation Research Network Implementation Brief, 1. Chapel Hill: The University of North Carolina; 2009. http://files.eric.ed.gov/fulltext/ED507422.pdf. Accessed 10 June 2017.
- Fixsen DL, Blase KA, Timbers GD, Wolf MM. In search of program implementation: 792 replications of the teaching-family model. In: Bernfeld GA, Farrington DP, Leschied AW, editors. Offender rehabilitation in practice: implementing and evaluating effective programs. London: Wiley; 2001. p. 149–66.Google Scholar
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute; 2005. http://ctndisseminationlibrary.org/PDF/nirnmonograph.pdf. Accessed 5 June 2017.
- Haji FA, Da Silva C, Daigle DT, Dubrowski A. From bricks to buildings: adapting the Medical Research Council framework to develop programs of research in simulation education and training for the health professions. Simul Healthc. 2014;9(4):249–59. https://doi.org/10.1097/SIH.0000000000000039.CrossRefPubMedGoogle Scholar
- Halle T, Zaslow M, Martinez-Beck I, Metz A. Applications of implementation science to early care and education programs and systems: implications for research, policy, and practice. In: Halle TG, Metz AJ, Martinez-Beck I, editors. Applying implementation science in early childhood programs and systems. Baltimore: Brookes Publishing; 2013. p. 295–314.Google Scholar
- Kirkpatrick DL. Evaluating training programs: the four levels. 2nd ed. San Francisco: Berrett-Koehler Publishers; 1998.Google Scholar
- Mittman B. Partnering for improvement across research, practice, and policy: the case of implementation research in health, presentation. Los Angeles: VA Greater Los Angeles Healthcare System; 2011. http://www.sbm.org/meeting/2011/presentations/thursday/Master%20Lecture%20-%20Brian%20Mittman.pdfGoogle Scholar
- MRC Health Services and Public Health Research Board. A framework for development and evaluation of RCTs for complex interventions to improve health. 2000. https://www.mrc.ac.uk/documents/pdf/rcts-for-complex-interventions-to-improve-health/. Accessed 14 June 2017.
- Pinnock H, Barwick M, Carpenter C, Eldridge S, Grandes G, Griffiths C, Rycroft-Malone J, Meissner P, Murray E, Patel A, Sheikh A, Taylor S. Standards for reporting implementation studies (StaRI) explanation and elaboration document. BMJ Open. 2017a;7(4):e013318. https://doi.org/10.1136/bmjopen-2016-013318.CrossRefPubMedPubMedCentralGoogle Scholar
- Pinnock H, Barwick M, Carpenter C, Eldridge S, Grandes G, Griffiths C, Rycroft-Malone J, Meissner P, Murray E, Patel A, Sheikh A, Taylor S. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017b;356:i6795. https://doi.org/10.1136/bmj.i6795.CrossRefPubMedPubMedCentralGoogle Scholar
- Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Admin Pol Ment Health. 2009;36(1):24–34. https://doi.org/10.1007/s10488–008–0197–4.CrossRefGoogle Scholar
- Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.CrossRefGoogle Scholar
- Stufflebeam DL. CIPP evaluation model checklist. 2007. http://dmeforpeace.org/sites/default/files/Stufflebeam_CIPP%20Evaluation%20Model%20CheCheckl.pdf. Accessed 14 June 2017.
- Varsi C, Ekstedt M, Gammon D, Ruland CM. Using the consolidated framework for implementation research to identify barriers and facilitators for the implementation of an internet-based patient-provider communication service in five settings: a qualitative study. J Med Internet Res. 2015;17(11):e262. https://doi.org/10.2196/jmir.5091.CrossRefPubMedPubMedCentralGoogle Scholar
- Xeroulis GJ, Park J, Moulton CA, Reznick RK, Leblanc V, Dubrowski A. Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery. 2007;141(4):442–9.CrossRefPubMedGoogle Scholar