Abstract
Despite advances in evidence-based practices (EBP) to support HIV prevention and treatment, youth ages 13–24 experience significant disparities in HIV risk and outcomes. An important factor in this disparity is poor EBP implementation, yet implementation research is limited, particularly in youth-serving settings. This study used the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to guide the implementation of four Motivational Interviewing (MI) and MI-framed interventions into youth-serving HIV prevention and treatment settings. Key stakeholders (n = 153) across 13 sites completed pre-implementation interviews. Stakeholders’ comments identified two critical factors for effective implementation: fit with the patient population and provider receptivity, including concerns about scope of practice, buy-in, and time. Stakeholders recommended strategies for structuring training, fidelity monitoring, and facilitating implementation including engaging informal leaders, collaboratively developing the implementation strategy, and site-wide implementation. Results highlight the importance of pre-implementation contextual assessment and strategic planning for identifying provider concerns and developing responsive implementation strategies.
RESUMEN
A pesar de los avances en las prácticas basadas en evidencia (EBP, por sus siglas en inglés) para apoyar la prevención y el tratamiento del VIH, los jóvenes de 13 a 24 años atraviesan disparidades significativas en el riesgo y los desenlaces del VIH. Un factor importante en esta disparidad es la implementación deficiente de las EBP, aunque la investigación sobre la implementación es limitada, particularmente en entornos que atienden a jóvenes. Este estudio utilizó el marco de Exploración, Preparación, Implementación, Mantenimiento (EPIS) para guiar la implementación de cuatro entrevistas motivacionales (MI) e intervenciones enmarcadas en MI en entornos de prevención y tratamiento del VIH que atienden a jóvenes. Las partes interesadas clave (n = 153) en 13 sitios completaron las entrevistas previas a la implementación. Los comentarios de las partes interesadas identificaron dos factores críticos para una implementación efectiva: idoneidad para la población de pacientes y receptividad de los proveedores, incluidas las preocupaciones sobre el alcance de la práctica, la aceptación y el tiempo. Las partes interesadas recomendaron estrategias para estructurar la capacitación, monitorear la fidelidad, y facilitar la implementación, incluyendo la participación de líderes informales, el desarrollo colaborativo de la estrategia de implementación y la implementación en todo el sitio. Los resultados destacan la importancia de la evaluación contextual previa a la implementación y la planificación estratégica para identificar las preocupaciones de los proveedores y desarrollar estrategias de implementación que respondan a ellas.
Similar content being viewed by others
Data Availability
N/A.
Code Availability
Not applicable.
Notes
Stakeholders with the same role identification are numbered in order of appearance in the manuscript
References
Centers for Disease Control and Prevention. Estimated HIV incidence and prevalence in the United States, 2015–2019. Georgia: Centers for Disease Control and Prevention (CDC), U.S. Department of Health and Human Services; Atlanta; 2021.
Centers for Disease Control and Prevention. Monitoring selected national HIV prevention and care objectives by using HIV surveillance data—United States and 6 dependent areas. 2019. Atlanta, Georgia: Centers for Disease Control and Prevention (CDC), U.S. Department of Health and Human Services; 2021.
Fauci AS, Redfield RR, Sigounas G, Weahkee MD, Giroir BP. Ending the HIV epidemic: A plan for the United States. JAMA. 2019;321(9):844–5.
Li Z, Purcell DW, Sansom SL, Hayes D, Hall HI. Vital signs: HIV transmission along the continuum of care-United States, 2016. MMWR Surveill Summ. 2019;68(11):267–72.
Mark D, Geng E, Vorkoper S, et al. Making implementation science work for children and adolescents living with HIV. J Acquir Immune Defic Syndr. 2018;78(Suppl 1(1):58–62.
Zhang C, McMahon J, Fiscella K, et al. HIV pre-exposure prophylaxis implementation cascade among health care professionals in the United States: Implications from a systematic review and meta-analysis. AIDS Patient Care STDS. 2019;33(12):507–27.
Simoni JM, Aunon FM, Kemp CG, et al. Implementation research on HIV adherence interventions: No time to wait. Lancet Infect Dis. 2017;17(6):564–5.
Kemp CG, Velloza J. Implementation of eHealth interventions across the HIV care cascade: A review of recent research. Curr HIV/AIDS Rep. 2018;15(6):403–13.
Norton WE, Amico KR, Cornman DH, Fisher WA, Fisher JD. An agenda for advancing the science of implementation of evidence-based HIV prevention interventions. AIDS Behav. 2009;13(3):424–9.
Office of AIDS Research. Update: NIH HIV/AIDS research priorities and guidelines for determining HIV/AIDS funding. National Institute of Health; 2019.
Smith JD, Li DH, Hirschhorn LR, et al. Landscape of HIV implementation research funded by the National Institutes of Health: A mapping review of project abstracts. AIDS Behav. 2020;24(6):1903–11.
Lane-Fall MB, Curran GM, Beidas RS. Scoping implementation science for the beginner: Locating yourself on the “subway line” of translational research. BMC Med Res Methodol. 2019;19(1):133.
Piper KN, Haardörfer R, Escoffery C, Sheth AN, Sales J. Exploring the heterogeneity of factors that may influence implementation of PrEP in family planning clinics: A latent profile analysis. Implement Sci Commun. 2021;2(1):48.
Butame SA, Idalski Carcone A, Coyle K, Naar S. Implementation of evidence-based practices to reduce youth HIV transmission and improve self-management: A survey of key stakeholder perspectives. AIDS Patient Care STDs. 2021 2021;35(10):385–391.
Nagy SM, Butame SA, Todd L, et al. Barriers and facilitators to implementing a motivational interviewing-based intervention: A multi-site study of organizations caring for youth living with HIV. Aids Care. 2021:1–6.
Zulkiewicz BA, Burrus O, Harshbarger C, Ortiz A, Garner BR, Lewis MA. Identifying implementation strategies that address barriers and facilitate implementation of digital interventions in HIV primary care settings: Results from the pilot implementation of Positive Health Check. AIDS Behav. 2021/01/01 2021;25(1):154–166.
Shangani S, Bhaskar N, Richmond N, Operario D, van den Berg JJ. A systematic review of early adoption of implementation science for HIV prevention or treatment in the United States. AIDS. 2021;35(2):177–91.
Davis M, Beidas RS. Refining contextual inquiry to maximize generalizability and accelerate the implementation process. Implement Res Pract. 2021;2:1–4.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health Ment Health Serv Res. 2011;38(1):4–23.
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci Jan. 2019;5(1):1. 14(.
Aarons GA, Fettes DL, Hurlburt MS, et al. Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. J Clin Child Adolesc Psychol. 2014;43(6):915–28.
Aarons GA, Green AE, Trott E, et al. The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Adm Policy Ment Health Ment Health Serv Res November. 2016;01(6):991–1008.
Aarons GA, Green AE, Willging CE, et al. Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implement Sci. 2014;9(1):1–12.
Becan JE, Bartkowski JP, Knight DK, et al. A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study. Health Justice April. 2018;13(1):1–14.
Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. J Am Acad Child Adolesc Psychiatry. 2013;52(10):1009–25. e1018.
Brookman-Frazee L, Stahmer AC. Effectiveness of a multi-level implementation strategy for ASD interventions: Study protocol for two linked cluster randomized trials. Implement Sci. 2018;13(1):1–14.
Addison D, Baim-Lance A, Suchman L, et al. Factors influencing the successful implementation of HIV linkage and retention interventions in healthcare agencies across New York state. AIDS Behav 2019/01/01. 2019;23(1):105–14.
Donenberg GR, Cohen MH, Ingabire C, et al. Applying the Exploration Preparation Implementation Sustainment (EPIS) Framework to the Kigali Imbereheza Project for Rwandan adolescents living with HIV. J Acquir Immune Defic Syndr. 2019;82:289–98.
Garner BR, Zehner M, Roosa MR, et al. Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: Study protocol for a cluster randomized trial. Addict Sci Clin Pract. 2017;12(1):32–2.
Naar S, MacDonell K, Chapman JE, et al. Testing a Motivational Interviewing implementation intervention in adolescent HIV clinics: Protocol for a type 3, hybrid implementation-effectiveness trial. JMIR Res Protoc. 2019;8(6):e11200.
Miller WR, Rollnick S. Motivational Interviewing: Helping people change. Third ed. New York: The Guilford Press; 2012.
Hettema JE, Miller WR, Steele JM. A meta-analysis of motivational interviewing techniques in the treatment of alcohol use disorders. Alcohol Clin Exp Res. 2004;28:74A.
Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A meta-analysis of Motivational Interviewing: Twenty-five years of empirical studies. Res Soc Work Pract. 2010;20(2):137–60.
Lundahl B, Moleni T, Burke BL, et al. Motivational Interviewing in medical care settings: A systematic review and meta-analysis of randomized controlled trials. Patient Educ Couns Nov. 2013;93(2):157–68.
Parsons JT, Starks T, Gurung S, Cain D, Marmo J, Naar S. Clinic-based delivery of the Young Men’s Health Project (YMHP) targeting HIV risk reduction and substance use among young men who have sex with men: Protocol for a type 2, hybrid implementation-effectiveness trial. JMIR Res Protoc. 2019;8(5):e11184.
Starks TJ, Feldstein Ewing SW, Lovejoy T, et al. Adolescent male couples-based HIV testing intervention (We Test): Protocol for a type 1, hybrid implementation-effectiveness trial. JMIR Res Protoc. 2019;8(6):e11186.
Belzer ME, Macdonell KK, Ghosh S, et al. Adaptive antiretroviral therapy adherence interventions for youth living with HIV through text message and cell phone support with and without incentives: Protocol for a sequential multiple assignment randomized trial (SMART). JMIR Res Protoc. 2018;7(12):e11183.
Idalski Carcone A, Coyle K, Gurung S, et al. Implementation science research examining the integration of evidence-based practices into HIV prevention and clinical care: Protocol for a mixed-methods study using the Exploration, Preparation, Implementation, and Sustainment (EPIS) Model. JMIR Res Protoc. 2019/05/23 2019;8(5):e11202.
Aarons GA, Green AE, Palinkas LA, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7(1):32–41.
Amico K. Interviewer Training Intensive Tool v1: Scribd; 2015.
Willging CE, Green AE, Gunderson L, Chaffin M, Aarons GA. From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreat. 2015/02// 2015;20(1):24–36.
Willging CE, Sommerfeld DH, Aarons GA, Waitzkin H. The effects of behavioral health reform on safety-net institutions: A mixed-method assessment in a rural state. Adm Policy Ment Health Ment Health Serv Res March. 2014;01(2):276–91.
Knight DK, Belenko S, Wiley T, et al. Juvenile Justice—Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS): A cluster randomized trial targeting system-wide improvement in substance use services. Implement Sci. 2015;11(1):1–18.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res Nov. 2005;15(9):1277–88.
Bauermeister JA, Pingel ES, Jadwin-Cakmak L, et al. Acceptability and preliminary efficacy of a tailored online HIV/STI testing intervention for young men who have sex with men: The Get Connected! Program. AIDS Behav. 2015;19(10):1860–74.
Horvath KJ, Bauermeister JA. eHealth literacy and intervention tailoring impacts the scceptability of a HIV/STI testing intervention and sexual decision making among young gay and bisexual men. AIDS Educ Prev. 2017;29(1):14–23.
Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Adm Policy Ment Health Ment Health Serv Res 07/07. 2012;39(5):331–40.
Kurth AE, Chhun N, Cleland CM, et al. Linguistic and cultural adaptation of a computer-based counseling program (CARE + Spanish) to support HIV treatment adherence and risk reduction for people living with HIV/AIDS: A randomized controlled trial. J Med Internet Res. 2016;18(7):e195.
Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implement Sci 10/23. 2014;9(157):1–11.
Powell BJ, Waltz TJ, Chinman MJ, et al. A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015/02/12 2015;10(1):21.
Okoli C, Brough G, Allan B, et al. Shared decision making between patients and healthcare providers and its association with favorable health outcomes among people living with HIV. AIDS Behav. 2020:1–12.
Reno J, O’Leary S, Garrett K, et al. Improving provider communication about HPV vaccines for vaccine-hesitant parents through the use of Motivational Interviewing. J Health Commun. 2018;23(4):313–20.
Rubak S, Sandbæk A, Lauritzen T, Christensen B. Motivational interviewing: A systematic review and meta-analysis. Br J Gen Pract. 2005;55(513):305–12.
Frielink N, Embregts P. Modification of motivational interviewing for use with people with mild intellectual disability and challenging behaviour. J Intellect Dev Disabil. 2013/12/01 2013;38(4):279–291.
Greenwald R. Motivation-Adaptive Skills-Trauma Resolution (MASTR) Therapy for adolescents with conduct problems. J Aggress Maltreat Trauma. 2002/07/16 2002;6(1):237–261.
Rasmussen LA, Hughes MJ, Murray CA. Applying Motivational Interviewing in a domestic violence shelter: A pilot study evaluating the training of shelter staff. J Aggress Maltreat Trauma 2008/10/17. 2008;17(3):296–317.
Britt E, Hudson SM, Blampied NM. Motivational interviewing in health settings: A review. Patient Educ Couns. 2004;53(2):147–55.
Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.
Barwick MA, Peters J, Boydell K. Getting to uptake: Do communities of practice support the implementation of evidence-based practice? J Can Acad Child Adolesc Psychiatry. 2009;18(1):16–29.
Ahmadi A, Noetel M, Schellekens M, et al. A systematic review of machine learning for assessment and feedback of treatment fidelity. Psychosoc Interv. 2021:1–15.
Flemotomos N, Martinez VR, Chen Z, et al. Automated evaluation of psychotherapy skills using speech and language technologies. Behav Res Methods. 2021:1-22.
Moyers TB, Martin T, Catley D, Harris KJ, Ahluwalia JS. Assessing the integrity of Motivational Interviewing interventions: Reliability of the Motivational Interviewing Skills Code. Behav Cogn Psychother. 2003;31(2):177–84.
The Joint United Nations Programme on HIV/AIDS (UNAIDS). Understanding fast-track: Accelerating action to end the AIDS epidemic by 2030. Geneva: UNAIDS; 2014.
Acknowledgements
The EPIS project (ATN 153; MPI: Carcone and Coyle) was supported by the NIH Adolescent Medicine Trials Network for HIV/AIDS Interventions as part of the Scale It Up Program (U19HD089875, Naar PI). Dr. Aarons was supported by NIMH grant R03MH117493 and NIDA grants R01DA049891 and R01DA038466. The content presented here is solely the responsibility of the authors and does not represent the official views of the funding agencies. The authors would like to thank Sonia Lee, Jessica De Leon, Monique Green-Jones, Lindsey McCracken, Amy Pennar, Bonita Stanton, Regina Firpo-Triplett, Sitaji Gurung, Rafael Dilones, Daniel Szymczyk, Doug Keeler, Jesse Bradford-Rogers, Patrick George, Christopher Boutelle, Jonathan Marmo, Steven Samrock, Emily Capote, Tina Koo, S. Scott Jones, and Demetria Cain for their contributions and support of the EPIS project.
Funding
The EPIS project (ATN 153; MPI: Carcone and Coyle) was supported by the NIH Adolescent Medicine Trials Network for HIV/AIDS Interventions as part of the Scale It Up Program (U19HD089875, Naar PI). Dr. Aarons was supported by NIMH grant R03MH117493 and NIDA grants R01DA049891 and R01DA038466. The content presented here is solely the responsibility of the authors and does not represent the official views of the funding agencies.
Author information
Authors and Affiliations
Contributions
April Idalski Carcone, EPIS Project study co-lead, conceived of the research question for this paper, oversaw data coding, conducted all data analyses and interpretation, and wrote the initial draft of the manuscript. Karin Coyle, EPIS Project study co-lead, assisted with data interpretation, read manuscript drafts, and provided feedback. Seyram Butame coded data, read manuscript drafts, and provided feedback. Gary W. Harper read manuscript drafts and provided feedback. Gregory A, Aarons is co-developer of the EPIS framework and consulted on the EPIS Project study conceptualization, read and edited manuscript drafts, and provided feedback. Sylvie Naar, Scale It Up Study Principal Investigator, read manuscript drafts and provided feedback.
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Ethics approval
This study was initially approved by the Wayne State University Institutional Review Board. Institutional regulatory oversight was transferred to Florida State University.
Trial Registration
Not applicable.
Consent to participate
All study participants provided informed consent prior to participating in study activities.
Consent for publication
All study participants provided informed consent prior to participating in study activities regarding publishing their data.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Carcone, A.I., Coyle, K., Butame, S. et al. Using the Exploration-Preparation-Implementation-Sustainment (EPIS) Framework to prepare for the implementation of evidence-based practices into adolescent HIV settings. AIDS Behav 26, 4093–4106 (2022). https://doi.org/10.1007/s10461-022-03735-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10461-022-03735-0

