Abstract
It is now widely understood that successful implementation of evidence-based treatments is facilitated by several favorable conditions (e.g., community buy-in, invested agency leadership). However, strategies for supporting agencies in promoting these conditions have been examined to a lesser extent. In this exploratory study, the implementation support procedures of Parenting with Love and Limits (PLL), an evidence-informed family treatment for child/adolescent behavior problems in which the training team follows structured procedures to help coordinate implementation support activities, are illustrated, and their preliminary effectiveness examined. PLL documents and communication records between PLL and n = 23 sites across the U.S. that initiated PLL pre-implementation activities were reviewed. In addition, implementation activities completed for each agency were entered into the Stages of Implementation Completion (SIC) dashboard. The prescriptive nature of the PLL implementation support protocol was illustrated through descriptions of procedural documents and case examples. Quantitative analyses revealed that, among the 23 sites that began pre-implementation, 9 discontinued, with a trend toward sites in metropolitan areas being more likely to discontinue than those in less populous areas. In addition, the 14 sites that launched PLL demonstrated a high amount of consistency in activities, with sites in the sustainability phase completing an average of 86% of implementation behaviors. Training team coordination of implementation activities may be one promising approach for supporting agencies in completing tasks to facilitate successful uptake of evidence-supported interventions. In turn, sustained implementation of evidence-supported treatments could allow communities to benefit from practice innovations to a greater extent.
This is a preview of subscription content, access via your institution.

Data Availability
The data can be made available upon request.
References
Albers, B., Mildon, R., Lyon, A. R., & Shlonsky, A. (2017). Implementation frameworks in child, youth and family services—Results from a scoping review. Children and Youth Services Review, 81, 101–116. https://doi.org/10.1016/j.childyouth.2017.07.003.
Akins, B. A., Strolin-Goltman, J., & Collins-Camargo, C. (2017). Successes and challenges in developing trauma-informed child welfare systems: A real-world case study of exploration and initial implementation. Children and Youth Services Review, 82, 42–52. https://doi.org/10.1016/j.chilyouth.2017.09.007.
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 1–9. https://doi.org/10.1186/1748-5908-2-40.
Chamberlain, P., Saldana, L., Brown, C. H., & Leve, L. D. (2011). Implementation of multidimensional treatment foster care in California: sa randomized control trial of an evidence-based practice. In M. Roberts-DeGennaro & S. J. Fogel (Eds.), Using evidence to inform practice for community and organizational change (pp. 218–234). London: Lyceum Books.
Chinman, M., Acosta, J., Ebener, P., Burkhart, Q., Malone, P. S., & Paddock, S. M. (2013). Intervening with practitioners to improve the quality of prevention: One-year findings from a randomized trial of Assets-Getting To Outcomes. Journal of Primary Prevention, 34, 173–191. https://doi.org/10.1007/s10935-013-0302-7.
Chinman, M., Imm, P. & Wandersman, A. (2004). Getting To Outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. RAND Corporation.
Crowley, D. M., Greenberg, M. T., Feinberg, M. E., Spoth, R. L., & Redmond, C. R. (2012). The effect of the PROSPER partnership model on cultivating local stakeholder knowledge of evidence-based programs: A five-year longitudinal study of 28 communities. Prevention Science, 13, 96–105. https://doi.org/10.1007/s11121-011-0250-5.
Damschroder, L. J., & Hagedorn, H. J. (2011). A guiding framework and approach for implementation research in substance use disorders treatment. Psychology of Addictive Behaviors, 25, 194–205. https://doi.org/10.1037/a0022284.
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540. https://doi.org/10.1177/1049731509335549.
Forgatch, M. S., Patterson, G. R., & Gewirtz, A. H. (2013). Looking forward: The promise of widespread implementation of parent training programs. Perspectives on Psychological Science, 8(6), 682–694. https://doi.org/10.1177/1745691613503478.
Garbacz, L. L., Brown, D. M., Spee, A., Polo, A. J., & Budd, K. S. (2014). Establishing treatment fidelity in evidence-based parent training programs for externalizing disorders in children and adolescents. Clinical Child and Family Psychology Review, 17, 230–247. https://doi.org/10.1007/s10567-014-0166-2.
Hodge, L. M., & Turner, K. M. T. (2016). Sustained implementation of evidence-based programs in disadvantaged communities: A conceptual framework of supporting factors. American Journal of Community Psychology, 58(1–2), 192–210. https://doi.org/10.1002/ajcp.12082.
Hogue, A. T., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76, 544–555. https://doi.org/10.1037/0022-006X.76.4.544.
Karam, E., Sterrett, E., & Kiaer, L. (2017). The integration of family and group therapy as an alternative to juvenile incarceration: A quasi-experimental evaluation using Parenting with Love and Limits (PLL). Family Process, 56, 331–347. https://doi.org/10.1111/famp.12187.
Latane, B., & Darley, J. M. (1970). The unresponsive bystander: Why doesn’t he help? New Jersey: Prentice Hall.
Miao, T., Umemoto, K., Gonda, D., & Hishinuma, E. A. (2011). Essential elements for community engagement in evidence-based youth violence prevention. American Journal of Community Psychology, 48, 120–132. https://doi.org/10.1007/s10464-010-9418-6.
Mistler, L. A., Sheidow, A. J., & Davis, M. (2016). Transdiagnostic motivational enhancement therapy to reduce treatment attrition: Use in emerging adults. Cognitive and Behavioral Practice, 23, 368–384. https://doi.org/10.1016/j.cbpra.2015.09.007.
Nadeem, E., Olin, S. S., Campbell, L., Hoagwood, K. E., & Horwitz, S. M. (2013). Understanding the components of quality improvement collaboratives: A systematic literature review. Milbank Quarterly, 91, 354–394. https://doi.org/10.1111/milq.12016.
Payán, D. D., Sloane, D. C., Illum, J., Vargas, R. B., Lee, D., Galloway-Gilliam, L., et al. (2017). Catalyzing implementation of evidence-based interventions in safety net settings: A clinical-community partnership in South Los Angeles. Health Promotion Practice, 18, 586–597. https://doi.org/10.1177/1524839917705418.
Portell, M., Anguera, M. T., Chacon-Moscoso, S., & Sanduvete-Chaves, S. (2015). Guidelines for reporting evaluations based on observational methodology. Psicothema, 27, 283–289. https://doi.org/10.7334/psicothema2014.276.
Randall, C. L., & McNeil, D. W. (2017). Motivational interviewing as an adjunct to cognitive behavior therapy for anxiety disorders: A critical review of the literature. Cognitive and Behavioral Practice, 24, 296–311. https://doi.org/10.1016/j.cbpra.2016.05.003.
Reynolds, H. T. (1984). Analysis of nominal data (2nd ed.). Thousand Oaks: Sage.
Robbins, M. S., Feaster, D. J., Horigian, V. E., Puccinelli, M. J., Henderson, C. E., & Szapocznik, J. (2011). Therapist adherence in Brief Strategic Family Therapy for adolescent drug abusers. Journal of Consulting and Clinical psychology, 79, 53–73. https://doi.org/10.1037/a0022146.
Ryon, S. B., Early, K. W., & Kosloski, A. E. (2017). Community-based and family-focused alternatives to incarceration: A quasi-experimental evaluation of interventions for delinquent youth. Journal of Criminal Justice, 51, 59–66. https://doi.org/10.1016/j.jcrimjus.2017.06.002.
Safar, J. A., Defields, C., Fulop, A., Dowd, M., & Zavod, M. J. (2006). Meeting business goals and managing office bandwith: A predictive model for organizational change. Journal of Change Management, 6, 87–98. https://doi.org/10.1080/1469701060057866.
Saldana, L., Bennett, I., Powers, D., Vredevoogd, M., Grover, T., Schaper, H., & Campbell, M. (2020). Scaling implementation of collaborative care for depression: Adaptation of the stages of implementation completion. Administration and Policy in Mental Health and Mental Health Services Research, 47, 188–196. https://doi.org/10.1007/s10488-019-00944-z.
Saldana, L., Chamberlain, P., Wang, W., & Hendricks, B. C. (2012). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-011-0363-y.
Saldana, L., Schaper, H., Campbell, M., & Chapman, J. (2015). Standardized measurement of implementation: The Universal SIC. Implementation Science, 10, A73. https://doi.org/10.1186/1748-5908-10-S1-A73.
Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38, 91–105. https://doi.org/10.1080/15374410802575388.
Smith, L. S., & Wilkins, N. (2018). Mind the gap: Approaches to addressing the research-to-practice, practice-to-research chasm. Journal of Public Health Management Practice, 24, S6–S11. https://doi.org/10.1097/PHH.0000000000000667.
Sterrett-Hong, E., Karam, E. & Kiaer, L. (2017). Statewide implementation of parenting with love and limits among youth with co-existing internalizing and externalizing functional impairments reduces return to service rates and treatment cost. Administration and Policy in Mental Health and Mental Health Services Research, 44, 792–809. https://doi.org/10.1007/s10488-016-0788-4.
Weisner, T. S., & Hay, M. C. (2015). Practice to research: Integrating evidence-based practices with culture and context. Transcultural Psychiatry, 52, 222–243. https://doi.org/10.1177/1363461514557066.
Williams, N. J., & Beidas, R. S. (2019). Annual research review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450. https://doi.org/10.1111/jcpp.12960.
Acknowledgements
We would like to express our gratitude to all the agency leaders, supervisors, and staff who worked so diligently to carry out the work described in this paper.
Funding
This work was supported, in part, by a grant to the second author, 1 R01 DA044745-01.
Author information
Authors and Affiliations
Contributions
CRediT Author Statement: Conceptualization (EMSH, LS), Methodology (EMSH, LS), Investigation (EMSH), Writing-Original Draft (EMSH, LS, JB, EK, ANV, KC), Writing-Review & Editing (EMSH, LS, EK), Formal Analysis (HS).
Corresponding author
Ethics declarations
Conflict of interest
The third author is the President and CEO of the treatment model described. None of the other authors have conflict of interest.
Rights and permissions
About this article
Cite this article
Sterrett-Hong, E.M., Saldana, L., Burek, J. et al. An Exploratory Study of a Training Team-Coordinated Approach to Implementation. Glob Implement Res Appl 1, 17–29 (2021). https://doi.org/10.1007/s43477-020-00003-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43477-020-00003-y