Abstract
Adoption of evidence-based programs for families by community agencies requires an understanding of variables that influence implementation. Managers and service providers from 64 community agencies reported on variables that affected the implementation of Triple P, an evidence-based parenting program. Both types of stakeholders reported adequate office resources; over half the managers and over two-thirds of service providers reported adequate training. Adequate office resources and positive agency characteristics, including organizational climate, were associated with higher program usage. Service providers’ reports of the variables impacted their individual adherence rates; managers had broader perspectives of the quality of implementation in their organizations.
Similar content being viewed by others
References
Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419. doi:10.1007/s10488-007-0121-3.
Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99, 2087–2095. doi:10.2105/AJPH.2009.161711.
American Psychological Association. (2009). Effective strategies to support positive parenting in community health centers: Report of the Working Group on Child Maltreatment Prevention in Community Health Centers. Washington, DC: American Psychological Association.
Asgary-Eden, V., & Lee, C. M. (2011). So now we’ve picked an evidence-based program, what’s next? Perspectives of service providers and administrators. Professional Psychology: Research and Practice, 42, 169–175. doi:10.1037/a0022745.
Barwick, M. A., Peters, J., & Boydell, K. (2009). Getting to update: Do communities of practice support the implementation of evidence-based practice? Journal of the Canadian Academy of Child and Adolescent Psychiatry, 18, 16–29. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2651208/pdf/ccap-18-1-16.pdf.
Chamberlain, P., Brown, C. H., Saldana, L., Reid, J., Wang, W., Marsenich, L., et al. (2008). Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. Administration and Policy in Mental Health and Mental Health Services Research, 35, 250–260. doi:10.1007/s10488-008-0167-x.
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi:10.1016/S0272-7358(97)00043-3.
de Graaf, I., Speetjens, P., Smit, F., de Wolff, M., & Tavecchio, L. (2008). Effectiveness of the Triple P Positive Parenting Program on behavioral problems in children. Behavior Modification, 32, 714–735. doi:10.1177/0145445508317134.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–53. doi:10.1023/B:PREV.0000013981.28071.52.
Fagan, A. A., Hanson, K., Kawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development study. American Journal of Community Psychology, 41, 235–249. doi:10.1007/s10464-008-9176-x.
Fixsen, D. L., Blase, K. A., Duda, M. A., Naoom, S. F., & Van Dyke, M. (2010). Implementation of evidence-based treatments for children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 435–450). New York: The Guildford Press.
Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 159–179). New York: The Guildford Press.
Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37, 15–26. doi:10.1007/s10488-010-0279-y.
Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5, 233–253. doi:10.1023/A:1020972906177.
Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22, 401–421. http://www.casbrant.ca/files/upload/oacas/Chapter2/The_Effects_of_Organizational_Climate.pdf.
Hoagwood, K., & Kolko, D. J. (2009). Introduction to the special series on practice contexts: A glimpse into the netherworld of public mental health services for children and families. Administration and Policy in Mental Health and Mental Health Services Research, 36, 35–36. doi:10.1007/s10488-008-0201-z.
Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38, 21–33. doi:10.1037/0735-7028.38.1.21.
Kolko, D. J., Herschell, A. D., Costello, A. H., & Kolko, R. P. (2009). Child welfare recommendations to improve mental health services for children who have experienced abuse and neglect: A national perspective. Administration and Policy in Mental Health and Mental Health Services Research, 36, 50–62. doi:10.1007/s10488-008-0202-y.
Lee, C. S., August, G. J., Realmuto, G. M., Horowitz, J. L., Bloomquist, M. L., & Klimes-Dougan, B. (2008). Fidelity at a distance: Assessing implementation fidelity of the early risers prevention program in a going-to-scale intervention trial. Prevention Science, 9, 215–229. doi:10.1007/s11121-008-0097-6.
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197–209. doi:10.1016/S0740-5472(02)00233-7.
Mihalic, S., & Irwin, K. (2003). Blueprints for violence prevention: From research to real-world settings—Factors influencing the successful replication of model programs. Youth Violence and Juvenile Justice, 1, 307–329. doi:10.1177/1541204003255841.
Mihalic, S., Irwin, K., Fagan, A., Ballard, D., & Elliott, D. (2004, July). Successful program implementation: Lessons from Blueprints. Juvenile Justice Bulletin, 1–11. http://www.ncjrs.gov/pdffiles1/ojjdp/204273.pdf.
National Institute for Health and Clinical Excellence (2009, September). Attention deficit hyperactivity disorder: Diagnosis and management of ADHD in children, young people, and adults. NICE Clinical Guideline 72. London, UK: National Institute for Health and Clinical Excellence.
National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, DC: National Academic Press.
Nowak, C., & Heinrichs, N. (2008). A comprehensive meta-analysis of Triple P-Positive Parenting Program using hierarchal linear modeling: Effectiveness and moderating variables. Clinical Child and Family Psychology Review, 11, 114–144. doi:10.1007/s10567-008-0033-0.
Perepletchikova, F., Hilt, L. M., Chereji, E., & Kazdin, A. E. (2009). Barriers to implementing treatment integrity procedures: Survey of treatment outcome researchers. Journal of Consulting and Clinical Psychology, 77, 212–218. doi:10.1037/a0015232.
Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2009). Population-based prevention of child maltreatment: The U.S. Triple P system population trial. Prevention Science, 10, 1–12. doi:10.1007/s11121-009-0123-3.
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34. doi:10.1007/s10488-008-0197-4.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchal linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
Reid, G. J., & Brown, J. B. (2008). Money, case complexity, and wait lists: Perspectives on problems and solutions at children’s mental health centers in Ontario. Journal of Behavioral Health Services & Research, 35, 334–346.
Sanders, M. R. (1999). Triple P-positive parenting program: Towards an empirically validated multilevel parenting and family support strategy for the prevention of behavior and emotional problems in children. Clinical Child and Family Psychology Review, 2, 71–90. doi:10.1023/A:1021843613840.
Sanders, M. R. (2010). Adopting a public health approach to the delivery of evidence-based parenting interventions. Canadian Psychology, 51, 17–23. doi:10.1037/a0018295.
Sanders, M. R., Markie-Dadds, C., & Turner, K. M. T. (1998). Practitioner’s manual for Enhanced Triple P. Brisbane, Queensland, Australia: Families International Publishing.
Sanders, M. R., Markie-Dadds, C., & Turner, K. M. T. (2000). Practitioner’s manual for Standard Triple P. Brisbane, Queensland, Australia: Families International Publishing.
Sanders, M. R., Prinz, R. J., & Shapiro, C. J. (2009). Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administration and Policy In Mental Health, 36, 133–143. doi:10.1007/s10488-009-0205-3.
Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behaviour problems one year after multisystemic therapy. Administration and Policy in Mental Health and Mental Health Services Research, 35, 379–394. doi:10.1007/s10488-008-0108-z.
Seng, A. C., Prinz, R. J., & Sanders, M. R. (2006). The role of training variables in effective dissemination of evidence-based parenting interventions. International Journal of Mental Health Promotion, 8, 20–28. http://www.ijmhp.co.uk/2006.htm.
Smith, S. R., & Gronbjerg, K. A. (2006). Government-nonprofit relations. In W. Powell & R. Steinberg (Eds.), The nonprofit sector: A research handbook (2nd ed., pp. 221–242). New Haven, CT: Yale University Press.
Stern, S. B., Alaggia, R., Watson, K., & Morton, T. (2008). Implementing an evidence-based parenting program with adherence in the real world of community practice. Research on Social Work, 18, 543–554. doi:10.1177/1049731507308999.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Pearson Education.
Thomas, R., & Zimmer-Gembeck, M. J. (2007). Behavioral outcomes of parent-child interaction therapy and Triple P-Positive Parenting Program: A review and meta-analysis. Journal of Abnormal Child Psychology, 35, 475–495. doi:10.1007/s10802-007-9104-9.
Turner, K. M. T., Markie-Dadds, C., & Sanders, M. R. (1997). Practitioner’s manual for Group Triple P. Brisbane, Queensland, Australia: Families International Publishing.
Weisz, J. R., & Kazdin, A. E. (2010). Evidence-based psychotherapies for children and adolescents (2nd ed.). New York: The Guildford Press.
World Health Organization. (2009). Preventing violence through the development of safe, stable, and nurturing relationships between children and their parents and caregivers. Series of briefings on violence prevention: The evidence. Geneva, Switzerland: World Health Organization.
Zazzali, J. L., Sherbourne, C., Hoagwood, K. E., Greene, D., Bigley, M. F., & Sexton, T. L. (2008). The adoption and implementation of an evidence based practice in child and family mental health services organizations: A pilot study of Functional Family Therapy in New York State. Administration and Policy in Mental Health and Mental Health Services Research, 5, 38–49. doi:10.1007/s10488-007-0145-8.
Acknowledgments
The data for this study were collected in partial completion of the first author’s doctoral dissertation. We would like to thank our colleagues in the Evidence-Based Parenting Research Working Group (Sue Barnes, Brian Beech, Sandra Cunning, Fred Schmidt, and Susan Stern) for their helpful suggestions throughout the study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Asgary-Eden, V., Lee, C.M. Implementing an Evidence-Based Parenting Program in Community Agencies: What Helps and What Gets in the Way?. Adm Policy Ment Health 39, 478–488 (2012). https://doi.org/10.1007/s10488-011-0371-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-011-0371-y