Skip to main content

Establishing Treatment Fidelity in Evidence-Based Parent Training Programs for Externalizing Disorders in Children and Adolescents

Clinical Child and Family Psychology Review volume 17, pages 230–247 (2014)Cite this article

Abstract

The current review evaluates the use of treatment fidelity strategies in evidence-based parent training programs for treating externalizing disorders. We used a broad framework for evaluating treatment fidelity developed by the National Institutes of Health Treatment Fidelity Workgroup that includes the aspects of treatment design, treatment delivery, training providers, and assessment of participant receipt of treatment and enactment of treatment skills. Sixty-five articles reporting outcome trials of evidence-based parent training programs met inclusion criteria and were coded for treatment fidelity strategies. The mean adherence to fidelity strategies was .73, which was higher than two previous review studies employing this framework in the health literature. Strategies related to treatment design showed the highest mean adherence (.83), whereas training of providers and enactment of treatment skills had the lowest (.58). In light of an increasing emphasis on effectiveness and dissemination trials, the broader treatment fidelity framework as applied in this review focuses needed attention on areas often overlooked in fidelity practices, such as training providers and generalization of treatment skills. We discuss the strengths and limitations of fidelity practices in parent training studies, implications of these findings, and areas for future research.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1

References

  • * denotes articles include in the review.

  • APA Publications and Communications Board Working Group on Journal Article Reporting Standards. (2008). Reporting standards for research in psychology: Why do need them? What might they be? American Psychologist, 63, 839–851. doi:10.1037/0003-066X.63.9.839.

    PubMed Central  Article  Google Scholar 

  • *Bagner, D. M., Sheinkopf, S. J., Vohr, B. R., & Lester, B. M. (2010). Parenting intervention for externalizing behavior problems in children born premature: An initial examination. Journal of Developmental and Behavioral Pediatrics, 31, 209–216. doi:10.1097/DBP.0b013e3181d5a294.

    PubMed Central  PubMed  Article  Google Scholar 

  • Barber, J. P., Sharpless, B. A., Klostermann, S., & McCarthy, K. S. (2007). Assessing intervention competence and its relation to therapy outcome: A selected review derived from the outcome literature. Professional Psychology: Research and Practice, 38, 493–500. doi:10.1037/0735-7028.38.5.493.

    Article  Google Scholar 

  • *Barkley, R. A., Edwards, G., Laneri, M., Fletcher, K., & Metevia, L. (2001). The efficacy of problem-solving communication training alone, behavior management training alone, and their combination for parent-adolescent conflict in teenagers with ADHD and ODD. Journal of Consulting and Clinical Psychology, 69, 926–941. doi:10.1037//0022-006x.69.6.926.

    PubMed  Article  Google Scholar 

  • *Barkley, R. A., Shelton, T. L., Crosswait, C., Moorehouse, M., Fletcher, K., Barrett, S., et al. (2000). Multi-method psycho-educational intervention for preschool children with disruptive behavior: Preliminary results at post-treatment. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41, 319–332. doi:10.1017/s0021963099005430.

    Article  Google Scholar 

  • Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Health Psychology, 23, 443–451. doi:10.1037/0278-6133.23.5.443.

    PubMed  Article  Google Scholar 

  • *Berkovits, M. D., O’Brien, K. A., Carter, C. G., & Eyberg, S. M. (2010). Early identification and intervention for behavior problems in primary care: A comparison of two abbreviated versions of Parent–Child Interaction Therapy. Behavior Therapy, 41, 375–387. doi:10.1016/j.beth.2009.11.002.

    PubMed  Article  Google Scholar 

  • Blase, K., & Fixsen, D. L. (2013). Core intervention components: Identifying and operationalizing what makes programs work. ASPE research brief, office of the assistant secretary for planning and evaluation, Office of Human Services Policy, US Department of Health and Human Services, p 1–21.

  • *Borduin, C. M., Mann, B. J., Cone, L. T., Henggeler, S. W., Fucci, B. R., Blaske, D. M., et al. (1995). Multisystemic treatment of serious juvenile offenders: Long-term prevention of criminality and violence. Journal of Consulting and Clinical Psychology, 63, 569–578. doi:10.1037/0022-006x.63.4.569.

    PubMed  Article  Google Scholar 

  • Borrelli, B. (2011). The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. Journal of Public Health Dentistry, 71, S52–S63. doi:10.1111/j.1752-7325.2011.00233.x.

    PubMed Central  Article  Google Scholar 

  • Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A. J., Czajkowski, S., Breger, R., et al. (2005). A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. Journal of Consulting and Clinical Psychology, 73, 852–860. doi:10.1037/0022-006X.73.5.852.

    PubMed  Article  Google Scholar 

  • *Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M., et al. (2010). Effects of the Oregon model of parent management training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24, 485–496. doi:10.1037/a0020267.

    PubMed Central  PubMed  Article  Google Scholar 

  • Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 1–9. doi:10.1186/1748-5908-2-40.

    Article  Google Scholar 

  • *Chacko, A., Wymbs, B. T., Wymbs, F. A., Pelham, W. E., Swanger-Gagne, M. S., Girio, E., et al. (2009). Enhancing traditional behavioral parent training for single mothers of children with ADHD. Journal of Clinical Child and Adolescent Psychology, 38, 206–218. doi:10.1080/15374410802698388.

    PubMed  Article  Google Scholar 

  • Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18. doi:10.1037//0022-006X.66.1.7.

    PubMed  Article  Google Scholar 

  • Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685–716. doi:10.1146/annurev.psych.52.1.685.

    PubMed  Article  Google Scholar 

  • Chorpita, B. F., Daleiden, E. L., Ebesutani, C., Young, J., Becker, K. D., Nakamura, B. J., et al. (2011). Evidence-based treatments for children and adolescents: An updated review of indicators of efficacy and effectiveness. Clinical Psychology: Science and Practice, 18, 154–172. doi:10.1111/j.1468-2850.2011.01247.x.

    Article  Google Scholar 

  • Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7, 5–20. doi:10.1007/s11020-005-1962-6.

    PubMed  Article  Google Scholar 

  • *Drugli, M. B., & Larsson, B. (2006). Children aged 4–8 years treated with parent training and child therapy because of conduct problems: Generalisation effects to day-care and school settings. European Child and Adolescent Psychiatry, 15, 392–399. doi:10.1007/s00787-006-0546-3.

    PubMed  Article  Google Scholar 

  • *Drugli, M. B., Larsson, B., & Clifford, G. (2007). Changes in social competence in young children treated because of conduct problems as viewed by multiple informants. European Child and Adolescent Psychiatry, 16, 370–378. doi:10.1007/s00787-007-0609-0.

    PubMed  Article  Google Scholar 

  • Eames, C., Daley, D., Hutchings, J., Whitaker, C., Jones, K., Hughes, J., et al. (2009). Treatment fidelity as a predictor of behaviour change in parents attending group-based parent training. Child: Care Health and Development, 35, 603–612. doi:10.1111/j.1365-2214.2009.00975.x.

    Article  Google Scholar 

  • Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37, 215–237. doi:10.1080/15374410701820117.

    PubMed  Article  Google Scholar 

  • *Fabiano, G. A., Chacko, A., Pelham, W. E, Jr, Robb, J., Walker, K. S., Wymbs, F., et al. (2009). A comparison of behavioral parent training programs for fathers of children with Attention Deficit/Hyperactivity Disorder. Behavior Therapy, 40, 190–204. doi:10.1016/j.beth.2008.05.002.

    PubMed  Article  Google Scholar 

  • Feeley, M., DeRubeis, R. J., & Gelfand, L. A. (1999). The temporal relation of adherence and alliance to symptom change in cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 67, 578–582. doi:10.1037//0022-006X.67.4.578.

    PubMed  Article  Google Scholar 

  • Fixsen, D., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children (Special Issue), 79, 213–230.

    Google Scholar 

  • *Forehand, R. L., Merchant, M. J., Parent, J., Long, N., Linnea, K., & Baer, J. (2011). An examination of a group curriculum for parents of young children with disruptive behavior. Behavior Modification, 35, 235–251. doi:10.1177/0145445510393731.

    PubMed  Article  Google Scholar 

  • Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2006). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training. Behavior Therapy, 36, 3–13. doi:10.1016/S0005-7894(05)80049-8.

    Article  Google Scholar 

  • *Fossum, S., Mørch, W.-T., Handegård, B. H., Drugli, M. B., & Larsson, B. (2009). Parent training for young Norwegian children with ODD and CD problems: Predictors and mediators of treatment outcome. Scandinavian Journal of Psychology, 50, 173–181. doi:10.1111/j.1467-9450.2008.00700.x.

    PubMed  Article  Google Scholar 

  • *Gallart, S. C., & Matthey, S. (2005). The effectiveness of group Triple P and the impact of the four telephone contacts. Behaviour Change, 22, 71–80. doi:10.1375/bech.2005.22.2.71.

    Article  Google Scholar 

  • *Gardner, F., Burton, J., & Klimes, I. (2006). Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: Outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry, 47, 1123–1132. doi:10.1111/j.1469-7610.2006.01668.x.

    PubMed  Article  Google Scholar 

  • Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 505–514. doi:10.1097/CHI.0b013e31816765c2.

    PubMed  Article  Google Scholar 

  • Garland, A. F., Hough, R. L., McCabe, K. M., Yeh, M., Wood, P. A., & Aarons, G. A. (2001). Prevalence of psychiatric disorders in youths across five sectors of care. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 409–418. doi:10.1097/00004583-200104000-00009.

    PubMed  Article  Google Scholar 

  • *Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537–550. doi:10.1037/a0019160.

    PubMed Central  PubMed  Article  Google Scholar 

  • Godley, S. H., Garner, B. R., Smith, J. E., Meyers, R. J., & Godley, M. D. (2011). A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clinical Psychology: Science and Practice, 18, 67–83. doi:10.1111/j.1468-2850.2011.01236.x.

    Article  Google Scholar 

  • Helmond, P., Overbeek, G., & Brugman, D. (2012). Program integrity and effectiveness of a cognitive behavioral intervention for incarcerated youth on cognitive distortions, social skills, and moral development. Children and Youth Services Review, 34, 1720–1728. doi:10.1016/j.childyouth.2012.05.001.

    Article  Google Scholar 

  • Henggeler, S. W. (2004). Decreasing effect sizes for effectiveness studies- implications for the transport of evidence-based treatments: Comment on Curtis, Ronan, and Borduin (2004). Journal of Family Psychology, 18, 420–423. doi:10.1037/0893-3200.18.3.420.

    PubMed  Article  Google Scholar 

  • *Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic Therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821–833. doi:10.1037/0022-006x.65.5.821.

    PubMed  Article  Google Scholar 

  • *Henggeler, S. W., Rowland, M. D., Randall, J., Ward, D. M., Pickrel, S. G., Cunningham, P. B., et al. (1999). Home-based Multisystemic Therapy as an alternative to the hospitalization of youths in psychiatric crisis: Clinical outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1331–1339. doi:10.1097/00004583-199911000-00006.

    PubMed  Article  Google Scholar 

  • Henggeler, S. W., & Schaeffer, C. (2010). Treating serious antisocial behavior using Multisystemic Therapy. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 259–276). New York: Guilford.

    Google Scholar 

  • *Herman, K. C., Borden, L. A., Reinke, W. M., & Webster-Stratton, C. (2011). The impact of the incredible year’s parent, child, and teacher training programs on children’s co-occurring internalizing symptoms. School Psychology Quarterly, 26, 189–201. doi:10.1037/a0025228.

    Article  Google Scholar 

  • Higgins, J. P. T., & Green, S. (Eds.). Cochrane handbook for systematic reviews of interventions Version 5.0.2 [updated September 2009]. The Cochrane Collaboration, 2009. Available from www.cochrane-handbook.org.

  • *Hoath, F. E., & Sanders, M. R. (2002). A feasibility study of enhanced group Triple P: Positive parenting program for parents of children with Attention Deficit/Hyperactivity Disorder. Behaviour Change, 19, 191–206. doi:10.1375/bech.19.4.191.

    Article  Google Scholar 

  • Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76, 544–555. doi:10.1037/0022-006x.76.4.544.

    PubMed Central  PubMed  Article  Google Scholar 

  • Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in Multisystemic Therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451–467. doi:10.1037//0022-006X.68.3.451.

    PubMed  Article  Google Scholar 

  • *Hutchings, J., Gardner, F., Bywater, T., Daley, D., Whitaker, C., Jones, K., et al. (2007). Parenting intervention in sure start services for children at risk of developing conduct disorder: Pragmatic randomised controlled trial. British Medical Journal, 334, 678–682. doi:10.1136/bmj.39126.620799.55.

    PubMed Central  PubMed  Article  Google Scholar 

  • *Ireland, J. L., Sanders, M. R., & Markie-Dadds, C. (2003). The impact of parent training on marital functioning: A comparison of two group versions of the Triple P-positive parenting program for parents of children with early-onset conduct problems. Behavioural and Cognitive Psychotherapy, 31, 127–142. doi:10.1017/S1352465803002017.

    Article  Google Scholar 

  • Jensen, A. L., & Weisz, J. R. (2002). Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents. Journal of Consulting and Clinical Psychology, 70, 158–168. doi:10.1037//0022-006X.70.1.158.

    PubMed  Article  Google Scholar 

  • Kaminski, J. W., Valle, L. A., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589. doi:10.1007/s10802-007-9201-9.

    PubMed  Article  Google Scholar 

  • Kazak, A. E., Hoagwood, K., Weisz, J. R., Hood, K., Kratochwill, T. R., Vargas, L. A., et al. (2010). A meta-systems approach to evidence-based practice for children and adolescents. American Psychologist, 65, 85–97. doi:10.1037/a0017784.

    PubMed  Article  Google Scholar 

  • Kazdin, A. E. (1986). Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54, 95–105. doi:10.1037//0022-006X.54.1.95.

    PubMed  Article  Google Scholar 

  • *Kazdin, A. E., Esveldtdawson, K., French, N. H., & Unis, A. S. (1987). Effects of parent management-training and problem-solving skills training combined in the treatment of antisocial child-behavior. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 416–424. doi:10.1097/00004583-198705000-00024.

    PubMed  Article  Google Scholar 

  • *Kazdin, A. E., Siegel, T. C., & Bass, D. (1992). Cognitive problem-solving skills training and parent management-training in the treatment of antisocial-behavior in children. Journal of Consulting and Clinical Psychology, 60, 733–747. doi:10.1037//0022-006x.60.5.733.

    PubMed  Article  Google Scholar 

  • *Kazdin, A. E., & Whitley, M. K. (2003). Treatment of parental stress to enhance therapeutic change among children referred for aggressive and antisocial behavior. Journal of Consulting and Clinical Psychology, 71, 504–515. doi:10.1037/0022-006x.71.3.504.

    PubMed  Article  Google Scholar 

  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. doi:10.2307/2529310.

    PubMed  Article  Google Scholar 

  • *Larsson, B., Fossum, S., Clifford, G., Drugli, M. B., Handegård, B. H., & Mørch, W.-T. (2009). Treatment of oppositional defiant and conduct problems in young Norwegian children: Results of a randomized controlled trial. European Child and Adolescent Psychiatry, 18, 42–52. doi:10.1007/s00787-008-0702-z.

    PubMed  Article  Google Scholar 

  • *Lau, A. S., Fung, J. J., Ho, L. Y., Liu, L. L., & Gudino, O. G. (2011). Parent training with high-risk immigrant Chinese families: A pilot group randomized trial yielding practice-based evidence. Behavior Therapy, 42, 413–426. doi:10.1016/j.beth.2010.11.001.

    PubMed  Article  Google Scholar 

  • *Lavigne, J. V., LeBailly, S. A., Gouze, K. R., Cicchetti, C., Pochyly, J., Arend, R., et al. (2008). Treating oppositional defiant disorder in primary care: A comparison of three models. Journal of Pediatric Psychology, 33, 449–461. doi:10.1093/jpepsy/jsm074.

    PubMed  Article  Google Scholar 

  • *Leung, C., Sanders, M. R., Leung, S., Mak, R., & Lau, J. (2003). An outcome evaluation of the implementation of the Triple P-Positive Parenting Program in Hong Kong. Family Process, 42, 531–544. doi:10.1111/j.1545-5300.2003.00531.x.

    PubMed  Article  Google Scholar 

  • *Leung, C., Tsang, S., Heung, K., & Yiu, I. (2009). Effectiveness of Parent–Child Interaction Therapy (PCIT) among Chinese families. Research on Social Work Practice, 19, 304–313. doi:10.1177/1049731508321713.

    Google Scholar 

  • Lichstein, K. L., Riedel, B. W., & Grieve, R. (1994). Fair tests of clinical trials: A treatment implementation model. Advances in Behaviour Research and Therapy, 16, 1–29. doi:10.1016/0146-6402(94)90001-9.

    Article  Google Scholar 

  • Luborsky, L., & DeRubeis, R. J. (1984). The use of psychotherapy treatment manuals: A small revolution in psychotherapy research style. Clinical Psychology Review, 4, 5–14. doi:10.1016/0272-7358(84)90034-5.

    Article  Google Scholar 

  • *Matos, M., Bauermeister, J. J., & Bernal, G. (2009). Parent–Child Interaction Therapy for Puerto Rican preschool children with ADHD and behavior problems: A pilot efficacy study. Family Process, 48, 232–252. doi:10.1111/j.1545-5300.2009.01279.x.

    PubMed  Article  Google Scholar 

  • McArthur, B. A., Riosa, P. B., & Preyde, M. (2012). Treatment fidelity in psychosocial intervention for children and adolescents with comorbid problems. Child and Adolescent Mental Health, 17, 139–145. doi:10.1111/j.1475-3588.2011.00635.x.

    Article  Google Scholar 

  • *McCabe, K., & Yeh, M. (2009). Parent–Child Interaction Therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child and Adolescent Psychology, 38, 753–759. doi:10.1080/15374410903103544.

    PubMed  Article  Google Scholar 

  • McHugh, R. K., Murray, H. W., & Barlow, D. H. (2009). Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions. Behaviour Research and Therapy, 47, 946–953. doi:10.1016/j.brat.2009.07.005.

    PubMed Central  PubMed  Article  Google Scholar 

  • McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50, 818–824.

    PubMed  Google Scholar 

  • Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., et al. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. British Medical Journal, 340, 869–897. doi:10.1136/bmj.c869.

    Article  Google Scholar 

  • Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266. doi:10.1016/0272-7358(91)90103-2.

    Article  Google Scholar 

  • *Morawska, A., & Sanders, M. (2009). An evaluation of a behavioural parenting intervention for parents of gifted children. Behaviour Research and Therapy, 47, 463–470. doi:10.1016/j.brat.2009.02.008.

    PubMed  Article  Google Scholar 

  • *MTACG. (1999). A 14-month randomized clinical trial of treatment strategies for Attention Deficit/Hyperactivity Disorder. Archives of General Psychiatry, 56, 1073–1086. doi:10.1001/archpsyc.56.12.1073.

    Article  Google Scholar 

  • *Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent–Child Interaction Therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71, 251–260. doi:10.1037/0022-006x.71.2.251.

    PubMed  Article  Google Scholar 

  • *Ogden, T., & Hagen, K. A. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76, 607–621. doi:10.1037/0022-006x.76.4.607.

    PubMed  Article  Google Scholar 

  • *Ogden, T., & Halliday-Boykins, C. A. (2004). Multisystemic treatment of antisocial adolescents in Norway: Replication of clinical outcomes outside of the US. Child and Adolescent Mental Health, 9, 77–83. doi:10.1111/j.1475-3588.2004.00085.x.

    Article  Google Scholar 

  • *Owens, J. S., Richerson, L., Beilstein, E. A., Crane, A., Murphy, C. E., & Vancouver, J. B. (2005). School-based mental health programming for children with inattentive and disruptive behavior problems: First-year treatment outcome. Journal of Attention Disorders, 9, 261–274. doi:10.1177/1087054705279299.

    PubMed  Article  Google Scholar 

  • *Patterson, G. R., Chamberlain, P., & Reid, J. B. (1982). A comparative evaluation of a parent-training program. Behavior Therapy, 13, 638–650. doi:10.1016/s0005-7894(82)80021-x.

    Article  Google Scholar 

  • Pelham, W. E., & Fabiano, G. A. (2008). Evidence-based psychosocial treatments for Attention Deficit/Hyperactivity Disorder. Journal of Clinical Child and Adolescent Psychology, 37, 184–214. doi:10.1080/15374410701818681.

    PubMed  Article  Google Scholar 

  • Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383.

    Article  Google Scholar 

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829. doi:10.1037/0022-006X.75.6.829.

    PubMed  Article  Google Scholar 

  • *Plant, K. M., & Sanders, M. R. (2007). Reducing problem behavior during care-giving in families of preschool-aged children with developmental disabilities. Research in Developmental Disabilities, 28, 362–385. doi:10.1016/j.ridd.2006.02.009.

    PubMed  Article  Google Scholar 

  • Preyde, M., & Burnham, P. V. (2011). Intervention fidelity in psychosocial oncology. Journal of Evidence-Based Social Work, 8, 379–396. doi:10.1080/15433714.2011.542334.

    PubMed  Article  Google Scholar 

  • *Reid, M. J., Webster-Stratton, C., & Hammond, M. (2007). Enhancing a classroom social competence and problem-solving curriculum by offering parent training to families of moderate- to high-risk elementary school children. Journal of Clinical Child and Adolescent Psychology, 36, 605–620. doi:10.1080/15374410701662741.

    PubMed  Article  Google Scholar 

  • Resnick, B., Bellg, A. J., Borrelli, B., De Francesco, C., Breger, R., Hecht, J., et al. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46–54. doi:10.1207/s15324796abm2902s_8.

    PubMed  Article  Google Scholar 

  • Reyno, S. M., & McGrath, P. J. (2005). Predictors of parent training efficacy for child externalizing behavior problems–a meta-analytic review. Journal of Child Psychology and Psychiatry, 47, 99–111. doi:10.1111/j.1469-7610.2005.01544.x.

    Article  Google Scholar 

  • *Roberts, C., Mazzucchelli, T., Studman, L., & Sanders, M. R. (2006). Behavioral family intervention for children with developmental disabilities and behavioral problems. Journal of Clinical Child and Adolescent Psychology, 35, 180–193. doi:10.1207/s15374424jccp3502_2.

    PubMed  Article  Google Scholar 

  • *Rowland, M. D., Halliday-Boykins, C. A., Henggeler, S. W., Cunningham, P. B., Lee, T. G., Kruesi, M. J. P., et al. (2005). A randomized trial of Multisystemic Therapy with Hawaii’s felix class youths. Journal of Emotional and Behavioral Disorders, 13, 13–23. doi:10.1177/10634266050130010201.

    Article  Google Scholar 

  • *Sanders, M. R., Markie-Dadds, C., Tully, L. A., & Bor, W. (2000). The Triple P-Positive Parenting Program: A comparison of enhanced, standard, and self-directed behavioral family intervention for parents of children with early onset conduct problems. Journal of Consulting and Clinical Psychology, 68, 624–640. doi:10.1037//002-006X.68.4.624.

    PubMed  Article  Google Scholar 

  • Sanders, M. R., Turner, K. M. T., & Markie-Dadds, C. (2002). The development and dissemination of the Triple P-Positive Parenting Program: A multilevel, evidence-based system of parenting and family support. Prevention Science, 3, 173–189. doi:10.1023/A:1019942516231.

    PubMed  Article  Google Scholar 

  • *Scahill, L., Sukhodolsky, D. G., Bearss, K., Findley, D., Hamrin, V., Carroll, D. H., et al. (2006). Randomized trial of parent management training in children with tic disorders and disruptive behavior. Journal of Child Neurology, 21, 650–656. doi:10.1177/08830738060210080201.

    PubMed  Article  Google Scholar 

  • *Scherer, D. G., & Brondino, M. J. (1994). Multisystemic family preservation therapy: Preliminary findings from a study of rural and minority serious adolescent offenders. Journal of Emotional and Behavioral Disorders, 2, 198. doi:10.1023/A:1019942516231.

    Article  Google Scholar 

  • Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behavior problems 1 year after Multisystemic Therapy. Administration and Policy in Mental Health and Mental Health Services Research, 35, 379–394. doi:10.1007/s10488-008-0181-z.

    PubMed  Article  Google Scholar 

  • Schoenwald, S. K., & Garland, A. F. (2013). A review of treatment adherence measurement methods. Psychological Assessment, 25, 146–156. doi:10.1037/a0029715.

    PubMed Central  PubMed  Article  Google Scholar 

  • Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32–43. doi:10.1007/s10488-010-0321-0.

    PubMed Central  PubMed  Article  Google Scholar 

  • Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic Therapy: Monitoring treatment fidelity. Family Process, 39, 83–103. doi:10.1111/j.1545-5300.2000.39109.x.

    PubMed  Article  Google Scholar 

  • *Schuhmann, E. M., Foote, R. C., Eyberg, S. M., Boggs, S. R., & Algina, J. (1998). Efficacy of Parent–Child Interaction Therapy: Interim report of a randomized trial with short-term maintenance. Journal of Clinical Child Psychology, 27, 34–45. doi:10.1207/s15374424jccp2701_4.

    PubMed  Article  Google Scholar 

  • Schulz, K., Altman, D., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. British Medical Journal, 340, 698–702. doi:10.1136/bmj.c332.

    Article  Google Scholar 

  • *Scott, S., Sylva, K., Doolan, M., Price, J., Jacobs, B., Crook, C., et al. (2010). Randomised controlled trial of parent groups for child antisocial behaviour targeting multiple risk factors: The SPOKES project. Journal of Child Psychology and Psychiatry, 51, 48–57. doi:10.1111/j.1469-7610.2009.02127.x.

    PubMed  Article  Google Scholar 

  • Silverman, W. K., & Hinshaw, S. P. (2008). The second special issue on evidence-based psychosocial treatments for children and adolescents: A 10-year update. Journal of Clinical Child and Adolescent Psychology, 37, 1–7. doi:10.1080/15374410701817725.

    Article  Google Scholar 

  • Smith, D. K., & Chamberlain, P. (2010). Multidimensional Treatment Foster Care for adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 243–258). New York: Guilford.

    Google Scholar 

  • *Solomon, M., Ono, M., Timmer, S., & Goodlin-Jones, B. (2008). The effectiveness of Parent–Child Interaction Therapy for families of children on the autism spectrum. Journal of Autism and Developmental Disorders, 38, 1767–1776. doi:10.1007/s10803-008-0567-5.

    PubMed  Article  Google Scholar 

  • *Sonuga-Barke, E. J. S., Daley, D., Thompson, M., Laver-Bradbury, C., & Weeks, A. (2001). Parent-based therapies for preschool Attention Deficit/Hyperactivity Disorder: A randomized, controlled trial with a community sample. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 402–408. doi:10.1097/00004583-200104000-00008.

    PubMed  Article  Google Scholar 

  • *Sonuga-Barke, E. J. S., Thompson, M., Daley, D., & Laver-Bradbury, C. (2004). Parent training for Attention Deficit/Hyperactivity Disorder: Is it as effective when delivered as routine rather than as specialist care? British Journal of Clinical Psychology, 43, 449–457.

    PubMed  Article  Google Scholar 

  • *Springer, C., & Reddy, L. A. (2010). Measuring parental treatment adherence in a multimodal treatment program for children with ADHD: A preliminary investigation. Child and Family Behavior Therapy, 32, 272–290. doi:10.1080/07317107.2010.515522.

    Article  Google Scholar 

  • *Stambaugh, L. F., Mustillo, S. A., Burns, B. J., Stephens, R. L., Baxter, B., Edwards, D., et al. (2007). Outcomes from wrap-around and Multisystemic Therapy in a center for mental health services system-of-care demonstration site. Journal of Emotional and Behavioral Disorders, 15, 143–155.

    Article  Google Scholar 

  • *Sundell, K., Hansson, K., Löfholm, C. A., Olsson, T., Gustle, L.-H., & Kadesjö, C. (2008). The transportability of Multisystemic Therapy to Sweden: Short-term results from a randomized trial of conduct-disordered youths. Journal of Family Psychology, 22, 550–560. doi:10.1037/0012790.

    PubMed  Article  Google Scholar 

  • *Thomas, R., & Zimmer-Gembeck, M. J. (2011). Accumulating evidence for Parent–Child Interaction Therapy in the prevention of child maltreatment. Child Development, 82, 177–192. doi:10.1111/j.1467-8624.2010.01548.x.

    PubMed  Article  Google Scholar 

  • *Thompson, M. J. J., Laver-Bradbury, C., Ayres, M., Le Poidevin, E., Mead, S., Dodds, C., et al. (2009). A small-scale randomized controlled trial of the revised new forest parenting programme for preschoolers with attention deficit hyperactivity disorder. European Child and Adolescent Psychiatry, 18, 605–616. doi:10.1007/s00787-009-0020-0.

    PubMed  Article  Google Scholar 

  • *Turner, K. M. T., Richards, M., & Sanders, M. R. (2007). Randomised clinical trial of a group parent education programme for Australian indigenous families. Journal of Paediatrics and Child Health, 43, 429–437. doi:10.1111/j.1440-1754.2007.01053.x.

    PubMed  Article  Google Scholar 

  • *van den Hoofdakker, B. J., Van der Veen-Mulders, L., Sytema, S., Emmelkamp, P. M. G., Minderaa, R. B., & Nauta, M. H. (2007). Effectiveness of behavioral parent training for children with ADHD in routine clinical practice: A randomized controlled study. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1263–1271. doi:10.1097/chi.0b013e3181354bc2.

    PubMed  Article  Google Scholar 

  • *van der Oord, S., Prins, P. J. M., Oosterlaan, J., & Emmelkarnp, P. M. G. (2007). Does brief, clinically based, intensive multimodal behavior therapy enhance the effects of methylphenidate in children with ADHD? European Child and Adolescent Psychiatry, 16, 48–57. doi:10.1007/s00787-006-0574-z.

    PubMed  Article  Google Scholar 

  • *Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: A comparison of child and parent training interventions. Journal of Consulting and Clinical Psychology, 65, 93. doi:10.1037//0022-006X.65.1.93.

    PubMed  Article  Google Scholar 

  • Webster-Stratton, C., & Herman, K. C. (2010). Disseminating Incredible Years series early-intervention programs: Integrating and sustaining services between school and home. Psychology in the Schools, 47, 36–54. doi:10.1002/pits20450.

    Google Scholar 

  • *Webster-Stratton, C. H., Reid, M. J., & Beauchaine, T. (2011). Combining parent and child training for young children with ADHD. Journal of Clinical Child and Adolescent Psychology, 40, 191–203. doi:10.1080/15374416.2011.546044.

    PubMed Central  PubMed  Article  Google Scholar 

  • Webster-Stratton, C., Reid, M. J., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology, 33, 105–124. doi:10.1207/s15374424jccp3301_11.

    PubMed  Article  Google Scholar 

  • Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671. doi:10.1037/0003-066X.61.7.671.

    PubMed  Article  Google Scholar 

  • *Wells, K. C., & Egan, J. (1988). Social learning and systems family therapy for childhood oppositional disorder: Comparative treatment outcome. Comprehensive Psychiatry, 29, 138–146. doi:10.1016/0010-440x(88)90006-5.

    PubMed  Article  Google Scholar 

  • *Werba, B. E., Eyberg, S. M., Boggs, S. R., & Algina, J. (2006). Predicting outcome in Parent–Child Interaction Therapy: Success and attrition. Behavior Modification, 30, 618–646. doi:10.1177/0145445504272977.

    PubMed  Article  Google Scholar 

  • *Wiggins, T. L., Sofronoff, K., & Sanders, M. R. (2009). Pathways Triple P-Positive Parenting Program: Effects on parent–child relationships and child behavior problems. Family Process, 48, 517–530. doi:10.1111/j.1545-5300.2009.01299.x.

    PubMed  Article  Google Scholar 

  • *Williford, A. P., & Shelton, T. L. (2008). Using mental health consultation to decrease disruptive behaviors in preschoolers: Adapting an empirically-supported intervention. Journal of Child Psychology and Psychiatry, 49, 191–200. doi:10.1111/j.1469-7610.2007.01839.x.

    PubMed  Article  Google Scholar 

Download references

Acknowledgments

Special thanks to Dr. Sharon Foster for her feedback on this manuscript.

Author information

Affiliations

  1. Department of Psychology, DePaul University, Chicago, IL, 60614, USA

    Lauren L. Garbacz, Dawn M. Brown, Grace A. Spee, Antonio J. Polo & Karen S. Budd

Authors
  1. Lauren L. Garbacz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dawn M. Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Grace A. Spee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Antonio J. Polo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Karen S. Budd
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lauren L. Garbacz.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Garbacz, L.L., Brown, D.M., Spee, G.A. et al. Establishing Treatment Fidelity in Evidence-Based Parent Training Programs for Externalizing Disorders in Children and Adolescents. Clin Child Fam Psychol Rev 17, 230–247 (2014). https://doi.org/10.1007/s10567-014-0166-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10567-014-0166-2

Keywords

  • Treatment fidelity
  • Treatment integrity
  • Parent training
  • Child
  • Adolescent