Skip to main content

Advertisement

SpringerLink
Log in

Description of a Fidelity Implementation System: An Example from a Community-Based Children’s Mental Health Program

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

Public policy initiatives to deliver evidence-based practices in community settings have increased the need to develop implementation feedback systems to assist program administrators adopting the practices as well as researchers who wish to continue the line of research. This paper contributes to the efforts to reduce the implementation gap in the children’s mental health services field by exploring the concept of fidelity and highlights its importance to the adoption of evidence-based practices. Fidelity, or the degree to which interventions are implemented as originally designed, is generally conceptualized as a system of five unique and interrelated components including adherence, dosage, participant responsiveness, quality of delivery, and program differentiation. Definitions and a critical analysis of each of the component’s strengths and weaknesses are offered while discussing the integrated nature of each component. An example of the development and use of the five components of fidelity within a community-based evidence-based program is described.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abbott, R. D., O’Donnell, J., Hawkins, D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542–552.

    Article  PubMed  Google Scholar 

  • Andrade, A. R., Lambert, E. W., & Bickman, L. (2000). Dose effect in child psychotherapy: Outcomes associated with negligible treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 161–168. doi:10.1097/00004583-200002000-00014.

    Article  PubMed  Google Scholar 

  • Barat, I., Andreasen, F., & Damsgaard, E. M. S. (2001). Drug therapy in the elderly: What doctors believe and patients actually do. British Journal of Clinical Pharmacology, 51, 615–622.

    Article  PubMed  Google Scholar 

  • Barkham, M., Connell, J., Stiles, W., Miles, J., Margison, F., Evans, C., et al. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74(1), 160–167.

    Article  PubMed  Google Scholar 

  • Bernfield, G. A., Farrington, D. P., & Leschied, A. W. (2001). Offender rehabilitation in practice; Implementation and evaluation effective programs. New York: Wiley.

    Google Scholar 

  • Bickman, L., Andrade, A. R., & Lambert, E. W. (2002). Dose response in child and adolescent mental health services. Mental Health Services Research, 4(2), 57–70.

    Article  PubMed  Google Scholar 

  • Botvin, G. J., Baker, E., Dusenbemy, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive behavioral approach: Results of a 3 year study. Journal of Consulting and Clinical Psychology, 5(8), 437–446.

    Article  Google Scholar 

  • Botvin, G. J., Dusenberry, L., Baker, E., James-Ortiz, S., & Rerner, J. (1989). A skills training approach to smoking prevention among Hispanic youth. Journal of Behavioral Medicine, 12, 279–296.

    Article  PubMed  Google Scholar 

  • Brandon, P. R., Taum, A. K. H., Young, D. B., Pottenger, P. M., I. I. I., & Speitel, T. W. (2008). The complexity of measuring the quality of program implementation with observations. The American Journal of Evaluation, 29(3), 235–250.

    Article  Google Scholar 

  • Burns, N., & Grove, S. K. (2005). The practice of nursing research: Conduct, critique, and utilization (5th ed.). St. Louis, MO: Elsevier Saunders.

    Google Scholar 

  • Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity [Electronic version]. Implementation Science, 2, 40. doi:10.1186/1748-5908-2-40.

    Article  PubMed  Google Scholar 

  • Dane, A., & Schneider, B. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–24.

    Article  PubMed  Google Scholar 

  • Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221.

    Article  Google Scholar 

  • Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5–18.

    Article  Google Scholar 

  • Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.

    Article  PubMed  Google Scholar 

  • Fixsen, D. L, Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).

  • Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.

    Article  PubMed  Google Scholar 

  • Gonzales, J. J., Ringeisen, H. L., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying “evidence”. Clinical Psychology: Science and Practice, 9, 204–209.

    Article  Google Scholar 

  • Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (1999). Preventing mental disorder in school-aged children: A review of the effectiveness of prevention programs. Report submitted to The Center for Mental Health Services (SAMHSA), Prevention Research Center, Pennsylvania State University (obtainable at http://www.psu.edu/dept/prevention/).

  • Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth-grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568–579.

    PubMed  Google Scholar 

  • Hansen, W. B., & McNeil, R. B. (1999). Drug education practice: Results of an observational study. Health Education Research, 14(1), 85–97.

    Article  PubMed  Google Scholar 

  • Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27, 711–731.

    Article  PubMed  Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press. http://www.guilford.com.

  • Hoagwood, K., Cavaleri, M., Olin, S., Burns, B., Slaton, E., Gruttadaro, D., et al. (2010). Family support in children’s mental health: A review and synthesis. Clinical Child and Family Psychology Review, 13(1), 1–45.

    Article  PubMed  Google Scholar 

  • Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33(2), 191–211.

    Article  Google Scholar 

  • Hulleman, C., & Cordray, D. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2, 88–110.

    Article  Google Scholar 

  • Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press.

    Google Scholar 

  • Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62, 617–627.

    Article  PubMed  Google Scholar 

  • Kutash, K., Duchnowski, A. J., Green, A., & Ferron, J. M. (2011). Supporting parents who have youth with emotional disturbances through a parent-to-parent support program: A proof of concept study using random assignment. Administration and Policy in Mental Health and Mental Health Services Research, 38(5), 412–427. doi:10.1007/s10488-010-0329-5.

    Article  PubMed  Google Scholar 

  • Landsverk, J., Brown, H., Aarons, G. A., Chamberlain, P., Gibbons, R., Horwitz, S. M., et al. (2010). Study design issues in implementation research: Application to child welfare settings. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–63.

    Google Scholar 

  • Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., et al. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18(2), 133–141.

    Article  PubMed  Google Scholar 

  • Lynch, S., & O’Donnell, C. (2005). The evolving definition, measurement, and conceptualization of fidelity of implementation in scale-up of highly rated science curriculum units in diverse middle schools. Paper presented at the meeting of the American Educational Research Association, Montreal, Canada.

  • Maidment, R., Livingston, G., & Katona, C. (2003). “Just keep taking the tablets”: Adherence to antidepressant treatment in older people in primary care. International Journal of Geriatric Psychiatry, 17, 752–757.

    Article  Google Scholar 

  • McBride, N., Farringdon, F., & Midford, R. (2002). Implementing a school drug education programme: Reflections on fidelity. International Journal of Health Promotion Education, 40, 40–50.

    Google Scholar 

  • Mihalic, S. (2002). The importance of implementation fidelity. Retrieved from the Center for the Study of Violence and Prevention website: www.colorado.edu/cspv/blueprints/Fidelity.pdf.

  • National Institute of Mental Health. (2004). Advancing the science of implementation: Improving the fit between mental health intervention development and service systems. Retrieved September 25, 2006 from http://www.nimh.nih.gov/scienfidmeetings/scienceofimplmentation/pdf.

  • O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in k-12 curriculum intervention research. Review of Educational Research, 78(1), 33–84.

    Article  Google Scholar 

  • Proctor, E. K., & Landsverk, J. (2005). Challenges of translating evidence-based treatments into practice contexts and service sectors. Paper presented at the Mental Health Services Research Conference, Washington, DC.

  • Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services, 36, 24–34.

    Article  Google Scholar 

  • Resnick, B., Bellg, A. J., Borrelli, B., DeFrancesco, C., Breger, R., & Hecht, J. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46–54.

    Article  PubMed  Google Scholar 

  • Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions, 29, 302–333.

    Article  Google Scholar 

  • Sanchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of Reconnecting Youth. Health Education Research, 22, 95–107. doi:10.1093/her/cyl052.

    Article  PubMed  Google Scholar 

  • Scanlon, J. W., Horst, P., Nay, J. W., Schmidt, R. E., & Waller, J. D. (1977). Evaluability assessment: Avoiding type III or IV errors. In G. R. Gilbert & P. J. Conklin (Eds.), Evaluation management: A source book of readings. Charlottesville: U.S. Civil Service Commission.

    Google Scholar 

  • Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. L., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32–43.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190–1197.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Child and Adolescent Clinical Psychology, 33, 94–104.

    Article  Google Scholar 

  • Schulte, A. C., Easton, J. E., & Parker, J. (2009). Advances in treatment integrity research: Multidisciplinary perspectives on the conceptualization, measurement, and enhancement of treatment integrity. School Psychology Review, 38(4), 460–475.

    Google Scholar 

  • Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. E. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Child and Family Studies, University of South Florida, Tampa, FL, USA

    Krista Kutash, Brittany Cross, Anthony Madias, Albert J. Duchnowski & Amy L. Green

Authors
  1. Krista Kutash
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brittany Cross
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anthony Madias
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Albert J. Duchnowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Amy L. Green
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krista Kutash.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kutash, K., Cross, B., Madias, A. et al. Description of a Fidelity Implementation System: An Example from a Community-Based Children’s Mental Health Program. J Child Fam Stud 21, 1028–1040 (2012). https://doi.org/10.1007/s10826-012-9565-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-012-9565-5

Keywords

Search

Navigation