Skip to main content

Advertisement

SpringerLink
Log in

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess “analogue fidelity” in a children’s mental health quality improvement initiative. Results indicated low—but representative—clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5(2), 88.

    Article  PubMed  PubMed Central  Google Scholar 

  • Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331.

    Article  CAS  PubMed  Google Scholar 

  • Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Research Network on Youth Mental Health. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 518–529.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., Cross, W., & Dorsey, S. (2014). Show me, don’t tell me: Behavioral rehearsal asa training and analogue fidelity tool. Cognitive and Behavioral Practice, 21(1), 1–11.

    Article  PubMed  Google Scholar 

  • Beidas, R. S., Edmunds, J. M., Cannuscio, C. C., Gallagher, M., Downey, M. M., & Kendall, P. C. (2013). Therapists perspectives on the effective elements of consultation following training. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 507–517. doi:10.1007/s10488-013-0475-7.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30.

    Google Scholar 

  • Beidas, R. S., Koerner, K., Weingardt, K. R., & Kendall, P. C. (2011). Training research: Practical recommendations for maximum impact. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 223–237. doi:10.1007/s10488-011-0338-z.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., et al. (2015a). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. doi:10.1001/jamapediatrics.2014.3736.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., Marcus, S., Wolk, C. B., Powell, B., Aarons, G. A., Evans, A. C., et al. (2015b). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-015-0673-6.

    PubMed  PubMed Central  Google Scholar 

  • Bernstein, A., Chorpita, B. F., Daleiden, E. L., Ebesutani, C. K., & Rosenblatt, A. (2015). Building an evidence-informed service array: Considering evidence-based programs as well as their practice elements. Journal of Consulting and Clinical Psychology, 83(6), 1085–1096. doi:10.1037/ccp0000029.

    Article  PubMed  Google Scholar 

  • Brookman-Frazee, L., Garland, A. F., Taylor, R., & Zoffness, R. (2009). Therapists’ attitudes towards psychotherapeutic strategies in community-based psychotherapy with children with disruptive behavior problems. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 1–12. doi:10.1007/s10488-008-0195-6.

    Article  PubMed  Google Scholar 

  • Brookman-Frazee, L., Haine, R. A., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2010). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 254–269. doi:10.1007/s10488-009-0244-9.

    Article  PubMed  Google Scholar 

  • Chapman, J. E., McCart, M. R., Letourneau, E. J., & Sheidow, A. J. (2013). Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of Consulting and Clinical Psychology, 81(4), 674–680. doi:10.1037/a0033021.

    Article  PubMed  PubMed Central  Google Scholar 

  • Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566.

    Article  PubMed  Google Scholar 

  • Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20.

    Article  PubMed  Google Scholar 

  • Chorpita, B. F., Park, A., Tsai, K., Korathu-Larson, P., Higa-McMillan, C. K., Nakamura, B. J., et al. (2015). Balancing effectiveness with responsiveness: Therapist satisfaction across different treatment designs in the Child STEPs randomized effectiveness trial. Journal of Consulting and Clinical Psychology. doi:10.1037/a0039301.

    Google Scholar 

  • Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284.

    Article  Google Scholar 

  • Cross, W. F., Seaburn, D., Gibbs, D., Schmeelk-Cone, K., White, A. M., & Caine, E. D. (2011). Does practice make perfect? A randomized control trial of behavioral rehearsal on suicide prevention gatekeeper skills. The Journal of Primary Prevention, 32(3–4), 195–211.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M., & Murray, L. K. (2014). A statewide common elements initiative for children’s mental health. Journal of Behavioral Health Services and Research. doi:10.1007/s11414-014-9430-y.

    Google Scholar 

  • Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., et al. (2013). Improving practice in community-based settings: A randomized trial of supervision—study protocol. Implementation Science, 8(89), 1–12.

    Google Scholar 

  • Edmunds, J. M., Kendall, P. C., Ringle, V. A., Read, K. L., Brodman, D. M., Pimentel, S. S., & Beidas, R. S. (2013). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 456–466. doi:10.1007/s10488-013-0490-8.

    Article  PubMed  Google Scholar 

  • Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26.

    Article  PubMed  PubMed Central  Google Scholar 

  • Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30, 448–466.

    Article  PubMed  PubMed Central  Google Scholar 

  • Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11(3), 267–288.

    Google Scholar 

  • Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68(3), 451.

    Article  PubMed  Google Scholar 

  • Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 37, 230–244.

    Article  PubMed  Google Scholar 

  • Kazantzis, N., Deane, F. P., & Ronan, K. R. (2000). Homework assignments in cognitive and behavior therapy: A meta-analysis. Clinical Psychology: Science and Practice, 7(2), 189–202. doi:10.1093/clipsy.7.2.189.

    Google Scholar 

  • Kazantzis, N., Deane, F. P., Ronan, K. R., & L’Abate, L. (Eds.). (2005). Using homework assignments in cognitive behavior therapy. New York: Routledge.

    Google Scholar 

  • Kazantzis, N., Whittington, C., & Dattilio, F. (2010). Meta-analysis of homework effects in cognitive behavioral therapy: A replication and extension. Clinical Psychology: Science and Practice, 17(2), 144–156. doi:10.1111/j.1468-2850.2010.01204.x.

    Google Scholar 

  • Lyon, A. R., Dorsey, S., Pullman, M., Silbaugh-Cowdin, J., & Berliner, L. (2014). Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Administration and Policy in Mental Health and Mental Health Services Research, 42(1), 47–60.

    Article  Google Scholar 

  • McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65(2), 73.

    Article  PubMed  Google Scholar 

  • McLeod, B. D., Smith, M. M., Southam-Gerow, M. A., Weisz, J. R., & Kendall, P. C. (2015). Measuring treatment differentiation for implementation research: The Therapy Process Observational Coding System for Child Psychotherapy Revised Strategies Scale. Psychological Assessment, 27(1), 314–325. doi:10.1037/pas0000037.

    Article  PubMed  Google Scholar 

  • McLeod, B. D., & Weisz, J. R. (2010). The therapy process observational coding system for child psychotherapy strategies scale. Journal of Clinical Child & Adolescent Psychology, 39(3), 436–443.

    Article  Google Scholar 

  • Merikangas, K. R., He, J. P., Brody, D., Fisher, P. W., Bourdon, K., & Koretz, D. S. (2010). Prevalence and treatment of mental disorders among US children in the 2001–2004 NHANES. Pediatrics, 125(1), 75–81.

    Article  PubMed  Google Scholar 

  • Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29, 457–471. doi:10.1017/S1352465801004064.

    Article  Google Scholar 

  • Nakamura, B. J., Selbo-Bruns, A., Okamura, K., Chang, J., Slavin, L., & Shimabukuro, S. (2014). Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy. Behaviour Research and Therapy, 53, 10–19. doi:10.1016/j.brat.2013.12.001.

    Article  PubMed  Google Scholar 

  • Outcome Evaluation of Washington State’s Evidence-Based Programs for Juvenile Offenders, January 2004. Washington State Institute for Public Policy, Report #04-01-1201.

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829.

    Article  PubMed  Google Scholar 

  • Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21. doi:10.1186/s13012-015-0209-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America.

  • Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76.

    Article  PubMed  Google Scholar 

  • Rakovshik, S. G., & McManus, F. (2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496–516.

    Article  PubMed  Google Scholar 

  • Ringle, V. A., Read, K. L., Edmunds, J. M., Brodman, D. M., Kendall, P. C., Barg, F., & Beidas, R. S. (2015). Barriers to and facilitators in the implementation of cognitive-behavioral therapy for youth anxiety in the community. Psychiatric Services, 66(9), 938–945.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sburlati, E. S., Schniering, C. A., Lyneham, H. J., & Rapee, R. M. (2011). A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clinical Child and Family Psychology Review, 14(1), 89–109.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., & Garland, A. F. (2013). A review of treatment adherence measurement methods. Psychological Assessment, 25(1), 146–156.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43.

    Article  PubMed  PubMed Central  Google Scholar 

  • Schulman, K. A., Berlin, J. A., Harless, W., Kerner, J. F., Sistrunk, S., Gersh, B. J., et al. (1999). The effect of race and sex on physicians’ recommendations for cardiac catheterization. New England Journal of Medicine, 340(8), 618–626. doi:10.1056/NEJM199902253400806.

    Article  CAS  PubMed  Google Scholar 

  • Shah, H., Rossen, B., Lok, B., Londino, D., Lind, S. D., & Foster, A. (2012). Interactive virtual-patient scenarios: An evolving tool in psychiatric education. Academic Psychiatry, 36(2), 146–150. doi:10.1176/appi.ap.10030049.

    Article  PubMed  Google Scholar 

  • Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis. New York: Oxford University Press.

    Book  Google Scholar 

  • Ward, A. M., Regan, J., Chorpita, B. F., Starace, N., Rodriguez, A., Okamura, K., & Research Network on Youth Mental Health. (2013). Tracking evidence based practice with youth: Validity of the MATCH and Standard Manual Consultation Records. Journal of Clinical Child & Adolescent Psychology, 42(1), 44–55.

    Article  Google Scholar 

  • Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282.

    Article  PubMed  Google Scholar 

  • Weisz, J. R., & Gray, J. S. (2008). Evidence-based psychotherapy for children and adolescents: Data from the present and a model for the future. Child and Adolescent Mental Health, 13(2), 54–65. doi:10.1111/j.1475-3588.2007.00475.x.

    Article  Google Scholar 

  • Williams, C., Martinez, R., Dafters, R., Ronald, L., & Garland, A. (2011). Training the wider workforce in cognitive behavioural self-help: The SPIRIT (Structured Psychosocial Interventions in Teams) training course. Behavioural and Cognitive Psychotherapy, 39(02), 139–149.

    Article  PubMed  Google Scholar 

  • Young, J. & Beck, A. T. (1980). Cognitive therapy scale rating manual. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA.

Download references

Acknowledgments

This publication was made possible in part by funding from the Washington State Department of Social and Health Services, Division of Behavioral Health Recovery, and from Grant Numbers R01 MH095749, K23 MH099179, and K08 MH095939, awarded from the National Institute of Mental Health (NIMH). Drs. Dorsey, Lyon, and Beidas are investigators with the Implementation Research Institute (IRI) (2011-2014), at the George Warren Brown School of Social Work, Washington University in St. Louis; through an award from the National Institute of Mental Health (R25 MH080916) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI).

Author information

Authors and Affiliations

  1. Department of Psychology, University of Washington, 335 Guthrie Hall, Box 351525, Seattle, WA, 98195, USA

    Shannon Dorsey, Nathaniel Jungbluth & Lucy Berliner

  2. Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA

    Aaron R. Lyon & Michael D. Pullmann

  3. Harborview Center for Sexual Assault and Traumatic Stress, Seattle, USA

    Lucy Berliner

  4. Perelman School of Medicine, University of Pennsylvania, Philadelphia, USA

    Rinad Beidas

Authors
  1. Shannon Dorsey
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aaron R. Lyon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael D. Pullmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nathaniel Jungbluth
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lucy Berliner
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rinad Beidas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shannon Dorsey.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dorsey, S., Lyon, A.R., Pullmann, M.D. et al. Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative. Adm Policy Ment Health 44, 395–404 (2017). https://doi.org/10.1007/s10488-016-0727-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-016-0727-4

Keywords

Search

Navigation