Abstract
Dialectical behavior therapy (DBT) can be challenging to implement in community-based settings. Little guidance is available on models to evaluate the effectiveness or sustainability of training and implementation efforts. Residential programs have much to gain from introduction of evidence-based practices, but present their own challenges in implementation. This paper presents a low-cost process evaluation model to assess DBT training piloted in residential programs. The model targets staff and organizational factors associated with successful implementation of evidence-based practices and matches data collection to the four stages of the DBT training model. The strengths and limitations of the evaluation model are discussed.
Similar content being viewed by others
References
Austin, M. J., & Claassen, J. (2008). Impact of organizational change on organizational culture: Implications for introducing evidence-based practice. Journal of Evidence-Based Practice, 5(1–2), 321–358.
Bachelor, A., & Horvath, A. (1999). The therapeutic relationship.
Ben-Porath, D. D., Peterson, G. A., & Smee, J. (2004). Treatment of individuals with borderline personality disorder using dialectical behavior therapy in a community mental health setting: Clinical application and a preliminary investigation. Cognitive and Behavioral Practice, 11(4), 424–434.
Blasko, B. L., & Hiller, M. L. (2014). Clinician ratings of client progress in a therapeutic community treatment setting: Do ratings predict outcomes? Journal of Offender Rehabilitation, 53(4), 253–272.
Bloch, R. M., Saeed, S. A., Rivard, J. C., & Rausch, C. (2006). Lessons learned in implementing evidence-based practices: Implications for psychiatric administrators. Psychiatric Quarterly, 77(4), 309–318.
Burroughs, T., & Somerville, J. (2013). Utilization of evidence based dialectical behavior therapy in assertive community treatment: Examining feasibility and challenges. Community Mental Health Journal, 49(1), 25–32.
Carmel, A., Fruzzetti, A., & Rose, M. (2014a). Dialectical behavior therapy to reduce clinical burnout in a public behavioral health system. Community Mental Health Journal, 50(1), 25–30.
Carmel, A., Rose, M. L., & Fruzzetti, A. E. (2014b). Barriers and solutions to implementing dialectical behavior therapy in a public behavioral health system. Administration and Policy in Mental Health and Mental Health Services Research, 41(5), 608–614.
Colton, M., & Roberts, S. (2007). Factors that contribute to high turnover among residential child care staff. Child and Family Social Work, 12(2), 133–142.
Connor, D. F., McIntyre, E. K., Miller, K., Brown, C., Bluestone, H., Daunais, D., & LeBeau, S. (2003). Staff retention and turnover in a residential treatment center. Residential Treatment for Children and Youth, 20(3), 43–53.
DBT Institute of Michigan. (2009). DBT Skills Group Observation tool. Unpublished instrument.
DBT-Linehan Board of Certification. (2017). Eligibility requirements. Retrieved from http://www.dbt-lbc.org/index.php?page=101133.
Dimeff, L. A., Koerner, K., Woodcock, E. A., Beadnell, B., Brown, M. Z., Skutch, J. M., Paves, A. P., Bazinet, A., & Harned, M. S. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behavior Research and Therapy, 47(11), 921–930.
Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D. (2003). The Session Rating Scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3(1), 3–12.
Feigenbaum, J. (2007). Dialectical behavior therapy: An increasing evidence base. Journal of Mental Health, 16(1), 51–68.
Gotham, H. J. (2006). Advancing the implementation of evidence-based practices into clinical practice: How do we get there from here? Professional Psychology: Research and Practice, 37(6), 606.
Gray, M. J., Elhai, J. D., & Schmidt, L. O. (2007). Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behavior Modification, 31(6), 732–748.
Hawkins, K. A., & Sinha, R. (1998). Can line clinicians master the conceptual complexities of dialectical behavior therapy? An evaluation of a State Department of Mental Health training program. Journal of Psychiatric Research, 32(6), 379–384.
Herschell, A. D., Kogan, J. N., Celedonia, K. L., Gavin, J. G., & Stein, B. D. (2009). Understanding community mental health administrators’ perspectives on dialectical behavior therapy implementation. Psychiatric Services, 60(7), 989–992.
Hesslinger, B., van Elst, L. T., Nyberg, E., Dykierek, P., Richter, H., Berner, M., & Ebert, D. (2002). Psychotherapy of attention deficit hyperactivity disorder in adults. European Archives of Psychiatry and Clinical Neuroscience, 252(4), 177–184.
James, S., Alemi, Q., & Zepeda, V. (2013). Effectiveness and implementation of evidence-based practices in residential care settings. Children and Youth Services Review, 35(4), 642–656.
Koerner, K., & Linehan, M. M. (2000). Research on dialectical behaviour therapy for patients with borderline personality disorder. Psychiatric Clinics of North America, 23(1), 151–167.
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209.
Lenz, A. S., Taylor, R., Fleming, M., & Serman, N. (2014). Effectiveness of dialectical behavior therapy for treating eating disorders. Journal of Counseling and Development, 92, 26–35.
Linehan, M. M. (1993). Cognitive-behavioral treatment of borderline personality disorder. New York: Guildford Press.
Linehan, M. M., & Wilkes, C. R. (2015). The course and evolution of dialectical behavior therapy. American Journal of Psychotherapy, 69(2), 97–110.
McCay, E., Carter, C., Aiello, A., Quesnel, S., Howes, C., & Johansson, B. (2016). Toward treatment fidelity: Developing an approach to measure the treatment integrity of a dialectical behavior therapy intervention with homeless youth in the community. Archives of Psychiatric Nursing, 30(5), 568–574.
McHugh, R. K., Murray, H. W., & Barlow, D. H. (2009). Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions. Behavior Research and Therapy, 47(11), 946–953.
Miller, S. D., Duncan, B. L., & Johnson, L. D. (2000). The session rating scale 3.0. Chicago: Authors.
Miller, A. L., Glinski, J., Woodberry, K. A., Mitchell, A. G., & Indik, J. (2002). Family therapy and dialectical behavior therapy with adolescents: Part I: Proposing a clinical synthesis. American Journal of Psychotherapy, 56(4), 568.
Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29(04), 457–471.
Neacsiu, A. D., Rizvi, S. L., & Linehan, M. M. (2010). Dialectical behavior therapy skills as a mediator and outcome of treatment for borderline personality disorder. Behavior Research and Therapy, 48, 832–839.
Nelson-Gray, R. O., Keane, S. P., Hurst, R. M., Mitchell, J. T., Warburton, J. B., Chok, J. T., & Cobb, A. R. (2006). A modified DBT skills training program for oppositional defiant adolescents: Promising preliminary findings. Behaviour Research and Therapy, 44(12), 1811–1820.
Perseius, K. I., Kaver, A., Ekdahl, S., Asberg, M., & Samualsson, M. (2007). Stress and burnout in psychiatric professionals when starting to use dialectical behavior therapy in the work with young self-harming women showing borderline personality symptoms. Journal of Psychiatric and Mental Health Nursing, 14(7), 635–643.
Ranmuthugala, G., Cunningham, F. C., Plumb, J. J., Long, J., Georgiou, A., Westbrook, J. I., & Braithwaite, J. (2011). A realist evaluation of the role communities of practice in changing healthcare practice. Implementation Science, 6(1), 49–55.
Rathus, J. H., & Miller, A. L. (2002). Dialectical behavior therapy adapted for suicidal adolescents. Suicide and Life-Threatening Behavior, 32(2), 146–171.
Schmidt, H. I. I. I., Ivanoff, A., Korslund, K., & Linehan, M. M. (2008). Program elements of treatment questionnaire. Seattle, WA: Behavioral Research & Therapy Clinics.
Simpson, D. D. (2009). Organizational readiness for stage-based dynamics of innovation implementation. Research on Social Work Practice, 19(5), 541–555.
Sunseri, P. (2004). Preliminary outcomes on use of dialectical behavior therapy to reduce hospitalization among adolescents in residential care. Residential Treatment for Children and Youth, 21(4), 59–76.
Swales, M. (2010). Implementing dialectical behaviour therapy: Organizational pre-treatment. The Cognitive Behaviour Therapist, 3(04), 145–157.
Swales, M., Taylor, B., & Hibbs, R. (2012). Implementing dialectical behavior therapy: Program survival in routine healthcare settings. Journal of Mental Health, 21(6), 548–555.
Swenson, C. R., Torrey, W. C., & Koerner, K. (2002). Implementing dialectical behavior therapy. Psychiatric Services, 53(2), 171–178.
Telch, C. F., Agras, W. S., & Linehan, M. M. (2001). Dialectical behavior therapy for binge eating disorder. Journal of Consulting and Clinical Psychology, 69(6), 1061.
Texas Christian University Institute of Behavioral Research. (2009). Organizational readiness to change. Retrieved from https://ibr.tcu.edu/forms/organizational-staff-assessments/.
Trupin, E., Stewart, D., Beach, B., & Boesky, L. (2002). Effectiveness of a dialectical behavior therapy program for incarcerated female juvenile offenders. Child and Adolescent Mental Health, 7(3), 121–127.
Valentine, S. E., Bankoff, S. M., Poulin, R. M., Reidler, E. B., & Pantalone, D. W. (2015). The use of dialectical behavior therapy skills training as stand-alone treatment: A systematic review of the treatment outcome literature. Journal of Clinical Psychology, 71(1), 1–20.
van den Bosch, L., Verheul, R., Schippers, G. M., & van den Brink, W. (2002). Dialectical behavior therapy of borderline patients with and without substance use problems: Implementation and long-term effects. Addictive Behaviors, 27, 911–923.
Weiner, B. J., Amick, H., & Lee, S. D. (2008). Conceptualization and measurement of organizational readiness to change: A review of the literature in health services research and other fields. Medical Care Research and Review, 65(4), 379–436.
Wenger, E., McDermott, R., & Snyder, W. (2002). Cultivating communities of practice. Boston: Harvard Business School Press.
Wolpow, S., Porter, M., & Hermanos, E. (2000). Adapting a DBT therapy group for use in a residential program. Psychiatric Rehabilitation Journal, 24(2), 135–141.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
DBT Knowledge Assessment Quiz Items
Question | DBT module | Question format |
---|---|---|
Integrating your Emotional Mind and your Rational Mind is part of which skill? | Emotional regulation | Multiple choice |
When you “just notice”, have a “teflon mind”, attach to nothing, you are using which skill? | Mindfulness | Multiple choice |
When you want to get your objective met from others, you should try and use which skill? | Interpersonal skills | Multiple choice |
What skill are you using when you throw yourself into the moment (“All in”) while at the same time you are letting go of the fear of failure, self-consciousness, and judgment? | Mindfulness | Multiple choice |
Which choice is one of the 6 steps of Validation? | Interpersonal effectiveness | Multiple choice |
Creating a validating environment is critical to reducing dysregulation because | Bio-social model | Multiple choice |
Distress Tolerance Skills are to help us get through a tough situation and not make it worse | Distress tolerance | True/false |
If you want an emotion to decrease, do the opposite to the emotion action | Emotional regulation | True/false |
When you give “just the facts” about what you notice, you are using your Describe skill | Mindfulness | True/false |
Multi-tasking and distraction are examples of Mindfulness | Mindfulness | True/false |
People become dysregulated because of an interaction between biological predisposition and an invalidating environment | Bio-social model | True/false |
Wise Mind is the synthesis of ____________ mind and the ______________ mind | Mindfulness | Fill in the blank |
Accepting yourself while simultaneously learning skills to change is an example of _____________ | Dialectics | Fill in the blank |
“We all are doing the best we can AND we can do better” | Dialectics | Matching |
“Just get through it, and don’t make it worse” | Distress tolerance | Matching |
“One thing at a time” | Mindfulness | Matching |
“Throw yourself all in” | Mindfulness | Matching |
“It is what it is” | Dialectics | Matching |
Rights and permissions
About this article
Cite this article
Holbrook, A.M., Hunt, S.R. & See, M.R. Implementation of Dialectical Behavior Therapy in Residential Treatment Programs: A Process Evaluation Model for a Community-Based Agency. Community Ment Health J 54, 921–929 (2018). https://doi.org/10.1007/s10597-017-0224-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10597-017-0224-6