Advertisement

The Juggling Act of Supervision in Community Mental Health: Implications for Supporting Evidence-Based Treatment

  • Shannon DorseyEmail author
  • Michael D. Pullmann
  • Suzanne E. U. Kerns
  • Nathaniel Jungbluth
  • Rosemary Meza
  • Kelly Thompson
  • Lucy Berliner
Original Article

Abstract

Supervisors are an underutilized resource for supporting evidence-based treatments (EBTs) in community mental health. Little is known about how EBT-trained supervisors use supervision time. Primary aims were to describe supervision (e.g., modality, frequency), examine functions of individual supervision, and examine factors associated with time allocation to supervision functions. Results from 56 supervisors and 207 clinicians from 25 organizations indicate high prevalence of individual supervision, often alongside group and informal supervision. Individual supervision serves a wide range of functions, with substantial variation at the supervisor-level. Implementation climate was the strongest predictor of time allocation to clinical and EBT-relevant functions.

Keywords

Evidence-based treatment supervision Implementation climate Community mental health 

Notes

Acknowledgements

The authors would like to acknowledge the Division of Behavioral Health and Recovery in Washington State, who funded the TF-CBT Initiative. We also thank the many clinicains and supervisors who partnered with us on this research.

Funding

This study was funded by NIMH (R01 MH095749).

Compliance with Ethical Standards

Conflict of interest

Authors Dorsey, Jungbluth, and Berliner have received honorariums for providing TF-CBT training. Authors Pullmann, Kerns, Meza, and Thompson declare no conflicts of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

References

  1. Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5(2), 88–96. doi: 10.1037/a0023537.CrossRefPubMedPubMedCentralGoogle Scholar
  2. Baker-Ericzén, M. J., Jenkins, M. M., Park, S., & Garland, A. F. (2015). Clinical decision-making in community children’s mental health: Using innovative methods to compare clinicians with and without training in evidence-based treatment. Child and Youth Care Forum, 44(1), 133–157. doi: 10.1007/s10566-014-9274-x.CrossRefPubMedGoogle Scholar
  3. Bearman, S. K., Schneiderman, R. L., & Zoloth, E. (2016). Building an evidence base for effective supervision practices: An analogue experiment of supervision to increase EBT fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 1–15. doi: 10.1007/s10488-016-0723-8.
  4. Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., Research Network on Youth Mental Health. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40 (6), 518–529. doi: 10.1007/s10488-013-0485-5.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665. doi: 10.1176/appi.ps.201100401.CrossRefPubMedPubMedCentralGoogle Scholar
  6. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology, 17(1), 1–30. doi: 10.1111/j.1468-2850.2009.01187.x.PubMedPubMedCentralGoogle Scholar
  7. Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., Mandel, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. doi: 10.1001/jamapediatrics.2014.3736.CrossRefPubMedPubMedCentralGoogle Scholar
  8. Bickman, L. (2000). Our quality-assurance methods aren’t so sure. Behavioral Health Tomorrow, 9(3), 41–42.Google Scholar
  9. Borders, L. D. (2005). Snapshot of clinical supervision in counseling and counselor education: A five-year review. The Clinical Supervisor, 24(1–2), 69–113. doi: 10.1300/J001v24n01_05.Google Scholar
  10. Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes towards evidence based practices: Are the concerns with the evidence or the manuals? Psychiatric Services, 60, 677–681. doi: 10.1176/appi.ps.60.5.677.CrossRefPubMedGoogle Scholar
  11. Chorpita, B. F., & Regan, J. (2009). Dissemination of effective mental health treatment procedures: Maximizing the return on a significant investment. Behavior Research and Therapy, 47, 990–993. doi: 10.1016/j.brat.2009.07.002.CrossRefGoogle Scholar
  12. Cicchetti, D. V. (1994). Guidelines, criteria, and rule of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi: 10.1037/1040-3590.6.4.284.CrossRefGoogle Scholar
  13. Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006). Treating trauma and traumatic grief in children and adolescents. New York City: Guilford Press.Google Scholar
  14. Crespi, T. D., & Dube, J. M. B (2005). Clinical supervision in school psychology: Challenges, considerations, and ethical and legal issues for clinical supervisors. The Clinical Supervisor, 24, 115–135. doi: 10.1300/J001v24n01_06.CrossRefGoogle Scholar
  15. Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E. U., Thompson, K., Unützer, J., & Garland, A. F. (2013). Improving practice in community-based settings: A randomized trial of supervision—study protocol. Implementation Science, 8(89). doi: 10.1186/1748-5908-8-89.
  16. Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M. D., & Murray, L. K. (2016a). A statewide common elements initiative for children’s mental health. The Journal of Behavioral Health Services and Research, 43(2), 246–261. doi: 10.1007/s11414-014-9430-y.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Dorsey, S., Pullmann, M. P., Kerns, S. E., Jungbluth, N., Berliner, B., Thompson, K., & Segel, E. (2016b). Efficient sustainability: Existing community based supervisors as evidence-based treatment supports. In C. C. Lewis (Ed.), Proceedings of the 3rd Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2015: Advancing efficient methodologies through community partnerships and team science (A63). Seattle.Google Scholar
  18. Edmunds, J., Beidas, R., & Kendall, P. (2013). Dissemination and implementation of evidence–based practices: Training and consultation as implementation strategies. Clinical Psychology, 20(2), 152–165. doi: 10.1111/cpsp.12031.PubMedPubMedCentralGoogle Scholar
  19. Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9, 157. doi: 10.1186/s13012-014-0157-1.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Ellis, M., Krengel, M., Ladany, N., & Schult, D. (1996). Clinical supervision research from 1981 to 1993: A methodological critique. Journal of Counseling Psychology, 43, 35–50.CrossRefGoogle Scholar
  21. Fairburn, C. G., & Cooper, Z. (2011). Therapist competence, therapy quality, and therapist training. Behaviour Research and Therapy, 49(6–7), 373–378. doi: 10.1016/j.brat.2011.03.005.CrossRefPubMedPubMedCentralGoogle Scholar
  22. Henggeler, S., Schoenwald, S., Liao, J., Letourneau, E., & Edwards, D. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child and Adolescent Psychology, 31, 155–167. doi: 10.1207/S15374424JCCP3102_02.CrossRefPubMedGoogle Scholar
  23. Henggeler, S. W., Mihalic, S. F., Rone, L., Thomas, C., & Timmons-Mitchell, J. (1998). Multisystemic therapy. In D. S. Elliott (Series Ed.), Blueprints for violence prevention. Boulder: University of Colorado at Boulder, Center for the Study and Prevention of Violence, Blueprints Publications.Google Scholar
  24. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. doi: 10.1016/j.cpr.2010.02.005.CrossRefPubMedPubMedCentralGoogle Scholar
  25. Hoge, M. A., Migdole, S., Farkas, M. S., Ponce, A. N., & Hunnicutt, C. (2011). Supervision in public sector behavioral health: A review. The Clinical Supervisor, 30(2), 183–203. doi: 10.1080/07325223.2011.604276.CrossRefGoogle Scholar
  26. Jacobs, S. R., Weiner, B. J., & Bunger, A. C. (2014). Context matters: Measuring implementation climate among individuals and groups. Implementation Science, 9(46). doi: 10.1186/1748-5908-9-46.
  27. Kelly, J. A., Heckman, T. G., Stevenson, L. Y., Williams, P. N., Ertl, T., Hays, R. B., Neumann, M. S. (2000). Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12(5 Suppl), 87–98.PubMedGoogle Scholar
  28. Kilminster, S. M., & Jolly, B. C. (2000). Effective supervision in clinical practice settings: A literature review. Medical Education, 34, 827–840. doi: 10.1046/j.1365-2923.2000.00758.x.CrossRefPubMedGoogle Scholar
  29. Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. The Academy of Management Review, 21(4), 1055–1080. doi: 10.5465/AMR.1996.9704071863.Google Scholar
  30. Lambert, M. J., & Ogles, B. M. (1997). The effectiveness of psychotherapy supervision. In C. E. Watkins (Ed.), Handbook of psychotherapy supervision (pp. 421–446). New York: Wiley.Google Scholar
  31. Marsh, H., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A., Abduljabbar, A., & Köller, O. (2012). Classroom climate and contextual Effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47(2), 106–124. doi: 10.1080/00461520.2012.670488.CrossRefGoogle Scholar
  32. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational learning. Journal of Consulting and Clinical Psychology, 72(6), 1050–1062. doi: 10.1037/0022-006X.72.6.1050.CrossRefPubMedGoogle Scholar
  33. Milne, D. (2007). An empirical definition of clinical supervision. British Journal of Clinical Psychology, 46(4), 437–447. doi: 10.1348/014466507X197415.CrossRefPubMedGoogle Scholar
  34. Milne, D. (2009). Evidence-based clinical supervision. Chichester: BPS Blackwell.Google Scholar
  35. Milne, D., & James, I. (2000). A systematic review of effective cognitive-behavioural supervision. British Journal of Clinical Psychology, 39(2), 111–127. doi: 10.1348/014466500163149.CrossRefPubMedGoogle Scholar
  36. Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450. doi: 10.1007/s10488-013-0502-8.CrossRefPubMedPubMedCentralGoogle Scholar
  37. Park, H., Ebesutani, C., Chung, K., & Stanick, C. (2016). Cross-cultural validation of the modified practice attitudes scale: Initial factor analysis and a new factor model. Assessment. doi: 10.1177/1073191116634202.Google Scholar
  38. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.Google Scholar
  39. Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Research Network on Youth Mental Health (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 84–97. doi: 10.1007/s10488-007-0147-6.CrossRefPubMedGoogle Scholar
  40. Sburlati, E. S., Schniering, C. A., Lyneham, H. J., & Rapee, R. M. (2011). A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clinical Child and Family Psychology Review, 14(1), 89–109. doi: 10.1007/s10567-011-0083-6.CrossRefPubMedGoogle Scholar
  41. Schoenwald, S. K., Hoagwood, K. E., Atkins, M. S., Evans, M. E., & Ringeisen, H. (2010). Workforce development and the organization of work: The science we need. Administration and Policy in Mental Health and Mental Health Services Research, 37, 71–80. doi: 10.1007/s10488-010-0278-z.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Schoenwald, S. K., Mehta, T. G., Frazier, S. L., & Shernoff, E. S. (2013). Clinical supervision in effectiveness and implementation research. Clinical Psychology, 20(1), 44–59. doi: 10.1111/cpsp.12022.Google Scholar
  43. Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410–421. doi: 10.1037/a0013788.CrossRefPubMedPubMedCentralGoogle Scholar
  44. Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child and Adolescent Psychology, 33(1), 94–104. doi: 10.1207/S15374424JCCP3301_10.CrossRefPubMedGoogle Scholar
  45. Southam-Gerow, M. A., & Kendall, P. C. (2016). Supervising a manual-based treatment program: Experiences from university-based and community-based clinics. In T. K. O’Neill (Ed.), Helping others help children: Clinical supervision of child psychotherapy (pp. 123–126). Washington, DC: American Psychological Association.Google Scholar
  46. Stirman, S. W., Gutner, C. A., Gamarra, J., Vogt, D., Suvak, M., Wachen, J. S., & Resick, P. A. (2016). Leveraging routine clinical materials to assess fidelity to an evidence-based psychotherapy. In C. C. Lewis (Ed.), Proceedings of the 3rd Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2015: advancing efficient methodologies through community partnerships and team science (A12). Seattle, WA.Google Scholar
  47. Stirman, S. W., Pontoski, K., Creed, T., Xhezo, R., Evans, A. C., Beck, A. T., & Crits-Christoph, P. (2015). A non-randomized comparison of strategies for consultation in a community-academic training program to implement an evidence-based psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 1–12. doi: 10.1007/s10488-015-0700-7.
  48. Weiner, B. J., Belden, C. M., Bergmire, D. M., & Johnston, M. (2011). The meaning and measurement of implementation climate. Implementation Science, 6(78). doi: 10.1186/1748-5908-6-78.
  49. Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60, 628–648. doi: 10.1037/0003-066X.60.6.628.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.University of WashingtonSeattleUSA
  2. 2.University of DenverDenverUSA
  3. 3.Harborview Center for Sexual Assault and Traumatic StressSeattleUSA
  4. 4.Department of PsychologyUniversity of WashingtonSeattleUSA

Personalised recommendations