Abstract
The importance of clinical supervision for supporting effective implementation of evidence-based treatments (EBTs) is widely accepted; however, very little is known about which supervision practice elements contribute to implementation effectiveness. This systematic review aimed to generate a taxonomy of empirically-supported supervision practice elements that have been used in treatment trials and shown to independently predict improved EBT implementation. Supervision practice elements were identified using a two-phase, empirically-validated distillation process. In Phase I, a systematic review identified supervision protocols that had evidence of effectiveness based on (a) inclusion in one or more EBT trials, and (b) independent association with improved EBT implementation in one or more secondary studies. In Phase II, a hybrid deductive-inductive coding process was applied to the supervision protocols to characterize the nature and frequency of supervision practice elements across EBTs. Twenty-one of the 876 identified articles assessed the associations of supervision protocols with implementation or clinical outcomes, representing 13 separate studies. Coding and distillation of the supervision protocols resulted in a taxonomy of 21 supervision practice elements. The most frequently used elements were: reviewing supervisees’ practice (92%; n = 12), clinical suggestions (85%; n = 11), behavioral rehearsal (77%; n = 10), elicitation (77%; n = 10), and fidelity assessment (77%; n = 10). This review identified supervision practice elements that could be targets for future research testing which elements are necessary and sufficient to support effective EBT implementation. Discrepancies between supervision practice elements observed in trials as compared to routine practice highlights the importance of research addressing supervision-focused implementation strategies.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Change history
21 March 2022
A Correction to this paper has been published: https://doi.org/10.1007/s10488-022-01193-3
References
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35(1), 255–274. https://doi.org/10.1146/annurev-publhealth-032013-182447
Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5(2), 88–96. https://doi.org/10.1037/a0023537
Alfonsson, S., Parling, T., Spannargard, A., Andersson, G., & Lundgren, T. (2018). The effects of clinical supervision on supervisees and patients in cognitive behavioral therapy: A systematic review. Cognitive Behaviour Therapy, 47(3), 206–228. https://doi.org/10.1080/16506073.2017.1369559
American Psychological Association. (2014). APA guidelines for clinical supervision in health service psychology. Retrieved from https://www.apa.org/about/policy/guidelines-supervision.pdf
American Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.
Association of Social Work Boards. (2019). An analysis of supervision for social work licensure guidelines on supervision for regulators and educators. Retrieved from https://www.aswb.org/wp-content/uploads/2021/01/Supervision-Analysis.pdf
Bailin, A., Bearman, S. K., & Sale, R. (2018). Clinical supervision of mental health professionals serving youth: Format and microskills. Administration and Policy in Mental Health and Mental Health Services Research, 45(5), 800–812. https://doi.org/10.1007/s10488-018-0865-y
Bearman, S. K., Schneiderman, R. L., & Zoloth, E. (2017). Building an evidence base for effective supervision practices: An analogue experiment of supervision to increase EBT fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 44(2), 293–307. https://doi.org/10.1007/s10488-016-0723-8
Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Bernstein, A. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 518–529. https://doi.org/10.1007/s10488-013-0485-5
Beckman, M., Forsberg, L., Lindqvist, H., Diez, M., Enö Persson, J., & Ghaderi, A. (2017). The dissemination of motivational interviewing in Swedish county councils: Results of a randomized controlled trial. PLoS ONE, 12(7), e0181715. https://doi.org/10.1371/journal.pone.0181715
Beckman, M., Forsberg, L., Lindqvist, H., & Ghaderi, A. (2020). Providing objective feedback in supervision in motivational interviewing: Results from a randomized controlled trial. Behavioural and Cognitive Psychotherapy, 48(4), 383–394. https://doi.org/10.1017/S1352465819000687
Beckman, M., Lindqvist, H., Öhman, L., Forsberg, L., Lundgren, T., & Ghaderi, A. (2021). Ongoing supervision as a method to implement Motivational interviewing: Results of a randomized controlled trial. Patient Education and Counseling, 104(8), 2037–2044. https://doi.org/10.1016/j.pec.2021.01.014
Beidas, R. S., Williams, N. J., Becker-haimes, E. M., Aarons, G. A., Barg, F. K., Evans, A. C., Jackson, K., Jones, D., Hadley, T., Hoagwood, K., Marcus, S. C., Neimark, G., Rubin, R. M., Schoenwald, S. K., Adams, D. R., Walsh, L. M., Zentgraf, K., & Mandell, D. S. (2019). A repeated cross-sectional study of clinicians ’ use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia. Implementation Science, 14(67), 1–13.
Borders, L. D. A., Glosoff, H. L., Welfare, L. E., Hays, D. G., DeKruyf, L., Fernando, D. M., & Page, B. (2014). Best practices in clinical supervision: evolution of a counseling specialty. Clinical Supervisor, 33(1), 26–44. https://doi.org/10.1080/07325223.2014.905225
Boustani, M., Frazier, S. L., Becker, K. D., Bechor, M., Dinizulu, S. M., Hedemann, E. R., Ogle, R. R., & Pasalich, D. S. (2014). Common elements of adolescent prevention programs: Minimizing burden while maximizing reach. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 209–219. https://doi.org/10.1007/s10488-014-0541-9
Bruns, E. J., Kerns, S. E. U., Pullmann, M. D., Hensley, S. W., Lutterman, T., & Hoagwood, K. E. (2016). Research, data, and evidence-based treatment use in state behavioral health systems, 2001–2012. Psychiatric Services, 67(5), 496–503. https://doi.org/10.1176/appi.ps.201500014
Burkhardt, J. T., Schröter, D. C., Magura, S., Means, S. N., & Coryn, C. L. S. (2015). An overview of evidence-based program registers (EBPRs) for behavioral health. Evaluation and Program Planning, 48, 92–99. https://doi.org/10.1016/j.evalprogplan.2014.09.006
Carmel, A., Villatte, J. L., Rosenthal, M. Z., & Comtois, K. A. (2015). Applying technological approaches to clinical supervision in dialectical behavior therapy: A randomized feasibility trial of the bug-in-the-eye (BITE) Model. Retrieved from www.elsevier.com/locate/cabp
Carpenter, K. M., Cheng, W. Y., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R. M., & Nunes, E. V. (2012). Old dogs and new skills: How clinician characteristics relate to motivational interviewing skills before, during, and after training. Journal of Consulting and Clinical Psychology, 80(4), 560–573. https://doi.org/10.1037/a0028362
Cénat, J. M. (2020). How to provide anti-racist mental health care. Lancet Psychiatry, 7, 929–931. https://doi.org/10.1016/S2215-0366(20)30309-6
Chacón-Moscoso, S., Sanduvete-Chaves, S., & Sánchez-Martín, M. (2016). The development of a checklist to enhance methodological quality in intervention programs. Frontiers in Psychology, 7, 1811.
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), 117. https://doi.org/10.1186/1748-5908-8-117
Chorpita, B. F., & Becker, K. D. (2007). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child & Adolescent Psychiatry, 46(5), 647–652.
Chorpita, B. F., Becker, K. D., & Daleiden, E. L. (2007). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry, 46(5), 647–652. https://doi.org/10.1097/chi.0b013e318033ff71
Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579. https://doi.org/10.1037/a0014565
Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20. https://doi.org/10.1007/s11020-005-1962-6
Choy-Brown, M. (2021). “ I see your punitive measure and I raise you a person-centered bar ”: Supervisory strategies to promote adoption of person-centered care. Community Mental Health Journal. https://doi.org/10.1007/s10597-021-00783-z
Choy-Brown, M., & Stanhope, V. (2018). The availability of supervision in routine mental health care. Clinical Social Work Journal, 46(4), 271–280. https://doi.org/10.1007/s10615-018-0687-0
Council on Social Work Education. (2014). CSWE educational policy and accredidation standards. Retrieved from https://www.cswe.org/getattachment/Accreditation/Accreditation-Process/2015-EPAS/2015EPAS_Web_FINAL.pdf.aspx
Cummings, J. R., Ji, X., Allen, L., Lally, C., & Druss, B. G. (2017). Racial and ethnic differences in ADHD treatment quality among medicaid-enrolled youth. Pediatrics. https://doi.org/10.1542/peds.2016-2444
Department of Health and Human Services. (2006). New Freedom Commission on Mental Health: Achieving the promise: Transforming mental health care in America: Final report. Department of Health and Human Services.
Dixon, L. B., Holoshitz, Y., & Nossel, I. (2016). Treatment engagement of individuals experiencing mental illness: Review and update. World Psychiatry, 15(1), 13–20. https://doi.org/10.1002/wps.20306
Dorsey, S., Kerns, S. E. U., Lucid, L., Pullmann, M. D., Harrison, J. P., Berliner, L., Thompson, K., & Deblinger, E. (2018). Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health. Implementation Science. https://doi.org/10.1186/s13012-017-0708-3
Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., Unützer, J., Weisz, J. R., & Garland, A. F. (2013). Improving practice in community-based settings: A randomized trial of supervision—study protocol. Implementation Science, 8(1), 1–11. https://doi.org/10.1186/1748-5908-8-89
Dorsey, S., Pullmann, M. D., Kerns, S. E. U., Jungbluth, N., Meza, R., Thompson, K., & Berliner, L. (2017). The juggling act of supervision in community mental health: Implications for supporting evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44(6), 838–852. https://doi.org/10.1007/s10488-017-0796-z
Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1(1), 1–3. https://doi.org/10.1186/1748-5908-1-1
Fereday, J., & Muir-Cochrane, E. (2006). Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods, 5(1), 80–92. https://doi.org/10.1177/160940690600500107
Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26. https://doi.org/10.1007/s10488-010-0279-y
Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child & Adolescent Psychiatry, 47(5), 505–514. https://doi.org/10.1097/CHI.0b013e31816765c2
Grant, M. J., Button, C. M., & Snook, B. (2017). An evaluation of interrater reliability measures on binary tasks using d-prime. Applied Psychological Measurement, 41(4), 264–276. https://doi.org/10.1177/0146621616684584
Greeno, E. J., Ting, L., Pecukonis, E., Hodorowicz, M., & Wade, K. (2017). The role of empathy in training social work students in motivational interviewing. Social Work Education, 36(7), 794–808. https://doi.org/10.1080/02615479.2017.1346071
Institute of Medicine. (2006). Improving the quality of health care for mental and substance-use conditions. Institute of Medicine.
Kadushin, A., & Harkness, D. (2002). Supervision in social work (4th ed.). Columbia University Press.
Kreyenbuhl, J., Nossel, I. R., & Dixon, L. B. (2009). Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: A review of the literature. Schizophrenia Bulletin, 35(4), 696–703. https://doi.org/10.1093/schbul/sbp046
Kühne, F., Maas, J., Wiesenthal, S., & Weck, F. (2019). Empirical research in clinical supervision: A systematic review and suggestions for future studies. BMC Psychology. https://doi.org/10.1186/s40359-019-0327-7
Lee, T. A., & Pickard, A. S. (2013). In P. Velentgas, N. Dreyer, & P. Nourjah (Eds.), Exposure definition and measurement: Developing a protocol for observational comparative effectiveness research: A user’s guide—NCBI bookshelf. Agency for Healthcare Research and Quality.
Legha, R. K., & Miranda, J. (2020). An anti-racist approach to achieving mental health equity in clinical care racism antiracism implicit bias health disparities. Psychiatric Clinics of North America, 43(3), 451–469. https://doi.org/10.1016/j.psc.2020.05.002
Lindsey, M. A., Brandt, N. E., Becker, K. D., Lee, B. R., Barth, R. P., Daleiden, E. L., & Chorpita, B. F. (2014). Identifying the common elements of treatment engagement interventions in children’s mental health services. Clinical Child and Family Psychology Review, 17, 283–298.
Mannix, K. A., Blackburn, I. M., Garland, A., Gracie, J., Moorey, S., Reid, B., Standart, S., & Scott, J. (2006). Effectiveness of brief training in cognitive behaviour therapy techniques for palliative care practitioners. Palliative Medicine, 20(6), 579–584. https://doi.org/10.1177/0269216306071058
Martino, S., Paris, M., Jr., Añez, L., Nich, C., Canning-Ball, M., Hunkele, K., Olmstead, T. A., & Carroll, K. M. (2016). The effectiveness and cost of clinical supervision for motivational interviewing: A randomized controlled trial. Journal of Substance Abuse Treatment, 68, 11–23. https://doi.org/10.1016/j.jsat.2016.04.005
Mastroleo, N. R., Magill, M., Barnett, N. P., & Borsari, B. (2014). A pilot study of two supervision approaches for peer-led alcohol interventions with mandated college students. In Journal of Studies on Alcohol and Drugs, 75(3), 458–466.
Mastroleo, N. R., Turrisi, R., Carney, J. L. V., Ray, A. E., & Larimer, M. E. (2010). Examination of posttraining supervision of peer counselors in a motivational enhancement intervention to reduce drinking in a sample of heavy-drinking college students. Journal of Substance Abuse Treatment, 39(3), 289–297. https://doi.org/10.1016/j.jsat.2010.06.005
Mcleod, B. D., Sutherland, K. S., Martinez, R. G., Conroy, M. A., Snyder, P. A., & Southam-Gerow, M. A. (2017). Identifying common practice elements to improve social, emotional, and behavioral outcomes of young children in early childhood classrooms. Prevention Science, 18, 204–213. https://doi.org/10.1007/s11121-016-0703-y
Mcleod, B. D., & Weisz, J. R. (2010). The therapy process observational coding system for child psychotherapy strategies scale. Journal of Clinical Child & Adolescent Psychology, 39(3), 436–443. https://doi.org/10.1080/15374411003691750
Means, S. N., Magura, S., Burkhardt, J. T., Schröter, D. C., & Coryn, C. L. S. (2015). Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs. Evaluation and Program Planning, 48, 100–116. https://doi.org/10.1016/j.evalprogplan.2014.09.007
Milne, D. (2009). Evidence-based clinical supervision: principles and practice. Evidence-Based Clinical Supervision: Principles and Practice. https://doi.org/10.1002/9781444308662
Milne, D., Aylott, H., Fitzpatrick, H., & Ellis, M. V. (2008). How does clinical supervision work? Using a best evidence synthesis approach to construct a basic model of supervision. Clinical Supervisor, 27(2), 170–190. https://doi.org/10.1080/07325220802487915
Milne, D., & Reiser, R. P. (2012). A Rationale for evidence-based clinical supervision. Journal of Contemporary Psychotherapy, 42(3), 139–149. https://doi.org/10.1007/s10879-011-9199-8
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016). Rayyan: A web and mobile app for systematic reviews. Systematic Reviews. https://doi.org/10.1186/s13643-016-0384-4
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glaville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., & Mayo-Wilson, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. https://doi.org/10.1136/bmj.n71
Pecukonis, E., Greeno, E., Hodorowicz, M., Park, H., Ting, L., Moyers, T., Burry, C., Linsenmeyer, D., Strieder, F., Wade, K., & Wirt, C. (2015). Teaching motivational interviewing to child welfare social work students using live supervision and standardized clients: A randomized controlled trial. Journal of the Society for Social Work and Research, 7(3), 479–505. https://doi.org/10.1086/688064
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. https://doi.org/10.1177/1077558711430690
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. A. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science. https://doi.org/10.1186/s13012-015-0209-1
Probst, T., Jakob, M., Kaufmann, Y. M., Müller-Neng, J. M. B., Bohus, M., & Weck, F. (2018). Patients’ and therapists’ experiences of general change mechanisms during bug-in-the-eye and delayed video-based supervised cognitive-behavioral therapy. A randomized controlled trial. Journal of Clinical Psychology, 74(4), 509–522. https://doi.org/10.1002/jclp.22519
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(1), 1–11. https://doi.org/10.1186/1748-5908-8-139
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
Rakovshik, S. G., McManus, F., Vazquez-Montes, M., Muse, K., & Ougrin, D. (2016). Is supervision necessary? Examining the effects of internet-based CBT training with and without supervision. Journal of Consulting and Clinical Psychology, 84(3), 191–199. https://doi.org/10.1037/ccp0000079
Robbins, M. S., Waldron, H. B., Turner, C. W., Brody, J., Hops, H., & Ozechowski, T. (2019). Evaluating supervision models in functional family therapy: Does adding observation enhance outcomes? Family Process, 58(4), 873–890. https://doi.org/10.1111/famp.12399
Roth, A. D., Pilling, S., & Turner, J. (2010). Therapist training and supervision in clinical trials: Implications for clinical practice. Behavioural and Cognitive Psychotherapy, 38(3), 291–302.
Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., Rolls-Reutz, J., Weisz, J. R., Chorpita, B. E., Gibbons, R., Green, E. P., Hoagwood, K., Jensen, P. S., Mayberg, S., Miranda, J., & Palinkas, L. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 84–97. https://doi.org/10.1007/s10488-007-0147-6
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. https://doi.org/10.1007/s10488-010-0321-0
Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410–421. https://doi.org/10.1037/a0013788
Schriger, S. H., Becker-Haimes, E. M., Skriner, L., & Beidas, R. S. (2020). Clinical supervision in community mental health: Characterizing supervision as usual and exploring predictors of supervision content and process. Community Mental Health Journal, 57, 552–566. https://doi.org/10.1007/s10597-020-00681-w
Scott, K., & Lewis, C. C. (2016). Using measurement-based care to enhance any treatment. Psychiatric Services, 22(1), 49–59. https://doi.org/10.1016/j.cbpra.2014.01.010.Using
Smedley, B. D., Stith, A. Y., & Nelson, A. R. (2003). Unequal treatment: Confronting racial and ethnic disparities in health care (with CD). Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care (with CD). https://doi.org/10.17226/12875
Smith, J. L., Bertone, P., Carpenter, K. M., Wain, R. M., Hu, M. C., Amrhein, P. C., & Nunes, E. V. (2018). Assessment of the relationship between a written measure of empathy and an independently rated interview of Motivational Interviewing. Journal of Substance Abuse Treatment, 87, 56–63. https://doi.org/10.1016/j.jsat.2017.12.004
Smith, J. L., Carpenter, K. M., Amrhein, P. C., Brooks, A. C., Levin, D., Schreiber, E. A., Travaglini, L. A., Hu, M.-C., & Nunes, E. V. (2012). Supplemental material for training substance abuse clinicians in motivational interviewing using live supervision via teleconferencing. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037/a0028176.supp
Stoyan, D., Pommerening, A., Hummel, M., & Kopp-Schneider, A. (2018). Multiple-rater kappas for binary data: Models and interpretation. Biometrical Journal, 60(2), 381–394. https://doi.org/10.1002/bimj.201600267
Substance Abuse and Mental Health Services Administration. (2019). National Mental Health Services Survey (N-MHSS): 2018. Data on Mental Health Treatment Facilities. Substance Abuse and Mental Health Services.
Substance Abuse and Mental Health Services Administration. (2020). Key substance use and mental health indicators in the United States: Results from the 2019 National Survey on Drug Use and Health (HHS Publication No. PEP20-07-01-001). Retrieved from https://www.samhsa.gov/data/sites/default/files/reports/rpt29393/2019NSDUHFFRPDFWHTML/2019NSDUHFFR1PDFW090120.pdf
Sutherland, K. S., Conroy, M. A., McLeod, B. D., Kunemund, R., & McKnight, K. (2019). Common practice elements for improving social, emotional, and behavioral outcomes of young elementary school students. Journal of Emotional and Behavioral Disorders, 27(2), 76–85. https://doi.org/10.1177/1063426618784009
Swales, M. A. (2010). Implementing DBT: Selecting, training and supervising a team. The Cognitive Behavior Therapist, 3, 71–79. https://doi.org/10.1017/S1754470X10000061
Tebes, J. K., Matlin, S. L., Migdole, S. J., Farkas, M. S., Money, R. W., Shulman, L., & Hoge, M. A. (2011). Providing competency training to clinical supervisors through an interactional supervision approach. Research on Social Work Practice, 21(2), 190–199. https://doi.org/10.1177/1049731510385827
Wain, R. M., Kutner, B. A., Smith, J. L., Carpenter, K. M., Hu, M. C., Amrhein, P. C., & Nunes, E. V. (2015). Self-report after randomly assigned supervision does not predict ability to practice motivational interviewing. Journal of Substance Abuse Treatment, 57, 96–101. https://doi.org/10.1016/j.jsat.2015.04.006
Ward, A. M., Regan, J., Chorpita, B. F., Starace, N., Rodriguez, A., Okamura, K., Daleiden, E. L., Bearman, S. K., & Weisz, J. R. (2013). Tracking evidence based practice with youth: Validity of the MATCH and standard manual consultation records. Journal of Clinical Child & Adolescent Psychology, 42(1), 44–55. https://doi.org/10.1080/15374416.2012.700505
Watkins, C. E. (2020). What do clinical supervision research reviews tell us? Surveying the last 25 years. Counselling and Psychotherapy Research, 20(2), 190–208. https://doi.org/10.1002/capr.12287
Weck, F., Jakob, M., Neng, J. M. B., Höfling, V., Grikscheit, F., & Bohus, M. (2016). The effects of bug-in-the-eye supervision on therapeutic alliance and therapist competence in cognitive-behavioural therapy: A randomized controlled trial. Clinical Psychology and Psychotherapy, 23(5), 386–396. https://doi.org/10.1002/cpp.1968
Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., Hawley, K. M., Krumholz Marchette, L. S., Chu, B. C., Robin Weersing, V., & Fordwood, S. R. (2017). What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79–117. https://doi.org/10.1037/a0040360
Williams, N. J. (2016). Multilevel Mechanisms of Implementation Strategies in Mental Health: Integrating Theory, Research, and Practice. Administration and Policy in Mental Health and Mental Health Services Research, 43(5), 783–798. https://doi.org/10.1007/s10488-015-0693-2
Williams, N. J., & Beidas, R. S. (2019). Annual Research Review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry and Allied Disciplines, 60(4), 430–450. https://doi.org/10.1111/jcpp.12960
Williams, N. J., Benjamin Wolk, C., Becker-Haimes, E. M., & Beidas, R. S. (2020). Testing a theory of strategic implementation leadership, implementation climate, and clinicians’ use of evidence-based practice: A 5-year panel analysis. Implementation Science, 15(10), 1–15. https://doi.org/10.1186/s13012-020-0970-7
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Marcus, S. C., & Beidas, R. S. (2018). Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: Cross-sectional and lagged analyses from a 2-year observational study. Implementation Science, 13(85), 1–13. https://doi.org/10.1186/s13012-018-0781-2
Williams, N. J., Frank, H. E., Frederick, L., Beidas, R. S., Mandell, D. S., Aarons, G. A., Green, P., & Locke, J. (2019). Organizational culture and climate profiles: Relationships with fidelity to three evidence-based practices for autism in elementary schools. Implementation Science, 14(15), 1–14.
Zima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., Wallace, P., Rosenblatt, A., Landsverk, J., & Wells, K. B. (2005). Quality of publicly-funded outpatient specialty mental health care for common childhood psychiatric disorders in California. Journal of the American Academy of Child and Adolescent Psychiatry, 44(2), 130–144. https://doi.org/10.1097/00004583-200502000-00005
Acknowledgements
We want to acknowledge all of the generous authors for sharing their supervision protocols for this study and Sarita Kundrod for her work to strengthen our search.
Funding
No funding was received for conducting this study.
Author information
Authors and Affiliations
Contributions
MCB conceptualized the research questions and all authors contributed to the study design and methods. Data search methods were performed by SM. Article review, data extraction, and analysis were performed by MCB, DB, and CC. The first draft of the manuscript was written by MCB and all authors commented on previous versions of the manuscript. DB and NW provided critical revisions for the paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Ethical Approval
This articles does not contain any studies with human or animal subjects performed by any of the authors. This study followed the PRISMA guidelines for reporting systematic reviews.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original article was revised: The Figure 1 and 2 were transposed mistakenly. It has been corrected.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Choy-Brown, M., Baslock, D., Cable, C. et al. In Search of the Common Elements of Clinical Supervision: A Systematic Review. Adm Policy Ment Health 49, 623–643 (2022). https://doi.org/10.1007/s10488-022-01188-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-022-01188-0