Abstract
Social anxiety is highly prevalent but goes untreated. Although school-based CBT programs are efficacious when delivered by specialized psychologists, it is unclear whether school counselors can implement these interventions effectively, which is essential to promote sustainable school programs. We present an initial consultation strategy to support school counselor implementation of group CBT for social anxiety and an evaluation of counselors’ treatment fidelity. Counselors were highly adherent to the treatment, but competence varied based on measurement. Counselors and consultants demonstrated good agreement for adherence, but relatively modest correspondence in competence ratings. We discuss future directions for school-based implementation efforts informed by these initial findings.
Similar content being viewed by others
References
American School Counselor Association. (2005). The ASCA national model: A framework for school counseling programs (2nd ed.). Alexandria, VA: Author.
Anderson, T., Crowley, M. E., Patterson, C. L., & Heckman, B. D. (2012). The influence of supervision on manual adherence and therapeutic processes. Journal of Clinical Psychology, 68(9), 972–988.
Atkins, M. S., Graczyk, P. A., Frazier, S. L., & Abdul-Adil, J. (2003). Toward a new model for promoting urban children’s mental health: Accessible, effective, and sustainable school-based mental health services. School Psychology Review, 32(4), 503–514.
Atkins, M. S., McKay, M. M., Arvantis, P., London, L., Madison, S., Costigan, C., et al. (1998). An ecological model for school-based mental health services for urban low-income aggressive children. The Journal of Behavioral Health Services & Research, 25(1), 64–75.
Becker, E. M., Becker, K. D., & Ginsburg, G. S. (2012). Modular cognitive behavioral therapy for youth with anxiety disorders: A closer look at the use of specific modules and their relation to treatment process and response. School Mental Health, 4, 243–253.
Beidas, R. S., Barmish, A. J., & Kendall, P. C. (2009). Training as usual: Can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Therapist, 32(5), 97–101.
Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30.
Beidas, R. S., Mychailyszyn, M. P., Edmunds, J. M., Khanna, M. S., Downey, M. M., & Kendall, P. C. (2012). Training school mental health providers to deliver cognitive-behavioral therapy. School Mental Health, 4(4), 197–206.
Beidel, D. C., Turner, S. M., & Morris, T. L. (1999). Psychopathology of childhood social phobia. Journal of the American Academy of Child and Adolescent Psychiatry, 38(6), 643–650.
Beidel, D. C., Turner, S. M., & Morris, T. L. (2000). Behavioral treatment of childhood social phobia. Journal of Consulting and Clinical Psychology, 68(6), 1072–1080.
Beidel, D. C., Turner, S. M., Young, B., & Paulson, A. (2005). Social effectiveness therapy for children: Three-year follow-up. Journal of Consulting and Clinical Psychology, 73(4), 721–725.
Bittner, A., Egger, H. L., Erkanli, A., Costello, E. J., Foley, D. L., & Angold, A. (2007). What do childhood anxiety disorders predict? Journal of Child Psychology and Psychiatry, 48(12), 1174–1183.
Bohart, A. C., Elliott, R., Greenberg, L. S., & Watson, J. C. (2002). Empathy. In J. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 89–108). New York: Oxford University Press.
Brosan, L., Reynolds, S., & Moore, R. G. (2008). Self-evaluation of cognitive therapy performance: Do therapists know how competent they are? Behavioural and Cognitive Psychotherapy, 36(5), 581–587.
Burns, B. J., Costello, E. J., Angold, A., Tweed, D., Stangle, D., Farmer, E. M., et al. (1995). Children’s mental health service use across service sectors. Health Affairs, 14(3), 147–159. doi:10.177/hlthaff.14.3.147.
Carroll, K. M., Nich, C., Sifry, R. L., Nuro, K. F., Frankforter, T. L., Ball, S. A., et al. (2000). A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug and Alcohol Dependence, 57(3), 225–238.
Chagnon, F., Houle, J., Marcoux, I., & Renaud, J. (2007). Control-group study of an intervention training program for youth suicide prevention. Suicide and Life-Threatening Behavior, 37(2), 135–144.
Chiu, A. W., McLeod, B. D., Har, K., & Wood, J. J. (2009). Child-therapist alliance and clinical outcomes in cognitive behavioral therapy for child anxiety disorders. Journal of Child Psychology and Psychiatry, 50(6), 751–758.
Chorpita, B. F. (2007). Modular cognitive-behavioral therapy for childhood anxiety disorders. New York: Guilford.
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290.
Colognori, D., Esseling, P., Stewart, C. E., Reiss, P., Lu, F., Case, B., et al. (2012). Self-disclosure and mental health service use in socially anxious adolescents. School Mental Health, 4(4), 219–230. doi:10.1007/s12310-012-9082-0.
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60(8), 837–844.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsch, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi:10.1186/1748-5908-4-50.
Dimeff, L. A., Koerner, K., Woodcock, E. A., Beadnell, B., Brown, M. Z., Skutch, J. M., et al. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behaviour Research and Therapy, 47(11), 921–930.
Dobson, K. S., & Singer, A. R. (2005). Definitional and practical issues in the assessment of treatment integrity. Clinical Psychology: Science and Practice, 12(4), 384–387.
Essau, C. A., Condradt, J., & Petermann, F. (1999). Frequency and comorbidity of social phobia and social fears in adolescents. Behaviour Research and Therapy, 37(9), 831–843.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI #231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Retrieved December 15, 2012 from http://nirn.fpg.unc.edu/resources/implementation-research-synthesis-literature.
Foster, S., Rollefson, M., Doksum, T., Noonan, D., & Robinson, G. (2005). School mental health services in the United States, 2002–2003. DHHS Pub. No. (SMA) 05-4068. Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.
Funderbunk, B. W., Ware, L. M., Altshuler, E., & Chaffin, M. (2008). Use and feasibility of telemedicine technology in the dissemination of Parent-Child Interaction Therapy. Child Maltreatment, 13(4), 377–382.
Garland, A. F., Brookman-Frazee, L., Hurlburt, M., Accurso, E. C., Zoffness, R., Haine-Schlagel, R. A., et al. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 1–8.
Gega, L., Norman, I. J., & Marks, I. M. (2007). Computer-aided vs. tutor-delivered teaching of exposure therapy for phobia/panic: Randomized controlled trial with pre-registration nursing students. International Journal of Nursing Studies, 44(3), 397–405.
Grover, R. L., Ginsburg, G. S., & Ialongo, N. (2007). Psychosocial outcomes of anxious first graders: A seven-year follow-up. Depression and Anxiety, 24, 410–420.
Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33(6), 665–679.
Henggeler, S. W., Clingempeel, W. G., Brondino, M. J., & Pickrel, S. G. (2002). Four-year follow-up of multisystemic therapy with substance-abusing and substance-dependent juvenile offenders. Journal of the American Academy of Child and Adolescent Psychiatry, 41(7), 868–874.
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466.
Herzig-Anderson, K., Colognori, D., Fox, J. K., Stewart, C. E., & Masia Warner, C. (2012). School-based anxiety treatments for children and adolescents. Child and Adolescent Psychiatric Clinics of North America, 21(3), 655–668.
Hogue, A., Dauber, S., Chinchilla, P., Fried, A., Henderson, C., Inclan, J., et al. (2008a). Assessing fidelity in individual and family therapy for adolescent substance abuse. Journal of Substance Abuse Treatment, 35(2), 137–147.
Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008b). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76(4), 544–555.
Husky, M. M., Sheridan, M., McGuire, L., & Olfson, M. (2011). Mental health screening and follow-up care in public high schools. Journal of the American Academy of Child and Adolescent Psychiatry, 50(9), 881–891.
James, I. A., Blackburn, I. M., Milne, D. L., & Reichfelt, F. K. (2001). Moderators of trainee therapists’ competence in cognitive therapy. British Journal of Clinical Psychology, 40(2), 131–141.
Kataoka, S., Stein, B. D., Jaycox, L. H., Wong, M., Escudero, P., Tu, W., et al. (2003). A school-based mental health program for traumatized Latino immigrant children. Journal of the American Academy of Child and Adolescent Psychiatry, 42(3), 311–318.
Katzelnick, D. J., Kobak, K. A., DeLeire, T., Henk, H. J., Greist, J. H., Davidson, J. R., et al. (2001). Impact of generalized social anxiety disorder in managed care. The American Journal of Psychiatry, 158(12), 1999–2007.
Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44(8), 1116–1129.
Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments. Journal of Consulting and Clinical Psychology, 66(1), 19–36. doi:10.1037/0022-006X.66.1.19.
Kelly, M. S., & Lueck, C. (2011). Adopting a data-driven public health framework in schools: Results from a multi-disciplinary survey on school-based mental health practice. Advances in School Mental Health Promotion, 4(4), 5–12.
Khanna, M. S., & Kendall, P. C. (2008). Computer-assisted CBT for child anxiety: The Coping Cat CD-ROM. Cognitive and Behavioral Practice, 15, 159–165.
Khanna, M. S., & Kendall, P. C. (2010). Computer-assisted cognitive behavioral therapy for child anxiety: Results of a randomized clinical trial. Journal of Consulting and Clinical Psychology, 78(5), 737–745.
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitator of successful implementation. School Mental Health, 2(3), 105–113.
Lyon, A. R., Charlesworth-Attie, S., Vander Stoep, A., & McCauley, E. (2011a). Modular psychotherapy for youth with internalizing problems: Implementation with therapists in school-based health centers. School Psychology Review, 40(4), 569–581.
Lyon, A. R., Frazier, S. L., Mehta, T., Atkins, M. S., & Weisbach, J. (2011b). Easier said than done: Intervention sustainability in an urban after-school program. Administration and Policy in Mental Health, 38(6), 504–517.
Lyon, A. R., McCauley, E., & Vander Stoep, A. (2011c). Toward successful implementation of evidence-based practices: Characterizing the intervention context of counselors in school-based health centers. Emotional & Behavioral Disorders in Youth, 11, 19–25.
Mannix, K. A., Blackburn, I. M., Garland, A., Gracie, J., Moorey, S., Reid, B., et al. (2006). Effectiveness of brief training in cognitive behaviour therapy techniques for palliative care practitioners. Palliative Medicine, 20(6), 579–584.
Manteuffel, B., Stephens, R., Sondheimer, D., & Fisher, S. (2008). Characteristics, service experiences, and outcomes of transition-aged youth in systems of care: Programmatic and policy implications. The Journal of Behavioral Health Services & Research, 35(4), 469–487. doi:10.1007/s11414-008-9130-6.
Masia, C., Beidel, D. C., Albano, A. M., Rapee, R. M., Turner, S. M., Morris, T. L., & Klein, R. G. (1999). Skills for Academic and Social Success. Available from Carrie Masia Warner, PhD.
Masia, C., Klein, R. G., Storch, E., & Corda, B. (2001). School-based behavioral treatment of social anxiety disorder: Results of a pilot study. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 780–786.
Masia Warner, C., Fisher, P. H., Ludwig, K., Rialon, R., & Ryan, J. L. (2011). Adapting treatment of social anxiety disorder for delivery in schools: A school-based intervention for adolescents. In D. Beidel & C. Alfano (Eds.), Social anxiety disorder in adolescents and young adults: Translating developmental research into practice (pp. 281–296). Washington, DC: American Psychological Association.
Masia Warner, C., Fisher, P. H., Shrout, P. E., Rathor, S., & Klein, R. G. (2007). Treating adolescents with social anxiety disorder in school: An attention control trial. Journal of Child Psychology and Psychiatry, 48, 676–686.
Masia Warner, C., Klein, R. G., Dent, H. C., Fisher, P. H., Alvir, J., Albano, A. M., et al. (2005). School-based intervention for adolescents with social anxiety disorder: Results of a controlled study. Journal of Abnormal Child Psychology, 33, 707–722.
McLeod, B. D., & Islam, N. Y. (2011). Using treatment integrity models to study the implementation process. Clinical Psychology: Science and Practice, 18(1), 36–40.
McLeod, B. D., & Weisz, J. R. (2005). The therapy process observational coding system-alliance scale: Measure characteristics and prediction of outcome in usual clinical practice. Journal of Consulting and Clinical Psychology, 73(2), 323–333.
Merikangas, K. R., He, J. P., Burnstein, M., Swanson, S. A., Avenevoli, S., Cui, L., et al. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the national comorbidity survey replication-adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 980–989.
Merikangas, K. R., He, J., Burstein, M., Swendsen, J., Avenevoli, S., Case, B., et al. (2011). Service utilization for lifetime mental disorders in U.S. adolescents: Results from the National Comorbidity Survey-Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 50, 32–45.
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50, 462–480.
Miller, S. J., & Binder, J. L. (2002). The effects of manual-based training on treatment fidelity and outcome: A review of the literature on adult individual psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 39(2), 184–198. doi:10.1037//0033-3204.39.2.184.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72(6), 1050–1062.
Milne, D. L., Baker, C., Blackburn, I. M., James, I., & Reichelt, K. (1999). Effectiveness of cognitive therapy training. Journal of Behavior Therapy and Experimental Psychiatry, 30(2), 81–92.
Mitcheson, L., Bhavsar, J., & McCambridge, J. (2009). Randomized trial of training and supervision in motivational interviewing with adolescent drug treatment practitioners. Journal of Substance Abuse Treatment, 37(1), 73–78. doi:10.1016/j.jsat.2008.11.001.
Mufson, L. H., Dorta, K. P., Olfson, M., Weissman, M. M., & Hoagwood, K. (2004). Effectiveness research: Transporting interpersonal psychotherapy for depressed adolescents (IPT-A) from the lab to school-based health clinics. Clinical Child and Family Psychology Review, 7, 251–261. doi:10.1007/s10567-004-6089-6.
Page, B. J., Pietrzak, D. R., & Sutton, J. M. (2001). National survey of school counselor supervision. Counselors Education and Supervision, 41(2), 142–150.
Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383.
President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America. Final report. Rockville, MD: US Department of Health and Human Services. Retrieved December 15, 2012 from http://govinfo.library.unt.edu/mentalhealthcommission/reports.
Ryan, J. L., & Masia Warner, C. (2012). Treating adolescents with social anxiety disorders in schools. Child and Adolescent Psychiatric Clinics of North America, 21(1), 105–118.
Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child & Adolescent Psychology, 33(1), 94–104.
Shediac-Rizhallah, M. C., & Bone, L. R. (1998). Planning for the sustainability of community-based health programs: Conceptual frameworks and future directions for research, practice, and policy. Health Education and Research, 13, 87–108.
Sholomskas, D. E., & Carroll, K. M. (2006). One small step for manuals: Computer-assisted training in twelve-step facilitation. Journal of Studies on Alcohol, 67(6), 939–945.
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73(1), 106–115.
Silverman, W. K., & Albano, A. M. (1996). The anxiety disorders interview schedule for DSM-IV: Child and parent versions. San Antonio, TX: Psychological Corporation.
Society for Research in Child Development. (2009). Healthy development: A summit on young children’s mental health. Partnering with communication scientist, collaborating across disciplines and leveraging impact to promote children’s mental health. Washington, DC. Retrieved December 15, 2012 from http://www.apa.org/pi/families/summit-report.pdf.
Strout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.
U.S. Department of Health and Human Services. (2000). Report of the surgeon general’s conference on children’s mental health: A national action agenda. Washington, DC. Retrieved December 15, 2012 from http://www.surgeongeneral.gov/topics/cmh/childreport.html.
Vismara, L. A., Young, G. S., Stahmer, A. C., Griffith, E. M., & Rogers, S. J. (2009). Dissemination of evidence-based practice: Can we train therapists from a distance? Journal of Autism and Developmental Disorders, 39(12), 1636–1651.
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61(4), 620–630.
Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144–155.
Weisz, J. R., Ugueto, A. M., Herren, J., Afienko, S. R., & Rutt, C. (2011). Kernels vs. ears, and other questions for a science of treatment dissemination. Clinical Psychology: Science and Practice, 18(1), 41–46.
Wittchen, H. U., Stein, M. B., & Kessler, R. C. (1999). Social fears and social phobia in a community sample of adolescents and young adults: Prevalence, risk factors, and co-morbidity. Psychological Medicine, 29(2), 309–323.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Masia Warner, C., Brice, C., Esseling, P.G. et al. Consultants’ Perceptions of School Counselors’ Ability to Implement an Empirically-Based Intervention for Adolescent Social Anxiety Disorder. Adm Policy Ment Health 40, 541–554 (2013). https://doi.org/10.1007/s10488-013-0498-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-013-0498-0