Abstract
Although the education sector has been referred to as the “de facto” mental health system for children and adolescents, such statements obscure the tremendous heterogeneity of school-based mental health (SMH) initiatives. This study asked how different school contexts and SMH provider types may influence different aspects of SMH service delivery. Data are derived from results of evaluations of implementation and outcomes of a research-based practice model (the Brief Intervention for School Clinicians [BRISC]) tested in two common but quite different SMH contexts. In one context, BRISC was implemented in a large urban school district by externally employed practitioners working in schools (n = 5); in the second context, BRISC was implemented across a large Canadian province by school-employed mental health practitioners (n = 24). Results suggest that certain variables showed small differences across contexts, including intervention adherence, and perceived relevance, acceptability, and feasibility of BRISC. Other variables varied much more substantively, such as baseline seriousness of mental health needs, rate of out referral of students to alternative community-based services, and student mental health outcomes. Although exploratory, the current study focuses a useful lens on practice patterns across SMH contexts in secondary schools and underscores the importance of considering contextual factors early in an implementation process.
Similar content being viewed by others
References
Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7.
Atkins, M. S., Hoagwood, K. E., Kutash, K., & Seidman, E. (2010). Toward the integration of education and mental health in schools. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 40–47. https://doi.org/10.1007/s10488-010-0299-7.
Barrett, S., Eber, L., & Weist, M. (Eds.). (2013). Advancing education effectiveness: Interconnecting school mental health and school-wide positive behavior support. Retrieved from http://csmh.umaryland.edu/media/SOM/Microsites/CSMH/docs/Reports/Advancing_Education_Effectiveness.pdf.
Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 41(6), 788–799. https://doi.org/10.1007/s10488-013-0529-x.
Bowers, H., Manion, I., Papadopoulos, D., & Gauvreau, E. (2013). Stigma in school-based mental health: Perceptions of young people and service providers. Child and Adolescent Mental Health, 18(3), 165–170. https://doi.org/10.1111/j.1475-3588.2012.00673.x.
Bruns, E. J., Duong, M. T., Lyon, A. R., Pullmann, M. D., Cook, C. R., Cheney, D., et al. (2016). Fostering SMART partnerships to develop an effective continuum of behavioral health services and supports in schools. American Journal of Orthopsychiatry, 86(2), 156–170. https://doi.org/10.1037/ort0000083.
Bruns, E. J., Pullmann, M. D., Nicodimos, S., Lyon, A. R., Namkung, N., & McCauley, E. Pilot test of an engagement, triage, and brief intervention strategy for school mental health (under review).
Bruns, E. J., Walrath, C., Glass-Siegel, M., & Weist, M. D. (2004). School-based mental health services in Baltimore association with school climate and special education referrals. Behavior Modification, 28(4), 491–512. https://doi.org/10.1177/0145445503259524.
Burns, B. J., Costello, E. J., Angold, A., Tweed, D., Stangl, D., Farmer, E. M., et al. (1995). Children’s mental health service use across service sectors. Health Affairs, 14(3), 147–159. https://doi.org/10.1377/hlthaff.14.3.147.
Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579. https://doi.org/10.1037/a0014565.
Chorpita, B. F., Daleiden, E. L., & Collins, K. S. (2014). Managing and adapting practice: A system for applying evidence in clinical care with youth and families. Clinical Social Work Journal, 42(2), 134–142. https://doi.org/10.1007/s10615-013-0460-3.
Cialdini, R. B., & Goldstein, N. J. (2004). Social influence: Compliance and conformity. Annual Review of Psychology, 55(1), 591–621. https://doi.org/10.1146/annurev.psych.55.090902.142015.
Cohen, J. (1977). Statistical power analysis for the behavioral sciences (revised ed.). New York: Academic Press.
Cook, C. R., Lyon, A. R., Kubergovic, D., Wright, D. B., & Zhang, Y. (2015). A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. School Mental Health, 7(1), 49–60. https://doi.org/10.1007/s12310-014-9139-3.
Duong, M. T., Lyon, A. R., Ludwig, K., Wasse, J. K., & McCauley, E. (2016). Student perceptions of the acceptability and utility of standardized and idiographic assessment in school mental health. International Journal of Mental Health Promotion, 18(1), 49–63. https://doi.org/10.1080/14623730.2015.1079429.
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432.
D’Zurilla, T. J., & Nezu, A. M. (2010). Problem-solving therapy. Handbook of Cognitive-Behavioral Therapies, 3, 197–225.
Evans, S. W., & Weist, M. D. (2004). Commentary: Implementing empirically supported treatments in the schools: What are we asking? Clinical Child and Family Psychology Review, 7(4), 263–267. https://doi.org/10.1007/s10567-004-6090-0.
Farahmand, F. K., Grant, K. E., Polo, A. J., & Duffy, S. N. (2011). School-based mental health and behavioral programs for low-income, urban youth: A systematic and meta-analytic review. Clinical Psychology: Science and Practice, 18(4), 372–390. https://doi.org/10.1111/j.1468-2850.2011.01265.x.
Farmer, E. M. Z., Burns, B. J., Phillips, S. D., Angold, A., & Costello, E. J. (2003). Pathways into and through mental health services for children and adolescents. Psychiatric Services, 54(1), 60–66. https://doi.org/10.1176/appi.ps.54.1.60.
Flaherty, L. T., & Osher, D. (2003). History of school-based mental health services in the United States. In M. D. Weist, S. W. Evans, & N. A. Lever (Eds.), Handbook of school mental health advancing practice and research (pp. 11–22). New York: Springer. https://doi.org/10.1007/978-0-387-73313-5_2.
Forman, S. G., Olin, S. S., Hoagwood, K. E., Crowe, M., & Saka, N. (2009). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1(1), 26. https://doi.org/10.1007/s12310-008-9002-5.
Forman, S. G., Shapiro, E. S., Codding, R. S., Gonzales, J. E., Reddy, L. A., Rosenfield, S. A., et al. (2013). Implementation science and school psychology. School Psychology Quarterly, 28(2), 77.
Foster, S., Rollefson, M., Doksum, T., Noonan, D., Robinson, G., & Teich, J. (2005). School mental health services in the United States, 2002–2003. SAMHSA’s National Clearinghouse for Alcohol and Drug Information (NCADI). Retrieved from http://eric.ed.gov/?id=ED499056.
Hoagwood, K. E., Serene Olin, S., Kerker, B. D., Kratochwill, T. R., Crowe, M., & Saka, N. (2007). Empirically based school interventions targeted at academic and mental health functioning. Journal of Emotional and Behavioral Disorders, 15(2), 66–92.
Kam, C.-M., Greenberg, M. T., & Walls, C. T. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4(1), 55–63.
Keeton, V., Soleimanpour, S., & Brindis, C. D. (2012). School-based health centers in an era of health care reform: Building on history. Current Problems in Pediatric and Adolescent Health Care, 42(6), 132–156. https://doi.org/10.1016/j.cppeds.2012.03.002.
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113. https://doi.org/10.1007/s12310-010-9038-1.
Lyon, A. R., Bruns, E. J., Ludwig, K., Stoep, A. V., Pullmann, M. D., Dorsey, S., et al. (2015a). The Brief Intervention for School Clinicians (BRISC): A mixed-methods evaluation of feasibility, acceptability, and contextual appropriateness. School Mental Health, 7(4), 273–286. https://doi.org/10.1007/s12310-015-9153-0.
Lyon, A. R., Bruns, E. J., Weathers, E. S., Canavas, N., Ludwig, K., Vander Stoep, A., et al. (2014a). Taking evidence-based practices to school: Using expert opinion to develop a brief, evidence-informed school-based mental health intervention. Advances in School Mental Health Promotion, 7(1), 42–61.
Lyon, A. R., Ludwig, K., Knaster Wasse, J., Bergstrom, A., Hendrix, E., & McCauley, E. (2016). Determinants and functions of standardized assessment use among school mental health clinicians: A mixed methods evaluation. Administration and Policy in Mental Health and Mental Health Services Research, 43, 122–134.
Lyon, A. R., Ludwig, K., Romano, E., Koltracht, J., Vander Stoep, A., & McCauley, E. (2014b). Using modular psychotherapy in school mental health: Provider perspectives on intervention-setting fit. Journal of Clinical Child and Adolescent Psychology, 43(6), 890–901. https://doi.org/10.1080/15374416.2013.843460.
Lyon, A. R., Maras, M. A., Pate, C. M., Igusa, T., & VanderStoep, A. (2015b). Modeling the impact of school-based universal depression screening on additional service capacity needs: A system dynamics approach. Administration and Policy in Mental Health and Mental Health Services Research, 43(2), 168–188. https://doi.org/10.1007/s10488-015-0628-y.
Lyon, A. R., Stirman, S. W., Kerns, S. E. U., & Bruns, E. J. (2011). Developing the mental health workforce: Review and application of training approaches from multiple disciplines. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 238–253. https://doi.org/10.1007/s10488-010-0331-y.
Mychailyszyn, M. P., Brodman, D. M., Read, K. L., & Kendall, P. C. (2012). Cognitive-behavioral school-based interventions for anxious and depressed youth: A meta-analysis of outcomes. Clinical Psychology: Science and Practice, 19(2), 129–153. https://doi.org/10.1111/j.1468-2850.2012.01279.x.
Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450. https://doi.org/10.1007/s10488-013-0502-8.
Neil, A. L., & Christensen, H. (2009). Efficacy and effectiveness of school-based prevention and early intervention programs for anxiety. Clinical Psychology Review, 29(3), 208–215.
Ontario Ministry of Health and Long-Term Care. (2011). Open minds, healthy minds: Ontario’s comprehensive mental health and addictions strategy. Queen’s Printer for Ontario. Retrieved from http://www.health.gov.on.ca/en/common/ministry/publications/reports/mental_health2011/mentalhealth_rep2011.pdf.
Owens, J. S., Lyon, A. R., Brandt, N. E., Warner, C. M., Nadeem, E., Spiel, C., et al. (2014). Implementation science in school mental health: Key constructs in a developing research agenda. School Mental Health, 6(2), 99–111. https://doi.org/10.1007/s12310-013-9115-3.
Paternite, C. E., Weist, M. D., Axelrod, J., Anderson-Butcher, D., Weston, K., Hoge, M., et al. (2006). School mental health workforce issues. A thousand voices: The national action plan on behavioral health workforce development (pp. 199–210).
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 21.
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7.
Rakovshik, S. G., & McManus, F. (2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496–516. https://doi.org/10.1016/j.cpr.2010.03.004.
Reinke, W. M., Stormont, M., Herman, K. C., Puri, R., & Goel, N. (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26(1), 1–13. https://doi.org/10.1037/a0022714.
Richardson, L. P., McCauley, E., Grossman, D. C., McCarty, C. A., Richards, J., Russo, J. E., et al. (2010). Evaluation of the Patient Health Questionnaire-9 item for detecting major depression among adolescents. Pediatrics, 126(6), 1117–1123. https://doi.org/10.1542/peds.2010-0852.
Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3(4), 223–241. https://doi.org/10.1023/A:1026425104386.
Silberberg, M., & Cantor, J. C. (2008). Making the case for school-based health: Where do we stand? Journal of Health Politics, Policy and Law, 33(1), 3–37. https://doi.org/10.1215/03616878-2007-045.
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing Generalized Anxiety Disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092.
Stephan, S. H., Weist, M., Kataoka, S., Adelsheim, S., & Mills, C. (2007). Transformation of children’s mental health services: The role of school mental health. Psychiatric Services. Retrieved from http://ps.psychiatryonline.org/doi/pdf/10.1176/ps.2007.58.10.1330.
Teich, J. L., Robinson, G., & Weist, M. D. (2008). What kinds of mental health services do public schools in the United States provide? Advances in School Mental Health Promotion, 1(Sup1), 13–22. https://doi.org/10.1080/1754730X.2008.9715741.
The President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America. Rockville, MD: Substance Abuse and Mental Health Services Administration.
Tobler, N. S., Roona, M. R., Ochshorn, P., Marshall, D. G., Streke, A. V., & Stackpole, K. M. (2000). School-based adolescent drug prevention programs: 1998 meta-analysis. Journal of Primary Prevention, 20(4), 275–336.
Walker, S. C., & Bruns, E. J. (2015). Impact of training and technical assistance (IOTTA).
Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., et al. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. https://doi.org/10.1001/archgenpsychiatry.2011.147.
Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry, 70(7), 750–761. https://doi.org/10.1001/jamapsychiatry.2013.1176.
Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., et al. (2017). What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79–117.
Wilson, D. B., Gottfredson, D. C., & Najaka, S. S. (2001). School-based prevention of problem behaviors: A meta-analysis. Journal of Quantitative Criminology, 17(3), 247–272. https://doi.org/10.1023/A:1011050217296.
Wilson, S. J., & Lipsey, M. W. (2007). School-based interventions for aggressive and disruptive behavior: Update of a meta-analysis. American Journal of Preventive Medicine, 33(2), S130–S143.
Funding
This work was funded by the Institute for Educational Sciences (Grant Number R305A120128).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional review board (IRB) of the University of Washington and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Informed Consent
Informed consent for the Washington cohort was obtained for all participants, given these data were collected under the auspice of a federal research study. Data collection for the Ontario cohort was not deemed subject of formal IRB review because it was a quality improvement evaluation of the BRISC intervention in which (1) data were recorded by the investigator in such a manner that participants could not be identified, directly or through identifiers linked to the subjects, and (2) data were collected primarily for the purpose of evaluating public benefit and identifying possible changes in or alternatives to the program.
Rights and permissions
About this article
Cite this article
Whitaker, K., Fortier, A., Bruns, E.J. et al. How Do School Mental Health Services Vary Across Contexts? Lessons Learned from Two Efforts to Implement a Research-Based Strategy. School Mental Health 10, 134–146 (2018). https://doi.org/10.1007/s12310-017-9243-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-017-9243-2