Skip to main content

Implementation of School-Based Behavioral Health Services Over Time: A Longitudinal, Multi-level Qualitative Study

Abstract

Behavioral health practitioners recognize how critical the process of implementation is to the successful use of evidence-based practices. It is further recognized that implementation is a complex, time-consuming process and that successful implementation often occurs in stages. Capitalizing on a national evaluation examining the implementation of school-based behavioral health (SBBH) services, this project involved an analysis of qualitative interview data to assess the unique barriers and facilitators that arise across time and organizational levels in the implementation of SBBH services. Forty-eight semi-structured telephone interviews were analyzed across 3 years and two organizational levels in seven sites (n = 48). Qualitative analysis identified five major implementation facilitators including communication and collaboration, data utilization, leadership, planning, and training. Major barriers to implementation included systemic state/governmental barriers, workforce shortages, and funding issues. While there were small changes in the relative importance of these facilitators and barriers over time and by organizational level, the most salient barriers and facilitators remained important across all 3 years of the study. Differences across organizational levels included greater emphasis at local levels for facilitators such as training and leadership and a greater emphasis at state levels for state/governmental barriers. Results suggest that while the importance of given facilitators and barriers changes as implementation progresses, the major factors that contribute to implementation are likely to remain unchanged over time. Effective communication/collaboration among stakeholders remains a powerful facilitator across time, and systemic state/governmental barriers remain a potent barrier. Implications for increasing successful integration of behavioral health services in public school settings are discussed.

This is a preview of subscription content, access via your institution.

References

  1. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274.

    Article  Google Scholar 

  2. Aarons, G. A., Hurlburt, M., & McCue Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.

    Article  Google Scholar 

  3. Akerland, K. (2000). Prevention and program sustainability: The state’s perspective. Journal of Community Psychology, 28(3), 353–362.

    Article  Google Scholar 

  4. Atkins, M. S., & Lakind, D. (2013). Usual care for clinicians, unusual care for their clients: Rearranging priorities for children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 40(1), 48–51.

    Article  Google Scholar 

  5. Behrens, D., Lear, J. G. & Price, O. A. (2012). Developing a business plan for sustaining school mental health service: Three success stories. Washington, D.C.: Center for Health and Health Care in Schools, The George Washington University. Retrieved from https://hsrc.himmelfarb.gwu.edu/cgi/viewcontent.cgi?article=1065&context=sphhs_prev_facpubs.

  6. Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., et al. (2016). A multi-level evaluation of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 893–908.

    Article  Google Scholar 

  7. Bernard, H. R., & Ryan, G. W. (2010). Analyzing qualitative data: Systematic approaches. Thousand Oaks, CA: SAGE Publishing.

    Google Scholar 

  8. Blase, K. A., Van Dyke, M. K., & Fixsen, D. L. (2013). Stages of implementation analysis: Where are we?. Chapel Hill, NC: National Implementation Science Network, Frank Porter Graham Child Development Institute, University of North Carolina Chapel Hill.

    Google Scholar 

  9. Bruns, E. J., Parker, E. M., Hensley, S., Pullmann, M. D., Benjamin, P. H., Lyon, A. R., et al. (2019). The role of the outer setting in implementation: Associations between state, demographic, fiscal, and policy factors and use of evidence-based treatments in mental healthcare. Implementation Science, 14(96), 1–13.

    Google Scholar 

  10. Cappella, E., Frazier, S. L., Atkins, M. S., Schoenwald, S. K., & Glisson, C. (2008). Enhancing schools’ capacity to support children in poverty: An ecological model of school-based mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 35(5), 395–409.

    Article  Google Scholar 

  11. Chafouleas, S. M., Johnson, A. H., Overstreet, S., & Santos, N. M. (2016). Toward a blueprint for trauma informed service delivery in schools. School Mental Health, 8(1), 144–162.

    Article  Google Scholar 

  12. Conners, E. H., Schiffman, J., Stein, K., LeDoux, S., Landsverk, J., & Hoover, S. (2019). Factors associated with community-partnered school behavioral health clinicians’ adoption and implementation of evidence-based practices. Administration and Policy in Mental Health and Mental Health Services Research, 46(1), 91–104.

    Article  Google Scholar 

  13. Cook, C. R., Lyon, A. R., Kubergovic, D., Wright, D. B., & Zhang, Y. (2015). Supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. School Mental Health, 7(1), 49–60.

    Article  Google Scholar 

  14. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(50), 1–15.

    Google Scholar 

  15. Evans, S. W., & Weist, M. D. (2004). Implementing empirically supported treatments in the schools: What are we asking? Clinical Child and Family Psychology Review, 7(4), 263–267.

    Article  Google Scholar 

  16. Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540.

    Article  Google Scholar 

  17. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: National Implementation Research Network, Louis de la Parte Mental Health Institute, University of South Florida.

    Google Scholar 

  18. Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18(1), 59–82.

    Article  Google Scholar 

  19. Guest, G., MacQueen, K. M., & Namey, E. E. (2012). Applied thematic analysis. Thousand Oaks, CA: SAGE Publishing.

    Book  Google Scholar 

  20. Herlitz, L., MacIntyre, H., Osborn, T., & Bonell, C. (2020). The sustainability of public health interventions in schools: A systematic review. Implementation Science, 15(4), 1–28.

    Google Scholar 

  21. Jones, D., Greenberg, M. T., & Crowley, M. (2015). The economic case for SEL. In J. A. Durlak, C. E. Domitrovich, R. P. Weissberg, & T. P. Gullotta (Eds.), Handbook of social and emotional learning: Research and practice (pp. 97–113). New York: The Guilford Press.

    Google Scholar 

  22. Kataoka, S. H., Rowan, B., & Hoagwood, K. E. (2009). Bridging the divide: In search of common ground in mental health and education research and policy. Psychiatric Services, 60(11), 1510–1515.

    Article  Google Scholar 

  23. Kutash, K., Duchnowski, A. J., & Lynn, N. (2006). School-based mental health: An empirical guide for decision-makers. Tampa, FL: The Louis de la Parte Florida Mental Health Institute, Research and Training Center for Children’s Mental Health, University of South Florida.

    Google Scholar 

  24. Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113.

    Article  Google Scholar 

  25. Locke, J., Lawson, G., Beidas, R., Aarons, G. A., Xie, M., Lyon, A. R., et al. (2019). Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: A cross-sectional observational study. Implementation Science, 14(29), 1–9.

    Google Scholar 

  26. MacQueen, K. M., McLellan, E., Kay, K., & Milstein, B. (1998). Codebook development for team-based qualitative analysis. Field Methods, 10(2), 31–36.

    Google Scholar 

  27. Massey, O. T., Armstrong, K., Boroughs, M., Henson, K., & McCash, L. (2005). Mental health services in schools: A qualitative analysis of challenges to implementation, operation, and sustainability. Psychology in the Schools, 42(4), 361–372.

    Article  Google Scholar 

  28. McIntosh, K., Horner, R. H., & Sugai, G. (2009). Sustainability of systems-level evidence-based practices in schools: Current knowledge and future directions. In W. Sailor, G. Dunlap, G. Sugai, & R. Horner (Eds.), Handbook of positive behavior support. Issues in clinical child psychology (pp. 327–352). Boston, MA: Springer.

    Chapter  Google Scholar 

  29. Mendenhall, A. N., Iachini, A., & Anderson-Butcher, D. (2013). Exploring stakeholder perceptions of facilitators and barriers to implementation of an expanded school improvement model. Children & Schools, 35(4), 225–234.

    Article  Google Scholar 

  30. Meyers, A. B., Tobin, R. M., Huber, B. J., Conway, D. E., & Shelvin, K. H. (2015). Interdisciplinary collaboration supporting social-emotional learning in rural school systems. Journal of Educational & Psychological Consultation, 25(2–3), 109–128.

    Article  Google Scholar 

  31. Padgett, S., Bekemeier, B., & Berkowitz, B. (2005). Building sustainable public health systems change at the state level. Journal of Public Health Management and Practice, 11(2), 109–115.

    Article  Google Scholar 

  32. Peek, C. J., & the National Integration Academy Council. (2013). Lexicon for behavioral health and primary care integration: Concepts and definitions developed by expert consensus. Rockville, MD: Agency for Healthcare Research and Quality (Publication No. 13-IP001-EF). Retrieved from https://integrationacademy.ahrq.gov/sites/default/files/2020-06/Lexicon.pdf.

  33. Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104(3), 700–712.

    Article  Google Scholar 

  34. Saldana, L. (2014). The stages of implementation completion for evidence-based practice: Protocol for a mixed methods study. Implementation Science, 9(43), 1–11.

    Google Scholar 

  35. Stemler, S. E. (2004). A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research, and Evaluation, 9(4), 1–11.

    Google Scholar 

  36. Substance Abuse and Mental Health Services Administration. (2019). Behavioral health treatments and services. Retrieved from https://www.samhsa.gov/find-help/treatment.

  37. Van Dyke, M. K., & Naoom, S. F. (2016). The critical role of state agencies in the age of evidence-based approaches: The challenge of new expectations. Journal of Evidence-Informed Social Work, 13(1), 45–58.

    Article  Google Scholar 

  38. Vroom, E. B., Massey, O. T., Yampolskaya, S., & Levin, B. L. (2020). The impact of implementation fidelity on student outcomes in the Life Skills Training program. School Mental Health, 12(1), 113–123.

    Article  Google Scholar 

  39. Weist, M. D., Mellin, E. A., Chambers, K. L., Lever, N. A., Haber, D., & Blaber, C. (2012). Challenges to collaboration in school mental health and strategies for overcoming them. Journal of School Health, 82(2), 97–105.

    Article  Google Scholar 

  40. Williams, N. J., Frank, H. E., Lindsay, F., Beidas, R. S., Mandell, D. S., Aarons, G. A., et al. (2019). Organizational culture and climate profiles: Relationships with fidelity to three evidence-based practices for autism in elementary schools. Implementation Science, 14(15), 1–14.

    Google Scholar 

  41. National Center for Healthy Safe Children. (n.d.). SS/HS framework. Retrieved from https://healthysafechildren.org/sshs-framework.

Download references

Funding

There was no funding for this study or preparation of the manuscript.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Oliver T. Massey.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures were in accordance with the ethical standards of the institutional review boards and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. For this type of study, verbal consent at the time of the interview, in lieu of documented written consent, was considered an adequate safeguard to participants’ rights.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Interview Guide

  1. 1.

    Can you briefly provide an overview of the Safe Schools Initiative at your site and how it works?

    1. (a)

      What are the main things you have accomplished, or are perhaps still hoping to accomplish?

  2. 2.

    What do you see as the major facilitators in implementing your plan and achieving the objectives of your state’s program?

  3. 3.

    What do you see as the major barriers or difficulties in implementing your plan and achieving the objectives of your state’s program?

  4. 4.

    Given these opportunities and barriers, what impact do you think they have had on the operations and success of the SSHS program?

  5. 5.

    What policies at the state and/or the community level facilitate and/or hinder your implementation efforts?

  6. 6.

    What can you tell me about the improvements that have been made to the services you offer and accessing those services?

    1. (a)

      Can you tell me how you ensure the quality of services you provide?

  7. 7.

    What have you learned about what makes a program successful?

  8. 8.

    What factors related to the workforce have helped to facilitate the implementation and ongoing operation of your program?

    1. (a)

      What factors related to the workforce have hindered the implementation and ongoing operation of your program?

  9. 9.

    What training programs for the mental health workforce have been initiated?

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Massey, O.T., Vroom, E.B. & Weston, A.N. Implementation of School-Based Behavioral Health Services Over Time: A Longitudinal, Multi-level Qualitative Study. School Mental Health 13, 201–212 (2021). https://doi.org/10.1007/s12310-020-09407-5

Download citation

Keywords

  • Implementation science
  • Evidence-based practice
  • Program evaluation
  • Barriers
  • Facilitators
  • School-based services
  • Behavioral health