Skip to main content

Advertisement

Log in

From Evidence to Impact: Joining Our Best School Mental Health Practices with Our Best Implementation Strategies

School Mental Health Aims and scope Submit manuscript

Abstract

There is substantial research evidence for the effectiveness of school mental health strategies across problem areas, developmental levels, and the prevention-intervention spectrum. At the same time, it is clear that the education and mental health fields continue to struggle to apply this evidence at any level of scale. This commentary reflects on ways in which education-specific applications of implementation science principles—and explicit consideration of determinants of implementation success—may guide more consistent use of evidence in school mental health. After reviewing implementation determinants and strategies across multiple levels of effect (i.e., the outer setting, inner setting, individual, and intervention levels), the commentary goes on to recommend specific areas of needed attention in school mental health implementation efforts and research. These include a need to adapt interventions to better fit the context of schools, streamlining school mental health programs and practices to make them more implementable, and recognizing the critical role of assessment and selection of evidence-based interventions by school leaders. The commentary concludes by reflecting on the substantial opportunity provided by the education sector to both apply and advance implementation science.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11.

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017). Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol. Implementation Science, 12(1), 29.

    Article  Google Scholar 

  • Aarons, G. A., & Sommerfeld, D. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child and Adolescent Psychiatry, 51(4), 423–431. https://doi.org/10.1016/j.jaac.2012.01.018.

    Article  PubMed  Google Scholar 

  • Balas, E. A., & Boren, S. A. (2000). Managing clinical knowledge for health care improvement. Yearbook of Medical Informatics 2000: Patient-Centered Systems. Retrieved from https://augusta.openrepository.com/augusta/handle/10675.2/617990.

  • Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K., et al. (2013). Policy to implementation: evidence-based practice in community mental health—study protocol. Implementation Science, 8(1), 38. https://doi.org/10.1186/1748-5908-8-38.

    Article  PubMed  Google Scholar 

  • Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. https://doi.org/10.1111/j.1468-2850.2009.01187.x.

    Article  Google Scholar 

  • Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., et al. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. https://doi.org/10.1001/jamapediatrics.2014.3736.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal. https://doi.org/10.1155/2014/802983.

    Article  PubMed  PubMed Central  Google Scholar 

  • Brackett, M. A., Rivers, S. E., Reyes, M. R., & Salovey, P. (2012). Enhancing academic performance and social and emotional competence with the RULER feeling words curriculum. Learning and Individual Differences, 22(2), 218–224. https://doi.org/10.1016/j.lindif.2010.10.002.

    Article  Google Scholar 

  • Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of school wide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12(3), 133–148. https://doi.org/10.1177/1098300709334798.

    Article  Google Scholar 

  • Bruns, E. B., Pullmann, M. D., Nicodimos, S., Lyon, A. R., Ludwig, K., Namkung, N., & McCauley, E. (in press). Pilot test of an engagement, triage, and brief intervention strategy for school mental health. School Mental Health.

  • Chambers, D. A., & Azrin, S. T. (2013). Partnership: A fundamental component of dissemination and implementation research. Psychiatric Services, 64(6), 509–511. https://doi.org/10.1176/appi.ps.201300032.

    Article  PubMed  Google Scholar 

  • Comer, J. S., & Barlow, D. H. (2014). The occasional case against broad dissemination and implementation: Retaining a role for specialty care in the delivery of psychological treatments. American Psychologist, 69(1), 1–18. https://doi.org/10.1037/a0033582.

    Article  PubMed  Google Scholar 

  • Cook, C. R., Lyon, A. R., Kubergovic, D., Browning Wright, D., & Zhang, Y. (2015). A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. School Mental Health, 7(1), 49–60. https://doi.org/10.1007/s12310-014-9139-3.

    Article  Google Scholar 

  • Cook, C. R., Lyon, A. R., Locke, J., Waltz, T., & Powell, B. (in press). Adapting a compilation of implementation strategies to advance school-based implementation research and practice. Prevention Science.

  • Costello, J. (2009). Editorial: How epidemiology helps. Journal of Child Psychology and Psychiatry, 50, 361–362. https://doi.org/10.1111/j.1469-7610.2009.02102.x.

    Article  PubMed  Google Scholar 

  • Costello, E. J., He, J., Sampson, N. A., Kessler, R. C., & Merikangas, K. R. (2014). Services for adolescents with psychiatric disorders: 12-month data from the national comorbidity survey-adolescent. Psychiatric Services, 65(3), 359–366. https://doi.org/10.1176/appi.ps.201100518.

    Article  PubMed  Google Scholar 

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. https://doi.org/10.1186/1748-5908-4-50.

    Article  PubMed  Google Scholar 

  • Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (in press). A glossary of user-centered design strategies for implementation experts. Translational Behavioral Medicine.

  • Flannery, K. B., Fenning, P., Kato, M. M., & McIntosh, K. (2014). Effects of school-wide positive behavioral interventions and supports and fidelity of implementation on problem behavior in high schools. School Psychology Quarterly, 29(2), 111–124. https://doi.org/10.1037/spq0000039.

    Article  PubMed  Google Scholar 

  • Forman, S. G., & Barakat, N. M. (2011). Cognitive-behavioral therapy in the schools: Bringing research to practice through effective implementation. Psychology in the Schools, 48(3), 283–296. https://doi.org/10.1002/pits.20547.

    Article  Google Scholar 

  • Freeman, R., Miller, D., & Newcomer, L. (2015). Integration of academic and behavioral MTSS at the district level using implementation science. Learning Disabilities—A Contemporary Journal, 13(1), 59–72.

    Google Scholar 

  • Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.

    Article  Google Scholar 

  • Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39(1), 3–35.

    Article  Google Scholar 

  • Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., et al. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76(4), 556–567. https://doi.org/10.1037/0022-006X.76.4.556.

    Article  PubMed  PubMed Central  Google Scholar 

  • Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005.

    Article  PubMed  PubMed Central  Google Scholar 

  • Houtrow, A. J., Larson, K., Olson, L. M., Newacheck, P. W., & Halfon, N. (2014). Changing trends of childhood disability, 2001–2011. Pediatrics, 134(3), 530–538.

    Article  Google Scholar 

  • Joyce, B. R., & Showers, B. (2002). Student achievement through staff development, 3rd edn. Alexandria, VA: Association for Supervision and Curriculum Development.

    Google Scholar 

  • Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1–27.

    Article  Google Scholar 

  • Kincaid, D., & Horner, R. (2017). Changing systems to scale up an evidence-based educational intervention. Evidence-Based Communication Assessment and Intervention, 11(3–4), 99–113. https://doi.org/10.1080/17489539.2017.1376383.

    Article  Google Scholar 

  • Lane, K. L., Menzies, H. M., Ennis, R. P., & Bezdek, J. (2013). School-wide systems to promote positive behaviors and facilitate instruction. Journal of Curriculum and Instruction, 7(1), 6–31.

    Article  Google Scholar 

  • Lewis, C. C. (2017). What are implementation mechanisms and why do they matter? In Plenary presentation at the 2017 conference of the Society for Implementation Research Collaboration (SIRC), Seattle, WA.

  • Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015). Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science, 10(1), 155. https://doi.org/10.1186/s13012-015-0342-x.

    Article  PubMed  Google Scholar 

  • Lewis, C. C., Mettert, K. D., Dorsey, C. N., Martinez, R. G., Weiner, B. J., Nolen, E., et al. (2018). An updated protocol for a systematic review of implementation-related measures. Systematic Reviews, 7(1), 66. https://doi.org/10.1186/s13643-018-0728-3.

    Article  PubMed  PubMed Central  Google Scholar 

  • Locke, J., Lee, K., Cook, C. R., Frederick, L., Vazquez-Colon, C., Ehrhart, M. G., et al. (in press). Understanding the organizational implementation context of schools: A qualitative study of multiple stakeholders. School Mental Health.

  • Locke, J., Olsen, A., Wideman, R., Downey, M. M., Kretzmann, M., Kasari, C., et al. (2015). A tangled web: The challenges of implementing an evidence-based social engagement intervention for children with autism in urban public school settings. Behavior Therapy, 46(1), 54–67. https://doi.org/10.1016/j.beth.2014.05.001.

    Article  PubMed  Google Scholar 

  • Lyon, A. R., & Bruns, E. J. (in press). User-centered redesign of evidence-based psychosocial interventions to enhance implementation—hospitable soil or better seeds? JAMA Psychiatry.

  • Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., et al. (2018a). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13(1), 5. https://doi.org/10.1186/s13012-017-0705-6.

    Article  PubMed  Google Scholar 

  • Lyon, A. R., Cook, C. R., Locke, J., Davis, C., Powell, B. J., & Waltz, T. J. (under review). Importance and feasibility of an adapted set of strategies for implementing evidence-based mental health practices in schools.

  • Lyon, A. R., & Koerner, K. (2016). User-centered design for psychosocial intervention development and implementation. Clinical Psychology: Science and Practice, 23(2), 180–200. https://doi.org/10.1111/cpsp.12154.

    Article  Google Scholar 

  • Lyon, A. R., Koerner, K., & Chung, J. (2018). How implementable is that evidence-based practice? A methodology for assessing complex innovation usability. In Paper presented at the 11th annual conference on the science of dissemination and implementation. Washington, DC.

  • Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014a). A case for modular design: Implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. https://doi.org/10.1037/a0035301.

    Article  Google Scholar 

  • Lyon, A. R., Ludwig, K., Romano, E., Koltracht, J., Vander Stoep, A., & McCauley, E. (2014b). Using modular psychotherapy in school mental health: Provider perspectives on intervention-setting fit. Journal of Clinical Child & Adolescent Psychology, 43, 890–901.

    Article  Google Scholar 

  • Lyon, A. R., Whitaker, K., Locke, J., Cook, C. R., King, K. M., Duong, M., et al. (2018b). The impact of inter-organizational alignment (IOA) on implementation outcomes: Evaluating unique and shared organizational influences in education sector mental health. Implementation Science: IS, 13. https://doi.org/10.1186/s13012-018-0721-1.

  • Maynard, B., Farina, A., & Dell, N. (2017). Effects of trauma-informed approaches in schools. Downloaded October 6, 2018 from https://www.campbellcollaboration.org/library/effects-of-trauma-informed-approaches-in-schools.html.

  • McIntosh, K., Mercer, S. H., Nese, R. N. T., Strickland-Cohen, M. K., & Hoselton, R. (2016). Predictors of sustained implementation of school-wide positive behavioral interventions and supports. Journal of Positive Behavior Interventions, 18(4), 209–218. https://doi.org/10.1177/1098300715599737.

    Article  Google Scholar 

  • Metz, A., & Louison, L. (2018). The Hexagon Tool: Exploring Context. Chapel Hill, NC: National Implementation Research Network, Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill.

  • New Jersey School Boards Association. (2016). Unfunded and underfunded state and federal mandates: A burden on local school districts. Retrived October 1, 2018 from https://www.njsba.org/wpcontent/uploads/2016/05/Unfunded-Underfunded-Mandates-may2016.pdf.

  • Owens, J. S., Lyon, A. R., Brandt, N. E., Masia Warner, C., Nadeem, E., Spiel, C., et al. (2014). Implementation science in school mental health: Key constructs in a developing research agenda. School Mental Health, 6(2), 99–111. https://doi.org/10.1007/s12310-013-9115-3.

    Article  PubMed  Google Scholar 

  • Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., et al. (2016). Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy In Mental Health, 43(6), 909–926. https://doi.org/10.1007/s10488-016-0733-6.

    Article  PubMed  PubMed Central  Google Scholar 

  • Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 21. https://doi.org/10.1186/s13012-015-0209-1.

    Article  PubMed  Google Scholar 

  • Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  • Purtle, J., Brownson, R. C., & Proctor, E. K. (2017). Infusing science into politics and policy: The importance of legislators as an audience in mental health policy dissemination research. Administration and Policy in Mental Health and Mental Health Services Research, 44(2), 160–163.

    Article  Google Scholar 

  • Purtle, J., Lê-Scherban, F., Wang, X., Shattuck, P. T., Proctor, E. K., & Brownson, R. C. (2018). Audience segmentation to disseminate behavioral health evidence to legislators: An empirical clustering analysis. Implementation Science, 13(1), 121.

    Article  Google Scholar 

  • Spiel, C. F., Evans, S. W., & Langberg, J. M. (2014). Evaluating the content of individualized education programs and 504 plans of young adolescents with attention deficit/hyperactivity disorder. School Psychology Quarterly, 29(4), 452–468. https://doi.org/10.1037/spq0000101.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sugai, G., & Horner, R. H. (2009). Responsiveness-to-intervention and school-wide positive behavior supports: Integration of multi-tiered system approaches. Exceptionality, 17(4), 223–237. https://doi.org/10.1080/09362830903235375.

    Article  Google Scholar 

  • Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337–350. https://doi.org/10.1016/j.amepre.2012.05.024.

    Article  PubMed  PubMed Central  Google Scholar 

  • Trupin, E., & Kerns, S. (2017). Introduction to the special issue: Legislation related to children’s evidence-based practice. Administration and Policy in Mental Health and Mental Health Services Research, 44(1), 1–5. https://doi.org/10.1007/s10488-015-0666-5.

    Article  PubMed  Google Scholar 

  • Williams, E. C., Achtmeyer, C. E., Young, J. P., Rittmueller, S. E., Ludman, E. J., Lapham, G. T., et al. (2016). Local implementation of alcohol screening and brief intervention at five veterans health administration primary care clinics: Perspectives of clinical and administrative staff. Journal of Substance Abuse Treatment, 60, 27–35. https://doi.org/10.1016/j.jsat.2015.07.011.

    Article  PubMed  Google Scholar 

Download references

Funding

The authors received no funding to support this article.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aaron R. Lyon.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants performed by either of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lyon, A.R., Bruns, E.J. From Evidence to Impact: Joining Our Best School Mental Health Practices with Our Best Implementation Strategies. School Mental Health 11, 106–114 (2019). https://doi.org/10.1007/s12310-018-09306-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12310-018-09306-w

Keywords

Navigation