Skip to main content
SpringerLink
Log in

Evaluating the Cost of Prevention Programming and Universal Screening with Discrete Event Simulation

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Discrete Event Simulation (DES) is a novel system modeling technique that allows for the evaluation of the potential costs and personnel needed for mental health services in school. A case study is presented to illustrate how DES could be used by a school’s decision makers to help plan for implementation of an integrated mental health service model. Discrete Event Simulation was used to model the personnel, time, and costs of an integrated mental health service model within a school setting. In addition, costs are calculated and then compared to a business as usual model. Data from the present investigation indicate substantial cost savings of implementing a prevention oriented mental health intervention model within a school setting. In a school of 1000 students, the prevention model could result in an annual cost savings of approximately $30,000 as well as a 50% reduction in disciplinary referrals and 22% reduction in suspensions. Results from the present investigation indicate substantial savings in financial resources and overall numbers of disciplinary infractions when implementing a prevention model. The DES allows for customization of personnel and time to modify the model and resulting output to local conditions. These data may allow school administrators to modify resources to meet student needs. In addition, cost data can help address some of the common implementation barriers associated with adoption of universal screening and preventative mental health services.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Adelman, H. S., & Taylor, L. (2007). Systemic change for school improvement. Journal of Educational and Psychological Consultation, 17(1), 55–77. https://doi.org/10.1080/10474410709336590.

    Article  Google Scholar 

  • Anderson, A. R., Christenson, S. L., Sinclair, M. F., & Lehr, C. A. (2004). Check & connect: The importance of relationships for promoting engagement with school. Journal of School Psychology, 42(2), 95–113. https://doi.org/10.1016/j.jsp.2004.01.002.

    Article  Google Scholar 

  • Anderson, J. K., Ford, T., Soneson, E., Coon, J. T., Humphrey, A., Rogers, M., & Howarth, E. (2019). A systematic review of effectiveness and cost-effectiveness of school-based identification of children and young people at risk of, or currently experiencing mental health difficulties. Psychological Medicine, 49(1), 9–19.

    Article  Google Scholar 

  • Barrett, S., Eber, L., & Weist, M. (2013). Advancing educational effectiveness: Interconnecting school mental health and school-wide positive behavior support. Retrieved from pbis.org.

  • Barrett, S., & Scott, T. M. (2007). Evaluating time saved as an index of the cost effectiveness in PBIS schools. Positive Behavioral Interventions and Supports Newsletter, 3(4), 1–4.

    Google Scholar 

  • Belfer, M. L. (2008). Child and adolescent mental disorders: the magnitude of the problem across the globe. Journal of Child Psychology and Psychiatry, 49(3), 221–356. https://doi.org/10.1111/j.1469-7610.2007.01855.x.

    Article  Google Scholar 

  • Blonigen, B. A., Harbaugh, W. T., Singell, L. D., Horner, R. H., Irvin, L. K., & Smolkowski, K. S. (2008). Application of economic analysis to school-wide positive behavior support (SWPBS) programs. Journal of Positive Behavior Interventions, 10(1), 5–19.

    Article  Google Scholar 

  • Briesch, A. M., Cintron, D. W., Dineen, J. N., Chafouleas, S. M., McCoach, D. B., & Auerbach, E. (2019). Comparing stakeholders’ knowledge and beliefs about supporting students’ social, emotional, and behavioral health in schools. School Mental Health. https://doi.org/10.1007/s12310-019-09355-9.

    Article  Google Scholar 

  • Burke, L. A., Wasserman, D., Carli, V., Corcoran, P., Keeley, H., Balazs, J., et al. (2013). A cost effectiveness analysis of four arms of a school-based mental health intervention in Europe. European Child and Adolescent Psychiatry, 1, S198–S199.

    Google Scholar 

  • Center for Benefit-Cost Studies of Education (BCSE) Cost Tool Kit. (2017). Retrieved from https://www.cbcsecosttoolkit.org/

  • Chatterji, P., Caffray, C. M., Crowe, M., Freeman, L., & Jensen, P. (2004). Cost assessment of a school-based mental health screening and treatment program in New York City. Mental Health Services Research, 6, 155–166. https://doi.org/10.1023/B:MHSR.0000036489.50470.cb.

    Article  PubMed  Google Scholar 

  • Cheney, D., Lynass, L., Flower, A., Waugh, M., Iwaszuk, W., Mielenz, C., & Hawken, L. (2009a). The Check, Connect, and Expect Program: A targeted, tier 2 intervention in the schoolwide positive behavior support model. Preventing School Failure: Alternative Education for Children and Youth, 53(4), 152–158. https://doi.org/10.1080/10459880903492742.

    Article  Google Scholar 

  • Cheney, D. A., Stage, S. A., Hawken, L. S., Lynass, L., Mielenz, C., & Waugh, M. (2009b). A 2-year outcome study of the Check, Connect, and Expect Interventions for students at risk for severe behavior problems. Journal of Emotional and Behavioral Disorders, 17(4), 226–243. https://doi.org/10.1177/1063426609339186.

    Article  Google Scholar 

  • Christ, T. J., Riley-Tillman, T. C., & Chafouleas, S. M. (2009). Foundation for the developmentand use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34(4), 201–213.

    Article  Google Scholar 

  • Cook, C. R., Volpe, R. J., & Livanis, A. (2010). Universal screening beyond academic performance: Introduction to the special series. Assessment for Effective Intervention, 35(4), 195–196. https://doi.org/10.1177/1534508410379843.

    Article  Google Scholar 

  • Crone, D. A., Hawken, L. S., & Horner, R. H. (2010). Responding to problem behavior in schools: The behavior education program. New York: Guilford Press.

    Google Scholar 

  • Dever, B. V., Dowdy, E., & DiStefano, C. (2018). Examining the stability, accuracy, and predictive validity of behavioral–emotional screening scores across time to inform repeated screening procedures. School Psychology Review, 47(4), 360–371. https://doi.org/10.17105/SPR-2017-0092.V47-4.

    Article  Google Scholar 

  • Dever, B. V., Raines, T. C., & Barclay, C. M. (2012). Chasing the unicorn: Practical implementation of universal screening for behavioral and emotional risk. School Psychology Forum, 6(4), 108–118.

    Google Scholar 

  • Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 1–447. https://doi.org/10.1111/j.1467-8624.2010.01564.x.

    Article  Google Scholar 

  • Eklund, K., & Dowdy, E. (2014). Screening for behavioral and emotional risk versus traditional school identification methods. School Mental Health, 6(1), 40–49. https://doi.org/10.1037/pas0000355.

    Article  Google Scholar 

  • Eklund, K., Kilgus, S., von der Embse, N. P., Beardmore, M., & Tanner, N. (2017). Use of universal screening scores to predict distal academic and behavioral outcomes: A multi-level approach. Psychological Assessment, 29(5), 486–499. https://doi.org/10.1037/pas0000355.

    Article  PubMed  Google Scholar 

  • Filter, K. J., McKenna, M. K., Benedict, E. A., Horner, R. H., Todd, A., & Watson, J. (2007). Check in/check out: A post-hoc evaluation of an efficient, secondary-level targeted intervention for reducing problem behaviors in schools. Education and Treatment of Children, 30(1), 69–84.

    Article  Google Scholar 

  • Furlong, M., Dowdy, E., Carnazzo, K., Bovery, B. L., & Kim, L. (2014). Covitality: Fosteringthe building blocks of complete mental health. NASP Communique.

  • Girio-Herrera, E., Owens, J. S., & Langberg, J. M. (2013). Perceived barriers to help-seeking among parents of at-risk kindergarteners in rural communities. Journal of Clinical Child & Adolescent Psychology, 42(1), 68–77. https://doi.org/10.1080/15374416.2012.715365.

    Article  Google Scholar 

  • Herbstrith, J. C., & Tobin, R. M. (2014). Best practices in group counseling. In P. Harrison & A. Thomas (Eds.), Best Practices in School Psychology (Vol. V, pp. 305–319). Washington, DC: National Association of School Psychologists.

    Google Scholar 

  • Hunter, L. J., DiPerna, J. C., Hart, S. C., & Crowley, M. (2018). At what cost? Examining the cost effectiveness of a universal social–emotional learning program. School Psychology Quarterly, 33(1), 147–154. https://doi.org/10.1037/spq0000232.

    Article  PubMed  Google Scholar 

  • Jain, R. (1991). The Art of Computer Systems Performance Analysis, John Wiley & Sons, Jepson, L., Juszczak, L., & Fisher, M. (1998). Mental health care in a high school-based health service. Adolescence, 33(129).

  • Jepson, L., Juszczak, L., & Fisher, M. (1998). Mental health care in a high school based health service. Adolescence, 33(129), 1–16.

    CAS  PubMed  Google Scholar 

  • Kalberg, R. J., Lane, K. L., Driscoll, S., & Wehby, J. (2011). Systematic screening for emotional and behavioral disorders at the high school level: A formidable and necessary task. Journal of Remedial and Special Education, 32(6), 506–520. https://doi.org/10.1177/0741932510362508.

    Article  Google Scholar 

  • Kamphaus, R. W., & Reynolds, C. R. (2007). BASC-2 Behavioral and Emotional Screening System. Minneapolis, MN: Pearson.

  • Kendall, P. C. (2006). Coping Cat Workbook. Workbook Pub.

  • Kilgus, S. P., & von der Embse, N. P. (2015). Social, academic, and emotional behavior risk screener (SAEBRS). Minneapolis, MN: Theodore J. Christ & Colleagues.

    Google Scholar 

  • Kilgus, S. P., von der Embse, N. P., Taylor, C., Allen, A., & Eklund, K. (2018). Examining SAEBRS technical adequacy and the moderating influence of criterion type on cut score performance. Remedial and Special Education, 39, 377–388. https://doi.org/10.1177/0741932517748421.

    Article  Google Scholar 

  • Kuo, E., Vander Stoep, A., McCauley, E., & Kernic, M. A. (2009). Cost-effectiveness of a school-based emotional health screening program. Journal of School Health, 79(6), 277–285.

    Article  Google Scholar 

  • Jain, R. (1991). The Art of Computer Systems Performance Analysis, John Wiley & Sons.

  • Lane, K. L., Oakes, W. P., Ennis, R. P., & Hirsch, S. E. (2014). Identifying students for secondary and tertiary prevention efforts: How do we determine which students have tier 2 and tier 3 needs? Preventing School Failure: Alternative Education for Children and Youth, 58(3), 171–182. https://doi.org/10.1080/1045988X.2014.895573.

    Article  Google Scholar 

  • Law, A. (2015). Simulation Modeling and Analysis, Fifth Edition, McGraw-Hill.

  • Lenz, S. (2015). Meta-Analysis of the Coping Cat program for decreasing severity of anxiety symptoms among children and adolescents. Journal of Child and Adolescent Counseling, 1(2), 51–56. https://doi.org/10.1080/23727810.2015.1079116.

    Article  Google Scholar 

  • Levin, H., & Belfield, C. (2015). Guiding the development and use of cost-effectiveness analysisin education. Journal of Research on Educational Effectiveness, 8(3), 400–418. https://doi.org/10.1080/19345747.2014.915604.

    Article  Google Scholar 

  • Lyon, A., Maras, M., Pate, C., Igusa, T., & Vander Stoep, A. (2016). Modeling the impact of school-based universal depression screening on additional service capacity needs: A system dynamics approach. Adm Policy Mental Health, 43, 168–188. https://doi.org/10.1007/s10488-015-0628-y.

    Article  Google Scholar 

  • National Association of School Psychologists. (2017). Shortages in school psychology: Challenges to meeting the growing needs of U.S. students and schools. Bethesda, MD: Author. Research summary. Retrieved from www.nasponline.org/Documents/Resources%20and%20publications/Resources/School_Psychology_Shortage_2017.pdf.

  • MacGinnis, E., & Goldstein, A. P. (1997). Skillstreaming the elementary school child: New strategies and perspectives for teaching prosocial skills. Champaign, IL: Research Press.

    Google Scholar 

  • McDaniel, S. C., Houchins, D. E., & Robinson, C. (2016). The effects of Check, Connect, and Expect on behavioral and academic growth. Journal of Emotional and Behavioral Disorders, 24(1), 42–53. https://doi.org/10.1177/106342.

    Article  Google Scholar 

  • Miller, C., & F. G., Chafouleas, D., Riley-Tillman, S.M., Welsh, T.C., & Fabiano M. E. . (2015). A comparison of measures to screen for social, emotional, and behavioral risk. School Psychology Quarterly, 30(2), 184–196.

    Article  Google Scholar 

  • Moore, S. A., Mayworm, A. M., Stein, R., Sharkey, J. D., & Dowdy, E. (2019). Languishing students: Linking complete mental health screening in schools to Tier 2 intervention Journal of applied school psychology, 35(3), 257–289.

  • Oakes, W. P., Lane, K. L., Cox, M. L., & Messenger, M. (2014). Logistics of behavior screenings: How and why do we conduct behavior screenings at our school? Preventing School Failure: Alternative Education for Children and Youth, 58(3), 159–170. https://doi.org/10.1080/1045988X.2014.895572.

    Article  Google Scholar 

  • Perou, R., Bitsko, R. H., Blumberg, S. J., Pastor, P., Ghandour, R. M., Gfroerer, J. C., & Huang, L. N. (2013). Mental health surveillance among children— United States, 2005–2011. MMWR Surveillance Summary, 62(2), 1–35.

    Google Scholar 

  • Phillips, R. (2010). The financial costs of bullying, violence, and vandalism. Reston, VA: NASSP.

    Google Scholar 

  • Reinke, W. M., Herman, K. C., Petras, H., & Ialongo, S. N. (2008). Empirically derived subtypes of child academic and behavior problems: Co-occurrence and distal outcomes. Journal of Abnormal Child Psychology, 36, 759–770. https://doi.org/10.1007/s10802-007-9208-2.

    Article  PubMed  PubMed Central  Google Scholar 

  • Romer, N., von der Embse, N., Eklund, K., Kilgus, S., Perales, K., Splett, J. W., Sudlo, S., Wheeler, D., (2020). Best Practices in Social, Emotional, and Behavioral Screening: An Implementation Guide. Version 2.0. Retrieved from www.smhcollaborative.org/universal screening

  • Sayal, K., Owen, V., White, K., Merrell, C., Tymms, P., & Taylor, E. (2010). Impact of early school-based screening and intervention programs for ADHD on children’s outcomes and access to services: Follow-up of a school-based trial at age 10 Years. Archives of Pediatrics and Adolescent Medicine, 164(5), 462–469. https://doi.org/10.1001/archpediatrics.2010.40.

    Article  PubMed  Google Scholar 

  • Sheridan, B. A., McDonald, D. A., McGovern, K., Donlon, M., Kuhn, B., & Friedman, H. (2011). Evaluation of social skills program based on social learning theory, implemented in a school setting. Psychological Reports, 108(2), 420–436. https://doi.org/10.2466/10.11.17.PR0.108.2.420-436.

    Article  PubMed  Google Scholar 

  • Skiba, R. J., Michael, R. S., Nardo, A. C., & Peterson, R. L. (2002). The color of discipline: sources of racial and gender disproportionality in school punishment. The Urban Review, 34, 317–342. https://doi.org/10.1023/A:1021320817372.

    Article  Google Scholar 

  • Skiba, R., & Sprague, J. (2008). Safety without suspensions. Educational Leadership.

  • Sklad, M., Diekstra, R., De-Ritter, M., Ben, J., & Gravesteijn, C. (2012). Effectiveness of school-based universal social, emotional, and behavioral programs: Do they enhance students’ development in the area of skill, behavior, and adjustment? Psychology in Schools, 49(9), 817–910. https://doi.org/10.1002/pits.21641.

    Article  Google Scholar 

  • Suldo, S. M., & Shaffer, E. J. (2008). Looking beyond psychopathology: The dual-factor model of mental health in youth. School Psychology Review, 37(1), 52–68. https://doi.org/10.1080/02796015.2008.12087908.

    Article  Google Scholar 

  • Swain-Bradway, J., Lindstrom Johnson, S., Bradshaw, C., & McIntosh, K. (2017). What are the economic costs of implementing SWPBIS in comparison to the benefits from reducing suspensions. (PBIS evaluation brief). Eugene, OR: OSEP TA Center on Positive Behavioral Interventions and Supports.

    Google Scholar 

  • Texas Appleseed. (2011). Breaking rules, breaking budgets: The cost of exclusionary discipline in Dallas ISD. Retrieved from: https://www.texasappleseed.org/sites/default/files/160-STPP-DISDCostAnalysis.pdf

  • US Department of Education, Office for Civil Rights. (2014). Civil rights data collection. Data snapshot: College and career readiness.

  • van der Ham, R. (2020). salabim Documentation, Release 20.0.1, retrieved from: https://rawgit.com/salabim/salabim/master/salabim.pdf.

  • van Starrenburg, M. L., Kuijpers, R. C., Kleinjan, M., Hutschemaekers, G. J., & Engels, R. C. (2017). Effectiveness of a Cognitive Behavioral Therapy-Based Indicated Prevention Program for Children with Elevated Anxiety Levels: a Randomized Controlled Trial. Prevention science: the official journal of the Society for Prevention Research, 18(1), 31–39. https://doi.org/10.1007/s11121-016-0725-5.

    Article  Google Scholar 

  • von der Embse, N. P., Kilgus, S. P., Ake, E., Eklund, K. R., & Levi-Nielsen, S. (2018). Training teachers to facilitate early identification of mental and behavioral health risk. School Psychology Review, 47, 372–384.

    Article  Google Scholar 

  • von der Embse, N. P., Kim, E., Kilgus, S. P., Dedrick, R., & Sanchez, A. (2019). Multi-informant universal screening: Evaluation of rater, item, and construct variance with a trifactor model. Journal of School Psychology, 77, 52–66. https://doi.org/10.1016/j.jsp.2019.09.005.

    Article  PubMed  Google Scholar 

  • von der Embse, N. P., Rutherford, L., Mankin, A., & Jenkins, A. (2019). Implementation of a trauma-informed assessment to intervention model in a large urban school district. School Mental Health, 11, 276–279. https://doi.org/10.1007/s12310-018-9294-z.

    Article  Google Scholar 

  • Zirkel, P. A. (2009). Ethical duties are not necessarily legal duties. Communique, 37(5), 8.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Florida, Tampa, FL, USA

    Nathaniel von der Embse, Andrew S. Jenkins, Kenneth Christensen, Maithili Mishra & Brianna Chin

  2. University of Wisconsin-Madison, Madison, WI, USA

    Stephen Kilgus

  3. College of Education, University of South Florida, 4202 E. Fowler Avenue, Tampa, FL, 33620, USA

    Nathaniel von der Embse

Authors
  1. Nathaniel von der Embse
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrew S. Jenkins
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kenneth Christensen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stephen Kilgus
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maithili Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Brianna Chin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nathaniel von der Embse.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 32 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

von der Embse, N., Jenkins, A.S., Christensen, K. et al. Evaluating the Cost of Prevention Programming and Universal Screening with Discrete Event Simulation. Adm Policy Ment Health 48, 962–973 (2021). https://doi.org/10.1007/s10488-021-01108-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-021-01108-8

Keywords

Search

Navigation