Comprehensive Cost Analysis of First Step Next for Preschoolers with Disruptive Behavior Disorder: Using Real-World Intervention Data to Estimate Costs at Scale
- 104 Downloads
While the long-term societal costs for youth with disruptive behavior disorders are well documented, there is a dearth of information about the comprehensive costs of implementing even the most well-regarded early intervention programs, and the costs of scaling effective interventions are even less well understood. This study estimated the costs of delivering and disseminating First Step Next (FSN), an established tier two school-based early intervention, in preschool and kindergarten settings, including the training and ongoing technical assistance that support sustained, high-quality implementation. Using the Ingredients Method, we estimated (a) the per student costs of implementation, (b) the incremental cost of offering FSN to an additional student, and (c) the cost to disseminate FSN to 40 preschool and kindergarten students, including a sensitivity analysis to examine potential areas of cost savings. The per child cost to implement the FSN intervention with 29 triads in two cohorts was $4330. The incremental cost per additional student was only $2970, highlighting efficiencies gained once intervention infrastructure had been established. The cost of disseminating the intervention to a single cohort of 40 students was $170,106, or $4253 per student. The range in sensitivity analysis was $3141–$7829 per student, with variability in personnel wages having the greatest impact on cost estimates. This research expands on existing literature by providing a more comprehensive understanding of the cost of effective disruptive behavior interventions based on real-world implementation data, using these data to estimate dissemination costs, and showing how dissemination costs are particularly sensitive to personnel wages.
KeywordsCost analysis Behavior disorders Preschool Early intervention
Availability of Data and Material
In addition to the tables presented in this manuscript, we have several tables that contain the raw data used to create the cost analysis. These are available upon request.
This study is funded by the Institute for Education Sciences #R324A150221.
Compliance with Ethical Standards
Conflict of Interest
Ed Feil and Hill Walker are two of the authors of the First Step Next intervention. The other authors declare that they have no competing interests.
Research Involving Human Participants: Statement of Human Rights
The study has been approved by the appropriate institutional and/or national research ethics committee (i.e., Oregon Research Institute and University of Louisville, and Jefferson County Public Schools) and has been performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Research Involving Human Participants: Informed Consent
Informed consent was obtained from all individual participants included in the study.
Consent for Publication
This manuscript contains no individual data requiring consent for publication.
- Aos, S., Lieb, R., Mayfield, J., Marna, M., & Pennucci, A. (2004). Benefits and costs of prevention and early intervention programs for youth. Olypmia, WA: Washington State Institute for Public Policy.Google Scholar
- Brabson, L. A., Herschell, A. D., Kolko, D. J., & Mrozowski, S. J. (2019). Associations among job role, training type, and staff turnover in a large-scale implementation initiative. The Journal of Behavioral Health Services & Research, Advanced online publication. https://doi.org/10.1007/s11414-018-09645-1.CrossRefGoogle Scholar
- Education Endowment Foundation (2018). EFF guidance on cost evaluation. Author, Retrieved September 4, 2018 at https://educationendowmentfoundation.org.uk/
- Feil, E. G., Small, J. W., Frey, A. J., Seeley, J. R., Walker, H. M., & Forness, S. (2014). Positive behavior early intervention for young children at-risk for the development attention-deficit hyperactivity disorders: Preschool First Step To Success. Journal of Early Intervention, 36, 151–170.CrossRefGoogle Scholar
- Levin, H. M., Belfield, C., Hollands, F., Bowden, A. B., Cheng, H., Shand, R., et al. (2012). In Columbia University (Ed.), Cost-effectiveness analysis of interventions that improve high school completion. Teacher College.Google Scholar
- Levin, M., & McEwan, J. (2001). Cost effectiveness analysis: Methods and applications. Thousand Oaks, CA: Sage.Google Scholar
- Lynch, R. (Ed.). (2004). Exceptional returns: Economic, fiscal and social benefits of investment in early childhood development. Washington, DC: The Economic Policy Institute.Google Scholar
- Moessner, M., Minarik, C., Ozer, F., & Bauer, S. (2016). Effectiveness and cost-effectiveness of school-based dissemination strategies of an Internet-based program for the prevention and early intervention in eating disorders: A randomized trial. Prevention Science, 17, 306–313.CrossRefGoogle Scholar
- National Academies of Sciences, Engineering, and Medicine. (2016). Advancing the power of economic evidence to inform investments in children, youth, and families. Washington, DC: The National Academies Press.Google Scholar
- Olweus, D., Limber, S. P., & Breivik, K. (2019). Addressing specific forms of bullying: A large-scale evaluation of the Olweus Bullying Prevention Program. International Journal of Bullying Prevention, 1–15.Google Scholar
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76.CrossRefGoogle Scholar
- Raghavan, R. (2012). The role of economic evaluation in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice, 94, 113.Google Scholar
- Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., .& Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319-351.Google Scholar
- Sumi, W. C., Woodbridge, M. W., Javitz, S., Harold, S., Torrnton, P., Wagner, M., & Rouspil, K. (2013). Assessing the effectiveness of First Step to Success: Are short-term results the first step to long-term behavioral improvements? Journal of Emotional and Behavioral Disorders, 21, 66–78.CrossRefGoogle Scholar
- Tran, J. L., Sheng, R., Beaulieu, A., Villodas, M., & McBurnett, K. (2018). Cost-effectiveness of a behavioral psychosocial treatment integrated across home and school of pediatric ADHD-inattentive type. Administration and Policy in Mental Health Services Research, 45, 741–750.CrossRefGoogle Scholar
- United States Department of Education, Institute of Education Sciences, (2017) Education Research Grants. CFDA Number 84.305A (May 30, 2017).Google Scholar
- United States Department of Labor, Bureau of Labor Statistics (2018a). Retrieved June 30 2018 at https://www.bls.gov/oes/current/611100_3.htm#19-0000Google Scholar
- United States Department of Labor, Bureau of Labor Statistics (2018b). Retrieved June 30 2018 at https://www.bls.gov/news.release/ecec.t04.htm
- Walker, H. M., Feil, E. G., Frey, A. J., Small, J., Golly, A., Crosby, S., et al. (2018). First Step Next: An update version of the First Step to Success early intervention program. Perspectives on Early Childhood in Psychology and Education, 3, 89–109.Google Scholar
- Walker, H. M., Stiller, B., Golly, A., Kavanagh, K., Severson, H. H., & Feil, E. G. (1997). First Step to Success: Helping young children overcome antisocial behavior. Longmont, CO: Sopris West.Google Scholar
- Washington State Institute for Public Policy (2018). Incredible Years Parent Training: Children's Mental Health: Disruptive Behavior. Retrieved from http://www.wsipp.wa.gov/BenefitCost/ProgramPdf/158/Incredible-Years-Parent-Training
- Zisser, A. & Eyberg, S.M. (2017). Parent-child interaction therapy and the treatment of disruptive beahvior disorders. In J.R. Weiss & A.E. Kazdin Evidence-based psychotherapies for children and adolescents, Third Ediction (pp179-193). New York, Guilford Press.Google Scholar