Advertisement

Prevention Science

, Volume 20, Issue 8, pp 1219–1232 | Cite as

Comprehensive Cost Analysis of First Step Next for Preschoolers with Disruptive Behavior Disorder: Using Real-World Intervention Data to Estimate Costs at Scale

  • Andy J. FreyEmail author
  • Margaret R. Kuklinski
  • Kiersten Bills
  • Jason W. Small
  • Steven R. Forness
  • Hill M. Walker
  • Edward G. Feil
  • John R. Seeley
Article
  • 104 Downloads

Abstract

While the long-term societal costs for youth with disruptive behavior disorders are well documented, there is a dearth of information about the comprehensive costs of implementing even the most well-regarded early intervention programs, and the costs of scaling effective interventions are even less well understood. This study estimated the costs of delivering and disseminating First Step Next (FSN), an established tier two school-based early intervention, in preschool and kindergarten settings, including the training and ongoing technical assistance that support sustained, high-quality implementation. Using the Ingredients Method, we estimated (a) the per student costs of implementation, (b) the incremental cost of offering FSN to an additional student, and (c) the cost to disseminate FSN to 40 preschool and kindergarten students, including a sensitivity analysis to examine potential areas of cost savings. The per child cost to implement the FSN intervention with 29 triads in two cohorts was $4330. The incremental cost per additional student was only $2970, highlighting efficiencies gained once intervention infrastructure had been established. The cost of disseminating the intervention to a single cohort of 40 students was $170,106, or $4253 per student. The range in sensitivity analysis was $3141–$7829 per student, with variability in personnel wages having the greatest impact on cost estimates. This research expands on existing literature by providing a more comprehensive understanding of the cost of effective disruptive behavior interventions based on real-world implementation data, using these data to estimate dissemination costs, and showing how dissemination costs are particularly sensitive to personnel wages.

Keywords

Cost analysis Behavior disorders Preschool Early intervention 

Notes

Availability of Data and Material

In addition to the tables presented in this manuscript, we have several tables that contain the raw data used to create the cost analysis. These are available upon request.

Funding

This study is funded by the Institute for Education Sciences #R324A150221.

Compliance with Ethical Standards

Conflict of Interest

Ed Feil and Hill Walker are two of the authors of the First Step Next intervention. The other authors declare that they have no competing interests.

Research Involving Human Participants: Statement of Human Rights

The study has been approved by the appropriate institutional and/or national research ethics committee (i.e., Oregon Research Institute and University of Louisville, and Jefferson County Public Schools) and has been performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Research Involving Human Participants: Informed Consent

Informed consent was obtained from all individual participants included in the study.

Consent for Publication

This manuscript contains no individual data requiring consent for publication.

References

  1. Alfonso, Y. N., Johnson, S. L., Cheng, T., Jones, V., Ryan, L., Fein, J., & Bishai, D. (2019). A marginal cost analysis of a big brothers big sisters of America youth mentoring program: New evidence using statistical analysis. Children and Youth Services Review, 101, 23–32.CrossRefGoogle Scholar
  2. Aos, S., Lieb, R., Mayfield, J., Marna, M., & Pennucci, A. (2004). Benefits and costs of prevention and early intervention programs for youth. Olypmia, WA: Washington State Institute for Public Policy.Google Scholar
  3. Brabson, L. A., Herschell, A. D., Kolko, D. J., & Mrozowski, S. J. (2019). Associations among job role, training type, and staff turnover in a large-scale implementation initiative. The Journal of Behavioral Health Services & Research, Advanced online publication.  https://doi.org/10.1007/s11414-018-09645-1.CrossRefGoogle Scholar
  4. Burke, J. D., Waidman, I., & Lahey, B. B. (2010). Predictive validity of childhood oppositional defiant disorder and conduct disorder: Implications for the DSM-V. Journal of Abnormal Psychology, 119, 739–751.CrossRefGoogle Scholar
  5. Crowley, D. M., Dodge, K. A., Barnett, W. S., Corso, P., Duffy, S., Graham, P., et al. (2018). Standards of evidence for conducting and reporting economic evaluations in prevention science. Prevention Science, 19, 366–390.CrossRefGoogle Scholar
  6. Education Endowment Foundation (2018). EFF guidance on cost evaluation. Author, Retrieved September 4, 2018 at https://educationendowmentfoundation.org.uk/
  7. Egger, H. L., & Angold, A. (2006). Common emotional and behavioral disorders in preschool children: Presentation, nosology, and epidemiology. Journal of Child Psychology & Psychiatry, 47, 313–337.CrossRefGoogle Scholar
  8. Feil, E. G., Small, J. W., Frey, A. J., Seeley, J. R., Walker, H. M., & Forness, S. (2014). Positive behavior early intervention for young children at-risk for the development attention-deficit hyperactivity disorders: Preschool First Step To Success. Journal of Early Intervention, 36, 151–170.CrossRefGoogle Scholar
  9. Flay, B. R., Biglan, A., Borruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science, 6, 151–175.CrossRefGoogle Scholar
  10. Foster, E. M., Olchowski, A. E., & Webster-Stratton, C. H. (2007). Is stacking intervention components cost-effective? An analysis of the Incredible Years program. Journal of the American Academy of Child & Adolescent Psychiatry, 46, 1414–1424.CrossRefGoogle Scholar
  11. Gottfredson, D. C., Cook, T. D., & Gardner, F. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16, 893–926.  https://doi.org/10.1007/s11121-015-0555-x.CrossRefPubMedPubMedCentralGoogle Scholar
  12. Kozica, S. L., Lombard, C. B., Harrison, C. L., & Teede, H. J. (2016). Evaluation of a large healthy lifestyle program: Informing program implementation and scale-up in the prevention of obesity. Implementation Science, 11, 151.CrossRefGoogle Scholar
  13. Levin, H. M., Belfield, C., Hollands, F., Bowden, A. B., Cheng, H., Shand, R., et al. (2012). In Columbia University (Ed.), Cost-effectiveness analysis of interventions that improve high school completion. Teacher College.Google Scholar
  14. Levin, M., & McEwan, J. (2001). Cost effectiveness analysis: Methods and applications. Thousand Oaks, CA: Sage.Google Scholar
  15. Lynch, R. (Ed.). (2004). Exceptional returns: Economic, fiscal and social benefits of investment in early childhood development. Washington, DC: The Economic Policy Institute.Google Scholar
  16. Menting, A. T., deCastro, B. O., & Matthys, W. (2013). Effectiveness of the Incredible Years parent training to modify disruptive and prosocial child behavior: A meta-analysis review. Clinical Psychology Review, 33, 901–913.CrossRefGoogle Scholar
  17. Moessner, M., Minarik, C., Ozer, F., & Bauer, S. (2016). Effectiveness and cost-effectiveness of school-based dissemination strategies of an Internet-based program for the prevention and early intervention in eating disorders: A randomized trial. Prevention Science, 17, 306–313.CrossRefGoogle Scholar
  18. National Academies of Sciences, Engineering, and Medicine. (2016). Advancing the power of economic evidence to inform investments in children, youth, and families. Washington, DC: The National Academies Press.Google Scholar
  19. O’Connor, A., Blewitt, C., Nolan, A., & Skouteris, H. (2018). Using intervention mapping for child development and wellbeing programs in early childhood education and care settings. Evaluation and Program Planning, 68, 57–63.CrossRefGoogle Scholar
  20. Olweus, D., Limber, S. P., & Breivik, K. (2019). Addressing specific forms of bullying: A large-scale evaluation of the Olweus Bullying Prevention Program. International Journal of Bullying Prevention, 1–15.Google Scholar
  21. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76.CrossRefGoogle Scholar
  22. Raghavan, R. (2012). The role of economic evaluation in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice, 94, 113.Google Scholar
  23. Sanders, G. D., Neumann, P. J., & Russell, L. B. (2017). Updated recommendations for cost-effectiveness studies—Reply. JAMA : The Journal of the American Medical Association, 317, 90–90.CrossRefGoogle Scholar
  24. Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., .& Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319-351.Google Scholar
  25. Sumi, W. C., Woodbridge, M. W., Javitz, S., Harold, S., Torrnton, P., Wagner, M., & Rouspil, K. (2013). Assessing the effectiveness of First Step to Success: Are short-term results the first step to long-term behavioral improvements? Journal of Emotional and Behavioral Disorders, 21, 66–78.CrossRefGoogle Scholar
  26. Tran, J. L., Sheng, R., Beaulieu, A., Villodas, M., & McBurnett, K. (2018). Cost-effectiveness of a behavioral psychosocial treatment integrated across home and school of pediatric ADHD-inattentive type. Administration and Policy in Mental Health Services Research, 45, 741–750.CrossRefGoogle Scholar
  27. United States Department of Education, Institute of Education Sciences, (2017) Education Research Grants. CFDA Number 84.305A (May 30, 2017).Google Scholar
  28. United States Department of Labor, Bureau of Labor Statistics (2018a). Retrieved June 30 2018 at https://www.bls.gov/oes/current/611100_3.htm#19-0000Google Scholar
  29. United States Department of Labor, Bureau of Labor Statistics (2018b). Retrieved June 30 2018 at https://www.bls.gov/news.release/ecec.t04.htm
  30. Velasco, V., Griffin, K. W., Antichi, M., & Celata, C. (2015). A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers. Evaluation and Program Planning, 52, 27–38.CrossRefGoogle Scholar
  31. Walker, H. M., Feil, E. G., Frey, A. J., Small, J., Golly, A., Crosby, S., et al. (2018). First Step Next: An update version of the First Step to Success early intervention program. Perspectives on Early Childhood in Psychology and Education, 3, 89–109.Google Scholar
  32. Walker, H. M., Seeley, J. R., Small, J., Severson, H. H., Graham, B. A., Feil, E. G., et al. (2009). A randomized controlled trial of the First Step to Success early intervention. Journal of Emotional and Behavioral Disorders, 17, 197–212.CrossRefGoogle Scholar
  33. Walker, H. M., Stiller, B., Golly, A., Kavanagh, K., Severson, H. H., & Feil, E. G. (1997). First Step to Success: Helping young children overcome antisocial behavior. Longmont, CO: Sopris West.Google Scholar
  34. Washington State Institute for Public Policy (2018). Incredible Years Parent Training: Children's Mental Health: Disruptive Behavior. Retrieved from http://www.wsipp.wa.gov/BenefitCost/ProgramPdf/158/Incredible-Years-Parent-Training
  35. Zisser, A. & Eyberg, S.M. (2017). Parent-child interaction therapy and the treatment of disruptive beahvior disorders. In J.R. Weiss & A.E. Kazdin Evidence-based psychotherapies for children and adolescents, Third Ediction (pp179-193). New York, Guilford Press.Google Scholar

Copyright information

© Society for Prevention Research 2019

Authors and Affiliations

  • Andy J. Frey
    • 1
    Email author
  • Margaret R. Kuklinski
    • 2
  • Kiersten Bills
    • 1
  • Jason W. Small
    • 3
  • Steven R. Forness
    • 4
  • Hill M. Walker
    • 3
    • 5
  • Edward G. Feil
    • 3
  • John R. Seeley
    • 3
    • 5
  1. 1.Kent School of Social WorkUniversity of LouisvilleLouisvilleUSA
  2. 2.Social Development Research Group, School of Social WorkUniversity of WashingtonSeattleUSA
  3. 3.Oregon Research InstituteEugeneUSA
  4. 4.University of CaliforniaLos AngelesUSA
  5. 5.College of EducationUniversity of OregonEugeneUSA

Personalised recommendations