Abstract
A substantial proportion of children and youth in the child welfare system have mental health concerns that warrant attention. While these youth are more likely to receive treatment in general, they are less likely to receive evidence-based treatments. Cognitive Behavioral Therapy Plus (CBT+) is a training approach in evidence-based treatments for anxiety, depression, behavior problems, and symptoms of traumatic stress. Included in the model is an emphasis on symptom and outcome monitoring. Though based on well-established evidence-based treatments, clinical effectiveness of CBT+ has not been evaluated for child welfare populations. Embedded within a broader initiative called Partnering for Success, the current study evaluated the impact of CBT+ training on treatment outcomes for the mental health symptoms of a racially diverse sample of 1281 children and youth in four different states. Symptom data were collected by community-based mental health therapists as part of standard CBT+ treatment adherence procedures. Multilevel linear growth modeling was used to evaluate symptom change over time. Significant improvements were observed across all four clinical targets, with a slight curvilinear relationship found for anxiety, depression, and behavior problems. This promising initial evidence suggests CBT+ is a viable training option for treatment of child welfare-involved children and youth with a range of mental health concerns.
Highlights
-
CBT+ is a promising training approach for therapists working with children and youth in the child welfare system.
-
Including symptom monitoring as part of CBT+ treatment facilitates assessment of clinical change over time.
-
Children and youth receiving CBT+ generally experienced improvements in mental health symptoms.
-
While improvements in symptoms were observed for anxiety, depression, behavior problems and symptoms of traumatic stress, improvement trajectories differed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barth, R. P., Rozeff, L., Kerns, S. E. U., & Baldwin, M. (2020). Partnering for success: Implementing a cross-systems collaborative model between behavioral health and child welfare. Children & Youth Services Review, 117, 104663 https://doi.org/10.1016/j.childyouth.2019.104663.
Barth, R. P., & Watrous, J. (2021). Partnering for success – A prototype for integrating evidence-based practices between referring professionals and mental health professionals. Journal of Clinical Pediatrics and Neonatology, 1(1), 1–3.
Bell, T., Romano, E., & Flynn, R. (2015). Profiles and predictors of behavioral resilience among children in child welfare. Child Abuse & Neglect, 48, 92–103. https://doi.org/10.1016/j.chiabu.2015.04.018.
Berliner, L., Fitzgerald, M. M., Dorsey, S., Chaffin, M., Ondersma, S. J., & Wilson, C. (2015). Report of the APSAC Task Force on evidence-based service planning guidelines for child welfare. Child Maltreatment, 20(1), 6–16. https://doi.org/10.1177/1077559514562066.
Birmaher, B., Brent, D. A., Chiappetta, L., Bridge, J., Monga, S., & Baugher, M. (1999). Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. Journal of the American Academy of Child & Adolescent Psychiatry, 38(10), 1230–1236. https://doi.org/10.1097/00004583-199910000-00011.
Bisson, J. I., Berliner, L., Cloitre, M., Forbes, D., Jensen, T. K., Lewis, C., & Shapiro, F. (2019). The international society for traumatic stress studies new guidelines for the prevention and treatment of posttraumatic stress disorder: Methodology and development process. Journal of Traumatic Stress, 32(4), 475–483. https://doi.org/10.1002/jts.22421.
Bronsard, G., Alessandrini, M., Fond, G., Loundou, A., Auquier, P., Tordjman, S., & Boyer, L. (2016). The prevalence of mental disorders among children and adolescents in the child welfare system: A systematic review and meta-analysis. Medicine, 95(7), e2622 https://doi.org/10.1097/MD.0000000000002622.
Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health need and access to mental health services by youths involved with child welfare: A national survey. Journal of the American Academy of Child & Adolescent Psychiatry, 43(8), 960–970. https://doi.org/10.1097/01.chi.0000127590.95585.65.
Casanueva, C., Ringeisen, H., Wilson, E., Smith, K., & Dolan, M. (2011). NSCAW II baseline report: Child well-being. Washington, DC: US Department of Health and Human Services.
Chamberlain, P., Price, J. M., Reid, J. B., Landsverk, J., Fisher, P. A., & Stoolmiller, M. (2006). Who disrupts from placement in foster and kinship care? Child Abuse & Neglect, 30, 409–424. https://doi.org/10.1016/j.chiabu.2005.11.004.
Chorpita, B. F., Daleiden, E. L., Ebesutani, C., Young, J., Becker, K. D., Nakamura, B. J., & Starace, N. (2011). Evidence‐based treatments for children and adolescents: An updated review of indicators of efficacy and effectiveness. Clinical Psychology: Science and Practice, 18(2), 154–172. https://doi.org/10.1111/j.1468-2850.2011.01247.x.
Chorpita, B. F., Daleiden, E. L., Park, A. L., Ward, A. M., Levy, M. C., Cromley, T., Chiu, A. W., Letamendi, A. M., Tsai, K. H., & Krull, J. L. (2017). Child STEPs in California: A cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. Journal of Consulting and Clinical Psychology, 85(1), 13–25. https://doi.org/10.1037/ccp0000133.
Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20. https://doi.org/10.1007/s11020-005-1962-6.
Chu, B. C., Skriner, L. C., & Zandberg, L. J. (2013). Shape of change in cognitive behavioral therapy for youth anxiety: Symptom trajectory and predictors of change. Journal of Consulting and Clinical Psychology, 81(4), 573 https://doi.org/10.1037/a0033390.
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2010). Trauma-focused cognitive-behavioral therapy for traumatized children. Evidence-based Psychotherapies for Children and Adolescents, 2, 295–311.
Cosgrove, J. A., Lee, B. R., Greeno, E. J., & Horen, M. J. (in press). Cognitive Behavioral Therapy – Plus for youth in out-of-home care: A quasi-experimental evaluation. Social Work Research.
Crandal, B. R., Martin, J. K., Hazen, A. L., & Rolls Reutz, J. A. (2019). Measuring collaboration across children’s behavioral health and child welfare systems. Psychological Services, 16(1), 111–119. https://doi.org/10.1037/ser0000302.
Dalgleish, T., Black, M., Johnston, D., & Bevan, A. (2020). Transdiagnostic approaches to mental health problems: Current status and future directions. Journal of Consulting and Clinical Psychology, 88(3), 179–195. https://doi.org/10.1037/ccp0000482.
DeVellis, R. F. (2003). Scale development: Theory and applications. Newbury Park, CA: Sage.
Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M. D., & Murray, L. K. (2016). A statewide common elements initiative for children’s mental health. The Journal of Behavioral Health Services & Research, 43(2), 246–261. https://doi.org/10.1007/s11414-014-9430-y.
Dorsey, S., Kerns, S. E., Trupin, E. W., Conover, K. L., & Berliner, L. (2012). Child welfare caseworkers as service brokers for youth in foster care: Findings from Project Focus. Child Maltreatment, 17(1), 22–31. https://doi.org/10.1177/1077559511429593.
Garb, H. N. (1997). Race bias, social class bias, and gender bias in clinical judgment. Clinical Psychology: Science and Practice, 4(2), 99–120. https://doi.org/10.1111/j.1468-2850.1997.tb00104.x.
Gardner, W., Lucas, A., Kolko, D. J., & Campo, J. V. (2007). Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. Journal of the American Academy of Child & Adolescent Psychiatry, 46(5), 611–618. https://doi.org/10.1097/chi.0b013e318032384b.
Gardner, W., Murphy, M., Childs, G., Kelleher, K., Pagano, M., Jellinek, M., & Chiappetta, L. (1999). The PSC-17: A brief pediatric symptom checklist with psychosocial problem subscales. A report from PROS and ASPN. Ambulatory Child Health, 5, 225–225.
Goemans, A., van Geel, M., van Beem, M., & Vedder, P. (2016). Developmental outcomes of foster children: A meta-analytic comparison with children from the general population and children at risk who remained at home. Child Maltreatment, 21(3), 198–217. https://doi.org/10.1177/1077559516657637.
Hambrick, E. P., Oppenheim-Weller, S., N’zi, A. M., & Taussig, H. N. (2016). Mental health interventions for children in foster care: A systematic review. Children and youth services review, 70, 65–77. https://doi.org/10.1016/j.childyouth.2016.09.002.
Horwitz, S. M., Chamberlain, P., Landsverk, J., & Mullican, C. (2010). Improving the mental health of children in child welfare through the implementation of evidence-based parenting interventions. Administration and Policy in Mental Health and Mental Health Services Research, 37(1-2), 27–39. https://doi.org/10.1007/s10488-010-0274-3.
James, S. (2004). Why do foster care placements disrupt? An investigation of reasons for placement change in foster care. Social Service Review, 78, 601–627. https://doi.org/10.1086/424546.
Kerker, B. D., & Dore, M. M. (2006). Mental health needs and treatment of foster youth: Barriers and opportunities. American Journal of Orthopsychiatry, 76(1), 138–147. https://doi.org/10.1037/0002-9432.76.1.138.
Kerns, S. E. U., Pullmann, M. D., Putnam, B., Buher, A., Holland, S., Berliner, L., & Trupin, E. W. (2014). Child welfare and mental health: Facilitators of and barriers to connecting children and youths in out-of-home care with effective mental health treatment. Children and Youth Services Review, 46, 315–324. https://doi.org/10.1016/j.childyouth.2014.09.013.
Kerns, S. E. U., Pullmann, M. D., Negrete, A., Uomoto, J. A., Berliner, L., Shogren, D., & Putnam, B. (2016). Development and implementation of a child welfare workforce strategy to build a trauma-informed system of support for foster care. Child Maltreatment,, 21(2), 135–146. https://doi.org/10.1177/1077559516633307.
Landers, A. L., McLuckie, A., Cann, R., Shapiro, V., Visintini, S., MacLaurin, B., & Carrey, N. J. (2018). A scoping review of evidence-based interventions available to parents of maltreated children ages 0-5 involved with child welfare services. Child Abuse & Neglect, 76, 546–560. https://doi.org/10.1016/j.chiabu.2017.09.012.
Landsverk, J. A., Burns, B. J., Stambaugh, L. F., & Reutz, J. A. (2009). Psychosocial interventions for children and adolescents in foster care: Review of research literature. Child Welfare, 88(1), 49–69.
Lang, J. M., Ake, G., Barto, B., Caringi, J., Little, C., Baldwin, M. J., & Stevens, K. (2017). Trauma screening in child welfare: Lessons learned from five states. Journal of Child & Adolescent Trauma, 10(4), 405–416. https://doi.org/10.1007/s40653-017-0155-y.
Leathers, S. J. (2006). Placement disruption and negative placement outcomes among adolescents in long-term foster care: The role of behavior problems. Child Abuse & Neglect, 30(3), 307–324. https://doi.org/10.1016/j.chiabu.2005.09.003.
Lehmann, S., Havik, O. E., Havik, T., & Heiervang, E. R. (2013). Mental disorders in foster children: a study of prevalence, comorbidity and risk factors. Child and Adolescent Psychiatry and Mental Health, 7(1), 39 https://doi.org/10.1186/1753-2000-7-39.
Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample size for multilevel modeling. Methodology, 1(3), 86–92. https://doi.org/10.1027/1614-2241.1.3.86.
McCrae, J. S. (2009). Emotional and behavioral problems reported in child welfare over 3 years. Journal of Emotional and Behavioral Disorders, 17(1), 17–28. https://doi.org/10.1177/1063426608319141.
McCrae, J. S., Barth, R. P., & Guo, S. (2010). Changes in maltreated children’s emotional–behavioral problems following typically provided mental health services. American Journal of Orthopsychiatry, 80(3), 350 https://doi.org/10.1111/j.1939-0025.2010.01039.x.
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144.
McNeish, D. M., & Stapleton, L. M. (2016). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28(2), 295–314. https://doi.org/10.1007/s10648-014-9287-x.
Parker, E. M., Jacobson, J., Pullmann, M. D., & Kerns, S. E. U. (2019). Identifying psychosocial problems among children and youth in the child welfare system using the PSC-17: Exploring convergent and discriminant validity with multiple informants. Child Psychiatry & Human Development, 50(1), 108–120. https://doi.org/10.1007/s10578-018-0824-6.
Peris, T. S., Compton, S. N., Kendall, P. C., Birmaher, B., Sherrill, J., March, J., & Piacentini, J. (2015). Trajectories of change in youth anxiety during cognitive—behavior therapy. Journal of Consulting and Clinical Psychology, 83(2), 239 https://doi.org/10.1037/a0038402.
Pritchard, D., Hoerger, M., & Mace, F. C. (2014). Treatment relapse and behavioral momentum theory. Journal of Applied Behavior Analysis, 47(4), 814–833. https://doi.org/10.1002/jaba.163.
Romano, E., Weegar, K., Babchishin, L., & Saini, M. (2018). Cross-informant agreement on mental health outcomes in children with maltreatment histories: A systematic review. Psychology of Violence, 8(1), 19–30. https://doi.org/10.1037/vio0000086.
Sachser, C., Berliner, L., Holt, T., Jensen, T. K., Jungbluth, N., Risch, E., Rosner, R., & Goldbeck, L. (2017). International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS). Journal of Affective Disorders,, 210, 189–195. https://doi.org/10.1016/j.jad.2016.12.040.
Snijders, T., & Bosker, R. J. (2012). Multilevel models. Thousand Oaks, CA: Sage.
Sunderland, M., Wong, N., Hilvert-Bruce, Z., & Andrews, G. (2012). Investigating trajectories of change in psychological distress amongst patients with depression and generalised anxiety disorder treated with internet cognitive behavioural therapy. Behaviour Research and Therapy, 50(6), 374–380. https://doi.org/10.1016/j.brat.2012.03.005.
Thomas, K. C., Ellis, A. R., Konrad, T. R., Holzer, C. E., & Morrissey, J. P. (2009). County-level estimates of mental health professional shortage in the United States. Psychiatric Services, 60(10), 1323–1328. https://doi.org/10.1176/ps.2009.60.10.1323.
U.S. Department of Health and Human Services. (2013, July 11). [Letter to State Medicaid Directors]. http://www.medicaid.gov/Federal-PolicyGuidance/Downloads/SMD-13-07-11.pdf
Van der Meer, M., Dixon, A., & Rose, D. (2008). Parent and child agreement on reports of problem behaviour obtained from a screening questionnaire, the SDQ. European Child & Adolescent Psychiatry, 17(8), 491–497. https://doi.org/10.1007/s00787-008-0691-y.
Walker, S. C., Hurvitz, P. M., Leith, J., Rodriguez, F. I., & Endler, G. C. (2016). Evidence-based program service deserts: A geographic information systems (GIS) approach to identifying service gaps for state-level implementation planning. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 850–860. https://doi.org/10.1007/s10488-016-0743-4.
Weems, C. F., Feaster, D. J., Horigian, V. E., & Robbins, M. S. (2011). Parent and child agreement on anxiety disorder symptoms using the DISC predictive scales. Assessment, 18(2), 213–216. https://doi.org/10.1177/1073191110389278.
Weisz, J. R., Bearman, S. K., Ugueto, A. M., Herren, J. A., Evans, S. C., Cheron, D. M., & Jensen-Doss, A. (2020). Testing robustness of Child STEPs effects with children and adolescents: A randomized controlled effectiveness trial. Journal of Clinical Child & Adolescent Psychology, 49(6), 883–896. https://doi.org/10.1080/15374416.2019.1655757.
Wood, A., Kroll, L., Moore, A., & Harrington, R. (1995). Properties of the mood and feelings questionnaire in adolescent psychiatric outpatients: a research note. Journal of Child Psychology and Psychiatry, 36(2), 327–334. https://doi.org/10.1111/j.1469-7610.1995.tb01828.x.
Zahn-Waxler, C. (1993). Warriors and worriers: Gender and psychopathology. Development and Psychopathology, 5(1-2), 79–89. https://doi.org/10.1017/S0954579400004272.
Funding
Partnering for Success is a program of the National Center for Evidence-Based Practice in Child Welfare, University of Maryland School of Social Work. This study was supported through grant 90CT7001-01-02 from the US Department of Health and Human Services, Administration for Children Youth and Families, Children’s Bureau.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kerns, S.E.U., Phillips, J.D., Berliner, L. et al. Partnering for Success Symptom Monitoring Outcomes: Cognitive Behavioral Therapy Plus for Children and Youth in Child Welfare. J Child Fam Stud 31, 247–259 (2022). https://doi.org/10.1007/s10826-021-02112-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-021-02112-0