Abstract
Responsive school mental health services require proactive family engagement at the outset of prevention and early intervention, particularly across key transition periods such as kindergarten. Universal screening for mental health is one important process within a school mental health framework to proactively engage families in a collaborative data-based decision-making and problem-solving process. In the current study, we tested the psychometric properties of the Positive Family Support–Strengths and Needs Assessment (PFS–SaNA), a brief parent–report screener of children’s social, emotional, and behavioral functioning. Participants included 365 parents/caregivers who were assessed across kindergarten to second grade. We assessed the construct and predictive validity of the PFS–SaNA, tested the longitudinal invariance of the measure across kindergarten to second grade, and established the reliability of the measure. We replicated the unidimensional structure of the PFS–SaNA identified in prior literature (Moore et al. 2016) and found that this single construct is invariant from kindergarten to second grade. Predictive and concurrent validity analyses with convergent behavioral measures show the PFS–SaNA has adequate predictive and diagnostic capability. Moreover, we found the single factor to have adequate reliability. Implications of these findings for comprehensive mental health support that includes family collaboration in the transition to schooling are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barrett, S., Eber, L., Weist. M. (2013). Advancing education effectiveness: interconnecting school mental health and school–wide positive behavior support. Center for positive behavioral interventions and supports. https://www.pbis.org/resource/advancing–education–effectiveness–interconnecting–school–mental–health–and–school–wide–positive–behavior–support
Bialosiewicz, S., Murphy, K., & Berry, T. (2013). An introduction to measurement invariance testing: resource packet for participants. Claremont Evaluation Center. p 1-37
Biglan, A., Elfner, K., Garbacz, S. A., Komro, K., Prinz, R. J., Weist, M. D., Wilson, D. K., & Zarling, A. (2020). A strategic plan for strengthening America’s families: a brief from the coalition of behavioral science organizations. Clinical Child and Family Psychology, 23, 153–175. https://doi.org/10.1007/s10567-020-00318-0
Briesch, A. M., Chafoleaus, S. M., Nissen, K., & Long, S. (2020). A review of state–level procedural guidance for implementing multitiered systems of support for behavior (MTSS–B). Journal of Positive Behavior Interventions, 22(3), 131–144. https://doi.org/10.1177/1098300719884707
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness–of–fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Costello, E. J., Erkanli, A., & Angold, A. (2006). Is there an epidemic of child or adolescent depression? Journal of Child Psychology and Psychiatry, 47(12), 1263–1271. https://doi.org/10.1111/j.1469-7610.2006.01682.x
Dishion, T., Forgatch, M., Chamberlain, P., & Pelham, W. E. (2016). The Oregon model of behavior family therapy: from intervention design to promoting large–scale system change. Behavior Therapy, 47(6), 812–837. https://doi.org/10.1016/j.beth.2016.02.002
Dishion, T. J., Nelson, S. E., & Kavanaugh, K. (2003). The family check–up with high risk young adolescents: preventing early–onset substance use by parent monitoring. Behavior Therapy, 34(4), 553–571. https://doi.org/10.1016/S0005-7894(03)80035-7
Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: an ecological, family–centered approach to mental health care. American Psychological Association. https://doi.org/10.1037/11485-000
Dodge, K. A Greenberg, M. T., Malone, P. S., & Conduct Problems Prevention Research Group. (2008). Testing an idealized dynamic cascade model of the development of serious violence in adolescence. Child Development, 79, 1907–1927. https://doi.org/10.1111/j.1467-8624.2008.01233.x
Dowdy, E., Dever, B. V., Raines, T. C., & Moffa, K. (2016). A preliminary investigation into the added value of multiple gates and informants in universal screening for behavioral and emotional risk. Journal of Applied School Psychology, 32(2), 178–198. https://doi.org/10.1080/15377903.2016.1165327
Evans, S. W. (1999). Mental health services in schools: Utilization, effectiveness and consent. Clinical Psychology Review, 19(2), 165–178. https://doi.org/10.1016/S0272-7358(98)00069-5
Fefer, S. A., Hieneman, M., Virga, C., Thoma, A., & Donnelly, A. (2020). Evaluating the effect of positive parent contact on elementary students’ on–task behavior. Journal of Positive Behavior Interventions, 22(4), 234–245. https://doi.org/10.1007/s10567-020-00318-0
Garbacz, S. A., Bolt, D. M., Seeley, J. R., Stormshak, E. A., & Smolkowski, K. (2020). Examining school proactive outreach to families in public middle schools. School Psychology Review, 49(4), 493–509. https://doi.org/10.1080/2372966X.2020.1787081
Garbacz, S. A., Beattie, T., Masser, J., & DeGarmo, D. (2019). Initial validation of an elementary version of the positive family support strengths and needs assessment. Assessment for Effective Intervention, 43, 73–80. https://doi.org/10.1177/1534508418793514
Garbacz, S. A., Hirano, K., McIntosh, K., Eagle, J. W., Minch, D., & Vatland, C. (2018). Family engagement in schoolwide positive behavioral interventions and supports: barriers and facilitators to implementation. School Psychology Quarterly, 33(3), 448–459. https://doi.org/10.1037/spq0000216
Girio-Herrara, E., & Owens, J. S. (2017). A pilot study examining a school–based parent engagement intervention following school mental health screening. School Mental Health, 9, 117–131. https://doi.org/10.1007/s12310-017-9208-5
Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135. https://doi.org/10.1016/j.jsp.2006.05.005
Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Clinical Psychiatry, 38(5), 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
Goodman, R., Ford, T., Corbin, T., & Meltzer, H. (2004). Using the Strengths and difficulties questionnaire (SDQ) multi–informant algorithm to screen looked–after children for psychiatric disorders. European Child & Adolescent Psychiatry. https://doi.org/10.1007/s00787-004-2005-3
Gottschall, A. C., West, S. G., & Enders, C. K. (2012). A comparison of item–level and scale– level multiple imputation for questionnaire batteries. Multivariate Behavioral Research, 47, 1–25. https://doi.org/10.1080/00273171.2012.640589
Griffin, D. (2011). Parent involvement with African American families in expanded school mental health practice. Advances in School Mental Health Promotion, 4(2), 16–26. https://doi.org/10.1080/1754730X.2011.9715626
Houri, A. K., Thayer, A. J., & Cook, C. R. (2019). Targeting parent trust to enhance engagement in a school–home communication system: A double–blind experiment of a parental wise feedback intervention. School Psychology, 34(4), 421–432. https://doi.org/10.1037/spq0000318
Jones, D., Dodge, K. A., Foster, E. M., Nix, R., & Conduct Problems Prevention Research Group. (2002). Early identification of children at risk for costly mental health service use. Prevention Science, 3(4), 247–256. https://doi.org/10.1023/AL1020896607298
Lochman, J. E., & The Conduct Problems Prevention Research Group. (1995). Screening of child behavior problems for prevention programs at school entry. Journal of Consulting and Clinical Psychology, 63, 549–559. https://doi.org/10.1037//0022-006x.63.4.549
Masten, A. S., & Cicchetti, D. (2010). Developmental cascades. Development and Psychopathology, 22(3), 491–495. https://doi.org/10.1017/S0954579410000222
McIntyre, L. K., Eckert, T. L., Fiese, B. H., Digennaro, F. D., & Wildenger, L. K. (2007). Transition to kindergarten: family experiences and involvement. Early Childhood Education Journal, 35, 83–88. https://doi.org/10.1007/s10643-007-0175-6
McIntyre, L. K., Eckert, T. L., Fiese, B. H., Digennaro Reed, F. D., & Wildenger, L. K. (2010). Family concerns surrounding kindergarten transition: a comparison of students in special and general education. Early Childhood Education Journal, 38, 259–263. https://doi.org/10.1007/s10643-010-0416-y
Merikangas, K. R., He, J–p., Burnstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: results from the national comorbidity study–adolescent supplement (NCS–A). Journal of the American Academy of Child Adolescent Psychiatry., 49(10), 980–989. https://doi.org/10.1016/j.jaac.1010.05.017
Moore, K. J., Garbacz, S. A., Dishion, T. J., Gau, J. M., Brown, K. L., Stormshak, E. A., & Seeley, J. R. (2016). Proactive parent engagement in public schools: Using a brief strengths and needs assessment in a multiple-gating risk management strategy. Journal of Positive Behavior Interventions, 18, 230–240. https://doi.org/10.1177/1098300716632590
Morris, T. P., White, I. R., & Royston, P. (2014). Tuning multiple imputation by predictive mean matching and local residual draws. BMC Medical Research Methodology, 14(75), 1–13. https://doi.org/10.1186/1471-2288-14-75
Ohan, J. L., Seward, R. J., Stallman, H. M., Bayliss, D., & M., & Sanders, M. R. . (2015). Parents’ barriers to using school psychology services for their child’s mental health problems. School Mental Health, 7, 287–297. https://doi.org/10.1007/S12310-015-9152-1
Rimm-Kaufman, S. E., & Pianta, R. C. (2005). Family-school communication in preschool and kindergarten in the context of a relationship-enhancing intervention. Early Education and Development, 16(3), 287–316. https://doi.org/10.1207/s15566935eed1603_1
Rosseel, Y. (2012). lavaan: an R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
Runge, T. J., Knoster, T. P., Moerer, D., Breinich, T., & Palmiero, J. (2017). A practical protocol for situating evidence–based mental health programs and practices within school–wide positive behavioral interventions and supports. Advances in School Mental Health Promotion, 10(2), 101–112. https://doi.org/10.1080/1754730X.2017.1285708
Ruopp, M. D., Perkins, N. J., Whitcomb, B. W., & Schisterman, E. F. (2008). Youden index and optimal cut–point estimated from observations affected by a lower limit of detection. Biometrical Journal. https://doi.org/10.1002/bimj.200710415
Santiago, R. T., Garbacz, S. A., Beattie, T., & Moore, C. L. (2016). Parent–teacher relationships in elementary school: An examination of parent–teacher trust. Psychology in the Schools, 53, 1003–1017. https://doi.org/10.1002/pits.21971
Sheridan, S. M., Bovaird, J. A., Glover, T. A., Garbacz, S. A., Witte, A., & Kwon, K. (2012). A randomized trial examining the effects of conjoint behavioral consultation and the mediating role of the parent–teacher relationship. School Psychology Review, 41(1), 23–46. https://doi.org/10.1080/02796015.2012.12087374
Sheridan, S. M., Smith, T. E., Kim, E. M., Beretvas, S. N., & Park, S. (2019). A meta–analysis of family–school interventions and children’s social–emotional functioning: Moderators and components of efficacy. Review of Educational Research, 89(2), 296–332. https://doi.org/10.3102/0034654318825437
Smith, T. E., Reinke, W. M., Herman, K. C., & Huang, F. (2019). Understanding family–school engagement across and within elementary– and middle–school contexts. School Psychology, 34, 363–375. https://doi.org/10.1037/spq0000290
Stormshak, E. A., DeGarmo, D., Garbacz, S. A., McIntyre, L. L., & Caruthers, A. (2020). Using motivational interviewing to improve parenting skills and prevent problem behavior during the transition to kindergarten. Prevention Science. https://doi.org/10.10007/s11121-020-01102-w
Stormshak, E. A., Connell, A., & Dishion, T. J. (2009). An adaptive approach to family–centered intervention in schools: linking intervention engagement to academic outcomes in middle and high school. Prevention Science, 10(3), 221–235. https://doi.org/10.1007/s11121-009-0131-3
Stormshak, & ConnellVéronneauM-H MyersDishion KavanaghCaruthers, A. M. M. W. T. J. K. A. S. (2011). An ecological approach to promoting early adolescent mental health and social adaptation: family–centered intervention in public middle schools. Child Development, 82, 209–225. https://doi.org/10.1111/j.1467-8624.2010.01551.x
Stormshak, E. A., Dishion, T. J., Light, J., & Yasui, M. (2005). Implementing family–centered interventions within the public middle school: Linking service delivery to change in student problem behavior. Journal of Abnormal Child Psychology, 33(6), 723–733. https://doi.org/10.1007/s10802-005-7650-6
Stratford, B., Cook, E., Hanneke, R., Katz, E., Seok, D., Steed, H., Fulks, E., Lessans, A., & Temkin, D. (2020). A scoping review of school–based efforts to support students who have experienced trauma. School Mental Health, 12, 442–477. https://doi.org/10.1007/s12310-020-09368-9
Thiele, C. (2019). cutpointr: determine and evaluate optimal cutpoints in binary classification tasks (Version 1.0.32) [Computer software]. R package.
van Buuren, S., & Groothuis Oudshoorn, K. (2011). Mice: multivariate imputation by chained equations in R. Journal of Statistical Software., 45, 1–67. https://doi.org/10.18637/jss.v04
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
Weist, M. D. (1997). Expanded school mental health services. Advances in Clinical Child Psychology, 19, 319–352. https://doi.org/10.1177/0145445503259498
Welchons, L. W., & McIntyre, L. L. (2017). The transition to kindergarten: predicting socio–behavioral outcomes for children with and without disabilities. Early Childhood Education Journal, 45(2), 83–93.
Wilgender, L. K., & McIntyre, L. L. (2011). Family concerns and involvement during kindergarten transition. Journal of Child and Family Studies, 20, 387–396. https://doi.org/10.1007/s10826-010-9403-6
Wymbs, F. A. (2018). Parents’ preferences for school– and community–based services for children at risk for ADHD. School Mental Health: A Multidisciplinary Research and Practice Journal, 10(4), 386–401. https://doi.org/10.1007/s12310-018-9258-3
Youden, W. J. (1950). Index for rating diagnostic tests. Cancer, 3, 32–35. https://doi.org/10.1002/10970142(1950)3:1%3c32::aid-cncr2820030106%3e3.0.co;2-3
Funding
The research reported here was supported by the Institute of Education Sciences, US Department of Education, through Grant R305A140189 to the University of Oregon and Grant R324B160026 to the University of Wisconsin. The opinions expressed are those of the authors and do not represent views of the Institute or the US Department of Education.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Garbacz, S.A., Lee, Y., Hall, G.J. et al. Initiating Family–School Collaboration in School Mental Health through a Proactive and Positive Strengths and Needs Assessment. School Mental Health 13, 667–679 (2021). https://doi.org/10.1007/s12310-021-09455-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-021-09455-5