Abstract
The objective of the study was to evaluate whether mental health problems identified through screens administered in first grade are related to poorer academic achievement test scores in the fourth grade. The government of Chile uses brief teacher- and parent-completed measures [Teacher Observation of Classroom Adaptation-Revised (TOCA-RR) and Pediatric Symptom Checklist (PSC-Cl)] to screen for mental health problems in about one-fifth of the country’s elementary schools. In fourth grade, students take the national achievement tests (SIMCE) of language, mathematics and science. This study examined whether mental health problems identified through either or both screens predicted achievement test scores after controlling for student and family risk factors. A total of 17,252 students had complete first grade teacher forms and these were matched with fourth grade SIMCE data for 11,185 students, 7,903 of whom also had complete parent form data from the first grade. Students at risk on either the TOCA-RR or the PSC-Cl or both performed significantly worse on all SIMCE subtests. Even after controlling for covariates and adjusting for missing data, students with mental health problems on one screen in first grade had fourth grade achievement scores that were 14–18 points (~1/3 SD) lower than students screened as not at risk. Students at risk on both screens had scores that were on average 33 points lower than students at risk on either screen. Mental health problems in first grade were one of the strongest predictors of lower achievement test scores 3 years later, supporting the premise that for children mental health matters in the real world.
Similar content being viewed by others
References
107th Congress (enacted January 8, 2002) No Child Left Behind Act of 2001. In: PUBLIC LAW 107–110, JAN 8 2002 115 STAT. 1425
Aluja A, Blanch A (2002) The children depression inventory as predictor of social and scholastic competence. Eur J Psychol Assess 18:15
Ambrosini PJ (2000) Historical development and present status of the schedule for affective disorders and schizophrenia for school-age children (K-SADS). J Am Acad Child Adolesc Psychiatry 39:49–58
American Academy of Pediatrics (2004) Policy statement: school-based mental health services. Pediatrics 113:1839–1845
American Academy of Pediatrics Task Force on Mental Health (2010) Appendix S4: the case for routine mental health screening. Pediatrics 125:S133–S139
Breslau J, Miller E, Breslau N, Bohnert K, Lucia V, Schweitzer J (2009) The impact of early behavior disturbances on academic achievement in high school. Pediatrics 123:1472–1476
Cancecko-Llego CD, Castillo-Carandang NT, Reyes AL (2009) Validation of the pictoral pediatric symptom checklist-filipino version for the psychosocial screening of children in a low-income urban community. Acta Medica Philippina 43:62–68
Contreras D, Bustos S, Sep′ulveda P (2007) When schools are the ones that choose: the effect of screening in Chile. In: Serie Documentos de Trabajo. Departamento de Economía, Universidad de Chile
Davis-Kean P (2005) The influence of parent education and family income on child achievement: the indirect role of parental expectations and the home environment. J Fam Psychol 19:294–304
de la Barra F, Toledo V, Rodriguez J (2005) Prediction of behavioral problems in Chilean school children. Child Psychiatry Hum Dev 35:227–243
Duncan G, Dowsett C, Claessens A, Magnuson K, Huston A, Klebanov P, Pagani L, Feinstein L, Engel M, Brooks-Gunn J, Sexton H, Duckworth K, Japel C (2007) School readiness and later achievement. Dev Psychol 43:1428–1446
Fisher JRW, Cabral de Mello M, Izutsu T, Vijayakumar L, Belfer M, Omigbodun O (2011) Adolescent mental health in resource-constrained settings: a review of the evidence of the nature, prevalence and determinants of common mental health problems and their management in primary health care. J Soc Psychiatry 57(1 Suppl):v–vii, 9–116
Fröjd S, Nissinena E, Pelkonenb MU, Marttunen MJ, Koivistoa A, Kaltiala-Heinoa R (2008) Depression and school performance in middle adolescent boys and girls. J Adolesc 31:14
Gall G, Pagano ME, Desmond MS, Perrin JM, Murphy JM (2000) Utility of psychosocial screening at a school-based health center. J Sch Health 70:292–298
Gardner W, Lucas A, Kolko D, Campo J (2007) Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry 46:611–618
George M, Siraqyan X, Mores R, de la Barra F, Rodríguez J, López C, Toledo V (1995) Adaptation and validation of two screening instruments of mental health of first grade schoolchildren of Santiago. Revista de Psicologıa 5:17–25
George M, Squicciarini A, Zapata R, Guzmán MP, Hartley M, Silva C (2004) Detection of early mental health risk factors in primary schools. Revista de Psicologia 13:9–20
Goldberg C (2007) Mental screening for young to begin: mass. doctors to offer questionnaires for children on Medicaid. The Boston Globe. NY Times Co., Boston
Hendren R, Birrell Weisen R, Orley J (1994) Mental health programmes in schools. World Health Organization, Geneva
Ishizaki Y, Fukai Y, Kobayashi Y (1997) Preliminary study of validation of the Japanese version of the pediatric symptom checklist by Jellinek of Massachusetts General Hospital- a new screening method for children with psychosocial and psychosomatic dysfunction. J Jpn Pediatr Soc 101:1679–1985
Jellinek MS, Bishop Joseph SJ, Murphy JM, Zigler E (2005) Mental health in head start; leave no child behind. NHSA DIALOG 8:25–35
Jellinek MS, Murphy JM, Burns BJ (1986) Brief psychosocial screening in outpatient pediatric practice. J Pediatr 109:371–378
JUNAEB Chilean Department of Education (2009) Skills for life program; Report on the 2008 school year. JUNAEB, Santiago
Kamphaus RW, Thorpe JS, Winsor AP, Kroncke AP, Dowdy ET, VanDeventer MC (2007) Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educ Psychol Measur 67:1–15
Kellam Sheppard G, Brown H, Poduska JM, Ialongo NS, Wang W, Toyinbo P, Petras H, Ford C, Windham A, Wilcox HC (2008) Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug Alcohol Dependence 95(Suppl 1):S5–S28
Kellam SG, Rebok GW, Mayer LS, Ialongo N (1994) Depressive symptoms over first grade and their response to a developmental epidemiologically based preventive trial aimed at improving achievement. Dev Psychopathol 6:463–481
Kelleher K, McInerny T, Gardner W, Childs G, Wasserman R (2000) Increasing identification of psychosocial problems: 1979–1996. Pediatrics 105:1313–1321
Kovacs M (1985) The children’s depression, inventory (CDI). Psychopharmacol Bull 21:995–998
Kuhlthau K, Jellinek M, White G, VanCleave J, Jack Simons J, Michael Murphy JM (2011) Increases in behavioral health screening in pediatric care for Massachusetts medicaid patients. Arch Pediatr Adolesc Med. doi:10.1001/archpediatrics.2011.18
López C, de la Barra F, George M, Toledo V, Rodríguez J (1996) Características de la Familia y Conducta de los Niños Evaluada por sus Padres y Profesores. Revista de Psiquiatria 12:195–1999
Meckes L, Carrasco R (2010) Two decades of SIMCE: An overview of the National Assessment System in Chile. Assessment in Education: Principles, Policy and Practice 17:233–248
Meier D, Wood G (2004) Many children left behind: how the No Child Left Behind Act is damaging our children and our schools. Beacon Press, Boston
Murphy JM, Jellinek M, Milinsky S (1989) The pediatric symptom checklist: validation in the real world of middle school. J Pediatr Psychol 14:629–639
Murphy JM, Masek B, Babcock R, Jellinek M, Gold J, Drubner S, Sklar K, Hacker K (2011) Measuring outcomes in outpatient child psychiatry: the contribution of electronic technologies and parent report. Clin Child Psychol Psychiatry 16:146–160
Murray CJ, Lopez AD (1996) Evidence-based health policy–lessons from the global burden of disease study. Science 274:740–743
Muzzolon SRB (2008) Evaluation of the use of the Pediatric Symptom Checklist as screening for emotional and psychosocial problems in a public school in Curitiba. Brazil Arquivos de Neuro-Psiquiatria 66:604
National Research Council and Institute of Medicine (2009) Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: research advances and promising interventions. In: O’Connell ME, Boat T, Warner KE (eds) Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education. The National Academies Press, Washington, DC
Petras H, Chilcoat H, Leaf P, Ialongo N, Kellam S (2004) Utility of TOCA-R scores during the elementary school years in identifying later violence among adolescent males. J Am Acad Child Adolesc Psychiatry 43:88–96
Petras H, Ialongo N, Lambert S, Barrueco S, Schaeffer C, Chilcoat H, Kellam S (2005) The utility of elementary school TOCA-R scores in identifying later criminal court violence among adolescent females. J Am Acad Child Adolesc Psychiatry 44:790–797
Ponsor MA (2006) ROSIE D. et al. v. Mitt ROMNEY et al. In: United States District Court District of Massachusetts (ed) Civil Action No. 01 30199 MAP. Boston, MA, p 410 F.Supp.412d 418
Reijneveld SA, Vogels AG, Hoekstra F, Crone MR (2006) Use of the pediatric symptom checklist for the detection of psychosocial problems in preventive child healthcare. BMC Public Health 6:197–204
Semansky RM, Koyanagi C, Vandivort-Warren R (2003) Behavioral health screening policies in medicaid programs nationwide. Psychiatr Serv 54:736–739
Siran S (2005) Status and academic achievement: a meta-analytic review of research. Rev Edu Res 75:417–453
Thun-Hohenstein L, Herzog S (2008) The predictive value of the pediatric symptom checklist in 5-year-old Austrian children. Eur J Pediatr 167:323–329
US Department of Health and Human Services (2000) Healthy People 2010, 2nd ed. With understanding and improving health and objectives for improving health, 2 vols. In: US Department of Health and Human Services Office of Disease Prevention and Health Promotion, Washington, DC
US Department of Health and Human Services (1999) Mental health: a report of the surgeon general. In: US Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health, Rockville, MD
US Preventive Services Task Force (2009) Screening and treatment for major depressive disorder in children and adolescents: US Preventive Services Task Force recommendation statement. Pediatrics 123:1611
Üstün TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJL (2004) Global burden of depressive disorders in the year 2000. Br J Psychiatry 184:386–392
Wagner M (1995) Outcomes for youths with serious emotional disturbances in secondary school and early adulthood. Future Child 5:90–112
Warnick EM, Bracken MB, Kasl S (2008) Screening efficiency of the Child Behavior Checklist and Strengths and Difficulties Questionnaire: a systematic review. J Child Adolesc Ment Health 13:140–147
Werthamer-Larsson L, Kellam SG, Wheeler L (1991) Effects of first-grade classroom environment on shy behavior, aggressive behavior, and concentration problems. Am J Community Psychol 19:585–602
WHO (2003) Caring for children and adolescents with mental disorders; setting WHO directions. In: Meeting on Caring for Children and Adolescents with Mental Disorders. Geneva, Switzerland
Yucel RM, Demirtas H (2010) Impact of non-normal random effects on inference by multiple imputation: a simulation assessment. Comput Stat Data Anal 54:790–801
Acknowledgments
We wish to thank Iris Delgado and Lilian Jadue for their help in preparing the dataset and Haley Kamin for her help in preparing the manuscript. The MGH Department of Psychiatry and a Fuss Family Fund grant to Newton Wellesley Hospital made the current data analysis and paper writing possible. Correspondence should be addressed to Michael Murphy, Ed.D.
Conflict of interest
All of the Chilean authors received salary support from the Chilean government for administering the mental health program. All US authors except Dr. Jellinek received salary or consultation support for data analysis or report writing. Drs. Jellinek and Murphy are the authors of the PSC, but they received no income from this since it is available free in the public domain. No other authors reported any financial disclosures or conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Guzman, M.P., Jellinek, M., George, M. et al. Mental health matters in elementary school: first-grade screening predicts fourth grade achievement test scores. Eur Child Adolesc Psychiatry 20, 401–411 (2011). https://doi.org/10.1007/s00787-011-0191-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00787-011-0191-3