Skip to main content

Advertisement

Log in

Mental health matters in elementary school: first-grade screening predicts fourth grade achievement test scores

  • Original Contribution
  • Published:
European Child & Adolescent Psychiatry Aims and scope Submit manuscript

Abstract

The objective of the study was to evaluate whether mental health problems identified through screens administered in first grade are related to poorer academic achievement test scores in the fourth grade. The government of Chile uses brief teacher- and parent-completed measures [Teacher Observation of Classroom Adaptation-Revised (TOCA-RR) and Pediatric Symptom Checklist (PSC-Cl)] to screen for mental health problems in about one-fifth of the country’s elementary schools. In fourth grade, students take the national achievement tests (SIMCE) of language, mathematics and science. This study examined whether mental health problems identified through either or both screens predicted achievement test scores after controlling for student and family risk factors. A total of 17,252 students had complete first grade teacher forms and these were matched with fourth grade SIMCE data for 11,185 students, 7,903 of whom also had complete parent form data from the first grade. Students at risk on either the TOCA-RR or the PSC-Cl or both performed significantly worse on all SIMCE subtests. Even after controlling for covariates and adjusting for missing data, students with mental health problems on one screen in first grade had fourth grade achievement scores that were 14–18 points (~1/3 SD) lower than students screened as not at risk. Students at risk on both screens had scores that were on average 33 points lower than students at risk on either screen. Mental health problems in first grade were one of the strongest predictors of lower achievement test scores 3 years later, supporting the premise that for children mental health matters in the real world.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. 107th Congress (enacted January 8, 2002) No Child Left Behind Act of 2001. In: PUBLIC LAW 107–110, JAN 8 2002 115 STAT. 1425

  2. Aluja A, Blanch A (2002) The children depression inventory as predictor of social and scholastic competence. Eur J Psychol Assess 18:15

    Article  Google Scholar 

  3. Ambrosini PJ (2000) Historical development and present status of the schedule for affective disorders and schizophrenia for school-age children (K-SADS). J Am Acad Child Adolesc Psychiatry 39:49–58

    Article  PubMed  CAS  Google Scholar 

  4. American Academy of Pediatrics (2004) Policy statement: school-based mental health services. Pediatrics 113:1839–1845

    Article  Google Scholar 

  5. American Academy of Pediatrics Task Force on Mental Health (2010) Appendix S4: the case for routine mental health screening. Pediatrics 125:S133–S139

    Article  Google Scholar 

  6. Breslau J, Miller E, Breslau N, Bohnert K, Lucia V, Schweitzer J (2009) The impact of early behavior disturbances on academic achievement in high school. Pediatrics 123:1472–1476

    Article  PubMed  Google Scholar 

  7. Cancecko-Llego CD, Castillo-Carandang NT, Reyes AL (2009) Validation of the pictoral pediatric symptom checklist-filipino version for the psychosocial screening of children in a low-income urban community. Acta Medica Philippina 43:62–68

    Google Scholar 

  8. Contreras D, Bustos S, Sep′ulveda P (2007) When schools are the ones that choose: the effect of screening in Chile. In: Serie Documentos de Trabajo. Departamento de Economía, Universidad de Chile

  9. Davis-Kean P (2005) The influence of parent education and family income on child achievement: the indirect role of parental expectations and the home environment. J Fam Psychol 19:294–304

    Article  PubMed  Google Scholar 

  10. de la Barra F, Toledo V, Rodriguez J (2005) Prediction of behavioral problems in Chilean school children. Child Psychiatry Hum Dev 35:227–243

    Article  Google Scholar 

  11. Duncan G, Dowsett C, Claessens A, Magnuson K, Huston A, Klebanov P, Pagani L, Feinstein L, Engel M, Brooks-Gunn J, Sexton H, Duckworth K, Japel C (2007) School readiness and later achievement. Dev Psychol 43:1428–1446

    Article  PubMed  Google Scholar 

  12. Fisher JRW, Cabral de Mello M, Izutsu T, Vijayakumar L, Belfer M, Omigbodun O (2011) Adolescent mental health in resource-constrained settings: a review of the evidence of the nature, prevalence and determinants of common mental health problems and their management in primary health care. J Soc Psychiatry 57(1 Suppl):v–vii, 9–116

    Google Scholar 

  13. Fröjd S, Nissinena E, Pelkonenb MU, Marttunen MJ, Koivistoa A, Kaltiala-Heinoa R (2008) Depression and school performance in middle adolescent boys and girls. J Adolesc 31:14

    Article  Google Scholar 

  14. Gall G, Pagano ME, Desmond MS, Perrin JM, Murphy JM (2000) Utility of psychosocial screening at a school-based health center. J Sch Health 70:292–298

    Article  PubMed  CAS  Google Scholar 

  15. Gardner W, Lucas A, Kolko D, Campo J (2007) Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry 46:611–618

    Article  PubMed  Google Scholar 

  16. George M, Siraqyan X, Mores R, de la Barra F, Rodríguez J, López C, Toledo V (1995) Adaptation and validation of two screening instruments of mental health of first grade schoolchildren of Santiago. Revista de Psicologıa 5:17–25

    Google Scholar 

  17. George M, Squicciarini A, Zapata R, Guzmán MP, Hartley M, Silva C (2004) Detection of early mental health risk factors in primary schools. Revista de Psicologia 13:9–20

    Google Scholar 

  18. Goldberg C (2007) Mental screening for young to begin: mass. doctors to offer questionnaires for children on Medicaid. The Boston Globe. NY Times Co., Boston

  19. Hendren R, Birrell Weisen R, Orley J (1994) Mental health programmes in schools. World Health Organization, Geneva

    Google Scholar 

  20. Ishizaki Y, Fukai Y, Kobayashi Y (1997) Preliminary study of validation of the Japanese version of the pediatric symptom checklist by Jellinek of Massachusetts General Hospital- a new screening method for children with psychosocial and psychosomatic dysfunction. J Jpn Pediatr Soc 101:1679–1985

    Google Scholar 

  21. Jellinek MS, Bishop Joseph SJ, Murphy JM, Zigler E (2005) Mental health in head start; leave no child behind. NHSA DIALOG 8:25–35

    Google Scholar 

  22. Jellinek MS, Murphy JM, Burns BJ (1986) Brief psychosocial screening in outpatient pediatric practice. J Pediatr 109:371–378

    Article  PubMed  CAS  Google Scholar 

  23. JUNAEB Chilean Department of Education (2009) Skills for life program; Report on the 2008 school year. JUNAEB, Santiago

  24. Kamphaus RW, Thorpe JS, Winsor AP, Kroncke AP, Dowdy ET, VanDeventer MC (2007) Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educ Psychol Measur 67:1–15

    Article  Google Scholar 

  25. Kellam Sheppard G, Brown H, Poduska JM, Ialongo NS, Wang W, Toyinbo P, Petras H, Ford C, Windham A, Wilcox HC (2008) Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug Alcohol Dependence 95(Suppl 1):S5–S28

    Article  Google Scholar 

  26. Kellam SG, Rebok GW, Mayer LS, Ialongo N (1994) Depressive symptoms over first grade and their response to a developmental epidemiologically based preventive trial aimed at improving achievement. Dev Psychopathol 6:463–481

    Article  Google Scholar 

  27. Kelleher K, McInerny T, Gardner W, Childs G, Wasserman R (2000) Increasing identification of psychosocial problems: 1979–1996. Pediatrics 105:1313–1321

    Article  PubMed  CAS  Google Scholar 

  28. Kovacs M (1985) The children’s depression, inventory (CDI). Psychopharmacol Bull 21:995–998

    PubMed  CAS  Google Scholar 

  29. Kuhlthau K, Jellinek M, White G, VanCleave J, Jack Simons J, Michael Murphy JM (2011) Increases in behavioral health screening in pediatric care for Massachusetts medicaid patients. Arch Pediatr Adolesc Med. doi:10.1001/archpediatrics.2011.18

  30. López C, de la Barra F, George M, Toledo V, Rodríguez J (1996) Características de la Familia y Conducta de los Niños Evaluada por sus Padres y Profesores. Revista de Psiquiatria 12:195–1999

    Google Scholar 

  31. Meckes L, Carrasco R (2010) Two decades of SIMCE: An overview of the National Assessment System in Chile. Assessment in Education: Principles, Policy and Practice 17:233–248

    Google Scholar 

  32. Meier D, Wood G (2004) Many children left behind: how the No Child Left Behind Act is damaging our children and our schools. Beacon Press, Boston

    Google Scholar 

  33. Murphy JM, Jellinek M, Milinsky S (1989) The pediatric symptom checklist: validation in the real world of middle school. J Pediatr Psychol 14:629–639

    Article  PubMed  CAS  Google Scholar 

  34. Murphy JM, Masek B, Babcock R, Jellinek M, Gold J, Drubner S, Sklar K, Hacker K (2011) Measuring outcomes in outpatient child psychiatry: the contribution of electronic technologies and parent report. Clin Child Psychol Psychiatry 16:146–160

    Article  PubMed  Google Scholar 

  35. Murray CJ, Lopez AD (1996) Evidence-based health policy–lessons from the global burden of disease study. Science 274:740–743

    Article  PubMed  CAS  Google Scholar 

  36. Muzzolon SRB (2008) Evaluation of the use of the Pediatric Symptom Checklist as screening for emotional and psychosocial problems in a public school in Curitiba. Brazil Arquivos de Neuro-Psiquiatria 66:604

    Article  Google Scholar 

  37. National Research Council and Institute of Medicine (2009) Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: research advances and promising interventions. In: O’Connell ME, Boat T, Warner KE (eds) Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education. The National Academies Press, Washington, DC

  38. Petras H, Chilcoat H, Leaf P, Ialongo N, Kellam S (2004) Utility of TOCA-R scores during the elementary school years in identifying later violence among adolescent males. J Am Acad Child Adolesc Psychiatry 43:88–96

    Article  PubMed  Google Scholar 

  39. Petras H, Ialongo N, Lambert S, Barrueco S, Schaeffer C, Chilcoat H, Kellam S (2005) The utility of elementary school TOCA-R scores in identifying later criminal court violence among adolescent females. J Am Acad Child Adolesc Psychiatry 44:790–797

    Article  PubMed  Google Scholar 

  40. Ponsor MA (2006) ROSIE D. et al. v. Mitt ROMNEY et al. In: United States District Court District of Massachusetts (ed) Civil Action No. 01 30199 MAP. Boston, MA, p 410 F.Supp.412d 418

  41. Reijneveld SA, Vogels AG, Hoekstra F, Crone MR (2006) Use of the pediatric symptom checklist for the detection of psychosocial problems in preventive child healthcare. BMC Public Health 6:197–204

    Article  PubMed  Google Scholar 

  42. Semansky RM, Koyanagi C, Vandivort-Warren R (2003) Behavioral health screening policies in medicaid programs nationwide. Psychiatr Serv 54:736–739

    Article  PubMed  Google Scholar 

  43. Siran S (2005) Status and academic achievement: a meta-analytic review of research. Rev Edu Res 75:417–453

    Article  Google Scholar 

  44. Thun-Hohenstein L, Herzog S (2008) The predictive value of the pediatric symptom checklist in 5-year-old Austrian children. Eur J Pediatr 167:323–329

    Article  PubMed  Google Scholar 

  45. US Department of Health and Human Services (2000) Healthy People 2010, 2nd ed. With understanding and improving health and objectives for improving health, 2 vols. In: US Department of Health and Human Services Office of Disease Prevention and Health Promotion, Washington, DC

  46. US Department of Health and Human Services (1999) Mental health: a report of the surgeon general. In: US Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health, Rockville, MD

  47. US Preventive Services Task Force (2009) Screening and treatment for major depressive disorder in children and adolescents: US Preventive Services Task Force recommendation statement. Pediatrics 123:1611

    Article  Google Scholar 

  48. Üstün TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJL (2004) Global burden of depressive disorders in the year 2000. Br J Psychiatry 184:386–392

    Article  PubMed  Google Scholar 

  49. Wagner M (1995) Outcomes for youths with serious emotional disturbances in secondary school and early adulthood. Future Child 5:90–112

    Article  PubMed  CAS  Google Scholar 

  50. Warnick EM, Bracken MB, Kasl S (2008) Screening efficiency of the Child Behavior Checklist and Strengths and Difficulties Questionnaire: a systematic review. J Child Adolesc Ment Health 13:140–147

    Article  Google Scholar 

  51. Werthamer-Larsson L, Kellam SG, Wheeler L (1991) Effects of first-grade classroom environment on shy behavior, aggressive behavior, and concentration problems. Am J Community Psychol 19:585–602

    Article  PubMed  CAS  Google Scholar 

  52. WHO (2003) Caring for children and adolescents with mental disorders; setting WHO directions. In: Meeting on Caring for Children and Adolescents with Mental Disorders. Geneva, Switzerland

  53. Yucel RM, Demirtas H (2010) Impact of non-normal random effects on inference by multiple imputation: a simulation assessment. Comput Stat Data Anal 54:790–801

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We wish to thank Iris Delgado and Lilian Jadue for their help in preparing the dataset and Haley Kamin for her help in preparing the manuscript. The MGH Department of Psychiatry and a Fuss Family Fund grant to Newton Wellesley Hospital made the current data analysis and paper writing possible. Correspondence should be addressed to Michael Murphy, Ed.D.

Conflict of interest

All of the Chilean authors received salary support from the Chilean government for administering the mental health program. All US authors except Dr. Jellinek received salary or consultation support for data analysis or report writing. Drs. Jellinek and Murphy are the authors of the PSC, but they received no income from this since it is available free in the public domain. No other authors reported any financial disclosures or conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Michael Murphy.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guzman, M.P., Jellinek, M., George, M. et al. Mental health matters in elementary school: first-grade screening predicts fourth grade achievement test scores. Eur Child Adolesc Psychiatry 20, 401–411 (2011). https://doi.org/10.1007/s00787-011-0191-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00787-011-0191-3

Keywords

Navigation