Skip to main content

Advertisement

SpringerLink
Log in

The Utility of Universal Screening to Guide School-Based Prevention Initiatives: Comparison of Office Discipline Referrals to Standardized Emotional and Behavioral Risk Screening

  • Published:
Contemporary School Psychology Aims and scope Submit manuscript

Abstract

A critical component of any school-based prevention program is early identification of student risk as reported by Lane et al. (Remedial and Special Education 32:39–54, 2011). While screening for academic risk has grown in the last decade, screening for behavioral risk has remained stagnant. Few schools systematically screen for behavioral and emotional risk, and those that do rely on subjective referral systems that have been linked to disproportionality in special education and exclusionary discipline practices. An alternative to these subjective referral systems is universal screening for behavioral and emotional risk. Despite evidence that this standardized screening measure is both valid and reliable, few schools have adopted universal screening tools for behavioral and emotional risk. One potential reason for the lagging use of screening for behavioral and emotional risk is lack of information regarding the utility of these measures. This study compares the predicative validity of a universal screening tool for behavioral and emotional risk, and the predictive validity of the more traditionally used office discipline referrals. Results indicate that the universal screening measure, the Behavioral and Emotional Screening System Teacher Form (BESS TF), is a more reliable predictor of student GPA (t(132) = 5.062, p < .001) and absences (t(132) = 2.370, p < .02) than office discipline referrals (ODRs), while both ODRs and the BESS TF reliably predict student suspension rates. The ability of the BESS TF to identify students experiencing behavioral and emotional risk that impacts both their academic and behavioral functioning at school makes it a more useful measure than ODRs alone.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Psychological Association Zero Tolerance Task Force. (2008). Are zero tolerance policies effective in the schools? An evidentiary review and recommendations. American Psychological Association, 63(9), 852–862. https://doi.org/10.1037/0003-066X.6

    Article  Google Scholar 

  • American Psychological Association. (2010). Ethical Principles of Psychologists and Code of Conduct. Available from http://www.apa.org/ethics/code/

  • Bear, G. C., Webster-Stratton, E., Furlong, M. J., & Rhee, S. (2000). Preventing school violence. In K. M. Minke & G. C. Bear (Eds.), Preventing school problems, promoting school success: strategies and programs that work (pp. 1–69). Bethesda: National Association of School Psychologists.

    Google Scholar 

  • Belser, C. T., Shillingford, M., & Joe, J. R. (2016). The ASCA model and a multi-tiered system of supports: a framework to support students of color with problem behavior. Professional Counselor, 6(3), 251–262. https://doi.org/10.15241/cb.6.3.251

    Article  Google Scholar 

  • Bruhn, A. L., Woods-Groves, S., & Huddle, S. (2014). A preliminary investigation of emotional and behavioral screening practices in K–12 schools. Education and Treatment of Children, 37(4), 611–634. https://doi.org/10.1353/etc.2014.0039

    Article  Google Scholar 

  • Chafouleas, S. M., Volpe, R. J., Gresham, F. M., & Cook, C. R. (2010). School-based behavioral assessment within problem-solving models: current status and future directions. School Psychology Review, 39(3), 343.

    Google Scholar 

  • Clonan, S. M., McDougal, J. L., Clark, K., & Davison, S. (2007). Use of office discipline referrals in school-wide decision making: a practical example. Psychology in the Schools, 44(1), 19–27. https://doi.org/10.1002/pits.20202

    Article  Google Scholar 

  • Dever, B. V., Dowdy, E., Raines, T. C., & Carnazzo, K. (2015). Stability and change of behavioral and emotional screening scores. Psychology in the Schools. https://doi.org/10.1002/pits.21825

  • Dever, B. V., Mays, K. L., Kamphaus, R. W., & Dowdy, E. (2012). The factor structure of the BASC-2 behavioral and emotional screening system teacher form, child/adolescent. Journal of Psychoeducational Assessment, 30(5), 488–495. https://doi.org/10.1177/0734282912438869

    Article  Google Scholar 

  • Dowdy, E., Doane, K., Eklund, K., & Dever, B. V. (2013). A comparison of teacher nomination and screening to identify behavioral and emotional risk within a sample of underrepresented students. Journal of Emotional and Behavioral Disorders, 21(2), 127–137. https://doi.org/10.1177/1063426611417627

    Article  Google Scholar 

  • Dowdy, E., Furlong, M., Raines, T. C., Bovery, B., Kauffman, B., Kamphaus, R. W., Dever, B. V., Price, M., & Murdock, J. (2014). Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. Journal of Educational and Psychological Consultation. https://doi.org/10.1080/10474412.2014.929951.2014

  • Duckworth, A. L., Quinn, P. D., & Tsukayama, E. (2012). What No Child Left Behind leaves behind: the roles of IQ and self-control in predicting standardized achievement test scores and report card grades. Journal of Educational Psychology, 104(2), 439–451. https://doi.org/10.1037/a0026280

    Article  PubMed  Google Scholar 

  • Eklund, K., & Dowdy, E. (2014). Screening for behavioral and emotional risk versus traditional school identification methods. School Mental Health, 6(1), 40–49. https://doi.org/10.1007/s12310-013-9109-1

    Article  Google Scholar 

  • Eklund, K., Renshaw, T. L., Dowdy, E., Jimerson, S. R., Hart, S. R., Jones, C. N., & Earhart, J. (2009). Early identification of behavioral and emotional problems in youth: universal screening versus teacher-referral identification. The California Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878355.pdf

    Article  Google Scholar 

  • Fish, R. E. (2016). The racialized construction of exceptionality: experimental evidence of race/ethnicity effects on teachers’ interventions. Social Science Research. https://doi.org/10.1016/j.ssresearch.2016.08.007 .

  • Gershoff, E. T. & Font, S. A. (2016). Corporal punishment in U.S. public schools: prevalence, disparities in use, and status in state and federal policy. Society for Research in Child Development Social Policy Report, 30(1). Retrieved from http://www.srcd.org/sites/default/files/documents/spr_30_1.pdf.

  • Glover, T., & Albers, C. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135. https://doi.org/10.1016/j.jsp.2006.05.005

    Article  Google Scholar 

  • Golann, J. W. (2015). The paradox of success at a no-excuses school. Sociology of Education, 88(2), 103–119. https://doi.org/10.1177/0038040714567866

    Article  PubMed  PubMed Central  Google Scholar 

  • Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions. Journal of Positive Behavior Interventions, 6(3), 131–147. https://doi.org/10.1177/10983007040060030201

    Article  Google Scholar 

  • Jellinek, M. S., Murphy, J. M., Little, M., Pagano, M. E., Comer, D. M., & Kelleher, K. J. (1999). Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Archives of Pediatrics & Adolescent Medicine, 153(3), 254–260 Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3905751/

    Article  Google Scholar 

  • Kamphaus, R. W., & Reynolds, C. R. (2007). Behavior assessment system for children—second edition (BASC–2): behavioral and emotional screening system (BESS). Bloomington: Pearson.

    Google Scholar 

  • Kamphaus, R. W., DiStefano, C., Dowdy, E., Eklund, K., & Dunn, A. R. (2010). Determining the presence of a problem: comparing two approaches for detecting youth behavioral risk. School Psychology Review, 39(3), 395.

    Google Scholar 

  • Kamphaus, R., Reynolds, C., & Dever, B. (2014). Behavioral and mental health screening. In Kettler, R., Glover, A., Albers, C., Feeny-Kettler, K. (Eds.) Universal screening in educational settings: Evidence-based decision making for schools. Washington, DC: APA.

  • Kamphaus, R. W., Reynolds, C. R., Hatcher, N. M., & Kim, S. (2014). Treatment planning and evaluation with the Behavior Assessment System for Children (BASC). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (Vol. 2. Instruments for children and adolescents, pp. 331–354). Mahwah: Lawrence Erlbaum.

    Chapter  Google Scholar 

  • Kamphaus, R. W., Thorpe, J. S., Winsor, A. P., Kroncke, A. P., Dowdy, E. T., & VanDeventer, M. C. (2007). Development and predictive validity of a teacher screener for child behavioral and emotional problems at school. Educational and Psychological Measurement, 67(2), 342–356. https://doi.org/10.1177/00131644070670021001

    Article  Google Scholar 

  • Kern, L., & Manz, P. (2004). A look at current validity issues of school-wide behavior support. Behavioral Disorders, 47–59. https://doi.org/10.1177/019874290403000102.

  • King, K. R., & Reschly, A. L. (2014). A comparison of screening instruments: predictive validity of the BESS and BSC. Journal of Psychoeducational Assessment, 32(8), 687–698. https://doi.org/10.1177/0734282914531714

    Article  Google Scholar 

  • King, K., Reschly, A. L., & Appleton, J. J. (2012). An examination of the validity of the behavioral and emotional screening system in a rural elementary school: validity of the BESS. Journal of Psychoeducational Assessment, 30(6), 527–538. https://doi.org/10.1177/0734282912440673

    Article  Google Scholar 

  • Lane, K. L., Kalberg, J. R., & Menzies, H. M. (2009). Developing school-wide programs to prevent and manage problem behaviors (p. 157). New York: Guilford.

    Google Scholar 

  • Lane, K. L., Kalberg, J. R., Menzies, H., Bruhn, A., Eisner, S., & Crnobori, M. (2011). Using systematic screening data to assess risk and identify students for targeted supports: illustrations across the K–12 continuum. Remedial and Special Education, 32, 39–54. https://doi.org/10.1177/0741932510361263

    Article  Google Scholar 

  • Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766. https://doi.org/10.1016/j.jesp.2013.03.013

    Article  Google Scholar 

  • Losen, D., Hodson, S., Keith, M. A., Morrison, K., & Belway, S. (2015). Are we closing the school discipline gap? The Center for Civil Rights Remedies at the Civil Rights Project. Retrieved from https://www.civilrightsproject.ucla.edu/resources/projects/center-for-civil-rights-remedies/school-to-prison-folder/federal-reports/are-we-closing-the-school-discipline-gap/AreWeClosingTheSchoolDisciplineGap_FINAL221.pdf.

  • Mathis, W.J. & Trujillo, T.M. (2016). Lessons from NCLB for the Every Student Succeeds Act. Boulder CO: National Education Policy Center. Retrieved from http://nepc.colorado.edu/files/publications/PB%20Mathis-Trujillo%20ESSA_0.pdf.

  • McIntosh, K., Frank, J. L., & Spaulding, S. A. (2010). Establishing research-based trajectories of office discipline referrals for individual students. School Psychology Review, 39(3), 380–394 Retrieved from http://web.b.ebscohost.com.libproxy.tulane.edu:2048/ehost/pdfviewer/pdfviewer?sid=331bfb61-aff4-4676-b91e-0bf9235fd2b2%40sessionmgr198&vid=2&hid=113

    Google Scholar 

  • Merrell, K. W., Juskelis, M. P., Tran, O. K. Buchanan, R. (2008). Social and Emotional Learning in the Classroom: Evaluation of and on Students' Social-Emotional Knowledge and Symptoms . Journal of Applied School Psychology 24(2), 209–224. https://doi.org/10.1080/15377900802089981

  • Miller, F. G., Cohen, D., Chafouleas, S. M., Riley-Tillman, T. C., Welsh, M. E., & Fabiano, G. A. (2015). A comparison of measures to screen for social, emotional, and behavioral risk. School Psychology Quarterly, 30(2), 184. https://doi.org/10.1037/spq0000085

    Article  PubMed  Google Scholar 

  • National Education Association. (n.d.). Indicators of future success: GPA and noncognitive skills. Washington: NEA Education Policy and Practice Department, Center for Great Public Schools Retrieved from https://www.nea.org/assets/docs/Indicators_of_Success-BGH_ac5-final.pdf

  • Nelson, R., Benner, G., Reid, R., & Currin, D. (2002). The convergent validity of office discipline referrals with the CBCL-TRF. Journal of Emotional and Behavioral Disorders, 10(3), 181–188. https://doi.org/10.1177/10634266020100030601

    Article  Google Scholar 

  • No Child Left Behind Act of 2001, Pub. L. No. 107–110 (2001). Retrieved from http://www2.ed.gov/nclb/landing.jhtml.

  • New Orleans Parents Guide. (2015). Available from http://neworleansparentsguide.org/

  • O’Connell, M. E., Boat, T., & Warner, K. E. (2009). Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities. Washington: The National Academies Press.

    Google Scholar 

  • Oakes, W. P., Lane, K. L., Cox, M. L., & Messenger, M. (2014). Logistics of behavior screenings: how and why do we conduct behavior screenings at our school? Preventing School Failure: Alternative education for children and youth, 58(3), 159–170. https://doi.org/10.1080/1045988X.2014.895572

    Article  Google Scholar 

  • Parisi, D. M., Ihlo, T., & Glover, T. A. (2014). Screening within a multitiered early prevention model: using assessment to inform instruction and promote students’ response to intervention. In R. J. Kettler, T. A. Glover, C. A. Albers, & K. A. Feeney-Kettler (Eds.), Universal screening in educational settings: evidence-based decision making for schools (pp. 19–45). Washington: American Psychological Association.

    Chapter  Google Scholar 

  • Perfect, M. M., & Morris, R. J. (2011). Delivering school-based mental health services by school psychologists: education, training, and ethical issues. Psychology in the Schools, 48(10), 1049–1063. https://doi.org/10.1002/pits.20612

    Article  Google Scholar 

  • Predy, L., McIntosh, K., & Frank, J. L. (2014). Utility of number and type of office discipline referrals in predicting chronic problem behavior in middle schools. School Psychology Review, 43(4), 472–489. https://doi.org/10.17105/SPR-13-0043.1

    Article  Google Scholar 

  • Proctor, S. L., Graves, S. L., & Esch, R. C. (2012). Assessing African American students for specific learning disabilities: the promises and perils of response to intervention. The Journal of Negro Education, 81(3), 268–282. https://doi.org/10.7709/jnegroeducation.81.3.0268

    Article  Google Scholar 

  • Raines, T. C., Dever, B. V., Kamphaus, R. W., & Roach, A. T. (2012). Universal screening for behavioral and emotional risk: a promising method for reducing disproportionate placement in special education. The Journal of Negro Education, 81(3), 283–296. https://doi.org/10.7709/jnegroeducation.81.3.0283

    Article  Google Scholar 

  • Rebell, M. A. (2012). The right to comprehensive educational opportunity. Harvard Civil Rights-Civil Liberties Law Review., 47, 48–117 Retrieved from http://harvardcrcl.org/wp-content/uploads/2012/03/Rebell.pdf

    Google Scholar 

  • Reid, J.B., Patterson, G.R., & Snyder, J.J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and a model for intervention. Washington, DC: American Psychological Association.

  • Renshaw, E., Eklund, K., Dowdy, E., Jimerson, S., Hart, S., Earhart, J., & Jones, C. (2009). Examining the relationship between scores on the Behavioral and Emotional Screening System and student academic, behavioral, and engagement outcomes: an investigation of concurrent validity in elementary school. The California School Psychologist, 14, 89–95 Retrieved from http://files.eric.ed.gov/fulltext/EJ878363.pdf

    Article  Google Scholar 

  • Skiba, R. J., Horner, R. H., Chung, C. G., Rausch, M. K., May, S. L., & Tobin, T. (2011). Race is not neutral: a national investigation of African American and Latino disproportionality in school discipline. School Psychology Review, 40(1), 85–107 Retrieved from http://www.indiana.edu/~equity/docs/Skiba%20et%20al%20Race%20is%20Not%20Neutral%202011.pdf

    Google Scholar 

  • Skiba, R. J., Michael, R. S., Nardo, A. C., & Paterson, R. L. (2002). The color of discipline: sources of racial and gender disproportionality in school punishment. The Urban Review, 34(4), 317–342.

    Article  Google Scholar 

  • Skiba, R. J., Ritter, S., Simmons, A., Peterson, R., & Miller, C. (2006). The Safe and Responsive Schools Project: a school reform model for implementing best practices in violence prevention. In S. R. Jimerson & M. J. Furlong (Eds.), Handbook of school violence and school safety: from research to practice (pp. 631–650). New York: Routledge.

    Google Scholar 

  • Staats, C., & Patton, C. (2014). State of the science: implicit bias review 2014. Kirwan Institute for the Study of Race and Ethnicity. Retrieved from http://kirwaninstitute.osu.edu/wp-content/uploads/2014/03/2014-implicit-bias.pdf.

  • Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). London: Pearson Education, Inc.

    Google Scholar 

  • Vaillancourt, K., Cowan, K. C., & Skalski, A. K. (2013). Providing mental health services within a multi-tiered system of supports. In J. Desrochers & G. Houck (Eds.), Depression in children and adolescents: guidelines for school practice. Bethesda: NASP & NASN.

    Google Scholar 

  • Vander S. A., Weiss, N. S., Kuo, E. S., Cheney, D., & Cohen, P. (2003). What proportion of failure to complete secondary school in the US population is attributable to adolescent psychiatric disorder? Journal of Behavioral Health Services and Research, 30(1), 119–124. https://doi.org/10.1007/BF02287817

  • Wadsworth, M., & Rienks, S. (2012). Stress as a mechanism of poverty’s ill effects on children: making a case for family strengthening interventions that counteract poverty-related stress. CYF News, Special Edition on Poverty, Health Disparities, and the Nation’s Children. Retrieved from http://www.apa.org/pi/families/resources/newsletter/2012/07/stress-mechanism.aspx.

  • Walker, H., Severson, H. H., & Seeley, J. (2010). Universal, school-based screening for the early detection of academic and behavioral problems contributing to later destructive outcomes. In H. M. Walker & M. Shinn (Eds.), Interventions for achievement and behavior problems in a three-tier model including RTI (pp. 677–703). Bethesda: National Association of School Psychologists.

    Google Scholar 

  • Warren, J. S., Edmonson, H. M., Griggs, P., Lassen, S. R., McCart, A., Turnbull, A., & Sailor, W. (2003). Urban applications of school-wide positive behavior support critical issues and lessons learned. Journal of Positive Behavior Interventions, 5(2), 80–91. https://doi.org/10.1177/10983007030050020301

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Cleveland State University, 2121 Euclid Ave. UN 245, Cleveland, OH, 44115, USA

    Shereen Naser

  2. Minnesota State University, 23 Armstrong Hall, Mankato, MN, 56001, USA

    Jeffery Brown

  3. Satcher Health Leadership Institute, Morehouse School of Medicine, 207 Huron Street, Decatur, GA, 30030, USA

    Jorge Verlenden

Authors
  1. Shereen Naser
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jeffery Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jorge Verlenden
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shereen Naser.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naser, S., Brown, J. & Verlenden, J. The Utility of Universal Screening to Guide School-Based Prevention Initiatives: Comparison of Office Discipline Referrals to Standardized Emotional and Behavioral Risk Screening. Contemp School Psychol 22, 424–434 (2018). https://doi.org/10.1007/s40688-018-0173-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40688-018-0173-2

Keywords

Search

Navigation