Abstract
The study examines the psychometric properties of a translated version of the Integrated Teacher Rating Form (ITRF) for use in Greek schools. The ITRF is a 67-item targeted screening measure that can be used to identify students who demonstrate behaviors that interfere with their academic and social functioning and assist educators in designing classroom interventions targeting these behaviors. The sample of the study consisted of 38 4th-6th grade teachers working in public schools in the central region of Greece. Results of an exploratory factor analysis suggested the presence of three factors, which collectively explained 61.13% of the observed variance. The content of the two of the factors was consistent with the original ITRF (i.e., Oppositional/Defiant, Academic Productivity/Disorganization) whereas the third factor (Internalizing scale) contained all items designed to broadly assess internalizing concerns. All three subscales demonstrated strong internal consistency reliability and moderate correlations with one another, suggesting that the constructs were interrelated but distinct.
Similar content being viewed by others
References
American Psychological Association. (2013). Diagnostic and statistical manual for mental disorders (5th ed.). Author.
Briesch, A. M., Chafouleas, S. M., Dineen, J. N., McCoach, D. B., & Donaldson, A. (2021). School building administrator reports of screening practices across academic, behavioral, and physical health domains. Journal of Positive Behavior Interventions, 24, 266–277.
Briesch, A., Chafouleas, S., Nissen, K., & Long, S. (2020). A review of state-level procedural guidance for implementing multitiered systems of support for behavior. Journal of Positive Behavior, 22(3), 131–144. https://doi.org/10.1177/10983007198847
Bruhn, A. L., Woods-Groves, S., & Huddle, S. (2014). A preliminary investigation of emotional and behavioral screening practices in K–12 schools. Education and Treatment of Children, 37(4), 611–634. https://doi.org/10.1353/etc.2014.0039
Burns, J. R., & Rapee, R. M. (2021). Barriers to universal mental health screening in schools: The perspective of school psychologists. Journal of Applied School Psychology. https://doi.org/10.1080/15377903.2021.1941470
Casale, G., Volpe, R. J., Daniels, B., Hennemann, T., Briesch, A. M., & Grosche, M. (2019). Measurement invariance of a universal behavioral screener across samples from the USA and Germany. European Journal of Psychological Assessment, 34, 87–100.
Chin, J. C., Dowdy, E., & Quirk, M. P. (2013). Universal screening in middle school: Examining the behavioral and emotional screening system. Journal of Psychoeducational Assessment, 31(1), 53–60. https://doi.org/10.1177/0734282912448137
Comrey, A. L., & Lee, H. B. (2013). A first course in factor analysis. Psychology Press.
Cortés-Ramos, A., & Landa-Blanco, M. (2021). Universal Screening in positive school mental health using the ASEBA methodology for teachers: A pilot epidemiological study. International Journal of Environmental Research and Public Health., 18(22), 1–14. https://doi.org/10.3390/ijerph182211807
Daniels, B., Volpe, R. J., & Fabiano, G. (2014). Development of a problem-focused behavioral screener linked to evidence-based interventions. School Psychology Quarterly, 29(4), 438–451. https://doi.org/10.1037/spq0000100
Daniels, B., Volpe, R. J., Fabiano, G. A., & Briesch, A. M. (2016). Classification accuracy and acceptability of the Integrated screening and intervention system teacher rating form. School Psychology Quarterly. https://doi.org/10.1037/spq0000147
Davis, P., & Anderson, R. (2022). Virtually Integrated Primary Care and Team-Based Mental Health Care for Improved Access in Underserved Settings. In: Hilty, D.M., Mishkind, M.C., Malik, T.S., Crawford, A. (Eds) Virtual Mental Health Care for Rural and Underserved Settings. Springer, Cham. https://doi.org/10.1007/978-3-031-11984-2_8
Didaskalou, E., Briesch, A. M., Volpe, R. J., & Roussi-Vergou, C. (2020). Psychometric properties of the classroom observation of engagement, disruptive, and disrespectful behavior (COEDD) in Greek school children. International Journal of School & Educational Psychology, 10(3), 303–315. https://doi.org/10.1080/21683603.2020.1776180
Didaskalou, E., Stavroussi, P., & Vlachou, A. (2015). Defining, identifying and assessing social and personal skills difficulties of students with special educational needs: The special education teachers’ perspectives. In E. Kourkoutas & A. Hart (Eds.), Innovative practice and interventions for children and adolescents with psychosocial difficulties and disabilities (pp. 295–325). Cambridge Scholars Publishing.
Didaskalou, E., Briesch, A. M., Volpe, R. J., & Roussi-Vergou, C. (in press). A preliminary investigation of the psychometric properties of the Integrated Teacher Rating Form (ITRF) in Greek school children. International Journal of School & Educational Psychology. https://doi.org/10.1080/21683603.2023.2252374
Didaskalou, E., Volpe, R. J., Briesch, A. M., & Roussi-Vergou, C. (2021). Integrated teacher rating form-greek version (ITRF-GR).
Dineen, J. N., Chafouleas, S. M., Briesch, A. M., McCoach, D. B., Newton, S. D., & Cintron, D. W. (2021). Exploring social, emotional, and behavioral screening approaches in U.S. public school districts. American Educational Research Journal. Online First Publication. https://doi.org/10.3102/00028312211000043
Dowdy, E., Dever, B. V., Raines, T. C., & Moffa, K. (2016). A preliminary investigation into the added value of multiple gates and informants in universal screening for behavioral and emotional risk. Journal of Applied School Psychology, 32(2), 178–198. https://doi.org/10.1080/15377903.2016.1165327
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancingstudents’ social and emotional learning: A meta-analysis of school-based interventions. Child Development, 82, 405–432.
Dvorsky, R., Girio-Herrera, E., & Owens, S. (2013). School-based screening for mental health in early childhood. In M. Weist, N. Lever, C. Bradshaw, & J. Owens (Eds.), Handbook of school mental health (pp. 297–310). Springer.
Ellis, W. E., Dumas, T. M., & Forbes, L. M. (2020). Physically isolated but socially connected: Psychological adjustment and stress among adolescents during the initial COVID-19 crisis. Canadian Journal of Behavioural Science, 52(3), 177.
Fabiano, G. A., & Evans, S. W. (2019). Introduction to the special issue of school mental health on best practices in effective multi-tiered intervention frameworks. School Mental Health, 11, 1–3. https://doi.org/10.1007/s12310-018-9283-2
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272–299.
Fazel, M. S., Hoagwood, K., Stephan, S., & Ford, T. (2014). Mental health interventions in schoolsin high-income countries. Lancet Psychiatry, 1, 377–387. https://doi.org/10.1016/S2215-0366(14)70312-8
Giannopoulou, I., Efstathiou, V., Triantafyllou, G., Korkoliakou, P., & Douzenis, A. (2021). Adding stress to the stressed: Senior high school students’ mental health amidst the COVID-19 nationwide lockdown in Greece. Psychiatry Research, 295(113), 560.
Harrison, J., Vannest, K., & Reynolds, C. (2013). Social acceptability of five screening instruments for social, emotional and behavioral challenges. Behavioral Disorders, 38(3), 171–189.
Hoagwood K.E., & Kelleher K.J. (2020). A Marshall Plan for Children’s Mental Health After COVID-19. Psychiatric Services. 2020:appi. ps.202000258.
Hoagwood, K. E., Gardner, W., Kelleher, K., & J.,. (2021). Promoting children’s mental, emotional, and behavioral (MEB) health in all public systems, post-COVID-19. Administration and Policy in Mental Health and Mental Health Services Research, 48, 379–387. https://doi.org/10.1007/s10488-021-01125-7
Julian, M. W. (2001). The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Structural Equation Modeling: A Multidisciplinary Journal, 8(3), 325–352.
Kentikelenis, A., Karanikolos, M., Papanicolas, I., Basu, S., McKee, M., & Stuckler, D. (2011). Health effects of financial crisis: Omens of a Greek tragedy. Lancet (london, England), 378(9801), 1457–1458. https://doi.org/10.1016/S0140-6736(11)61556-0
Kessler, R. C., Berglund, P., Denler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 596–768. https://jamanetwork.com/ on 12/05/2022
Kidscreen Group (2004). Translation and validation procedure. Authors. https://www.kidscreen.org/english/translation-process/
Kilgus, S. P., & Eklund, K. R. (2016). Consideration of base rates within universal screening for behavioural and emotional risk: A novel procedural framework. School Psychology Forum: Research in Practice, 10(1), 120–130.
Kilgus, S. P., Eklund, K., Nathaniel, P., Taylor, C. N., & Sims, W. A. (2016). Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedures within elementary and middle school samples. Journal of School Psychology, 58, 21–39. https://doi.org/10.1016/j.jsp.2016.07.001
Kilpatrick, K., Maras, M., Brann, K., & Kilgus, S. (2018). Universal Screening for Social, Emotional, and Behavioral Risk in Students: DESSA-mini risk stability over time and its implications for screening procedures. School Psychology Review, 47(3), 244–257. https://doi.org/10.17105/SPR-2017-0069.V47-3
Kolaitis, G., & Giannakopoulos, G. (2015). Greek financial crisis and child mental health. Lancet (london, England), 386(9991), 335. https://doi.org/10.1016/S0140-6736(15)61402-7
Koutrouba, K. (2012). A profile of the effective teacher: Greek secondary education teachers’ perceptions. European Journal of Teacher Education, 35(3), 359–374. https://doi.org/10.1080/02619768.2011.654332
Lane, K. L., Menzies, H. M., Oakes, W. P., & Kalberg, J. R. (Eds.). (2102). Systematic screening of behavior to support instruction: From preschool to high school. Guilford Press.
Magklara, K., Lazaratou, H., Barbouni, A., Poulas, K., & Farsalinos, K. (2023). The impact of COVID-19 lockdown on children’s and adolescents’ mental health in Greece. Children & Society, 37, 469–484. https://doi.org/10.1111/chso.12605
Marsh, R., & Mathur, S. (2020). Mental health in schools: An overview of multitiered systems of support. Intervention in School and Clinic, 56(2), 67–73. https://doi.org/10.1177/10534512209148
Naglieri, J. A., LeBuffe, P. A., & Shapiro, V. B. (Eds.). (2011). Devereux Student Strengths Assessment-mini. Kaplan Press.
Nikolaidis, A., Paksarian, D., Alexander, L., Derosa, J., Dunn, J., Nielson, D. M., Droney, I., Kang, M., Douka, I., Bromet, E., Milham, M. P., Stringaris, A., & Merikangas, K. R. (2021). The Coronavirus Health and Impact Survey (CRISIS) reveals reproducible correlates of pandemic-related mood states across the Atlantic. Scientific Reports, 11(1), 1–13.
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis. Sage.
Ravens-Sieberer, U., Kaman, A., Erhart, M., Devine, J., Schlack, R., & Otto, C. (2022). Impact of the COVID-19 pandemic on quality of life and mental health in children and adolescents in Germany. European Child & Adolescent Psychiatry, 31, 879–889. https://doi.org/10.1007/s00787-021-01726-5
Reinke, W. M., Herman, K. C., Petras, H., & Ialongo, N. S. (2008). Empirically derived subtypes of child academicand behavior problems: Co-occurrence and distal outcomes. Journal of Abnormal Child Psychology, 36, 759–770.
Revelle, W. (2021). How to use the psych package for mediation/moderation/regression analysis. Personal. Proj.
Robinson, J., Pan Yuen, H., Martin, C., Hughes, A., Baksheev, G. N., Dodd, S., Bapat, S., Schwass, W., McGorry, P., & Yung, A. R. (2011). Does screening high school students for psychological distress, deliberate self-harm, or suicidal ideation cause distress-and is it acceptable? An Australian-Based study. Crisis, 32(5), 254–263. https://doi.org/10.1027/0227-5910/a000087
Roussi-Vergou, C., Andreou, E., & Didaskalou, E. (2020). Greece. In G. Skrzypiec, M. Wyra, & E. Didaskalou (Eds.), A global perspective of young adolescents’ peer aggression and wellbeing: Beyond bullying (pp. 195–206). Routledge.
Tabachnick, B. & Fidell, L. (2001). Using multivariate statistics. Needham Heights: Allyn & Bacon.
Tanner, N., Eklund, K., Kilgus, S. P., & Johnson, A. H. (2018). Generalizability of universal screening measures for behavioral and emotional risk. School Psychology Review, 47(1), 3–17. https://doi.org/10.17105/SPR-2017-0044.V47-1
Vander Stoep, A., Mccauley, E., Thompson, K. A., Herting, J. R., Kuo, E. S., Stewart, D. G., Anderson, C. A., . . . Kushner, S. (2005). Universal emotional health screening at the middle school transition. Journal of Emotional and Behavioral Disorders, 13, 213–223. https://doi.org/10.1177/10634266050130040301
Vlachou, A., Didaskalou, E., & Kontofryou, M. (2015). Roles, duties and challenges of special/support teachers at secondary education: Implications for promoting inclusive practices. European Journal of Special Needs Education, 30(4), 551–564. https://doi.org/10.1080/08856257.2015.1060073
Volpe, R. J. & Fabiano, G. A. (2013). Daily behavior report cards: An evidence-based system of assessment and intervention. The Guilford Press.
Volpe, R. J., & Briesch, A. M. (2020). Integrated system teacher rating form.
Volpe, R., & Briesch, A. (2018). Establishing evidence-based behavioral screening practices in U.S. schools. School Psychology Review, 47(4), 396–402. https://doi.org/10.17105/SPR-2018-0047.V47-4
Volpe, R. J., Casale, G., Mohiyeddini, C., Grosche, M., Hennemann, T., Briesch, A. M., & Daniels, B. (2018). A universal behavioral screener linked to personalized classroom interventions: Psychometric characteristics in a large sample of German schoolchildren. Journal of School Psychology, 66, 25–40.
Volpe, R. J., Yeung, T. S., Casale, G., Krull, J., Briesch, A. M., & Henneman, T. (2021). Evaluation of a German language school-based universal screening for student social, emotional, and behavioral risk. International Journal of School & Educational Psychology, 9, 10–20.
Waite, P., Pearcey, S., Shum, A., Raw, J. A., Patalay, P., & Creswell, C. (2021). How did the mental health symptoms of children and adolescents change over early lockdown during the COVID-19 pandemic in the UK? JCPP Advances, 1(1), e12009.
Witt, J. C., Elliot, S., & Martens, B. K. (2017). Republication of “Acceptablility of behavioral interventions used in classrooms: The influence of amount of teacher time, severity of behavior problem, and type of intervention.” Behavioral Disorders, 43(1), 262–268. https://doi.org/10.1177/0198742917736794
World Health Organization. (2005). Department of mental health, substance abuse, World Health Organization. Mental Health Evidence, & Research Team. Mental health atlas 2005.
Yeung, T. S., Volpe, R. J., & Briesch, A. M. (2019). Reliability and validity of a Chinese language universal behavioral screener. International Journal of School & Educational Psychology, 8, 80–9.
Funding
This work was supported by the Onassis Foundation under grant [number 6885].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
No potential conflict of interest was reported by the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Didaskalou, E., Briesch, A.M., Volpe, R.J. et al. A Preliminary Investigation of the Factor Structure of the Greek Language Version of the Integrated Teacher Rating Form (ITRF-GR). Contemp School Psychol (2024). https://doi.org/10.1007/s40688-024-00495-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s40688-024-00495-7