Abstract
When rating scales are used in different countries, thorough investigation of the psychometric properties is needed. We examined the internal structure of the Finnish translated Behavioral and Emotional Rating Scale-2 (BERS-2) using Rasch and confirmatory factor analysis approaches with a sample of youth, parents, and teachers. The results suggested that the Finnish translated BERS-2 has acceptable measurement properties and is suitable for use in Finnish schools. Results highlighted the issue that there is a need to consider cross-cultural aspects when introducing new measures in another culture. Directions for future research are also discussed in light of present findings.
Similar content being viewed by others
Notes
A multi-level model could be fit only if Monte Carlo integration was used to estimate the model. We decided not to estimate the teacher model this way because we had used traditional numerical integration to estimate the other models, and, therefore, we wanted to parameterize the models in a consistent manner.
References
Achenbach, T. M., Becker, A., Döpfner, M., Heiervang, E., Roessner, V., Steinhausen, H., et al. (2008). Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: Research findings, applications, and future directions. Journal of Child Psychology and Psychiatry, 49(3), 251–275.
American Educational Research Association, American Psychological Association & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573.
Benner, G., Beaudoin, K., Mooney, P., Uhing, B., & Pierce, C. (2008). Convergent validity with the BERS-2 teacher rating scale and the Achenbach Teacher’s report form: A replication and extension. Journal of Child and Family Studies, 17(3), 427–436.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.
Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., et al. (2010). Manual of the Peabody treatment progress battery (2nd ed.). Nashville, TN: Vanderbilt University.
Bond, T. G., & Fox, C. M. (2002). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Erlbaum.
Brazeau, J., Teatero, M., Rawana, E., Brownlee, K., & Blanchette, L. (2012). The strengths assessment inventory: Reliability of a new measure of psychosocial strengths for youth. Journal of Child and Family Studies, 21(3), 384–390.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: The Guildford Press.
Buckley, J. A., Ryser, G., Reid, R., & Epstein, M. H. (2006). Confirmatory factor analysis of the Behavioral and Emotional Rating Scale−2 (BERS-2) parent and youth rating scales. Journal of Child and Family Studies, 15(1), 27–37.
Chapman, J. E., Sheidow, A. J., Henggeler, S. W., Halliday-Boykins, C. A., & Cunningham, P. B. (2008). Developing a measure of therapist adherence to contingency management: An application of the many-facets Rasch model. Journal of Child and Adolescent Substance Abuse, 17(3), 47–68.
Epstein, M. H. (2004). Behavioral and Emotional Rating Scale: A strength-based approach to assessment (2nd ed.). Austin, TX: PRO-Ed.
Epstein, M. H., Atkins, M., Cullinan, D., Kutash, K., & Weaver, R. (2008). Reducing behavior problems in the elementary school classroom: A practice guide (NCEE#2008-012). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Science, U.S. Department of Education.
Epstein, M. H., Mooney, P., Ryser, G., & Pierce, C. D. (2004). Validity and reliability of the Behavioral and Emotional Rating Scale (2nd edition): Youth rating scale. Research on Social Work Practice, 14(5), 358–367.
Farmer, T. W., Farmer, E. M. Z., & Brooks, D. S. (2010). Recasting the ecological and developmental roots of intervention for students with emotional and behavior problems: The promise of strength-based perspectives. Exceptionality, 18(2), 53–57.
Finnish Ministry of Education [FMOE]. (2007). Erityisopetuksen strategia [special education strategy]. Helsinki, Finland: Reports of Ministry of Education, Finland, no 47, 2007.
Finnish National Board of Education [FNBE]. (2010). Amendments and additions to the national core curriculum for basic education, DNRO 50/011/2010. Retrieved from http://www.oph.fi/download/132551_amendments_and_additions_to_national_core_curriculum_basic_education.pdf
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491.
Galassi, J. P., & Akos, P. (2007). Strengths-based school counseling. Promoting student development and achievement. London, England: Lawrence Erlbaum.
Geisinger, K. F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304–312.
Gilman, R., Huebner, E. S., & Furlong, M. J. (Eds.). (2009). Handbook of positive psychology in schools. New York, NY: Routledge.
Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 38(5), 581–586.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.
Jaffee, S. R., Harrington, H., Cohen, P., & Moffitt, T. E. (2005). Cumulative prevalence of psychiatric disorder in youths. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 406–407.
Jimerson, S. R., Sharkey, J. D., Nyborg, V., & Furlong, M. J. (2004). Strength-based assessment and school psychology: A summary of synthesis. The California School Psychologist, 9, 9–19.
Lambert, M. C., Rowan, G. T., Kim, S., Rowan, S. A., An, J. S., Kirsch, E. A., et al. (2005). Assessment of behavioral and emotional strengths in black children: Development of the behavioral assessment for children of African heritage. Journal of Black Psychology, 31(4), 321–351.
Lappalainen, K., Savolainen, H., Kuorelahti, M., & Epstein, M. H. (2009). An international assessment of the emotional and behavioral strengths of youth. Journal of Child and Family Studies, 18(6), 746–753.
LeBuffe, P. A., Shapiro, V. B., & Naglieri, J. A. (2009). Devereux student strengths assessment. Lewisville, NC: Kaplan Press.
Lewis, T. J., Jones, S. E. L., Horner, R. H., & Sugai, G. (2010). School-wide positive behavior support and students with emotional/behavioral disorders: Implications for prevention, identification and intervention. Exceptionality, 18(2), 82–93.
Liau, A. K., Chow, D., Tan, T. K., & Senf, K. (2011). Development and validation of the personal strengths inventory using exploratory and confirmatory factor analyses. Journal of Psychoeducational Assessment, 29(1), 14–26.
Linacre, J. M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 9, 85–106.
Linacre, J. M. (2012). WINSTEPS®, Rasch measurement computer program. Beaverton, OR: Winsteps.com.
Marsh, H. W., & Hau, K. (2004). Explaining paradoxical relations between academic self-concepts and achievements: Cross-cultural generalizability of the internal/external frame of reference predictions across 26 countries. Journal of Educational Psychology, 96, 56–67.
Merikangas, K. R., He, J., Brody, D., Fisher, P. W., Bourdon, K., & Koretz, D. S. (2010). Prevalence and treatment of mental disorders among U.S. children in the 2001–2004 NHANES. Pediatrics, 125(1), 75–81.
Merikangas, K. R., He, J. P., Burstein, M., Swendsen, J., Avenevoli, S., Case, B., et al. (2011). Service utilization for lifetime mental disorders in U.S. adolescents: Results of the National Comorbidity Survey-Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 50(1), 32–45.
Merrell, K. W. (2008). Social and Emotional Assets and Resiliency Scales (SEARS). Eugene: University of Oregon, School Psychology Program. Retrieved from http://strongkids.uoregon.edu/SEARS.html.
Möller, J., Pohlmann, B., Köller, O., & Marhs, H. W. (2009). A meta-analytic path analysis of the internal/external frame of reference model of academic achievement and academic self-concept. Review of Educational Reseach, 79(3), 1129–1167.
Mooney, P., Epstein, M. H., Ryser, G., & Pierce, C. D. (2005). Reliability and validity of the Behavioral and Emotional Rating Scale, 2nd edition: Parent rating scale. Children and Schools, 27(3), 147–155.
Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. Sociological Methodology, 25, 267–316.
Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus User’s guide, sixth edition. Los Angeles, CA: Muthén & Muthén.
National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. In M. E. O’Connell, T. Boat, & K. E. Warner (Eds.), Board on children, youth, and families, division of behavioral and social sciences and education. Washington, DC: National Academies Press.
Obel, C., Heiervang, E., Rodriguez, A., Heyerdahl, S., Smedje, H., Sourander, A., et al. (2004). The strengths and difficulties questionnaire in the Nordic countries. European Child & Adolescent Psychiatry, 13(Suppl 2), ii32–ii39.
OECD. (2009). PISA 2009 results: What students know and can do. Student performance in reading, mathematics and science. Retrieved from www.oecd.org/edu/pisa/2009
Official Statistics Finland. (2011a). Special education. Retrieved from http://www.stat.fi/til/erop/2010/erop_2010_2011-06-09_tie_001_en.html
Official Statistics Finland. (2011b). Religious affiliation of the population 2003–2010. Retrieved from http://www.stat.fi/til/vaerak/2010/01/vaerak_2010_01_2011-09-30_tau_008_en.html
Official Statistics Finland. (2012). Population. Retrieved from http://www.stat.fi/tup/suoluk/suoluk_vaesto_en.html
Park, N., & Peterson, C. (2006). Moral competence and character strengths among adolescents: The development and validation of the values in action inventory of strengths for youth. Journal of Adolescence, 29(6), 891–909.
Rasch, G. (1960). Probabilistic models for some intelligence and achievement tests. Copenhagen, Denmark: Danish Institute for Educational Research.
Rashid, T., & Ostermann, R. F. (2009). Strength-based assessment in clinical practice. Journal of Clinical Psychology, 65(5), 488–498.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
Rawana, E., & Brownlee, K. (2009). Making the possible probable: A strength-based assessment and intervention framework for clinical work with parents, children, and adolescents. Families in Society, 90(3), 255–260.
Rhee, S., Furlong, M. J., Turner, J. A., & Harari, I. (2001). Integrating strength-based perspective in psychoeducational evaluations. The California School Psychologist, 6, 5–17.
Riemer, M., & Kearns, M. A. (2010). Description and psychometric evaluation of the youth counseling impact scale. Psychological Assessment, 22(2), 259–268.
Rothenberger, A., & Woerner, W. (2004). Editorial: Strengths and difficulties questionnaire (SDQ)—Evaluations and applications. European Child & Adolescent Psychiatry, 13(Suppl 2), ii1–ii2.
Saleebey, D. (Ed.). (2009). The strengths perspective in social work practice (5th ed.). Boston, MA: Allyn & Bacon.
Savolainen, H., Nordness, P., Sointu, E. T., Lappalainen, K., & Epstein, M. H. (in press). Convergent validity of the Finnish Behavioral and Emotional Rating Scale-2 with teachers and parents as raters. Journal of International Special Needs Education.
Scales, P. C., Benson, P. L., Leffert, N., & Blyth, D. A. (2000). Contribution of developmental assets to the prediction of thriving among adolescents. Applied Developmental Science, 4(1), 27–46.
Snyder, C. R., Ritschel, L. A., Rand, K. L., & Berg, C. J. (2006). Balancing psychological assessments: Including strengths and hope in client reports. Journal of Clinical Psychology, 62(1), 33–46.
Sointu, E. T., Savolainen, H., Lappalainen, K., & Epstein, M. H. (2012a). Cross informant agreement of behavioral and emotional strengths between Finnish students and teachers. Scandinavian Journal of Educational Research, 56(6), 625–636.
Sointu, E. T., Savolainen, H., Lappalainen, K., & Epstein, M. H. (2012b). Parent, teacher and student cross informant agreement of behavioral and emotional strengths: Students with and without special education support. Journal of Child and Family Studies, 21(4), 682–690.
Steiger, J. H., & Lind, J. C. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society. IA: Iowa City.
Tucker, L., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10.
U.S. Department of Education. (2010). 32 nd Annual Report to Congress on the Implementation of the Individuals with Disabilities Education Act. Washington, DC: Author.
U.S. Department of Health and Human Services. (1999). Mental health: A report of the Surgeon General. Rockville, MD: U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health.
Watkins, A. (Ed.). (2007). Assessment in inclusive settings: Key issues for policy and practice. Odense, Denmark: European Agency for Development in Special Needs Education.
Acknowledgments
The research reported herein was supported, in part, by the Finnish National Board of Education; by a grant from Finnish Cultural Foundation; and by the Institute of Education Sciences, U.S. Department of Education, through Grant R324B110001 to the University of Nebraska-Lincoln. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.
Author information
Authors and Affiliations
Corresponding author
Additional information
Erkko T. Sointu. Philosophical Faculty, School of Educational Sciences and Psychology, Special Education, University of Eastern Finland, P.O. Box 111, 80101 Joensuu, Finland. E-mail: erkko.sointu@uef.fi
Current themes of research:
Student strengths. Strength-based assessment. Positive youth development. Prevention of emotional and behavioral problems.
Most relevant publications in the field of Psychology of Education:
Sointu, E. T., Savolainen, H., Lappalainen, K., & Epstein, M. H. (2012a). Cross informant agreement of behavioral and emotional strengths between Finnish students and teachers. Scandinavian Journal of Educational Research, 56(6), 625–636.
Sointu, E., T., Savolainen, H., Lappalainen, K., & Epstein, M. H. (2012b). Parent, teacher and student cross informant agreement of behavioral and emotional strengths: Students with and without special education support. Journal of Child and Family Studies, 21(4), 682–690.
Hannu Savolainen. Philosophical Faculty, School of Educational Sciences and Psychology, Special Education, University of Eastern Finland, P.O. Box 111, 80101 Joensuu, Finland. E-mail: hannu.savolainen@uef.fi
Current themes of research:
Prevention of behavioral and emotional problems. School-wide Positive Behavior Support. International comparative research on inclusive education. Long-Term Consequences of learning difficulties.
Most relevant publications in the field of Psychology of Education:
Savolainen, H., Engelbrecht, P., Nel, M., & Malinen, O-P. (2012). Understanding teachers’ attitudes and self-efficacy in inclusive education: implications for pre-service and in-service teacher education. European Journal of Special Needs Education, 27 (1), 51–68.
Hakkarainen, A., Holopainen, L., Savolainen, H. (2012). Mathematical and Reading Difficulties as Predictors of School Achievement and Transition to Secondary Education, Scandinavian Journal of Educational Research, doi:10.1080/00313831.2012.696207
Malinen, O., Savolainen, H. & Xu J. (2012). Beijing In-Service Teachers’ Self-Efficacy and Attitudes towards Inclusive Education, Teaching and Teacher Education, doi:10.1016/j.tate.2011.12.004.
Kiuru, N., Haverinen, K., Salmela-Aro, K., Nurmi, J-E., Savolainen, H. & Holopainen, L. (2011). Students with reading and spelling disabilities: Peer groups and educational attainment in secondary education. Journal of Learning Disabilities, 44 (6), 556–569.
Matthew C. Lambert. Center for Child and Family Well-Being, University of Nebraska-Lincoln, 211 Barkley Center, Lincoln, NE 68583–0732, USA. E-mail: matthew.lambert@unl.edu
Current themes of research :
Psychometrics. Rasch Modeling. Confirmatory Factor Analysis. Strength-Based Assessment. Child Welfare.
Most relevant publications in the field of Psychology of Education:
Hoffman, S., Lambert, M. C., Nelson, T., Trout, A., et al. (in press). Confirmatory factor analysis of the PedsQL for youth in residential care settings. Quality of Life Research. doi:10.1007/s11136-012-0327-z
Duppong Hurley, K., Lambert, M. C., Van Ryzin, M., Sullivan, J., & Stevens, A. (2013). Therapeutic alliance between youth and staff in residential group care: Psychometrics of the therapeutic alliance quality scale. Children and Youth Services Review, 35 (1), 56–64.
Lambert, M. C., Burley, H., & Rudd, L.C. (2012). The Jumpstart model: The contours of a new force in early literacy. The Educational Forum, 76 (2), 234–247.
Rudd, L.C., Lambert, M. C., Satterwhite, M., & Smith, C. (2009). Professional development + coaching = enhanced teaching: Increasing usage of math mediated language in preschool classrooms. Early Childhood Education Journal, 37 (1), 63–69.
Rudd, L.C., Lambert, M. C., Satterwhite, M., & Zaier, A. (2008). Mathematical language in early childhood settings: What really counts? Early Childhood Education Journal, 36 (1), 75–80.
Kristiina Lappalainen. Philosophical Faculty, School of Educational Sciences and Psychology, Special Education, University of Eastern Finland, P.O. Box 111, 80101 Joensuu, Finland. E-mail: kristiina.lappalainen@uef.fi@uef.fi
Current themes of research:
Socio-emotional behavior. Self-concept. Strength-based assessment. School-wide positive behavior support. Special education.
Most relevant publications in the field of Psychology of Education:
Lappalainen, K. & Hotulainen, R. (2012) Participation in Part-time Special Education and its Correlation with Educational Paths and Self-concept of Young Adults. British Journal of Special Education 39(4), 185–193.
Holopainen, L., Lappalainen, K., Junttila, N., & Savolainen, H. (2012). The Role of Social Competence in the Psychological Well-being of Adolescents in Secondary Education Scandinavian Journal of Educational Research 56(2), 199–212.
Hotulainen, R. & Lappalainen, K. (2011). Pre-School Socio-Emotional Behaviour and its Correlation to Self-Perceptions and Strengths of Young Adults. Emotional and Behavioural Difficulties 16(4), 365–381.
Hotulainen, R., Lappalainen, K., Ruoho, K., & Savolainen, H. (2010). Pre-school Verbo-sensory Motor Status as a Predictor of Educational Life-courses and Self-perceptions of Young Adults International Journal of Disability, Development and Education 57(3), 299–314.
Lappalainen, K., Savolainen, H., Kuorelahti, M. & Epstein, M.H. (2009). An International Assessment of the Emotional and Behavioral Strengths of Youth. Journal of Child and Family Studies 18(6), 746–753.
Michael H. Epstein. Center for Child and Family Well-Being, University of Nebraska-Lincoln, 202 F Barkley Center, Lincoln, NE 68583–0732, USA. E-mail: mepstein1@unl.edu
Current themes of research:
Strength-based assessment. Evidence based practices. Home school relationships
Most relevant publications in the field of Psychology of Education:
Epstein, M.H. (2004). Behavioral and Emotional Rating Scale. Austin, TX: PRO-ED.
Rights and permissions
About this article
Cite this article
Sointu, E.T., Savolainen, H., Lambert, M.C. et al. Behavioral and emotional strength-based assessment of Finnish elementary students: psychometrics of the BERS-2. Eur J Psychol Educ 29, 1–19 (2014). https://doi.org/10.1007/s10212-013-0184-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10212-013-0184-3