Abstract
Students’ perceptions of the learning environment play an important role in their academic achievement and social lives. While most measures of school environment have been developed for middle- and high-school students, they also have been used for younger students, such as 4th and 5th graders. What is unclear is whether these measures are actually valid enough for younger student populations. We investigated whether the measurement invariance of one such measure, the popular 5Essentials of School Culture and Climate Survey, holds for younger learners and middle-school students. Results showed that not all measurement invariances hold across younger (4th and 5th grade) and older learners (7th grade). Moreover, half of the survey questions show differential item functioning (DIF). Findings from this study suggest that younger and older students could perceive school learning environments differently. Accordingly, cautions should be exercised when comparing younger and older students’ perceptions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, C. S. (1982). The search for school climate: A review of the research. Review of Educational Research, 52(3), 368–420.
Bear, G. G., Gaskins, C., Blank, J., & Chen, F. F. (2011). Delaware School Climate Survey—Student: Its factor structure, concurrent validity, and reliability. Journal of School Psychology, 49(2), 157–174. https://doi.org/10.1016/j.jsp.2011.01.001.
Bear, G. G., Yang, C., Pell, M., & Gaskins, C. (2014). Validation of a brief measure of teachers’ perceptions of school climate: Relations to student achievement and suspensions. Learning Environments Research, 17(3), 339–354. https://doi.org/10.1007/s10984-014-9162-1.
Bradshaw, C. P., Waasdorp, T. E., Debnam, K. J., & Johnson, S. L. (2014). Measuring school climate in high schools: A focus on safety, engagement, and the environment. Journal of School Health, 84(9), 593–604.
Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.
Bryk, A. S., Sebring, P. B., Allensworth, E., Easton, J. Q., & Luppescu, S. (2010). Organizing schools for improvement: Lessons from Chicago. Chicago: University of Chicago Press.
Bryk, A. S., Sebring, P. B., Allensworth, E., Luppescu, S., & Easton, J. Q. (2009). Survey measures, factors, composite variables, and items used in organizing schools for improvement: Lessons from Chicago. Chicago: University of Chicago Press.
Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO for windows [Computer software]. Lincolnwood, IL: Scientific Software International.
Canivez, G. L. (2016). Bifactor modeling in construct validation of multifactored tests: Implications for understanding multidimensional constructs and test interpretation. In K. Schweizer & C. DiStefano (Eds.), Principles and methods of test construction: Standards and recent advancements (Vol. 3, pp. 247–271). Boston, MA: Hogrefe Publishing.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504.
Cohen, J., Mccabe, L., Michelli, N. M., & Pickeral, T. (2009). School climate: research, policy, practice, and teacher education. Teachers College Record, 111(1), 180–213.
Furlong, M. J., Greif, J. L., Bates, M. P., Whipple, A. D., Jimenez, T. C., & Morrison, R. (2005). Development of the California school climate and safety survey—Short form. Psychology in the Schools, 42(2), 137–149. https://doi.org/10.1002/pits.20053.
Gignac, G. E. (2006). The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences, 27(2), 73–86.
Hoy, W. K., & Miskel, C. G. (2013). Educational administration: Theory, research, and practice (9th ed.). New York: McGraw-Hill.
Hoy, W. K., Tarter, C. J., & Hoy, A. W. (2006). Academic optimism of schools: A force for student achievement. American Educational Research Journal, 43(3), 425–446.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
Johnson, B., Stevens, J. J., & Zvoch, K. (2007). Teachers’ perceptions of school climate: A validity study of scores from the Revised School Level Environment Questionnaire. Educational and Psychological Measurement, 67(5), 833–844. https://doi.org/10.1177/0013164406299102.
Klugman, J., Gordon, M. F., Sebring, P. B., & Sporte, S. E. (2015). A first look at the 5Essentials in Illinois Schools (Research report). Chicago: University of Chicago Consortium on Chicago School Research.
Lee, E., Reynolds, K. J., Subasic, E., Bromhead, D., Lin, H., Marinov, V., et al. (2017). Development of a dual school climate and school identification measure–student (SCASIM-St). Contemporary Educational Psychology, 49, 91–106. https://doi.org/10.1016/j.cedpsych.2017.01.003.
Muthén, L. K., & Muthén, B. O. (1998–2017). Mplus user’s guide (8th ed.). Los Angeles, CA: Muthén & Muthén.
Phillips, S. F., & Rowley, J. F. S. (2016). The tripod school climate index: An invariant measure of school safety and relationships. Social Work Research, 40(1), 31–39.
Ramelow, D., Currie, D., & Felder-Puig, R. (2015). The assessment of school climate: Review and appraisal of published student-report measures. Journal of Psychoeducational Assessment, 33(8), 731–743. https://doi.org/10.1177/0734282915584852.
Thapa, A., Cohen, J., Guffey, S., & Higgins-D’Alessandro, A. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. https://doi.org/10.3102/0034654313483907.
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70.
Wang, M.-T., & Degol, J. L. (2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315–352. https://doi.org/10.1007/s10648-015-9319-1.
Yang, C., Bear, G. G., Chen, F. F., Zhang, W., Blank, J. C., & Huang, X. (2013). Students’ perceptions of school climate in the U.S. and China. School Psychology Quarterly, 28(1), 7–24.
Ziv, M., & Frye, D. (2004). Children’s understanding of teaching: The role of knowledge and belief. Cognitive Development, 19(4), 457–477.
Ziv, M., Solomon, A., & Frye, D. (2008). Young children’s recognition of the intentionality of teaching. Child Development, 79(5), 1237–1256.
Zullig, K. J., Collins, R., Ghani, N., Hunter, A. A., Patton, J. M., Huebner, E. S., et al. (2015). Preliminary development of a revised version of the school climate measure. Psychological Assessment, 27(3), 1072–1081.
Zullig, K. J., Koopman, T. M., Patton, J. M., & Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(2), 139–152.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Gilman, L.J., Zhang, B. & Jones, C.J. Measuring perceptions of school learning environments for younger learners. Learning Environ Res 24, 169–181 (2021). https://doi.org/10.1007/s10984-020-09333-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10984-020-09333-y