Abstract
In an attempt to engage more students in Science, Technology, Engineering and Mathematics (STEM) subjects, schools are encouraged by STEM educators and professionals to introduce students to STEM through projects which integrate skills from each of the STEM disciplines. Because little is known about the learning environment of STEM classrooms, we developed and validated a Classroom Emotional Climate (CEC) questionnaire. Initially, the questionnaire was pilot tested with six focus groups of students from three schools to obtain feedback to incorporate into a revision of the CEC. Next, the modified CEC questionnaire was administered to 698 students participating in STEM activities in 57 classes in 20 schools. Exploratory factor analysis (principal component analysis) led to reduction of the CEC to 41 items in seven dimensions: Consolidation, Collaboration, Control, Motivation, Care, Challenge and Clarity. The structure of the CEC was then further explored using confirmatory factor analysis. Internal consistency reliability, concurrent validity (ability to differentiate between classrooms), discriminant validity (scale intercorrelations) and predictive validity (associated with student attitudes) were satisfactory. Finally, Rasch analysis of data for each dimension revealed good model fit and unidimensionality of the items describing each latent variable.
Similar content being viewed by others
References
Aldridge, J. M., & Fraser, B. J. (2008). Outcomes-focused learning environments: Determinants and effects. Rotterdam: Sense Publishers.
Aldridge, J. M., Fraser, B. J., Bell, L., & Dorman, J. P. (2012). Using a new learning environment questionnaire for reflection in teacher action research. Journal of Science Teacher Education, 23, 259–290.
Alhija, F. A. N. (2010). Factor analysis: An overview and some contemporary advances. In P. L. Peterson, E. Baker, & B. McGaw (Eds.), International encyclopedia of education (3rd ed., pp. 162–170). London: Elsevier.
Allen, J., Gregory, A., Mikami, A., Lun, J., Hamre, B. K., & Pianta, R. C. (2013). Observations of effective teacher–student interactions in secondary school classrooms: Predicting student achievement with the classroom assessment scoring system–secondary. School Psychology Review, 42(1), 76–98.
Bartlett, M. S. (1950). Tests of significance in factor analysis. British Journal of Psychology, 3, 77–85.
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Erlbaum.
Boone, W. J., Staver, J. R., & Yale, M. S. (Eds.). (2014). Rasch analysis in the human sciences. Dordrecht: Springer.
Brown, T. A. (2014). Confirmatory factor analysis for applied research (2nd ed.). New York: Guilford.
Byrne, B. (1998). Structural equation modeling with LISREL, PRELIS and SIMPLIS: Basic concepts, application and programming. Mahwah, NJ: Erlbaum.
Byrne, B. M. (2002). Structural equation modeling with EQS. London: Taylor & Francis.
Cerny, C. A., & Kaiser, H. F. (1977). A study of a measure of sampling adequacy for factor-analytic correlation matrices. Mutlivariate Behavioral Research, 12(1), 43–47.
Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). London: Routledge.
Daniels, D. H., & Shumow, L. (2003). Child development and classroom teaching: A review of the literature and implications for educating teachers. Jounal of Applied Developmental Psychology, 23, 495–526.
Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Buttner, G. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1–9. https://doi.org/10.1016/j.learninstruc.2013.07.001.
Ferguson, R. F. (2010). Student perceptions and the MET Project. Bill & Melinda Gates Foundation. Retrieved from https://k12education.gatesfoundation.org/resource/met-project-student-perceptions on 4 April 2020.
Ferguson, R. F. (2012). Can student surveys measure teaching quality? Phi Delta Kappan, 94(3), 24–28.
Ferguson, R. F., & Danielson, C. (2014). How framework for teaching and Tripod 7Cs evidence distinguish key components of effective teaching. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems (pp. 98–143). San Francisco: Jossey-Bass.
Fraser, B. J. (1981). Test of Science Related Attitudes (TOSRA). Melbourne: Australian Council for Educational Research.
Fraser, B. J. (1984). Differences between preferred and actual classroom environment as perceived by primary students and teachers. British Journal of Educational Psychology, 54(3), 336–339.
Fraser, B. J. (1988). Classroom environment instrument: Development, validity and applications. Learning Environments Research, 1(1), 7–33.
Fraser, B. J. (2012). Classroom learning environments: Retrospect, context and prospect. In B. J. Fraser, K. G. Tobin, & C. J. McRobbie (Eds.), Second international handbook of science education (Vol. 2, pp. 1191–1239). New York: Springer.
Fraser, B. J. (2014). Classroom learning environments: Historical and contemporary perspectives. In N. G. Lederman & S. K. Abell (Eds.), Handbook of research on science education (Vol. II, pp. 104–117). New York: Routledge.
Fraser, B. J. (2019). Milestones in the evolution of the learning environments field over the past three decades. In D. B. Zandvliet & B. J. Fraser (Eds.), Thirty years of learning environments (pp. 1–19). Leiden: Brill | Sense.
Fraser, B. J., & Aldridge, J. M. (2017). Improving classrooms through assessment of learning environments. In J. P. Bakken (Ed.), Classrooms: Assessment practices for teachers and student improvement strategies (Vol. 1, pp. 91–107). New York: Nova.
Fraser, B. J., & Fisher, D. L. (1982). Predicting students’ outcomes from their perceptions of classroom psychosocial environment. American Educational Research Journal, 19, 498–518.
Fraser, B. J., & Fisher, D. L. (1983a). Development and validation of short forms of some instruments measuring student perceptions of actual and preferred classroom learning environment. Science Education, 67(1), 115–131.
Fraser, B. J., & Fisher, D. L. (1983b). Student achievement as a function of person–environment fit: A regression surface analysis. British Journal of Educational Psychology, 53, 89–99.
Fraser, B. J., Giddings, G. J., & McRobbie, C. J. (1995). Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environments. Journal of Research in Science Teaching, 32, 399–422.
Fraser, B. J., & Kahle, J. B. (2007). Classroom, home and peer environment influences on student outcomes in science and mathematics: An analysis of systemic reform data. International Journal of Science Education, 29, 189–1909.
Hair, J. F., Jr., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice-Hall.
Hamre, B. K., & Pianta, R. C. (2007). Learning opportunities in preschool and early elementary classrooms. In R. C. Pianta, M. J. Cox, & K. L. Snow (Eds.), School readiness and the transition to kindergarten in the era of accountability (pp. 49–83). Baltimore, MD: Brookes.
Honey, M., Pearson, G., & Schweingruber, H. (Eds.). (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. Washington, DC: The National Academies Press.
Johnson, C. C., Mohr-Schroeder, M. J., Moore, T. J., & English, L. (Eds.). (2020). Handbook of research on STEM education. London: Routledge.
Jöreskog, K. G., & Sörbom, D. (2018). LISREL10: User’s reference guide. Chicago: Scientific Software Inc.
Khine, M. S. (Ed.). (2015). Attitude measurements in science education: Classic and contemporary approaches. Charlotte, NC: Information Age Publishing.
Kind, P., Jones, K., & Barmby, P. (2007). Developing attitudes towards science measures. International Journal of Science Education, 29(7), 871–893. https://doi.org/10.1080/09500690600909091.
Koch, A., Polnick, B., & Irby, B. (Eds.). (2014). Girls and women in STEM: A never ending story. Charlotte, NC: Information Age Publishing.
Kuhfeld, M. (2017). When students grade their teachers: A validity analysis of the Tripod student survey. Educational Assessment, 22(4), 1–22. https://doi.org/10.1080/10627197.2017.1381555.
Lee, S. S. U., Fraser, B. J., & Fisher, D. L. (2003). Teacher–student interactions in Korean high school science classrooms. International Journal of Science and Mathemataics Education, 1(1), 67–85.
Lightburn, M. E., & Fraser, B. J. (2007). Classroom environment and student outcomes among students using anthropometry activities in high school science. Research in Science and Technological Education, 25, 153–166.
Linacre, J. M. (1997). KR-20 or Rasch reliability: Which tells the “truth”? Rasch Measurement Transactions, 11(3), 580–581.
Linacre, J. M. (2002). What do infit, outfit, mean-square, and standardized mean? Rasch Measurement Transactions, 16(2), 878.
Linacre, J. M. (2007). A user’s guide to WINSTEPS: Rasch-model computer program. Chicago: MESA.
Linacre, J. M. (2019). Winsteps (Version 4.4.7). Chicago: Winsteps.com.
Loof, H., Struyf, A., Pauw, J., & Petegem, P. (2019). Teachers’ motivating style and students’ motivation and engagement in STEM: The relationship between three key educational concepts. Research in Science Education. https://doi.org/10.1007/s11165-019-9830-3.
Means, B., Wang, H., Young, V., Peters, V. L., & Lynch, S. J. (2016). STEM-focused high schools as a strategy for enhancing readiness for postsecondary STEM programs. Journal of Research in Science Teaching, 53(5), 709–736.
Moos, R. H., & Trickett, E. J. (1974). Classroom Environment Scale manual. Palo Alto, CA: Consulting Psychologists Press.
Moote, J. K. (2019). Investigating the impact of classroom climate on UK school students taking part in a science inquiry-based learning programme–CREST. Research Papers in Education. https://doi.org/10.1080/02671522.2019.1568533.
Moote, J. K., Williams, J. M., & Sproule, J. (2013). When students take control: Investigating the impact of the CREST inquiry-based learning program on self-regulated processes and related motivations in young science students. Journal of Cognitive Education and Psychology, 12(2), 178–196.
Mullis, I. V. S., Martin, M. O., Foy, P., & Hooper, M. (2016). TIMSS 2015 international results in mathematics. Retrieved March 20, 2020, from Boston College, TIMSS & PIRLS International Study Center website: http://timssandpirls.bc.edu/timss2015/internationalresults/.
Nadelson, L. S., & Seifert, A. L. (2017). Integrated STEM defined: Contexts, challenges, and the future. The Journal of Educational Research, 110(3), 221–223. https://doi.org/10.1080/00220671.2017.1289775.
OECD (Organisation for Economic Co-operation and Development). (2016). PISA 2015 results (Volume I): Excellence and equity in education. Paris: OECD Publishing.
Office of Chief Scientist. (2016). Australia’s STEM workforce. Canberra: Australian Government.
Parker, L. H., Rennie, L. J., & Fraser, B. J. (Eds.). (1996). Gender, science and mathemataics: Shortening the shadow. London: Falmer Press.
Pekrun, R., & Linnenbrink-Garcia, L. (Eds.). (2014). International handbook of emotions in education. New York: Routledge.
Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119. https://doi.org/10.3102/0013189X09332374.
Pianta, R. C., La Paro, K. M., & Hamre, B. K. (2008). Classroom Assessment Scoring SystemTM: Manual K-3. Baltimore, MD: Brookes.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago.
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104(3), 700–712. https://doi.org/10.1037/a0027268.
Rowley, J. F. S., Phillips, S. F., & Ferguson, R. F. (2019). The stability of student ratings of teacher instructional practice: Examining the one-year stability of the 7Cs composite. School Effectiveness and School Improvement, 30(4), 549–562. https://doi.org/10.1080/09243453.2019.1620293.
Sinatra, G. M., Mukhopadhyay, A., & Allbright, T. N. (2017). Speedometry: A vehicle for promoting interest and engagement through integrated STEM instruction. The Journal of Educational Research, 110(3), 308–316. https://doi.org/10.1080/00220671.2016.1273178.
Smith, E. V. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3, 205–231.
Spearman, J., & Watt, H. G. M. (2013). Perception shapes experience: The influence of actual and perceived classroom environment dimensions on girls’ motivations for science. Learning Environments Research, 16(2), 217–238. https://doi.org/10.1007/s10984-013-9129-7.
Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). New York: Routledge.
Taylor, P. C., Fraser, B. J., & Fisher, D. L. (1997). Monitoring constructivist classroom learning environments. International Journal of Educational Research, 27, 293–302.
Thibaut, L., Ceuppens, S., De Loof, H., De Meester, J., Goovaerts, L., Struyf, A., et al. (2018). Integrated STEM education: A systematic review of instructional practices in secondary education. European Journal of STEM Education. https://doi.org/10.20897/ejsteme/85525.
Urdan, T., & Schoenfelder, E. (2006). Classroom effects on student motivation: Goal structures, social relationships, and competence beliefs. Journal of School Psychology, 44, 331–349.
Wagner, D., Gollner, R., Helmke, A., Trautwein, U., & Ludtke, O. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1–11. https://doi.org/10.1016/j.learninstruc.2013.03.003.
Walberg, H. J., & Anderson, G. J. (1968). Classroom climate and individual learning. Journal of Educational Psychology, 59, 414–419.
Wallace, T. L. B., Kelcey, B., & Ruzek, E. (2016). What can student perception surveys tell us about teaching? Empirically testing the underlying structure of the tripod student perception survey. American Educational Research Journal, 53(6), 1834–1868. https://doi.org/10.3102/0002831216671864.
Wolfe, E. W., & Smith, E. V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part II—Validation activities. Journal of Applied Measurement, 8, 204–234.
Wright, B. D. (1999). Fundamental measurement for psychology. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know (pp. 65–104). Mahwah, NJ: Erlbaum.
Wright, B. D., & Masters, G. N. (2002). Number of person or item strata. Rasch Measurement Transactions, 16, 888.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Fraser, B.J., McLure, F.I. & Koul, R.B. Assessing Classroom Emotional Climate in STEM classrooms: developing and validating a questionnaire. Learning Environ Res 24, 1–21 (2021). https://doi.org/10.1007/s10984-020-09316-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10984-020-09316-z