Skip to main content
SpringerLink
Log in

Use of multitrait-multimethod modelling to validate actual and preferred forms of the What Is Happening In this Class? (WIHIC) questionnaire

  • Original Paper
  • Published:
Learning Environments Research Aims and scope Submit manuscript

Abstract

This article describes the validation of scores on actual and preferred forms of the What Is Happening In this Class? (WIHIC). The WIHIC is a 56-item instrument that assesses seven classroom environment dimensions: Student Cohesiveness, Teacher Support, Involvement, Investigation, Task Orientation, Cooperation and Equity. A sample of 978 secondary school students from Australia responded to actual and preferred forms of the WIHIC. Separate confirmatory factor analyses for the actual and preferred forms supported the seven-scale a priori structure of the instrument. Fit statistics indicated a good fit of the models to the data. The use of multitrait-multimethod modelling with the seven scales as traits and the two forms of the instrument as methods supported the WIHIC’s construct validity. This research has provided strong evidence of the sound psychometric properties of the WIHIC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aldridge, J. M., Dorman, J. P., & Fraser, B. J. (2004). Use of multitrait-multimethod modelling to validate actual and preferred forms of the Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI). Australian Journal of Educational and Developmental Psychology, 4, 110–125.

    Google Scholar 

  • Aldridge, J. M., Laugksch, R. C., Seopa, M. A., & Fraser, B. J. (2006). Development and validation of an instrument to monitor the implementation of outcomes-based learning environments in science classrooms in South Africa. International Journal of Science Education, 28, 45–70. doi:10.1080/09500690500239987.

    Article  Google Scholar 

  • Allen, D., & Fraser, B. J. (2007). Parent and student perceptions of classroom learning environment and its association with student outcomes. Learning Environments Research, 10, 67–82. doi:10.1007/s10984-007-9018-z.

    Article  Google Scholar 

  • Bong, M., & Hocevar, D. (2002). Measuring self-efficacy: A multitrait-multimethod comparison of scaling procedures. Applied Measurement in Education, 15, 143–171. doi:10.1207/S15324818AME1502_02.

    Article  Google Scholar 

  • Boy, A. V., & Pine, G. J. (1988). Fostering psychosocial development in the classroom. Springfield, IL: Charles C. Thomas.

    Google Scholar 

  • Browne, M. W. (1984). The decomposition of multitrait-multimethod matrices. British Journal of Mathematical and Statistical Psychology, 37, 1–21.

    Google Scholar 

  • Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications and programming. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Byrne, B. M., & Bazana, P. G. (1996). Investigating the measurement of social and academic competencies for early/late preadolescents and adolescents: A multitrait-multimethod analysis. Applied Measurement in Education, 9, 113–132. doi:10.1207/s15324818ame0902_2.

    Article  Google Scholar 

  • Byrne, B. M., & Goffin, R. D. (1993). Modeling MTMM data from additive and multiplicative covariance structures: An audit of construct validity concordance. Multivariate Behavioral Research, 28, 67–96. doi:10.1207/s15327906mbr2801_5.

    Article  Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105. doi:10.1037/h0046016.

    Article  Google Scholar 

  • Cole, D. A., Martin, J. M., Peeke, L., Henderson, A., & Harwell, J. (1998). Validation of depression and anxiety measures in white and black youths: Multitrait-multimethod analyses. Psychological Assessment, 10, 261–276. doi:10.1037/1040-3590.10.3.261.

    Article  Google Scholar 

  • Dorman, J. P. (2002). Classroom environment research: Progress and possibilities. Queensland Journal of Educational Research, 18, 112–140.

    Google Scholar 

  • Dorman, J. P. (2003). Cross national validation of the What Is Happening In this Class? (WIHIC) questionnaire using confirmatory factor analysis. Learning Environments Research, 6, 231–245. doi:10.1023/A:1027355123577.

    Article  Google Scholar 

  • Dorman, J. P., Fisher, D. L., & Waldrip, B. G. (2006). Learning environments, attitudes, efficacy and perceptions of assessment: A LISREL analysis. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments (pp. 1–28). Singapore: World Scientific.

    Google Scholar 

  • Dunkin, M. J., & Biddle, B. J. (1974). The study of teaching. New York: Holt, Rinehart & Winston.

    Google Scholar 

  • Fisher, D. L., & Khine, M. S. (Eds.). (2006). Contemporary approaches to research on learning environments. Singapore: World Scientific.

    Google Scholar 

  • Fraser, B. J. (1998). Classroom environment instruments: Development, validity, and applications. Learning Environments Research, 1, 7–33. doi:10.1023/A:1009932514731.

    Article  Google Scholar 

  • Fraser, B. J. (2007). Classroom learning environments. In S. K. Abell & N. G. Lederman (Eds.), Handbook of research on science education (pp. 103–124). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Fraser, B. J., McRobbie, C. J., & Fisher, D. L. (1996, April). Development, validation and use of personal and class forms of a new classroom environment instrument. Paper presented at the annual meeting of the American Educational Research Association, New York.

  • Gabler, C. T., & Fraser, B. J. (2007, April). Sustained, job embedded professional development and the learning environment of middle-school mathematics classrooms. Paper presented at the annual meeting of the American Educational Research Association, Chicago.

  • Goh, S. C., & Khine, M. S. (Eds.). (2002). Studies in educational learning environments: An international perspective. Singapore: World Scientific.

    Google Scholar 

  • Holmes-Smith, P., & Rowe, K.J. (1994, January). The development and use of congeneric measurement models in school effectiveness research: Improving the reliability and validity of composite and latent variables for fitting multilevel and structural equation models. Paper presented at the International Congress for School Effectiveness and Improvement, Melbourne, Australia.

  • Huang, S. L. (2006). An assessment of science teachers’ perceptions of secondary school environments in Taiwan. International Journal of Science Education, 28, 25–44. doi:10.1080/09500690500239862.

    Article  Google Scholar 

  • Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: User’s reference guide. Chicago, IL: Scientific Software International.

    Google Scholar 

  • Kelloway, E. K. (1998). Using LISREL for structural equation modeling: A researcher’s guide. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Khoo, H. S., & Fraser, B. J. (2008). Using classroom psychosocial environment in the evaluation of adult computer application courses in Singapore. Technology. Pedagogy & Education, 17, 53–67. doi:10.1080/14759390701847591.

    Article  Google Scholar 

  • Koul, R. B., & Fisher, D. L. (2006). A contemporary study of learning environments in Jammu, India. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments (pp. 273–296). Singapore: World Scientific.

    Google Scholar 

  • Kunter, M., & Baumert, J. (2006). Who is the expert? Construct and criteria validity of student and teacher ratings of instruction. Learning Environments Research, 9, 231–251. doi:10.1007/s10984-006-9015-7.

    Article  Google Scholar 

  • Marsh, H. W. (1988). Multitrait-multimethod analysis. In J. P. Keeves (Ed.), Educational research methodology, measurement, and evaluation: An international handbook (pp. 570–578). Oxford, UK: Pergamon.

    Google Scholar 

  • Marsh, H. W., & Byrne, B. M. (1993). Confirmatory factor analysis of multitrait-multimethod self-concept data: Between-group and within-group invariance constraints. Multivariate Behavioral Research, 28, 313–349. doi:10.1207/s15327906mbr2803_2.

    Article  Google Scholar 

  • Marsh, H. W., & Grayson, D. (1997). Multitrait-multimethod analysis. In J. P. Keeves (Eds.), Educational research, methodology, and measurement: An international handbook (2nd ed., pp. 600–607). Oxford, England: Pergamon.

    Google Scholar 

  • Martin-Dunlop, C., & Fraser, B. J. (2008). Learning environment and attitudes associated with an innovative science course designed for prospective elementary teachers. International Journal of Science and Mathematics Education, 6(1), 163–190. doi:10.1007/s10763-007-9070-2.

    Article  Google Scholar 

  • Moos, R. H. (1979) Evaluating educational environments: Procedures, measures, findings and policy implications. San Francisco: Jossey-Bass.

    Google Scholar 

  • Ogbuehi, P. I., & Fraser, B. J. (2007). Learning environment, attitudes and conceptual development associated with innovative strategies in middle-school mathematics. Learning Environments Research, 10, 101–114. doi:10.1007/s10984-007-9026-z.

    Article  Google Scholar 

  • Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design and analysis: An integrated approach. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Saunders, K. J., & Fisher, D. L. (2006). An action research approach with primary pre-service teachers to improve university and primary school classroom environments. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments (pp. 247–272). Singapore: World Scientific.

    Google Scholar 

  • Schumacker, R. E., & Lomax, R.G. (1996). A beginner’s guide to structural equation modeling. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Telli, S., Cakiroglu, J., & den Brok, P. (2006). Turkish secondary education students’ perceptions of their classroom learning environment and their attitude towards biology. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments (pp. 517–542). Singapore: World Scientific.

    Google Scholar 

  • von Glasersfeld, E. (1989). Cognition, construction of knowledge, and teaching. Syntheses, 80, 121–140. doi:10.1007/BF00869951.

    Article  Google Scholar 

  • Wahyudi, & Treagust, D. F. (2006). Science education in Indonesia: A classroom learning environment perspective. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments (pp. 221–246). Singapore: World Scientific.

    Google Scholar 

  • Walberg, H. J., & Anderson, G. J. (1968). Classroom climate and individual learning. Journal of Educational Psychology, 59, 414–419. doi:10.1037/h0026490.

    Article  Google Scholar 

  • Waldrip, B. G., Fisher, D. L., & Dorman, J. P. (2005, April). Students’ understanding of primary science concepts, cultural learning environments and teacher-student interactions. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.

  • Widaman, K. F. (1985). Hierarchically tested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1–26. doi:10.1177/014662168500900101.

    Article  Google Scholar 

  • Zandvliet, D. B., & Fraser, B. J. (2005). Physical and psychosocial environments associated with networked classrooms. Learning Environments Research, 8, 1–17. doi:10.1007/s10984-005-7951-2.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Education, Australian Catholic University, P.O. Box 456, Virginia, 4014, QLD, Australia

    Jeffrey P. Dorman

Authors
  1. Jeffrey P. Dorman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jeffrey P. Dorman.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dorman, J.P. Use of multitrait-multimethod modelling to validate actual and preferred forms of the What Is Happening In this Class? (WIHIC) questionnaire. Learning Environ Res 11, 179–193 (2008). https://doi.org/10.1007/s10984-008-9043-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10984-008-9043-6

Keywords

Search

Navigation