Advertisement

USING RASCH MEASUREMENT TO VALIDATE THE INSTRUMENT OF STUDENTS’ UNDERSTANDING OF MODELS IN SCIENCE (SUMS)

  • Silin WeiEmail author
  • Xiufeng Liu
  • Yuane Jia
Article

Abstract

Scientific models and modeling play an important role in science, and students’ understanding of scientific models is essential for their understanding of scientific concepts. The measurement instrument of Students’ Understanding of Models in Science (SUMS), developed by Treagust, Chittleborough & Mamiala (International Journal of Science Education, 24(4):357–368, 2002), has commonly been used to measure SUMS. SUMS was developed using the Classical Test Theory (CTT). Considering the limitations of CTT, in this study we applied a Rasch model to validate SUMS further. SUMS was given to 629 students in 18 classes of grades 9 and 10 from six high schools in China. The results present both additional evidence for the validity and reliability of SUMS and specific aspects for further improvement. This approach of validation of a published instrument by Rasch measurement can be applied to other measurement instruments developed using CTT.

Key words

high school item response theory rasch measurement scientific model and modeling students’ understanding of models in science 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Acher, A., Arca, M. & Sanmarti, N. (2007). Modeling as a teaching learning process for understanding materials: A case study in primary education. Science Education, 91(3), 398–418.CrossRefGoogle Scholar
  2. Adams, R. J., Wilson, M. & Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1–23.CrossRefGoogle Scholar
  3. Bond, T. G. & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human science(2nd). Mahwah: Lawrence Erlbaum Associates.Google Scholar
  4. Chittleborough, G. D., Treagust, D. F., Mamial, T. L. & Mocerino, M. (2005). Students’ perceptions of the role of models in the process of science and in the process of learning. Research in Science & Technological Education, 23(2), 195–212.CrossRefGoogle Scholar
  5. Clement, J. (2000). Model based learning as a key research area for science education. International Journal of Science Education, 22(9), 1041–1053.CrossRefGoogle Scholar
  6. Coll, R., France, B. & Taylor, I. (2005). The role of models/and analogies in science education: Implications from research. International Journal of Science Education, 27(2), 183–198.CrossRefGoogle Scholar
  7. Coll, R. K.,& Lajium, D. (2011). Modeling and the future of science learning. In Khine, M. S. & Saleh, I. M. (Eds.). Models and modeling: Cognitive tools for scientific enquiry. Springer, Berlin (pp. 3–22)Google Scholar
  8. Danusso, L., Testa, I. & Vicentini, M. (2010). Improving prospective teachers’ knowledge about scientific models and modelling: Design and evaluation of a teacher education intervention. International Journal of Science Education, 32(7), 871–905.CrossRefGoogle Scholar
  9. Everett, S., Otto, C. & Luera, G. R. (2009). Preservice elementary teachers’ growth in knowledge of models in a science capstone course. International Journal of Science & Mathematics Education, 7(6), 1201–1225.CrossRefGoogle Scholar
  10. Gilbert, J. K. & Boulter, C. J. (2000). Positioning models in science education and in design and technology education. In J. K. Gilbert & C. J. Boulter (Eds.), Developing models in science education (pp. 3–17). Dordrecht: Kluwer Academic Publishers.CrossRefGoogle Scholar
  11. Gilbert, J. K. & Boutler, C. (1998). Learning science through models and modeling. In B. Fraser & K. Tobin (Eds.), International handbook of science education (pp. 53–66). Dordrecht: Kluwer Academic Publishers.CrossRefGoogle Scholar
  12. Gobert, J. D. & Buckley, B. C. (2000). Introduction to model-based teaching and learning in science education. International Journal of Science Education, 22(9), 891–894.CrossRefGoogle Scholar
  13. Gobert, J. D., O’Dwyer, L., Horwitz, P., Buckley, B., Levy, S. & Wilensky, U. (2011). Examining the relationship between students’ understanding of the nature of models and conceptual learning in Biology, Physics, and Chemistry. International Journal of Science Education, 33(5), 653–684.CrossRefGoogle Scholar
  14. Greca, I. M. & Moreira, M. A. (2000). Mental models, conceptual models, and modelling. International Journal of Science Education, 22(1), 1–11.CrossRefGoogle Scholar
  15. Grosslight, L. C., Unger, C., Jay, E. & Smith, C. L. (1991). Understanding models and their use in science: Conceptions of middle and high school students and experts. Journal of Research in Science Teaching, 28(9), 799–822.CrossRefGoogle Scholar
  16. Halloun, I. A. (2006). Modeling theory in science education. Dordrecht: Springer.Google Scholar
  17. Justi, R. S. & Gilbert, J. K. (2002a). Models and modelling in chemical education. In J. K. Gilbert, O. D. Jong, R. Justi, D. F. Treagust & J. H. Driel (Eds.), Chemical education: Towards research-based practice (pp. 47–69). New York: Kluwer Academic Publishers.Google Scholar
  18. Justi, R. S. & Gilbert, J. K. (2002b). Science teachers’ knowledge about and attitudes towards the use of models and modelling in learning science. International Journal of Science Education, 24(12), 1273–1292.CrossRefGoogle Scholar
  19. Lehrer, R. & Schauble, L. (2006). Scientific thinking and science literacy: Supporting development in learning in contexts. In W. Damon, R. M. Lerner, K. A. Renninger & I. E. Sigel (Eds.), Handbook of child psychology (6th ed., Vol. 4). Hoboken: Wiley.Google Scholar
  20. Levy, S. T. & Wilensky, U. (2009). Students’ learning with the connected chemistry (CC1) curriculum: Navigating the complexities of the particulate world. Journal of Science Education and Technology, 18(3), 243–254.CrossRefGoogle Scholar
  21. Linacre, J. M. (2007). Winsteps. Chicago, IL. www.winsteps.com.
  22. Liu, X. (2006). Effects of combined hands-on laboratory and computer modeling on student learning of gas laws: A quasi-experimental study. Journal of Science Education & Technology, 15(1), 89–100.Google Scholar
  23. Liu, X. (2010). Using and developing measurement instruments in science education: A Rasch modeling approach. Charlotte: Information Age Publishing.Google Scholar
  24. Matthews, M. (2007). Models in science and in science education: An introduction. Science & Education, 16(7/8), 647–652.CrossRefGoogle Scholar
  25. NRC (1996). National science education standards (p. 273). Washington: National Academy Press.Google Scholar
  26. NRC (2007). Taking science to school: Learning and teaching science in grades K-8. Washington: National Academies Press.Google Scholar
  27. Otto, C., Luera, G. R. & Everett, S. A. (2009). An innovative course featuring action research integrated with unifying science themes. Journal of Science Teacher Education, 20(6), 537–552.CrossRefGoogle Scholar
  28. Pluta, W. J., Chinn, C. A. & Duancan, R. G. (2011). Learners’ epistemic criteria for good scientific models. Journal of Research in Science Teaching, 48(5), 486–511.CrossRefGoogle Scholar
  29. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.Google Scholar
  30. Schwarz, C. V., Reiser, B. J., Davis, E. A., Kenyon, L., Acher, A., Fortus, D., Shwartz, Y., Hue, B. & Krajcik, J. (2009). Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners. Journal of Research in Science Teaching, 46(6), 632–54.CrossRefGoogle Scholar
  31. Schwarz, C. V. & White, B. Y. (2005). Metamodeling knowledge: Developing students’ understanding of scientific modeling. Cognition & Instruction, 23(2), 165–205.CrossRefGoogle Scholar
  32. Sins, P. H. M., Savelsbergh, E. R., van Joolingen, W. R. & van Hout-Wolters, B. H. A. M. (2009). The relation between students’ epistemological understanding of computer models and their cognitive processing on a modelling task. International Journal of Science Education, 31(9), 1205–1229.CrossRefGoogle Scholar
  33. Treagust, D. F., Chittleborough, G. & Mamiala, T. L. (2002). Students’ understanding of the role of scientific models in learning science. International Journal of Science Education, 24(4), 357–368.CrossRefGoogle Scholar
  34. Wang, W.-C., Chen, P.-H. & Cheng, Y.-Y. (2004). Improving measurement precision of test batteries using multidimensional Item Response Models. Psychological Methods, 9(1), 116–136.CrossRefGoogle Scholar
  35. Wang, W.-C., Yao, G., Tsai, Y.-J., Wang, J.-D. M. & Hsieh, C.-L. (2006). Validating, improving reliability, and estimating correlation of the four subscales in the WHOQOL-BREF using multidimensional Rasch analysis. Quality of Life Research, 15, 607–620.CrossRefGoogle Scholar
  36. Wei, S., Liu, X., Wang, Z. & Wang, X. (2011). Using Rasch measurement to develop a computer modeling-based instrument to assess students’ conceptual understanding of matter. Journal of Chemical Education, 89(3), 335–345.CrossRefGoogle Scholar
  37. White, B. Y. (1998). Computer microworlds and scientific inquiry: An alternative approach to science education. In B. J. Fraser & K. G. Tobin (Eds.), International handbook of science education (pp. 295–315). Dordrecht: Kluwer Academic Publishers.CrossRefGoogle Scholar
  38. Windschitl, M., Thompson, J. & Braaten, M. (2008). Beyond the scientific method: Model-based inquiry as a new paradigm of preference for school science investigations. Science Education, 92(5), 941–967.CrossRefGoogle Scholar
  39. Wu, M. L., Adams, R. J. & Wilson, M. (1997). Conquest: Generalized item response modelling software—manual. Melbourne: Australian Council for Educational Research.Google Scholar

Copyright information

© National Science Council, Taiwan 2013

Authors and Affiliations

  1. 1.College of Material, Chemistry and Chemical EngineeringHangzhou Normal UniversityHangzhouPeople’s Republic of China
  2. 2.Department of Learning and InstructionState University of New York at BuffaloBuffaloUSA
  3. 3.School of Psychology and Cognitive ScienceEast China Normal UniversityShanghaiPeople’s Republic of China

Personalised recommendations