Skip to main content
SpringerLink
Log in

Rasch Measurement in Discipline-Based Physics Education Research

  • Chapter
  • First Online:
Advances in Applications of Rasch Measurement in Science Education

Part of the book series: Contemporary Trends and Issues in Science Education ((CTISE,volume 57))

  • 250 Accesses

Abstract

This chapter reports the advancement of Rasch measurement in discipline-based physics education research and the challenges that scholars in the community are facing. It provides an evaluative review of relevant empirical studies, featuring the diverse applications of Rasch theory in PER that targets various constructs, instrument formats, scoring schemes and analytical techniques. It also offers a critical review of published studies, highlighting confusions and improper practices related to the theory-driven nature of Rasch measurement, its basic principles and operations, confirmatory bias in practice, and inconsistent benchmarks for data interpretation. To mitigate these issues, recommendations are made for stricter peer-review processes and more professional development opportunities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alonzo, A. C., & Steedle, J. T. (2009). Developing and assessing a force and motion learning progression. Science Education, 98(3), 389–421.

    Article  Google Scholar 

  • Aslanides, J. S., & Savage, C. M. (2013). Relativity concept inventory: Development, analysis, and results. Physical Review Special Topics – Physics Education Research, 9(1), 1–10.

    Article  Google Scholar 

  • Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Routledge.Taylor & Francis.

    Google Scholar 

  • Boone, W. J., & Staver, J. R. (2020). Advances in Rasch analyses in the human sciences. Springer Nature.

    Book  Google Scholar 

  • Cvenic, K. M., Planinic, M., Susac, A., Ivanjek, L., Jelicic, K., & Hopf, M. (2022). Development and validation of the conceptual survey on wave optics. Physical Review Physics Education Research, 18(1), 010103. https://doi.org/10.1103/PhysRevPhysEducRes.18.010103

    Article  Google Scholar 

  • Ding, L. (2012). Applying Rasch theory to evaluate the construct validity of brief electricity and magnetism assessment. In N. S. Rebello, P. Engelhardt, & C. Singh (Eds.), 2011 physics education research conference proceedings (Vol. 1413, pp. 175–178). American Institute of Physics.  https://doi.org/10.1063/1.3680023

  • Ding, L. (2014). Seeking missing pieces in science concept assessments: Reevaluating the brief electricity and magnetism assessment through Rasch analysis. Physical Review Special Topics – Physics Education Research, 10(1), 010105. https://doi.org/10.1103/PhysRevSTPER.10.010105

    Article  Google Scholar 

  • Ding, L., & Beichner, R. (2009). Approaches to data analysis of multiple-choice questions. Physical Review Special Topics – Physics Education Research, 5(2), 020103. https://doi.org/10.1103/PhysRevSTPER.5.020103

  • Ding, L., Chabay, R., Sherwood, B., & Beichner, R. (2006). Evaluating an electricity and magnetism assessment tool: Brief electricity and magnetism assessment. Physical Review Special Topics - Physics Education Research, 2(1), 010105. https://doi.org/10.1103/PhysRevSTPER.2.010105

    Article  Google Scholar 

  • Ding, L., Wei, X., & Liu, X. (2016). Variations in university students’ scientific reasoning skills across majors, years, and types of institutions. Research in Science Education, 46(5), 613–632. https://doi.org/10.1007/s11165-015-9473-y

    Article  Google Scholar 

  • Ene, E., & Ackerson, B. (2018). Assessing learning in small sized physics courses. Physical Review – Physics Education Research, 14(1), 010102. https://doi.org/10.1103/PhysRevPhysEducRes.14.010102

    Article  Google Scholar 

  • Fulmer, G. (2015). Validating proposed learning progression on force and motion using the force concept inventory: Findings from Singapore secondary schools. International Journal of Science and Mathematics Education, 13(6), 1235–1254.

    Article  Google Scholar 

  • Fulmer, G., Liang, L., & Liu, X. (2014). Applying a force and motion learning progression over an extended time span using the force concept inventory. International Journal of Science Education, 36(17), 2918–2936.

    Article  Google Scholar 

  • Glamočić, D. S., Mešić, V., Neumann, K., Sušac, A., Boone, W. J., Aviani, I., et al. (2021). Maintaining item banks with the Rasch model: An example from wave optics. Physical Review Physics Education Research, 17(1), 010105. https://doi.org/10.1103/PhysRevPhysEducRes.17.010105

    Article  Google Scholar 

  • Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30(3), 141–158.

    Article  Google Scholar 

  • Ivanjek, L., Morris, L., Schubatzky, T., Hopf, M., Burde, J.-P., Haagen-Schützenhöfer, C., et al. (2021). Development of a two-tier instrument on simple electric circuits. Physical Review Physics Education Research, 17(2), 020123. https://doi.org/10.1103/PhysRevPhysEducRes.17.020123

    Article  Google Scholar 

  • Joint Committee of AERA, APA, & NCME. (2014). Standards for educational and psychological testing. American Educational Research Association.

    Google Scholar 

  • Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (pp. 17–64). Praeger Publishers.

    Google Scholar 

  • Kirschner, S., Borowski, A., Fischer, H., Gess-Newsome, J., & Aufschnaiter, C. v. (2016). Developing and evaluating a paper-and-pencil test to assess components of physics teachers’ pedagogical content knowledge. International Journal of Science Education, 38(8), 1343–1372.

    Article  Google Scholar 

  • Knaub, A. V., Aiken, J. M., & Caballero, M. (2019). Quantitative methods in PER: A critical examination. Physical Review – Physics Education Research, 15(2), 020001. https://doi.org/10.1103/PhysRevPhysEducRes.15.020001

    Article  Google Scholar 

  • Küchemann, S., Malone, S., Edelsbrunner, P., Lichtenberger, A., Stern, E., Schumacher, R., Brünken, R., Vaterlaus, A., & Kuhn, J. (2021). Inventory for the assessment of representational competence of vector fields. Physical Review Physics Education Research, 17(2), https://doi.org/10.1103/PhysRevPhysEducRes.17.020126

  • Lawson, A. E. (1978). The development and validation of a classroom test of formal reasoning. Journal of Research in Science Teaching, 15(1), 11–24.

    Article  Google Scholar 

  • Linacre, J. (2002). Review of reviews of Bond & Fox (2001). Rasch measurement: Transactions of the Rasch measurement. SIG American Educational Research Association, 16(2), 871–872.

    Google Scholar 

  • Liu, X. (2010). Using and developing measurement instruments in science education: A Rasch modeling approach. Information Age Publishing.

    Google Scholar 

  • Maloney, D. P., O’Kuma, T. L., Hieggelke, C. J., & Van Heuvelen, A. (2001). Surveying students’ conceptual knowledge of electricity and magnetism. American Journal of Physics, 69(S1), S12–S23.

    Article  Google Scholar 

  • Marzoli, I., Colantonio, A., Fazio, C., Giliberti, M., & Uccio, U. S. d., & Testa, I. (2021). Effects of emergency remote instruction during the COVID-19 pandemic on university physics students in Italy. Physical Review Physics Education Research, 17(2), 020130. https://doi.org/10.1103/PhysRevPhysEducRes.17.020130

    Article  Google Scholar 

  • Mesic, V., & Muratovic, H. (2011). Identifying predictors of physics item difficulty: A linear regression approach. Physical Review – Physics Education Research, 7(1), 010110.

    Article  Google Scholar 

  • Mesic, V., Hajder, E., Neumann, K., & Erceg, N. (2016). Comparing different approaches to visualizing light waves: An experimental study on teaching wave optics. Physical Review – Physics Education Research, 12(1), 010135. https://doi.org/10.1103/PhysRevPhysEducRes.12.010135

    Article  Google Scholar 

  • Mešić, V., Neumann, K., Aviani, I., Hasović, E., Boone, W. J., Erceg, N., et al. (2019). Measuring students’ conceptual understanding of wave optics: A Rasch modeling approach. Physical Review Physics Education Research, 15(1), 010115. https://doi.org/10.1103/PhysRevPhysEducRes.15.010115

    Article  Google Scholar 

  • Neumann, K., Viering, T., Boone, W. J., & Fischer, H. (2012). Towards a learning progression of energy. Journal of Research in Science Teaching, 50(2), 162–188.

    Article  Google Scholar 

  • Oon, P.-T., & Subramaniam, R. (2011a). On the declining interest in physics among students-- from the perspective of teachers. International Journal of Science Education, 33(5), 727–746.

    Article  Google Scholar 

  • Oon, P.-T., & Subramaniam, R. (2011b). Rasch modeling of a scale that explores the take-up of physics among school students from the perspective of teachers. In R. Cavanagh & R. Waugh (Eds.), Applications of Rasch measurement in learning environments research. Sense Publishers.

    Google Scholar 

  • Oon, P.-T., & Subramaniam, R. (2013). Factors influencing Singapore students’ choice of physics as a tertiary field of study: A Rasch analysis. International Journal of Science Education, 35(1), 86–118.

    Article  Google Scholar 

  • Planinic, M. (2006). Assessment of difficulties of some conceptual areas from electricity and magnetism using the conceptual survey of electricity and magnetism. American Journal of Physics, 74(12), 1143–1148.

    Article  Google Scholar 

  • Planinic, M., Boone, W. J., Krsnik, R., & Beilfuss, M. (2006). Exploring alternative conceptions from Newtonian dynamics and simple DC circuits: Links between item difficulty and item confidence. Journal of Research in Science Education, 43(2), 150–171.

    Google Scholar 

  • Planinic, M., Ivanjek, L., & Susac, A. (2010). Rasch model based analysis of the force concept inventory. Physical Review Physics Education Research, 6(1), 1–11. https://doi.org/10.1103/PhysRevSTPER.6.010103

    Article  Google Scholar 

  • Planinic, M., Ivanjek, L., & Susac, A. (2013). Comparison of university students’ understanding of graphs in different contexts. Physical Review - Physics Education Research, 9(2), 020103. https://doi.org/10.1103/PhysRevSTPER.9.020103

    Article  Google Scholar 

  • Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review - Physics Education Research, 15(2), 020111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111

    Article  Google Scholar 

  • Plummer, J., & Maynard, L. (2014). Building a learning progression for celestial motion: An exploration of students’ reasoning about the seasons. Journal of Research in Science Teaching, 51(7), 902–929.

    Article  Google Scholar 

  • Potgieter, M., Malatje, E., Gaigher, E., & Venter, E. (2010). Confidence versus performance as an indicator of the presence of alternative conceptions and inadequate problem-solving skills in mechanics. International Journal of Science Education, 32(11), 1407–1429.

    Article  Google Scholar 

  • Saglam, M., & Millar, R. (2006). Upper high school students’ understanding of electromagnetism. International Journal of Science Education, 28(5), 543–566.

    Article  Google Scholar 

  • Smith, R., Schumacker, R., & Bush, M. J. (1998). Using item mean squares to evaluate fit to the Rasch model. Journal of Outcome Measurement, 2(1), 66–78.

    Google Scholar 

  • Susac, A., Planinic, M., Klemencic, D., & Sipus, Z. M. (2018). Using the Rasch model to analyze the test of understanding of vectors. Physical Review - Physics Education Research, 14(2), 023101. https://doi.org/10.1103/PhysRevPhysEducRes.14.023101

    Article  Google Scholar 

  • Taasoobshirazi, G., Bailey, M., & Farley, J. (2015). Physics metacognition inventory part II: Confirmatory factor analysis and Rasch analysis. International Journal of Science Education, 37(17), 2769–2786.

    Article  Google Scholar 

  • Testa, I., Galano, S., Leccia, S., & Puddu, E. (2015). Development and validation of a learning progression for change of seasons, solar and lunar eclipses, and moon phases. Physical Review – Physics Education Research, 11(2), 020102. https://doi.org/10.1103/PhysRevSTPER.11.020102

    Article  Google Scholar 

  • Testa, I., Capasso, G., Collantonio, A., Galano, S., Marzoli, I., Uccio, U. S. D., et al. (2019). Development and validation of a university students’ progression in learning quantum mechanics through exploratory factor analysis and Rasch analysis. International Journal of Science Education, 41(3), 388–417.

    Article  Google Scholar 

  • Testa, I., Colantonio, A., Galano, S., Marzoli, I., Trani, F., & Uccio, U. S. d. (2020). Effects of instruction on students’ overconfidence in introductory quantum mechanics. Physical Review Physics Education Research, 16(1), 010143. https://doi.org/10.1103/PhysRevPhysEducRes.16.010143

    Article  Google Scholar 

  • Uccio, U. S. D., Colantonio, A., Galano, S., Marzoli, I., Trani, F., & Testa, I. (2019). Design and validation of a two-tier questionnaire on basic aspects in quantum mechanics. Physical Review Physics Education Research, 15(1), 010137. https://doi.org/10.1103/PhysRevPhysEducRes.15.010137

    Article  Google Scholar 

  • Uccio, U. S. D., Colantonio, A., Galano, S., Marzoli, I., Trani, F., & Testa, I. (2020). Development of a construct map to describe students’ reasoning about introductory quantum mechanics. Physical Review Physics Education Research, 16(1), 010144. https://doi.org/10.1103/PhysRevPhysEducRes.16.010144

    Article  Google Scholar 

  • Vo, D. V., & Csapo, B. (2021). Development of scientific reasoning test measuring control of variables strategy in physics for high school students: Evidence of validity and latent predictors of item difficulty. International Journal of Science Education, 43(13), 2185–2205.

    Article  Google Scholar 

  • WWC. (2022). What works clearinghouse procedures and standards handbook, Version 5.0. US Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance (NCEE).

    Google Scholar 

  • Xiao, Y., Fritchman, J., Bao, J. Y., Nie, Y., Han, J., Xiong, J., et al. (2019a). Linking and comparing short and full-length concept inventories of electricity and magnetism using item response theory. Physical Review Physics Education Research, 15(2), 020149. https://doi.org/10.1103/PhysRevPhysEducRes.15.020149

    Article  Google Scholar 

  • Xiao, Y., Koenig, K., Han, J., Liu, Q., Xiong, J., & Bao, L. (2019b). Test equity in developing short version conceptual inventories: A case study on the conceptual survey of electricity and magnetism. Physical Review Physics Education Research, 15(1), 010122. https://doi.org/10.1103/PhysRevPhysEducRes.15.010122

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Teaching and Learning, The Ohio State University, Columbus, OH, USA

    Lin Ding

Authors
  1. Lin Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lin Ding .

Editor information

Editors and Affiliations

  1. Department of Learning & Instruction, Graduate School of Education University at Buffalo, Buffalo, NY, USA

    Xiufeng Liu

  2. Department of Educational Psychology, Program in Learning Sciences and Human Development, Miami University, Oxford, OH, USA

    William J. Boone

Appendix: A Summary of Reviewed Studies of Rasch Measurement in Discipline-Based Physics Education Research

Appendix: A Summary of Reviewed Studies of Rasch Measurement in Discipline-Based Physics Education Research

Published studies

Rasch model

Target construct

Sample

Journal

Aslanides and Savage (2013)

Unidimensional dichotomous model

Conceptual understanding of special relativity

University physics students in Australia

PRPER

Cvenic et al. (2022)

Unidimensional dichotomous model for individual items; partial credit model for item groups

Conceptual understanding of wave optics

High school students in Croatia

PRPER

Ding (2012)

Unidimensional dichotomous model

Conceptual understanding of introductory electricity and magnetism

University science and engineering majors in US

PERC proceedings

Ding (2014)

Unidimensional dichotomous model

Conceptual understanding of introductory electricity and magnetism

University science and engineering majors in US

PRPER

Ding et al. (2016)

Multidimensional dichotomous model

Scientific reasoning skills

University students in China

RISE

Ene and Ackerson (2018)

Unidimensional dichotomous model

Conceptual understanding of semiconductors

University graduate and undergraduate students in US

PRPER

Fulmer et al. (2014)

Unidimensional partial credit model

Conceptual understanding of force and motion (force and motion learning progression)

High school and university students in US

IJSE

Fulmer (2015)

Multidimensional (2-d) rating scale model

Conceptual understanding of force and motion, including Newton’s third law

Secondary school students in Singapore

IJSME

Glamočić et al. (2021)

Unidimensional dichotomous model; item linking

Conceptual understanding of wave optics

University physics students in Slovenia, Croatia, and Bosnia and Herzegovina

PRPER

Ivanjek et al. (2021)

Unidimensional dichotomous model

Conceptual understanding of simple electric circuits

Middle school students in Austria and Germany

PRPER

Kirschner et al. (2016)

Multidimensional Rasch analysis; model unspecified, but likely the rating scale model

Physics teachers’ pedagogical content knowledge

Physics teachers; presumably in Germany (unspecified)

IJSE

Küchemann et al. (2021)

Unidimensional dichotomous model

Competency in field lines and vector-field representations

University STEM students in Switzerland and Germany

PRPER

Marzoli et al. (2021)

Unidimensional Rasch analysis; model unspecified, but likely the rating scale model

Views of emergency remote instruction

University students in Italy

PRPER

Mesic et al. (2016)

Unidimensional dichotomous model

Qualitative understanding of wave optics

Secondary school students in Bosnia and Herzegovina

PRPER

Mesic and Muratovic (2011)

Unidimensional dichotomous model; virtual test equating

Competency in physics

Secondary school students in Bosnia and Herzegovina

PRPER

Mešić et al. (2019)

Unidimensional dichotomous model

Understanding of wave optics

University students in Bosnia and Herzegovina, Croatia, and Slovenia

PRPER

Neumann et al. (2012)

Unidimensional dichotomous model

Understanding of energy

Grade 6–10 students in Germany

JRST

Oon and Subramaniam (2011a)

Unidimensional rating scale model

Teachers’ views on student declining interest in physics

Secondary and junior college physics teachers in Singapore

IJSE

Oon and Subramaniam (2011b)

Unidimensional rating scale model

Teachers’ views on student declining interest in physics

Secondary and junior college physics teachers in Singapore

Book chapter

Oon and Subramaniam (2013)

Unidimensional rating scale model

Views on and interest in physics

Secondary and junior college students in Singapore

IJSE

Planinic et al. (2006)

Unidimensional rating scale model

Confidence on conceptions of Newtonian dynamics and DC circuits

High school students in Croatia

JRST

Planinic et al. (2019)

Review of unidimensional Rasch models

General discussion of constructs in physics education

General discussion of assessment respondents

PRPER

Planinic et al. (2010)

Unidimensional dichotomous model

Conceptual understanding of force

High school students in Croatia

PRPER

Planinic et al. (2013)

Unidimensional Rasch analysis; model unspecified, but likely the partial credit model

Understanding of graph slope and undercurve area

First-year university students in Zagreb

PRPER

Plummer and Maynard (2014)

Unidimensional partial credit model

Understanding of celestial motion and seasons

Middle school students in US

JRST

Potgieter et al. (2010)

Unidimensional dichotomous model for multiple-choice concept items; unidimensional rating scale model for Likert-scale confidence items

Confidence on conceptions of mechanics

University physics students in South Africa

IJSE

Saglam and Millar (2006)

Unidimensional dichotomous model

Understanding of electromagnetism

High school students in Turkey and England

IJSE

Susac et al. (2018)

Unidimensional dichotomous model

Understanding of vectors

First-year university students in Zagreb

PRPER

Taasoobashirazi et al. (2015)

Unidimensional Rasch analysis, model unspecified but likely the rating scale model

Metacognition of problem solving in physics

University physics students in US

IJSE

Testa et al. (2019)

Unidimensional partial credit model

Understanding of quantum mechanics

University students in Italy

IJSE

Testa et al. (2020)

Unidimensional dichotomous model for concept items and rating scale model for confidence items

Understanding of and confidence on conceptions of quantum mechanics

High school students in Italy

PRPER

Testa et al. (2015)

Unidimensional dichotomous model

Understanding of seasons, solar and lunar eclipses, and moon phases

Secondary school students in Italy

PRPER

Uccio et al. (2019)

Unidimensional dichotomous and partial credit models for various item scoring methods

Knowledge and reasoning of quantum mechanics

University physics students and high school physics teachers

PRPER

Uccio et al. (2020)

Unidimensional dichotomous model

Reasoning about quantum mechanics

High school students in Italy

PRPER

Vo and Csapo (2021)

Unidimensional and multidimensional dichotomous models

Reasoning in control of variables

High school students in Vietnam

IJSE

Xiao et al. (2019a)

Purportedly unidimensional dichotomous Rasch model, but likely 1-parameter IRT

Conceptual understanding of electromagnetism

University students; nation unspecified

PRPER

Xiao et al. (2019b)

Purportedly unidimensional dichotomous Rasch model, but likely 1-parameter IRT

Conceptual understanding of electromagnetism

University students; nation unspecified

PRPER

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ding, L. (2023). Rasch Measurement in Discipline-Based Physics Education Research. In: Liu, X., Boone, W.J. (eds) Advances in Applications of Rasch Measurement in Science Education. Contemporary Trends and Issues in Science Education, vol 57. Springer, Cham. https://doi.org/10.1007/978-3-031-28776-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28776-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28775-6

  • Online ISBN: 978-3-031-28776-3

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation