Skip to main content
SpringerLink
Log in

Validating a Multiple-Choice Modelling Competencies Assessment

  • Chapter
  • First Online:
Advancing and Consolidating Mathematical Modelling

  • 375 Accesses

Abstract

As part of a larger project focused on exploring development of mathematical modelling competencies among post-secondary STEM majors enrolled in advanced mathematics, we developed a pair of parallel multiple-choice modelling competencies assessments. In this chapter, we provide a technical report of item development, scale calibration, and validation of the assessment. We used multiple statistical approaches, including classical test theory (CTT), item response theory (IRT), and principal component analysis (PCA) to document item behaviours, scale properties, and dimensionality of a developing multiple-choice assessment of mathematical modelling competencies designed for post-secondary STEM majors. We share analyses and inferences, making recommendations for the field in pursuing such assessments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. AERA. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf

  • Ärlebäck, J., & Bergsten, C. (2010). On the use of realistic Fermi problems in introducing mathematical modelling in upper secondary mathematics. In R. Lesh, P. Galbraith, C. Haines, & A. Hurford (Eds.), Modeling students’ mathematical modeling competencies (pp. 597–609). Springer. https://doi.org/10.1007/978-1-4419-0561-1_52

  • Bandura, A. (2006). Guide for constructing self-efficacy scales. In T. Urdan & F. Pajares (Eds.), Self-efficacy beliefs of adolescents (pp. 307–337). Information Age Publishing.

    Google Scholar 

  • Blomhöj, M., & Jensen, T. H. (2003). Developing mathematical modelling competence: Conceptual clarification and educational planning. Teaching Mathematics and its Applications, 22(3), 123–139.

    Google Scholar 

  • Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how? CBE Life Sciences Education, 15(4), 1–7. https://doi.org/10.1187/cbe.16-04-0148

    Article  Google Scholar 

  • Crouch, R., & Haines, C. (2004). Mathematical modelling: Transitions between the real world and the mathematical model. International Journal of Mathematical Education in Science and Technology, 35(2), 197–206. https://doi.org/10.1080/00207390310001638322

    Article  Google Scholar 

  • Czocher, J. A. (2016). Introducing modeling transition diagrams as a tool to connect mathematical modeling to mathematical thinking. Mathematical Thinking and Learning, 18(2), 77–106. https://doi.org/10.1080/10986065.2016.1148530

    Article  Google Scholar 

  • Czocher, J. A. (2018). How does validating activity contribute to the modeling process? Educational Studies in Mathematics, 99(2), 137–159. https://doi.org/10.1007/s10649-018-9833-4

    Article  Google Scholar 

  • Czocher, J. A., Melhuish, K., & Kandasamy, S. S. (2019). Building mathematics self-efficacy of STEM undergraduates through mathematical modelling. International Journal of Mathematical Education in Science and Technology, 51(6), 807–834. https://doi.org/10.1080/0020739x.2019.1634223

    Article  Google Scholar 

  • Czocher, J. A., Kandasamy, S. S., & Roan, E. (2020). Validating a modelling competencies assessment Paper presented at 14th International Congress on Mathematics Education, Shanghai, China.

    Google Scholar 

  • Czocher, J. A., Melhuish, K., Kandasamy, S. S., & Roan, E. (2021). Dual measures of mathematical modeling for engineering and other STEM undergraduates. International Journal of Research in Undergraduate Mathematics Education, 51(6), 807–834. https://doi.org/10.1007/s40753-020-00124-7

    Article  Google Scholar 

  • DiBattista, D., & Kurzawa, L. (2011). Examination of the quality of multiple-choice items on classroom tests. The Canadian Journal for the Scolarship of Teaching and Learning, 2(2), Article 4. https://doi.org/10.5206/cjsotl-rcacea.2011.2.4

  • Frejd, P. (2013). Modes of modelling assessment—A literature review. Educational Studies in Mathematics, 84, 413–438. https://doi.org/10.1007/s10649-013-9491-5

    Article  Google Scholar 

  • Hackett, G., & Betz, N. E. (1989). An exploration of the mathematics self-efficacy/mathematics performance correspondence. Journal for Research in Mathematics Education, 20(3), 261–273. https://doi.org/10.2307/749515

    Article  Google Scholar 

  • Haines, C., Crouch, R., & Davis, J. (2000). Mathematical modelling skills: A research instrument (Technical Report No. 55). University of Hertfordshire Faculty of Engineering and Information Sciences.

    Google Scholar 

  • Kaiser, G. (2017). The teaching and learning of mathematical modeling. In J. Cai (Ed.), Compendium for research in mathematics education (pp. 267–291). National Council of Teachers of Mathematics.

    Google Scholar 

  • Maaß, K. (2006). What are modelling competencies? ZDM, 38(2), 113–142. https://doi.org/10.1007/BF02655885

  • Raykov, T. (1997). Scale reliability, cronbach’s coefficient alpha, and violations of essential tau-equivalence with fixed congeneric components. Multivariate Behavioral Research, 32(4), 329–353. https://doi.org/10.1207/s15327906mbr3204_2

    Article  Google Scholar 

  • Stillman, G. (2000). Impact of prior knowledge of task context on approaches to applications tasks. Journal of Mathematical Behavior, 19(3), 333–361. https://doi.org/10.1016/S0732-3123(00)00049-3

  • Zöttl, L., Ufer, S., & Reiss, K. (2011). Assessing modelling competencies using a multidimensional IRT approach. In G. Kaiser, W. Blum, R. Borromeo Ferri, & G. Stillman (Eds.), Trends in teaching and learning of mathematical modelling (pp. 427–437). Springer. https://doi.org/10.1007/978-94-007-0910-2_42

Download references

Acknowledgements

This material is based upon work supported by the National Science Foundation under Grant No. 1750813.

Author information

Authors and Affiliations

  1. Department of Mathematics, Texas State University, San Marcos, TX, USA

    Jennifer A. Czocher, Sindura Subanemy Kularajan, Elizabeth Roan & Robert Sigley

Authors
  1. Jennifer A. Czocher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sindura Subanemy Kularajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elizabeth Roan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Robert Sigley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jennifer A. Czocher .

Editor information

Editors and Affiliations

  1. Institute for Mathematics Education and Computer Science Education, University of Münster, Münster, Germany

    Gilbert Greefrath

  2. University of Algarve and UIDEF, Institute of Education, University of Lisbon, Faro, Portugal

    Susana Carreira

  3. Australian Catholic University, Ballarat, VIC, Australia

    Gloria Ann Stillman

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Czocher, J.A., Kularajan, S.S., Roan, E., Sigley, R. (2023). Validating a Multiple-Choice Modelling Competencies Assessment. In: Greefrath, G., Carreira, S., Stillman, G.A. (eds) Advancing and Consolidating Mathematical Modelling. International Perspectives on the Teaching and Learning of Mathematical Modelling. Springer, Cham. https://doi.org/10.1007/978-3-031-27115-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27115-1_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27114-4

  • Online ISBN: 978-3-031-27115-1

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation