Skip to main content
Book cover

Self-directed Learning Oriented Assessments in the Asia-Pacific pp 223–233Cite as

Using User-Defined Fit Statistic to Analyze Two-Tier Items in Mathematics

  • 1856 Accesses

Part of the Education in the Asia-Pacific Region: Issues, Concerns and Prospects book series (EDAP,volume 18)

Abstract

The two-tier item is a relatively new item format and is gradually gaining popularity in some areas of educational research. In science education, a typical two-tier item is made up of two portions. The purpose of the first portion is to assess whether students could identify the correct concept with respect to the information stated in the item stem, while the second examines the reason they supplied to justify the option they chose in the first portion. Since the data thus collected are related in a certain way, they pose challenges regarding how analysis should be done to capture the relationship that exists between the two tiers. This chapter attempts to analyze such data by using a user-defined fit statistic within the Rasch approach. The kind of information that can be gathered will be illustrated by way of analyzing a data set in mathematics.

Keywords

  • Word Problem
  • Subject Matter Expert
  • Partial Credit
  • Data Analyst
  • Item Pair

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-94-007-4507-0_12
  • Chapter length: 11 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   149.00
Price excludes VAT (USA)
  • ISBN: 978-94-007-4507-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   199.99
Price excludes VAT (USA)
Hardcover Book
USD   199.99
Price excludes VAT (USA)
Learn about institutional subscriptions

References

  • Adams, R. J., & Wu, M. L. (2011). The construction and implementation of user-defined fit tests for use with marginal maximum likelihood estimation and generalized item response models. In N. J. S. Brown, B. Duckor, K. Draney, & M. Wilson (Eds.), Advances in Rasch measurement (Vol. 2). Maple Grove: JAM Press.

    Google Scholar 

  • Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Tam, H. P., & Li, L. A. (2007). Sampling and data collection procedures for the National Science Concept Learning Study. International Journal of Science Education, 29(4), 405–420.

    CrossRef  Google Scholar 

  • Tam, H. P., & Wu, M. (2009). Analyzing two-tier items with user-defined fit statistics. Paper presented at the annual meeting of the American Educational Research Association, San Diego, USA.

    Google Scholar 

  • Tan, K. D., & Treagust, D. (1999). Evaluating students’ understanding of chemical bonding. School Science Review, 81(294), 75–83.

    Google Scholar 

  • Treagust, D. (1988). Development and use of diagnostic test to evaluate students’ misconceptions in science. International Journal of Science Education, 10(2), 159–169.

    CrossRef  Google Scholar 

  • Treagust, D. F., & Smith, C. L. (1989). Secondary students’ understanding of gravity and the motion of planets. School Science and Mathematics, 89(5), 380–391.

    CrossRef  Google Scholar 

  • Wainer, H., Bradlow, E. T., & Wang, X. (2007). Testlet response theory and its applications. New York: Cambridge University Press.

    CrossRef  Google Scholar 

  • Wu, M. L., Adams, R. J., & Wilson, M. R. (1998). ConQuest – Generalised item response modeling software. Melbourne: Australian Council for Educational Research.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate Institute of Science Education, National Taiwan Normal University, Taipei City, Taiwan

    Hak Ping Tam

  2. Work-based Education Research Centre, Victoria University, Melbourne, Australia

    Margaret Wu

  3. Formerly Centre for Assessment Research and Development, The Hong Kong Institute of Education, Tai Po, Hong Kong

    Doris Ching Heung Lau

  4. The University of Hong Kong, Hong Kong, Hong Kong

    Doris Ching Heung Lau

  5. Department of Psychological Studies, and Assessment Research Centre, The Hong Kong Institute of Education, 10 Lo PingRoad, Tai Po, N.T., Hong Kong

    Magdalena Mo Ching Mok

Authors
  1. Hak Ping Tam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Margaret Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Doris Ching Heung Lau
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Magdalena Mo Ching Mok
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hak Ping Tam .

Editor information

Editors and Affiliations

  1. , Dep. of Int'l Ed. & Lifelong Learning, Hong Kong Institute of Education, Lo Ping Road 10, Tai Po, New Territories, Hong Kong SAR

    Magdalena Mo Ching Mok

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Tam, H.P., Wu, M., Lau, D.C.H., Mok, M.M.C. (2012). Using User-Defined Fit Statistic to Analyze Two-Tier Items in Mathematics. In: Mok, M. (eds) Self-directed Learning Oriented Assessments in the Asia-Pacific. Education in the Asia-Pacific Region: Issues, Concerns and Prospects, vol 18. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4507-0_12

Download citation