Using User-Defined Fit Statistic to Analyze Two-Tier Items in Mathematics
The two-tier item is a relatively new item format and is gradually gaining popularity in some areas of educational research. In science education, a typical two-tier item is made up of two portions. The purpose of the first portion is to assess whether students could identify the correct concept with respect to the information stated in the item stem, while the second examines the reason they supplied to justify the option they chose in the first portion. Since the data thus collected are related in a certain way, they pose challenges regarding how analysis should be done to capture the relationship that exists between the two tiers. This chapter attempts to analyze such data by using a user-defined fit statistic within the Rasch approach. The kind of information that can be gathered will be illustrated by way of analyzing a data set in mathematics.
- Adams, R. J., & Wu, M. L. (2011). The construction and implementation of user-defined fit tests for use with marginal maximum likelihood estimation and generalized item response models. In N. J. S. Brown, B. Duckor, K. Draney, & M. Wilson (Eds.), Advances in Rasch measurement (Vol. 2). Maple Grove: JAM Press.Google Scholar
- Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum Associates.Google Scholar
- Tam, H. P., & Wu, M. (2009). Analyzing two-tier items with user-defined fit statistics. Paper presented at the annual meeting of the American Educational Research Association, San Diego, USA.Google Scholar
- Tan, K. D., & Treagust, D. (1999). Evaluating students’ understanding of chemical bonding. School Science Review, 81(294), 75–83.Google Scholar
- Wu, M. L., Adams, R. J., & Wilson, M. R. (1998). ConQuest – Generalised item response modeling software. Melbourne: Australian Council for Educational Research.Google Scholar