Simulation Study of Scoring Methods for Various Multiple-Multiple-Choice Items
Multiple-choice (MC) format is the most widely used format in objective testing. The “select all the choices that are true” items, also called multiple-multiple-choice (MMC) items, is a variation of the MC format, which gives no instructions about how many correct choices may be selected. Although many studies have been developed and various scoring methods for MMC items have been compared, the results have often been inconsistent. Arai and Miyano (Bull Data Anal Japan Classif Soc 6:101–112, 2017) proposed new scoring methods and compared their scoring features by conducting numerical simulations of a few MMC item patterns. In this study, we conducted numerical simulations of all other plausible MMC item patterns to examine the relationships between examinees’ abilities (true scores) and scores given by scoring methods. We illustrated the effects of the total number of choices and correct choices for each scoring.
KeywordsMultiple-multiple-choice items Scoring method
- Arai, S., & Miyano, H. (2017). Scoring method for “Select All the Choices That Are True” items. Bulletin of Data Analysis of Japanese Classification Society, 6(1), 101–112(in Japanese).Google Scholar
- Domnich, A., Panatto, D., Arata, L., Bevilacqua, I., Apprato, L., Gasparini, R., et al. (2015). Impact of different scoring algorithms applied to multiple-mark survey items on outcome assessment: An in-field study on health-related knowledge. Journal of Preventive Medicine and Hygiene, 56(4), E162.Google Scholar
- Haladyna, T. M. (2004). Developing and validating multiple-choice test items. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
- Mayekawa, S. (2018, November 15). Lazy R packages. Retrieved from http://mayekawa.in.coocan.jp/Rpackages.html.
- Ripkey, D. R., Case, S. M., & Swanson, D. B. (1996). A “new” item format for assessing aspects of clinical competence. Academic Medicine, 71(10), S34–6.Google Scholar
- Sokal, R. R., & Sneath, P. H. A.(1963). Principles of numerical taxonomy. W. H. Freeman and Company.Google Scholar