Skip to main content
SpringerLink
Log in

Cognitive Diagnostic Computerized Adaptive Testing for Polytomously Scored Items

  • Published:
Journal of Classification Aims and scope Submit manuscript

Abstract

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. Currently, large number of CD-CAT researches focus on the dichotomous data. In our knowledge, there are no researches on CD-CAT for polytomously scored items or data. However, polytomously scored items have been broadly used in a variety of tests for their advantages of providing more information about examinee, and fewer polytomous items can achieve the same precision compared with dichotomous items. Therefore, it is an interesting topic on CD-CAT with polytomously scored items, which need promote the research in polytomous cognitive diagnostic computerized adaptive testing (called PCD-CAT). This study aims to construct a framework of PCD-CAT, including the construction of the item bank, the item selection method, the parameter estimation, and the termination rule.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Chen, P., Li, Z., & Xin, T. (2011). A note on the uniformity of item bank usage in cognitive diagnostic computerized adaptive testing. Studies of Psychology and Behavior, 9, 125–132.

    Google Scholar 

  • Chen, P., Xin, T., Wang, C., & Chang, H. H. (2012). Online calibration methods for the DINA model with independent attributes in CD-CAT. Psychometrika, 77(2), 201–222.

    Article  MathSciNet  Google Scholar 

  • Chen, Y., Liu, J., & Ying, Z. (2015). Online item calibration for Q-matrix in CD-CAT. Applied Psychological Measurement, 39(1), 5–15.

    Article  Google Scholar 

  • Cheng, Y. (2009). When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika, 74, 619–632.

    Article  MathSciNet  Google Scholar 

  • Dai, B., Zhang, M., & Li, G. (2016). Exploration of item selection in dual-purpose cognitive diagnostic computerized adaptive testing: Based on the RRUM. Applied Psychological Measurement, 40(8), 625–640.

    Article  Google Scholar 

  • De la Torre, J. (2010). The partial-credit DINA model. Paper presented at the international meeting of the psychometric society, Athens, GA.

  • Gibbons, R. D., Weiss, D. J., Pilkonis, P. A., Frank, E., Moore, T., Kim, J. B., & Kupfer, D. J. (2012). Development of a computerized adaptive test for depression. Archives of General Psychiatry, 69(11), 1104–1112.

    Article  Google Scholar 

  • Hansen, M. (2013). Hierarchical item response models for cognitive diagnosis. Unpublished doctoral dissertation. University of California at Los Angeles.

  • Hsu, C. L., & Chen, S. Y. (2007). Controlling item exposure and test overlap in variable length computerized adaptive testing (in Chinese). Psychological Testing, 54, 403–428.

    Google Scholar 

  • Hsu, C. L., Wang, W. C., & Chen, S. Y. (2013). Variable-length computerized adaptive testing based on cognitive diagnosis models. Applied Psychological Measurement, 37(7), 563–582.

    Article  Google Scholar 

  • Jang, E. (2008), “A framework for cognitive diagnostic assessment”, in Towards an Adaptive CALL: Natural Language, eds. C.a. Chapelle, Y.-R. Chung, and J. Xu, pp. 117–132.

  • Kaplan, M., De La Torre, J., & Barrada, J. R. (2015). New item selection methods for cognitive diagnosis computerized adaptive testing. Applied Psychological Measurement, 39(3), 167–188.

    Article  Google Scholar 

  • Kunina-Habenicht, O., Rupp, A. A., & Wilhelm, O. (2012). The impact of model misspecification on parameter estimation and item-fit assessment in log-linear diagnostic classification models. Journal of Educational Measurement, 49, 59–81.

    Article  Google Scholar 

  • Lei, P. W., & Li, H. (2016). Performance of fit indices in choosing correct cognitive diagnostic models and Q-matrices. Applied Psychological Measurement, 40(6), 405–417.

    Article  MathSciNet  Google Scholar 

  • Liu, H. Y., You, X. F., Wang, W. Y., Ding, S. L., & Chang, H. H. (2013). The development of computerized adaptive testing with cognitive diagnosis for an English achievement test in China. Journal of Classification, 30(2), 152–172.

    Article  MathSciNet  Google Scholar 

  • Ma, W., & De La Torre, J. (2016). A sequential cognitive diagnosis model for polytomous responses. British Journal of Mathematical and Statistical Psychology, 69(3), 253–275.

    Article  Google Scholar 

  • Ma, W., and De La Torre, J. (2018). GDINA: The generalized DINA model framework. R package version 2.2.0. Retrived from https://CRAN.R-project.org/package=GDINA.

  • Ma, W., & De La Torre, J. (2019). An empirical Q-matrix validation method for the sequential generalized DINA model. British Journal of Mathematical and Statistical Psychology, 44(1), 45–77.

    Google Scholar 

  • Mao, X., & Xin, T. (2013). The application of the Monte Carlo approach to cognitive diagnostic computerized adaptive testing with content constraints. Applied Psychological Measurement, 37(6), 482–496.

    Article  Google Scholar 

  • Rupp, A. A., & Templin, J. (2008). Effects of Q-matrix misspecification on parameter estimates and misclassification rates in the DINA model. Educational and Psychological Measurement, 68, 78–98.

    Article  MathSciNet  Google Scholar 

  • Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345–354.

    Article  Google Scholar 

  • Tatsuoka, C. (2002). Data analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society: Series C: Applied Statistics, 51, 337–350.

    Article  MathSciNet  Google Scholar 

  • Tatsuoka, C., & Ferguson, T. (2003). Sequential classification on partially ordered sets. Journal of the Royal Statistical Society, Series B: Statistical Methodology, 65, 143–157.

    Article  MathSciNet  Google Scholar 

  • Van Der Ark, L. A. (2001). Relationships and properties of polytomous item response theory models. Applied Psychological Measurement, 25(3), 273–282.

    Article  MathSciNet  Google Scholar 

  • Von Davier, M. (2008). A general diagnostic model applied to language testing data. British Journal of Mathematical and Statistical Psychology, 61, 287–307.

    Article  MathSciNet  Google Scholar 

  • Wang, C. (2013). Mutual information item selection method in cognitive diagnostic computerized adaptive testing with short test length. Educational and Psychological Measurement, 73(6), 1017–1035.

    Article  Google Scholar 

  • Wang, C., Chang, H. H., & Huebner, A. (2011). Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing. Journal of Educational Measurement, 48, 255–273.

    Article  Google Scholar 

  • Xu, X., Chang, H. H., and Douglas, J. (2003). Computerized adaptive testing strategies for cognitive diagnosis. Paper presented at the annual meeting of National Council on measurement in education, Montreal, Quebec, Canada.

  • Zheng, C., & Chang, H. H. (2016). High-efficiency response distribution–based item selection algorithms for short-length cognitive diagnostic computerized adaptive testing. Applied Psychological Measurement, 40(8), 608–624.

    Article  Google Scholar 

  • Zheng, C., & Wang, C. (2017). Application of binary searching for item exposure control in cognitive diagnostic computerized adaptive testing. Applied Psychological Measurement, 41(7), 561–576.

    Article  Google Scholar 

Download references

Funding

This study was supported by the National Natural Science Foundation of China(31960186,31760288,31660278).

Author information

Authors and Affiliations

  1. School of Psychology, Jiangxi Normal University, Nanchang, China

    Xuliang Gao, Daxun Wang, Yan Cai & Dongbo Tu

  2. School of Psychology, Guizhou Normal University, Guiyang, China

    Xuliang Gao

Authors
  1. Xuliang Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daxun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yan Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dongbo Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongbo Tu.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Daxun Wang and Yan Cai are the co-first author of this paper.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, X., Wang, D., Cai, Y. et al. Cognitive Diagnostic Computerized Adaptive Testing for Polytomously Scored Items. J Classif 37, 709–729 (2020). https://doi.org/10.1007/s00357-019-09357-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00357-019-09357-x

Keywords

Search

Navigation