Skip to main content

Mixed Compensation Multidimensional Item Response Theory

  • Conference paper
  • First Online:
Intelligent Tutoring Systems (ITS 2020)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12149))

Included in the following conference series:

  • 1885 Accesses

Abstract

Computerized Assisted Testing (CAT) has supported the development of numerous adaptive testing approaches. Such approach as Item Response Theory (IRT) estimates a student’s competency level by modeling a test as a function of the individual’s knowledge ability, and the parameters of the question (i.e. item). Multidimensional Item Response Theory (MIRT) extends IRT so that each item depends on multiple competency areas (i.e., knowledge dimensions). MIRT models consider two opposing types of relationship between knowledge dimensions: compensatory and noncompensatory. In a compensatory model, having a higher competency with one knowledge dimension compensates for having a lower competence in another dimension. Conversely, in a noncompensatory model all the knowledge dimensions are independent and do not compensate for each other. However, using only one type of relationship at a time restricts the use of MIRT in practice. In this work, we generalize MIRT to a mixed-compensation multidimensional item response theory (MCMIRT) model that incorporates both types of relationships. We also relax the MIRT assumption that each item must include every knowledge dimension. Thus, the MCMIRT can better represent real-world curricula. We show that our approach outperforms random item selection with synthetic data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Chap. 4 of [14] for a thorough introduction.

  2. 2.

    If a dimension is not covered by i, the value is 0 by default.

References

  1. Anderson, J.R.: Act: a simple theory of complex cognition. Am. Psychol. 51(4), 355 (1996)

    Article  MathSciNet  Google Scholar 

  2. Ashburner, M., et al.: Gene ontology: tool for the unification of biology. Nat. Genet. 25(1), 25 (2000)

    Article  Google Scholar 

  3. Bloom, B.S., Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of Educational Objectives: Handbook 1: Cognitive Domain. Longman Publishing Group (1984)

    Google Scholar 

  4. Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250. ACM (2008)

    Google Scholar 

  5. Conejo, R., Guzmán, E., Pérez-de-la Cruz, J.L., Millán, E.: Introducing adaptive assistance in adaptive testing. In: AIED, pp. 777–779 (2005)

    Google Scholar 

  6. Doignon, J.P., Falmagne, J.C.: Knowledge Spaces and Learning Spaces, November 2015

    Google Scholar 

  7. Galvez, J., Guzman, E., Conejo, R., Millan, E.: Student knowledge diagnosis using item response theory and constraint-based modeling. In: AIED, pp. 291–298 (2009)

    Google Scholar 

  8. Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, vol. 1. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  9. Hernando, M., Guzmán, E., Conejo, R.: Measuring procedural knowledge in problem solving environments with item response theory. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 653–656. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_81

    Chapter  Google Scholar 

  10. Van der Linden, W.J., Pashley, P.J.: Item selection and ability estimation in adaptive testing. In: van der Linden, W., Glas, C. (eds.) Elements of Adaptive Testing, pp. 3–30. Springer, Heidelberg (2009). https://doi.org/10.1007/978-0-387-85461-8_1

    Chapter  Google Scholar 

  11. Lord, F.: Application of Item Response Theory to Practical Testing Problems (1980)

    Google Scholar 

  12. Lord, F.M.: Applications of Item Response Theory to Practical Testing Problems. Routledge (2012)

    Google Scholar 

  13. Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  14. Reckase, M.D.: Multidimensional Item Response Theory. Statistics for Social and Behavioral Sciences. Springer, New York (2009). https://doi.org/10.1007/978-0-387-89976-3

    Book  MATH  Google Scholar 

  15. Ypma, T.J.: Historical development of the Newton-Raphson method. SIAM Rev. 37(4), 531–551 (1995)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aditya Vempaty .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moissinac, B., Vempaty, A. (2020). Mixed Compensation Multidimensional Item Response Theory. In: Kumar, V., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2020. Lecture Notes in Computer Science(), vol 12149. Springer, Cham. https://doi.org/10.1007/978-3-030-49663-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49663-0_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49662-3

  • Online ISBN: 978-3-030-49663-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics