Advertisement

Towards Computerized Adaptive Assessment Based on Structured Tasks

  • Jozef Tvarožek
  • Miloš Kravčík
  • Mária Bieliková
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5149)

Abstract

In an attempt to support traditional classroom assessment processes with fully computerized methods, we have developed a method for adaptive assessment suitable for well structured domains with high emphasis on problem solving and capable of robust continuous assessment, potentially encouraging student’s achievements, reflective thinking, and creativity. The method selects problems according to the student’s demonstrated ability, structured task description schemes allow for a detailed analysis of student’s errors, and on-demand generation of task instances facilitates independent student work. We evaluated the proposed method using a software system we had developed in the domain of middle school mathematics.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Brusilovsky, P., Miller, P.: Web-based testing for distance education. In: De Bra, P., Leggett, J. (eds.) Proceedings of WebNet 1999, pp. 149–154. AACE (1999)Google Scholar
  2. 2.
    Mills, C., Steffen, M.: The GRE Computer Adaptive Test: Operational Issues. Computerized Adaptive Testing: Theory and Practice (2000)Google Scholar
  3. 3.
    Aleven, V., McLaren, B., Sewall, J., Koedinger, K.: The Cognitive Tutor Authoring Tools (CTAT): Preliminary evaluation of efficiency gains. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 61–70. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Feng, M., Heffernan, N., Koedinger, K.: Addressing the Testing Challenge with a Web-based E-Assessment System that Tutors as it Assesses. In: Proceedings of the 15th international conference on World Wide Web, pp. 307–316 (2006)Google Scholar
  5. 5.
    Lord, F., Novick, M.: Statistical theories of mental test scores. Addison-Wesley, Reading (1968)zbMATHGoogle Scholar
  6. 6.
    Wainer, H.: Computerized Adaptive Testing: A Primer. Lawrence Erlbaum Associates, Mahwah (2000)Google Scholar
  7. 7.
    Black, P., Wiliam, D.: Inside the Black Box: Raising Standards Through Classroom Assessment. Phi Delta Kappan 80(2), 139–148 (1998)Google Scholar
  8. 8.
    Conejo, R.: SIETTE: A Web-Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14(1), 29–61 (2004)Google Scholar
  9. 9.
    Conejo, R., Guzmán, E., Pérez-de-la Cruz, J.L., Millán, E.: An Empirical Study About Calibration of Adaptive Hints in Web-Based Adaptive Testing Environments. In: Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 71–80 (2006)Google Scholar
  10. 10.
    Irvine, S., Kyllonen, P.: Item Generation for Test Development. Lawrence Erlbaum Associates, Mahwah (2002)Google Scholar
  11. 11.
    Bejar, I., Lawless, R., Morley, M., Wagner, M., Bennett, R., Revuelta, J.: A Feasibility Study of On-the-Fly Item Generation in Adaptive Testing. Journal of Technology, Learning, and Assessment 2(3) (2003)Google Scholar
  12. 12.
    Sinharay, S., Johnson, M.: Analysis of Data From an Admissions Test With Item Models. Educational Testing Service (2005)Google Scholar
  13. 13.
    Deane, P., Sheehan, K.: Automatic Item Generation via Frame Semantics: Natural Language Generation of Math Word Problems. In: Annual meeting of the National Council on Measurement in Education, Chicago, IL (2003)Google Scholar
  14. 14.
    Chang, H., Qian, J., Ying, Z.: a-Stratified Multistage Computerized Adaptive Testing with b-Blocking. Applied Psych. Measurement 25(4), 333–341 (2001)CrossRefMathSciNetGoogle Scholar
  15. 15.
    Birnbaum, A.: Efficient design and use of tests of a mental ability for various decision-making problems. In: Randolph Air Force Base. Air University, School of Aviation Medicine, Texas (1957)Google Scholar
  16. 16.
    Baker, F., Seock-Ho, K.: Item Response Theory: Parameter Estimation Techniques. CRC Press, Boca Raton (2004)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Jozef Tvarožek
    • 1
  • Miloš Kravčík
    • 2
  • Mária Bieliková
    • 1
  1. 1.Faculty of Informatics and Information TechnologiesSlovak University of TechnologyBratislavaSlovakia
  2. 2.Open University of The NetherlandsHeerlenThe Netherlands

Personalised recommendations