Towards Computerized Adaptive Assessment Based on Structured Tasks
In an attempt to support traditional classroom assessment processes with fully computerized methods, we have developed a method for adaptive assessment suitable for well structured domains with high emphasis on problem solving and capable of robust continuous assessment, potentially encouraging student’s achievements, reflective thinking, and creativity. The method selects problems according to the student’s demonstrated ability, structured task description schemes allow for a detailed analysis of student’s errors, and on-demand generation of task instances facilitates independent student work. We evaluated the proposed method using a software system we had developed in the domain of middle school mathematics.
Unable to display preview. Download preview PDF.
- 1.Brusilovsky, P., Miller, P.: Web-based testing for distance education. In: De Bra, P., Leggett, J. (eds.) Proceedings of WebNet 1999, pp. 149–154. AACE (1999)Google Scholar
- 2.Mills, C., Steffen, M.: The GRE Computer Adaptive Test: Operational Issues. Computerized Adaptive Testing: Theory and Practice (2000)Google Scholar
- 4.Feng, M., Heffernan, N., Koedinger, K.: Addressing the Testing Challenge with a Web-based E-Assessment System that Tutors as it Assesses. In: Proceedings of the 15th international conference on World Wide Web, pp. 307–316 (2006)Google Scholar
- 6.Wainer, H.: Computerized Adaptive Testing: A Primer. Lawrence Erlbaum Associates, Mahwah (2000)Google Scholar
- 7.Black, P., Wiliam, D.: Inside the Black Box: Raising Standards Through Classroom Assessment. Phi Delta Kappan 80(2), 139–148 (1998)Google Scholar
- 8.Conejo, R.: SIETTE: A Web-Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14(1), 29–61 (2004)Google Scholar
- 9.Conejo, R., Guzmán, E., Pérez-de-la Cruz, J.L., Millán, E.: An Empirical Study About Calibration of Adaptive Hints in Web-Based Adaptive Testing Environments. In: Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 71–80 (2006)Google Scholar
- 10.Irvine, S., Kyllonen, P.: Item Generation for Test Development. Lawrence Erlbaum Associates, Mahwah (2002)Google Scholar
- 11.Bejar, I., Lawless, R., Morley, M., Wagner, M., Bennett, R., Revuelta, J.: A Feasibility Study of On-the-Fly Item Generation in Adaptive Testing. Journal of Technology, Learning, and Assessment 2(3) (2003)Google Scholar
- 12.Sinharay, S., Johnson, M.: Analysis of Data From an Admissions Test With Item Models. Educational Testing Service (2005)Google Scholar
- 13.Deane, P., Sheehan, K.: Automatic Item Generation via Frame Semantics: Natural Language Generation of Math Word Problems. In: Annual meeting of the National Council on Measurement in Education, Chicago, IL (2003)Google Scholar
- 15.Birnbaum, A.: Efficient design and use of tests of a mental ability for various decision-making problems. In: Randolph Air Force Base. Air University, School of Aviation Medicine, Texas (1957)Google Scholar