Advertisement

Computer-Automated Testing: An Evaluation of Student Performance

  • Silvia Cagnone
  • Stefania Mignani
  • Roberto Ricci
  • Giorgio Casadei
  • Simone Riccucci
Conference paper
Part of the IFIP International Federation for Information Processing book series (IFIPAICT, volume 171)

Abstract

In the last few years, the need for an automated way to assess people has increased quickly because of the growing request from both private and public structures. Many Learning Management Systems (LMS) have been developed in order to automatize the learning and assessment process. In most of the cases these systems don’t allow a quality content evaluation and an efficient ability estimation. In this paper we analyze the features of the Proportional Odd Model (POM), belonging to the Item Response Theory. The POM enables to translate an automatic test deliver in an efficient way in order to get an evaluation through either a summative or a formative way. The data have been collected in some undergraduate courses of Bologna University, by using test delivering and by authoring system developed in ASP and Java, respectively.

Keywords

Automatic test deliver automatic evaluation system undergraduate students ability system IRT models for ordered polytomous variables 

References

  1. Gentner, D. and Stevens, A.L. (1983). Mental Models. New York: Lawrence Erlbaum Associates.Google Scholar
  2. Lord, F. M. and Novick, M.E. (1968). Statistical theories of mental test scores. New York: Addison-Wesley Publishing Co.Google Scholar
  3. Hambleton, R.K. and Swaminathan H. (1985). Item Response Theory. Boston: Kluwer-Nijhoff Publishing.Google Scholar
  4. Jöreskog, K. and Moustaki, I. (2001). Factor Analysis of Ordinal Variables: A Comparison of three Approaches. Multivariate Behavioral Research, 36, 347–387.CrossRefGoogle Scholar
  5. Moustaki, I. (2000). A Latent Variable Model for Ordinal Variables. Applied Psychological Measurement, 24, 211–223.CrossRefGoogle Scholar
  6. Samejima, F. (1969). Estimation of ability using a response pattern of graded scores. Psychometrika Monograph, 17.Google Scholar

Copyright information

© International Federation for Information Processing 2005

Authors and Affiliations

  • Silvia Cagnone
    • 1
  • Stefania Mignani
    • 1
  • Roberto Ricci
    • 1
  • Giorgio Casadei
    • 2
  • Simone Riccucci
    • 2
  1. 1.Statistics DepartmentUniversity of BolognaBologna
  2. 2.Computer Science DepartmentUniversity of BolognaBologna

Personalised recommendations