Evaluating Multiple Choice Question Generator

  • Sieow-Yeek Tan
  • Ching-Chieh Kiu
  • Dickson Lukose
Conference paper

DOI: 10.1007/978-3-642-32826-8_29

Volume 295 of the book series Communications in Computer and Information Science (CCIS)
Cite this paper as:
Tan SY., Kiu CC., Lukose D. (2012) Evaluating Multiple Choice Question Generator. In: Lukose D., Ahmad A.R., Suliman A. (eds) Knowledge Technology. Communications in Computer and Information Science, vol 295. Springer, Berlin, Heidelberg

Abstract

Semantic-based computer-assisted automated question generator has been increasingly popular as a tool for creating personalized assessment questions.Various question generator tools have been proposed, such as those which generate structured question from a text file, generate Multiple Choice Question (MCQ) from a text file or from ontology-based knowledge representation. A comparison framework and evaluation methodology is required to evaluate different question generator tools. This paper discusses the requirement and criteria to carry out performance comparison of different MCQ generator. A feature comparison of Question Generation (QG) tool, namely Mimos-QG with the existing QG tools is presented. We have evaluated our QG tool based on several standard criteria such as the correctness of (a) distractor generation, (b) answer choice grouping strategy and (c) syntactical and pedagogical quality on three different domain ontologies. The experimental result indicated that Mimos-QG is capable of producing good quality direct type and grouping type multiple choice questions.

Keywords

Question Generator Multiple Choice Question Generator Ontology Semantic Web Education Technology 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Sieow-Yeek Tan
    • 1
  • Ching-Chieh Kiu
    • 1
  • Dickson Lukose
    • 1
  1. 1.Artificial Intelligence CenterMimos Berhad, Technology Park MalaysiaKuala LumpurMalaysia