ArikIturri: An Automatic Question Generator Based on Corpora and NLP Techniques

  • Itziar Aldabe
  • Maddalen Lopez de Lacalle
  • Montse Maritxalar
  • Edurne Martinez
  • Larraitz Uria
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4053)

Abstract

Knowledge construction is expensive for Computer Assisted Assessment. When setting exercise questions, teachers use Test Makers to construct Question Banks. The addition of Automatic Generation to assessment applications decreases the time spent on constructing examination papers. In this article, we present ArikIturri, an Automatic Question Generator for Basque language test questions, which is independent from the test assessment application that uses it. The information source for this question generator consists of linguistically analysed real corpora, represented in XML mark-up language. ArikIturri makes use of NLP tools. The influence of the robustness of those tools and the used corpora is highlighted in the article. We have proved the viability of ArikIturri when constructing fill-in-the-blank, word formation, multiple choice, and error correction question types. In the evaluation of this automatic generator, we have obtained positive results as regards the generation process and its usefulness.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Aduriz, I., Aranzabe, M.J., Arriola, J.M., de Ilarraza, A.D., Gojenola, K., Oronoz, M., Uria, L.: A Cascaded Syntactic Analyser for Basque. In: Gelbukh, A. (ed.) CICLing 2004. LNCS, vol. 2945, pp. 124–134. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  2. 2.
    Alegria, I., Aranzabe, M., Ezeiza, A., Ezeiza, N., Urizar, R.: Robustness and customisation in an analyser/lemmatiser for Basque. In: LREC 2002 Customizing knowledge in NLP applications workshop (2002)Google Scholar
  3. 3.
    Boyle, A., Russell, T., Smith, S., Varga-Atkins, T.: The eLearning Place: progress report on a complete system for learning and assessment. In: Ashby, M. (ed.) Proceedings of the Eight International Computer Assisted Conference, pp. 71–77 (2004), http://www.caaconference.com/
  4. 4.
    Liu, C.-L., Wang, C.-H., Gao, Z.-M., Huang, S.-M.: Applications of Lexical Information for Algorithmically Composing Multiple choice Cloze Iem. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 1–8 (2005)Google Scholar
  5. 5.
    Conejo, R., Guzmán, E., Millán, E., Trella, M., Pérez-De-La-Cruz, J.L., Ríos, A.: SIETTE: A Web-Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14(1), 29–61 (2004)Google Scholar
  6. 6.
    Díaz de Ilarraza, A., Maritxalar, M., Oronoz, M.: IDAZKIDE: an intelligent CALL environment for second language acquisition. In: Proceedings of a One-day Conference Natural Language Processing in Computer-Assisted Language Learning organised by the Centre for Computational Linguistics, UMIST, in association with EUROCALL. a special Re-CALL publication, UK, pp. 12–19 (1999)Google Scholar
  7. 7.
    Hoshino, A., Nakagawa, H.: A real-time multiple-choice question generation for language testing. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 17–20 (2005)Google Scholar
  8. 8.
    Kerejeta, M., Larrañaga, M., Rueda, U., Arruarte, A., Elorriaga, J.A.: A Computer Assisted Assessment Tool Integrated in a Real Use Context. In: Proceedings of the 5th IEEE International Conference on Advanced Learning Technologies, ICALT, pp. 848–852 (2005)Google Scholar
  9. 9.
    Kraift, O., Antoniadis, G., Echinard, S., Loiseau, M., Lebarbé, T., Ponton, C.: NLP Tools for CALL: the Simpler, the Better. In: Proceedings of the InSTIL/ICALL2004 – NLP and Speech Technologies in Advanced Language Learning Systems, Venice (2004)Google Scholar
  10. 10.
    Mitkov, R., An, L.: Computer-aided generation of multiple-choice tests. In: Proceedings of the 1st Workshop on Building Educational Applications Using NLP. HLT-NAACL, pp. 17–22 (2003)Google Scholar
  11. 11.
    Pollock, M.J., Whittington, C.D., Doughty, G.F.: Evaluating the Costs and Benefits of Changing to CAA. In: Proceedings of the Fourth International Computer Assisted Conference CAA (2000), http://www.caaconference.com/
  12. 12.
    Schwartz, L., Aikawa, T., Pahud, M.: Dynamic Language Learning Tools. In: Proceedings of the InSTIL/ICALL2004 – NLP and Speech Technologies in Advanced Language Learning Systems, Venice (2004)Google Scholar
  13. 13.
    Sumita, E., Sugaya, F., Yamamota, S.: Measuring Non-native Speakers’ Proficiency of English by Using a Test with Automatically-Generated Fill-in-the Blank Questions. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 61–68 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Itziar Aldabe
    • 1
  • Maddalen Lopez de Lacalle
    • 1
  • Montse Maritxalar
    • 1
  • Edurne Martinez
    • 2
  • Larraitz Uria
    • 1
  1. 1.Department of Computer Languages and Systems, Computer Engineering FacultyUniversity of the Basque CountryDonostiaSpain
  2. 2.Computer Science DepartmentUdako Euskal Unibertsitatea (UEU), ELEKA Language Engineering Enterprise 

Personalised recommendations