Advertisement

Automatic Generation of Text-Based Open Cloze Exercises

  • Alexey MalafeevEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 436)

Abstract

This article presents an approach to the automatic generation of open cloze exercises that are based on real-life English texts. The exercise format is similar to the open cloze test used in Cambridge certificate exams (FCE, CAE, CPE). Two experiments were conducted to evaluate the usefulness on the machine-generated exercises and compare them with authentic Cambridge tests. The experiments showed that the generation method used was quite effective. With some customization, the presented method can be applied to generating similar exercises based on texts written in other languages.

Keywords

Exercise generation Open cloze Language exercises Computer-assisted language learning (CALL) English as a foreign language (EFL) 

References

  1. 1.
    Cambridge English: Advanced Handbook for Teachers (2012)Google Scholar
  2. 2.
    Lee, S.H.: Beyond reading and proficiency assessment: The rational cloze procedure as stimulus for integrated reading, writing, and vocabulary instruction and teacher-student interaction in ESL. System 36, 642–660 (2008)CrossRefGoogle Scholar
  3. 3.
    Chalhoub-Deville, M., Turner, C.E.: What to look for in ESL admission tests: Cambridge certificate exams, IELTS, and TOEFL. System 28, 523–539 (2000)CrossRefGoogle Scholar
  4. 4.
    Heilman, M., Collins-Thompson, K., Callan, J., Eskenazi, M., Juffs, A., Wilson, L.: Personalization of reading passages improves vocabulary acquisition. Int. J. Artif. Intell. Educ. 20, 73–98 (2010)Google Scholar
  5. 5.
    Sonntag, M.: Exercise generation by group models for autonomous web-based learning. In: 35th Euromicro Conference on Software Engineering and Advanced Applications, SEAA ’09, pp. 57–63 (2009)Google Scholar
  6. 6.
    Almeida, J.J., Araujo, I., Brito, I., Carvalho, N., Machado, G.J., Pereira, R.M.S., Smirnov, G.: PASSAROLA: High-order exercise generation system. In: 2013 8th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–5 (2013)Google Scholar
  7. 7.
    Mitkov, R., Ha, A.L., Karamanis, N.: A computer-aided environment for generating multiple-choice test items. Nat. Lang. Eng. 12, 177–194 (2006)CrossRefGoogle Scholar
  8. 8.
    Gates, D.M.: Automatically generating reading comprehension look-back strategy: Questions from expository texts (2008)Google Scholar
  9. 9.
    Antonsen, L., Johnson, R., Trondsterud, T., Uibo, H.: Generating modular grammar exercises with finite-state transducers. In: Proceedings of Second Workshop NLP Computer-Assisted Language Learning, NODALIDA 2013, pp. 27–38 (2013)Google Scholar
  10. 10.
    Aldabe, I., de Lacalle, M.L., Maritxalar, M., Martinez, E., Uria, L.: ArikIturri: An automatic question generator based on corpora and NLP techniques. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 584–594. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Dickinson, M., Herring, J.: Developing online ICALL exercises for Russian. In: Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications, pp. 1–9. Association for Computational Linguistics, Stroudsburg, PA, USA (2008)Google Scholar
  12. 12.
    Bick, E.: Live use of corpus data and corpus annotation tools in CALL: Some new developments in VISL. Nord. Lang. Technol. Aarb. Nord. Sprogteknologisk Forskningsprogram, pp. 171–185 (2005)Google Scholar
  13. 13.
    Meurers, D., Ziai, R., Amaral, L., Boyd, A., Dimitrov, A., Metcalf, V., Ott, N.: Enhancing authentic web pages for language learners. In: Proceedings of the NAACL HLT 2010 Fifth Workshop on Innovative Use of NLP for Building Educational Applications, pp. 10–18. Association for Computational Linguistics, Stroudsburg, PA, USA (2010)Google Scholar
  14. 14.
    Heilman, M., Eskenazi, M.: Application of automatic thesaurus extraction for computer generation of vocabulary questions. In: Proceedings of the SLaTE Workshop on Speech and Language Technology in Education, pp. 65–68 (2007)Google Scholar
  15. 15.
    Perez-Beltrachini, L., Gardent, C., Kruszewski, G.: Generating grammar exercises. In: Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, pp. 147–156. Association for Computational Linguistics, Stroudsburg, PA, USA (2012)Google Scholar
  16. 16.
    Burstein, J., Marcu, D.: Translation exercise assistant: Automated generation of translation exercises for native-arabic speakers learning english. In: Proceedings of HLT/EMNLP on Interactive Demonstrations, pp. 16–17. Association for Computational Linguistics, Stroudsburg, PA, USA (2005)Google Scholar
  17. 17.
    Sumita, E., Sugaya, F., Yamamoto, S.: Measuring non-native speakers’ proficiency of english by using a test with automatically-generated fill-in-the-blank questions. In: Proceedings of the Second Workshop on Building Educational Applications Using NLP, pp. 61–68. Association for Computational Linguistics, Stroudsburg, PA, USA (2005)Google Scholar
  18. 18.
    Hoshino, A., Nakagawa, H.: WebExperimenter for multiple-choice question generation. In: Proceedings of HLT/EMNLP on Interactive Demonstrations, pp. 18–19. Association for Computational Linguistics, Stroudsburg, PA, USA (2005)Google Scholar
  19. 19.
    Goto, T., Kojiri, T., Watanabe, T., Iwata, T., Yamada, T.: Automatic generation system of multiple-choice cloze questions and its evaluation. Knowl. Manag. E-Learn. Int. J. KMEL. 2, 210–224 (2010)Google Scholar
  20. 20.
    Knoop, S., Wilske, S.: WordGap - Automatic generation of gap-filling vocabulary exercises for mobile learning. In: Proceedings of Second Workshop NLP Computer-Assisted Language Learning at NODALIDA 2013, pp. 39–47 (2013)Google Scholar
  21. 21.
    Kurtasov, A.: A System for generating cloze test items from Russian-language text. In: Proceedings of the Student Research Workshop Associated with RANLP, pp. 107–112 (2013)Google Scholar
  22. 22.
    Stenner, A.J.: Measuring reading comprehension with the lexile framework. In: Fourth North American Conference on Adolescent/Adult Literacy. Washington D.C. (1996)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.National Research University Higher School of EconomicsNizhny NovgorodRussia

Personalised recommendations