Advertisement

Rolling out Text Categorization for Language Learning Assessment Supported by Language Technology

  • António Branco
  • João Rodrigues
  • Francisco Costa
  • João Silva
  • Rui Vaz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8775)

Abstract

This paper is concerned with a tool that supports human experts in their task of classifying text excerpts suitable to be used in quizzes for learning materials and as items of exams that are aimed at assessing and certifying the language level of students taking courses of Portuguese as a second language.

We assess the performance of this tool, which is currently available as an online service and is being used by the experts of the team of Camões IP that is responsible for the elaboration of the quizzes and of exam items to be used in language certification exams.

Keywords

Language learning assessment readability assessment text categorization second language skills certification Portuguese language 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Branco, A., Rodrigues, J., Costa, F., Silva, J., Vaz, R.: Text Classification for Interactive Language Learning (forth)Google Scholar
  2. 2.
    Council of Europe (2011), consulted on http://www.coe.int/t/dg4/linguistic/Cadre1_en.asp (March 31, 2014)
  3. 3.
    DuBay, W.: The Principles of Readability. Impact Information, Costa Mesa (2004)Google Scholar
  4. 4.
    Flesch, R.: How to write in plain English: A book for lawyers and consumers. Harper, New York (1979)Google Scholar
  5. 5.
    Branco, A., Silva, J.: Evaluating Solutions for the Rapid Development of State-of-the-Art POS Taggers for Portuguese. In: Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), pp. 507–510. ELRA, Paris (2004)Google Scholar
  6. 6.
    Branco, A., Silva, J.: LX-Suite: Shallow Processing Tools for Portuguese. In: Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2006), Trento, Italy, pp. 179–182 (2006)Google Scholar
  7. 7.
    Silva, J., Branco, A., Castro, S., Reis, R.: Out-of-the-Box Robust Parsing of Portuguese. In: Pardo, T.A.S., Branco, A., Klautau, A., Vieira, R., de Lima, V.L.S. (eds.) PROPOR 2010. LNCS (LNAI), vol. 6001, pp. 75–85. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  8. 8.
    Fleiss, J.L.: Statistical methods for rates and proportions, 2nd edn., pp. 38–46. John Wiley, New York (1981)zbMATHGoogle Scholar
  9. 9.
    Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • António Branco
    • 1
  • João Rodrigues
    • 1
  • Francisco Costa
    • 1
  • João Silva
    • 1
  • Rui Vaz
    • 2
  1. 1.Departamento de Informática, Faculdade de CiênciasUniversidade de LisboaPortugal
  2. 2.Divisão de Programação, Formação e CertificaçãoCamões IPPortugal

Personalised recommendations