EFL Learner Reading Time Model for Evaluating Reading Proficiency

  • Katsunori Kotani
  • Takehiko Yoshimi
  • Takeshi Kutsumi
  • Ichiko Sata
  • Hitoshi Isahara
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4919)

Abstract

We propose a reading time model for learners of English as a foreign language (EFL) that is based on a learner’s reading proficiency and the linguistic properties of sentences. Reading proficiency here refers to a learner’s reading score on the Test of English for International Communications (TOEIC), and the linguistic properties are the lexical, syntactic and discourse complexities of a sentence. We used natural language processing technology to automatically extract these linguistic properties, and developed a model using multiple regression analysis as a learning algorithm in combining the learner’s proficiency and linguistic properties. Experimental results showed that our reading time model predicted sentence-reading time with a 22.9% error rate, which is lower than the models constructed based on linguistic properties proposed in previous studies.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Alderson, J.C.: Assessing Reading. Cambridge University Press, Cambridge (2000)Google Scholar
  2. 2.
    Bell, T.: Extensive reading: Speed and comprehension. The Reading Matrix, 1(1) (2001)Google Scholar
  3. 3.
    Carver, R.P.: Optimal rate of reading prose. Reading Research Quarterly 18(1), 56–88 (1982)CrossRefGoogle Scholar
  4. 4.
    Flesch, R.: A new readability yardstick. Journal of Applied Psychology 32, 221–233 (1948)CrossRefGoogle Scholar
  5. 5.
    Frazier, L., Rayner, K.: Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology 14, 178–210 (1982)CrossRefGoogle Scholar
  6. 6.
    JACET. JACET 4000 Basic Words. The Japan Association of College English Teachers, Tokyo (1993)Google Scholar
  7. 7.
    Just, M.A., Carpenter, P.A.: The Psychology of Reading and Language Comprehension. Allyn and Bacon, Newton (1987)Google Scholar
  8. 8.
    Kotani, K., et al.: Effects of syntactic factors on EFL learners’ reading time. Information Technology Letters 6, 457–460 (2007)Google Scholar
  9. 9.
    Lougheed, L.: How to Prepare for the TOEIC Test: Test of English for International Communication. Barron’s Educational Series, Inc., Hauppanuge, New York (2003)Google Scholar
  10. 10.
    Naganuma, N., Wada, T.T.: Measurement of English reading ability by reading speed and text readability. JLTA Journal 5, 34–52 (2002)Google Scholar
  11. 11.
    Nagata, R., et al.: A method of rating English reading skill automatically: Rating English reading skill using reading speed. Computer & Education 12, 99–103 (2002)Google Scholar
  12. 12.
    Sano, H., Ino, M.: Measurement of difficulty on English grammar and automatic analysis. IPSJ SIG Notes 117, 5–12 (2000)Google Scholar
  13. 13.
    Schwarm, S.E., Ostendorf, M.: Reading level assessment using support vector machines and statistical language models. In: Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics, pp. 523–530 (2005)Google Scholar
  14. 14.
    Sekine, S., Grishman, A.: A corpus-based probabilistic grammar with only two non-terminals. In: Proceedings of the 4th International Workshop on Parsing Technologies, pp. 216–223 (1995)Google Scholar
  15. 15.
    Shizuka, T.: The effects of stimulus presentation mode, question type, and reading speed incorporation on the reliability/validity of a computer-based sentence reading test. JACET Bulletin 29, 155–172 (1998)Google Scholar
  16. 16.
    Smith, E.A., Kincaid, P.: Derivation and validation of the automated readability index for use with technical materials. Human Factors 12, 457–464 (1970)Google Scholar
  17. 17.
    Someya, Y.: Word Level Checker: Vocabulary Profiling Program by AWK, Ver. 1.5 (2000) (consulted November 6, 2006), http://www1.kamakuranet.ne.jp/someya/wlc/wlc_manual.html
  18. 18.
    The Chauncery Group International, Ltd., TOEIC Technical Manual, The Chauncery Group International, Ltd., Princeton, NJ (1998)Google Scholar
  19. 19.
    Yoshimi, T., et al.: A method of measuring reading time for assessing EFL-learners’ reading ability. Transactions of Japanese Society for Information and Systems in Education 22(1), 24–29 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Katsunori Kotani
    • 1
    • 2
  • Takehiko Yoshimi
    • 3
    • 2
  • Takeshi Kutsumi
    • 4
  • Ichiko Sata
    • 4
  • Hitoshi Isahara
    • 2
  1. 1.Kansai Gaidai UniversityHirakataJapan
  2. 2.National Institute of Information and Communications TechnologySoraku-gunJapan
  3. 3.Ryukoku UniversityOtsuJapan
  4. 4.Sharp CorporationYamatokoriyamaJapan

Personalised recommendations