Listenability Measurement Based on Learners’ Transcription Performance
Language teachers using listening materials on the Internet need to examine the ease of the listening materials (hereafter, listenability) they choose in order to maintain learners’ motivation for listening practice since the listenability of such materials is not controlled, unlike commercially available teaching materials. This study proposes to use a listenability index based on learners’ transcription performance. Transcription performance was determined using the normalized edit distance (hereafter, NED) from a learner’s transcription to a reference sentence. We examined the reliability and validity of NED as a dependent variable for listenability measurement using multiple regression analysis in an experiment comprising 50 learners of English as a foreign language. The results supported the reliability and validity of NED.
KeywordsListenability English as a foreign language Transcription performance Edit distance
The authors would like to thank the anonymous reviewers for their valuable comments and suggestions to improve the quality of the paper. All remaining inadequacies are ours alone. This work was supported by JSPS KAKENHI Grant Numbers, 22300299, 15H02940.
- 1.Kotani, K., Ueda, S., Yoshimi, T., Nanjo, H.: A listenability measuring method for an adaptive computer-assisted language learning and teaching system. In: Proceedings of the 28th Pacific Asia Conference on Language, Information, and Computation, pp. 387–394 (2014)Google Scholar
- 2.Kotani, K., Yoshimi, T.: Learner feature variation in measuring the listenability for learners of English as a foreign language. In: Proceedings of the 1st International Workshop on Emerging Technologies for Language Learning (2016)Google Scholar
- 3.Yoon, S.-Y., Cho, Y., Napolitano, D.: Spoken text difficulty estimation using linguistic features. In: Proceedings of the 11th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 267–276 (2016)Google Scholar
- 6.Brown, D.J.: Testing in Language Programs. Prentice Hall Regents, New Jersey (1996)Google Scholar
- 7.Chall, J.S., Dial, H.E.: Predicting listener understanding and interest in newscasts. Educ. Res. Bull. 27(6), 141–153 + 168 (1948)Google Scholar
- 9.Kiyokawa, J.: A formula for predicting listenability: the listenability of English language materials 2. Wayo Women’s Univ. Lang. Lit. 24, 57–74 (1990)Google Scholar
- 10.Messerklinger, J.: Listenability. Center Engl. Lang. Educ. J. 14, 56–70 (2006)Google Scholar
- 11.International Phonetic Association: Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet. Cambridge University Press, Cambridge (1999)Google Scholar
- 13.Cronbach, L.J.: Essentials of Psychological Testing. Harper & Row, New York (1970)Google Scholar
- 14.Chauncey Group International: TOEIC Technical Manual. Chauncey Group International, New Jersey (1998)Google Scholar
- 15.Lee, I.A., Preacher, K.J.: Calculation for the Test of the Difference Between Two Dependent Correlations with One Variable in Common (2013). http://quantpsy.org
- 16.Neter, J., Kutner, M., Wasserman, W., Nachtsheim, C.: Applied Linear Statistical Models, 4th edn. McGrawHill/Irwin, New York (1996)Google Scholar