Vocabulary Recognition Skill as a Screening Tool in English-as-a-Lingua-Franca University Settings

  • Thomas Roche
  • Michael Harrington
  • Yogesh Sinha
  • Christopher Denman


Research has shown that vocabulary recognition skill is a readily measured and relatively robust predictor of second language performance in university settings in English-speaking countries. This study builds on that research by developing an understanding of the relationship between word recognition skill and Academic English performance in English-medium instruction (EMI) university programs in English-as-a-lingua-franca (ELF) contexts. The use of a Timed Yes/No (TYN) test of vocabulary recognition skill was assessed as a screening tool in two EMI university foundation programs in an Arab Gulf State: in a metropolitan state university (N = 93) and a regional private institution (N = 71). Pearson correlation coefficients between the TYN test and performance on university placement and final test scores ranged between 0.3 and 0.6 across the two groups and by gender within those groups. This study indicates the TYN test measures have predictive value in university ELF settings for screening purposes. The trade-off between validity, reliability, usability and the cost-effectiveness of the TYN test in academic ELF settings are discussed with consideration of test-takers’ digital literacy levels.


Screening Academic English Placement testing Vocabulary recognition English as a Lingua Franca Digital literacy 


  1. Abu Rabia, S., & Seigel, L. S. (1995). Different orthographies, different context effects: The effects of Arabic sentence context in skilled and poor readers. Reading Psychology, 16, 1–19.CrossRefGoogle Scholar
  2. Agustín Llach, M. P., & Terrazas Gallego, M. (2012). Vocabulary knowledge development and gender differences in a second language. Estudios de Lingüística Inglesa Aplicada, 12, 45–75.Google Scholar
  3. Alderson, J. C., & Banerjee, J. (2001). Language testing and assessment (part 1). State-of-the-art review. Language Testing, 18, 213–236.Google Scholar
  4. Al-Hazemi, H. (2001). Listening to the Y/N vocabulary test and its impact on the recognition of words as real or non-real. A case study of Arab learners of English. IRAL, 38(2), 81–94.Google Scholar
  5. Ammon, U. (2006). The language of tertiary education. In E. K. Brown (Ed.), Encyclopaedia of languages & linguistics (pp. 556–559). Amsterdam: Elsevier.CrossRefGoogle Scholar
  6. Bayliss, A., & Ingram D. E. (2006). IELTS as a predictor of academic language performance. Paper presented at the Australian International Education Conference. Retrieved from http://www.aiec.idp.com.
  7. Bernhardt, E., Rivera, R. J., & Kamil, M. L. (2004). The practicality and efficiency of web-based placement testing for college-level language programs. Foreign Language Annals, 37(3), 356–366.CrossRefGoogle Scholar
  8. Broad Band Commission. (2012). The state of broadband 2012: Achieving digital inclusion for all. Retrieved from www.boradbandcommission.org.
  9. Chaney, M. (2013). Australia: Educating globally. Retrieved from https://aei.gov.au/IEAC2/theCouncilsReport.
  10. Chui, A. S. Y. (2006). A study of the English vocabulary knowledge of university students in Hong Kong. Asian Journal of English Language Teaching, 16, 1–23.Google Scholar
  11. Cortese, M. J., & Balota, D. A. (2013). Visual word recognition in skilled adult readers. In M. J. Spivey, K. McRae, & M. F. Joanisse (Eds.), The Cambridge handbook of psycholinguistics (pp. 159–185). New York: Cambridge University Press.Google Scholar
  12. Cotton, F., & Conrow, F. (1998). An investigation of the predictive validity of IELTS amongst a sample of international students studying at the University of Tasmania (IELTS Research Reports, Vol. 1, pp. 72–115). Canberra: IELTS Australia.Google Scholar
  13. Dodorico-McDonald, J. (2008). Measuring personality constructs: The advantages and disadvantages of self-reports, informant reports and behavioural assessments. Enquire, 1(1). Retrieved from www.nottingham.ac.uk/shared/McDonald.pdf.
  14. Elder, C., & von Randow, J. (2008). Exploring the utility of a web-based English language screening tool. Language Assessment Quarterly, 5(3), 173–194.CrossRefGoogle Scholar
  15. Elder, C., Bright, C., & Bennett, S. (2007). The role of language proficiency in academic success: Perspectives from a New Zealand university. Melbourne Papers in Language Testing, 12(1), 24–28.Google Scholar
  16. Espinosa, S. M. (2010). Boys’ and girls’ L2 word associations. In R. M. Jiménez Catalán (Ed.), Gender perspectives on vocabulary in foreign and second languages (pp. 139–163). Chippenham: Macmillan.CrossRefGoogle Scholar
  17. Evans, S., & Morrison, B. (2011). Meeting the challenges of English-medium higher education: The first-year experience in Hong Kong. English for Specific Purposes, 30(3), 198–208.CrossRefGoogle Scholar
  18. Fender, M. (2003). English word recognition and word integration skills of native Arabic- and Japanese-speaking learners of English as a second language. Applied Psycholinguistics, 24(3), 289–316.Google Scholar
  19. Harrington, M. (2006). The lexical decision task as a measure of L2 lexical proficiency. EUROSLA Yearbook, 6, 147–168.CrossRefGoogle Scholar
  20. Harrington, M., & Carey, M. (2009). The on-line yes/no test as a placement tool. System, 37, 614–626.CrossRefGoogle Scholar
  21. Harrington, M., & Roche, T. (2014). Post–enrolment language assessment for identifying at–risk students in English-as-a-Lingua-Franca university settings. Journal of English for Academic Purposes, 15, 37–47.CrossRefGoogle Scholar
  22. Humphreys, P., Haugh, M., Fenton-Smith, B., Lobo, A., Michael, R., & Walkenshaw, I. (2012).Tracking international students’ English proficiency over the first semester of undergraduate study. IELTS Research Reports Online Series, 1. Retrieved from http://www.ielts.org.
  23. Jenkins, J. (2007). English as a Lingua Franca: Attitudes and identity. Oxford: Oxford University Press.Google Scholar
  24. Jenkins, J. (2012). English as a Lingua Franca from the classroom to the classroom. ELT Journal, 66(4), 486–494. doi:10.1093/elt/ccs040.CrossRefGoogle Scholar
  25. Jiménez Catalán, R. M. (2010). Gender tendencies in EFL across vocabulary tests. In R. M. Jiménez Catalán (Ed.), Gender perspectives on vocabulary in foreign and second languages (pp. 117–138). Chippenham: Palgrave Macmillan.CrossRefGoogle Scholar
  26. Just, M. A., & Carpenter, P. A. (1992). A capacity theory of comprehension: Individual differences in working memory. Psychological Review, 98(1), 122–149.CrossRefGoogle Scholar
  27. Kokhan, K. (2012). Investigating the possibility of using TOEFL scores for university ESL decision-making: Placement trends and effect of time lag. Language Testing, 29(2), 291–308.CrossRefGoogle Scholar
  28. Lam, Y. (2010). Yes/no tests for foreign language placement at the post-secondary level. Canadian Journal of Applied Linguistics, 13(2), 54–72.Google Scholar
  29. Laufer, B. (1992). Reading in a foreign language: How does L2 lexical knowledge interact with the reader’s general academic ability? Journal of Research in Reading, 15(2), 95–103.CrossRefGoogle Scholar
  30. Laufer, B., & Nation, I. S. P. (1999). A vocabulary size test of controlled productive ability. Language Testing, 16(1), 33–51.CrossRefGoogle Scholar
  31. Lee, Y., & Greene, J. (2007). The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1, 366–389.CrossRefGoogle Scholar
  32. Loewen, S., & Ellis, R. (2004). The relationship between English vocabulary skill and the academic success of second language university students. New Zealand Studies in Applied Linguistics, 10, 1–29.Google Scholar
  33. McCarthy, M. (2003). Vocabulary. Oxford: Oxford University Press.Google Scholar
  34. Meara, P., & Buxton, B. (1987). An alternative multiple-choice vocabulary test. Language Testing, 4, 142–145.CrossRefGoogle Scholar
  35. Meara, P., & Jones, G. (1988). Vocabulary size as a placement indicator. In P. Grunwell (Ed.), Applied linguistics in society (pp. 80–87). London: Centre for Information on Language Teaching and Research.Google Scholar
  36. Mehrpour, S., Razmjoo, S. A., & Kian, P. (2011). The relationship between depth and breadth of vocabulary knowledge and reading comprehension among Iranian EFL learners. Journal of English Language Teaching and Learning, 53, 97–127.Google Scholar
  37. Milton, J. (2009). Measuring second language vocabulary acquisition. Bristol: Multilingual Matters.Google Scholar
  38. Nation, I. S. P. (1983). Learning vocabulary. New Zealand Language Teacher, 9(1), 10–11.Google Scholar
  39. Nation, I. S. P. (1990). Teaching and learning vocabulary. Boston: Heinle & Heinle.Google Scholar
  40. Nation, I. S. P. (2006). How large a vocabulary is needed for reading and listening? The Canadian Modern Language Review/La Revue Canadienne des Langues Vivantes, 63(1), 59–81.CrossRefGoogle Scholar
  41. Nation, I. S. P. (2007). Fundamental issues in modelling and assessing vocabulary knowledge. In H. Daller, J. Milton, & J. Treffers-Daller (Eds.), Modelling and assessing vocabulary knowledge (pp. 35–43). Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  42. Oman Academic Accreditation Authority. (2008). The Oman academic standards for general foundation programs. Retrieved from http://www.oac.gov.om/.
  43. Perfetti, C. A. (2007). Reading ability: Lexical quality to comprehension. Scientific Studies of Reading, 11(4), 357–383.CrossRefGoogle Scholar
  44. Qian, D. D. (2002). Investigating the relationship between vocabulary knowledge and academic reading performance: An assessment perspective. Language Learning, 52(3), 513–536.CrossRefGoogle Scholar
  45. Read, J. (2004). Plumbing the depths: How should the construct of vocabulary knowledge be defined? In P. Bogaards & B. Laufer (Eds.), Vocabulary in a second language: Selection, acquisition and testing (pp. 209–227). Amsterdam: John Benjamins.CrossRefGoogle Scholar
  46. Read, J., & Chapelle, C. A. (2001). A framework for second language vocabulary assessment. Language Testing, 18(1), 1–32.CrossRefGoogle Scholar
  47. Roche, T., & Harrington, M. (2013). Recognition vocabulary knowledge as a predictor of academic performance in an English-as-a-foreign language setting. Language Testing in Asia, 3(12), 133–144.Google Scholar
  48. Saigh, K., & Schmitt, N. (2012). Difficulties with vocabulary word form: The case of Arabic ESL learners. System, 40, 24–36. doi:10.1016/j.system.2012.01.005.CrossRefGoogle Scholar
  49. Schmitt, N., Jiang, X., & Grabe, W. (2011). The percentage of words known in a text and reading comprehension. The Modern Language Journal, 95, 26–43. doi:10.1111/j.1540-4781.2011.01146.x.CrossRefGoogle Scholar
  50. Schmitt, N., Cobb, T., Horst, M., & Schmitt, D. (2015). How much vocabulary is needed to use English? Replication of Van Zeeland & Schmitt (2012), Nation (2006) and Cobb (2007). Language Teaching, 1–15.Google Scholar
  51. Segalowitz, N., & Segalowitz, S. (1993). Skilled performance, practice, and the differentiation of speed-up from automatization effects: Evidence from second language word. Applied Psycholinguistics, 14, 369–385.CrossRefGoogle Scholar
  52. Seidlhofer, B. (2011). Understanding English as a Lingua Franca. Oxford: Oxford University Press.Google Scholar
  53. Shiotsu, T. (2001). Individual differences in L2 word recognition speed: a measurement perspective. Bulletin of the Institute of Foreign Language Education Kurume University, 8, 63–77. Retrieved from http://www.lognostics.co.uk
  54. Stæhr, L. S. (2009). Vocabulary knowledge and advanced listening comprehension in English as a foreign language. Studies in Second Language Acquisition, 31, 577–607.CrossRefGoogle Scholar
  55. Tilak, J. B. G. (2011). Trade in higher education: The role of the General Agreement on Trade in Services (GATS) (Fundamentals of Educational Planning, Vol. 95, p. 154). Paris: UNESCO.Google Scholar
  56. Wang, L., Eignor, D., & Enright, M. K. (2008). A final analysis. In C. A. Chapelle, M. K. Enright, & J. M. Jamieson (Eds.), Building a validity argument for the test of English as a foreign language (pp. 259–318). New York: Routledge.Google Scholar
  57. Webb, S., & Paribakht, T. S. (2015). What is the relationship between the lexical profile of test items and performance on a standardized English proficiency test? English for Specific Purposes, 38, 34–43.CrossRefGoogle Scholar
  58. Wesche, M., & Paribakht, T. S. (1996). Assessing second language vocabulary knowledge: Depth versus breadth. Canadian Modern Language Review, 53, 13–40.Google Scholar
  59. Wesche, M., Paribakht, T. S., & Ready, D. (1996). A comparative study of four ESL placement instruments. In M. Milanovic & N. Saville (Eds.), Performance testing, cognition and assessment: Selected papers from the 15th Language Testing Research Colloquium (LTRC), Cambridge and Arnhem (pp. 199–209). Cambridge: Cambridge University Press.Google Scholar
  60. World Bank. (2013). Internet users (per 100 people). Retrieved http://data.worldbank.org/indicator/IT.NET.USER.P2.
  61. Yushau, B., & Omar, M. H. (2007). Preparatory year program courses as predictors of first calculus course grade. Mathematics and Computer Education, 41(2), 92–108.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Thomas Roche
    • 1
  • Michael Harrington
    • 2
  • Yogesh Sinha
    • 3
  • Christopher Denman
    • 4
  1. 1.SCU CollegeSouthern Cross UniversityLismoreAustralia
  2. 2.School of Languages and CulturesUniversity of QueenslandBrisbaneAustralia
  3. 3.Department of English Language TeachingSohar UniversityAl SoharOman
  4. 4.Humanities Research CenterSultan Qaboos UniversityMuscatOman

Personalised recommendations