Abstract
The validity of two measures of English reading comprehension was examined across three different groups of English language learners (ELLs; 64 Portuguese, 66 Spanish and 65 Cantonese). All three groups were achieving within the average range in second grade. An exploratory principal components analysis of reading skills was carried out to determine which skills were related to two commonly used tests of reading comprehension, the Woodcock Language Proficiency Battery’s test of Passage Comprehension (WLPB-PC; Woodcock, 1991) and the Gray Oral Reading Test-4 (GORT-4; Wiederholt & Bryant, 2001). The factor solutions were different for the three language groups but showed many similarities in that the GORT-4 and WLPB-R tests of reading comprehension fell on the same factor within each group. Hierarchical regression analyses examining relationships among vocabulary, decoding and reading comprehension showed that language group membership did not significantly predict performance on either measure of reading comprehension. Differences that arose are likely due to issues with task validity and not ELL status. Limitations and future research are discussed.
Similar content being viewed by others
Notes
No significant differences were found for the Spanish speaking students (ps > .14) across location. There were two significant differences between the Portuguese speakers in two areas, where the students from the smaller metropolitan area outperformed the students from the larger area on rapid naming of letters, F (1, 62) = 5.34, p < .05, and on the GORT comprehension measure, F (1, 62) = 6.34, p < .05. Due to the differences in sample size across these two locations (N = 10–56), it is difficult to determine whether these effects would persist with larger, and more equal samples. Similarly, due to the large number of schools (N = 28) and the small number of participants per school (range 1–17, median = 5) school effects could not be statistically controlled (see “Appendix” for a discussion of school effects).
References
Aarnoutse, C., van Leeuwe, J., Voeten, M., & Oud, H. (2001). Development of decoding, reading comprehension, vocabulary and spelling during the elementary school years. Reading and Writing: An Interdisciplinary Journal, 14, 61–89.
Arts, R., & Verhoeven, L. (1999). Literacy attainment in second language submersion context. Applied Psycholinguistics, 20, 377–393.
August, D., Carlo, M., Dressler, C., & Snow, C. (2005). The critical role of vocabulary development for English language learners. Learning Disabilities Research & Practice, 20, 50–57.
August, D., & Shanahan, T. (2006). Developing literacy in second-language learners: A report of the National Literacy Panel on Language-Minority Children and Youth. Mahwah, NJ: Erlbaum.
Bialystok, E. (2007). Acquisition of literacy in bilingual children: A framework for research. Language Learning, 57, 45–77.
Bialystok, E., Luk, G., & Kwan, E. (2005). Bilingualism, biliteracy, and learning to read: Interactions among languages and writing systems. Scientific Studies of Reading, 9, 43–61.
Bialystok, E., Majumder, S., & Martin, M. (2003). Developing phonological awareness: Is there a bilingual advantage? Applied Psycholinguistics, 24, 27–44.
Biemiller, A., & Slomin, N. (2001). Estimating root word vocabulary growth in normative and advantaged populations: Evidence for a common sequence of vocabulary acquisition. Journal of Educational Psychology, 93, 498–520.
Braze, D., Tabor, W., Shankweiler, D. P., & Mencl, W. E. (2007). Speaking up for vocabulary: Reading skill differences in young adults. Journal of Learning Disabilities, 40, 226–243.
Cain, K., Oakhill, J., & Bryant, P. (2004). Children’s reading comprehension ability: Concurrent prediction by working memory, verbal ability, and component skills. Journal of Educational Psychology, 96, 31–42.
Carlisle, J. F., Beeman, M., Davis, L. H., & Spharim, G. (1999). Relationship of metalinguistic capabilities and reading achievement for children who are becoming bilingual. Applied Psycholinguistics, 20, 459–478.
Carver, R. P. (1997). Reading for one second, one minute, or one year from the perspective of rauding theory. Scientific Studies of Reading, 1, 3–43.
Castles, A., & Coltheart, M. (2004). Is there a causal link from phonological awareness to success in learning to read? Cognition, 91, 71–111.
Catts, H. W., Hogan, T. P., & Adolf, S. M. (2005). Developmental changes in reading and reading disabilities. In H. W. Catts & A. G. Kamhi (Eds.), The connections between language and reading disabilities (pp. 25–40). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Chall, J. S. (1996). Learning to read: The great debate (3rd ed.). New York, NY: McGraw-Hill.
Chiappe, P., & Siegel, L. (1999). Phonological awareness and reading acquisition in English-and Punjabi-speaking Canadian children. Journal of Educational Psychology, 91, 20–28.
Chiappe, P., Siegel, L., & Gottardo, A. (2002a). Reading related skills of kindergarteners from diverse linguistic backgrounds. Applied Psycholinguistics, 23, 95–116.
Chiappe, P., Siegel, L., & Wade-Woolley, L. (2002b). Linguistic diversity and the development of reading skills: A longitudinal study. Scientific Studies of Reading, 6, 369–400.
Costell, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment Research & Evaluation, 10(7). Available online: http://pareonline.net/getvn.asp?v=1-&n=7.
Cummins, J. (1991). Interdependence of first- and second-language proficiency in bilingual children. In E. Bialystok (Ed.), Language processing in bilingual children (pp. 70–89). New York, NY: Cambridge University Press.
Cutting, L. E., & Scarborough, H. S. (2006). Prediction of reading comprehension: Relative contributions of word recognition, language proficiency, and other cognitive skills can depend on how comprehension is measured. Scientific Studies of Reading, 10, 277–299.
D’Angiulli, D., Siegel, L. S., & Maggi, S. (2004). Literacy instruction, SES, and word-reading achievement in English-language learners and children with English as a first language: A longitudinal study. Learning Disabilities Research & Practice, 19, 202–213.
D’Angiulli, A., Siegel, L., & Serra, E. (2001). The development of reading in English and Italian in bilingual children. Applied Psycholinguistics, 22, 479–507.
DaFontoura, H. A., & Siegel, L. S. (1995). Reading, syntactic, and working memory skills of bilingual Portuguese-English Canadian children. Reading and Writing: An Interdisciplinary Journal, 7, 139–153.
DeHouwer, A. (2005). Early bilingual acquisition: Focus on morphosyntax and the separate development hypothesis. In J. F. Kroll & A. M. de Groot (Eds.), Handbook of bilingualism: Psycholinguistic approaches (pp. 30–48). New York, NY: Oxford University Press.
Droop, M., & Verhoeven, L. (1998). Language proficiency and reading ability in first- and second- language learners. Reading Research Quarterly, 38, 78–103.
Dunn, L., & Dunn, L. (1997). The peabody-picture vocabulary test-III. Circle Pines, MN: American Guidance Service.
Durgunoglu, A., Nagy, W., & Hancin-Bhatt, B. (1993). Cross-language transfer of phonological awareness. Journal of Educational Psychology, 85, 453–465.
Ensminger, M. E., & Fothergill, K. (2003). A decade of measuring SES: What it tells us and where to go from here. In M. H. Bornstein & R. H. Bradley (Eds.), Socioeconomic status, parenting and child development. Monographs in parenting series (pp. 13–27). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Entwisle, D. R., & Astone, N. M. (1994). Some practical guidelines for measuring youth’s race/ethnicity and socioeconomic status. Child Development, 65, 1521–1540.
Farnia, F., & Geva, E. (2011). Cognitive correlates of vocabulary growth in English language learners. Applied Psycholinguistics, 32, 711–738.
Flege, J. E. (1992). Speech learning in a second language. In C. Ferguson, L. Menn, & C. Stoel Gammon (Eds.), Phonological development: Models, research, and implications (pp. 565–604). Timonium, MD: York.
Francis, D. J., Fletcher, J. M., Catts, H. W., & Tomblin, J. B. (2005). Dimensions affecting the assessment of reading comprehension. In S. G. Paris & S. A. Stahl (Eds.), Children’s reading comprehension and assessment (pp. 369–394). Mahwah, NJ: Erlbaum.
Francis, D. J., Snow, C. E., August, D., Carlson, C., Miller, J., & Iglesias, A. (2006). Measures of reading comprehension: A latent variable analysis of the diagnostic assessment of reading comprehension. Scientific Studies of Reading, 10, 301–322.
Gersten, R., & Baker, S. (2000). What we know about effective instructional practices for English language learners. Exceptional Children, 66, 454–470.
Geva, E. (2006). Second language oral proficiency and second language literacy. In D. August & T. Shanahan (Eds.), Developing literacy in second-language learners: A report of the National Literacy Panel on Language-Minority Children and Youth. NJ: Erlbaum.
Geva, E., & Siegel, L. (2000). Orthographic and cognitive factors in the concurrent development of basic reading skills in two languages. Reading and Writing: An Interdisciplinary Journal, 12, 1–30.
Geva, E., & Wade-Woolley, L. (1998). Component processes in becoming English-Hebrew biliterate. In A. Y. Durgunoglu & L. Verhoeven (Eds.), Literacy development in a multilingual context. Cross cultural perspectives (pp. 85–110). Mahwah, NJ: Lawrence Erlbaum Associates.
Geva, E., & Yaghoub-Zadeh, Z. (2006). Reading efficiency in native English speaking and ESL children: The role of oral proficiency and underlying cognitive-linguistic processes. Scientific Studies of Reading, 10, 31–57.
Geva, E., Yaghoub-Zadeh, Z., & Schuster, B. (2000). Understanding individual differences in word recognition skills of ESL children. Annals of Dyslexia, 50, 123–153.
Gottardo, A., Collins, P., Baciu, I., & Gebotys, R. (2008). Predictors of grade 2 word reading and vocabulary learning from grade 1 variables in Spanish-speaking children: Similarities and differences. Learning Disabilities Research & Practice, 23, 11–24.
Gottardo, A., & Mueller, J. (2009). Are first- and second-language factors related in predicting second-language reading comprehension? A study of Spanish-speaking children acquiring English as a second language from first to second grade. Journal of Educational Psychology, 101, 330–344.
Gough, P. B., & Tunmer, W. (1986). Decoding, reading, and reading disability. Remedial and Special Education, 7, 6–10.
Grant, A., Gottardo, A., & Geva, E. (2011). How is language acquisition background related to the development of reading comprehension in students learning to speak English as a second language? Learning Disabilities: Research and Practice, 26, 67–83.
Hagley, F. (1987). Suffolk Reading Scale. Windsor: NFER-Nelson.
Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393–416.
Hoover, W., & Gough, P. (1990). The simple view of reading. Reading and Writing: An Interdisciplinary Journal, 2, 127–160.
Hoover, W., & Tunmer, W. E. (1993). The components of reading. In G. B. Thompson, W. E. Tunmer, & T. Nicholson (Eds.), Reading acquisition processes (pp. 1–19). Adelaide, Australia: Multilingual Matters.
Jean, M., & Geva, E. (2009). The development of vocabulary in English as a second language children and its role in word recognition ability. Applied Psycholinguistics, 30, 153–185.
Jongejan, W., Verhoeven, L., & Siegel, L. S. (2007). Predictors of reading and spelling abilities in first- and second-language learners. Journal of Educational Psychology, 99, 835–851.
Katz, S., & Lautenschlager, G. J. (2001). The contribution of passage and no-passage factors to item performance on the SAT reading task. Educational Assessment, 7, 165–176.
Keenan, J. K., & Betjemann, R. S. (2006). Comprehending the Gray Oral Reading Test without reading it: Why comprehension tests should not include passage-independent items. Scientific Studies of Reading, 10, 363–380.
Keenan, J. K., Betjemann, R. S., & Olson, R. K. (2008). Reading comprehension tests vary in the skills they assess: Differential dependence on decoding and oral comprehension. Scientific Studies of Reading, 12, 281–300.
Kirby, J. R., & Savage, R. S. (2008). Can the simple view deal with the complexities of reading? Literacy, 42, 75–82.
Leary, M. R. (2008). Introduction to behavioural research methods. Boston, MA: Pearson Education Ltd.
Leong, C. K., & Tamaoka, K. (1998). Cognitive processing of Chinese characters, words, sentences and Japanese kanji and kana: An introduction. Reading and Writing: An Interdisciplinary Journal, 10, 155–164.
Lesaux, N., Koda, K., Siegel, L., & Shanahan, T. (2006). Development of literacy. In D. August & T. Shanahan (Eds.), Developing literacy in second-language learners: A report of the National Literacy Panel on Language-Minority Children and Youth. Mahwah, NJ: Erlbaum.
Lesaux, N., Rupp, A. A., & Siegel, L. S. (2007). Growth in reading skills of children from diverse linguistic backgrounds: Findings from a 5-year longitudinal study. Journal of Educational Psychology, 99, 821–834.
Lesaux, N. K., & Siegel, L. S. (2003). The development of reading in children who speak English as a second language. Developmental Psychology, 39, 1005–1019.
Leslie, L., & Caldwell, J. (2001). Qualitative Reading Inventory-3. New York, NY: Addison Wesley Longman.
Lindsey, K. A., Manis, F. R., & Bailey, C. E. (2003). Prediction of first-grade reading in Spanish-speaking English-language learners. Journal of Educational Psychology, 93, 482–494.
Low, P. B., & Siegel, L. S. (2005). A comparison of the cognitive processes underlying reading comprehension in native English and ESL speakers. Written Language and Literacy: Special Issue: Literacy processes and literacy development, 8, 207–231.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size and factor analysis. Psychological Methods, 4, 84–99.
MacGinitie, W. H., MacGinitie, R. K., Maria, K., & Dreyer, L. G. (2000). Gates–MacGinitie reading tests (4th ed.). Itasca, IL: Riverside.
Mancilla-Martinez, J., & Lesaux, N. (2010). Predictors of reading comprehension for struggling readers: The case of Spanish-speaking language minority learners. Journal of Educational Psychology, 102, 701–711.
Manis, F. R., Lindsey, K. A., & Bailey, C. E. (2004). Development of reading in grades K-2 in Spanish-speaking English-language learners. Learning Disabilities Research & Practice, 19, 214–224.
Manis, F. R., Nakamoto, J., & Lindsey, K. (2006). Growth of word decoding and reading comprehension in English language learners. Paper presented at the 13th annual meeting for the Society for Scientific Studies in Reading, Vancouver, BC, Canada.
Markwardt, F. C. (1989). Peabody individual achievement test-revised. Bloomington, MN: Pearson Assessments.
Meng, X. L., Rosenthal, R., & Rubin, D. (1992). Comparing correlated correlation coefficients. Quantitative Methods in Psychology, 111, 172–175.
Naglieri, J. (1989). Matrix Analogies Test—expanded form. San Antonio, TX: Psychological Corporation.
Nation, K., & Snowling, M. (1997). Assessing reading difficulties: The validity and utility of current measures of reading skill. British Journal of Educational Psychology, 67, 359–370.
Neale, M. (1989). Neale analysis of reading ability. Windsor, UK: NFER-Nelson.
Ouelette, G., & Beers, A. (2009). A not-so-simple view of reading: how oral vocabulary and visual-word recognition complicate the story. Reading and Writing, 23, 189–208.
Pasquarella, A., Gottardo, A., & Grant, A. (2012). Comparing factors related to reading comprehension in adolescents who speak English as a first (L1) or second (L2) language. Scientific Studies of Reading. Retrieved from http://www.tandfonline.com/loi/hssr20.
Preacher, K. J., & MacCallum, R. C. (2002). Exploratory factor analysis in behavior genetics research: Factor recovery with small sample sizes. Behavior Genetics, 32, 153–161.
Proctor, C., August, D., Carlo, M., & Snow, C. (2006). The intriguing role of Spanish language vocabulary knowledge in predicting English reading comprehension. Journal of Educational Psychology, 98, 159–169.
Proctor, C., Carlo, M., August, D., & Snow, C. (2005). Native Spanish-speaking children reading in English: Toward a model of comprehension. Journal of Educational Psychology, 97, 246–256.
Rupley, W. H., Willson, V. L., & Nichols, W. D. (1998). Exploration of the developmental components contributing to elementary school children’s reading comprehension. Scientific Studies of Reading, 2, 143–158.
Savage, R. (2006). Reading comprehension is not always the product of nonsense word decoding and linguistic comprehension: Evidence from teenagers who are extremely poor readers. Scientific Studies of Reading, 10, 143–164.
Seymour, P. H. K., Aro, M., & Erskine, J. M. (2003). Foundation literacy acquisition in European orthographies. British Journal of Psychology, 94, 143–174.
Shahidi, V., Gottardo, A., Farnia, F., & Pasquarella, A. (2010). Challenges in developing first language assessments for adolescent English as second language learners: Farsi speakers in Canada. Retrieved May 31, 2011 from: http://docs.cllrnet.ca/LARCIC/17_VS%20&%20AG%20-%20LARCIC%20paper.pdf.
Sinatra, G. M., & Royer, J. M. (1993). Development of cognitive component processing skills that support skilled reading. Journal of Educational Psychology, 85, 509–519.
Statistics Canada (2006). 2006 census. Retrieved July 28, 2010 from: http://www12.statcan.ca/census-recensement/2006/dp-pd/prof/92-597/index.cfm?lang=E.
Tilstra, J., McMaster, K., Van den Broek, P., Kendeou, P., & Rapp, D. (2009). Simple but complex: Components of the simple view of reading across grade levels. Journal of Research in Reading, 32, 383–401.
Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (1997). Contributions of phonological awareness and rapid automatic naming ability to growth of word reading skills in second-to fifth grade children. Scientific Studies in Reading, 1, 161–185.
Verhoeven, L. (1990). Acquisition of reading in a second language. Reading Research Quarterly, 25, 90–114.
Verhoeven, L. (2000). Components in early second language reading and spelling. Scientific Studies of Reading, 4, 313–330.
Verhoeven, L., & Vermeer, A. (2006). Literacy achievement of children with intellectual disabilities and differing linguistic backgrounds. Journal of Intellectual Disabilities Research, 50, 725–738.
Wagner, R. K., Torgesen, J. K., & Rashotte, C. A. (1994). Development of reading-related phonological processing abilities: New evidence of bidirectional causality from a latent variable longitudinal study. Developmental Psychology, 30, 73–87.
Wagner, R., Torgesen, J., & Rashotte, C. (1999). Comprehensive test of phonological processing. Austin, TX: Pro-ED.
Wechsler, D. L. (1992). Wechsler individual achievement test. San Antonio, TX: Psychological Corporation.
Wiederholt, J. L., & Bryant, B. R. (1992). Gray Oral Reading Test (3rd ed.). Austin, TX: PRO-ED.
Wiederholt, J. L., & Bryant, B. R. (2001). GORT 4: Gray Oral Reading Tests examiner’s manual. Austin, TX: PRO-ED.
Wolf, M. (1991). The word-retrieval deficit hypothesis and developmental dyslexia. Learning and Individual Differences. Special Issue: Integrating Cognitive and Neurodevelopmental Approaches, 3, 205–223.
Woodcock, R. W. (1987). Woodcock reading mastery test, revised. Circle Pines, MN: American Guidance Service, Inc.
Woodcock, R. W. (1991). Woodcock language proficiency battery, revised. Chicago, IL: Riverside.
Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III tests of achievement. Itasca, IL: Riverside.
Ziegler, J., & Goswami, U. (2005). Reading acquisition, developmental dyslexia, and skilled reading across languages: A psycholinguistic grain size theory. Psychological Bulletin, 131, 3–29.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
In order to determine if there were school effects, separate analyses were carried out for each language group. There were 28 different schools involved in the current study with the number of students in each school ranging from 1 to 17 students. The Portuguese students were located at nine schools (N = 1–13 per school). A series of one-way ANOVAs revealed differences across schools on all measures (all ps < .03) except phonological awareness, rapid naming, and matrix analogies. Similarly, differences were found on all measures (all ps < .04) except receptive vocabulary, rapid naming of letters, and GORT comprehension in the Cantonese group over 11 schools (N = 1–17 per school). No differences were found between the eight schools in the Spanish group (N = 1–12 per school; all ps > .17). Because many schools had such a low sample size, post hoc analyses could not be carried out to determine what specific school differences there were. Thus, although there were significant differences between schools overall, these effects are largely participant level effects due to the small sample size for each school. There were no overall outliers, and data were collapsed within language groups. Although it is possible that if given sufficient samples, the cause of these effects (e.g., SES, maternal education, neighbourhood cohesion) could be analyzed, the current study was not designed to explore these specific influences. As such, the data may be interpreted to represent a diverse group of ELLs, who are more likely to be representative of the overall population for each language group than children who are recruited from one small geographic area, and from within the same school.
Rights and permissions
About this article
Cite this article
Grant, A., Gottardo, A. & Geva, E. Measures of reading comprehension: do they measure different skills for children learning English as a second language?. Read Writ 25, 1899–1928 (2012). https://doi.org/10.1007/s11145-012-9370-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11145-012-9370-y