Academic language and the quality of written arguments and explanations of Chilean 8th graders
Abstract
Writing is a task that entails high cognitive and linguistic efforts, especially when producing academic texts. Academic language might be one of the factors influencing the quality of written texts, given that prior research has shown its impact on reading comprehension. The purpose of this study is to examine the contribution of Spanish Core Academic Language Skills (S-CALS) and academic vocabulary to the quality of written argumentation and explanation. For this study, 126 Chilean 8th grade students produced an argumentative text and an explanatory text about the same topic. In addition, their academic vocabulary was assessed with the S-AVoc-T test and their CALS with the S-CALS-I test. Results show that both CALS and academic vocabulary are significantly and positively correlated with both writing tasks. Even though these instruments make different contributions to the predictive models in each discursive genre, a Principal Component Analysis revealed that the model that best explains writing quality are those which combine both language variables, namely Spanish Core Academic Language and Vocabulary Skills (S-CALVS). In argumentation, the S-CALVS model explains 29% of the variance, after controlling by gender. In contrast, in explanation, S-CALVS explains 35% of the variance. It is concluded that it is relevant to develop situated writing in each discursive genre and, upon that basis, to work with both CALS and academic vocabulary, because they have a specific impact on academic texts writing.
Keywords
Academic language Academic vocabulary Writing quality Writing assessmentNotes
Acknowledgements
This study was conducted as part of FONDECYT REGULAR Project number 1150238, funded by CONICYT, Chile, and a CONICYT-PCHA/National Doctorate/21130191 scholarship. Also we thanks to the Doctoral Program in Education, Pontificia Universidad Católica de Chile to support the preparation of this manuscript and Natalia Ávila for her suggestions to improve this paper.
References
- Agencia de Calidad de la Educación. (2013). Metodología de construcción de grupos socioeconómicos Simce 2013. Resource document http://archivos.agenciaeducacion.cl/biblioteca_digital_historica/metodologia/2013/gse_2013.pdf.
- Agencia de Calidad de la Educación. (2014). Síntesis de resultados Simce Escritura 6º Básico 2013. Resource document https://s3-us-west-2.amazonaws.com/resultados-simce-2013/SR_6basico_escritura_2013.pdf.
- Agencia de Calidad de la Educación. (2017). Síntesis de resultados Simce Escritura 6º Básico 2016. Resource document http://archivos.agenciaeducacion.cl/resultados_nacionales_escritura_2016.pdf.
- Álvarez, T. (2001). Textos expositivo-explicativo y argumentativos. Barcelona: Octaedro.Google Scholar
- Bazerman, C. (2004). Speech acts, genres, and activity systems: How texts organize activity and people. In C. Bazerman & P. Prior (Eds.), What writing does and how it does it: An introduction to analyzing texts and textual practices (pp. 309–339). Mahwah, N.J.: Lawrence Erlbaum Associates.Google Scholar
- Beck, S. W., & Jeffery, J. V. (2009). Genre and thinking in academic writing tasks. Journal of Literacy Research, 41(2), 228–272. https://doi.org/10.1080/10862960902908483.CrossRefGoogle Scholar
- Beers, S. F., & Nagy, W. E. (2009). Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre? Reading and Writing, 22(2), 185–200. https://doi.org/10.1007/s11145-007-9107-5.CrossRefGoogle Scholar
- Berman, R. A. (2004). From emergence to mastery: The long developmental route of language acquisition. In R. A. Berman (Ed.), Language development across childhood and adolescence (pp. 9–34). Amsterdam: John Benjamins.CrossRefGoogle Scholar
- Berman, R. A., & Nir-Sagiv, B. (2007). Comparing narrative and expository text construction across adolescence: A developmental paradox. Discourse Processes, 43(2), 79–120.CrossRefGoogle Scholar
- Berman, R. A., & Ravid, D. (2009). Becoming a literate language user. Oral and written text construction across adolescence. In D. Olson & N. Torrance (Eds.), The Cambridge handbook of literacy (pp. 92–111). New York, NT: Cambridge University Press.CrossRefGoogle Scholar
- Calfee, R., & Greitz, R. (2007). Best practices in writing assessment. In S. Y. Graham & Ch. MacArthur (Eds.), Best practices in writing instruction (pp. 351–377). New York, NY: The Guilford Press.Google Scholar
- Chen, H., & Myhill, D. (2016). Children talking about writing: Investigating metalinguistic understanding. Linguistics and Education, 35, 100–108. https://doi.org/10.1016/j.linged.2016.07.004.CrossRefGoogle Scholar
- Concha, S., & Paratore, J. (2011). Local coherence in persuasive writing: An exploration of Chilean students’ metalinguistic knowledge, writing process, and writing products. Written Communication, 28(1), 34–69. https://doi.org/10.1177/0741088310383383.CrossRefGoogle Scholar
- Crossley, S., Muldner, K., & McNamara, D. (2016). Idea generation in student writing: Computational assessments and links to successful writing. Written Communication, 33(3), 328–354. https://doi.org/10.1177/0741088316650178.CrossRefGoogle Scholar
- Danzak, R. L. (2011). The integration of lexical, syntactic, and discourse features in bilingual adolescents’ writing: An exploratory approach. Language Speech and Hearing Services in Schools, 42(4), 491–505. https://doi.org/10.1044/0161-1461(2011/10-0063).CrossRefGoogle Scholar
- Dobbs, C. L. (2014). Signaling organization and stance: Measuring the use of academic language markers in middle grade persuasive writing. Reading and Writing, 27(8), 1327–1352. https://doi.org/10.1007/s11145-013-9489-5.CrossRefGoogle Scholar
- Dobbs, C. L., & Kearns, D. (2016). Using new vocabulary in writing: Exploring how word and learner characteristics relate to the likelihood that writers use newly taught vocabulary. Reading and Writing, 29(9), 1817–1844. https://doi.org/10.1007/s11145-016-9654-8.CrossRefGoogle Scholar
- Espinosa, M., & Concha, S. (2015). Aprendizaje de la escritura en las nuevas bases curriculares de lenguaje y comunicación: nociones teóricas y modelos de escritura que subyacen a la propuesta curricular. Estudios Pedagógicos, 41(2), 325–344.CrossRefGoogle Scholar
- Figueroa, J., Chandia, E., & Meneses, A. (2017). Calidad de la escritura en el género explicativo y argumentativo: validación de una rúbrica para medir desempeño. Manuscript submitted for publication.Google Scholar
- Figueroa, J., Meneses, A., & Chandia, E. (2017). Desempeños en la calidad de explicaciones y argumentaciones en estudiantes chilenos de 8º básico. Manuscript submitted for publication.Google Scholar
- Flower, L., & Hayes, J. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365–387.CrossRefGoogle Scholar
- Gillespie, A., Olinghouse, N. G., & Graham, S. (2013). Fifth-grade students’ knowledge about writing process and writing genres. Elementary School Journal, 113(4), 565–588. https://doi.org/10.1086/669938.CrossRefGoogle Scholar
- Gómez, G., Sotomayor, C., Bedwell, P., Dominguez, A., & Jeldrez, E. (2016). Analysis of lexical quality and its relation to writing quality for 4th grade, primary school students in Chile. Reading and Writing, 29, 1317–1336. https://doi.org/10.1007/s11145-016-9637-9.CrossRefGoogle Scholar
- Graham, S., & Sandmel, K. (2011). The process writing approach: A meta-analysis. Journal of Educational Research, 104(6), 396–407. https://doi.org/10.1080/00220671.2010.488703.CrossRefGoogle Scholar
- Hayes, J. R. (1996). A new framework for understanding cognition and affect in writing. In C. M. Levy & S. Ransdell (Eds.), The science of writing: Theories, methods, individual differences, and applications (pp. 1–27). Mahwah, NJ: Lawrence Erlbaum Associate.Google Scholar
- Hwang, J. K., Lawrence, J. F., Mo, E., & Snow, C. E. (2015). Differential effects of a systematic vocabulary intervention on adolescent language minority students with varying levels of English proficiency. The International Journal of Bilingualism, 19(3), 314–332. https://doi.org/10.1177/1367006914521698.CrossRefGoogle Scholar
- Kellogg, R. T. (1987). Effects of topic knowledge on the allocation of processing time and cognitive effort to writing processes. Memory & Cognition, 15(3), 256–266.CrossRefGoogle Scholar
- Kent, S., & Wanzek, J. (2016). The relationship between component skills and writing quality and production across developmental levels: A meta-analysis of the last 25 years. Review of Educational Research, 86(2), 570–601. https://doi.org/10.3102/0034654315619491.CrossRefGoogle Scholar
- Kraha, A., Turner, H., Nimon, K., Zientek, L. R., & Henson, R. K. (2012). Tools to support interpreting multiple regression in the face of multicollinearity. Frontiers in psychology. https://doi.org/10.3389/fpsyg.2012.00044.Google Scholar
- Lesaux, N. K., Kieffer, M. J., Kelley, J. G., & Harris, J. R. (2014). Effects of academic vocabulary instruction for linguistically diverse adolescents: Evidence from a randomized field trial. American Educational Research Journal, 51(6), 1159–1194. https://doi.org/10.1016/j.appdev.2010.09.004.CrossRefGoogle Scholar
- Mancilla-Martinez, J., & Lesaux, N. K. (2010). Predictors of reading comprehension for struggling readers: The case of Spanish speaking language minority learners. Journal of Educational Psychology, 102(3), 701–711. https://doi.org/10.1037/a0019135.CrossRefGoogle Scholar
- Martin, J., & Rose, D. (2008). Genre relations: Mapping culture. London: Equinox.Google Scholar
- McCutchen, D. (2000). Knowledge, processing, and working memory: Implications for a theory of writing. Educational Psychologist, 35(1), 13–23.CrossRefGoogle Scholar
- McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication, 27(1), 57–86. https://doi.org/10.1177/0741088309351547.CrossRefGoogle Scholar
- Meneses, A., Uccelli, P., Santelices, M., Ruiz, M., Acevedo, D., & Figueroa, J. (2017). Academic language as a predictor of reading comprehension in monolingual Spanish-speaking readers: Evidence from Chilean early adolescents. Reading Research Quarterly. Advance online publication https://doi.org/10.1002/rrq.192.Google Scholar
- National Assessment Governing Board. (2010). Writing framework for 2011 National Assessment of Educational Progress. Washington, DC.: National Assessment Governing Board.Google Scholar
- Olinghouse, N. G., & Graham, S. (2009). The relationship between the discourse knowledge and the writing performance of elementary-grade students. Journal of Educational Psychology, 101(1), 37–50. https://doi.org/10.1037/a0013248.CrossRefGoogle Scholar
- Olinghouse, N. G., & Wilson, J. (2013). The relationship between vocabulary and writing quality in three genres. Reading and Writing, 26(1), 45–65. https://doi.org/10.1007/s11145-012-9392-5.CrossRefGoogle Scholar
- Phillips Galloway, E., & Uccelli, P. (2015). Modeling the relationship between lexico-grammatical and discourse organization skills in middle grade writers: Insights into later productive language skills that support academic writing. Reading and Writing, 28(6), 797–828. https://doi.org/10.1007/s11145-015-9550-7.CrossRefGoogle Scholar
- Prior, P. (2009). From speech genres to mediated multimodal genre systems: Bakhtin, Voloshinov, and the question of writing. In C. Bazerman, A. Bonini & D. Figueiredo (Eds.), Genre in a changing world (pp. 17–34). Resource document http://wac.colostate.edu/books/genre/chapter2.pdf.
- R Core Team. (2017). A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Resource document http://www.R-project.org/.
- Ravid, D., & Tolchinsky, L. (2002). Developing linguistic literacy: A comprehensive model. Journal of Child Language, 29, 417–447. https://doi.org/10.1017/S03050009020055111.Google Scholar
- Salas, N., Llauradó, A., Castillo, C., Taulé, M., & Martí, M. A. (2016). Linguistic correlates of text quality from childhood to adulthood. In J. Perera, M. Aparici, E. Rosado, & N. Salas (Eds.), Written and spoken language development across the lifespan. Essays in honour of Liliana Tolchinsky (pp. 307–326). New York, NY: Springer.CrossRefGoogle Scholar
- Scardamalia, M., & Bereiter, C. (1987). Knowledge telling and knowledge transforming in written composition. In S. Rosenberg (Ed.), Advances in applied psycholinguistics: Reading, writing, and language learning (Vol. 2, pp. 142–175). New York: Cambridge University Press.Google Scholar
- Schleppegrell, M. J. (2001). Linguistic features of the language of schooling. Linguistics and Education, 12(4), 431–459.CrossRefGoogle Scholar
- Schleppegrell, M. J. (2004). The language of schooling. A functional linguistics perspective. Mahwah, NJ: Lawrence Erlbaum Publishers.Google Scholar
- Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120.CrossRefGoogle Scholar
- Snow, C., & Uccelli, P. (2009). The challenge of academic language. In D. R. Olson & N. Torrance (Eds.), The Cambridge handbook of literacy (pp. 112–133). New York: Cambridge University Press.CrossRefGoogle Scholar
- Strasser, K., & del Río, F. (2014). The role of comprehension monitoring, theory of mind, and vocabulary depth in predicting story comprehension and recall of kindergarten children. Reading Research Quarterly, 49(2), 169–187. https://doi.org/10.1002/rrq.68.CrossRefGoogle Scholar
- Strasser, K., Larraín, A., & Lissi, M. R. (2013). Effects of storybook reading style on comprehension: The role of word elaboration and coherence questions. Early Education and Development, 24(5), 616–639. https://doi.org/10.1080/10409289.2012.715570.CrossRefGoogle Scholar
- Tolchinsky, L., & Simó, R. (2001). Escribir y leer a través del currículum. Barcelona: Horsori.Google Scholar
- Uccelli, P., Barr, C., Dobbs, C., Phillips Galloway, E., Meneses, A., & Sánchez, E. (2015a). Core academic language skills: An expanded operational construct and a novel instrument to chart school-relevant language proficiency in preadolescent and adolescent learners. Applied Psycholinguistics, 36(5), 1077–1109. https://doi.org/10.1017/S014271641400006X.CrossRefGoogle Scholar
- Uccelli, P., Dobbs, C. L., & Scott, J. (2013). Mastering academic language: Organization and stance in the persuasive writing of high school students. Written Communication, 30(1), 36–62. https://doi.org/10.1177/0741088312469013.CrossRefGoogle Scholar
- Uccelli, P., & Meneses, A. (2015). Habilidades de lenguaje académico y su asociación con la comprensión de lectura en la escuela primaria y media: un nuevo constructo operacional. Miríada Hispánica, 10, 179–206.Google Scholar
- Uccelli, P., & Phillips Galloway, E. (in press). What we know now about students’ academic language skills: Reflections for practice. Invited chapter. In C. Adger, & D. Christian (Eds.), What teachers need to know about language. Center for Applied Linguistics Series on Language and Education. Multilingual Matters.Google Scholar
- Uccelli, P., Phillips Galloway, E., Barr, C., Meneses, A., & Dobbs, C. (2015b). Beyond vocabulary: Exploring cross-disciplinary academic-language proficiency and its association with reading comprehension. Reading Research Quarterly, 50(3), 337–356. https://doi.org/10.1002/rrq.104.CrossRefGoogle Scholar
- Uccelli, P., Phillips Galloway, E., & Qin, W. (in press). Academic language proficiencies and reading comprehension relations during the mid-adolescent years: Recent findings and new questions. Invited chapter. In N.K. Lesaux & E. Moje (Eds.), Handbook of reading research (Vol. 5).Google Scholar
- Valenzuela, J. P., Bellei, C., & De Los Ríos, D. (2014). Socioeconomic school segregation in a market-oriented educational system. The case of Chile. Journal of Education Policy, 29(2), 217–241. https://doi.org/10.1080/02680939.2013.806995.CrossRefGoogle Scholar
- Verhoeven, L., & van Hell, J. G. (2008). From knowledge representation to writing text: A developmental perspective. Discourse Processes, 45(4–5), 387–405. https://doi.org/10.1080/01638530802145734.CrossRefGoogle Scholar