Abstract
In recent years, growing interest is shown in Technology-aided formative assessment (TAFA) and language learning. Research has shed light on the experimentation and effectiveness of various TAFA tools, focusing on their pedagogical advantages in assisting the teaching of particular linguistic skills (reading, writing, spelling, etc.). Taking an ecological perspective, this paper reports on an ethnographic case study on the various affordances perceived by a group of English as a Foreign Language (EFL) teachers who used a learning management system “designed for Formative assessment (FA) purposes” in China. Data from interviews, teacher journals, and EFL classrooms are collected. Thematic coding of interview data shows that the platform offers a wide range of pedagogical, managerial, assessment, social, and developmental affordances for the EFL teachers, with experienced teachers in FA reporting better affordances both in quality and in quantity. This paper further proposes a model to understand how TAFA can be designed in a way that fosters EFL teaching and student learning. Implications for designing TAFA and future studies are also discussed.
Notes
Name of this learning platform and of teachers appear in this article are pseudonyms.
References
Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment and Evaluation in Higher Education, 43(7), 1106–1119.
Assessment Reform Group. (2002). Assessment for learning: 10 principles. Retrieved 10 May. 2012, from https://www.aaia.org.uk/content/uploads/2010/06/Assessment-for-Learning-10-principles.pdf
Balfour, S. P. (2013). Assessing writing in MOOCs: Automated essay scoring and calibrated peer review. Research and Practice in Assessment, 8, 40–48.
Barbera, E. (2009). Mutual feedback in e-portfolio assessment: An approach to the netfolio system. British Journal of Educational Technology, 40(2), 342–357.
Barrot, J. S. (2016). Using Facebook-based e-portfolio in ESL writing classrooms: Impact and challenges. Language, Culture and Curriculum, 29(3), 286–301.
Baturay, M. H., & Daloğlu, A. (2010). E-portfolio assessment in an online English language course. Computer Assisted Language Learning, 23(5), 413–428.
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(5), 5–31.
Blin, F. (2016). Towards an ‘ecological’ CALL theory: Theoretical perspectives and their instantiation in CALL research and practice. In F. Farr & L. Murray (Eds.), The Routledge handbook of language learning and technology (pp. 39–54). Routledge.
Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy. Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372
Chun, D., Kern, R., & Smith, B. (2016). Technology in language use, language teaching, and language learning. The Modern Language Journal, 100(S1), 64–80.
Daly, C., Pachler, N., Mor, Y., & Mellar, H. (2010). Exploring formative e-assessment: Using case stories and design patterns. Assessment and Evaluation in Higher Education, 35(5), 619–636.
Darhower, M. A. (2008). The role of linguistic affordances in telecollaborative chat. CALICO Journal, 26(1), 48–69.
Faber, J. M., & Visscher, A. J. (2018). The effects of a digital formative assessment tool on spelling achievement: Results of a randomized experiment. Computers and Education, 122, 1–8.
Fusch, P., Fusch, G., & Ness, L. R. (2017). How to conduct a mini-ethnographic case study: A guide for novice researchers. The Qualitative Report, 22(3), 923–941.
García Laborda, J. (2007). Introducing standardized EFL/ESL exams. Language Learning and Technology, 11(2), 3–9.
Garrett, N. (1991). Technology in the service of language learning: Trends and issues. Modern Language Journal, 75, 74–101.
Garrett, N. (2009). Computer-assisted language learning trends and issues revisited: Integrating innovation. Modern Language Journal, 93(1), 719–740.
Gibson, J. (1977). The theory of affordances. In R. Shaw & J. D. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology. Lawrence Erlbaum.
Hockly, N. (2019). Automated writing evaluation. ELT Journal, 73(1), 82–88.
Jamieson, J., & Musumeci, M. (2017). Integrating assessment with instruction through technology. In C. A. Chapelle & S. Sauro (Eds.), The handbook of technology and second language teaching and learning (pp. 293–316). Wiley Blackwell.
Jiang, L. (2017). The affordances of digital multimodal composing for EFL learning. ELT Journal, 71(4), 413–422. https://doi.org/10.1093/elt/ccw098
Jiang, L., & Yu, S. (2020). Appropriating automated feedback in L2 writing: Experiences of Chinese EFL student writers. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2020.1799824
Jiang, L., Yang, M., & Yu, S. (2020a). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54, 954–979. https://doi.org/10.1002/tesq.566
Jiang, L., Yu, S., & Wang, C. (2020b). Second language writing instructors’ feedback practice in response to automated writing evaluation: A sociocultural perspective. System, 93, 102302. https://doi.org/10.1016/j.system.2020.102302
Jiang, L., Yu, S., & Zhao, Yu. (2021). Teacher engagement with digital multimodal composing in a Chinese tertiary EFL curriculum. Language Teaching Research, 25(4), 613–632. https://doi.org/10.1177/1362168819864975
Jordan, S., & Mitchell, T. (2009). e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback. British Journal of Educational Technology, 40(2), 371–385.
Kim, M., & Ryu, J. (2013). The development and implementation of a web-based formative peer assessment system for enhancing students’ metacognitive awareness and performance in ill-structured tasks. Educational Technology Research and Development, 61, 549–561. https://doi.org/10.1007/s11423-012-9266-1
Kirschner, P., Strijbos, J.-W., Kreijns, K., & Beers, P. J. (2004). Designing electronic collaborative learning environments. Educational Technology Research and Development, 52(3), 47–66.
Lai, H. (2012). A study on the impact of an online automated essay evaluation system on middle school EFL teachers. In J. Tang (Ed.), English teaching reform in the digital age (pp. 137–144). Foreign Language Teaching and Research Press.
Li, J. (2018). Digital affordances on WeChat: Learning Chinese as a second language. Computer Assisted Language Learning, 31, 27–52.
Li, L. (2014). Understanding language teachers’ practice with educational technology: A case from China. System, 46, 105–119.
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic Inquiry. Sage.
Luckin, R., Clark, W., Avramides, K., Hunter, J., & Oliver, M. (2017). Using teacher inquiry to support technology-enhanced formative assessment: A review of the literature to inform a new method. Interactive Learning Environments, 25(1), 85–97.
Merrell, C., & Tymms, P. (2007). Identifying reading problems with computer-adaptive assessments. Journal of Computer Assisted Learning, 23, 27–35.
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis. Sage.
Pellegrino, J. W., & Quellmalz, E. S. (2010). Perspectives on the integration of technology and assessment. Journal of Research on Technology in Education, 43(2), 119–134.
Russell, M. K. (2010). Technology aided formative assessment of learning: New developments and applications. In H. L. Andrade & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 125–138). Routledge.
Scharber, C., Dexter, S., Riedel, E. (2008). Students’ experiences with an automated essay scorer. Journal of Technology, Learning, and Assessment, 7(1). Retrieved 30 July, 2011 from http://www.jtla.org
Sheard, M. K., & Chambers, B. (2014). A case of technology-enhanced formative assessment and achievement in primary grammar: How is quality assurance of formative assessment assured? Studies in Educational Evaluation, 43, 14–23.
Song, Y., & Sparks, J. R. (2019). Building a game-enhanced formative assessment to gather evidence about middle school students’ argumentation skills. Educational Technology Research and Development, 67, 1175–1196. https://doi.org/10.1007/s11423-018-9637-3
Tang, J., & Wu, Y. (2011). Using automated writing evaluation in classroom assessment: A critical review. Foreign Language Teaching and Research, 43(2), 273–283.
Thoms, J. J. (2014). An ecological view of whole-class discussions in a second language literature classroom: Teacher reformulations as affordances for learning. The Modern Language Journal, 98(3), 724–741.
Thoms, J. J., & Poole, F. (2017). Investigating linguistic, literary, and social affordances of L2 collaborative reading. Language Learning and Technology, 21(2), 139–156.
van Lier, L. (2000). From input to affordance: Social-interactive learning from an ecological perspective. In J. P. Lantolf (Ed.), Sociocultural theory and second language learning (pp. 245–259). Oxford University Press.
van Lier, L. (2004). The ecology and semiotics of language learning: A sociocultural perspective. Kluwer Academic.
van Lier, L. (2008). Ecological-semiotic perspectives on educational linguistics. In B. Spolsky & F. M. Hult (Eds.), The handbook of educational linguistics (pp. 595–605). Blackwell.
Vasquez, A., Nussbaum, M., Sciarresi, E., Martínez, T., Barahona, C., & Strasser, K. (2017). The impact of the technology used in formative assessment: The case of spelling. Journal of Educational Computing Research, 54(8), 1142–1167.
Warschauer, M., & Kern, R. (2000). Network-based language teaching: Concepts and practice. Cambridge University Press.
Warschauer, M., & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10(2), 157–180.
Wu, Y., & Tang, J. (2012). A study on the impact of a writing course using online automated essay evaluation system on college EFL teachers. In J. Tang (Ed.), English teaching reform in the digital age (pp. 201–218). Foreign Language Teaching and Research Press.
Yan, Z., & Brown, G. T. L. (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment and Evaluation in Higher Education, 42(8), 1247–1262.
Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We declare that there are no conflicts of interest among the authors.
Ethical approval
Ethical approval has been obtained from the first author’s university.
Research involving human and animal rights
Our research has involved human participants and we have obtained informed consent.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, E., Jiang, L. & Yang, M. The affordances of a technology-aided formative assessment platform for the assessment and teaching of English as a foreign language: an ecological perspective. Education Tech Research Dev 69, 3391–3412 (2021). https://doi.org/10.1007/s11423-021-10047-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-021-10047-y