Skip to main content

Advertisement

Log in

The affordances of a technology-aided formative assessment platform for the assessment and teaching of English as a foreign language: an ecological perspective

Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

In recent years, growing interest is shown in Technology-aided formative assessment (TAFA) and language learning. Research has shed light on the experimentation and effectiveness of various TAFA tools, focusing on their pedagogical advantages in assisting the teaching of particular linguistic skills (reading, writing, spelling, etc.). Taking an ecological perspective, this paper reports on an ethnographic case study on the various affordances perceived by a group of English as a Foreign Language (EFL) teachers who used a learning management system “designed for Formative assessment (FA) purposes” in China. Data from interviews, teacher journals, and EFL classrooms are collected. Thematic coding of interview data shows that the platform offers a wide range of pedagogical, managerial, assessment, social, and developmental affordances for the EFL teachers, with experienced teachers in FA reporting better affordances both in quality and in quantity. This paper further proposes a model to understand how TAFA can be designed in a way that fosters EFL teaching and student learning. Implications for designing TAFA and future studies are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Notes

  1. Name of this learning platform and of teachers appear in this article are pseudonyms.

References

  • Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment and Evaluation in Higher Education, 43(7), 1106–1119.

    Google Scholar 

  • Assessment Reform Group. (2002). Assessment for learning: 10 principles. Retrieved 10 May. 2012, from https://www.aaia.org.uk/content/uploads/2010/06/Assessment-for-Learning-10-principles.pdf

  • Balfour, S. P. (2013). Assessing writing in MOOCs: Automated essay scoring and calibrated peer review. Research and Practice in Assessment, 8, 40–48.

    Google Scholar 

  • Barbera, E. (2009). Mutual feedback in e-portfolio assessment: An approach to the netfolio system. British Journal of Educational Technology, 40(2), 342–357.

    Google Scholar 

  • Barrot, J. S. (2016). Using Facebook-based e-portfolio in ESL writing classrooms: Impact and challenges. Language, Culture and Curriculum, 29(3), 286–301.

    Google Scholar 

  • Baturay, M. H., & Daloğlu, A. (2010). E-portfolio assessment in an online English language course. Computer Assisted Language Learning, 23(5), 413–428.

    Google Scholar 

  • Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(5), 5–31.

    Google Scholar 

  • Blin, F. (2016). Towards an ‘ecological’ CALL theory: Theoretical perspectives and their instantiation in CALL research and practice. In F. Farr & L. Murray (Eds.), The Routledge handbook of language learning and technology (pp. 39–54). Routledge.

    Google Scholar 

  • Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy. Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372

    Article  Google Scholar 

  • Chun, D., Kern, R., & Smith, B. (2016). Technology in language use, language teaching, and language learning. The Modern Language Journal, 100(S1), 64–80.

    Google Scholar 

  • Daly, C., Pachler, N., Mor, Y., & Mellar, H. (2010). Exploring formative e-assessment: Using case stories and design patterns. Assessment and Evaluation in Higher Education, 35(5), 619–636.

    Google Scholar 

  • Darhower, M. A. (2008). The role of linguistic affordances in telecollaborative chat. CALICO Journal, 26(1), 48–69.

    Google Scholar 

  • Faber, J. M., & Visscher, A. J. (2018). The effects of a digital formative assessment tool on spelling achievement: Results of a randomized experiment. Computers and Education, 122, 1–8.

    Google Scholar 

  • Fusch, P., Fusch, G., & Ness, L. R. (2017). How to conduct a mini-ethnographic case study: A guide for novice researchers. The Qualitative Report, 22(3), 923–941.

    Google Scholar 

  • García Laborda, J. (2007). Introducing standardized EFL/ESL exams. Language Learning and Technology, 11(2), 3–9.

    Google Scholar 

  • Garrett, N. (1991). Technology in the service of language learning: Trends and issues. Modern Language Journal, 75, 74–101.

    Google Scholar 

  • Garrett, N. (2009). Computer-assisted language learning trends and issues revisited: Integrating innovation. Modern Language Journal, 93(1), 719–740.

    Google Scholar 

  • Gibson, J. (1977). The theory of affordances. In R. Shaw & J. D. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology. Lawrence Erlbaum.

    Google Scholar 

  • Hockly, N. (2019). Automated writing evaluation. ELT Journal, 73(1), 82–88.

    Google Scholar 

  • Jamieson, J., & Musumeci, M. (2017). Integrating assessment with instruction through technology. In C. A. Chapelle & S. Sauro (Eds.), The handbook of technology and second language teaching and learning (pp. 293–316). Wiley Blackwell.

    Google Scholar 

  • Jiang, L. (2017). The affordances of digital multimodal composing for EFL learning. ELT Journal, 71(4), 413–422. https://doi.org/10.1093/elt/ccw098

    Article  Google Scholar 

  • Jiang, L., & Yu, S. (2020). Appropriating automated feedback in L2 writing: Experiences of Chinese EFL student writers. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2020.1799824

    Article  Google Scholar 

  • Jiang, L., Yang, M., & Yu, S. (2020a). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54, 954–979. https://doi.org/10.1002/tesq.566

    Article  Google Scholar 

  • Jiang, L., Yu, S., & Wang, C. (2020b). Second language writing instructors’ feedback practice in response to automated writing evaluation: A sociocultural perspective. System, 93, 102302. https://doi.org/10.1016/j.system.2020.102302

    Article  Google Scholar 

  • Jiang, L., Yu, S., & Zhao, Yu. (2021). Teacher engagement with digital multimodal composing in a Chinese tertiary EFL curriculum. Language Teaching Research, 25(4), 613–632. https://doi.org/10.1177/1362168819864975

    Article  Google Scholar 

  • Jordan, S., & Mitchell, T. (2009). e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback. British Journal of Educational Technology, 40(2), 371–385.

    Google Scholar 

  • Kim, M., & Ryu, J. (2013). The development and implementation of a web-based formative peer assessment system for enhancing students’ metacognitive awareness and performance in ill-structured tasks. Educational Technology Research and Development, 61, 549–561. https://doi.org/10.1007/s11423-012-9266-1

    Article  Google Scholar 

  • Kirschner, P., Strijbos, J.-W., Kreijns, K., & Beers, P. J. (2004). Designing electronic collaborative learning environments. Educational Technology Research and Development, 52(3), 47–66.

    Google Scholar 

  • Lai, H. (2012). A study on the impact of an online automated essay evaluation system on middle school EFL teachers. In J. Tang (Ed.), English teaching reform in the digital age (pp. 137–144). Foreign Language Teaching and Research Press.

    Google Scholar 

  • Li, J. (2018). Digital affordances on WeChat: Learning Chinese as a second language. Computer Assisted Language Learning, 31, 27–52.

    Google Scholar 

  • Li, L. (2014). Understanding language teachers’ practice with educational technology: A case from China. System, 46, 105–119.

    Google Scholar 

  • Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic Inquiry. Sage.

    Google Scholar 

  • Luckin, R., Clark, W., Avramides, K., Hunter, J., & Oliver, M. (2017). Using teacher inquiry to support technology-enhanced formative assessment: A review of the literature to inform a new method. Interactive Learning Environments, 25(1), 85–97.

    Google Scholar 

  • Merrell, C., & Tymms, P. (2007). Identifying reading problems with computer-adaptive assessments. Journal of Computer Assisted Learning, 23, 27–35.

    Google Scholar 

  • Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis. Sage.

    Google Scholar 

  • Pellegrino, J. W., & Quellmalz, E. S. (2010). Perspectives on the integration of technology and assessment. Journal of Research on Technology in Education, 43(2), 119–134.

    Google Scholar 

  • Russell, M. K. (2010). Technology aided formative assessment of learning: New developments and applications. In H. L. Andrade & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 125–138). Routledge.

    Google Scholar 

  • Scharber, C., Dexter, S., Riedel, E. (2008). Students’ experiences with an automated essay scorer. Journal of Technology, Learning, and Assessment, 7(1). Retrieved 30 July, 2011 from http://www.jtla.org

  • Sheard, M. K., & Chambers, B. (2014). A case of technology-enhanced formative assessment and achievement in primary grammar: How is quality assurance of formative assessment assured? Studies in Educational Evaluation, 43, 14–23.

    Google Scholar 

  • Song, Y., & Sparks, J. R. (2019). Building a game-enhanced formative assessment to gather evidence about middle school students’ argumentation skills. Educational Technology Research and Development, 67, 1175–1196. https://doi.org/10.1007/s11423-018-9637-3

    Article  Google Scholar 

  • Tang, J., & Wu, Y. (2011). Using automated writing evaluation in classroom assessment: A critical review. Foreign Language Teaching and Research, 43(2), 273–283.

    Google Scholar 

  • Thoms, J. J. (2014). An ecological view of whole-class discussions in a second language literature classroom: Teacher reformulations as affordances for learning. The Modern Language Journal, 98(3), 724–741.

    Google Scholar 

  • Thoms, J. J., & Poole, F. (2017). Investigating linguistic, literary, and social affordances of L2 collaborative reading. Language Learning and Technology, 21(2), 139–156.

    Google Scholar 

  • van Lier, L. (2000). From input to affordance: Social-interactive learning from an ecological perspective. In J. P. Lantolf (Ed.), Sociocultural theory and second language learning (pp. 245–259). Oxford University Press.

    Google Scholar 

  • van Lier, L. (2004). The ecology and semiotics of language learning: A sociocultural perspective. Kluwer Academic.

    Google Scholar 

  • van Lier, L. (2008). Ecological-semiotic perspectives on educational linguistics. In B. Spolsky & F. M. Hult (Eds.), The handbook of educational linguistics (pp. 595–605). Blackwell.

    Google Scholar 

  • Vasquez, A., Nussbaum, M., Sciarresi, E., Martínez, T., Barahona, C., & Strasser, K. (2017). The impact of the technology used in formative assessment: The case of spelling. Journal of Educational Computing Research, 54(8), 1142–1167.

    Google Scholar 

  • Warschauer, M., & Kern, R. (2000). Network-based language teaching: Concepts and practice. Cambridge University Press.

    Google Scholar 

  • Warschauer, M., & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10(2), 157–180.

    Google Scholar 

  • Wu, Y., & Tang, J. (2012). A study on the impact of a writing course using online automated essay evaluation system on college EFL teachers. In J. Tang (Ed.), English teaching reform in the digital age (pp. 201–218). Foreign Language Teaching and Research Press.

    Google Scholar 

  • Yan, Z., & Brown, G. T. L. (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment and Evaluation in Higher Education, 42(8), 1247–1262.

    Google Scholar 

  • Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lianjiang Jiang.

Ethics declarations

Conflict of interest

We declare that there are no conflicts of interest among the authors.

Ethical approval

Ethical approval has been obtained from the first author’s university.

Research involving human and animal rights

Our research has involved human participants and we have obtained informed consent.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, E., Jiang, L. & Yang, M. The affordances of a technology-aided formative assessment platform for the assessment and teaching of English as a foreign language: an ecological perspective. Education Tech Research Dev 69, 3391–3412 (2021). https://doi.org/10.1007/s11423-021-10047-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-021-10047-y

Keywords

Navigation