Skip to main content
SpringerLink
Log in

The Challenges of Learning Assessment in the Age of Artificial Intelligence

  • Conference paper
  • First Online:
Good Practices and New Perspectives in Information Systems and Technologies (WorldCIST 2024)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 988))

Included in the following conference series:

  • 13 Accesses

Abstract

The continuous growth of artificial intelligence in the world and the consequent integration of this type of technology into the various economic sectors of societies seems to be triggering new relationships with machines, but also new ways of working. Education, as one of the most important sectors of a nation, can no longer escape this new reality of integrating this type of technology into teaching and learning processes. It is precisely because of this fact that this research emerges, which aims not to set aside or exclude this (r)evolution, but rather to consider them as important and useful tools for innovation in education, putting them at the service of this sector. In this sense, we believe that it is essential to carry out a study to identify and understand the main challenges in carrying out the process of assessing students in the age of artificial intelligence. A systematic review of the literature will be carried out, focusing only on the three years - the artificial intelligence boom - and through it we will try to identify the major challenges that educational agents, but especially teachers, face in assessing students, contributing to literacy in the area, but also to a serious debate on this issue that is already being discussed so much in educational institutions. The results suggest that there is a set of challenges that teachers have to deal with, which, according to the content analysis carried out, are related to authenticity, ethics and fraud.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kumar, D.N.M.: Implementation of artificial intelligence in imparting education and evaluating student performance. J. Artif. Intell. Capsul. Netw. 1(1), 1–9 (2019)

    Article  Google Scholar 

  2. Hwang, G.-J., Xie, H., Wah, B.W., Gašević, D.: Vision, challenges, roles and research issues of artificial intelligence in education. Comput. Educ. Artif. Intell. 1, 100001 (2020). Elsevier

    Google Scholar 

  3. González-Calatayud, V., Prendes-Espinosa, P., Roig-Vila, R.: Artificial intelligence for student assessment: a systematic review. Appl. Sci. 11(12), 5467 (2021)

    Article  Google Scholar 

  4. Zhai, X., et al.: A review of artificial intelligence (AI) in education from 2010 to 2020. Complexity 2021, 1–18 (2021)

    Google Scholar 

  5. Huang, J., Saleh, S., Liu, Y.: A review on artificial intelligence in education. Acad. J. Interdiscip. Stud. 10(3), 206 (2021)

    Google Scholar 

  6. Hooda, M., Rana, C., Dahiya, O., Rizwan, A., Hossain, M.S.: Artificial intelligence for assessment and feedback to enhance student success in higher education. Math. Probl. Eng. 2022, 1–19 (2022)

    Google Scholar 

  7. Celik, I., Dindar, M., Muukkonen, H., Järvelä, S.: The promises and challenges of artificial intelligence for teachers: a systematic review of research. TechTrends 66(4), 616–630 (2022)

    Article  Google Scholar 

  8. Swiecki, Z., et al.: Assessment in the age of artificial intelligence. Comput. Educ. Artif. Intell. 3, 100075 (2022)

    Article  Google Scholar 

  9. Zafari, M., Bazargani, J.S., Sadeghi-Niaraki, A., Choi, S.-M.: Artificial intelligence applications in K-12 education: a systematic literature review. IEEE Access 10, 61905–61921 (2022)

    Article  Google Scholar 

  10. Babitha, M.M., Sushma, C., Gudivada, V.K.: Trends of Artificial Intelligence for online exams in education. Int. J. Early Child. Spec. Educ. 14(01), 2457–2463 (2022)

    Google Scholar 

  11. Xia, Q., Chiu, T.K.F., Zhou, X., Chai, C.S., Cheng, M.: Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput. Educ. Artif. Intell. 4, 100118 (2022)

    Google Scholar 

  12. Nguyen, A., Ngo, H.N., Hong, Y., Dang, B., Nguyen, B.-P.T.: Ethical principles for artificial intelligence in education. Educ. Inf. Technol. 28(4), 4221–4241 (2023)

    Article  Google Scholar 

  13. Lawrie, G.: Establishing a delicate balance in the relationship between artificial intelligence and authentic assessment in student learning. Chem. Educ. Res. Pract. 24(2), 392–393 (2023)

    Article  Google Scholar 

  14. Qureshi, B.: Exploring the use of ChatGPT as a tool for learning and assessment in undergraduate computer science curriculum: Opportunities and challenges. arXiv Prepr. arXiv2304.11214 (2023)

    Google Scholar 

  15. Jiao, H., He, Q., Yao, L.: Machine learning and deep learning in assessment. Psychol. Test Assess. Model. 64(1), 178–189 (2023)

    Google Scholar 

  16. Holmes, W., Bialik, M., Fadel, C.: Artificial Intelligence in Education. Globethics Publications (2023)

    Google Scholar 

  17. Li, T., Reigh, E., He, P., Adah Miller, E.: Can we and should we use artificial intelligence for formative assessment in science?. J. Res. Sci. Teach. 60(6), 1–5 (2023)

    Google Scholar 

  18. Dimitriadou, E., Lanitis, A.: A critical evaluation, challenges, and future perspectives of using artificial intelligence and emerging technologies in smart classrooms. Smart Learn. Environ. 10(1), 1–26 (2023)

    Article  Google Scholar 

  19. Baidoo-Anu, D., Owusu Ansah, L.: Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning. Available SSRN 4337484 (2023)

    Google Scholar 

  20. Dogan, M.E., Goru Dogan, T., Bozkurt, A.: The use of artificial intelligence (AI) in online learning and distance education processes: a systematic review of empirical studies. Appl. Sci. 13(5), 3056 (2023)

    Google Scholar 

  21. Gašević, D., Siemens, G., Sadiq, S.: Empowering learners for the age of artificial intelligence. Comput. Educ. Artif. Intell. 4, 100130 (2023)

    Google Scholar 

  22. Çebi, A., Karal, H.: An application of fuzzy analytic hierarchy process (FAHP) for evaluating students’ project. Educ. Res. Rev. 12(3), 120–132 (2017)

    Article  Google Scholar 

  23. Alghamdi, A., Alanezi, M., Khan, F.: Design and implementation of a computer aided intelligent examination system. Int. J. Emerg. Technol. Learn. 15(1), 30–44 (2020)

    Article  Google Scholar 

  24. Fu, S., Gu, H., Yang, B.: The affordances of AI-enabled automatic scoring applications on learners’ continuous learning intention: an empirical study in China. Br. J. Educ. Technol. 51(5), 1674–1692 (2020)

    Article  Google Scholar 

  25. Kumar, V., Boulanger, D.: Explainable automated essay scoring: deep learning really has pedagogical value. In: Frontiers in Education, vol. 5, pp. 572367 (2020)

    Google Scholar 

  26. Ma, H., Slater, T.: Using the developmental path of cause to bridge the gap between AWE scores and writing teachers’ evaluations (2015)

    Google Scholar 

  27. Sun, Y.: Application of artificial intelligence in the cultivation of art design professionals. Int. J. Emerg. Technol. Learn. 16(8), 221–237 (2021)

    Article  Google Scholar 

  28. Akmeşe, Ö.F., Kör, H., Erbay, H.: Use of machine learning techniques for the forecast of student achievement in higher education. Inf. Technol. Learn. Tools 82(2), 297–311 (2021)

    Google Scholar 

  29. Costa-Mendes, R., Oliveira, T., Castelli, M., Cruz-Jesus, F.: A machine learning approximation of the 2015 Portuguese high school student grades: a hybrid approach. Educ. Inf. Technol. 26(2), 1527–1547 (2021)

    Article  Google Scholar 

  30. Yu, J.: Academic performance prediction method of online education using random forest algorithm and artificial intelligence methods. Int. J. Emerg. Technol. Learn. 15(5), 45–57 (2021)

    Google Scholar 

  31. Cope, B., Kalantzis, M., Searsmith, D.: Artificial intelligence for education: knowledge and its assessment in AI-enabled learning ecologies. Educ. Philos. Theory 53(12), 1229–1245 (2021)

    Article  Google Scholar 

  32. Espinosa, M.P.P., Cartagena, F.C.: Tecnologías avanzadas para afrontar el reto de la innovación educativa. RIED. Rev. Iberoam. Educ. a Distancia 24(1), 33–53 (2021)

    Google Scholar 

  33. Cabero-Almenara, J., Romero-Tena, R., Palacios-Rodríguez, A.: Evaluation of teacher digital competence frameworks through expert judgement: The use of the expert competence coefficient. J. New Approaches Educ. Res. (NAER Journal) 9(2), 275–293 (2020)

    Article  Google Scholar 

  34. (Hans) Korteling, J.E., van de Boer-Visschedijk, G.C., Blankendaal, R.A.M., Boonekamp, R.C., Eikelboom, A.R.: Human-versus artificial intelligence. Front. Artif. Intell. 4, 622364 (2021)

    Google Scholar 

  35. De Beijing, C.: Consenso de Beijinng sobre a inteligência artificial e a educação (2019). https://en.unesco.org/themes/ict-education

  36. Collazos, C.A., Gutiérrez, F.L., Gallardo, J., Ortega, M., Fardoun, H.M., Molina, A.I.: Descriptive theory of awareness for groupware development. J. Ambient. Intell. Humaniz. Comput. 10, 4789–4818 (2019)

    Article  Google Scholar 

  37. Yu, P.K.: The algorithmic divide and equality in the age of artificial intelligence. Fla. L. Rev. 72, 331 (2020)

    Google Scholar 

  38. Bodo, B., et al.: Tackling the algorithmic control crisis-the technical, legal, and ethical challenges of research into algorithmic agents. Yale JL Tech. 19, 133 (2017)

    Google Scholar 

  39. Southgate, E.: Artificial intelligence, ethics, equity and higher education: A ‘beginning-of-the-discussion’ paper (2020)

    Google Scholar 

  40. Fitzgerald, J., et al.: Important text characteristics for early-grades text complexity. J. Educ. Psychol. 107(1), 4 (2015)

    Google Scholar 

  41. Qian, L., Zhao, Y., Cheng, Y.: Evaluating China’s automated essay scoring system iWrite. J. Educ. Comput. Res. 58(4), 771–790 (2020)

    Article  Google Scholar 

  42. Lu, X.: An empirical study on the artificial intelligence writing evaluation system in China CET. Big data 7(2), 121–129 (2019)

    Article  Google Scholar 

  43. Williams, C.: Hype, or the future of learning and teaching? 3 Limits to AI’s ability to write student essays (2023)

    Google Scholar 

  44. Tate, T., Doroudi, S. Ritchie, D., Xu, Y.: Educational research and AI-generated writing: Confronting the coming tsunami (2023)

    Google Scholar 

  45. Chiu, T.K.F., Chai, C.: Sustainable curriculum planning for artificial intelligence education: a self-determination theory perspective. Sustainability 12(14), 5568 (2020)

    Article  Google Scholar 

  46. McCarthy, T., Rosenblum, L.P., Johnson, B.G., Dittel, J., Kearns, D.M.: An artificial intelligence tutor: a supplementary tool for teaching and practicing braille. J. Vis. Impair. Blind. 110(5), 309–322 (2016)

    Article  Google Scholar 

  47. Earl, L.M.: Assessment as Learning: Using Classroom Assessment to Maximize Student Learning. Corwin Press, Thousand Oaks (2012)

    Google Scholar 

  48. Wiliam, D.: What is assessment for learning? Stud. Educ. Eval. 37(1), 3–14 (2011)

    Article  Google Scholar 

  49. Willis, J., Adie, L., Klenowski, V.: Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform. Aust. Educ. Res. 40, 241–256 (2013)

    Article  Google Scholar 

Download references

Acknowledgment

This work has been supported by FCT – Fundação para a Ciência e Tecnologia within the Project Scope: UIDB/05777/2020.

Author information

Authors and Affiliations

  1. CIEB, Polytechnic Institute of Bragança, Bragança, Portugal

    Bruno F. Gonçalves & Maria Raquel Patrício

  2. Catholic University of Mozambique, Beira, Mozambique

    Amália Comiche

Authors
  1. Bruno F. Gonçalves
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Raquel Patrício
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amália Comiche
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bruno F. Gonçalves .

Editor information

Editors and Affiliations

  1. ISEG, Universidade de Lisboa, Lisbon, Portugal

    Álvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

  3. Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania

    Gintautas Dzemyda

  4. DCT, Universidade Portucalense, Porto, Portugal

    Fernando Moreira

  5. Institute of Information Technology, Lodz University of Technology, Łódz, Poland

    Aneta Poniszewska-Marańda

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gonçalves, B.F., Patrício, M.R., Comiche, A. (2024). The Challenges of Learning Assessment in the Age of Artificial Intelligence. In: Rocha, Á., Adeli, H., Dzemyda, G., Moreira, F., Poniszewska-Marańda, A. (eds) Good Practices and New Perspectives in Information Systems and Technologies. WorldCIST 2024. Lecture Notes in Networks and Systems, vol 988. Springer, Cham. https://doi.org/10.1007/978-3-031-60224-5_3

Download citation

Publish with us

Policies and ethics

Search

Navigation