Skip to main content

Chat GPT Performance Evaluation Model for Learning

  • Conference paper
  • First Online:
Smart Mobile Communication & Artificial Intelligence (IMCL 2023)

Abstract

Artificial Intelligence has evolved significantly since its initial conception, and today is a widespread technology that finds applications in various sectors, including education. The emergence of Chat GPT provoked considerable interest both among ordinary users and among a number of researchers. In this regard, it is of interest to study the possibilities of Chat GPT to deal with challenges from the modern educational environment. For this purpose, Chat GPT is considered as an educational assistant, for which it is necessary to define performance indicators. In this report, two groups of performance indicators are defined in terms of Technical performance and Educational performance of Chat GPT in an educational environment. The determined indicators were used in the formulation of a mathematical model for the overall evaluation of the effectiveness of the use of Chat GPT in relation to the educational process. The applicability of the model is demonstrated using Chat GPT to solve specific tasks related to learning JavaScript in grade 12.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Al-Bahrani, M., Gombos, Z., Cree, A.: The mechanical properties of functionalised MWCNT infused epoxy resin: A theoretical and experimental study. Int. J. Mech. Mechatron. Eng. 18, 76–86 (2018)

    Google Scholar 

  2. Alarabi, K., Wardat, Y.: UAE-based teachers’ hindsight judgments on physics education during the COVID-19 pandemic. Psychol. Educ. J. 58(3), 2497–2511 (2021)

    Google Scholar 

  3. Al-Bahrani, M., Mohammed, A., Ridh, H., Alistair, C.: Damage sensing and mechanical properties of a laminate composite material containing MWCNTs during low-velocity impact. J. Petrol. Res. Stud. 10(4), 147–164 (2020)

    Article  Google Scholar 

  4. Alneyadi, S., Wardat, Y., Alshannag, Q., Abu-Al-Aish, A.: The effect of using smart e-learning app on the academic achievement of eighth-grade students. EURASIA J. Math. Sci. Technol. Educ. 19(4), em2248 (2023)

    Google Scholar 

  5. Baidoo-Anu, D., Owusu Ansah, L.: Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. SSRN. https://doi.org/10.2139/ssrn.4337484. (2023)

  6. Brownlee, J.: What is GPT-3? A guide to the OpenAI language model. Machine Learning Mastery. https://machinelearningmastery.com/gpt-3-explained/. Accessed 15 April 2023

  7. Coppin, B.: Artificial Intelligence Illuminated, Boston, MA. Jones and Bartlett, Boston MA USA (2004)

    Google Scholar 

  8. Harry, A.: Role of AI in Education. Interdicipl. J. Hum. Injur. 2(3), 260–268 (2023)

    Google Scholar 

  9. Herft, A.: A teacher's prompt guide to ChatGPT aligned with ‘What Works Best’ guide. https://usergeneratededucation.files.wordpress.com/2023/01/a-teachers-prompt-guide-to-chatgpt-aligned-with-what-works-best.pdf. Accessed 25 May 2023

  10. Holmes, W., Bialik, M., Fadel, C.: Center for Curriculum Redesign, Boston, MA. https://discovery.ucl.ac.uk/id/eprint/10168357/. Accessed 14 May 2023

  11. Hwang, G.J., Xie, H., Wah, B.W., Gašević, D.: Vision, challenges, roles and research issues of Artificial Intelligence in Education, Computers & Education: Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/S2666920X20300011. Accessed 1 July 2023

  12. Kasneci, E., et al.: ChatGPT for good? On opportunities and challenges of Large Language Models for education. https://www.edu.sot.tum.de/fileadmin/w00bed/hctl/_my_direct_uploads/ChatGPT_for_Good_.pdf. Accessed 11 April 2023

  13. Kaplan, A., Haenlein, M.: Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Bus. Horiz. 62, 15–25 (2019)

    Article  Google Scholar 

  14. Kumar, T., et al.: A new vehicle tracking system with R-CNN and random forest classifier for disaster management platform to improve performance. In: 2022 2nd International Conference on Technological Advancements in Computational Sciences (ICTACS), pp. 797–804. IEEE, Prateek (2022)

    Google Scholar 

  15. Lund, B., Wang, T.: Chatting about ChatGPT: How May AI and GPT Impact Academia and Libraries? Hi Tech News, SSRN. https://ssrn.com/abstract=4333415. Accessed 4 April 2023

  16. Mhlanga, D.: Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. SSRN. https://doi.org/10.2139/ssrn.4354422. Accessed 4 April 2023

  17. Qadir, J.: Engineering education in the era of ChatGPT: Promise and pitfalls of Generative AI for education. TechRxiv. https://doi.org/10.36227/techrxiv.21789434.v1. Accessed 11 May 2023

  18. Seaborn, K., Fels, D.: Gamification in theory and action: A survey. Int. J. Hum. Comput. Stud. 74, 14–31 (2023)

    Article  Google Scholar 

  19. Sok, S.: Opinion: Benefits and Risks of ChatGPT in Education. Cambodianess. https://cambodianess.com/article/opinion-benefits-and-risks-of-chatgpt-in-education. Accessed 24 June 2023

  20. Staneva, A., Ivanova, T., Rasheva-Yordanova, K., Borissova, D..: Gamification in education: building an escape Room using VR technologies. In: The 46th International ICT Hybrid Convention MIPRO-Croatian Society for Information, Communication and Electronic Technology, pp. 782–786. MIPRO, Croatia (2023)

    Google Scholar 

  21. Wardat, Y., Belbase, S., Tairab, H.: Mathematics teachers’ perceptions of trends in international mathematics and science study (TIMSS)-related practices in Abu Dhabi Emirate schools. Sustainability 14(9), 5436 (2022)

    Google Scholar 

  22. Whitby, B.: Artificial Intelligence: A Beginner’s Guide. Oneworld, Oxford, U.K (2008)

    Google Scholar 

  23. Yang, X., Hesami, M., Nazemipool, Elnaz, B., Ashkan, Al-Bahrani, M., Azizi, B.: Fabrication of CuCo2S4 yolk-shell spheres embedded with S-scheme V2O5-deposited on wrinkled g-C3N4 for effective promotion of levofloxacin photodegradation. Separat. Purific. Technol. 301, 122005 (2022)

    Google Scholar 

  24. Yeruva, A.R.: Providing a personalized healthcare service to the patients using AIOPs monitoring. Eduvest-J. Univ. Stud. 3(2), 327–334 (2023)

    Article  Google Scholar 

  25. Zhai, X.: ChatGPT user experience: Implications for education. SSRN. https://doi.org/10.2139/ssrn.4312418. Accessed 25 June 2023

  26. Zhai, X.: ChatGPT for next generation science learning. SSRN. https://doi.org/10.2139/ssrn.4331313. Accessed 24 June 2023

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tereza Ivanova .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ivanova, T., Staneva, A., Borissova, D., Rasheva-Yordanova, K. (2024). Chat GPT Performance Evaluation Model for Learning. In: Auer, M.E., Tsiatsos, T. (eds) Smart Mobile Communication & Artificial Intelligence. IMCL 2023. Lecture Notes in Networks and Systems, vol 936. Springer, Cham. https://doi.org/10.1007/978-3-031-54327-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-54327-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-54326-5

  • Online ISBN: 978-3-031-54327-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics