Abstract
Our previous analysis on 26 languages which represent over 2.9 billion speakers and 8 language families demonstrated that cross-lingual automatic short answer grading allows students to write answers in exams in their native language and graders to rely on the scores of the system [1]. With lower deviations than 14% (0.72 points out of 5 points) on the corpus of the short answer grading data set of the University of North Texas [2], our natural language processing models show better performances compared to the human grader variability (0.75 points, 15%). In this paper we describe our latest analysis of the integration and application of a multilingual model in interactive training programs to optimally prepare students for exams. We present a multilingual interactive conversational artificial intelligence tutoring system for exam preparation. Our approach leverages and combines learning analytics, crowdsourcing and gamification to automatically allow us to evaluate and adapt the system as well as to motivate students and increase their learning experience. In order to have an optimal learning effect and enhance the user experience, we also tackle the challenge of explainability with the help of keyword extraction and highlighting techniques. Our system is based on Telegram since it can be easily integrated into massive open online courses and other online study systems and has already more than 400 million users worldwide [3].
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Schlippe, T., Sawatzki, J.: Cross-Lingual Automatic Short Answer Grading. In: AIET, Wuhan, China (2021)
Mohler, M., Bunescu, R., Mihalcea, R.: Learning to Grade Short Answer Questions using Semantic Similarity Measures and Dependency Graph Alignments. In: ACL-HLT, Portland, Oregon, USA (2011)
Statista: Number of monthly active Telegram users worldwide from March 2014 to April 2020 (2021). https://www.statista.com/statistics/234038/telegram-messenger-mau-users
United Nations: Sustainable Development Goals: 17 Goals to Transform our World (2021). https://www.un.org/sustainabledevelopment/sustainable-development-goals
Statista: The Most Spoken Languages Worldwide in 2019 (2020). https://www.statista.com/statistics/266808/the-most-spoken-languages-worldwide
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: NAACL-HLT, Minneapolis, Minnesota (2019)
Libbrecht, P., Declerck, T., Schlippe, T., Mandl, T., Schiffner, D.: NLP for Student and Teacher: Concept for an AI based Information Literacy Tutoring System. In: CIKM. Galway, Ireland (2020)
Liu, Y., et al.: RoBERTa: A Robustly Optimized BERT Pretraining Approach (2019). https://arxiv.org/abs/1907.11692
Conneau, A., et al.: Unsupervised Cross-lingual Representation Learning at Scale (2018). https://arxiv.org/abs/1911.02116
Pires, T., Schlinger, E., Garrette, D.: How Multilingual is Multilingual BERT? In: ACL. Florence, Italy (2019)
Burrows, S., Gurevych, I., Stein, B.: The Eras and Trends of Automatic Short Answer Grading. Int. J. Artif. Intell. Educ. 25(1), 60–117 (2014). https://doi.org/10.1007/s40593-014-0026-8
Camus, L., Filighera, A.: Investigating Transformers for Automatic Short Answer Grading. AIED. Cyberspace (2020)
Sawatzki, J., Schlippe, T., Benner-Wickner, M.: Deep Learning Techniques for Automatic Short Answer Grading: Predicting Scores for English and German Answers. In: AIET, Wuhan, China (2021)
Wölfel, M.: Towards the Automatic Generation of Pedagogical Conversational Agents from Lecture Slides. In: Fu, W., Xu, Y., Wang, S.-H., Zhang, Y. (eds.) Multimedia Technology and Enhanced Learning. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 388, pp. 216–229. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-82565-2_18
Bocklisch, T., Faulkner, J., Pawlowski, N., Nichol, A.: Rasa: Open Source Language Understanding and Dialogue Management. Cornell University (2017). https://arxiv.org/abs/1712.05181
Reyes, R., Garza, D., Garrido, L., De la Cueva, V., Ramirez, J.: Methodology for the Implementation of Virtual Assistants for Education using Google Dialogflow. In: Martínez-Villaseñor, L., Batyrshin, I., Marín-Hernández, A. (eds.) Advances in Soft Computing. Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence), vol. 11835, pp. 440–451. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33749-0_35
Setiaji, H., Paputungan, I.V.: Design of Telegram Bots for Campus Information Sharing. In: ICITDA. Yogyakarta, Indonesia (2017)
Wu, Y., et al.: Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation (2016). https://arxiv.org/abs/1609.08144
Aiken, M.: An Updated Evaluation of Google Translate Accuracy. Stud. Linguist. Literat. 3, 253 (2019)
Hasan, K.S.: Automatic Keyphrase Extraction: A Survey of the State of the Art. In: ACL. Baltimore, Maryland, USA (2014)
Alami Merrouni, Z., Frikh, B., Ouhbi, B.: Automatic Keyphrase Extraction: A Survey and Trends. JIIS 54, 391–424 (2020)
Chandrasekaran, D., Mago, V.: Evolution of Semantic Similarity - A Survey. (2021). https://arxiv.org/abs/2004.13820
Honnibal, M., Montani, I. (n.d.). spaCy. https://spacy.io
de Sousa Borges, S., Durelli, V.H.S., Reis, H.M., Isotani, S.: A Systematic Mapping on Gamification Applied to Education. In: SAC. New York, NY, USA (2014)
Luo, H., Robinson, A., Park, J.-Y.: Peer Grading in a MOOC: Reliability, Validity, and Perceived Effects. Onl. Learn. Off. J. Onl. Learn. Consort. 18, 1–14 (2014). https://doi.org/10.24059/olj.v18i2.429.
Wölfel, M., Schlippe, T., Stitz, A.: Voice Driven Type Design. In: SpeD. Bucharest, Romania (2015)
Schlippe, T., Alessai, S., El-Taweel, G., Wölfel, M., Zaghouani, W.: Visualizing Voice Characteristics with Type Design in Closed Captions for Arabic. In: Cyberworlds. Caen, France (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Schlippe, T., Sawatzki, J. (2022). AI-Based Multilingual Interactive Exam Preparation. In: Guralnick, D., Auer, M.E., Poce, A. (eds) Innovations in Learning and Technology for the Workplace and Higher Education. TLIC 2021. Lecture Notes in Networks and Systems, vol 349. Springer, Cham. https://doi.org/10.1007/978-3-030-90677-1_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-90677-1_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90676-4
Online ISBN: 978-3-030-90677-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)