Skip to main content
Book cover

The Learning Ideas Conference

TLIC 2021: Innovations in Learning and Technology for the Workplace and Higher Education pp 396–408Cite as

AI-Based Multilingual Interactive Exam Preparation

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 349)

Abstract

Our previous analysis on 26 languages which represent over 2.9 billion speakers and 8 language families demonstrated that cross-lingual automatic short answer grading allows students to write answers in exams in their native language and graders to rely on the scores of the system [1]. With lower deviations than 14% (0.72 points out of 5 points) on the corpus of the short answer grading data set of the University of North Texas [2], our natural language processing models show better performances compared to the human grader variability (0.75 points, 15%). In this paper we describe our latest analysis of the integration and application of a multilingual model in interactive training programs to optimally prepare students for exams. We present a multilingual interactive conversational artificial intelligence tutoring system for exam preparation. Our approach leverages and combines learning analytics, crowdsourcing and gamification to automatically allow us to evaluate and adapt the system as well as to motivate students and increase their learning experience. In order to have an optimal learning effect and enhance the user experience, we also tackle the challenge of explainability with the help of keyword extraction and highlighting techniques. Our system is based on Telegram since it can be easily integrated into massive open online courses and other online study systems and has already more than 400 million users worldwide [3].

Keywords

  • Artificial intelligence in education
  • Cross-lingual short answer grading
  • Conversational AI
  • Keyword extraction
  • Natural language processing

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-90677-1_38
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   189.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-90677-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   249.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.

References

  1. Schlippe, T., Sawatzki, J.: Cross-Lingual Automatic Short Answer Grading. In: AIET, Wuhan, China (2021)

    Google Scholar 

  2. Mohler, M., Bunescu, R., Mihalcea, R.: Learning to Grade Short Answer Questions using Semantic Similarity Measures and Dependency Graph Alignments. In: ACL-HLT, Portland, Oregon, USA (2011)

    Google Scholar 

  3. Statista: Number of monthly active Telegram users worldwide from March 2014 to April 2020 (2021). https://www.statista.com/statistics/234038/telegram-messenger-mau-users

  4. United Nations: Sustainable Development Goals: 17 Goals to Transform our World (2021). https://www.un.org/sustainabledevelopment/sustainable-development-goals

  5. Statista: The Most Spoken Languages Worldwide in 2019 (2020). https://www.statista.com/statistics/266808/the-most-spoken-languages-worldwide

  6. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: NAACL-HLT, Minneapolis, Minnesota (2019)

    Google Scholar 

  7. Libbrecht, P., Declerck, T., Schlippe, T., Mandl, T., Schiffner, D.: NLP for Student and Teacher: Concept for an AI based Information Literacy Tutoring System. In: CIKM. Galway, Ireland (2020)

    Google Scholar 

  8. Liu, Y., et al.: RoBERTa: A Robustly Optimized BERT Pretraining Approach (2019). https://arxiv.org/abs/1907.11692

  9. Conneau, A., et al.: Unsupervised Cross-lingual Representation Learning at Scale (2018). https://arxiv.org/abs/1911.02116

  10. Pires, T., Schlinger, E., Garrette, D.: How Multilingual is Multilingual BERT? In: ACL. Florence, Italy (2019)

    Google Scholar 

  11. Burrows, S., Gurevych, I., Stein, B.: The Eras and Trends of Automatic Short Answer Grading. Int. J. Artif. Intell. Educ. 25(1), 60–117 (2014). https://doi.org/10.1007/s40593-014-0026-8

    CrossRef  Google Scholar 

  12. Camus, L., Filighera, A.: Investigating Transformers for Automatic Short Answer Grading. AIED. Cyberspace (2020)

    Google Scholar 

  13. Sawatzki, J., Schlippe, T., Benner-Wickner, M.: Deep Learning Techniques for Automatic Short Answer Grading: Predicting Scores for English and German Answers. In: AIET, Wuhan, China (2021)

    Google Scholar 

  14. Wölfel, M.: Towards the Automatic Generation of Pedagogical Conversational Agents from Lecture Slides. In: Fu, W., Xu, Y., Wang, S.-H., Zhang, Y. (eds.) Multimedia Technology and Enhanced Learning. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 388, pp. 216–229. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-82565-2_18

    CrossRef  Google Scholar 

  15. Bocklisch, T., Faulkner, J., Pawlowski, N., Nichol, A.: Rasa: Open Source Language Understanding and Dialogue Management. Cornell University (2017). https://arxiv.org/abs/1712.05181

  16. Reyes, R., Garza, D., Garrido, L., De la Cueva, V., Ramirez, J.: Methodology for the Implementation of Virtual Assistants for Education using Google Dialogflow. In: Martínez-Villaseñor, L., Batyrshin, I., Marín-Hernández, A. (eds.) Advances in Soft Computing. Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence), vol. 11835, pp. 440–451. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33749-0_35

    CrossRef  Google Scholar 

  17. Setiaji, H., Paputungan, I.V.: Design of Telegram Bots for Campus Information Sharing. In: ICITDA. Yogyakarta, Indonesia (2017)

    Google Scholar 

  18. Wu, Y., et al.: Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation (2016). https://arxiv.org/abs/1609.08144

  19. Aiken, M.: An Updated Evaluation of Google Translate Accuracy. Stud. Linguist. Literat. 3, 253 (2019)

    CrossRef  Google Scholar 

  20. Hasan, K.S.: Automatic Keyphrase Extraction: A Survey of the State of the Art. In: ACL. Baltimore, Maryland, USA (2014)

    Google Scholar 

  21. Alami Merrouni, Z., Frikh, B., Ouhbi, B.: Automatic Keyphrase Extraction: A Survey and Trends. JIIS 54, 391–424 (2020)

    Google Scholar 

  22. Chandrasekaran, D., Mago, V.: Evolution of Semantic Similarity - A Survey. (2021). https://arxiv.org/abs/2004.13820

  23. Honnibal, M., Montani, I. (n.d.). spaCy. https://spacy.io

  24. de Sousa Borges, S., Durelli, V.H.S., Reis, H.M., Isotani, S.: A Systematic Mapping on Gamification Applied to Education. In: SAC. New York, NY, USA (2014)

    Google Scholar 

  25. Luo, H., Robinson, A., Park, J.-Y.: Peer Grading in a MOOC: Reliability, Validity, and Perceived Effects. Onl. Learn. Off. J. Onl. Learn. Consort. 18, 1–14 (2014). https://doi.org/10.24059/olj.v18i2.429.

  26. Wölfel, M., Schlippe, T., Stitz, A.: Voice Driven Type Design. In: SpeD. Bucharest, Romania (2015)

    Google Scholar 

  27. Schlippe, T., Alessai, S., El-Taweel, G., Wölfel, M., Zaghouani, W.: Visualizing Voice Characteristics with Type Design in Closed Captions for Arabic. In: Cyberworlds. Caen, France (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IU International University of Applied Sciences, Bad Honnef, Germany

    Tim Schlippe & Jörg Sawatzki

Authors
  1. Tim Schlippe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jörg Sawatzki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tim Schlippe .

Editor information

Editors and Affiliations

  1. Kaleidoscope Learning, International E-Learning Association, New York, NY, USA

    Dr. David Guralnick

  2. Carinthia University of Applied Sciences, St. Magdalen, Austria

    Prof. Dr. Michael E. Auer

  3. Università degli Studi di Modena e Reggio Emilia, Rome, Italy

    Prof. Dr. Antonella Poce

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Schlippe, T., Sawatzki, J. (2022). AI-Based Multilingual Interactive Exam Preparation. In: Guralnick, D., Auer, M.E., Poce, A. (eds) Innovations in Learning and Technology for the Workplace and Higher Education. TLIC 2021. Lecture Notes in Networks and Systems, vol 349. Springer, Cham. https://doi.org/10.1007/978-3-030-90677-1_38

Download citation