Skip to main content
SpringerLink
Log in

Intelligent On-line Exam Management and Evaluation System

  • Conference paper
  • First Online:
Intelligent Tutoring Systems (ITS 2019)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 11528))

Included in the following conference series:

Abstract

Educational assessment plays a central role in the teaching-learning process as a tool for evaluating students’ knowledge of the concepts associated with the learning objectives. The evaluation and scoring of essay answers is a process, besides being costly in terms of time spent by teachers, what may lead to inequities due to the difficulty in applying the same evaluation criteria to all answers. In this work, we present a system for online essay exam evaluation and scoring which is composed of different modules and helps teachers in creating, evaluating and giving textual feedbacks on essay exam solutions provided by students. The system automatically scores essays, semantically, using pair-wise approach. Using the system, the teacher can also give an unlimited number of textual feedbacks by selecting a phrase, a sentence or a paragraph on a given student’s essay. We performed a survey to assess the usability of the system with regard to the time saved during grading, an overall level of satisfaction, fairness in grading and simplification of essay evaluation. Around 80% of the users responded that the system helps them to grade essays more fairly and easily.

J. P. Esclamado—Independent Researcher

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.etestsupport.com.

  2. 2.

    The developed system is not intended to serve as a learning management system (e.g. Moodle) but, rather, as an e-Testing framework. However, we have implemented this ability to upload course materials for teachers not using any other system.

  3. 3.

    https://code.google.com/archive/p/word2vec/.

  4. 4.

    https://www.kaggle.com/c/asap-sas.

References

  1. Leckie, G., Baird, J.-A.: Rater effects on essay scoring: a multilevel analysis of severity drift, central tendency, and rater experience. J. Educ. Meas. 48, 399–418 (2011)

    Article  Google Scholar 

  2. Kaya, B.Y., Kaya, G., Dagdeviren, M.: A sample application of web based examination system for distance and formal education. Procedia - Soc. Behav. Sci. 141, 1357–1362 (2014)

    Article  Google Scholar 

  3. Yağci, M., Ünal, M.: Designing and implementing an adaptive online examination system. Procedia - Soc. Behav. Sci. 116, 3079–3083 (2014)

    Article  Google Scholar 

  4. Tashu, T.M., Horvath, T.: Pair-wise: automatic essay evaluation using word mover’s distance. In: The 10th International Conference on Computer Supported Education - Volume 2: CSEDU, pp. 59–66. SciTePress (2018)

    Google Scholar 

  5. Attali, Y.: A differential word use measure for content analysis in automated essay scoring. ETS Res. Rep. Ser. 36, 1–19 (2011)

    Google Scholar 

  6. Page, E.B.: Grading essays by computer: progress report. In: Invitational Conference on Testing Problems (1966)

    Google Scholar 

  7. Thomas, P., Haley, D., deRoeck, A., Petre, M.: e-Assessment using latent semantic analysis in the computer science domain: a pilot study. In: Proceedings of the Workshop on eLearning for Computational Linguistics and Computational Linguistics for eLearning, pp. 38–44. ACL (2004)

    Google Scholar 

  8. Foltz, P.W., Laham, D., Landauer, T.K.: Automated essay scoring : applications to educational technology. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA) (1999)

    Google Scholar 

  9. Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distances. In: International Conference on Machine Learning (2015)

    Google Scholar 

  10. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositions. In: NIPS (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Informatics, Department of Data Science and Engineering, Telekom Innovation Laboratories, ELTE-Eötvös Loránd University, Pázmány Péter Sétány 1117, Budapest, Hungary

    Tsegaye Misikir Tashu & Tomas Horvath

  2. Faculty of Informatics, 3in Research Group, ELTE-Eötvös Loránd University, Martonvásár, Hungary

    Tsegaye Misikir Tashu

  3. Faculty of Science, Institute of Computer Science, Pavol Jozef Šafárik University, Jesenná 5, 040 01, Košice, Slovakia

    Tomas Horvath

  4. Cagayan de Oro, Philippines

    Julius P. Esclamado

Authors
  1. Tsegaye Misikir Tashu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julius P. Esclamado
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomas Horvath
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tsegaye Misikir Tashu .

Editor information

Editors and Affiliations

  1. University of the West Indies, Kingston, Jamaica

    Andre Coy

  2. Ritsumeikan University, Osaka, Japan

    Yugo Hayashi

  3. Athabasca University, Edmonton, AB, Canada

    Maiga Chang

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tashu, T.M., Esclamado, J.P., Horvath, T. (2019). Intelligent On-line Exam Management and Evaluation System. In: Coy, A., Hayashi, Y., Chang, M. (eds) Intelligent Tutoring Systems. ITS 2019. Lecture Notes in Computer Science(), vol 11528. Springer, Cham. https://doi.org/10.1007/978-3-030-22244-4_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-22244-4_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-22243-7

  • Online ISBN: 978-3-030-22244-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation