Multicriteria Automatic Essay Assessor Generation by Using TOPSIS Model and Genetic Algorithm
With the advance of computer technology and computing power, more efficient automatic essay assessment is coming to use. Essay assessment should be a multicriteria decision making problem, because an essay is composed of multiple concepts. While prior works have proposed several methods to assess students’ essays, little attention is paid to use multicriteria for essay evaluation. This paper presents a Multicriteria Automatic Essay Assessor (MAEA) based on combined Latent Semantic Analysis (LSA), Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), and Genetic Algorithm (GA) to assess essays. LSA is employed to construct concept dimensions, TOPSIS incorporated to model the multicriteria essay assessor, and GA used to find the optimal concept dimensions among LSA concept dimensions. To show the effectiveness of the method, the essays of students majoring in information management are evaluated by MAEA. The results show that MAEA’s scores are highly correlated with those of the human graders.
KeywordsGenetic Algorithm Latent Semantic Analysis Multicriteria Decision Semantic Space Concept Dimension
Unable to display preview. Download preview PDF.
- 1.Abo-Sinna, M.A., Amer, A.H.: Extensions of TOPSIS for multi-objective large-scale nonlinear programming problems. Applied Mathematics and Computation, 243–256 (2005)Google Scholar
- 3.Clauser, B.E., Ross, L.P., Clyman, S.G., Rose, K.M., Margolis, M.J., Nungester, R.J., Piemme, T.E., Chang, L., El-Bayoumi, G., Malakoff, G.L., Pincetl, P.S.: Development of a scoring algorithm to replace expert rating for scoring a complex performance-based assessment. Applied Measurement in Education 10, 345–358 (1997)CrossRefGoogle Scholar
- 4.Dale, E., Chall, J.S.: A formula for predicting readability. Educational Research Bulletin 87, 11–20 (1948)Google Scholar
- 9.Holland, J.H.: Adaption in natural and artificial systems. MIT Press, Massachusetts (1992)Google Scholar
- 10.Hwang, C.L., Yoon, K.: Multiple Attribute Decision Making: Methods and Applica-tions. Springer, New York (1981)Google Scholar
- 12.Landauer, T.K., Laham, D., Foltz, P.W.: The intelligent Essay Assessor. IEEE Intelligent Systems 15, 27–31 (2000)Google Scholar
- 18.Page, E.B.: The imminence of grading essays by computers. Phi Delta Kappan 47, 238–243 (1966)Google Scholar
- 20.Page, E.B., Petersen, N.S.: The computer moves into essay grading: updating the ancient test. Phi Delta Kappan, 561–565 (1995)Google Scholar