Abstract
Prediction of student performance is one of the most important subjects of educational data mining. Artificial neural networks are seen to be an effective tool in predicting student performance in e-learning environments. In the studies carried out with artificial neural networks, performance predictions based on student scores are generally made, but students’ use of learning management system is not focused. In this study, performances of 3518 university students, who studying and actively participating in a learning management system, were tried to be predicted by artificial neural networks in terms of gender, content score, time spent on the content, number of entries to content, homework score, number of attendance to live sessions, total time spent in live sessions, number of attendance to archived courses and total time spent in archived courses variables. Since it is difficult to interpret how much input variables in artificial neural networks contribute to predicting output variables, these networks are called black boxes. Also, in this study the amount of contribution of input variables on the prediction of output variable was also examined. The artificial neural network created as a result of the study makes a prediction with an accuracy of 80.47%. Finally, it was found that the variables of number of attendance to the live classes, the number of attendance to archived courses and the time spent in the content contributed most to the prediction of the output variable.
Similar content being viewed by others
References
Al-Shehri, H., Al-Qarni, A., Al-Saati, L., Batoaq, A., Badukhen, H., Alrashed, S., . . . Olatunji, S. O. (2017, April 30–May 3). Student performance prediction using Support Vector Machine and K-Nearest Neighbor. Paper presented at the 2017 IEEE 30th Canadian conference on electrical and computer engineering (CCECE).
Angeli, C., Howard, S. K., Ma, J., Yang, J., & Kirschner, P. A. (2017). Data mining in educational technology classroom research: Can it make a contribution? Computers & Education, 113, 226–242. https://doi.org/10.1016/j.compedu.2017.05.021.
Arsad, P. M., Buniyamin, N., & Manan, J. A. (2013, November 25–27). A neural network students’ performance prediction model (NNSPPM). Paper presented at the 2013 IEEE international conference on smart instrumentation, measurement and applications (ICSIMA).
Asif, R., Merceron, A., Ali, S. A., & Haider, N. G. (2017). Analyzing undergraduate students’ performance using educational data mining. Computers & Education, 113, 177–194. https://doi.org/10.1016/j.compedu.2017.05.007.
Baker, R. S., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. JEDM| Journal of Educational Data Mining, 1(1), 3–17.
Bakhshinategh, B., Zaiane, O. R., ElAtia, S., & Ipperciel, D. (2018). Educational data mining applications and tasks: A survey of the last 10 years. Education and Information Technologies, 23(1), 537–553. https://doi.org/10.1007/s10639-017-9616-z.
Benítez, J. M., Castro, J. L., & Requena, I. (1997). Are artificial neural networks black boxes? IEEE Transactions on Neural Networks, 8(5), 1156–1164.
Bousbia, N., & Belamri, I. (2014). Which contribution does EDM provide to computer-based learning environments? In Educational data mining (pp. 3–28). Cham: Springer.
Chickering, A. W., & Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. AAHE Bulletin, 3, 7.
Chollet, F. (2018). Keras. Retrieved from https://keras.io
Conijn, R., Snijders, C., Kleingeld, A., & Matzat, U. (2017). Predicting student Performance from LMS data: A comparison of 17 blended courses using Moodle LMS. IEEE Transactions on Learning Technologies, 10(1), 17–29. https://doi.org/10.1109/TLT.2016.2616312.
Conijn, R., Van den Beemt, A., & Cuijpers, P. (2018). Predicting student performance in a blended MOOC. Journal of Computer Assisted Learning, 34(5), 615–628.
da Silva, I. N., Hernane Spatti, D., Andrade Flauzino, R., Liboni, L. H. B., & dos Reis Alves, S. F. (2017). Introduction. In Artificial neural networks: A practical course (pp. 3–19). Cham: Springer International Publishing.
de Barba, P. G., Kennedy, G. E., & Ainley, M. D. (2016). The role of students’ motivation and participation in predicting performance in a MOOC. Journal of Computer Assisted Learning, 32(3), 218–231. https://doi.org/10.1111/jcal.12130.
de Oña, J., & Garrido, C. (2014). Extracting the contribution of independent variables in neural network models: A new approach to handle instability. Neural Computing and Applications, 25(3), 859–869. https://doi.org/10.1007/s00521-014-1573-5.
Dimopoulos, Y., Bourret, P., & Lek, S. (1995). Use of some sensitivity criteria for choosing networks with good generalization ability. Neural Processing Letters, 2(6), 1–4.
Garson, G. D. (1991). Interpreting neural-network connection weights. AI Expert, 6(4), 46–51.
Goh, A. T. C. (1995). Back-propagation neural networks for modeling complex systems. Artificial Intelligence in Engineering, 9(3), 143–151. https://doi.org/10.1016/0954-1810(94)00011-S.
González-Gómez, F., Guardiola, J., Martín Rodríguez, Ó., & Montero Alonso, M. Á. (2012). Gender differences in e-learning satisfaction. Computers & Education, 58(1), 283–290. https://doi.org/10.1016/j.compedu.2011.08.017.
Gray, G., McGuinness, C., & Owende, P. (2014, February 21–22). An application of classification models to predict learner progression in tertiary education. Paper presented at the 2014 IEEE international advance computing conference (IACC).
Guarín, C. E. L., Guzmán, E. L., & González, F. A. (2015). A model to predict low academic performance at a specific enrollment using data mining. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 10(3), 119–125. https://doi.org/10.1109/RITA.2015.2452632.
Huang, S., & Fang, N. (2013). Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models. Computers & Education, 61, 133–145. https://doi.org/10.1016/j.compedu.2012.08.015.
Hussain, M., Zhu, W., Zhang, W., Abidi, S. M. R., & Ali, S. (2018). Using machine learning to predict student difficulties from learning session data. Artificial Intelligence Review, 52, 381–407. https://doi.org/10.1007/s10462-018-9620-8.
Ibrahim, Z., & Rusli, D. (2007). Predicting students’ academic performance: Comparing artificial neural network, decision tree and linear regression. Paper presented at the 21st annual SAS Malaysia forum.
Ketkar, N. (2017). Deep learning with python: A hands-on introduction. Berkeley: Apress.
Kim, P. (2017). MATLAB deep learning: With machine learning, neural networks and artificial intelligence. Berkeley: Apress.
Kumar, A. D., Selvam, R. P., & Kumar, K. S. (2018). Review on prediction algorithms in educational data mining. International Journal of Pure and Applied Mathematics, 118, 531–536.
Ma, J., Han, X., Yang, J., & Cheng, J. (2015). Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor. The Internet and Higher Education, 24, 26–34. https://doi.org/10.1016/j.iheduc.2014.09.005.
Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008.
Narayanan, S. A., Prasanth, M., Mohan, P., Kaimal, M., & Bijlani, K. (2012). Attention analysis in e-learning environment using a simple web camera. Paper presented at the 2012 IEEE international conference on technology enhanced education (ICTEE).
Naser, S. A., Zaqout, I., Ghosh, M. A., Atallah, R., & Alajrami, E. (2015). Predicting student performance using artificial neural network: In the Faculty of Engineering and Information Technology. International Journal of Hybrid Information Technology, 8(2), 221–228.
Nielsen, M. A. (2015). Neural networks and deep learning (Vol. 25). San Francisco, CA, USA:Determination Press.
Olden, J. D., & Jackson, D. A. (2002). Illuminating the “black box”: A randomization approach for understanding variable contributions in artificial neural networks. Ecological Modelling, 154(1–2), 135–150.
Olden, J. D., Joy, M. K., & Death, R. G. (2004). An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data. Ecological Modelling, 178(3), 389–397. https://doi.org/10.1016/j.ecolmodel.2004.03.013.
Ong, C.-S., & Lai, J.-Y. (2006). Gender differences in perceptions and relationships among dominants of e-learning acceptance. Computers in Human Behavior, 22(5), 816–829. https://doi.org/10.1016/j.chb.2004.03.006.
Özonur, M., Yanpar Yelken, T., & Sancar Tokmak, H. (2018). Social presence and motivation in online environments: Second life versus the Enocta learning management system/adobe connect. Australasian Journal of Educational Technology, 34(3). https://doi.org/10.14742/ajet.3128.
Özonur, M., Kamışlı, H., Yanpar Yelken, T., & Sancar Tokmak, H. (2019). Uzaktan Eğitim Öğrencilerinin Enocta Öğrenme Yönetim Sistemi Hakkında Görüşlerinin İncelenmesi. Mehmet Akif Ersoy Üniversitesi Eğitim Fakültesi Dergisi, 50, 283–302.
Paliwal, M., & Kumar, U. A. (2009). A study of academic performance of business school graduates using neural network and statistical techniques. Expert Systems with Applications, 36(4), 7865–7872. https://doi.org/10.1016/j.eswa.2008.11.003.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(Oct), 2825–2830.
Peña-Ayala, A. (2014). Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications, 41(4, Part 1), 1432–1462. https://doi.org/10.1016/j.eswa.2013.08.042.
Quadri, M. M., & Kalyankar, N. V. (2010). Drop out feature of student data for academic performance using decision tree techniques. Global Journal of Computer Science and Technology, 10(2), 2-5.
Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40(6), 601–618. https://doi.org/10.1109/TSMCC.2010.2053532.
Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12–27.
Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013). Predicting students’ final performance from participation in on-line discussion forums. Computers & Education, 68, 458–472. https://doi.org/10.1016/j.compedu.2013.06.009.
Schacter, D. L., & Szpunar, K. K. (2015). Enhancing attention and memory during video-recorded lectures. Scholarship of Teaching and Learning in Psychology, 1(1), 60–71. https://doi.org/10.1037/stl0000011.
Şengür, D., & Tekin, A. (2013). Öğrencilerin mezuniyet notlarının veri madenciliği metotları ile tahmini. Bilişim Teknolojileri Dergisi, 6(3), 7–16.
Shahiri, A. M., Husain, W., & Rashid, N. A. (2015). A review on predicting Student’s performance using data mining techniques. Procedia Computer Science, 72, 414–422. https://doi.org/10.1016/j.procs.2015.12.157.
Stevens, R., Ikeda, J., Casillas, A., Palacio-Cayetano, J., & Clyman, S. (1999). Artificial neural network-based performance assessments. Computers in Human Behavior, 15(3), 295–313. https://doi.org/10.1016/S0747-5632(99)00025-4.
Tanner, T., & Toivonen, H. (2010). Predicting and preventing student failure – using the k-nearest neighbour method to predict student performance in an online course environment. International Journal of Learning Technology, 5(4), 356–377. https://doi.org/10.1504/ijlt.2010.038772.
Yang, F., & Li, F. W. B. (2018). Study on student performance estimation, student progress analysis, and student potential prediction based on data mining. Computers & Education, 123, 97–108. https://doi.org/10.1016/j.compedu.2018.04.006.
Zhou, Y., Chang, F.-J., Chang, L.-C., Kao, I. F., & Wang, Y.-S. (2019). Explore a deep learning multi-output neural network for regional multi-step-ahead air quality forecasts. Journal of Cleaner Production, 209, 134–145. https://doi.org/10.1016/j.jclepro.2018.10.243.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Aydoğdu, Ş. Predicting student final performance using artificial neural networks in online learning environments. Educ Inf Technol 25, 1913–1927 (2020). https://doi.org/10.1007/s10639-019-10053-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-019-10053-x