Abstract
Learning analytics are being used in many educational applications in order to help students and Faculty. In our work we use predictive analytics, using student behaviour to predict the likely performance of end of semester final grades with a system we call PredictED. The main contribution of our approach is that our intervention automatically emailed students on a regular basis, with our prediction for the outcome of their exam performance. We targeted first year, first semester University students who often struggle with making the transition into University life where they are given much more responsibility for things like attending class, completing assignments, etc. The form of student behaviour that we used is students’ levels and types of engagement with the University’s Virtual Learning Environment (VLE), Moodle. We mined the Moodle access log files for a range of parameters based on temporal as well as content access, and use machine learning techniques to predict likely pass/fail, on a weekly basis throughout the semester using logs and outcomes from previous years as training material. We chose ten first-year modules with reasonably high failure rates, large enrolments and stability of module content across the years to implement an early warning system on. From these modules 1,558 students were registered for one of these modules. They were offered the chance to opt into receiving weekly email alerts warning them about their likely outcome. Of these 75 % or 1,181 students opted into this service. Pre-intervention there were no differences between participants and non-participants on a number of measures related to previous academic record. However, post-intervention the first-attempt final grade performance yielded nearly 3 % improvement (58.4 % to 61.2 %) on average for those who opted in. This tells us that providing weekly guidance and personalised feedback to vulnerable first year students, automatically generated from monitoring of their online behaviour, has a significant positive effect on their exam performance.
Keywords
References
Arnold, K.E., Pistilli, M.D.: Course signals at purdue: using learning analytics to increase student success. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, LAK 2012, p. 267. ACM Press, New York, April 2012
Calvo-Flores, M.D., Galindo, E.G., Jiménez, M.C.P., Pérez, O.: Predicting students’ marks from moodle logs using neural network models. In: Proceedings of the IV International Conference on Multimedia and Information and Communication Technologies in Education (M-ICTEE 2006), vol. 1, pp. 586–590 (2006)
Casey, K., Gibson, J.P.: (m)Oodles of data: mining moodle to understand student behaviour. In: O’Riordan, F., Toolan, F., Hernandez, R., Smyth, R., Becker, B., Casey, K., Lillis, D., McGing, G., Mulhall, M., O’Sullivan, K. (eds.) Proceedings of the 10th International Conference on Engaging Pedagogy (ICEP 2010), pp, pp. 61–71. Griffith College Dublin, Maynooth, Ireland (2010)
Cocea, M., Weibelzahl, S.: Can log files analysis estimate learners’ level of motivation? In: LWA 2006, Lernen Wissen und Adaptivit. Lernen-Wissensentdeckung - Adaptivität, March 2006
Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiol. 143(1), 29–36 (1982)
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Platt, J., et al.: Fast training of support vector machines using sequential minimal optimization. In: Advances in kernel methods: support vector learning, MIT Press, vol. 3, pp. 185–208 (1999)
Romero, C., Ventura, S., García, E.: Data mining in course management systems: moodle case study and tutorial. Comput. Edu. 51(1), 368–384 (2008)
Wolff, A., Zdrahal, Z., Nikolov, A., Pantucek, M.: Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK 2013, p. 145. ACM Press, New York, April 2013
Acknowledgements
This research was supported by Science Foundation Ireland under grant number SFI/12/RC/2289, and by Dublin City University. The authors wish to thank Aisling McKenna for her help with the statistical analysis of some of the results.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Corrigan, O., Smeaton, A.F., Glynn, M., Smyth, S. (2015). Using Educational Analytics to Improve Test Performance. In: Conole, G., Klobučar, T., Rensing, C., Konert, J., Lavoué, E. (eds) Design for Teaching and Learning in a Networked World. EC-TEL 2015. Lecture Notes in Computer Science(), vol 9307. Springer, Cham. https://doi.org/10.1007/978-3-319-24258-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-24258-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24257-6
Online ISBN: 978-3-319-24258-3
eBook Packages: Computer ScienceComputer Science (R0)