Predicting course achievement of university students based on their procrastination behaviour on Moodle

Abstract

A significant amount of educational data mining (EDM) research consider students’ past performance or non-academic factors to build predictive models, paying less attention to students’ activity data. While procrastination has been found as a crucial indicator which negatively affects performance of students, no research has investigated this underlying factor in predicting achievement of students in online courses. In this study, we aim to predict students’ course achievement in Moodle through their procrastination behaviour using their homework submission data. We first build feature vectors of students’ procrastination tendencies by considering their active, inactive, and spare time for homework, along with homework grades. Accordingly, we then use clustering and classification methods to optimally sort and put students into various categories of course achievement. We use a Moodle course from the University of Tartu in Estonia which includes 242 students to assess the efficacy of our proposed approach. Our findings show that our approach successfully predicts course achievement for students through their procrastination behaviour with precision and accuracy of 87% and 84% with L-SVM outperforming other classification methods. Furthermore, we found that students who procrastinate more are less successful and are potentially going to do poorly in a course, leading to lower achievement in courses. Finally, our results show that it is viable to use a less complex approach that is easy to implement, interpret, and use by practitioners to predict students’ course achievement with a high accuracy, and possibly take remedial actions in the semester.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. Abu Tair MM, El-Halees AM (2012) Mining educational data to improve students’ performance: a case study. Int J Inf 2(2). http://hdl.handle.net/20.500.12358/25066

  2. Ahmad F, Ismail NH, Aziz AA (2015) The prediction of students’ academic performance using classification data mining techniques. Appl Math Sci 9(129):6415–6426

    Google Scholar 

  3. Akram A, Fu C, Li Y, Javed MY, Lin R, Jiang Y, Tang Y (2019) Predicting Students’ academic procrastination in blended learning course using homework submission data. IEEE Access 7:102487–102498

    Google Scholar 

  4. Azevedo R, Cromley JG, Seibert D (2004) Does adaptive scaffolding facilitate students’ ability to regulate their learning with hypermedia? Contemp Educ Psychol 29(3):344–370

    Google Scholar 

  5. Carroll P, White A (2017) Identifying patterns of learner behaviour: what business statistics students do with learning resources. INFORMS Trans Educ 18(1):1–13

    Google Scholar 

  6. Cemalcilar Z, Gökşen F (2014) Inequality in social capital: social capital, social risk and drop-out in the Turkish education system. Br J Sociol Educ 35(1):94–114

    Google Scholar 

  7. Cerezo R, Esteban M, Sánchez-Santillán M, Núñez JC (2017) Procrastinating behaviour in computer-based learning environments to predict performance: a case study in Moodle. Front Psychol 8:1403

    Google Scholar 

  8. Cerezo R, Sánchez-Santillán M, Paule-Ruiz MP, Núñez JC (2016) Students’ LMS interaction patterns and their relationship with achievement: a case study in higher education. Comput Educ 96:42–54

    Google Scholar 

  9. Christian TM, Ayub M (2014) Exploration of classification using NBTree for predicting students’ performance. In: 2014 International conference on data and software engineering (ICODSE). IEEE, pp 1–6

  10. Chui KT, Fung DCL, Lytras MD, Lam TM (2020) Predicting at-risk university students in a virtual learning environment via a machine learning algorithm. Comput Human Behav 107:105584

    Google Scholar 

  11. Díaz-Morales JF, Ferrari JR, Cohen JR (2008) Indecision and avoidant procrastination: the role of morningness—eveningness and time perspective in chronic delay lifestyles. J Gen Psychol 135(3):228–240

    Google Scholar 

  12. Drăgulescu B, Bucos M, Vasiu R (2015) Predicting assignment submissions in a multi-class classification problem. TEM J 4(3):244

    Google Scholar 

  13. Dutt A, Ismail MA, Herawan T (2017) A systematic review on educational data mining. IEEE Access 5:15991–16005

    Google Scholar 

  14. Elvers GC, Polzella DJ, Graetz K (2003) Procrastination in online courses: performance and attitudinal differences. Teach Psychol 30(2):159–162

    Google Scholar 

  15. Ferrari JR (2010) Still procrastinating: the no regrets guide to getting it done. Wiley, New York

    Google Scholar 

  16. Gray G, McGuinness C, Owende P (2014) An application of classification models to predict learner progression in tertiary education. In: 2014 IEEE international advance computing conference (IACC). IEEE, pp 549–554

  17. Graff M (2019) Self-efficacy beliefs and academic procrastination. N Am J Psychol 21(1):81–99

    Google Scholar 

  18. He J, Bailey J, Rubinstein BI, Zhang R (2015) Identifying at-risk students in massive open online courses. In: Twenty-ninth AAAI conference on artificial intelligence

  19. Hellas A, Ihantola P, Petersen A, Ajanovski VV, Gutica M, Hynninen T et al (2018) Predicting academic performance: a systematic literature review. ACM, New York, pp 175–199

    Google Scholar 

  20. Herodotou C, Rienties B, Hlosta M, Boroowa A, Mangafa C, Zdrahal Z (2020) The scalable implementation of predictive learning analytics at a distance learning university: insights from a longitudinal case study. Int High Educ 45:100725

    Google Scholar 

  21. Hill RM, Yaroslavsky I, Pettit JW (2015) Enhancing depression screening to identify college students at risk for persistent depressive symptoms. J Affect Disord 174:1–6

    Google Scholar 

  22. Hooshyar D, Kori K, Pedaste M, Bardone E (2019) The potential of open learner models to promote active thinking by enhancing self‐regulated learning in online higher education learning environments. Br J Educ Technol 50(5):2365–2386

    Google Scholar 

  23. Hooshyar D, Pedaste M, Saks K, Leijen Ä, Bardone E, Wang M (2020a) Open learner models in supporting self-regulated learning in higher education: a systematic literature review. Comput Educ 154:103878. https://doi.org/10.1016/j.compedu.2020.103878

    Article  Google Scholar 

  24. Hooshyar D, Pedaste M, Yang Y (2020) Mining educational data to predict students’ performance through procrastination behaviour. Entropy 22(1):12

    Google Scholar 

  25. Huang S, Fang N (2013) Predicting student academic performance in an engineering dynamics course: a comparison of four types of predictive mathematical models. Comput Educ 61:133–145

    Google Scholar 

  26. Huang L, Wang CD, Chao HY, Lai JH, Philip SY (2019) A score prediction approach for optional course recommendation via cross-user-domain collaborative filtering. IEEE Access 7:19550–19563

    Google Scholar 

  27. Hüsing T, Korte WB, Fonstad N, Lanvin B, Cattaneo G, Kolding M, Lifonti R, van Welsum D (2013) E-leadership: E-skills for competitiveness and innovation–vision, roadmap and foresight scenarios. Prepared for European Commission

  28. Hyppönen L, Hirsto L, Sointu E (2019) Perspectives on University Students’ self-regulated learning, task-avoidance, time management and achievement in a flipped classroom context. Int J Learn Teach Educ Res. https://doi.org/10.26803/ijlter.19.1.5

    Article  Google Scholar 

  29. Junco R, Clem C (2015) Predicting course outcomes with digital textbook usage data. Internet High Educ 27:54–63

    Google Scholar 

  30. Kazanidis I, Valsamidis S, Gounopoulos E, Kontogiannis S (2020) Proposed S-Algo+ data mining algorithm for web platforms course content and usage evaluation. Soft Comput 1–23

  31. Kotsiantis S, Pierrakeas C, Pintelas P (2004) Predicting students’ performance in distance learning using machine learning techniques. Appl Artif Intell 18(5):411–426

    Google Scholar 

  32. Kori K, Pedaste M, Tõnisson E, Palts T, Altin H, Rantsus R , Sell R, Murtazin K, Rüütmann T (2015) First-year dropout in ICT studies. In: 2015 IEEE global engineering education conference (EDUCON). IEEE, pp 437–445

  33. Kori K, Pedaste M, Altin H, Tõnisson E, Palts T (2016) Factors that influence students' motivation to start and to continue studying information technology in Estonia. IEEE Trans Educ 59(4):255–262

    Google Scholar 

  34. Kori K, Pedaste M, Must O (2018) The academic, social, and professional integration profiles of information technology students. ACM Trans Comput Educ 18(4):20

    Google Scholar 

  35. Kotsiantis S, Tselios N, Filippidi A, Komis V (2013) Using learning analytics to identify successful learners in a blended learning course. Int J Technol Enhanc Learn 5(2):133–150

    Google Scholar 

  36. Kumar DA, Vijayalakshmi M, Kumar DA (2012) Appraising the significance of self regulated learning in higher education using neural networks. Int J Eng Res Dev 1(1):09–15

    Google Scholar 

  37. Letseka M, Maile S (2008) High university drop-out rates: a threat to South Africa’s future. Human Sciences Research Council Pretoria

  38. Lee S, Hooshyar D, Ji H, Nam K, Lim H (2018) Mining biometric data to predict programmer expertise and task difficulty. Cluster Comput 21(1):1097–1107

    Google Scholar 

  39. Li C, Yoo J (2006) Modeling student online learning using clustering. In: Proceedings of the 44th annual Southeast regional conference, pp 186–191

  40. Li KF, Rusk D, Song F (2013) Predicting student academic performance. In: 2013 Seventh international conference on complex, intelligent, and software intensive systems. IEEE, pp 27–33

  41. Lust G, Vandewaetere M, Ceulemans E, Elen J, Clarebout G (2011) Tool-use in a blended undergraduate course: In search of user profiles. Comput Educ 57(3):2135–2144

    Google Scholar 

  42. Marbouti F, Diefes-Dux HA, Madhavan K (2016) Models for early prediction of at-risk students in a course using standards-based grading. Comput Educ 103:1–15

    Google Scholar 

  43. Meier Y, Xu J, Atan O, Van der Schaar M (2015) Predicting grades. IEEE Trans Signal Process 64(4):959–972

    MathSciNet  MATH  Google Scholar 

  44. Melton AW (1970) The situation with respect to the spacing of repetitions and memory. J Verbal Learn Verbal Behav 9(5):596–606

    Google Scholar 

  45. Michinov N, Brunot S, Le Bohec O, Juhel J, Delaval M (2011) Procrastination, participation, and performance in online learning environments. Comput Educ 56(1):243–252

    Google Scholar 

  46. Michinov N, Primois C (2005) Improving productivity and creativity in online groups through social comparison process: new evidence for asynchronous electronic brainstorming. Comput Hum Behav 21(1):11–28

    Google Scholar 

  47. Minaei-Bidgoli B, Kashy DA, Kortemeyer G, Punch WF (2003) Predicting student performance: an application of data mining methods with an educational web-based system, vol 1, T2A-13. IEEE

  48. Natek S, Zwilling M (2014) Student data mining solution–knowledge management system related to higher education institutions. Expert Syst Appl 41(14):6400–6407

    Google Scholar 

  49. Nayak SG (2019) Impact of procrastination and time-management on academic stress among undergraduate nursing students: a cross sectional study. Int J Caring Sci 12(3):1480–1486

    Google Scholar 

  50. Nieto Y, García-Díaz V, Montenegro C, Crespo RG (2019) Supporting academic decision making at higher educational institutions using machine learning-based algorithms. Soft Comput 23(12):4145–4153

    Google Scholar 

  51. Olivé DM, Huynh DQ, Reynolds M, Dougiamas M, Wiese DQ (2019) A quest for a one-size-fits-all neural network: early prediction of students at risk in online courses. IEEE Trans Learn Technol 12(2):171–183

    Google Scholar 

  52. Park Y, Yu JH, Jo IH (2016) Clustering blended learning courses by online behaviour data: a case study in a Korean higher education institute. Internet High Educ 29:1–11

    Google Scholar 

  53. Parack S, Zahid Z, Merchant F (2012) Application of data mining in educational databases for predicting academic trends and patterns. In: 2012 IEEE international conference on technology enhanced education (ICTEE). IEEE, pp 1–4

  54. Pedaste M, Sarapuu T (2006) Developing an effective support system for inquiry learning in a web-based environment. J Comput Assist Learn 22(1):47–62

    Google Scholar 

  55. Richardson M, Abraham C, Bond R (2012) Psychological correlates of university students’ academic performance: a systematic review and meta-analysis. Psychol Bull 138(2):353

    Google Scholar 

  56. Romero C, Ventura S (2007) Educational data mining: a survey from 1995 to 2005. Expert Syst Appl 33(1):135–146

    Google Scholar 

  57. Romero C, Ventura S (2010) Educational data mining: a review of the state of the art. IEEE Trans Syst Man Cybern Part C (Appl Rev) 40(6):601–618

    Google Scholar 

  58. Romero C, Ventura S (2013) Data mining in education. Wiley Interdiscip Rev Data Min Knowl Discov 3(1):12–27

    Google Scholar 

  59. Sandoval A, Gonzalez C, Alarcon R, Pichara K, Montenegro M (2018) Centralized student performance prediction in large courses based on low-cost variables in an institutional context. Internet High Educ 37:76–89

    Google Scholar 

  60. Schraw G, Wadkins T, Olafson L (2007) Doing the things we do: a grounded theory of academic procrastination. J Educ Psychol 99(1):12

    Google Scholar 

  61. Tomasevic N, Gvozdenovic N, Vranes S (2020) An overview and comparison of supervised data mining techniques for student exam performance prediction. Comput Educ 143:103676. https://doi.org/10.1016/j.compedu.2019.103676

    Article  Google Scholar 

  62. Tuckman BW (2002) Academic procrastinators: their rationalizations and web-course performance

  63. Tuckman BW (2005) Relations of academic procrastination, rationalizations, and performance in a web course with deadlines. Psychol Rep 96(3_Suppl):1015–1021

    Google Scholar 

  64. Visser L, Korthagen F, Schoonenboom J (2015) Influences on and consequences of academic procrastination of first-year student teachers. Pedagogische Stud 92(6):394–412

    Google Scholar 

  65. Wighting MJ, Liu J, Rovai AP (2008) Distinguishing sense of community and motivation characteristics between online and traditional college students. Q Rev Distance Educ 9(3)

  66. You JW (2012) The relationship among academic procrastination, self-regulated learning, fear, academic self-efficacy, and perceived academic control in e-learning. J Educ Inf Media 18(3):249–271

    Google Scholar 

  67. You JW (2016) Identifying significant indicators using LMS data to predict course achievement in online learning. Internet High Educ 29:23–30

    Google Scholar 

Download references

Funding

This research was partly supported by the European Regional Development Fund through the University of Tartu project ASTRA per ASPERA; the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2018-0-01405) supervised by the IITP (Institute for Information & Communications Technology Planning & Evaluation); Institute for Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2020-0-00368, A Neural-Symbolic Model for Knowledge Acquisition and Inference Techniques); Eastern Scholar Chair Professorship Fund from Shanghai Municipal Education Commission of China (No. JZ2017005); National Natural Science Foundation of China (No. 61977023).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Heuiseok Lim.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Communicated by V. Loia.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yang, Y., Hooshyar, D., Pedaste, M. et al. Predicting course achievement of university students based on their procrastination behaviour on Moodle. Soft Comput 24, 18777–18793 (2020). https://doi.org/10.1007/s00500-020-05110-4

Download citation

Keywords

  • Predication of course achievement
  • Prediction of grade
  • Higher education
  • Educational data mining
  • Procrastination behavior
  • Online learning
  • Moodle