Clustering patterns of engagement in Massive Open Online Courses (MOOCs): the use of learning analytics to reveal student categories

Abstract

Massive Open Online Courses (MOOCs) are remote courses that excel in their students’ heterogeneity and quantity. Due to the peculiarity of being massiveness, the large datasets generated by MOOC platforms require advanced tools and techniques to reveal hidden patterns for purposes of enhancing learning and educational behaviors. This publication offers a research study on using clustering as one of these techniques to portray learners’ engagement in MOOCs. It utilizes Learning Analytics techniques to investigate an offered MOOC by Graz University of Technology held for undergraduates. The authors mainly seek to classify students into appropriate categories based on their level of engagement. Clusters afterward are compared with another classical scheme (Cryer’s scheme of Elton) for further examination and comparison. The final results of this study show that extrinsic factors are not enough to make students highly committed to the MOOC, yet, adding intrinsic factors are recommended to improve future MOOCs.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Notes

  1. 1.

    Explanation: http://stats.stackexchange.com/questions/141280/understanding-cluster-plot-and-component-variability (Last accessed, 11th May 2016).

References

  1. Alario-Hoyos, C., Muñoz-Merino, P. J., Pérez-Sanagustín, M., Delgado Kloos, C., & Parada, G. (2016). Who are the top contributors in a MOOC? Relating participants’ performance and contributions. Journal of Computer Assisted Learning. doi:10.1111/jcal.12127.

    Google Scholar 

  2. Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. In Proceedings of the 23rd International Conference on World Wide Web (pp. 687–698). ACM.

  3. Balakrishnan, G., & Coetzee, D. (2013). Predicting student retention in massive open online courses using hidden Markov models. Tech. Rep. UCB/EECS-2013-109, University of California.

  4. Carson, S., & Schmidt, J. (2012). The massive open online professor academic matter. Journal of Higher Education. Retrieved May 02, 2016 from http://www.academicmatters.ca/2012/05/the-massive-open-online-professor/.

  5. Charrad, M., Ghazzali, N., Boiteau, V., & Niknafs, A. (2013). NbClust: An examination of indices for determining the number of clusters: NbClust package. Retrieved May 12, 2016 from https://cran.r-project.org/web/packages/NbClust/NbClust.pdf.

  6. Ebner, M., & Maurer, H. (2008). Can Microblogs and Weblogs change traditional scientific writing?. In Proceedings of E-learn 2008, Las Vegas, USA (pp. 768–776).

  7. Ebner, M., Kopp, M., Wittke, A., & Schön, S. (2014). Das O in MOOCs—über die Bedeutung freier Bildungsressourcen in frei zugänglichen Online-Kursen. In HMD Praxis der Wirtschaftsinformatik (vol. 52, no. 1, pp. 68–80). Springer, December 2014.

  8. Elliot, A. J., & Harackiewicz, J. M. (1994). Goal setting, achievement orientation, and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 66(5), 968.

    Article  Google Scholar 

  9. Elton, L. (1996). Strategies to enhance student motivation: A conceptual analysis. Studies in Higher Education, 21(1), 57–68.

    Article  Google Scholar 

  10. Ferguson, R., & Clow, D. (2015). Examining engagement: Analysing learner subpopulations in massive open online courses (MOOCs). In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 51–58). ACM.

  11. Ferguson, R., Clow, D., Beale, R., Cooper, A. J., Morris, N., Bayne, S., et al. (2015). Moving through MOOCS: Pedagogy, learning design and patterns of engagement. In T. Klobucar & G. Conole (Eds.), Design for teaching and learning in a networked world (pp. 70–84). Lecture Notes in Computer Science. Switzerland: Springer International Publishing.

    Google Scholar 

  12. Guo, P. J., & Reinecke, K. (2014). Demographic differences in how students navigate through MOOCs. In Proceedings of the First ACM Conference on Learning@ Scale Conference (pp. 21–30). ACM.

  13. Herzberg, F. (1968). One more time: How do you motivate employees (pp. 46–57). Harvard Business Review, 46, 53–62.

    Google Scholar 

  14. Hollands, F. M., & Tirthali, D. (2014). MOOCs: Expectations and reality. New York, NY: Center for Benefit-Cost Studies of Education, Teachers College, Columbia University.

    Google Scholar 

  15. Jain, A. K., & Dubes, R. C. (1988). Algorithms for clustering data. Englewood Cliffs: Prentice Hall.

    Google Scholar 

  16. Jordan, K. (2013). MOOC completion rates: The data. Retrieved May 03, 2016 from http://www.katyjordan.com/MOOCproject.html.

  17. Khalil, H., & Ebner, M. (2014). Moocs completion rates and possible methods to improve retention-a literature review. In World Conference on Educational Multimedia, Hypermedia and Telecommunications (vol. 2014, no. 1, pp. 1305–1313).

  18. Khalil, M., & Ebner, M. (2015a). A STEM MOOC for school children—What does learning analytics tell us?. In Proceedings of 2015 International Conference on Interactive Collaborative Learning, Florence, Italy (pp. 1217–1221). IEEE.

  19. Khalil, M., & Ebner, M. (2015b). Learning analytics: Principles and constraints. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, Canada (pp. 1789–1799).

  20. Khalil, M., & Ebner, M. (2016a). What is learning analytics about? A survey of different methods used in 2013–2015. In Proceedings of Smart Learning Conference, Dubai, UAE, March 7–9, 2016 (pp. 294–304). Dubai: HBMSU Publishing House.

  21. Khalil, M., & Ebner, M. (2016b). What massive open online course (MOOC) stakeholders can learn from learning analytics? In M. Spector, B. Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–30). Springer International Publishing.

  22. Khalil, M., Kastl, C., & Ebner, M. (2016). Portraying MOOCs learners: A clustering experience using learning analytics. In Khalil, M., Ebner, M., Kopp, M., Lorenz, A. & Kalz, M. (Eds.), Proceedings of the European Stakeholder Summit on Experiences and Best Practices in and Around MOOCs (EMOOCS 2016), Graz, Austria (pp. 265–278).

  23. Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 170–179). ACM.

  24. Knox, J. (2014). From MOOCs to learning analytics: Scratching the surface of the ‘visual’. eLearn, 2014(11). ACM.

  25. Kovanović, V., Joksimović, S., Gašević, D., Owers, J., Scott, A. M., & Woodgate, A. (2016). Profiling MOOC course returners: How does student behavior change between two course enrollments?. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale (pp. 269–272). ACM.

  26. Lackner, E., Ebner, M., & Khalil, M. (2015). MOOCs as granular systems: Design patterns to foster participant activity. eLearning Papers, 42, 28–37.

    Google Scholar 

  27. McAuley, A., Stewart, B., Siemens, G., & Dave Cormier, D. (2010). Massive Open Online Courses Digital ways of knowing and learning. The MOOC Model for Digital Practice. Retrieved from http://www.elearnspace.org/Articles/MOOC_Final.pdf.

  28. Meyer, R. (2012). What it’s like to teach a MOOC (and what the heck’s a MOOC?), Retrieved October 2015 from http://tinyurl.com/cdfvvqy.

  29. Neuendorf, K. A. (2002). The content analysis guidebook (Vol. 300). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  30. Peeples, M. A. (2011). R script for K-means cluster analysis. Retrieved May 13, 2016 from http://www.mattpeeples.net/kmeans.html.

  31. Pison, G., Struyf, A., & Rousseeuw, P. J. (1999). Displaying a clustering with CLUSPLOT. Computational Statistics & Data Analysis, 30(4), 381–392.

    Article  Google Scholar 

  32. Rodriguez, C. O. (2012). MOOCs and the AI-Stanford like courses: Two successful and distinct course formats for Massive Open Online Courses. European Journal of Open, Distance and E-Learning.

  33. Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68.

    Article  Google Scholar 

  34. Wang, Y., & Baker, R. (2015). Content or platform: Why do students complete MOOCs? Journal of Online Learning and Teaching, 11(1), 17.

    Google Scholar 

  35. Wüster, M., & Ebner, M. (2016). How to integrate and automatically issue Open Badges in MOOC platforms. In Khalil, M., Ebner, M., Kopp, M., Lorenz, A. & Kalz, M. (Eds.), Proceedings of the European Stakeholder Summit on Experiences and Best Practices in and Around MOOCs (EMOOCS 2016), Graz, Austria (pp. 279–286).

  36. Xu, B., & Yang, D. (2016). Motivation classification and grade prediction for MOOCs learners. Computational Intelligence and Neuroscience, 2016, 4. doi:10.1155/2016/2174613.

    Google Scholar 

  37. Yuan, L., & Powell, S. (2013). MOOCs and open education: Implications for higher education. Cetis White Paper. Retrieved from http://publications.cetis.ac.uk/2013/667.

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mohammad Khalil.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Khalil, M., Ebner, M. Clustering patterns of engagement in Massive Open Online Courses (MOOCs): the use of learning analytics to reveal student categories. J Comput High Educ 29, 114–132 (2017). https://doi.org/10.1007/s12528-016-9126-9

Download citation

Keywords

  • Massive Open Online Courses (MOOCs)
  • Learning analytics
  • Clustering
  • Engagement
  • Undergraduates
  • Patterns
  • Activity