Clustering patterns of engagement in Massive Open Online Courses (MOOCs): the use of learning analytics to reveal student categories
- 1.4k Downloads
Massive Open Online Courses (MOOCs) are remote courses that excel in their students’ heterogeneity and quantity. Due to the peculiarity of being massiveness, the large datasets generated by MOOC platforms require advanced tools and techniques to reveal hidden patterns for purposes of enhancing learning and educational behaviors. This publication offers a research study on using clustering as one of these techniques to portray learners’ engagement in MOOCs. It utilizes Learning Analytics techniques to investigate an offered MOOC by Graz University of Technology held for undergraduates. The authors mainly seek to classify students into appropriate categories based on their level of engagement. Clusters afterward are compared with another classical scheme (Cryer’s scheme of Elton) for further examination and comparison. The final results of this study show that extrinsic factors are not enough to make students highly committed to the MOOC, yet, adding intrinsic factors are recommended to improve future MOOCs.
KeywordsMassive Open Online Courses (MOOCs) Learning analytics Clustering Engagement Undergraduates Patterns Activity
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. In Proceedings of the 23rd International Conference on World Wide Web (pp. 687–698). ACM.Google Scholar
- Balakrishnan, G., & Coetzee, D. (2013). Predicting student retention in massive open online courses using hidden Markov models. Tech. Rep. UCB/EECS-2013-109, University of California.Google Scholar
- Carson, S., & Schmidt, J. (2012). The massive open online professor academic matter. Journal of Higher Education. Retrieved May 02, 2016 from http://www.academicmatters.ca/2012/05/the-massive-open-online-professor/.
- Charrad, M., Ghazzali, N., Boiteau, V., & Niknafs, A. (2013). NbClust: An examination of indices for determining the number of clusters: NbClust package. Retrieved May 12, 2016 from https://cran.r-project.org/web/packages/NbClust/NbClust.pdf.
- Ebner, M., & Maurer, H. (2008). Can Microblogs and Weblogs change traditional scientific writing?. In Proceedings of E-learn 2008, Las Vegas, USA (pp. 768–776).Google Scholar
- Ebner, M., Kopp, M., Wittke, A., & Schön, S. (2014). Das O in MOOCs—über die Bedeutung freier Bildungsressourcen in frei zugänglichen Online-Kursen. In HMD Praxis der Wirtschaftsinformatik (vol. 52, no. 1, pp. 68–80). Springer, December 2014.Google Scholar
- Ferguson, R., & Clow, D. (2015). Examining engagement: Analysing learner subpopulations in massive open online courses (MOOCs). In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 51–58). ACM.Google Scholar
- Ferguson, R., Clow, D., Beale, R., Cooper, A. J., Morris, N., Bayne, S., et al. (2015). Moving through MOOCS: Pedagogy, learning design and patterns of engagement. In T. Klobucar & G. Conole (Eds.), Design for teaching and learning in a networked world (pp. 70–84). Lecture Notes in Computer Science. Switzerland: Springer International Publishing.Google Scholar
- Guo, P. J., & Reinecke, K. (2014). Demographic differences in how students navigate through MOOCs. In Proceedings of the First ACM Conference on Learning@ Scale Conference (pp. 21–30). ACM.Google Scholar
- Herzberg, F. (1968). One more time: How do you motivate employees (pp. 46–57). Harvard Business Review, 46, 53–62.Google Scholar
- Hollands, F. M., & Tirthali, D. (2014). MOOCs: Expectations and reality. New York, NY: Center for Benefit-Cost Studies of Education, Teachers College, Columbia University.Google Scholar
- Jain, A. K., & Dubes, R. C. (1988). Algorithms for clustering data. Englewood Cliffs: Prentice Hall.Google Scholar
- Jordan, K. (2013). MOOC completion rates: The data. Retrieved May 03, 2016 from http://www.katyjordan.com/MOOCproject.html.
- Khalil, H., & Ebner, M. (2014). Moocs completion rates and possible methods to improve retention-a literature review. In World Conference on Educational Multimedia, Hypermedia and Telecommunications (vol. 2014, no. 1, pp. 1305–1313).Google Scholar
- Khalil, M., & Ebner, M. (2015a). A STEM MOOC for school children—What does learning analytics tell us?. In Proceedings of 2015 International Conference on Interactive Collaborative Learning, Florence, Italy (pp. 1217–1221). IEEE.Google Scholar
- Khalil, M., & Ebner, M. (2015b). Learning analytics: Principles and constraints. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, Canada (pp. 1789–1799).Google Scholar
- Khalil, M., & Ebner, M. (2016a). What is learning analytics about? A survey of different methods used in 2013–2015. In Proceedings of Smart Learning Conference, Dubai, UAE, March 7–9, 2016 (pp. 294–304). Dubai: HBMSU Publishing House.Google Scholar
- Khalil, M., & Ebner, M. (2016b). What massive open online course (MOOC) stakeholders can learn from learning analytics? In M. Spector, B. Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–30). Springer International Publishing.Google Scholar
- Khalil, M., Kastl, C., & Ebner, M. (2016). Portraying MOOCs learners: A clustering experience using learning analytics. In Khalil, M., Ebner, M., Kopp, M., Lorenz, A. & Kalz, M. (Eds.), Proceedings of the European Stakeholder Summit on Experiences and Best Practices in and Around MOOCs (EMOOCS 2016), Graz, Austria (pp. 265–278).Google Scholar
- Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 170–179). ACM.Google Scholar
- Knox, J. (2014). From MOOCs to learning analytics: Scratching the surface of the ‘visual’. eLearn, 2014(11). ACM.Google Scholar
- Kovanović, V., Joksimović, S., Gašević, D., Owers, J., Scott, A. M., & Woodgate, A. (2016). Profiling MOOC course returners: How does student behavior change between two course enrollments?. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale (pp. 269–272). ACM.Google Scholar
- Lackner, E., Ebner, M., & Khalil, M. (2015). MOOCs as granular systems: Design patterns to foster participant activity. eLearning Papers, 42, 28–37.Google Scholar
- McAuley, A., Stewart, B., Siemens, G., & Dave Cormier, D. (2010). Massive Open Online Courses Digital ways of knowing and learning. The MOOC Model for Digital Practice. Retrieved from http://www.elearnspace.org/Articles/MOOC_Final.pdf.
- Meyer, R. (2012). What it’s like to teach a MOOC (and what the heck’s a MOOC?), Retrieved October 2015 from http://tinyurl.com/cdfvvqy.
- Neuendorf, K. A. (2002). The content analysis guidebook (Vol. 300). Thousand Oaks, CA: Sage Publications.Google Scholar
- Peeples, M. A. (2011). R script for K-means cluster analysis. Retrieved May 13, 2016 from http://www.mattpeeples.net/kmeans.html.
- Rodriguez, C. O. (2012). MOOCs and the AI-Stanford like courses: Two successful and distinct course formats for Massive Open Online Courses. European Journal of Open, Distance and E-Learning.Google Scholar
- Wang, Y., & Baker, R. (2015). Content or platform: Why do students complete MOOCs? Journal of Online Learning and Teaching, 11(1), 17.Google Scholar
- Wüster, M., & Ebner, M. (2016). How to integrate and automatically issue Open Badges in MOOC platforms. In Khalil, M., Ebner, M., Kopp, M., Lorenz, A. & Kalz, M. (Eds.), Proceedings of the European Stakeholder Summit on Experiences and Best Practices in and Around MOOCs (EMOOCS 2016), Graz, Austria (pp. 279–286).Google Scholar
- Yuan, L., & Powell, S. (2013). MOOCs and open education: Implications for higher education. Cetis White Paper. Retrieved from http://publications.cetis.ac.uk/2013/667.