Advertisement

Analyzing Learner and Instructor Interactions within Learning Management Systems: Approaches and Examples

  • Mimi ReckerEmail author
  • Ji Eun Lee
Living reference work entry

Abstract

Institutions of higher education are increasingly turning to learning management systems (LMSs) to help support their instructional missions. An LMS provides features to support various teaching and learning activities and can be used in online, face-to-face, and blended courses. An LMS also automatically records all instructor and student usage activities and stores them in vast repositories collected as a part of natural instructional activity. The increasing availability of these datasets, coupled with emerging “big data” and educational data mining techniques, offers unparalleled opportunities for research on understanding learning and teaching “at scale.” This chapter reviews approaches and processes for analyzing both instructor and student usage data collected by LMSs. The review is organized according to a standard three-phase data mining methodology called knowledge discovery from database (KDD). It also illustrates the KDD process by presenting examples from research by the authors that analyzed instructor and student usage data collected by a widely used LMS, called Canvas. The chapter concludes with recommendations for future research.

Keywords

Educational data mining Learning management systems Knowledge discovery from database Learning Teaching 

References

  1. Abdous, M., He, W., & Yen, C. J. (2012). Using data mining for predicting relationships between online question theme and final grade. Journal of Educational Technology and Society, 15(3), 77–88.Google Scholar
  2. Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). Vancouver, BC: ACM.CrossRefGoogle Scholar
  3. Baker, R., & Siemens, G. (2014). Educational data mining and learning analytics. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 253–274). New York, NY: Cambridge University Press.CrossRefGoogle Scholar
  4. Baker, R. S., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. Journal of Educational Data Mining, 1(1), 3–17.Google Scholar
  5. Bienkowski, M., Feng, M., & Means, B. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. Washington, DC: US Department of Education.Google Scholar
  6. Bowers, A. J. (2010). Analyzing the longitudinal K-12 grading histories of entire cohorts of students: Grades, data driven decision making, dropping out and hierarchical cluster analysis. Practical Assessment, Research and Evaluation, 15(7), 1–18.Google Scholar
  7. Browne, T., Jenkins, M., & Walker, R. (2006). A longitudinal perspective regarding the use of VLEs by higher education institutions in the United Kingdom. Interactive Learning Environments, 14(2), 177–192.CrossRefGoogle Scholar
  8. Cooley, R., Mobasher, B., & Srivastava, J. (1997, November). Web mining: Information and pattern discovery on the World Wide Web. In Tools with artificial intelligence, 1997. Proceedings, Ninth IEEE international conference on (pp. 558–567). IEEE.Google Scholar
  9. Cooley, R., Mobasher, B., & Srivastava, J. (1999). Data preparation for mining World Wide Web browsing patterns. Knowledge and Information Systems, 1(1), 5–32.CrossRefGoogle Scholar
  10. Dahlstrom, E., Brooks, D. C., & Bichsel, J. (2014, September). The current ecosystem of learning management systems in higher education: Student, faculty, and IT perspectives. Research report. Louisville, CO: ECAR.Google Scholar
  11. Dawson, S. (2008). A study of the relationship between student social networks and sense of community. Journal of Educational Technology and Society, 11(3), 224–238.Google Scholar
  12. Ferguson, K., Arroyo, I., Mahadevan, S., Woolf, B., & Barto, A. (2006). Improving intelligent tutoring systems: Using expectation maximization to learn student skill levels. In M. Ikeda, K. D. Ashley, & T.W. Chan (Eds.), Lecture Notes in Computer Science: Vol. 4053. Intelligent Tutoring Systems (pp. 453–462). Berlin, Germany: Springer.Google Scholar
  13. Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71.CrossRefGoogle Scholar
  14. Han, J., Kamber, M., & Pei, J. (2011). Data mining: Concepts and techniques (3rd ed.). Waltham, MA: Morgan Kaufmann.Google Scholar
  15. Hawkins, B. L., & Rudy, J. A. (2007). EDUCAUSE Core data service: Fiscal year 2006 summary report. Boulder, CO: EDUCAUSE. Retrieved from https://net.educause.edu/ir/library/pdf/pub8004.pdfGoogle Scholar
  16. Jo, I. H., Kim, D., & Yoon, M. (2015). Constructing proxy variables to measure adult learners’ time management strategies in LMS. Educational Technology and Society, 18(3), 214–225.Google Scholar
  17. Kerly, A., Ellis, R., & Bull, S. (2007). CALMsystem: A conversational agent for learner modelling. In R. Ellis, T. Allen, & M. Petridis (Eds.), Applications and innovations in intelligent systems XV: Proceedings of AI-2007, 27th SGAI international conference on innovative techniques and applications of artificial intelligence (pp. 89–102). Berlin, Germany: Springer.Google Scholar
  18. Klosgen, W., & Zytkow, J. (2002). Handbook of data mining and knowledge discovery. Oxford, UK: Oxford University Press.Google Scholar
  19. Kobsa, E., Dimitrova, V., & Boyle, R. (2005). Using student and group models to support teachers in web-based distance education. In Proceedings of the 10th international conference on user modeling (pp. 124–133). Berlin, Germany: Springer.Google Scholar
  20. Koedinger, K. R., D’Mello, S., McLaughlin, E. A., Pardos, Z. A., & Rosé, C. P. (2015). Data mining and education. Wiley Interdisciplinary Reviews: Cognitive Science.doi:10.1002/wcs.1350Google Scholar
  21. Krumm, A. E., Waddington, R. J., Teasley, S. D., & Lonn, S. (2014). A learning management system-based early warning system for academic advising in undergraduate engineering. In Learning analytics (pp. 103–119). New York, NY: Springer.Google Scholar
  22. Lee, J. E., Recker, M, Choi, H., Hong, W. J., Kim, N. J., Lee, K., Lefler, M., Louviere, J., & Walker, A. (in press). Applying data mining methods to understand user interactions within learning management systems: Approaches and lessons learned. Journal of Educational Technology Development and Exchange.Google Scholar
  23. Lust, G., Elen, J., & Clarebout, G. (2013). Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1), 385–395.CrossRefGoogle Scholar
  24. Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599.CrossRefGoogle Scholar
  25. Mooi, E., & Sarstedt, M. (2011). A concise guide to market research: The process, data, and methods using IBM SPSS statistics. Berlin/Heidelberg, Germany: Springer.CrossRefGoogle Scholar
  26. Norvig, P. (n.d.). All we want are the facts, ma’am. Retrieved from http://norvig.com/fact-check.html
  27. Romero, C., & Ventura, S. (2007). Educational data mining: A survey from 1995 to 2005. Expert Systems with Applications, 33(1), 135–146.CrossRefGoogle Scholar
  28. Romero, C., Ventura, S., & García, E. (2008). Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1), 368–384.CrossRefGoogle Scholar
  29. Romesburg, H. C. (1984). Cluster analysis for researchers. Belmont, CA: Lifetime Learning Publications.Google Scholar
  30. Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400.CrossRefGoogle Scholar
  31. Siemens, G., & Baker, R. S. J. D. (2012). Learning analytics and educational data mining: Towards communication and collaboration. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252–254). Vancouver, BC: ACM.CrossRefGoogle Scholar
  32. Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. Educause Review, 46(5), 30–32.Google Scholar
  33. Smith, V. C., Lange, A., & Huston, D. R. (2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses. Journal of Asynchronous Learning Networks, 16(3), 51–61.Google Scholar
  34. Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414–2422.CrossRefGoogle Scholar
  35. Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning analytics in a data-rich context. Computers in Human Behavior, 47, 157–167.CrossRefGoogle Scholar
  36. Thakur, G. S., Olama, M. M., McNair, A. W., Sukumar, S. R., & Studham, S. (2014, January). Towards adaptive educational assessments: Predicting student performance using temporal stability and data analytics in learning management systems. In Proceedings 20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. New York, NY: ACM.Google Scholar
  37. Valsamidis, S., Kontogiannis, S., Kazanidis, I., Theodosiou, T., & Karakos, A. (2012). A clustering methodology of web log data for learning management systems. Journal of Educational Technology and Society, 15(2), 154–167.Google Scholar
  38. Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500–1509.CrossRefGoogle Scholar
  39. Witten, I. H., & Frank, E. (2005). Data mining: Practical machine learning tools and techniques (2nd ed.). San Francisco, CA: Morgan Kaufmann.Google Scholar
  40. Xu, B., & Recker, M. (2012). Teaching analytics: A clustering and triangulation study of digital library user data. Educational Technology and Society Journal, 15(3), 103–115.Google Scholar
  41. Yildiz, O., Bal, A., & Gulsecen, S. (2015). Statistical and clustering based rules extraction approaches for fuzzy model to estimate academic performance in distance education. Eurasia Journal of Mathematics, Science and Technology Education, 11(2), 391–404.Google Scholar
  42. Yu, T., & Jo, I.-H. (2014). Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education. In Proceedings of the 4th International Conference on Learning Analytics and Knowledge (pp. 269–270). Indianapolis, IN: ACM.CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Department of Instructional Technology and Learning Sciences, Emma Eccles Jones College of Education and Human ServicesUtah State UniversityLoganUSA
  2. 2.Department of Instructional Technology and Learning SciencesUtah State UniversityLoganUSA

Personalised recommendations