Skip to main content
SpringerLink
Log in

Analyzing Learner and Instructor Interactions within Learning Management Systems: Approaches and Examples

  • Living reference work entry
  • First Online:
Learning, Design, and Technology

Abstract

Institutions of higher education are increasingly turning to learning management systems (LMSs) to help support their instructional missions. An LMS provides features to support various teaching and learning activities and can be used in online, face-to-face, and blended courses. An LMS also automatically records all instructor and student usage activities and stores them in vast repositories collected as a part of natural instructional activity. The increasing availability of these datasets, coupled with emerging “big data” and educational data mining techniques, offers unparalleled opportunities for research on understanding learning and teaching “at scale.” This chapter reviews approaches and processes for analyzing both instructor and student usage data collected by LMSs. The review is organized according to a standard three-phase data mining methodology called knowledge discovery from database (KDD). It also illustrates the KDD process by presenting examples from research by the authors that analyzed instructor and student usage data collected by a widely used LMS, called Canvas. The chapter concludes with recommendations for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • Abdous, M., He, W., & Yen, C. J. (2012). Using data mining for predicting relationships between online question theme and final grade. Journal of Educational Technology and Society, 15(3), 77–88.

    Google Scholar 

  • Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). Vancouver, BC: ACM.

    Chapter  Google Scholar 

  • Baker, R., & Siemens, G. (2014). Educational data mining and learning analytics. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 253–274). New York, NY: Cambridge University Press.

    Chapter  Google Scholar 

  • Baker, R. S., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. Journal of Educational Data Mining, 1(1), 3–17.

    Google Scholar 

  • Bienkowski, M., Feng, M., & Means, B. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. Washington, DC: US Department of Education.

    Google Scholar 

  • Bowers, A. J. (2010). Analyzing the longitudinal K-12 grading histories of entire cohorts of students: Grades, data driven decision making, dropping out and hierarchical cluster analysis. Practical Assessment, Research and Evaluation, 15(7), 1–18.

    Google Scholar 

  • Browne, T., Jenkins, M., & Walker, R. (2006). A longitudinal perspective regarding the use of VLEs by higher education institutions in the United Kingdom. Interactive Learning Environments, 14(2), 177–192.

    Article  Google Scholar 

  • Cooley, R., Mobasher, B., & Srivastava, J. (1997, November). Web mining: Information and pattern discovery on the World Wide Web. In Tools with artificial intelligence, 1997. Proceedings, Ninth IEEE international conference on (pp. 558–567). IEEE.

    Google Scholar 

  • Cooley, R., Mobasher, B., & Srivastava, J. (1999). Data preparation for mining World Wide Web browsing patterns. Knowledge and Information Systems, 1(1), 5–32.

    Article  Google Scholar 

  • Dahlstrom, E., Brooks, D. C., & Bichsel, J. (2014, September). The current ecosystem of learning management systems in higher education: Student, faculty, and IT perspectives. Research report. Louisville, CO: ECAR.

    Google Scholar 

  • Dawson, S. (2008). A study of the relationship between student social networks and sense of community. Journal of Educational Technology and Society, 11(3), 224–238.

    Google Scholar 

  • Ferguson, K., Arroyo, I., Mahadevan, S., Woolf, B., & Barto, A. (2006). Improving intelligent tutoring systems: Using expectation maximization to learn student skill levels. In M. Ikeda, K. D. Ashley, & T.W. Chan (Eds.), Lecture Notes in Computer Science: Vol. 4053. Intelligent Tutoring Systems (pp. 453–462). Berlin, Germany: Springer.

    Google Scholar 

  • Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71.

    Article  Google Scholar 

  • Han, J., Kamber, M., & Pei, J. (2011). Data mining: Concepts and techniques (3rd ed.). Waltham, MA: Morgan Kaufmann.

    Google Scholar 

  • Hawkins, B. L., & Rudy, J. A. (2007). EDUCAUSE Core data service: Fiscal year 2006 summary report. Boulder, CO: EDUCAUSE. Retrieved from https://net.educause.edu/ir/library/pdf/pub8004.pdf

    Google Scholar 

  • Jo, I. H., Kim, D., & Yoon, M. (2015). Constructing proxy variables to measure adult learners’ time management strategies in LMS. Educational Technology and Society, 18(3), 214–225.

    Google Scholar 

  • Kerly, A., Ellis, R., & Bull, S. (2007). CALMsystem: A conversational agent for learner modelling. In R. Ellis, T. Allen, & M. Petridis (Eds.), Applications and innovations in intelligent systems XV: Proceedings of AI-2007, 27th SGAI international conference on innovative techniques and applications of artificial intelligence (pp. 89–102). Berlin, Germany: Springer.

    Google Scholar 

  • Klosgen, W., & Zytkow, J. (2002). Handbook of data mining and knowledge discovery. Oxford, UK: Oxford University Press.

    Google Scholar 

  • Kobsa, E., Dimitrova, V., & Boyle, R. (2005). Using student and group models to support teachers in web-based distance education. In Proceedings of the 10th international conference on user modeling (pp. 124–133). Berlin, Germany: Springer.

    Google Scholar 

  • Koedinger, K. R., D’Mello, S., McLaughlin, E. A., Pardos, Z. A., & Rosé, C. P. (2015). Data mining and education. Wiley Interdisciplinary Reviews: Cognitive Science.doi:10.1002/wcs.1350

    Google Scholar 

  • Krumm, A. E., Waddington, R. J., Teasley, S. D., & Lonn, S. (2014). A learning management system-based early warning system for academic advising in undergraduate engineering. In Learning analytics (pp. 103–119). New York, NY: Springer.

    Google Scholar 

  • Lee, J. E., Recker, M, Choi, H., Hong, W. J., Kim, N. J., Lee, K., Lefler, M., Louviere, J., & Walker, A. (in press). Applying data mining methods to understand user interactions within learning management systems: Approaches and lessons learned. Journal of Educational Technology Development and Exchange.

    Google Scholar 

  • Lust, G., Elen, J., & Clarebout, G. (2013). Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1), 385–395.

    Article  Google Scholar 

  • Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599.

    Article  Google Scholar 

  • Mooi, E., & Sarstedt, M. (2011). A concise guide to market research: The process, data, and methods using IBM SPSS statistics. Berlin/Heidelberg, Germany: Springer.

    Book  Google Scholar 

  • Norvig, P. (n.d.). All we want are the facts, ma’am. Retrieved from http://norvig.com/fact-check.html

  • Romero, C., & Ventura, S. (2007). Educational data mining: A survey from 1995 to 2005. Expert Systems with Applications, 33(1), 135–146.

    Article  Google Scholar 

  • Romero, C., Ventura, S., & García, E. (2008). Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1), 368–384.

    Article  Google Scholar 

  • Romesburg, H. C. (1984). Cluster analysis for researchers. Belmont, CA: Lifetime Learning Publications.

    Google Scholar 

  • Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400.

    Article  Google Scholar 

  • Siemens, G., & Baker, R. S. J. D. (2012). Learning analytics and educational data mining: Towards communication and collaboration. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252–254). Vancouver, BC: ACM.

    Chapter  Google Scholar 

  • Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. Educause Review, 46(5), 30–32.

    Google Scholar 

  • Smith, V. C., Lange, A., & Huston, D. R. (2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses. Journal of Asynchronous Learning Networks, 16(3), 51–61.

    Google Scholar 

  • Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414–2422.

    Article  Google Scholar 

  • Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning analytics in a data-rich context. Computers in Human Behavior, 47, 157–167.

    Article  Google Scholar 

  • Thakur, G. S., Olama, M. M., McNair, A. W., Sukumar, S. R., & Studham, S. (2014, January). Towards adaptive educational assessments: Predicting student performance using temporal stability and data analytics in learning management systems. In Proceedings 20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. New York, NY: ACM.

    Google Scholar 

  • Valsamidis, S., Kontogiannis, S., Kazanidis, I., Theodosiou, T., & Karakos, A. (2012). A clustering methodology of web log data for learning management systems. Journal of Educational Technology and Society, 15(2), 154–167.

    Google Scholar 

  • Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500–1509.

    Article  Google Scholar 

  • Witten, I. H., & Frank, E. (2005). Data mining: Practical machine learning tools and techniques (2nd ed.). San Francisco, CA: Morgan Kaufmann.

    Google Scholar 

  • Xu, B., & Recker, M. (2012). Teaching analytics: A clustering and triangulation study of digital library user data. Educational Technology and Society Journal, 15(3), 103–115.

    Google Scholar 

  • Yildiz, O., Bal, A., & Gulsecen, S. (2015). Statistical and clustering based rules extraction approaches for fuzzy model to estimate academic performance in distance education. Eurasia Journal of Mathematics, Science and Technology Education, 11(2), 391–404.

    Google Scholar 

  • Yu, T., & Jo, I.-H. (2014). Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education. In Proceedings of the 4th International Conference on Learning Analytics and Knowledge (pp. 269–270). Indianapolis, IN: ACM.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Instructional Technology and Learning Sciences, Emma Eccles Jones College of Education and Human Services, Utah State University, Room 215, 2830 Old Main Hill, Logan, UT, 84322-2830, USA

    Mimi Recker

  2. Department of Instructional Technology and Learning Sciences, Utah State University, 2830 Old Main Hill, Logan, UT, USA

    Ji Eun Lee

Authors
  1. Mimi Recker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ji Eun Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mimi Recker .

Editor information

Editors and Affiliations

  1. College of Info, Ste G150, Univ of North Texas, Denton, Texas, USA

    Michael J Spector

  2. School of Education, Virginia Tech, Blacksburg, Virginia, USA

    Barbara B Lockee

  3. School of Education, Baker University, Overland Park, Kansas, USA

    Marcus D. Childress

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this entry

Cite this entry

Recker, M., Lee, J.E. (2016). Analyzing Learner and Instructor Interactions within Learning Management Systems: Approaches and Examples. In: Spector, M., Lockee, B., Childress, M. (eds) Learning, Design, and Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-17727-4_7-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17727-4_7-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Online ISBN: 978-3-319-17727-4

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics

Search

Navigation