Evaluating the Student Activity Meter: Two Case Studies
In the Technology Enhanced Learning (TEL) domain, visualizations are attracting increased interest. In this paper, we present the Student Activity Meter that visualizes learner activities within online learning environments for learners and teachers to help increase awareness and to support self-reflection. We present evaluation results of two case studies with teachers, learning analytics students and experts. Results from teachers show that the visualizations can assist in creating awareness, understanding of student resource use and student time spending behavior. SAM’s three visualizations were perceived as equally useful, but for different tasks. The evaluation participants also identified new metrics to extend our current set and prioritized new visualization ideas.
KeywordsVisualization Self-reflection Awareness Case Study
Unable to display preview. Download preview PDF.
- 1.1st International Conference on Learning Analytics and Knowledge 2011 (February 2011), https://tekri.athabascau.ca/analytics/
- 2.Allendoerfer, K.R.: How information visualization systems change users’ understandings of complex data. Ph.D. thesis, Drexel University (2010)Google Scholar
- 4.Dawson, S., Bakharia, A., Heathcote, E.: Snapp: Realising the affordances of real-time SNA within networked learning environments. In: Proceedings of the 7th International Conference on Networked Learning 2010, pp. 125–133 (2010)Google Scholar
- 6.van Harmelen, M.: Personal learning environments. In: ICALT 2006: Proc. of the 6th IEEE Int. Conf. on Advanced Learning Technologies, pp. 815–816. IEEE Computer Society (2006)Google Scholar
- 10.Larusson, J.A., Alterman, R.: Visualizing student activity in a wiki-mediated co-blogging exercise. In: CHI 2009: Proceedings of 27th International Conference on Human Factors in Computing Systems, pp. 4093–4098. ACM (2009)Google Scholar
- 11.Rath, A.S., Devaurs, D., Lindstaedt, S.N.: UICO: an ontology-based user interaction context model for automatic task detection on the computer desktop. In: Proc. of the 1st Workshop on Context, Information and Ontologies, CIAO 2009, pp. 8:1–8:10. ACM (2009)Google Scholar
- 13.Siirtola, H., Laivo, T., Heimonen, T., Raiha, K.-J.: Visual perception of parallel coordinate visualizations. In: IV 2009: Proc. of 13th Int. Conf. of Info. Visual, pp. 3–9. IEEE (2009)Google Scholar
- 15.Soller, A., Martínez-Monés, A., Jermann, P., Muehlenbrock, M.: From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. I. J. Artificial Intelligence in Education 15(4), 261–290 (2005)Google Scholar
- 16.Thomas, J.J., Cook, K.A.: Illuminating the Path: The Research and Development Agenda for Visual Analytics. National Visualization and Analytics Ctr (2005)Google Scholar
- 17.Wolpers, M., Martin, G., Najjar, J., Duval, E.: Attention metadata in knowledge and learning management. In: Proceedings of I-Know 2006: 6th International Conference on Knowledge Management, pp. 1–8 (2006)Google Scholar
- 18.Zhang, H., Almeroth, K., Knight, A., Bulger, M., Mayer, R.: Moodog: Tracking students’ online learning activities. In: Proc. of World Conf. on Educational Multimedia, Hypermedia and Telecomm. 2007, pp. 4415–4422. AACE, Vancouver (2007)Google Scholar