Abstract
Team learning has become an essential activity in both professional and educational contexts. Learning analytics offers promising opportunities to support team learning by making information about group processes available to teams in real time to help them learn how to interact more productively. The design of team analytics requires three sets of critical decisions: the choices of metrics, the ways in which these metrics are presented, and how the analytics are implemented. This chapter describes four guiding principles for navigating this decision space in ways that produce relevant, understandable, and actionable analytics to support team learning.
Application of the principles is illustrated in a design case of creating analytics for a discussion-based online course. The chapter concludes by describing the uptake of and student responses to the analytics in a pilot implementation and considering lessons learned for the design of team learning analytics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Such as in-degree
- 2.
Learning Management System
References
Anderson, T. (2008). Towards a theory of online learning. In T. Anderson (Ed.), The theory and practice of online learning (pp. 45–74). Athabasca University Press.
Bodemer, D., Janssen, J., & Schnaubert, L. (2018). Group awareness tools for computer supported collaborative learning. In F. Fischer, C. E. Hmelo-Silver, S. R. Goldman, & P. Reimann (Eds.), International handbook of the learning sciences (pp. 351–358). Routledge.
Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019). Human-centered learning analytics. Journal of Learning Analytics, 6(2), 1–9.
Chen, C. (2010). Information visualization. Wiley Interdisciplinary Reviews: Computational Statistics, 2(4), 387–403.
Chen, B., Chang, Y. H., Ouyang, F., & Zhou, W. (2018). Fostering student engagement in online discussion through social learning analytics. The Internet and Higher Education, 37, 21–30.
Chen, B., & Huang, T. (2019). It is about timing: Network prestige in asynchronous online discussions. Journal of Computer Assisted Learning, 35(4), 503–515.
Clark, D. B., & Sampson, V. (2008). Assessing dialogic argumentation in online environments to relate structure, grounds, and conceptual quality. Journal of Research in Science Teaching, 45(3), 293–321.
Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). ACM.
Dawson, S. (2006). A study of the relationship between student communication interaction and sense of community. The Internet and Higher Education, 9(3), 153–162.
Dawson, S., Bakharia, A., & Heathcote, E. (2010). SNAPP: Realising the affordances of real-time SNA within networked learning environments. Paper presented at the 7th International Conference on Networked Learning, Aalborg, Denmark.
Dennen, V. P. (2001). The design and facilitation of asynchronous discussion activities in web-based courses: Implications for instructional design theory. Doctoral dissertation, Indiana University Bloomington. ProQuest Dissertations Publishing.
Dillenbourg, P. (1999). What do you mean by collaborative learning? In P. Dillenbourg (Ed.), Collaborative learning: Cognitive and computational approaches (pp. 1–19). Elsevier.
Edmondson, A. C., Dillon, J. R., & Roloff, K. S. (2007). Three perspectives on team learning: improvement, task mastery, and group process. Academy of Management Annals, 1, 269–314.
Farrow, E., Moore, J., & Gašević, D. (2020). Dialogue attributes that inform depth and quality of participation in course discussion forums. In Proceedings of the Tenth International Conference on Learning Analytics and Knowledge (pp. 129–134). ACM.
Ferguson, R., & Shum, S. B. (2012). Social learning analytics: five approaches. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 23–33). ACM.
Fincham, E., Whitelock-Wainwright, A., Kovanović, V., Joksimović, S., van Staalduinen, J. P., & Gašević, D. (2019). Counting clicks is not enough: Validating a theorized model of engagement in learning analytics. In Proceedings of the 9th International Conference on Learning Analytics and Knowledge (pp. 501–510). ACM.
Gao, F., Wang, C. X., & Sun, Y. (2009). New model of productive online discussion and its implications for research and instruction. Journal of Educational Technology Development and Exchange, 2(1), 65–78.
Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2), 193–202.
Hewitt, J. (2003). How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research, 28(1), 31–45.
Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Koivuniemi, M., & Järvenoja, H. (2015). Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools. Educational Technology Research and Development, 63(1), 125–142.
Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness is not enough: pitfalls of learning analytics dashboards in the educational practice. In Proceedings of European Conference on Technology Enhanced Learning 2017 (pp. 82–96). Springer Cham.
John-Steiner, V., & Mahn, H. (1996). Sociocultural approaches to learning and development: A Vygotskian framework. Educational Psychologist, 31(3/4), 191–206.
Katzenbach, J. R., & Smith, D. K. (1993). The rules for managing cross-functional reengineering teams. Planning Review, 21(2), 12–13.
Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. Journal of Educational Psychology, 88(1), 64–73.
Nussbaum, E. M., Hartley, K., Sinatra, G. M., Reynolds, R. E., & Bendixen, L. D. (2004). Personality interactions and scaffolding in on-line discussions. Journal of Educational Computing Research, 30(1–2), 113–137.
Ochoa, X. (2017). Multimodal learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 129–141). SoLAR.
Roschelle, J., & Teasley, S. D. (1995). The construction of shared knowledge in collaborative problem solving. In Computer supported collaborative learning (pp. 69–97). Springer.
Senge, P. M. (1990). The art and practice of the learning organization. Doubleday.
Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Shum, S. S., Ferguson, R., Duval, E., Verbert, K., & Baker, R. S. (2011). Open learning analytics: An integrated & modularized platform. SoLAR.
Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(1), 1509–1528.
Stahl, G. (2020). Theoretical investigations: Philosophical foundations of group cognition. Springer.
Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2010). A framework for conceptualizing, representing, and analyzing distributed interaction. International Journal of Computer-Supported Collaborative Learning, 5(1), 5–42.
Ullmann, T. D. (2015). Automated detection of reflection in texts. A machine learning based approach. Doctoral dissertation, The Open University. Open Research Online.
Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 203–211). ACM.
Wise, A. F., & Cui, Y. (2018). Learning communities in the crowd: Characteristics of content related interactions and social relationships in MOOC discussion forums. Computers & Education, 122, 221–242.
Wise, A. F., & Hsiao, Y. T. (2019). Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions. Computers in Human Behavior, 96, 273–284.
Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53–69.
Wise, A. F., Knight, S., & Buckingham Shum, S. (in press). Collaborative learning analytics. In U. Cress, C. P. Rosé, J. Oshima, & A. F. Wise (Eds.), International handbook of computer-supported collaborative learning. Springer.
Wise, A. F., & Vytasek, J. (2017). Learning analytics implementation design. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 151–160). SoLAR.
Wise, A. F., Vytasek, J. M., Hausknecht, S., & Zhao, Y. (2016). Developing learning analytics design knowledge in the “middle space”: The student tuning model and align design framework for learning analytics use. Online Learning, 20(2), 155–182.
Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71.
Yilmaz, F. G., & Yilmaz, R. (2020). Learning analytics as a metacognitive tool to influence learner transactional distance and motivation in online learning environments. Innovations in Education and Teaching International, 1–11.
Acknowledgments
The authors would like to thank Trang Thi Thuy Tran for her assistance with designing and revising the discussion forum analytic report.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Association for Educational Communications and Technology
About this chapter
Cite this chapter
Li, Q., Jung, Y., Wise, A.F., Sommer, S., Axelrod, V.G. (2021). Designing Analytics to Support Team Learning. In: Campbell, L.O., Hartshorne, R., DeMara, R.F. (eds) Perspectives on Digitally-Mediated Team Learning. Educational Communications and Technology: Issues and Innovations. Springer, Cham. https://doi.org/10.1007/978-3-030-77614-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-77614-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77613-8
Online ISBN: 978-3-030-77614-5
eBook Packages: EducationEducation (R0)