Skip to main content

Designing Analytics to Support Team Learning

  • Chapter
  • First Online:
Book cover Perspectives on Digitally-Mediated Team Learning

Abstract

Team learning has become an essential activity in both professional and educational contexts. Learning analytics offers promising opportunities to support team learning by making information about group processes available to teams in real time to help them learn how to interact more productively. The design of team analytics requires three sets of critical decisions: the choices of metrics, the ways in which these metrics are presented, and how the analytics are implemented. This chapter describes four guiding principles for navigating this decision space in ways that produce relevant, understandable, and actionable analytics to support team learning.

Application of the principles is illustrated in a design case of creating analytics for a discussion-based online course. The chapter concludes by describing the uptake of and student responses to the analytics in a pilot implementation and considering lessons learned for the design of team learning analytics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Such as in-degree

  2. 2.

    Learning Management System

References

  • Anderson, T. (2008). Towards a theory of online learning. In T. Anderson (Ed.), The theory and practice of online learning (pp. 45–74). Athabasca University Press.

    Google Scholar 

  • Bodemer, D., Janssen, J., & Schnaubert, L. (2018). Group awareness tools for computer supported collaborative learning. In F. Fischer, C. E. Hmelo-Silver, S. R. Goldman, & P. Reimann (Eds.), International handbook of the learning sciences (pp. 351–358). Routledge.

    Chapter  Google Scholar 

  • Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019). Human-centered learning analytics. Journal of Learning Analytics, 6(2), 1–9.

    Article  Google Scholar 

  • Chen, C. (2010). Information visualization. Wiley Interdisciplinary Reviews: Computational Statistics, 2(4), 387–403.

    Article  Google Scholar 

  • Chen, B., Chang, Y. H., Ouyang, F., & Zhou, W. (2018). Fostering student engagement in online discussion through social learning analytics. The Internet and Higher Education, 37, 21–30.

    Article  Google Scholar 

  • Chen, B., & Huang, T. (2019). It is about timing: Network prestige in asynchronous online discussions. Journal of Computer Assisted Learning, 35(4), 503–515.

    Google Scholar 

  • Clark, D. B., & Sampson, V. (2008). Assessing dialogic argumentation in online environments to relate structure, grounds, and conceptual quality. Journal of Research in Science Teaching, 45(3), 293–321.

    Article  Google Scholar 

  • Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). ACM.

    Chapter  Google Scholar 

  • Dawson, S. (2006). A study of the relationship between student communication interaction and sense of community. The Internet and Higher Education, 9(3), 153–162.

    Article  Google Scholar 

  • Dawson, S., Bakharia, A., & Heathcote, E. (2010). SNAPP: Realising the affordances of real-time SNA within networked learning environments. Paper presented at the 7th International Conference on Networked Learning, Aalborg, Denmark.

    Google Scholar 

  • Dennen, V. P. (2001). The design and facilitation of asynchronous discussion activities in web-based courses: Implications for instructional design theory. Doctoral dissertation, Indiana University Bloomington. ProQuest Dissertations Publishing.

    Google Scholar 

  • Dillenbourg, P. (1999). What do you mean by collaborative learning? In P. Dillenbourg (Ed.), Collaborative learning: Cognitive and computational approaches (pp. 1–19). Elsevier.

    Google Scholar 

  • Edmondson, A. C., Dillon, J. R., & Roloff, K. S. (2007). Three perspectives on team learning: improvement, task mastery, and group process. Academy of Management Annals, 1, 269–314.

    Article  Google Scholar 

  • Farrow, E., Moore, J., & Gašević, D. (2020). Dialogue attributes that inform depth and quality of participation in course discussion forums. In Proceedings of the Tenth International Conference on Learning Analytics and Knowledge (pp. 129–134). ACM.

    Chapter  Google Scholar 

  • Ferguson, R., & Shum, S. B. (2012). Social learning analytics: five approaches. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 23–33). ACM.

    Chapter  Google Scholar 

  • Fincham, E., Whitelock-Wainwright, A., Kovanović, V., Joksimović, S., van Staalduinen, J. P., & Gašević, D. (2019). Counting clicks is not enough: Validating a theorized model of engagement in learning analytics. In Proceedings of the 9th International Conference on Learning Analytics and Knowledge (pp. 501–510). ACM.

    Chapter  Google Scholar 

  • Gao, F., Wang, C. X., & Sun, Y. (2009). New model of productive online discussion and its implications for research and instruction. Journal of Educational Technology Development and Exchange, 2(1), 65–78.

    Article  Google Scholar 

  • Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2), 193–202.

    Article  Google Scholar 

  • Hewitt, J. (2003). How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research, 28(1), 31–45.

    Article  Google Scholar 

  • Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Koivuniemi, M., & Järvenoja, H. (2015). Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools. Educational Technology Research and Development, 63(1), 125–142.

    Article  Google Scholar 

  • Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness is not enough: pitfalls of learning analytics dashboards in the educational practice. In Proceedings of European Conference on Technology Enhanced Learning 2017 (pp. 82–96). Springer Cham.

    Google Scholar 

  • John-Steiner, V., & Mahn, H. (1996). Sociocultural approaches to learning and development: A Vygotskian framework. Educational Psychologist, 31(3/4), 191–206.

    Article  Google Scholar 

  • Katzenbach, J. R., & Smith, D. K. (1993). The rules for managing cross-functional reengineering teams. Planning Review, 21(2), 12–13.

    Article  Google Scholar 

  • Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. Journal of Educational Psychology, 88(1), 64–73.

    Article  Google Scholar 

  • Nussbaum, E. M., Hartley, K., Sinatra, G. M., Reynolds, R. E., & Bendixen, L. D. (2004). Personality interactions and scaffolding in on-line discussions. Journal of Educational Computing Research, 30(1–2), 113–137.

    Article  Google Scholar 

  • Ochoa, X. (2017). Multimodal learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 129–141). SoLAR.

    Chapter  Google Scholar 

  • Roschelle, J., & Teasley, S. D. (1995). The construction of shared knowledge in collaborative problem solving. In Computer supported collaborative learning (pp. 69–97). Springer.

    Chapter  Google Scholar 

  • Senge, P. M. (1990). The art and practice of the learning organization. Doubleday.

    Google Scholar 

  • Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Shum, S. S., Ferguson, R., Duval, E., Verbert, K., & Baker, R. S. (2011). Open learning analytics: An integrated & modularized platform. SoLAR.

    Google Scholar 

  • Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(1), 1509–1528.

    Google Scholar 

  • Stahl, G. (2020). Theoretical investigations: Philosophical foundations of group cognition. Springer.

    Google Scholar 

  • Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2010). A framework for conceptualizing, representing, and analyzing distributed interaction. International Journal of Computer-Supported Collaborative Learning, 5(1), 5–42.

    Article  Google Scholar 

  • Ullmann, T. D. (2015). Automated detection of reflection in texts. A machine learning based approach. Doctoral dissertation, The Open University. Open Research Online.

    Google Scholar 

  • Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 203–211). ACM.

    Chapter  Google Scholar 

  • Wise, A. F., & Cui, Y. (2018). Learning communities in the crowd: Characteristics of content related interactions and social relationships in MOOC discussion forums. Computers & Education, 122, 221–242.

    Article  Google Scholar 

  • Wise, A. F., & Hsiao, Y. T. (2019). Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions. Computers in Human Behavior, 96, 273–284.

    Article  Google Scholar 

  • Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53–69.

    Article  Google Scholar 

  • Wise, A. F., Knight, S., & Buckingham Shum, S. (in press). Collaborative learning analytics. In U. Cress, C. P. Rosé, J. Oshima, & A. F. Wise (Eds.), International handbook of computer-supported collaborative learning. Springer.

    Google Scholar 

  • Wise, A. F., & Vytasek, J. (2017). Learning analytics implementation design. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 151–160). SoLAR.

    Chapter  Google Scholar 

  • Wise, A. F., Vytasek, J. M., Hausknecht, S., & Zhao, Y. (2016). Developing learning analytics design knowledge in the “middle space”: The student tuning model and align design framework for learning analytics use. Online Learning, 20(2), 155–182.

    Article  Google Scholar 

  • Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71.

    Article  Google Scholar 

  • Yilmaz, F. G., & Yilmaz, R. (2020). Learning analytics as a metacognitive tool to influence learner transactional distance and motivation in online learning environments. Innovations in Education and Teaching International, 1–11.

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Trang Thi Thuy Tran for her assistance with designing and revising the discussion forum analytic report.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qiujie Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Association for Educational Communications and Technology

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Li, Q., Jung, Y., Wise, A.F., Sommer, S., Axelrod, V.G. (2021). Designing Analytics to Support Team Learning. In: Campbell, L.O., Hartshorne, R., DeMara, R.F. (eds) Perspectives on Digitally-Mediated Team Learning. Educational Communications and Technology: Issues and Innovations. Springer, Cham. https://doi.org/10.1007/978-3-030-77614-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77614-5_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77613-8

  • Online ISBN: 978-3-030-77614-5

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics