Skip to main content
Book cover

Perspectives on Digitally-Mediated Team Learning pp 147–165Cite as

Designing Analytics to Support Team Learning

  • 155 Accesses

Part of the Educational Communications and Technology: Issues and Innovations book series (ECTII)

Abstract

Team learning has become an essential activity in both professional and educational contexts. Learning analytics offers promising opportunities to support team learning by making information about group processes available to teams in real time to help them learn how to interact more productively. The design of team analytics requires three sets of critical decisions: the choices of metrics, the ways in which these metrics are presented, and how the analytics are implemented. This chapter describes four guiding principles for navigating this decision space in ways that produce relevant, understandable, and actionable analytics to support team learning.

Application of the principles is illustrated in a design case of creating analytics for a discussion-based online course. The chapter concludes by describing the uptake of and student responses to the analytics in a pilot implementation and considering lessons learned for the design of team learning analytics.

Keywords

  • Team learning
  •  Learning analytics
  • Team analytics design
  •  Design principles

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-77614-5_8
  • Chapter length: 19 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   129.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-77614-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book
USD   169.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Notes

  1. 1.

    Such as in-degree

  2. 2.

    Learning Management System

References

  • Anderson, T. (2008). Towards a theory of online learning. In T. Anderson (Ed.), The theory and practice of online learning (pp. 45–74). Athabasca University Press.

    Google Scholar 

  • Bodemer, D., Janssen, J., & Schnaubert, L. (2018). Group awareness tools for computer supported collaborative learning. In F. Fischer, C. E. Hmelo-Silver, S. R. Goldman, & P. Reimann (Eds.), International handbook of the learning sciences (pp. 351–358). Routledge.

    CrossRef  Google Scholar 

  • Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019). Human-centered learning analytics. Journal of Learning Analytics, 6(2), 1–9.

    CrossRef  Google Scholar 

  • Chen, C. (2010). Information visualization. Wiley Interdisciplinary Reviews: Computational Statistics, 2(4), 387–403.

    CrossRef  Google Scholar 

  • Chen, B., Chang, Y. H., Ouyang, F., & Zhou, W. (2018). Fostering student engagement in online discussion through social learning analytics. The Internet and Higher Education, 37, 21–30.

    CrossRef  Google Scholar 

  • Chen, B., & Huang, T. (2019). It is about timing: Network prestige in asynchronous online discussions. Journal of Computer Assisted Learning, 35(4), 503–515.

    Google Scholar 

  • Clark, D. B., & Sampson, V. (2008). Assessing dialogic argumentation in online environments to relate structure, grounds, and conceptual quality. Journal of Research in Science Teaching, 45(3), 293–321.

    CrossRef  Google Scholar 

  • Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). ACM.

    CrossRef  Google Scholar 

  • Dawson, S. (2006). A study of the relationship between student communication interaction and sense of community. The Internet and Higher Education, 9(3), 153–162.

    CrossRef  Google Scholar 

  • Dawson, S., Bakharia, A., & Heathcote, E. (2010). SNAPP: Realising the affordances of real-time SNA within networked learning environments. Paper presented at the 7th International Conference on Networked Learning, Aalborg, Denmark.

    Google Scholar 

  • Dennen, V. P. (2001). The design and facilitation of asynchronous discussion activities in web-based courses: Implications for instructional design theory. Doctoral dissertation, Indiana University Bloomington. ProQuest Dissertations Publishing.

    Google Scholar 

  • Dillenbourg, P. (1999). What do you mean by collaborative learning? In P. Dillenbourg (Ed.), Collaborative learning: Cognitive and computational approaches (pp. 1–19). Elsevier.

    Google Scholar 

  • Edmondson, A. C., Dillon, J. R., & Roloff, K. S. (2007). Three perspectives on team learning: improvement, task mastery, and group process. Academy of Management Annals, 1, 269–314.

    CrossRef  Google Scholar 

  • Farrow, E., Moore, J., & Gašević, D. (2020). Dialogue attributes that inform depth and quality of participation in course discussion forums. In Proceedings of the Tenth International Conference on Learning Analytics and Knowledge (pp. 129–134). ACM.

    CrossRef  Google Scholar 

  • Ferguson, R., & Shum, S. B. (2012). Social learning analytics: five approaches. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 23–33). ACM.

    CrossRef  Google Scholar 

  • Fincham, E., Whitelock-Wainwright, A., Kovanović, V., Joksimović, S., van Staalduinen, J. P., & Gašević, D. (2019). Counting clicks is not enough: Validating a theorized model of engagement in learning analytics. In Proceedings of the 9th International Conference on Learning Analytics and Knowledge (pp. 501–510). ACM.

    CrossRef  Google Scholar 

  • Gao, F., Wang, C. X., & Sun, Y. (2009). New model of productive online discussion and its implications for research and instruction. Journal of Educational Technology Development and Exchange, 2(1), 65–78.

    CrossRef  Google Scholar 

  • Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2), 193–202.

    CrossRef  Google Scholar 

  • Hewitt, J. (2003). How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research, 28(1), 31–45.

    CrossRef  Google Scholar 

  • Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Koivuniemi, M., & Järvenoja, H. (2015). Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools. Educational Technology Research and Development, 63(1), 125–142.

    CrossRef  Google Scholar 

  • Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness is not enough: pitfalls of learning analytics dashboards in the educational practice. In Proceedings of European Conference on Technology Enhanced Learning 2017 (pp. 82–96). Springer Cham.

    Google Scholar 

  • John-Steiner, V., & Mahn, H. (1996). Sociocultural approaches to learning and development: A Vygotskian framework. Educational Psychologist, 31(3/4), 191–206.

    CrossRef  Google Scholar 

  • Katzenbach, J. R., & Smith, D. K. (1993). The rules for managing cross-functional reengineering teams. Planning Review, 21(2), 12–13.

    CrossRef  Google Scholar 

  • Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. Journal of Educational Psychology, 88(1), 64–73.

    CrossRef  Google Scholar 

  • Nussbaum, E. M., Hartley, K., Sinatra, G. M., Reynolds, R. E., & Bendixen, L. D. (2004). Personality interactions and scaffolding in on-line discussions. Journal of Educational Computing Research, 30(1–2), 113–137.

    CrossRef  Google Scholar 

  • Ochoa, X. (2017). Multimodal learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 129–141). SoLAR.

    CrossRef  Google Scholar 

  • Roschelle, J., & Teasley, S. D. (1995). The construction of shared knowledge in collaborative problem solving. In Computer supported collaborative learning (pp. 69–97). Springer.

    CrossRef  Google Scholar 

  • Senge, P. M. (1990). The art and practice of the learning organization. Doubleday.

    Google Scholar 

  • Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Shum, S. S., Ferguson, R., Duval, E., Verbert, K., & Baker, R. S. (2011). Open learning analytics: An integrated & modularized platform. SoLAR.

    Google Scholar 

  • Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(1), 1509–1528.

    Google Scholar 

  • Stahl, G. (2020). Theoretical investigations: Philosophical foundations of group cognition. Springer.

    Google Scholar 

  • Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2010). A framework for conceptualizing, representing, and analyzing distributed interaction. International Journal of Computer-Supported Collaborative Learning, 5(1), 5–42.

    CrossRef  Google Scholar 

  • Ullmann, T. D. (2015). Automated detection of reflection in texts. A machine learning based approach. Doctoral dissertation, The Open University. Open Research Online.

    Google Scholar 

  • Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 203–211). ACM.

    CrossRef  Google Scholar 

  • Wise, A. F., & Cui, Y. (2018). Learning communities in the crowd: Characteristics of content related interactions and social relationships in MOOC discussion forums. Computers & Education, 122, 221–242.

    CrossRef  Google Scholar 

  • Wise, A. F., & Hsiao, Y. T. (2019). Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions. Computers in Human Behavior, 96, 273–284.

    CrossRef  Google Scholar 

  • Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53–69.

    CrossRef  Google Scholar 

  • Wise, A. F., Knight, S., & Buckingham Shum, S. (in press). Collaborative learning analytics. In U. Cress, C. P. Rosé, J. Oshima, & A. F. Wise (Eds.), International handbook of computer-supported collaborative learning. Springer.

    Google Scholar 

  • Wise, A. F., & Vytasek, J. (2017). Learning analytics implementation design. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 151–160). SoLAR.

    CrossRef  Google Scholar 

  • Wise, A. F., Vytasek, J. M., Hausknecht, S., & Zhao, Y. (2016). Developing learning analytics design knowledge in the “middle space”: The student tuning model and align design framework for learning analytics use. Online Learning, 20(2), 155–182.

    CrossRef  Google Scholar 

  • Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71.

    CrossRef  Google Scholar 

  • Yilmaz, F. G., & Yilmaz, R. (2020). Learning analytics as a metacognitive tool to influence learner transactional distance and motivation in online learning environments. Innovations in Education and Teaching International, 1–11.

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Trang Thi Thuy Tran for her assistance with designing and revising the discussion forum analytic report.

Author information

Authors and Affiliations

  1. Learning Analytics Research Network, Steinhardt School of Culture, Education, and Human Development, New York University, New York, NY, USA

    Qiujie Li, Yeonji Jung, Alyssa Friend Wise & Sophie Sommer

  2. School of Professional Studies, New York University, New York, NY, USA

    Victoria G. Axelrod

Authors
  1. Qiujie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yeonji Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alyssa Friend Wise
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sophie Sommer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Victoria G. Axelrod
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiujie Li .

Editor information

Editors and Affiliations

  1. Learning Sciences and Educational Research, University of Central Florida, Orlando, FL, USA

    Assist. Prof. Laurie O. Campbell

  2. Learning Sciences and Educational Research, University of Central Florida, Orlando, FL, USA

    Assoc. Prof. Richard Hartshorne

  3. Electrical Engineering and Computer Science, University of Central Florida, Orlando, FL, USA

    Prof. Ronald F. DeMara

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Association for Educational Communications and Technology

About this chapter

Verify currency and authenticity via CrossMark

Cite this chapter

Li, Q., Jung, Y., Wise, A.F., Sommer, S., Axelrod, V.G. (2021). Designing Analytics to Support Team Learning. In: Campbell, L.O., Hartshorne, R., DeMara, R.F. (eds) Perspectives on Digitally-Mediated Team Learning. Educational Communications and Technology: Issues and Innovations. Springer, Cham. https://doi.org/10.1007/978-3-030-77614-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77614-5_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77613-8

  • Online ISBN: 978-3-030-77614-5

  • eBook Packages: EducationEducation (R0)