Abstract
In the field of learning analytics, dashboards are visual displays that help instructors and students monitor performance, track goals and modify learning-related activities and plans. Student-facing dashboards provide visualizations of the data students need to take responsibility for their own learning, while instructor-facing dashboards help instructors guide and orchestrate student learning. After summarizing the spectrum of learning analytics research on dashboards, we critically review dashboards designed to support collaborative learning and examine research on student-facing and instructor-facing dashboards for problem-based learning, project-based learning, collaborative argumentation, and various team-based learning activities. We explain key concepts such as group awareness, shared mental models, and group cognition, and review tools including shared mirroring systems, ambient displays, and learning dashboards. We then identify opportunities and challenges in the burgeoning field of learning analytics dashboards for computer-supported collaborative learning and argue that learning dashboards can be a useful aid in facilitating collaborative learning but only when designed with a clear pedagogical purpose informed by research and theory will learning dashboards be able to foster effective teaching and learning strategies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akkerman, S., Van den Bossche, P., Admiraal, W., Gijselaers, W., Segers, M., Simons, R.J., Kirschner, P.: Reconsidering group cognition: From conceptual confusion to a boundary area between cognitive and socio-cultural perspectives? Educ. Res. Rev. 2(1), 39–63 (2007)
Ali, L., Hatala, M., Gašević, D., Jovanović, J.: A qualitative evaluation of evolution of a learning analytics tool. Comput. Educ. 58(1), 470–489 (2012)
Arnold, K.E., Pistilli, M.D.: Course signals at Purdue: using learning analytics to increase student success. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 267–270. ACM, New York, NY (2012). https://doi.org/10.1145/2330601.2330666
Baker, R.S.J.d., Corbett, A.T., Aleven, V.: More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian knowledge tracing. In: Proceedings of the 9th International Conference on Intelligent Tutoring Systems, pp. 406–415. Springer, Berlin, Heidelberg (2008)
Barr, J., Gunawardena, A.: Classroom salon: a tool for social collaboration. In: Proceedings of the 43rd ACM technical symposium on Computer Science Education, pp. 197–202. ACM, New York, NY (2012)
Blikstein, P.: Using learning analytics to assess students’ behavior in open-ended programming tasks. In: Proceedings of the First International Conference on Learning Analytics and Knowledge, pp. 110–116. Association for Computing Machinery, New York, NY (2011)
Bodily, R., Verbert, K.: Trends and issues in student-facing learning analytics reporting systems research. In Proceedings of the 7th International Conference on Learning Analytics and Knowledge, pp. 309–318. ACM, New York, NY (2017)
Börner, D., Kalz, M., Specht, M.: Beyond the channel: a literature review on ambient displays for learning. Comput. Educ. 60(1), 426–435 (2013)
Buder, J., Bodemer, D.: Supporting controversial CSCL discussions with augmented group awareness tools. Int. J. Comput. Support. Collab. Learn. 3(2), 123–139 (2008)
Bull, S., Ginon, B., Boscolo, C., Johnson, M.: Introduction of learning visualisations and metacognitive support in a persuadable open learner model. In: Proceedings of the Sixth International Learning Analytics & Knowledge Conference (LAK’16), pp. 30–39. ACM, New York, NY (2016)
Campbell, J.P., Oblinger, D.G.: Academic Analytics. EDUCAUSE White Paper (2007). http://www.educause.edu/ir/library/pdf/PUB6101.pdf
Cannon-Bowers, J.A., Salas, E., Converse, S.: Shared mental models in expert team decision making. In: Castellan, N.J. (ed.). Individual and Group Decision Making, pp. 221–245. Lawrence Erlbaum Associates (1993)
Charleer, S., Klerkx, J., Duval, E., Laet, T.D., Verbert, K.: Towards balanced discussions in the classroom using ambient information visualisations. Int. J. Technol. Enhanc. Learn. 9(2–3), 227–253 (2017)
Chen, C.H., Härdle, W.K., Unwin, A.: Handbook of Data Visualization. Springer Handbooks of Computational Statistics. Springer, Berlin, Heidelberg (2008)
Dawson, S.: ‘Seeing’ the learning community: an exploration of the development of a resource for monitoring online student networking. Br. J. Educ. Technol. 41(5), 736–752 (2010)
Dawson, S., Bakharia, A., Heathcote, E.: SNAPP: Realising the affordances of real-time SNA within networked learning environments. In: Dirckinck-Holmfeld, L., Hodgson, V., Jones, C., de Laat, M., McConnell, D., Ryberg, T. (eds.) Proceedings of the 7th International Conference on Networked Learning, pp. 125–133. University of Lancaster, Lancaster, UK (2010)
Diana, N., Eagle, M., Stamper, J.C., Grover, S., Bienkowski, M.A., Basu, S.: An instructor dashboard for real-time analytics in interactive programming assignments. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference. LAK ’17, pp. 272–279. ACM, New York, NY (2017)
Dickinson, T.L., McIntyre, R.M.: A conceptual framework for teamwork measurement. In: Brannick, M.T., Salas, E., Prince, C. (eds.) Team Performance and Measurement: Theory, Methods, and Applications, pp. 19–43. Lawrence Erlbaum Associates, Mahwah, NJ (1997)
Dillenbourg, P.: Designing biases that augment socio-cognitive interactions. In: Bromme, R., Hesse, F.W., Spada, H. (eds.) Barriers and Biases in Computer-Mediated Knowledge Communication, pp. 243–264. Springer, Boston, MA (2005)
Dillenbourg, P., Zufferey, G., Alavi, H., Jermann, P., Do-Lenh, S., Bonnard, Q.: Classroom orchestration: the third circle of usability. In: Proceedings of the International Conference on Computer Supported Collaborative Learning 2011 (CSCL 2011), pp. 510–517. HK, China (2011)
DiMicco, J.M., Hollenbach, K.J., Pandolfo, A., Bender, W.: The impact of increased awareness while face-to-face. Hum. Comput. Interact. 22(1), 47–96 (2007)
Edwards, B.D., Day, E.A., Arthur, W., Bell, S.T.: Relationships among team ability composition, team mental models, and team performance. J. Appl. Psychol. 91, 727–736 (2006)
Endsley, M.R.: Toward a theory of situation awareness. Hum. Factors 37(1), 32–64 (1995)
Endsley, M.R.: Communication and situation awareness in the aviation system. Paper presented at Aviation Communication: A Multi-Cultural Forum, Prescott, AZ (1997)
Erickson, T., Kellogg, W.A.: Social translucence: An approach to designing systems that support social processes. ACM Trans. Comput. Hum. Interact. (TOCHI) 7(1), 59–83 (2000)
Few, S.: Information Dashboard Design: The Effective Visual Communication of Data. O’Reilly Media Inc., Sebastopol, CA (2006)
Gašević, D., Dawson, S., Siemens, G.: Let’s not forget: learning analytics are about learning. TechTrends 59(1), 64–71 (2015)
Govaerts, S., Verbert, K., Duval, E., Pardo, A.: The student activity meter for awareness and self-reflection. CHI’12 Extended Abstracts on Human Factors in Computing Systems, pp. 869–884. ACM, New York, NY (2012)
Greeno, J.G.: The situativity of knowing, learning and research. Am. Psychol. 53, 5–26 (1998)
Gross, T., Stary, C., Totter, A.: User-centered awareness in computer-supported cooperative work-systems: structured embedding of findings from social sciences. Int. J. Hum. Comput. Interact. 18(3), 323–360 (2005)
Gunawardena, C.N.: Social presence theory and implications for interaction and collaborative learning in computer conferences. Int. J. Educ. Telecommun. 1(2), 147–166 (1995)
Gutwin, C., Stark, G., Greenberg, S.: Support for workspace awareness in educational groupware. In: The First International Conference on Computer Support for Collaborative Learning, pp. 147–156. L. Erlbaum Associates Inc. (1995)
Hadwin, A., Oshige, M.: Self-Regulation, coregulation, and socially shared regulation: exploring perspectives of social in self-regulated learning theory. Teach. Coll. Rec. 113(2), 240–264 (2011)
Ifenthaler, D., Widanapathirana, C.: Development and validation of a learning analytics framework: Two case studies using support vector machines. Technol. Knowl. Learn. 19, 221–240 (2014)
Janssen, J., Bodemer, D.: Coordinated computer-supported collaborative learning: awareness and awareness tools. Educ. Psychol. 48(1), 40–55 (2013)
Janssen, J., Erkens, G., Kanselaar, G., Jaspers, J.: Visualization of participation: does it contribute to successful computer-supported collaborative learning? Comput. Educ. 49(4), 1037–1065 (2007)
Janssen, J., Erkens, G., Kirschner, P.A.: Group awareness tools: it’s what you do with it that matters. Comput. Hum. Behav. 27(3), 1046–1058 (2011)
Järvelä, S., Hadwin, A.F.: New frontiers: regulating learning in CSCL. Educ. Psychol. 48(1), 25–39 (2013)
Järvelä, S., Kirschner, P.A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Järvenoja, H.: Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools. Educ. Tech. Res. Develop. 63(1), 125–142 (2015)
Järvelä, S., Kirschner, P.A., Hadwin, A., Järvenoja, H., Malmberg, J., Miller, M., Laru, J.: Socially shared regulation of learning in CSCL: understanding and prompting individual-and group-level shared regulatory activities. Inter. J. Computer-Supported Collab. Lea. 11(3), 263–280 (2016)
Jermann, P., Dillenbourg, P.: Group mirrors to support interaction regulation in collaborative problem solving. Comput. Educ. 51(1), 279–296 (2008)
Jivet, I., Scheffel, M., Drachsler, H., Specht, M.: Awareness is not enough: Pitfalls of learning analytics dashboards in the educational practice. In: Proceedings of the 12th European Conference on Technology-Enhanced Learning, pp. 82–96. Springer, Cham (2017)
Kardan, S., Conati, C.: A framework for capturing distinguishing user interaction behaviors in novel interfaces. In: Pechenizkiy, M., Calders, T., Conati, C., Ventura, S., Romero, C., Stamper, J. (eds.) Proceedings of the 4th International Conference on Educational Data Mining, pp. 159–168. Eindhoven, the Netherlands (2011)
Kerly, A., Ellis, R., Bull, S.: (2007) CALMsystem: a conversational agent for learner modelling. In: Ellis, R., Allen, T., Petridis, M. (eds.) Applications and Innovations in Intelligent Systems XV: Proceedings of AI-2007, 27th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, pp. 89–102. Springer, Berlin, Heidelberg
Kerr, N.L.: Motivation losses in small groups: a social dilemma analysis. Personal. Soc. Psychol. 45, 819–828 (1983)
Kerr, N.L., Bruun, S.E.: Dispensability of member effort and group motivation losses: free rider effects. J. Personal. Soc. Psychol. 44, 78–94 (1983)
Kirschner, P.A.: Can we support CSCL? Educational, social and technological affordances for learning. In: Kirschner, P. (ed.) Three Worlds of CSCL: Can We Support CSCL, pp. 7–47. OUNL, Heerlen (2002)
Kirschner, P.A., Kreijns, K.: Designing sociable CSCL environments: applying interaction design principles. In Dillenbourg, P., Strijbos, J.W., Kirschner, P.A., Martens, R.L. (eds.) Computer-Supported Collaborative Learning, vol. 3, pp. 241–263 (2004)
Kock, M., Paramythis, A.: Activity sequence modelling and dynamic clustering for personalized e-learning. User Model. User Adapt. Interact. 21(1–2), 51–97 (2011)
Kreijns, K., Kirschner, P.A., Jochems, W.: Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research. Comput. Hum. Behav. 19(3), 335–353 (2003)
Latané, B., Williams, K., Harkins, S.: Many hands make light the work: the causes and consequences of social loafing. J. Personal. Soc. Psychol. 37, 822–832 (1979)
Lockyer, L., Heathcote, E., Dawson, S.: Informing pedagogical action: aligning learning analytics with learning design. Am. Behav. Sci. 57(10), 1439–1459 (2013)
Macfadyen, L.P., Dawson, S.: Mining LMS data to develop an “early warning system” for educators: a proof of concept. Comput. Educ. 54(2), 588–599 (2010)
Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Lederer, S., Ames, M.: Heuristic evaluation of ambient displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 169–176. ACM, New York, NY (2003)
Martin, B., Mitrovic, A., Koedinger, K., Mathan, S.: Evaluating and improving adaptive educational systems with learning curves. User Model. User Adapt. Interact. 21(3), 249–283 (2011)
Martinez-Maldonado, R., Yacef, K., Kay, J.: TSCL: a conceptual model to inform understanding of collaborative learning processes at interactive tabletops. Int. J. Hum. Comput. Stud. 83, 62–82 (2015)
Martinez-Maldonado, R., Kay, J., Yacef, K., Schwendimann, B.: An interactive teacher’s dashboard for monitoring groups in a multi-tabletop learning environment. In: Cerri et al. (eds.) Proceedings of the 11th International Conference on Intelligent Tutoring, pp. 482–492. Springer, Berlin, Heidelberg (2012)
Martinez-Maldonado, R.M., Kay, J., Yacef, K., Schwendimann, B.: An interactive teacher’s dashboard for monitoring groups in a multi-tabletop learning environment. In: International Conference on Intelligent Tutoring Systems, pp. 482–492. Springer, Berlin, Heidelberg (2012)
Marzouk, Z., Rakovic, M., Liaqat, A., Vytasek, J., Samadi, D., Stewart-Alonso, J., Ram, I., Woloshen, S., Winne, P.H., Nesbit, J.C.: What if learning analytics were based on learning science? Australasian J. Educ. Tech. 32(6), 1–18 (2016)
Mathieu, J.E., Heffner, T.S., Goodwin, G.F., Salas, E., Cannon-Bowers, J.A.: The influence of shared mental models on team process and performance. J. Appl. Psychol. 85(2), 273 (2000)
May, M., George, S., Prévôt, P.: TrAVis to enhance students’ self-monitoring in online learning supported by computer-mediated communication tools. Comput. Inf. Syst. Ind. Manag. Appl. 3, 623–634 (2011)
Mazza, R., Milani, C.: Gismo: a graphical interactive student monitoring tool for course management systems. In: International Conference on Technology Enhanced Learning, pp. 1–8, Milan (2004)
Miller, M., Hadwin, A.: Scripting and awareness tools for regulating collaborative learning: changing the landscape of support in CSCL. Comp. Human Behav. 52, 573–588 (2015)
Panadero, E., Järvelä, S.: Socially shared regulation of learning: a review. Eur. Psychol. 20, 190–203 (2015)
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., Mirriahi, N.: Using learning analytics to scale the provision of personalised feedback. Br. J. Educ. Technol. (2017)
Phielix, C., Prins, F.J., Kirschner, P.A., Erkens, G., Jaspers, J.: Group awareness of social and cognitive performance in a CSCL environment: effects of a peer feedback and reflection tool. Comput. Hum. Behav. 27(3), 1087–1102 (2011)
Pousman, Z., Stasko, J.: A taxonomy of ambient information systems: Four patterns of design. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 67–74. ACM, New York, NY (2006)
Premlatha, K.R., Dharani, B., Geetha, T.V.: Dynamic learner profiling and automatic learner classification for adaptive e-learning environment. Interact. Learn. Environ. 24(6), 1054–1075 (2016)
Redlich, B., Siemon, D., Lattemann, C., Robra-Bissantz, S.: Shared mental models in creative virtual teamwork. In: Proceedings of the 50th Hawaii International Conference on System Sciences. Kaua’i, USA (2017)
Rienties, B., Toetenel, L.: The impact of 151 learning designs on student satisfaction and performance: social learning (analytics) matters. In: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pp. 339–343. ACM, New York, NY (2016)
Salas, E., Sims, D., Burke, C.: Is there a ‘Big Five’ in teamwork? Small Group Res. 36, 555–599 (2005)
Santos, J.L., Govaerts, S., Verbert, K., Duval, E.: Goal-oriented visualizations of activity tracking: a case study with engineering students. 2nd International Conference on Learning Analytics and Knowledge, pp. 143–152. ACM, New York, NY (2012)
Sarter, N.B., Woods, D.D.: Situation awareness: a critical but ill-defined phenomenon. Int. J. Aviat. Psychol. 1(1), 45–57 (1991)
Scheffel, M., Drachsler, H., De Kraker, J., Kreijns, K., Slootmaker, A., Specht, M.: Widget, widget on the wall, am I performing well at all? IEEE Trans. Learn. Technol. 10(1), 42–52 (2017)
Schmitz, M., van Limbeek, E., Greller, W., Sloep, P., Drachsler, H.: Opportunities and challenges in using learning analytics in learning design. In: Lavoué, É., Drachsler, H., Verbert, K., Broisin, J., Pérez-Sanagustín, M. (eds.) Data Driven Approaches in Digital Education. EC-TEL 2017. Lecture Notes in Computer Science, vol. 10474. Springer, Cham (2017)
Schwendimann, B.A., Rodriguez-Triana, M.J., Vozniuk, A., Prieto, L.P., Boroujeni, M.S., Holzer, A., Gillet, D., Dillenboug, P.: Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans. Learn. Technol. 10(1), 30–41 (2017)
Shen, X., Moere, A. V., Eades, P., Hong, S.: The long-term evaluation of Fisherman in a partial-attention environment. In: Proceedings of the 2008 Conference on Beyond Time and Errors: Novel Evaluation Methods for Information Visualization, pp. 1–6. ACM, New York, NY (2008)
Shum, S.B., Crick, R.D.: Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 92–101. ACM, New York, NY (2012)
Siemens, G.: Learning analytics: the emergence of a discipline. Am. Behav. Sci. 57(10), 1380–1400 (2013)
Slof, B., Erkens, G., Kirschner, P.A., Jaspers, J.: Design and effects of a representational scripting tool on group performance. Educ. Technol. Res. Dev. 58, 589–608 (2010)
Soller, A., Martínez, A., Jermann, P., Muehlenbrock, M.: From mirroring to guiding: a review of state of the art technology for supporting collaborative learning. Int. J. Artif. Intell. Educ. 15(4), 261–290 (2005)
Stahl, G.: Group Cognition: Computer Support for Building Collaborative Knowledge. MIT Press, Cambridge, MA (2006)
Stahl, G.: Theories of cognition in collaborative learning. In: Hmelo-Silver, C., Chinn, C., Chan, C., O’Donnell, A. (eds.) The International Handbook of Collaborative Learning, pp. 74–90. Routledge, New York, NY (2013)
Streng, S., Stegmann, K., Hussmann, H., Fischer, F.: Metaphor or diagram? Comparing different representations for group mirrors. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, pp. 249–256. ACM, New York, NY (2009)
Suthers, D., Hundhausen, C., Girardeau, L.: Comparing the roles of representations in face-to-face and online computer supported collaborative learning. Comput. Educ. 41, 335–351 (2003)
Tan, J.P.L., Koh, E., Jonathan, C.R., Yang, S.: Learner dashboards a double-edged sword? Students’ sense-making of a collaborative critical reading and learning analytics environment for fostering 21st century literacies. J. Learn. Anal. 4(1), 117–140 (2017)
Tarmazdi, H., Vivian, R., Szabo, C., Falkner, K., Falkner, N.: Using learning analytics to visualise computer science teamwork. In: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, pp. 165–170. ACM, New York, NY (2015)
Teasley, S.D.: Student facing dashboards: one size fits all? Technol. Knowl. Learn. 22(3), 377–384 (2017)
United States Education Dashboard (n.d.): https://dashboard.ed.gov/
Upton, K., Kay, J.: Narcissus: group and individual models to support small group work. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 54–65. Springer, Berlin, Heidelberg (2009)
Verbert, K., Drachsler, H., Manouselis, N., Wolpers, M., Vuorikari, R., Duval, E.: Dataset-driven research for improving recommender systems for learning. In: Proceedings of the 1st International Conference on Learning Analytics and Knowledge, pp. 44–53. ACM, New York, NY (2011)
Wang, F., Hannafin, M.J.: Design-based research and technology-enhanced learning environments. Educ. Technol. Res. Dev. 53(4), 5–23 (2005)
Wise, A.F., Vytasek, J.M., Hausknecht, S., Zhao, Y.: Developing learning analytics design knowledge in the “middle space”: the student tuning model and align design framework for learning analytics use. Online Learn. 20(2), 155–182 (2016)
Wise, A.F., Azevedo, R., Stegmann, K., Malmberg, J., Rosé, C.P., Fischer, F.: CSCL and learning analytics: opportunities to support social interaction, self-regulation and socially shared regulation. In: Proceedings of Computer Supported Collaborative Learning (CSCL) Conference 2015, pp. 607–614. Gothenburg, Sweden (2015)
Wise, A.F., Zhao, Y., Hausknecht, S.N.: Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp. 48–56. ACM, New York, NY (2013)
Wise, A.F.: Designing pedagogical interventions to support student use of learning analytics. In: Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, pp. 203–211. ACM, New York, NY (2014)
Wolf, G.: Know thyself: tracking every facet of life, from sleep to mood to pain, 24/7/365. Wired Magazine (2009). https://www.wired.com/2009/06/lbnp-knowthyself/
Yusoff, N.M., Salim, S.S.: A systematic review of shared visualisation to achieve common ground. J. Vis. Lang. Comput. 28, 83–99 (2015)
Zimmerman, B.J.: Attainment of self-regulation: A social cognitive perspective. In: Boekaerts, M., Pintrich, P.R., Zeidner, M. (eds.) Handbook of Self-Regulation, pp. 13–39. Academic Press, San Diego, CA (2000)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Liu, A.L., Nesbit, J.C. (2020). Dashboards for Computer-Supported Collaborative Learning. In: Virvou, M., Alepis, E., Tsihrintzis, G., Jain, L. (eds) Machine Learning Paradigms. Intelligent Systems Reference Library, vol 158. Springer, Cham. https://doi.org/10.1007/978-3-030-13743-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-13743-4_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-13742-7
Online ISBN: 978-3-030-13743-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)