Technology, Knowledge and Learning

, Volume 22, Issue 3, pp 317–333 | Cite as

Give Me a Customizable Dashboard: Personalized Learning Analytics Dashboards in Higher Education

  • Lynne D. Roberts
  • Joel A. Howell
  • Kristen Seaman
Original Research

Abstract

With the increased capability of learning analytics in higher education, more institutions are developing or implementing student dashboards. Despite the emergence of dashboards as an easy way to present data to students, students have had limited involvement in the dashboard development process. As part of a larger program of research examining student and academic perceptions of learning analytics, we report here on work in progress exploring student perceptions of dashboards and student preferences for dashboard features. First, we present findings on higher education students’ attitudes towards learning analytic dashboards resulting from four focus groups (N = 41). Thematic analysis of the focus group transcripts identified five key themes relating to dashboards: ‘provide everyone with the same learning opportunities’, ‘to compare or not to compare’, ‘dashboard privacy’, ‘automate alerts’ and ‘make it meaningful—give me a customizable dashboard’. Next we present findings from a content analysis of students’ drawings of dashboards demonstrating that students are interested in features that support learning opportunities, provide comparisons to peers and are meaningful to the student. Finally, we present preliminary findings from a survey of higher education students, reinforcing students’ desire to choose whether to have a dashboard and to be able to customize their dashboards. These findings highlight the potential for providing students with some level of control over learning analytics as a means to increasing self-regulated learning and academic achievement. Future research directions aimed at better understanding students emotional and behavioral responses to learning analytics feedback on dashboards and alerts are outlined.

Keywords

Learning analytics Higher education Student attitudes Student dashboards Big data 

References

  1. Ali, L., Hatala, M., Gašević, D., & Jovanović, J. (2012). A qualitative evaluation of evolution of a learning analytics tool. Computers & Education. doi:10.1016/j.compedu.2011.08.030.Google Scholar
  2. Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd international conference on learning analytics and knowledge. doi:10.1145/2330601.2330666.
  3. Atif, A., Bilgin, A., & Richards, D. (2015). Student preferences and attitudes to the use of early alerts. In Paper presented at the twenty-first Americas conference on information systems. Google Scholar
  4. Baumeister, R. F. (1984). Choking under pressure: Self-consciousness and paradoxical effects of incentives on skillful performance. Journal of Personality and Social Psychology. doi:10.1037/0022-3514.46.3.610.Google Scholar
  5. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Reearch in Psychology. doi:10.1191/1478088706qp063oa.Google Scholar
  6. Corrin, L., & de Barba, P. (2014). Exploring students’ interpretation of feedback delivered through learning analytics dashboards. In Proceedings of the ascilite 2014 conference. doi:10.1145/2723576.2723662.
  7. de Freitas, S., Gibson, D., Du Plessis, C., Halloran, P., Williams, E., Ambrose, M., et al. (2015). Foundations of dynamic learning analytics: Using university student data to increase retention. British Journal of Educational Technology. doi:10.1111/bjet.12212.Google Scholar
  8. Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and implementation of a learning analytics toolkit for teachers. Educational Technology & Society, 15(3), 58–76.Google Scholar
  9. Fenigstein, A., Scheier, M. F., & Buss, A. H. (1975). Public and private self-consciousness: Assessment and theory. Journal of Consulting and Clinical Psychology. doi:10.1037/h0076760.Google Scholar
  10. Few, S. (2013). Information dashboard design: Displaying data for at-a-glance monitoring. Burlingame, CA: Analytics Press.Google Scholar
  11. Guest, G., Namey, E., & McKenna, K. (2016). How many focus groups are enough? Building an evidence base for nonprobability sample sizes. Field Methods. doi:10.1177/1525822X16639015.Google Scholar
  12. Hatala, M., Beheshitha, S. S., & Gašević, D. (2016). Associations between students’ approaches to learning and learning analytics visualizations. In Paper presented at LAL 2016 workshop at LAK 2016, Edinburgh.Google Scholar
  13. Heath, J., & Leinonen, E. (2016). An institution wide approach to learning analytics. In C. A. M. Gavan (Ed.), Developing effective educational experiences through learning analytics (pp. 73–87). Hershey, PA: IGI Global.CrossRefGoogle Scholar
  14. Kim, J., Jo, I. H., & Park, Y. (2016). Effects of learning analytics dashboard: Analyzing the relations among dashboard utilization, satisfaction, and learning achievement. Asia Pacific Education Review, 17(1), 13–24.CrossRefGoogle Scholar
  15. Li, I., Dey, A., Forlizzi, J., Höök, K., & Medynskiy, Y. (2011). Personal informatics and HCI: Design, theory, and social implications. In Proceedings of the 2011 annual conference on human factors in computing systems, CHI EA’11 (pp. 2417–2420). New York, NY: ACM. doi:10.1145/1979482.1979573.
  16. McPherson, J., Tong, H. L., Fatt, S. J., & Liu, D. Y. (2016). Student perspectives on data provision and use: Starting to unpack disciplinary differences. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. doi:10.1145/2883851.2883945.Google Scholar
  17. O’Donoghue, T., & Rabin, M. (2003). Self-awareness and self-control. Time and decision: Economic and psychological perspectives on intertemporal choice. New York, NY: Russell Sage Foundation.Google Scholar
  18. Park, Y., & Jo, I.-H. (2015). Development of the learning analytics dashboard to support students’ learning performance. Journal of Universal Computer Science, 21(1), 110–133.Google Scholar
  19. Perry, R. P., Hladkyj, S., Pekrun, R. H., Clifton, R. A., & Chipperfield, J. G. (2005). Perceived academic control and failure in college students: A 3-year study of scholastic attainment. Research in Higher Education. doi:10.1007/s11162-005-3364-4.Google Scholar
  20. Perry, R. P., Hladkyj, S., Pekrun, R. H., & Pelletier, S. T. (2001). Academic control and action control in the achievement of college students: A longitudinal field study. Journal of Educational Psychology. doi:10.1037/0022-0663.93.4.776.Google Scholar
  21. QSR International Pty Ltd. (2012). NVivo qualitative data analysis software, Version 10.Google Scholar
  22. Reimers, G., & Neovesky, A. (2015). Student focused dashboards. In Paper presented at the 7th international conference on computer supported education. doi:10.5220/0005475103990404.
  23. Roberts, L. D., Howell, J. A., Seaman, K., & Gibson, D. C. (2016). Student attitudes toward learning analytics in higher education: “The fitbit version of the learning world”. Frontiers in Psychology, 7, 1959. doi:10.3389/fpsyg.2016.01959.
  24. Rubel, A., & Jones, K. M. (2016). Student privacy in learning analytics: An information ethics perspective. The Information Society. doi:10.1080/01972243.2016.1130502.Google Scholar
  25. Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., et al. (2016). Understanding learning at a glance: An overview of learning dashboard studies. In Proceedings of the sixth international conference on learning analytics and knowledge (pp. 532–533). ACM. doi:10.1145/2883851.2883930.
  26. Sclater, N. (Producer) (2015a). Jisc Learning Analytics Architecture. https://www.youtube.com/watch?v=PoH0NXUbrjw.
  27. Sclater, N. (2015b). What do students want from a learning analytics app. Resource Document. JISC effective learning analytics. https://analytics.jiscinvolve.org/wp/2015/04/29/what-do-students-want-from-a-learning-analytics-app/.
  28. Slade, S., & Prinsloo, P. (2015). Student perspectives on the use of their data: Between intrusion, surveillance and care. European Journal of Open, Distance and E-Learning, 18(1), 1–8.Google Scholar
  29. Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist. doi:10.1177/0002764213479363.Google Scholar
  30. Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., et al. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing. doi:10.1007/s00779-013-0751-2.Google Scholar
  31. Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2016). Supporting learners’ agentic engagement with feedback: A systematic review and a taxonomy of recipience processes. Educational Psychologist. doi:10.1080/00461520.2016.1207538.Google Scholar
  32. You, J. W., & Kang, M. (2014). The role of academic emotions in the relationship between perceived academic control and self-regulated learning in online learning. Computers and Education, 77, 125–133.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2017

Authors and Affiliations

  1. 1.School of Psychology and Speech PathologyCurtin UniversityPerthAustralia
  2. 2.Faculty of Health SciencesCurtin UniversityPerthAustralia

Personalised recommendations