Skip to main content
SpringerLink
Log in

How to Design Effective Learning Analytics Indicators? A Human-Centered Design Approach

  • Conference paper
  • First Online:
Book cover Addressing Global Challenges and Quality Education (EC-TEL 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12315))

Included in the following conference series:

Abstract

Empowering learners and teachers to take control of the indicator design process can increase value and drive forward the acceptance and adoption of learning analytics (LA) systems. In this paper, we present the Human-Centered Indicator Design (HCID) approach as a theory-driven framework to guide the systematic and effective design of LA indicators that truly meet user needs. With human needs at the forefront, the aim of HCID is to enable a shift from an ad hoc, data-first to a systematic, people-first approach to indicator design. As a proof of concept, we present a case of applying the HCID approach to indicator design in a higher education context. The case demonstrates that HCID could be a viable approach to design useful LA indicators for and with their users, informed by design practices from the human-computer interaction (HCI) and information visualization fields.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ahn, J., Campos, F., Hays, M., DiGiacomo, D.: Designing in context: reaching beyond usability in learning analytics dashboard design. J. Learn. Anal. 6(2), 70–85 (2019)

    Google Scholar 

  2. Alhadad, S.S.: Visualizing data to support judgement, inference, and decision making in learning analytics: insights from cognitive psychology and visualization science. J. Learn. Anal. 5(2), 60–85 (2018)

    Google Scholar 

  3. Bodily, R., et al.: Open learner models and learning analytics dashboards: a systematic review. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, LAK 2018, pp. 41–50. ACM, New York (2018). https://doi.org/10.1145/3170358.3170409

  4. Buckingham Shum, S., Ferguson, R., Martinez-Maldonado, R.: Human-centred learning analytics. J. Learn. Anal. 6(2), 1–9 (2019)

    Google Scholar 

  5. Chatti, M.A., Muslim, A.: The PERLA framework: blending personalization and learning analytics. Int. Rev. Res. Open Distrib. Learn. 20(1), 43 (2019). https://doi.org/10.7202/1057982ar

    Article  Google Scholar 

  6. Chen, B., Zhu, H.: Towards value-sensitive learning analytics design. In: Proceedings of the 9th International Conference on Learning Analytics & Knowledge, LAK 2019, pp. 343–352. ACM, New York (2019). https://doi.org/10.1145/3303772.3303798

  7. Dollinger, M., Liu, D., Arthars, N., Lodge, J.M.: Working together in learning analytics towards the co-creation of value. J. Learn. Anal. 6(2), 10–26 (2019)

    Google Scholar 

  8. Dollinger, M., Lodge, J.M.: Co-creation strategies for learning analytics. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, LAK 2018, pp. 97–101. ACM, New York (2018). https://doi.org/10.1145/3170358.3170372

  9. Gašević, D., Dawson, S., Pardo, A.: How Do We Start? State Directions of Learning Analytics Adoption, International Council for Open and Distance Education (2016)

    Google Scholar 

  10. Gašević, D., Dawson, S., Siemens, G.: Let’s not forget: learning analytics are about learning. TechTrends 59(1), 64–71 (2014). https://doi.org/10.1007/s11528-014-0822-x

    Article  Google Scholar 

  11. Holstein, K., McLaren, B.M., Aleven, V.: Co-designing a real-time classroom orchestration tool to support teacher-AI complementarity. J. Learn. Anal. 6(2), 27–52 (2019)

    Google Scholar 

  12. Jivet, I., Scheffel, M., Drachsler, H., Specht, M.: Awareness is not enough: pitfalls of learning analytics dashboards in the educational practice. In: Lavoué, É., Drachsler, H., Verbert, K., Broisin, J., Pérez-Sanagustín, M. (eds.) EC-TEL 2017. LNCS, vol. 10474, pp. 82–96. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66610-5_7

    Chapter  Google Scholar 

  13. Jivet, I., Scheffel, M., Specht, M., Drachsler, H.: License to evaluate: preparing learning analytics dashboards for educational practice. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 31–40. ACM (2018)

    Google Scholar 

  14. Kelly, N., Thompson, K., Yeoman, P.: Theory-led design of instruments and representations in learning analytics: developing a novel tool for orchestration of online collaborative learning. J. Learn. Anal. 2(2), 14–43 (2015)

    Article  Google Scholar 

  15. Klerkx, J., Verbert, K., Duval, E.: Learning analytics dashboards. In: Lang, C., Siemens, G., Wise, A., Gasevic, D. (eds.) The Handbook of Learning Analytics, pp. 143–150. Society for Learning Analytics Research (SoLAR), Newport Beach (2017)

    Chapter  Google Scholar 

  16. Martinez-Maldonado, R., Pardo, A., Mirriahi, N., Yacef, K., Kay, J., Clayphan, A.: LATUX: an iterative workflow for designing, validating, and deploying learning analytics visualizations. J. Learn. Anal. 2(3), 9–39 (2016)

    Article  Google Scholar 

  17. Marzouk, Z., et al.: What if learning analytics were based on learning science? Aust. J. Educ. Technol. 32(6), 23 (2016). https://doi.org/10.14742/ajet.3058

    Article  Google Scholar 

  18. Molenaar, I., Horvers, A., Dijkstra, R., Baker, R.: Designing dashboards to support learners’ self-regulated learning. In: Companion Proceedings 9th International Conference on Learning Analytics & Knowledge (LAK 2019), pp. 764–775. Society for Learning Analytics Research (SoLAR), Newport Beach (2019)

    Google Scholar 

  19. Munzner, T.: Visualization Analysis and Design. AK Peters Visualization Series. CRC Press, Boca Raton (2014)

    Book  Google Scholar 

  20. Muslim, A., Chatti, M.A., Mughal, M., Schroeder, U.: The goal-question-indicator approach for personalized learning analytics. In: Proceedings of the 9th International Conference on Computer Supported Education CSEDU, pp. 371–378 (2017)

    Google Scholar 

  21. Norman, D.: The Design of Everyday Things: Revised and Expanded Edition. Basic books, New York (2013)

    Google Scholar 

  22. North, C.: Toward measuring visualization insight. IEEE Comput. Graph. Appl. 26(3), 6–9 (2006). https://doi.org/10.1109/MCG.2006.70

    Article  Google Scholar 

  23. Prieto-Alvarez, C.G., Martinez-Maldonado, R., Anderson, T.D.: Co-designing learning analytics tools with learners. In: Learning Analytics in the Classroom: Translating Learning Analytics for Teachers (2018)

    Google Scholar 

  24. Rehrey, G., Shepard, L., Hostetter, C., Reynolds, A., Groth, D.: Engaging faculty in learning analytics: agents of institutional culture change. J. Learn. Anal. 6(2), 86–94 (2019)

    Google Scholar 

  25. Ritsos, P.D., Roberts, J.C.: Towards more visual analytics in learning analytics. In: Proceedings of the 5th EuroVis Workshop on Visual Analytics, pp. 61–65 (2014)

    Google Scholar 

  26. Schwendimann, B.A., et al.: Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans. Learn. Technol. 10(1), 30–41 (2016)

    Article  Google Scholar 

  27. Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S., Kirschner, P.A.: Linking learning behavior analytics and learning science concepts: designing a learning analytics dashboard for feedback to support learning regulation. Comput. Hum. Behav. 107, 105512 (2018)

    Article  Google Scholar 

  28. Verbert, K., Duval, E., Klerkx, J., Govaerts, S., Santos, J.L.: Learning analytics dashboard applications. Am. Behav. Sci. 57(10), 1500–1509 (2013). https://doi.org/10.1177/0002764213479363

    Article  Google Scholar 

  29. Verbert, K., et al.: Learning dashboards: an overview and future research opportunities. Pers. Ubiquitous Comput. 18(6), 1499–1514 (2013). https://doi.org/10.1007/s00779-013-0751-2

    Article  Google Scholar 

  30. Ware, C.: Information Visualization: Perception for Design. Elsevier, Amsterdam (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Duisburg-Essen, Duisburg, Germany

    Mohamed Amine Chatti, Arham Muslim, Mouadh Guesmi, Florian Richtscheid, Dawood Nasimi, Amin Shahin & Ritesh Damera

Authors
  1. Mohamed Amine Chatti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arham Muslim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mouadh Guesmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Florian Richtscheid
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dawood Nasimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Amin Shahin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ritesh Damera
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mouadh Guesmi .

Editor information

Editors and Affiliations

  1. Universidad Carlos III de Madrid, Leganés (Madrid), Spain

    Carlos Alario-Hoyos

  2. Tallinn University, Tallinn, Estonia

    María Jesús Rodríguez-Triana

  3. Open University Netherlands, Heerlen, The Netherlands

    Maren Scheffel

  4. Trinity College Dublin, Dublin, Ireland

    Inmaculada Arnedillo-Sánchez

  5. Graz University of Technology and Know-Center, Graz, Austria

    Sebastian Maximilian Dennerlein

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chatti, M.A. et al. (2020). How to Design Effective Learning Analytics Indicators? A Human-Centered Design Approach. In: Alario-Hoyos, C., Rodríguez-Triana, M.J., Scheffel, M., Arnedillo-Sánchez, I., Dennerlein, S.M. (eds) Addressing Global Challenges and Quality Education. EC-TEL 2020. Lecture Notes in Computer Science(), vol 12315. Springer, Cham. https://doi.org/10.1007/978-3-030-57717-9_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-57717-9_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-57716-2

  • Online ISBN: 978-3-030-57717-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation