Abstract
In contemporary higher education, learner behaviour is increasingly traced by digital systems. As such, there is a strong potential for data mining over time to track and represent learner actions in the context of their assessment performance. This chapter explores how learning analytics can assist educators to design impactful feedback processes and help learners identify the impact of feedback information, both across time and at scale. In doing so, it offers current examples of how learning analytics could guide educational designs and be employed to support learners to direct their own learning and study habits. This chapter also highlights how learning analytics can help understand and optimise learning, and the environments in which the learning occurs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ali, L., Hatala, M., Gašević, D., & Jovanović, J. (2012). A qualitative evaluation of evolution of a learning analytics tool. Computers & Education, 58(1), 470–489. https://doi.org/10.1016/j.compedu.2011.08.030.
Arnold, K. E., & Pistilli, M. D. (2012, April). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). ACM.
Bakharia, A., Corrin, L., de Barba, P., Kennedy, G., Gašević, D., Mulder, R., … Lockyer, L. (2016, April). A conceptual framework linking learning design with learning analytics. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 329–338). ACM.
Bodily, R., & Verbert, K. (2017). Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies, 10(4), 405–418. https://doi.org/10.1109/TLT.2017.2740172.
Boud, D. (1995). Enhancing learning through self assessment. Oxon: Routledge.
Boud, D. (2015). Feedback: Ensuring that it leads to enhanced learning. The Clinical Teacher, 12, 3–7. https://doi.org/10.1111/tct.12345.
Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment & Evaluation in Higher Education, 38(6), 698–712. https://doi.org/10.1080/02602938.2012.691462.
Bridges, D. (2000). Back to the future: The higher education curriculum in the 21st century. Cambridge Journal of Education, 30(1), 37–55. https://doi.org/10.1080/03057640050005762.
Broos, T., Verbert, K., Langie, G., Van Soom, C., & De Laet, T. (2017). Small data as a conversation starter for learning analytics: Exam results dashboard for first-year students in higher education. Journal of Research in Innovative Teaching & Learning, 10(2), 94–106. https://doi.org/10.1108/JRIT-05-2017-0010.
Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. https://doi.org/10.3102/00346543065003245.
Carless, D., Salter, D., Yang, M., & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher Education, 36(4), 395–407. https://doi.org/10.1080/03075071003642449.
Ciftci, H., & Kocoglu, Z. (2012). Effects of peer E-feedback on Turkish EFL students’ writing performance. Journal of Educational Computing Research, 46(1), 61–84.
Cuseo, J. (2007). The empirical case against large class size: Adverse effects on the teaching, learning, and retention of first-year students. Journal of Faculty Development, 21(1), 5–21.
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019). What makes for effective feedback: Staff and student perspectives. Assessment and Evaluation in Higher Education, 44(1), 25–36. https://doi.org/10.1080/02602938.2018.1467877.
Debuse, J. C. W., Lawley, M., & Shibl, R. (2008). Educators’ perceptions of automated feedback systems. Australasian Journal of Educational Technology, 24(4), 374–386. https://doi.org/10.14742/ajet.1198.
Deepwell, F., & Benfield, G. (2012). Evaluating assessment practices: The academic staff perspective. In L. Clouder, C. Brougham, S. Jewell, & G. Steventon (Eds.), Improving student engagement and development through assessment: Theory and practice in higher education (pp. 59–72). New York: Routledge.
Exeter, D. J., Ameratunga, S., Ratima, M., Morton, S., Dickson, M., Hsu, D., & Jackson, R. (2010). Student engagement in very large classes: The teachers’ perspective. Studies in Higher Education, 35(7), 761–775. https://doi.org/10.1080/03075070903545058.
Fincham, O. E., Gašević, D., Jovanović, J., & Pardo, A. (2018). From study tactics to learning strategies: An analytical method for extracting interpretable representations. IEEE Transactions on Learning Technologies, 12(1), 59–72. https://doi.org/10.1109/TLT.2018.2823317.
Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. https://doi.org/10.1007/s11528-014-0822-x.
Gašević, D., Dawson, S., Rogers, T., & Gašević, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting learning success. The Internet and Higher Education, 28, 68–84. https://doi.org/10.1016/j.iheduc.2015.10.002.
Gašević, D., Mirriahi, N., Dawson, S., & Joksimović, S. (2017). Effects of instructional conditions and experience on the adoption of a learning tool. Computers in Human Behavior, 67, 207–220. https://doi.org/10.1016/j.chb.2016.10.026.
Gibbs, G., & Simpson, C. (2004). Conditions under which assessment supports students’ learning. Learning and Teaching in Higher Education, 1(1), 3–31.
Gibbs, G., Lucas, L., & Simonite, V. (1996). Class size and student performance: 1984–94. Studies in Higher Education, 21(3), 261–273. https://doi.org/10.1080/03075079612331381201.
Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology & Society, 15(3), 42–57. Retrieved from https://www.jstor.org/stable/jeductechsoci.15.3.42.
Hartley, J., & Chesworth, K. (2000). Qualitative and quantitative methods in research on essay writing: No one way. Journal of Further and Higher Education, 24(1), 15–24. https://doi.org/10.1080/030987700112282.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487.
Herder, T., Swiecki, Z., Fougt, S. S., Tamborg, A. L., Allsopp, B. B., Shaffer, D. W., & Misfeldt, M. (2018, March). Supporting teachers’ intervention in students’ virtual collaboration using a network based model. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 21–25). ACM.
Huang, S.-C. (2016). Understanding learners’ self-assessment and self-feedback on their foreign language speaking performance. Assessment & Evaluation in Higher Education, 41(6), 803–820. https://doi.org/10.1080/02602938.2015.1042426.
Huxham, M. (2007). Fast and effective feedback: Are model answers the answer? Assessment & Evaluation in Higher Education, 32(6), 601–611. https://doi.org/10.1080/02602930601116946.
Joksimović, S., Dowell, N., Gašević, D., Mirriahi, N., Dawson, S., & Graesser, A. C. (2019). Linguistic characteristics of reflective states in video annotations under different instructional conditions. Computers in Human Behavior, 96, 211–222. https://doi.org/10.1016/j.chb.2018.03.003.
Jovanović, J., Gašević, D., Dawson, S., Pardo, A., & Mirriahi, N. (2017). Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education, 33, 74–85. https://doi.org/10.1016/j.iheduc.2017.02.001.
Lust, G., Elen, J., & Clarebout, G. (2013). Students’ tool-use within a web enhanced course: Explanatory mechanisms of students’ tool-use pattern. Computers in Human Behavior, 29(5), 2013–2021. https://doi.org/10.1016/j.chb.2013.03.014.
Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice, 14(4), 5–8. https://doi.org/10.1111/j.1745-3992.1995.tb00881.x.
Mirriahi, N., Joksimović, S., Gašević, D., & Dawson, S. (2018). Effects of instructional conditions and experience on student reflection: A video annotation study. Higher Education Research & Development, 37(6), 1245–1259. https://doi.org/10.1080/07294360.2018.1473845.
Moore, C., & Teather, S. (2012). Engaging students in peer review: Feedback as learning. eCULTURE, 5, 27–36.
Panadero, E., & Broadbent, J. (2018). Developing evaluative judgement: A self-regulated learning perspective. In D. Boud, R. Ajjawi, P. Dawson, & J. Tai (Eds.), Developing evaluative judgement in higher education: Assessment for knowing and producing quality work (pp. 81–89). Oxon: Routledge.
Pardo, A. (2018). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 43(3), 428–438. https://doi.org/10.1080/02602938.2017.1356905.
Pardo, A., Jovanović, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 50(1), 128–138. https://doi.org/10.1111/bjet.12592.
Price, M., Handley, K., Millar, J., & O’Donovan, B. (2010). Feedback: All that effort, but what is the effect? Assessment & Evaluation in Higher Education, 35(3), 277–289. https://doi.org/10.1080/02602930903541007.
Siemens, G., & Gašević, D. (2012). Guest editorial-learning and knowledge analytics. Journal of Educational Technology & Society, 15(3), 1–2.
Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414–2422. https://doi.org/10.1016/j.compedu.2011.05.016.
Teasley, S. D. (2017). Student facing dashboards: One size fits all? Technology, Knowledge and Learning, 22(3), 377–384. https://doi.org/10.1007/s10758-017-9314-3.
Timmerman, A. A., & Dijkstra, J. (2017). A practice approach to programmatic assessment design. Advances in Health Sciences Education, 22(5), 1169–1182. https://doi.org/10.1007.s10459-017-9756-3.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012). A model for programmatic assessment fit for purpose. Medical Teacher, 34(3), 205–214. https://doi.org/10.3109/0142159X.2012.652239.
Winne, P. H. (2017). Leveraging big data to help each learner and accelerate learning science. Teachers College Record, 119(3), 1–24.
Winstone, N. E., Nash, R. A., Rowntree, J., & Parker, M. (2017). ‘It’d be useful, but I wouldn’t use it’: Barriers to university students’ feedback seeking and recipience. Studies in Higher Education, 42(11), 2026–2041. https://doi.org/10.1080/03075079.2015.1130032.
Wise, A. F., Speer, J., Marbouti, F., & Hsiao, Y.-T. (2013). Broadening the notion of participation in online discussions: Examining patterns in learners’ online listening behaviors. Instructional Science, 41(2), 323–343. https://doi.org/10.1007/s11251-012-9230-9.
Wu, W. C. V., Petit, E., & Chen, C. H. (2015). EFL writing revision with blind expert and peer review using a CMC open forum. Computer Assisted Language Learning, 28(1), 58–80. https://doi.org/10.1080/09588221.2014.937442.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 The Author(s)
About this chapter
Cite this chapter
Ryan, T., Gašević, D., Henderson, M. (2019). Identifying the Impact of Feedback Over Time and at Scale: Opportunities for Learning Analytics. In: Henderson, M., Ajjawi, R., Boud, D., Molloy, E. (eds) The Impact of Feedback in Higher Education. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-25112-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-25112-3_12
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-030-25111-6
Online ISBN: 978-3-030-25112-3
eBook Packages: EducationEducation (R0)