Skip to main content

Advertisement

SpringerLink
Log in

A user-transaction-based recommendation strategy for an educational digital library

  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

The automated recommendation of content resources to learners is one of the most promising functions of educational digital libraries. Underlying strategies should take the individual progress of the learner into account to provide appropriate recommendations that are meaningful to the learner. If presented with appropriate assistance, learners will more likely engage in productive learning strategies, such as reading up on concepts and accessing preparatory materials, and refrain from unproductive behavior, such as guessing on or copying of homework. In this exploratory case study, we are analyzing transactional data within an educational digital library of online physics homework problems and learning content. The sequence of events starting with a learner failing to solve a particular problem, interacting with other online resources, and then succeeding on that same problem is used to identify potentially helpful resources for future learners. It was found that these “success stories” indeed allow for providing recommendations with acceptable accuracy, which, when implemented, may lead to more productive learning paths.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)

    Article  Google Scholar 

  2. Arons, A.B., Gould, H., Gould, M.: A guide to introductory physics teaching. Am. J. Phys. 59(2), 189–190 (1991)

    Article  Google Scholar 

  3. Baeza-Yates, R., Ribeiro-Neto, B., et al.: Modern Information Retrieval, vol. 463. ACM press, New York (1999)

    Google Scholar 

  4. Beel, J., Gipp, B., Langer, S., Breitinger, C.: Research-paper recommender systems: a literature survey. Int. J. Digit. Libr. 17(4), 305–338 (2016)

    Article  Google Scholar 

  5. Birnbaum, A.: Statistical theories of mental test scores. In: Lord and Novick (1968), Chap Some Latent Trait Models and their Use in Inferring an Examinee’s Ability, pp. 374–472 (1968)

  6. Bobadilla, J., Serradilla, F., Hernando, A., et al.: Collaborative filtering adapted to recommender systems of e-learning. Knowl.-Based Syst. 22(4), 261–265 (2009)

    Article  Google Scholar 

  7. Bonham, S., Beichner, R., Deardorff, D.: Online homework: does it make a difference? Phys. Teacher 39(5), 293–296 (2001)

    Article  Google Scholar 

  8. Brooks, C., McCalla, G.: Towards flexible learning object metadata. Int. J. Contin. Eng Educ. Life Long Learn. 16(1–2), 50–63 (2006)

    Article  Google Scholar 

  9. Chen, C.M.: Intelligent web-based learning system with personalized learning path guidance. Comput. Educ. 51(2), 787–814 (2008)

    Article  Google Scholar 

  10. Cheng, K.K., Thacker, B.A., Cardenas, R.L., Crouch, C.: Using an online homework system enhances students’ learning of physics concepts in an introductory physics course. Am. J. Phys. 72(11), 1447–1453 (2004)

    Article  Google Scholar 

  11. Council, N.R., et al.: How People Learn: Brain, Mind, Experience, and School, Expanded edn. National Academies Press, USA (2000)

    Google Scholar 

  12. Dȩbowska, E., Girwidz, R., Greczyło, T., Kohnle, A., Mason, B., Mathelitsch, L., Melder, T., Michelini, M., Ruddock, I., Silva, J.: Report and recommendations on multimedia materials for teaching and learning electricity and magnetism. Eur. J. Phys. 34(3), L47 (2013)

    Article  Google Scholar 

  13. Drachsler, H., Hummel, H.G., Koper, R.: Personal recommender systems for learners in lifelong learning networks: the requirements, techniques and model. Int. J. Learn. Technol. 3(4), 404–423 (2008)

    Article  Google Scholar 

  14. Drachsler, H., Verbert, K., Santos, O. C., Manouselis, N.: Panorama of recommender systems to support learning. In: Recommender Systems Handbook, Springer, Berlin pp. 421–451 (2015)

  15. Gavrin, A., Watt, J.X., Marrs, K., Blake Jr., R.E.: Just-in-time teaching (JITT): using the web to enhance classroom learning. Comput. Educ. J. 14(2), 51–60 (2004)

    Google Scholar 

  16. Ge, M., Delgado-Battenfeld, C., Jannach, D.: Beyond accuracy: evaluating recommender systems by coverage and serendipity. In: Proceedings of the Fourth ACM Conference on Recommender Systems, ACM, pp. 257–260 (2010)

  17. Gladding, G., Gutmann, B., Schroeder, N., Stelzer, T.: Clinical study of student learning using mastery style versus immediate feedback online activities. Phys. Rev. ST Phys. Educ. Res. 11, 010114 (2015). https://doi.org/10.1103/PhysRevSTPER.11.010114

    Article  Google Scholar 

  18. Gönülateş, E., Kortemeyer, G.: Modeling unproductive behavior in online homework in terms of latent student traits: an approach based on item response theory. J. Sci. Educ. Technol. 26(2), 139–150 (2017)

    Article  Google Scholar 

  19. Gunawardana, A., Shani, G.: A survey of accuracy evaluation metrics of recommendation tasks. J. Mach. Learn. Res 10, 2935–2962 (2009)

    MathSciNet  MATH  Google Scholar 

  20. Han, J., Pei, J., Kamber, M.: Data Mining: Concepts and Techniques. Elsevier, Amsterdam (2011)

    MATH  Google Scholar 

  21. Hansen, C., Hansen, C., Hjuler, N., Alstrup, S., Lioma, C.: Sequence modelling for analysing student interaction with educational systems. In: Proceedings of the 10th International Conference on Educational Data Mining, EDM (2017)

  22. Herlocker, J.L., Konstan, J.A., Terveen, L.G., Riedl, J.T.: Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst. (TOIS) 22(1), 5–53 (2004)

    Article  Google Scholar 

  23. Iaquinta, L., De Gemmis, M., Lops, P., Semeraro, G., Filannino, M., Molino, P.: Introducing serendipity in a content-based recommender system. In: Hybrid Intelligent Systems, 2008. HIS’08. Eighth International Conference on, IEEE, pp. 168–173 (2008)

  24. Jyothi, N., Bhan, K., Mothukuri, U., Jain, S., Jain, D.: A recommender system assisting instructor in building learning path for personalized learning system. In: Technology for Education (T4E), 2012 IEEE Fourth International Conference On, IEEE, pp 228–230 (2012)

  25. Kashy, D.A., Albertelli, G., Kashy, E., Thoennessen, M.: Teaching with ALN technology: benefits and costs. J. Eng. Educ. 90(4), 499–505 (2001)

    Article  Google Scholar 

  26. Kettle, M.: Flipped physics. Phys. Educ. 48(5), 593 (2013)

    Article  Google Scholar 

  27. Khribi, M. K., Jemni, M., Nasraoui, O.: Automatic recommendations for e-learning personalization based on web usage mining techniques and information retrieval. In: Advanced Learning Technologies, 2008. ICALT’08. Eighth IEEE International Conference on, IEEE, pp 241–245 (2008)

  28. Klašnja-Milićević, A., Vesin, B., Ivanović, M., Budimac, Z., Jain, L. C.:Recommender systems in e-learning environments. In: E-Learning Systems, Springer, Berlin pp 51–75 (2017)

  29. Kortemeyer, G.: Gender differences in the use of an online homework system in an introductory physics course. Phys. Rev. Special Topics-Phys. Educ. Res. 5(1), 010107 (2009)

    Article  Google Scholar 

  30. Kortemeyer, G.: Extending item response theory to online homework. Phys. Rev. Special Topics-Phys. Educ. Res. 10(1), 010118 (2014)

    Article  Google Scholar 

  31. Kortemeyer, G.: An empirical study of the effect of granting multiple tries for online homework. Am. J. Phys. 83(7), 646–653 (2015)

    Article  Google Scholar 

  32. Kortemeyer, G.: Scalable continual quality control of formative assessment items in an educational digital library: an empirical study. Int. J. Digit. Libr. 17(2), 143–155 (2016a)

    Article  Google Scholar 

  33. Kortemeyer, G.: Work habits of students in traditional and online sections of an introductory physics course: a case study. J. Sci. Educ. Technol. 25(5), 697–703 (2016b)

    Article  Google Scholar 

  34. Kortemeyer, G.: Quick-and-dirty item response theory. Phys. Teacher 57, 608 (2019)

    Article  Google Scholar 

  35. Kortemeyer, G., Hall, M., Parker, J., Minaei-Bidgoli, B., Albertelli II, G., Bauer, W., Kashy, E.: Effective feedback to the instructor from online homework. J. Asynchronous Learn. Netw. 9(2), 19–28 (2005)

    Google Scholar 

  36. Kortemeyer, G., Kashy, E., Benenson, W., Bauer, W.: Experiences using the open-source learning content management and assessment system LON-CAPA in introductory physics courses. Am. J. Phys. 76, 438–444 (2008)

    Article  Google Scholar 

  37. Kortemeyer, G., Dröschler, S., Pritchard, D.E.: Harvesting latent and usage-based metadata in a course management system to enrich the underlying educational digital library. Int. J. Digit. Libr. 14(1–2), 1–15 (2014)

    Article  Google Scholar 

  38. Linden, G., Smith, B., York, J.: Amazon. com recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 7(1), 76–80 (2003)

    Article  Google Scholar 

  39. Lord, F.M., Novick, M.R. (eds.): Statistical Theories of Mental Test Scores. Addison-Wesley, Boston (1968)

    MATH  Google Scholar 

  40. Manouselis, N., Drachsler, H., Vuorikari, R., Hummel, H., Koper, R.: Recommender systems in technology enhanced learning. In: Recommender Systems Handbook, Springer, Berlin pp. 387–415 (2011)

  41. McMartin, F., Iverson, E., Wolf, A., Morrill, J., Morgan, G., Manduca, C.: The use of online digital resources and educational digital libraries in higher education. Int. J. Digit. Libr. 9(1), 65–79 (2008)

    Article  Google Scholar 

  42. Mestre, J., Hart, D.M., Rath, K.A., Dufresne, R.: The effect of web-based homework on test performance in large enrollment introductory physics courses. J. Comput. Math. Sci. Teach. 21(3), 229–251 (2002)

    Google Scholar 

  43. Minaei-Bidgoli, B., Punch, W. F.: Using genetic algorithms for data mining optimization in an educational web-based system. In: Genetic and Evolutionary Computation Conference, Springer, Berlin pp. 2252–2263 (2003)

  44. Minaei-Bidgoli, B., Kashy, D. A., Kortemeyer, G., Punch, W.F.:Predicting student performance: an application of data mining methods with an educational web-based system. In: Frontiers in Education, 2003. FIE 2003 33rd annual, IEEE, vol 1, pp T2A–13 (2003)

  45. Nicol, D.J., Macfarlane-Dick, D.: Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud. High. Educ. 31(2), 199–218 (2006)

    Article  Google Scholar 

  46. Perdian, D.C.: Early identification of student performance and effort using an online homework system: a pilot study. J. Sci. Educ. Technol. 22(5), 697–701 (2013)

    Article  Google Scholar 

  47. Pol, H.J., Harskamp, E.G., Suhre, C.J.M., Goedhart, M.J.: The effect of hints and model answers in a student-controlled problem-solving program for secondary physics education. J. Sci. Educ. Technol. 17(4), 410–425 (2008). https://doi.org/10.1007/s10956-008-9110-x

    Article  Google Scholar 

  48. Recker, M.M., Dorward, J., Nelson, L.M.: Discovery and use of online learning resources: case study findings. J. Educ. Technol. Soc. 7(2), 93 (2004)

    Google Scholar 

  49. Resnick, P., Varian, H.R.: Recommender systems. Commun. ACM 40(3), 56–58 (1997)

    Article  Google Scholar 

  50. Romero, C., Ventura, S.: Educational data mining: a survey from 1995 to 2005. Expert Syst. Appl. 33(1), 135–146 (2007)

    Article  Google Scholar 

  51. Sangwin, C., Harjula, M.: Online assessment of dimensional numerical answers using stack in science. Eur. J. Phys. 38(3), 035701 (2017)

    Article  Google Scholar 

  52. Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web, ACM, pp 285–295 (2001)

  53. Seaton, D. T., Bergner, Y., Pritchard, D. E.: Exploring the relationship between course structure and etext usage in blended and open online courses. In: Educational Data Mining 2013 (2013)

  54. Stelzer, T., Gladding, G., Mestre, J.P., Brookes, D.T.: Comparing the efficacy of multimedia modules with traditional textbooks for learning introductory physics content. Am. J. Phys. 77(2), 184–190 (2009)

    Article  Google Scholar 

  55. Stewart, J., DeVore, S., Stewart, G., Michaluk, L.: Behavioral self-regulation in a physics class. Phys. Rev. Phys. Educ. Res. 12(1), 010125 (2016)

    Article  Google Scholar 

  56. Verbert, K., Drachsler, H., Manouselis, N., Wolpers, M., Vuorikari, R., Duval, E.: Dataset-driven research for improving recommender systems for learning. In: Proceedings of the 1st International Conference on Learning Analytics and Knowledge, ACM, pp 44–53 (2011)

  57. Zaíane, O. R.:Building a recommender agent for e-learning systems. In: Computers in Education, 2002. Proceedings. International Conference on, IEEE, pp 55–59 (2002)

Download references

Author information

Authors and Affiliations

  1. Educational Development and Technology (LET), ETH Zurich, 8092, Zurich, Switzerland

    Gerd Kortemeyer

  2. Department of Computer Science, ETH Zurich, 8092, Zurich, Switzerland

    Stefan Dröschler

Authors
  1. Gerd Kortemeyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefan Dröschler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gerd Kortemeyer.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kortemeyer, G., Dröschler, S. A user-transaction-based recommendation strategy for an educational digital library. Int J Digit Libr 22, 147–157 (2021). https://doi.org/10.1007/s00799-021-00298-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-021-00298-8

Keywords

Search

Navigation