A Fuzzy Approach for Recommending Problems to Solve in Programming Online Judges

  • Raciel YeraEmail author
  • Yailé Caballero
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10632)


Programming online judges are e-learning tools usually used in programming practices for the automatic evaluation of source code developed by students, for solving programming problems. Specifically, they contain a large collection of such problems where the students, at their own personalized pace, have to select and try to solve. Therefore, the increasing of the number of problems makes difficult the selection of the right problem to solve according to the previous users performance, causing information overload and a widespread discouragement. The current contribution proposes a recommendation approach to mitigate this issue by suggesting problems to solve in programming online judges, through the use of fuzzy tools which manage the uncertainty related to this scenario. The proposal evaluation, using real data obtained from a programming online judge, shows that the new approach improves previous recommendation strategies which do not consider uncertainty management in the programming online judge scenarios.


Programming online judges Fuzzy logic Problems recommendation 


  1. 1.
    Castro, J., Yera, R., Martínez, L.: An empirical study of natural noise management in group recommendation systems. Decis. Support Syst. 94, 1–11 (2017)CrossRefGoogle Scholar
  2. 2.
    Gunawardana, A., Shani, G.: A survey of accuracy evaluation metrics of recommendation tasks. J. Mach. Learn. Res. 10, 2935–2962 (2009)MathSciNetzbMATHGoogle Scholar
  3. 3.
    Kurnia, A., Lim, A., Cheang, B.: Online judge. Comput. Educ. 36(4), 299–315 (2001)CrossRefGoogle Scholar
  4. 4.
    Leal, J.P. and Silva, F.: Mooshak: a web-based multi-site programming contest system. Softw.: Pract. Exp. 33(6), 567–581 (2003)Google Scholar
  5. 5.
    Llana, L., Martin-Martin, E., Pareja-Flores, C., Velázquez-Iturbide, J.: FLOP: a user-friendly system for automated program assessment. J. Univ. Comput. Sci. 20(9), 1304–1326 (2014)Google Scholar
  6. 6.
    Jie, L., Dianshuang, W., Mao, M., Wang, W., Zhang, G.: Recommender system application developments: a survey. Decis. Support Syst. 74, 12–32 (2015)CrossRefGoogle Scholar
  7. 7.
    Miranda, S., Orciuoli, F., Sampson, D.G.: A SKOS-based framework for subject ontologies to improve learning experiences. Comput. Hum. Behav. 61, 609–621 (2016)CrossRefGoogle Scholar
  8. 8.
    Polson, M.C., Richardson, J.J. Foundations of Intelligent Tutoring Systems. Psychology Press (2013)Google Scholar
  9. 9.
    Regueras, L.M., et al.: Effects of competitive e-learning tools on higher education students: a case study. IEEE Trans. Educ. 52(2), 279–285 (2009)CrossRefGoogle Scholar
  10. 10.
    Verdú, E., Regueras, L.M., Verdú, M.J., Leal, J.P., de Castro, J.P., Queirós, R.: A distributed system for learning programming on-line. Comput. Educ. 58(1), 1–10 (2012)CrossRefGoogle Scholar
  11. 11.
    Wang, G.P., Chen, S.Y., Yang, X., Feng, R.: OJPOT: online judge & practice oriented teaching idea in programming courses. Eur. J. Eng. Educ. 41(3), 304–319 (2016)CrossRefGoogle Scholar
  12. 12.
    Toledo, R.Y., Mota, Y.C.: An e-learning collaborative filtering approach to suggest problems to solve in programming online judges. Int. J. Distance Educ. Technol. 12(2), 51–65 (2014)CrossRefGoogle Scholar
  13. 13.
    Toledo, R.Y., Mota, Y.C., Borroto, M.G.: A regularity-based preprocessing method for collaborative recommender systems. J. Inf. Process. Syst. 9(3), 435–460 (2013)CrossRefGoogle Scholar
  14. 14.
    Yera, R., Martínez, L.: Fuzzy tools in recommender systems: a survey. Int. J. Comput. Intell. Syst. 10(1), 776–803 (2017)CrossRefGoogle Scholar
  15. 15.
    Yera, R., Martínez, L.: A recommendation approach for programming online judges supported by data preprocessing techniques. Appl. Intell. 47(2), 277–290 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.University of Ciego de ÁvilaCiego de ÁvilaCuba
  2. 2.University of CamagüeyCamagüeyCuba

Personalised recommendations