Advertisement

A collaborative filtering recommendation algorithm based on information theory and bi-clustering

  • Mingyang Jiang
  • Zhifeng Zhang
  • Jingqing Jiang
  • Qinghu Wang
  • Zhili PeiEmail author
Machine Learning - Applications & Techniques in Cyber Intelligence
  • 8 Downloads

Abstract

Collaborative filtering is the most popular and efficient recommendation algorithm to character the potential preference of the new users, by exploring the patterns of historical consuming records/ratings of the investigated users. There are two types of primary collaborative filtering algorithms: the user-based recommendation system, which recommends items to new users by ranking the similarity of the shared items between the history users and the new users, and the item-based collaborative filtering recommend items to new users by considering the rank of the similarity among all the history items of the training data. Although the collaborative filtering has been successfully applied to many commercial fields, several original drawbacks of collaborative filtering, especially the sparsity of the rating data raises a serious challenge to the accuracy and the universality of those algorithms. In particular, the most rating terms for each specific user are missing in many applications, and the performance of collaborative filtering will be degraded along with the increment of the number of items in training dataset. In this paper, we proposed a novel collaborative filtering method (CBE-CF) to extract the local dense rating modules to cope with the data sparsity and the computational efficiency of the traditional recommendation algorithms, by introducing the information entropy and bi-clustering into collaborative filtering. Here, both the rows and columns of the user-item-rating matrix are clustered together to identify the dense rating modules of the historical records (training) data, and then an information entropy metric is used to quantify the similarity between the new user and each dense modules, and the final prediction is optimized by the aggregative recommendations of the global generalization of item-based methods and the local similarity of the nearest modules. Experimental analysis presents the characters of the proposed CBE-CF, and the precision and the computational cost, etc., are better than state of the art on the benchmark dataset.

Keywords

Collaborative filtering Information entropy Bi-clustering Recommendation system 

Notes

Acknowledgements

This work was supported by the National Natural Science Foundation of China (61672301, 61662057), Program for Young Talents of Science and Technology in Universities of Inner Mongolia Autonomous Region (NJYT-19-B18), Industry Innovation Talent Team of Inner Mongolia Grassland Talent Engineering (2017), the Science and Technology Innovation Guide Project of Inner Mongolia Autonomous Region (2016, 2017), Research on the Information of Mongolian Medicine Based on Machine Learning Algorithm (MDXK004), Opening Foundation of Inner Mongolia Autonomous Region Engineering Technology Research Center of personalized medicine (MDK2018010), the science research project of Inner Mongolia University for the Nationalities (NMDYB17136).

Compliance with ethical standards

Conflict of interest

No conflicts of interests.

References

  1. 1.
    Zhou Y, Wilkinson D, Schreiber R, Pan R (2008) Large-scale parallel collaborative filtering for the Netflix prize. In: Fleischer R, Xu J (eds) Algorithmic aspects in information and management. Springer, Berlin, pp 337–348.  https://doi.org/10.1007/978-3-540-68880-8_32 CrossRefGoogle Scholar
  2. 2.
    Ekstrand MD, Riedl JT, Konstan JA (2011) Collaborative filtering recommender systems. Found Trends Hum-Comput Interact 4(2):81–173.  https://doi.org/10.1561/1100000009 CrossRefGoogle Scholar
  3. 3.
    Barragáns-Martínez AB, Costa-Montenegro E, Burguillo JC, Rey-López M, Mikic-Fonte FA, Peleteiro A (2010) A hybrid content-based and item-based collaborative filtering approach to recommend TV programs enhanced with singular value decomposition. Inf Sci 180(22):4290–4311.  https://doi.org/10.1016/j.ins.2010.07.024 CrossRefGoogle Scholar
  4. 4.
    Breese JS, Heckerman D, Kadie C (2013) Empirical analysis of predictive algorithms for collaborative filtering. CoRR abs/1301.7363. arXiv: 1301.7363Google Scholar
  5. 5.
    Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp 285–295.  https://doi.org/10.1145/371920.372071
  6. 6.
    Xue G-R, Lin C, Yang Q, Xi W, Zeng H-J, Yu Y, Chen Z (2005) Scalable collaborative filtering using cluster-based smoothing. In: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, pp 114–121.  https://doi.org/10.1145/1076034.1076056
  7. 7.
    Schein AI, Popescul A, Ungar LH, Pennock DM (2002) Methods and metrics for cold-start recommendations. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval, pp 253–260.  https://doi.org/10.1145/564376.564421
  8. 8.
    Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inf Sci 178(1):37–51.  https://doi.org/10.1016/j.ins.2007.07.024 MathSciNetCrossRefGoogle Scholar
  9. 9.
    Castro PADd, Franca FOd, Ferreira HM, Zuben FJV (2007) Evaluating the performance of a biclustering algorithm applied to collaborative filtering—a comparative analysis. In: Proceedings of the 7th international conference on hybrid intelligent systems, pp 65–70.  https://doi.org/10.1109/his.2007.55
  10. 10.
    Symeonidis P, Nanopoulos A, Papadopoulos A, Manolopoulos Y (2007) Nearest-biclusters collaborative filtering with constant values. In: Proceedings of the 8th knowledge discovery on the web international conference on advances in web mining and web usage analysis, pp 36–55.  https://doi.org/10.1007/978-3-540-77485-3_3
  11. 11.
    Paterek A (2007) Improving regularized singular value decomposition for collaborative filtering. In: Proceedings of KDD cup and workshop, pp 5–8.  https://doi.org/10.1145/1557019.1557072
  12. 12.
    Zhang S, Wang W, Ford J, Makedon F, Pearlman J (2005) Using singular value decomposition approximation for collaborative filtering. In: Proceedings of the seventh IEEE international conference on E-commerce technology, pp 257–264.  https://doi.org/10.1109/icect.2005.102
  13. 13.
    Barragáns-Martínez AB, Costa-Montenegro E, Burguillo JC, Rey-López M, Mikic-Fonte FA, Peleteiro A (2010) A hybrid content-based and item-based collaborative filtering approach to recommend TV programs enhanced with singular value decomposition. Inf Sci 180(22):4290–4311.  https://doi.org/10.1016/j.ins.2010.07.024 CrossRefGoogle Scholar
  14. 14.
    Zhang S, Wang W, Ford J, Makedon F (2006) Learning from incomplete ratings using non-negative matrix factorization. In: Proceedings of the 2006 SIAM international conference on data mining, pp 549–553.  https://doi.org/10.1137/1.9781611972764.58
  15. 15.
    Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284.  https://doi.org/10.1109/TII.2014.2308433 CrossRefGoogle Scholar
  16. 16.
    Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl-Based Syst 97:188–202.  https://doi.org/10.1016/j.knosys.2015.12.018 CrossRefGoogle Scholar
  17. 17.
    Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell.  https://doi.org/10.1155/2009/421425 CrossRefGoogle Scholar
  18. 18.
    Li G, Li L (2012) A new algorithm for solving cold start problem of collaborative filtering system. J Shandong Univ (Engineering Edition) 42(02):11–17Google Scholar
  19. 19.
    Zhang ZK, Liu C, Zhang YC, Zhou T (2010) Solving the cold-start problem in recommender systems with social tags. EPL (Europhys Lett) 92(2):28002–28007.  https://doi.org/10.1209/0295-5075/92/28002 CrossRefGoogle Scholar
  20. 20.
    Deng XC, Jin C, Han QP (2013) Improved collaborative filtering modle based on context clustering and user ranking. Syst Eng Theory Pract 33:2945–2953Google Scholar
  21. 21.
    Jeong B, Lee J, Cho H (2009) User credit-based collaborative filtering. Expert Syst Appl 36(3):7309–7312.  https://doi.org/10.1016/j.eswa.2008.09.034 CrossRefGoogle Scholar
  22. 22.
    Anand D, Bharadwaj KK (2011) Utilizing various sparsity measures for enhancing accuracy of collaborative recommender systems based on local and global similarities. Expert Syst Appl 38(5):5101–5109.  https://doi.org/10.1016/j.eswa.2008.09.034 CrossRefGoogle Scholar
  23. 23.
    Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022.  https://doi.org/10.1162/jmlr.2003.3.4-5.993 CrossRefzbMATHGoogle Scholar
  24. 24.
    Hofmann T (2004) Latent semantic models for collaborative filtering. ACM Trans Inf Syst (TOIS) 22(1):89–115.  https://doi.org/10.1145/963770.963774 MathSciNetCrossRefGoogle Scholar
  25. 25.
    Cheng Y, Church GM (2000) Biclustering of expression data. In: Proceedings of the eighth international conference on intelligent systems for molecular biology, pp 93–103Google Scholar
  26. 26.
    Campbell J (1982) Grammatical man: information, entropy, language, and life. Simon and Schuster, New YorkGoogle Scholar
  27. 27.
    Kaleli C (2014) An entropy-based neighbor selection approach for collaborative filtering. Knowl-Based Syst 56:273–280.  https://doi.org/10.1016/j.knosys.2013.11.020 CrossRefGoogle Scholar
  28. 28.
    Karatzoglou A, Balázs H (2017) Deep learning for recommender systems. In: Proceedings of the eleventh ACM conference on recommender systems, pp 396–397.  https://doi.org/10.1145/3109859.3109933
  29. 29.
    Covington P, Adams J, Sargin E (2016) Deep neural networks for YouTube recommendations. In: Proceedings of the 10th ACM conference on recommender systems, pp 191–198.  https://doi.org/10.1145/2959100.2959190
  30. 30.
    Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1235–1244.  https://doi.org/10.1145/2783258.2783273

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Mingyang Jiang
    • 1
  • Zhifeng Zhang
    • 1
  • Jingqing Jiang
    • 1
  • Qinghu Wang
    • 1
  • Zhili Pei
    • 1
    Email author
  1. 1.College of Computer Science and TechnologyInner Mongolia University for NationalitiesTongliaoChina

Personalised recommendations