Skip to main content
Log in

Merging user and item based collaborative filtering to alleviate data sparsity

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

Memory based algorithms, generally referred as similarity based Collaborative Filtering (CF) algorithm, is one of the most widely accepted approaches to provide service recommendations. It provides personalized and automated suggestions to customers to select variety of products. Memory based algorithms mainly have two kinds of algorithms: User-based and Item-based algorithms. The User-based CF algorithm recommends items by finding similar users. Contrary to User-based CF, an Item-based CF algorithm recommends items by finding similar items. The core of memory based CF technologies is to calculate similarity among users or items. However, due to inherent sparsity, a large number of entries (ratings) in user-item rating matrix are missing. This results in only few available ratings to make prediction for the unknown ratings. This results in poor prediction quality of the CF algorithm. In this paper a hybrid approach is presented that combines user-based CF and item-based CF. It also leverage the biclustering technique to reduce the dimensionality. The biclustering helps to cluster all users/items into several groups. These clusters are then used to measure users/items similarities based on their respective parent groups. To obtain individual prediction, it adopts the user-based and item-based CF schemes based on the computed similarity respectively. Finally it combines the resultant predictions of each model to make final predictions. Interestingly, experiments demonstrated that the proposed approach outperforms the traditional user-based, item-based and some state of the art recommendation approaches in terms of accuracy of prediction and quality of recommendations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alqadah F, Reddy CK, Hu J, Alqadah HF (2015) Biclustering neighborhood-based collaborative filtering method for top-n recommender systems. Knowl Inf Syst 44(2):475–491. doi:10.1007/s10115-014-0771-x

    Article  Google Scholar 

  • Birtolo C, Ronca D (2013) Advances in clustering collaborative filtering by means of fuzzy C-means and trust. Expert Syst Appl 40(17):6997–7009. doi:10.1016/j.eswa.2013.06.022

    Article  Google Scholar 

  • Birtolo C, Ronca D, Armenise R, Ascione M (2011) Personalized suggestions by means of collaborative filtering: a comparison of two different model-based techniques. In Nature and biologically inspired computing (NaBIC), 2011 third world Congress on IEEE, pp 444–450. doi:10.1109/NaBIC.2011.6089628.

  • Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl-Based Syst 46:109–132. doi:10.1016/j.knosys.2013.03.012

    Article  Google Scholar 

  • Cacheda F, Carneiro V, Fernández D, Formoso V (2011) Comparison of collaborative filtering algorithms. ACM Trans Web 5(1):1–33. doi:10.1145/1921591.1921593

    Article  Google Scholar 

  • Chen MH, Teng CH, Chang PC (2015) Applying artificial immune systems to collaborative filtering for movie recommendation. Adv Eng Inform 29(4):830–839. doi:10.1016/j.aei.2015.04.005

    Article  Google Scholar 

  • Funk S (2006) Netflix update: try this at home (December 2006). http://sifter.org/simon/journal/20061211.html

  • Gedikli F, Bagdat F, Ge M, Jannach D (2011) RF-REC: fast and accurate computation of recommendations based on rating frequencies. In: Proceedings of 13th IEEE international conference on commerce and enterprise computing, CEC, pp 50–57. doi:10.1109/CEC.2011.24

  • George T, Merugu S (2005) A scalable collaborative filtering framework based on co-clustering. Proc-IEEE Int Conf Data Min ICDM. doi:10.1109/ICDM.2005.14

    Google Scholar 

  • Gori M, Pucci A (2002) ItemRank: a random-walk based scoring algorithm for recommender engines. In: Proceedings of the international joint conference on artificial intelligence, pp 2766–2771

  • Huang C, Yin J (2010) Effective association clusters filtering to cold-start recommendations. In: Proceedings—2010 7th international conference on fuzzy systems and knowledge discovery, FSKD 2010 5 (Fskd), pp 2461–2464. doi:10.1109/FSKD.2010.5569294

  • Jannach D, Karakaya Z, Gedikli F (2012) Accuracy improvements for multi-criteria recommender systems. Ec 1(212):674–689. doi:10.1145/2229012.2229065

    Google Scholar 

  • Jiang XM, Wen GS, Wei GF (2006) Optimizing collaborative filtering by interpolating the individual and group behaviors. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 3841 LNCS, pp 568–578. doi:10.1007/11610113_50

  • Kant S, Ansari IA (2015) An improved K means clustering with Atkinson index to classify liver patient dataset. Int J Syst Assur Eng Manag. doi:10.1007/s13198-015-0365-3

    Google Scholar 

  • Koren Y (2010) Factor in the neighbors: factor in the neighbors: scalable and accurate collaborative filtering. ACM Trans Knowl Discov Data 4(1):1–24. doi:10.1145/1644873.1644874

    Article  MathSciNet  Google Scholar 

  • Koutrika G, Benjamin B, Hector G-M (2009) FlexRecs: expressing and combining flexible recommendations. In: Proceedings of the 35th SIGMOD international conference on management of data, pp 745–58. doi:10.1145/1559845.1559923

  • Liang C, Leng Y (2014) Collaborative filtering based on information-theoretic co-clustering. Int J Syst Sci 45(3):589–597. doi:10.1080/00207721.2012.724109

    Article  MATH  Google Scholar 

  • Liu Q, Chen E, Xiong H, Ding CHQ, Chen J (2012) Enhancing collaborative filtering by user interest expansion via personalized ranking. IEEE Trans Syst Man Cybern B Cybern 42(1):218–233. doi:10.1109/TSMCB.2011.2163711

    Article  Google Scholar 

  • Murali TM, Kasif S (2003) Extracting conserved gene expression motifs from gene expression data. Pac Symp Biocomput 88:77–88. doi:10.1142/9789812776303_0008

    MATH  Google Scholar 

  • O’Connor M, Herlocker J (2001) Clustering Items for collaborative filtering. In: SIGIR 2001, workshop on recommender systems

  • Resnick P, Neophytos I, Mitesh S, Peter B, John R (1994) “GroupLens: an open architecture for collaborative filtering of netnews. In: Proceedings of the 1994 ACM conference on computer supported cooperative work, pp 175–86. doi:10.1145/192844.192905

  • Sarwar B, George K, Joseph K, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp 285–295. ACM. doi:10.1145/371920.372071

  • Sarwar BM , Karypis G, Konstan J, Riedl J (2002) Recommender systems for large-scale e-commerce: scalable neighborhood formation using clustering. Communications 50(12):158–167

    Google Scholar 

  • Symeonidis P, Nanopoulos A, Papadopoulos AN, Manolopoulos Y (2008) Nearest-biclusters collaborative filtering based on constant and coherent values. Inf Retrieval 11(1):51–75. doi:10.1007/s10791-007-9038-4

    Article  Google Scholar 

  • Vizine P, Andre L, Eduardo RH (2015) Simultaneous co-clustering and learning to address the cold start problem in recommender systems. Knowl-Based Syst 82:11–19. doi:10.1016/j.knosys.2015.02.016

    Article  Google Scholar 

  • Xue G-R, Chenxi L, Qiang Y, WenSi X, Hua-Jun Z, Yong Y, Zheng C (2005) Scalable collaborative filtering using cluster-based smoothing. In: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval—SIGIR’05, p 114. doi:10.1145/1076034.1076056

  • Töscher A, Graz A, Legenstein R (2008) Improved neighborhood-based algorithms for large-scale recommender systems

  • Zhang CX, Zhang ZK, Lu Y, Liu C, Liu H, Yan XY (2014a) Information filtering via collaborative user clustering modeling. Phys A 396:195–203. doi:10.1016/j.physa.2013.11.024

    Article  Google Scholar 

  • Zhang D, Hsu C-H, Chen M, Chen Q, Xiong N, Lloret J (2014b) Cold-start recommendation using biclustering and fusion for large-scale social recommender systems. IEEE Trans Emerg Topics Comput 2(2):239–250. doi:10.1109/TETC.2013.2283233

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Surya Kant.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kant, S., Mahara, T. Merging user and item based collaborative filtering to alleviate data sparsity. Int J Syst Assur Eng Manag 9, 173–179 (2018). https://doi.org/10.1007/s13198-016-0500-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-016-0500-9

Keywords

Navigation