Skip to main content
SpringerLink
Log in

An improved item-based collaborative filtering using a modified Bhattacharyya coefficient and user–user similarity as weight

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Item-based filtering technique is a collaborative filtering algorithm for recommendations. Correlation-based similarity measures such as cosine similarity, Pearson correlation, and its variants have inherent limitations on sparse datasets because items may not have enough ratings for predictions. In addition, traditional similarity measures mainly focus on the orientations of the rating vectors, not magnitude, and as a result two rating vectors with different magnitudes but oriented in the same direction, can be exactly similar. Another aspect is that on a set of items, similar users’ may have different rating pattern. In addition, to calculate the similarity between items, ratings of all co-rated users are considered; however, a judicious approach is to consider the similarity between users as a weight to find the similar neighbors of a target item. To mitigate these issues, a modified Bhattacharyya coefficient is proposed in this paper. The proposed similarity measure is used to calculate user–user similarity, which in turn is used as a weight in item-based collaborative filtering. The experimental analysis on the collected MovieLens datasets shows a significant improvement of item-based collaborative filtering, when user–user similarity calculated by the proposed modified similarity measure is used as a weight.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28

Similar content being viewed by others

References

  1. Zheng K, Yang Z, Zhang K, Chatzimisios P, Yang K, Xiang W (2016) Big data-driven optimization for mobile networks toward 5g. IEEE Netw 30:44–51

    Article  Google Scholar 

  2. Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intel 4(2–4):2

    Google Scholar 

  3. Singh PK, Pramanik PKD, Choudhury P (2018) A comparative study of different similarity metrics in highly sparse rating dataset, In: V. Balas, N. Sharma, A. Chakrabarti (Eds.), Data Management, Analytics and Innovation (vol. 2), Vol. 839 of Advances in Intelligent Systems and Computing, Springer, pp. 45–60. https://doi.org/10.1007/978-981-13-1274-8_4

  4. Li D, Miao C, Chu S, Mallen J, Yoshioka T, Srivastava P (2018) Stable Matrix Approximation for Top-N Recommendation on Implicit Feedback Data

  5. Jorge AM, Vinagre J, Domingues M, Gama J, Soares C, Matuszyk P, Spiliopoulou M (2017) Scalable Online Top-N Recommender Systems. Springer International Publishing, Berlin

    Book  Google Scholar 

  6. Schafer JB, Konstan J, Iedl J (1999) Recommender systems in e-commerce, In: Proceedings of the 1st ACM Conference on Electronic Commerce, ACM, pp. 158–166

  7. Singh PK, Pramanik PKD, Choudhury P (2019) Collaborative filtering in recommender systems: Technicalities, challenges, applications and research trends, In: G. Shrivastava, S. L. Peng, H. Bansal, K. Sharma, M. Sharma (Eds.), New Age Analytics: Transforming Internet, Apple Academic Press

  8. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms, In: Proceedings of the 10th International Conference on World Wide Web, ACM, pp. 285–295

  9. Kant S, Mahara T (2018) Merging user and item based collaborative filtering to alleviate data sparsity. Int J Syst Assurance Eng Manag 9(1):173–179

    Article  Google Scholar 

  10. Comparison of user-based and item-based collaborative filtering, https://medium.com/@www.bbb8510/comparison-of-user-based-and-item-based-collaborative-filtering-f58a1c8a3f1d, online; Accessed 30-April-2019

  11. Yang Z, Wu B, Zheng K, Wang X, Lei L (2016) A survey of collaborative filtering-based recommender systems for mobile internet applications. IEEE Access 4:3273–3287

    Article  Google Scholar 

  12. Boström P, Filipsson M (2017) Comparison of user based and item based collaborative filtering recommendation services

  13. Panda SK, Bhoi SK, Singh M (2020) A collaborative filtering recommendation algorithm based on normalization approach, J Ambient Intel Hum Comput 1–23

  14. Pal A, Parhi P, Aggarwal M (2017) An improved content based collaborative filtering algorithm for movie recommendations, In: Tenth International Conference on Contemporary Computing (IC3), IEEE, pp. 1–3

  15. Liu H, Hu Z, Mian AU, Tian H, Zhu X (2014) A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Syst 56:156–166

    Article  Google Scholar 

  16. Ghazarian S, Nematbakhsh MA (2015) Enhancing memory-based collaborative filtering for group recommender systems. Expert Syst Appl 42(7):3801–3812

    Article  Google Scholar 

  17. Li C, He K Cbmr: An optimized mapreduce for item-based collaborative filtering recommendation algorithm with empirical analysis, Concurrency and Computation: Practice and Experience 29(10)

  18. Vizine Pereira AL, Hruschka ER (2015) Simultaneous co-clustering and learning to address the cold start problem in recommender systems. Knowledge-Based Syst 82:11–19

    Article  Google Scholar 

  19. Shambour Q, Hourani M, Fraihat S An item-based multi-criteria collaborative filtering algorithm for personalized recommender systems, Int J Adv Computer Sci Appl, 7

  20. Karydi E, Margaritis KG (2012) Parallel implementation of the slope one algorithm for collaborative filtering, In: 16th Panhellenic Conference on Informatics, pp. 174–179

  21. Wang Z, Liu Y, Ma P (2014) A cuda-enabled parallel implementation of collaborative filtering. Procedia Comput Sci 30:66–74

    Article  Google Scholar 

  22. Karydi E, Margaritis K (2016) Parallel and distributed collaborative filtering: a survey. ACM Computing Surveys (CSUR) 49(2):1–41

    Article  Google Scholar 

  23. Sardianos C, Ballas Papadatos G, Varlamis I (2019) Optimizing parallel collaborative filtering approaches for improving recommendation systems performance. Information 10(5):155

    Article  Google Scholar 

  24. Li D, Chen C, Lv Q, Shang L, Zhao Y, Lu T, Gu N (2016) An algorithm for efficient privacy-preserving item-based collaborative filtering. Future Generat Comput Syst 55:311–320

    Article  Google Scholar 

  25. Bilge A, Kaleli C (2014) A multi-criteria item-based collaborative filtering framework, In: 11th International Joint Conference on Computer Science and Software Engineering, pp. 18–22

  26. Adomavicius G, Kwon Y (2007) New recommendation techniques for multicriteria rating systems. IEEE Intel Syst 22(3):48–55

    Article  Google Scholar 

  27. Choi K, Suh Y (2013) A new similarity function for selecting neighbors for each target item in collaborative filtering. Knowledge-Based Syst 37:146–153

    Article  Google Scholar 

  28. Bobadilla J, Hernando A, Ortega F, Gutiérrez A (2012) Collaborative filtering based on significances. Inf Sci 185(1):1–17

    Article  Google Scholar 

  29. Ricci F, Rokach L, Shapira B, Kantor PB (2010) Recommender Systems Handbook, 1st edn. Springer-Verlag, New York Inc

    MATH  Google Scholar 

  30. Patra BK, Launonen R, Ollikainen V, Nandi S (2015) A new similarity measure using bhattacharyya coefficient for collaborative filtering in sparse data. Knowledge-Based Systems 82:163–177

    Article  Google Scholar 

  31. Su H, Wang C, Zhu Y, Yan B, Zheng H (2014) Parallel collaborative filtering recommendation model based on expand-vector, in: International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), pp. 1–6

  32. Tan Z, He L (2017) An efficient similarity measure for user-based collaborative filtering recommender systems inspired by the physical resonance principle, IEEE Access PP 1–1

  33. Singh PK, Sinha M, Das S, Choudhury P (2020) Enhancing recommendation accuracy of item-based collaborative filtering using bhattacharyya coefficient and most similar item, Applied Intelligence 1–24

  34. Goudail F, Réfrégier P, Delyon G (2004) Bhattacharyya distance as a contrast parameter for statistical processing of noisy optical images. J Opt Soc Am A 21(7):1231–1240. https://doi.org/10.1364/JOSAA.21.001231

    Article  Google Scholar 

  35. Toussaint G (1972) Comments on “the divergence and bhattacharyya distance measures in signal selection.“. IEEE Trans Commun 20(3):485–485

    Article  Google Scholar 

  36. Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inf Sci 178(1):37–51

    Article  Google Scholar 

  37. Sun H-F, Chen J-L, Yu G, Liu C-C, Peng Y, Chen G, Cheng B (2012) Jacuod: a new similarity measurement for collaborative filtering. J Computer Sci Technol 27(6):1252–1260

    Article  Google Scholar 

  38. Wang W, Lu J, Zhang G (2014) A new similarity measure-based collaborative filtering approach for recommender systems, In: Foundations of Intelligent Systems, Springer, pp. 443–452

  39. Gazdar A, Hidri L (2020) A new similarity measure for collaborative filtering based recommender systems. Knowledge-Based Syst 188:105058

    Article  Google Scholar 

  40. Margaris D, Spiliotopoulos D, Karagiorgos G, Vassilakis C (2020) An algorithm for density enrichment of sparse collaborative filtering datasets using robust predictions as derived ratings. Algorithms 13(7):174

    Article  Google Scholar 

  41. Iftikhar A, Ghazanfar MA, Ayub M, Mehmood Z, Maqsood M (2020) An improved product recommendation method for collaborative filtering. IEEE Access 8:123841–123857

    Article  Google Scholar 

  42. Boratto L, Carta S, Fenu G (2017) Investigating the role of the rating prediction task in granularity-based group recommender systems and big data scenarios. Inf Sci 378:424–443

    Article  Google Scholar 

  43. Koohi H, Kiani K (2017) A new method to find neighbor users that improves the performance of collaborative filtering. Expert Syst Appl 83:30–39

    Article  Google Scholar 

  44. Liu Y, Feng, Lu J (2017) Collaborative filtering algorithm based on rating distance, In: Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication, ACM, pp. 66: 1–66:7

  45. Aggarwal CC (2016) Neighborhood-based collaborative filtering. Springer, Berlin

    Book  Google Scholar 

  46. Singh PK, Setta S, Pramanik PKD, Choudhury P (2019) Improving the accuracy of collaborative filtering based recommendations by considering the temporal variance of top-n neighbors, In: Proceedings of the International Conference on Innovative Computing and Communication (ICICC-2019), Ostrava, Czech Republic

  47. Singh PK, Pramanik PKD, Debnath NC, Choudhury P (2019) A novel neighborhood calculation method by assessing users’ varying preferences in collaborative filtering, In: Proceedings of the 34th International Conference on Computers and Their Applications (CATA 2019), no. 58 in EPiC Series in Computing, Honolulu, Hawaii, pp. 345–355. https://doi.org/10.29007/3xfj

  48. Singh PK, Pramanik PKD, Choudhury P (2019) An improved similarity calculation method for collaborative filtering-based recommendation, considering the liking and disliking of categorical attributes of items. J Inf Optim Sci 40(2):397–412. https://doi.org/10.1080/02522667.20191580881

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering and Application, GLA University, Mathura, Uttar Pradesh, India

    Pradeep Kumar Singh

  2. Department of Computer Science and Engineering, National Institute of Technology, Durgapur, West Bengal, India

    Shreyashee Sinha & Prasenjit Choudhury

Authors
  1. Pradeep Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shreyashee Sinha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Prasenjit Choudhury
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pradeep Kumar Singh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, P.K., Sinha, S. & Choudhury, P. An improved item-based collaborative filtering using a modified Bhattacharyya coefficient and user–user similarity as weight. Knowl Inf Syst 64, 665–701 (2022). https://doi.org/10.1007/s10115-021-01651-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-021-01651-8

Keywords

Search

Navigation