Skip to main content
SpringerLink
Log in

DeepNNMF:deep nonlinear non-negative matrix factorization to address sparsity problem of collaborative recommender system

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

A recommender system (RS) is a data filtering technique that suggests the appropriate information to the end-user. Collaborative filtering is the most frequently deployed algorithm in this domain, which analyzes the users’ past behavior and recommends the products to an intended user based on correlation score. However, this technique often faces data sparsity problems. We propose a deep nonlinear non-negative matrix factorization (DNNMF) technique to address the above problem. First, we impose non-negative constraints in the embedding layer to generate non-negative vectors. Then pass them to the deep neural networks (DNN) to extract the nonlinear interactions between the users and products. The latent features and parameters are simultaneously updated using Adam optimizer. Experimental outcomes on MovieLens 100K and 1M datasets signify that the proposed model improves MAE by 3.2% and RMSE by 5.8% than the best benchmark techniques. Also, from the sparsity analysis, it is observed that the proposed model handles the sparsity issue of CF.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://keras.io/.

References

  1. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on world wide web, pp 285–295

  2. Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Int Comput 7(1):76–80

    Article  Google Scholar 

  3. Behera G, Nain N (2022) Trade-off between memory and model-based collaborative filtering recommender system. In: Proceedings of the international conference on paradigms of communication, computing and data sciences. Springer, pp 137–146

  4. Behera G, Nain N (2021) Collaborative recommender system (CRS) using optimized SGD-ALS. In: International conference on advances in computing and data sciences. Springer, pp 627–637

  5. Cron A, Zhang L, Agarwal D (2014) Collaborative filtering for massive multinomial data. J Appl Stat 41(4):701–715

    Article  MathSciNet  MATH  Google Scholar 

  6. Mavridis A (2017) Matrix factorization techniques for recommender systems

  7. Behera G, Nain N (2022) Handling data sparsity via item metadata embedding into deep collaborative recommender system. J King Saud Univ Comput Inf Sci

  8. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37

    Article  Google Scholar 

  9. Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. In: 2008 eighth IEEE international conference on data mining. IEEE, pp 263–272

  10. Núñez-Valdéz ER, Lovelle JMC, Martínez OS, García-Díaz V, De Pablos PO, Marín CEM (2012) Implicit feedback techniques on recommender systems applied to electronic books. Comput Hum Behav 28(4):1186–1193

    Article  Google Scholar 

  11. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434

  12. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618

  13. Mnih A, Teh Y (2012) Learning label trees for probabilistic modelling of implicit feedback. Adv Neural Inf Process Syst 25:2816–2824

    Google Scholar 

  14. He R, McAuley J (2016) VBPR: visual Bayesian personalized ranking from implicit feedback. In: Proceedings of the AAAI conference on artificial intelligence, vol 30

  15. Yang H, Lozano A (2015) Multi-relational learning via hierarchical nonparametric Bayesian collective matrix factorization. J Appl Stat 42(5):1133–1147

    Article  MathSciNet  MATH  Google Scholar 

  16. Salakhutdinov R, Mnih A, Hinton G (2007) Restricted Boltzmann machines for collaborative filtering. In: Proceedings of the 24th international conference on machine learning, pp 791–798

  17. Li S, Kawale J, Fu Y (2015) Deep collaborative filtering via marginalized denoising auto-encoder. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp 811–820

  18. Sedhain S, Menon AK, Sanner S, Xie L (2015) Autorec: autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on world wide web, pp 111–112

  19. Strub F, Mary J (2015) Collaborative filtering with stacked denoising autoencoders and sparse inputs. In: NIPS workshop on machine learning for eCommerce

  20. Wu Y, DuBois C, Zheng AX, Ester M (2016) Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the ninth ACM international conference on web search and data mining, pp 153–162

  21. He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182

  22. Aghdam MH, Analoui M, Kabiri P (2012) Application of nonnegative matrix factorization in recommender systems. In: 6th international symposium on telecommunications (IST). IEEE, pp 873–876

  23. Kurucz M, Benczúr AA, Csalogány K (2007) Methods for large scale SVD with missing values. In: Proceedings of KDD cup and workshop, vol 12. Citeseer, pp 31–38

  24. Jia Y, Liu H, Hou J, Kwong S (2020) Semisupervised adaptive symmetric non-negative matrix factorization. IEEE Trans Cybern 51(5):2550–2562

    Article  Google Scholar 

  25. Luo X, Liu Z, Shang M, Lou J, Zhou M (2020) Highly-accurate community detection via pointwise mutual information-incorporated symmetric non-negative matrix factorization. IEEE Trans Netw Sci Eng 8(1):463–476

    Article  MathSciNet  Google Scholar 

  26. Gündüz N, Fokoué E (2021) Understanding students’ evaluations of professors using non-negative matrix factorization. J Appl Stat 48(13–15):2961–2981

    Article  MathSciNet  MATH  Google Scholar 

  27. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791

    Article  MATH  Google Scholar 

  28. Zhang D, Zhou Z-H, Chen S (2006) Non-negative matrix factorization on kernels. In: Pacific rim international conference on artificial intelligence. Springer, pp 404–412

  29. Buciu I, Nikolaidis N, Pitas I (2008) Nonnegative matrix factorization in polynomial feature space. IEEE Trans Neural Netw 19(6):1090–1100

    Article  Google Scholar 

  30. Liu X, Aggarwal C, Li Y-F, Kong X, Sun X, Sathe S (2016) Kernelized matrix factorization for collaborative filtering. In: Proceedings of the 2016 SIAM international conference on data mining. SIAM, pp 378–386

  31. Jena KK, Bhoi SK, Mallick C, Jena SR, Kumar R, Long HV, Son NTK (2022) Neural model based collaborative filtering for movie recommendation system. Int J Inf Technol 1–11

  32. Si S, Chiang K-Y, Hsieh C-J, Rao N, Dhillon IS (2016) Goal-directed inductive matrix completion. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1165–1174

  33. Alameda-Pineda X, Ricci E, Yan Y, Sebe N (2016) Recognizing emotions from abstract paintings using non-linear matrix completion. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5240–5248

  34. Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284

    Article  Google Scholar 

  35. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507

    Article  MathSciNet  MATH  Google Scholar 

  36. Choudhury SS, Mohanty SN, Jagadev AK (2021) Multimodal trust based recommender system with machine learning approaches for movie recommendation. Int J Inf Technol 13(2):475–482

    Google Scholar 

  37. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980

  38. Zhou J, Wei W, Zhang R, Zheng Z (2021) Damped newton stochastic gradient descent method for neural networks training. Mathematics 9(13):1533

    Article  Google Scholar 

  39. Steeb W-H, Shi TK (1997) Matrix calculus and Kronecker product with applications and C++ programs. World Scientific, Singapore, pp 55–106

    Book  Google Scholar 

  40. Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Transa Interact Intell Syst (TIIS) 5(4):1–19

    Google Scholar 

  41. Aljunid MF, Dh M (2020) An efficient deep learning approach for collaborative filtering recommender system. Procedia Comput Sci 171:829–836

    Article  Google Scholar 

  42. Kumar P, Thakur RS (2018) Recommendation system techniques and related issues: a survey. Int J Inf Technol 10(4):495–501

    Google Scholar 

  43. Sohail SS, Siddiqui J, Ali R (2019) A comprehensive approach for the evaluation of recommender systems using implicit feedback. Int J Inf Technol 11(3):549–567

    Google Scholar 

Download references

Acknowledgements

We thanks CSE Department of MNIT jaipur for providing the resource to utilize.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Malaviya National Institute of Technology, Jaipur, India

    Gopal Behera & Neeta Nain

Authors
  1. Gopal Behera
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neeta Nain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gopal Behera.

Ethics declarations

Conflict of interest

No potential conflict of interest was reported by the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Behera, G., Nain, N. DeepNNMF:deep nonlinear non-negative matrix factorization to address sparsity problem of collaborative recommender system. Int. j. inf. tecnol. 14, 3637–3645 (2022). https://doi.org/10.1007/s41870-022-00982-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-022-00982-1

Keywords

Search

Navigation