Advertisement

Convolutional Neural Network-Based Collaborative Filtering for Recommendation Systems

  • Yat Hong LowEmail author
  • Wun-She Yap
  • Yee Kai Tee
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1015)

Abstract

Collaborative filtering based recommender systems that predict the user preference based on their past interactions have been adopted by many online services. Matrix factorization that projects users and items into a shared latent space is one of the popular collaborative filtering techniques. Recently, a general neural network-based collaborative filtering (NCF) framework, employing generalized matrix factorization and multi-layer perceptron models termed as neural matrix factorization (NeuMF), was proposed for recommendation. Meanwhile, convolutional neural network (CNN) is a variation of a multi-layer perceptron commonly used in computer vision. CNN is also normally used to model user profiles and item descriptions for recommendation. In this work, the CNN was used differently, that is, to model the interaction between user and item features directly in the recommendation systems. More specifically, a special case of NCF that employs matrix factorization and CNN was proposed. The model used general matrix factorization to model latent feature interactions using a linear kernel and the CNN to learn the interaction function from data using a non-linear kernel. Experiments conducted on a public dataset, Movielens, demonstrated that the proposed model was superior when compared to the published NCF framework such as NeuMF and other state-of-the-art methods.

Keywords

Recommender system Machine learning Convolutional Neural Network Collaborative filtering 

Notes

Acknowledgement

We gratefully acknowledge Jin Zhe for sharing his computing resource (i.e. the Titan Xp GPU donated by the NVIDIA Corporation) to support this research at the preliminary stage. This research was also supported by the Collaborative Agreement with NextLabs (Malaysia) Sdn Bhd (Project title: Advanced and Context-Aware Text/Media Analytics for Data Classification).

References

  1. 1.
    Internet Usage Statistics. http://www.internetworldstats.com/stats.htm. Accessed 20 Aug 2018
  2. 2.
    Chen, C., Schedl, M., Zamani, H.: RecSys Challenge 2018. https://recsys.acm.org/recsys18/challenge/. Accessed 20 Aug 2018
  3. 3.
    Bennet, J., Lanning, S.: The Netflix Prize. https://www.netflixprize.com. Accessed 20 Aug 2018
  4. 4.
    Hu, Y., Koren, Y., Volinsky, C.: Collaborative filtering for implicit feedback datasets. In: Eighth IEEE International Conference on Data Mining, Pisa, Italy, pp. 263–272 (2008)Google Scholar
  5. 5.
    Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)CrossRefGoogle Scholar
  6. 6.
    Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, USA, pp. 426–434, ACM (2008)Google Scholar
  7. 7.
    Rendle, S.: Factorization machines. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), Sydney, Australia, pp. 995–1000. IEEE (2010)Google Scholar
  8. 8.
    Wang, H., Wang, N., Yeung, D.Y.: Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, USA, pp. 1235–1244, ACM (2015)Google Scholar
  9. 9.
    He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.S.: Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, Perth, Australia, pp. 173–182. International World Wide Web Conferences Steering Committee (2017)Google Scholar
  10. 10.
    Salakhutdinov, R., Mnih, A., Hinton, G.: Restricted Boltzmann machines for collaborative filtering. In: Proceedings of the 24th International Conference on Machine Learning, New York, USA, pp. 791–798. ACM (2007)Google Scholar
  11. 11.
    Van den Oord, A., Dieleman, S., Schrauwen, B.: Deep content-based music recommendation. In: Advances in Neural Information Processing Systems, pp. 2643–2651 (2013)Google Scholar
  12. 12.
    Kim, D., Park, C., Oh, J., Lee, S., Yu, H.: Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM Conference on Recommender Systems, New York, USA, pp. 233–240. ACM (2016)Google Scholar
  13. 13.
    He, X., Zhang, H., Kan, M.Y., Chua, T.S.: Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, NY, USA, pp. 549–558. ACM (2016)Google Scholar
  14. 14.
    Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, Arlington, Virginia, USA, pp. 452–461. AUAI Press (2009)Google Scholar
  15. 15.
    Socher, R., Chen, D., Manning, C., Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: NIPS, pp. 926–934 (2013)Google Scholar
  16. 16.
    Herlocker, J.L., Konstan, J.A., Borchers, A., Riedl, J.: An algorithmic framework for performing collaborative filtering. In: ACM SIGIR Forum, New York, USA, pp. 227–234. ACM (2017)CrossRefGoogle Scholar
  17. 17.
    Sarwar, B., Karypis, G., Konstan, J., Reidl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the Tenth International Conference on World Wide Web, WWW 2001, New York, USA, pp. 285–295 (2001)Google Scholar
  18. 18.
    Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, pp. 1746–1751 (2014)Google Scholar
  19. 19.
    Glorot, X., Bordes, A., Bengio, Y.: Deep sparse rectifier neural networks. In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Florida, USA, pp. 315–323 (2011)Google Scholar
  20. 20.
    Kiefer, J., Wolfowitz, J.: Stochastic estimation of the maximum of a regression function. Ann. Math. Stat. 23(3), 462–466 (1952)MathSciNetCrossRefGoogle Scholar
  21. 21.
    MovieLens Dataset. https://grouplens.org/datasets/movielens/. Accessed 20 Aug 2018
  22. 22.
    Bayer, I., He, X., Kanagal, B., Rendle, S.: A generic coordinate descent framework for learning from implicit feedback. In: WWW, Perth, Australia, pp. 1341–1350. International World Wide Web Conferences Steering Committee (2017)Google Scholar
  23. 23.
    Wu, Y., DuBois, C., Zheng, A.X., Ester, M.: Collaborative denoising auto-encoders for top-n recommender systems. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, San Francisco, California, USA, pp. 153–162. ACM (2016)Google Scholar
  24. 24.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: International Conference on Learning Representations (ICLR), San Diego, USA, pp. 1–15 (2014)Google Scholar
  25. 25.
    Liu, Y., Wang, S., Khan, M.S., He, J.: A novel deep hybrid recommender system based on auto-encoder with neural collaborative filtering. Big Data Min. Anal. 1(3), 211–221 (2018)CrossRefGoogle Scholar
  26. 26.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Lee Kong Chian Faculty of Engineering and ScienceUniversiti Tunku Abdul RahmanPetaling JayaMalaysia

Personalised recommendations