Addressing Item-Cold Start Problem in Recommendation Systems Using Model Based Approach and Deep Learning

  • Ivica Obadić
  • Gjorgji MadjarovEmail author
  • Ivica Dimitrovski
  • Dejan Gjorgjevikj
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 778)


Traditional recommendation systems rely on past usage data in order to generate new recommendations. Those approaches fail to generate sensible recommendations for new users and items into the system due to missing information about their past interactions. In this paper, we propose a solution for successfully addressing item-cold start problem which uses model-based approach and recent advances in deep learning. In particular, we use latent factor model for recommendation, and predict the latent factors from item’s descriptions using convolutional neural network when they cannot be obtained from usage data. Latent factors obtained by applying matrix factorization to the available usage data are used as ground truth to train the convolutional neural network. To create latent factor representations for the new items, the convolutional neural network uses their textual description. The results from the experiments reveal that the proposed approach significantly outperforms several baseline estimators.



We would like to acknowledge the support of the European Commission through the project MAESTRA Learning from Massive, Incompletely annotated, and Structured Data (Grant number ICT-2013-612944). Also, this work was partially financed by the Faculty of Computer Science and Engineering at the Ss. Cyril and Methodius University.


  1. 1.
    Rajaraman, A., Ullman, J.D.: Mining of Massive Datasets. Cambridge University Press, New York (2011)CrossRefGoogle Scholar
  2. 2.
    Ricci, F., Rokach, L., Shapira, B., Kantor, P.B.: Recommender Systems Handbook, 1st edn. Springer, New York (2010)zbMATHGoogle Scholar
  3. 3.
    Segaran, T.: Programming Collective Intelligence, 1st edn. O’Reilly (2007)Google Scholar
  4. 4.
    Bell, R.M., Koren, Y.: Scalable collaborative filtering with jointly derived neighborhood interpolation weights. In: Proceedings of the Seventh International Conference on Data Mining, ICDM 2007, Washington, DC, USA, pp. 43–52. IEEE Computer Society (2007)Google Scholar
  5. 5.
    Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2008, New York, NY, USA, pp. 426–434. ACM (2008)Google Scholar
  6. 6.
    Koren, Y.: Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2009, New York, NY, USA, pp. 447–456. ACM (2009)Google Scholar
  7. 7.
    Oord, A.V.D., Dieleman, S., Schrauwen, B.: Deep content-based music recommendation. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS 2013, USA, pp. 2643–2651. Curran Associates Inc. (2013)Google Scholar
  8. 8.
    Bennett, J., Lanning, S., Netflix, N.: The netflix prize. In: KDD Cup and Workshop in Conjunction with KDD (2007)Google Scholar
  9. 9.
    Bernardi, L., Kamps, J., Kiseleva, J., Müller, M.J.I.: The continuous cold start problem in e-commerce recommender systems. CoRR, vol. abs/1508.01177 (2015)Google Scholar
  10. 10.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates Inc. (2012)Google Scholar
  11. 11.
    Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)zbMATHGoogle Scholar
  12. 12.
    Kalchbrenner, N., Grefenstette, E., Blunsom, P.: A convolutional neural network for modelling sentences. CoRR, vol. abs/1404.2188 (2014)Google Scholar
  13. 13.
    Kim, Y.: Convolutional neural networks for sentence classification. CoRR, vol. abs/1408.5882 (2014)Google Scholar
  14. 14.
    Stojanovski, D., Strezoski, G., Madjarov, G., Dimitrovski, I.: Twitter sentiment analysis using deep convolutional neural network. In: Onieva, E., Santos, I., Osaba, E., Quintián, H., Corchado, E. (eds.) HAIS 2015. LNCS, vol. 9121, pp. 726–737. Springer, Cham (2015). doi: 10.1007/978-3-319-19644-2_60 CrossRefGoogle Scholar
  15. 15.
    Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation (2014)Google Scholar
  16. 16.
    Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Fürnkranz, J., Joachims, T. (eds.) Proceedings of the 27th International Conference on Machine Learning, ICML-2010, pp. 807–814. Omnipress (2010)Google Scholar
  17. 17.
    Cormode, G., Muthukrishnan, S.: The string edit distance matching problem with moves. ACM Trans. Algorithms (TALG) 3(1), 2 (2007)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Ivica Obadić
    • 1
  • Gjorgji Madjarov
    • 1
    Email author
  • Ivica Dimitrovski
    • 1
  • Dejan Gjorgjevikj
    • 1
  1. 1.Faculty of Computer Science and EngineeringSs. Cyril and Methodius UniversitySkopjeMacedonia

Personalised recommendations