Tag2Vec: Tag Embedding for Top-N Recommendation

  • Ming HeEmail author
  • Kaisheng Yao
  • Peng Yang
  • Yuan Yao
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1075)


It is already well known that recommender systems usually suffer from data sparsity issue of user-item interactions. However, representation learning can efficiently measure correlations between objects, which presents an unprecedented opportunity to alleviate this issue. In this paper, we propose a new distributional vector space model, Tag2Vec, for capturing meaningful relationships of users and items to improve the performance of recommender systems. First, we represent users and items as vectors respectively using tag embedding. With this innovative representation, the semantic relationships between users and items can be captured. To be specific, tag2vec learns representations of users and items in low-dimensional space from user-tag-item interactions using the skip-gram model. Second, we measure similarity between both users and items, and collaborative filtering can then be performed in the learned embedding space. To evaluate the performance of Tag2Vec, we conduct extensive experiments with two real world datasets for Top-N recommendation tasks. The results demonstrate that our proposed method significantly outperforms existing approaches.


Recommendation systems Representation learning Collaborative filtering 



The work is supported by the Beijing Natural Science Foundation (No. 4192008) and the Beijing Municipal Education Commission (No. KM201710005023).


  1. 1.
    Katarya, R., Verma, O.P.: Privacy-preserving and secure recommender system enhance with K-NN and social tagging. In: 2017 IEEE 4th International Conference on Cyber Security and Cloud Computing (CSCloud), pp. 52–57. IEEE (2017).
  2. 2.
    Yu, H., Li, J.: Algorithm to solve the cold-start problem in new item recommendations. J. Softw. 26(6), 1395–1408 (2015). Scholar
  3. 3.
    Mistry, O., Sen, S.: Tag recommendation for social bookmarking: probabilistic approaches. Multiagent Grid Syst. 8(2), 143–163 (2012). Scholar
  4. 4.
    Yoshua, B., Aaron, C., Pascal, V.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013). Scholar
  5. 5.
    Ortega, F., Hernando, A., Bobadilla, J., Kang, J.H.: Recommending items to group of users using matrix factorization based collaborative filtering. Inf. Sci. 345(C), 313–324 (2016). Scholar
  6. 6.
    Lin, J., Sugiyama, K., Kan, M.Y., Chua, T.S.: Addressing cold-start in app recommendation: latent user models constructed from twitter followers (2013).
  7. 7.
    Georgiev, K., Nakov, P.: A non-IID framework for collaborative filtering with restricted boltzmann machines. In: Proceedings of the 30th International Conference on International Conference on Machine Learning - vol. 28, ICML 2013, pp. III–1148–III–1156. (2013).
  8. 8.
    Salakhutdinov, R., Mnih, A., Hinton, G.E.: Restricted Boltzmann machines for collaborative filtering. In: International Conference on Machine Learning (2007).
  9. 9.
    Saveski, M., Mantrach, A.: Item cold-start recommendations: learning local collective embeddings (2014).
  10. 10.
    He, X., Kan, M.Y., Xie, P., Xiao, C.: Comment-based multi-view clustering of web 2.0 items. In: International Conference on World Wide Web (2014).
  11. 11.
    Costa, F., Dolog, P.: Hybrid learning model with barzilai-borwein optimization for context-aware recommendations. In: Proceedings of the Thirty-First International Florida Artificial Intelligence Research Society Conference, FLAIRS 2018, Melbourne, Florida, USA. May 21–23 2018, pp. 456–461 (2018).

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Beijing University of TechnologyBeijingChina
  2. 2.Beijing University of Chinese MedicineBeijingChina

Personalised recommendations