Link Prediction for Isolated Nodes in Heterogeneous Network by Topic-Based Co-clustering

  • Katsufumi TomobeEmail author
  • Masafumi Oyamada
  • Shinji Nakadai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10234)


This paper presents a new probabilistic generative model (PGM) that predicts links for isolated nodes in a heterogeneous network using textual data. In conventional PGMs, a link between two nodes is predicted on the basis of the nodes’ other existing links. This method makes it difficult to predict links for isolated nodes, which happens when new items are recommended. In this study, we first naturally expand the relational topic model (RTM) to a heterogeneous network (Hetero-RTM). However, this simple extension degrades performance in a link prediction for existing nodes. We present a new model called the Grouped Hetero-RTM that has both latent topics and latent clusterings. Through intensive experiments that simulate real recommendation problems, the Grouped Hetero-RTM outperforms baseline methods at predicting links for isolated nodes. This model, furthermore, performs as effectively as the stochastic block model in the link prediction for existing nodes. We also find that the Grouped Hetero-RTM is effective for various textual data such as item reviews and movie descriptions.


Relational model Topic model Link prediction Recommendation 



This work is supported in part by MEXT Grant-in-Aid for the Program for Leading Graduate Schools and Keio University Doctorate Student Grant-in-Aid Program.


  1. 1.
    Airoldi, E.M., Blei, D.M., Fienberg, S.E., Xing, E.P.: Mixed membership stochastic blockmodels. In: Advances in Neural Information Processing Systems, pp. 33–40 (2009)Google Scholar
  2. 2.
    Airoldi, E.M., Blei, D.M., Fienberg, S.E., Xing, E.P., Jaakkola, T.: Mixed membership stochastic block models for relational data with application to protein-protein interactions. In: Proceedings of the International Biometrics Society Annual Meeting, pp. 1–34 (2006)Google Scholar
  3. 3.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)zbMATHGoogle Scholar
  4. 4.
    Breese, J.S., Heckerman, D., Kadie, C.: Empirical analysis of predictive algorithms for collaborative filtering. In: Proceedings of 14th Conference Uncertainty in Artificial Intelligence (UAI 1998), pp. 43–52. Morgan Kaufmann Publishers Inc. (1998)Google Scholar
  5. 5.
    Cai, X., Bain, M., Krzywicki, A., Wobcke, W., Kim, Y.S., Compton, P., Mahidadia, A.: ProCF: probabilistic collaborative filtering for reciprocal recommendation. In: Pei, J., Tseng, V.S., Cao, L., Motoda, H., Xu, G. (eds.) PAKDD 2013. LNCS (LNAI), vol. 7819, pp. 1–12. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-37456-2_1 CrossRefGoogle Scholar
  6. 6.
    Chang, J., Blei, D.M.: Relational topic models for document networks. In: Proceedings of 12th International Conference on Artificial Intelligence and Statistics (AISTATS 2009), vol. 9, pp. 81–88 (2009)Google Scholar
  7. 7.
    Cohn, D., Hofmann, T.: The missing link - a probabilistic model of document content and hypertext connectivity. In: Advances in Neural Information Processing Systems, pp. 430–436 (2001)Google Scholar
  8. 8.
    Erosheva, E., Fienberg, S., Lafferty, J.: Mixed-membership models of scientific publications. Proc. Natl. Acad. Sci. 101(Suppl. 1), 5220–5227 (2004)CrossRefGoogle Scholar
  9. 9.
    Gori, M., Pucci, A., Roma, V., Siena, I.: ItemRank: a random-walk based scoring algorithm for recommender engines. IJCAI 7, 2766–2771 (2007)Google Scholar
  10. 10.
    Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. Natl. Acad. Sci. 101(Suppl. 1), 5228–5235 (2004)CrossRefGoogle Scholar
  11. 11.
    Herlocker, J.L., Konstan, J.A., Borchers, A., Riedl, J.: An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 230–237. ACM (1999)Google Scholar
  12. 12.
    Hofmann, T.: Probabilistic latent semantic analysis. In: Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence (UAI 1999), pp. 289–296. Morgan Kaufmann Publishers Inc. (1999)Google Scholar
  13. 13.
    Li, X., Chen, H.: Recommendation as link prediction in bipartite graphs: a graph kernel-based machine learning approach. Decis. Support Syst. 54(2), 880–890 (2013)CrossRefGoogle Scholar
  14. 14.
    Lü, L., Zhou, T.: Link prediction in complex networks: a survey. Physica A 390(6), 1150–1170 (2011)CrossRefGoogle Scholar
  15. 15.
    McAuley, J., Targett, C., Shi, Q., van den Hengel, A.: Image-based recommendations on styles and substitutes. In: Proceedings of the 38th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 43–52. ACM (2015)Google Scholar
  16. 16.
    Mikolov, T., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems (2013)Google Scholar
  17. 17.
    Nallapati, R., Cohen, W.W.: Link-PLSA-LDA: a new unsupervised model for topics and influence of blogs. In: ICWSM 2008 (2008)Google Scholar
  18. 18.
    Nallapati, R.M., Ahmed, A., Xing, E.P., Cohen, W.W.: Joint latent topic models for text and citations. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery Data Mining (ACM SIGKDD 2008), pp. 542–550. ACM (2008)Google Scholar
  19. 19.
    Nowicki, K., Snijders, T.A.B.: Estimation and prediction for stochastic blockstructures. J. Am. Stat. Assoc. 96(455), 1077–1087 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Ozsoy, M.G.: From word embeddings to item recommendation (2016). arXiv preprint: arXiv:1601.01356
  21. 21.
    Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: Proceedings of the 25th Neural Information Processing Systems (NIPS 2011), vol. 20, pp. 1–8 (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Katsufumi Tomobe
    • 1
    Email author
  • Masafumi Oyamada
    • 2
  • Shinji Nakadai
    • 2
  1. 1.Department of Mechanical EngineeringKeio UniversityKanagawaJapan
  2. 2.NEC CorporationKanagawaJapan

Personalised recommendations