Link Prediction via Factorization Machines

  • Lile Li
  • Wei LiuEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11320)


Link prediction is the problem of predicting the existence of edges in a network. The link prediction problem is a fundamental research problem in graph mining and has numerous applications in social networks, bioinformatics, e-commerce, etc. A major challenge of link prediction problems is handling the fact that real-world networks are becoming extremely large. The large network size leads to huge sparsity in the network’s adjacency matrix which most existing link prediction methods (such as matrix factorization) rely on. Moreover, when networks become very large, there exists a non-trivial link imbalance problem where the numbers of known present and known absent links are significantly different. Such sparsity and imbalance issues significantly impact and decrease the performance of existing link prediction methods. To address these challenges, in this research we propose a Balanced Factorization Machine (BFM) which performs link predictions on very sparse network via learning interactions among nodes and edges of the network in a supervised learning setting. Through extensive experiments on real-world network data sets, we show that our BFM method significantly outperforms other existing link prediction methods.


  1. 1.
    Al Hasan, M., Chaoji, V., Salem, S., Zaki, M.: Link prediction using supervised learning. In: SDM06: Workshop on Link Analysis, Counter-Terrorism and Security (2006)Google Scholar
  2. 2.
    Barzel, B., Barabási, A.L.: Network link prediction by global silencing of indirect correlations. Nat. Biotechnol. 31(8), 720 (2013)CrossRefGoogle Scholar
  3. 3.
    Chen, B., Li, F., Chen, S., Hu, R., Chen, L.: Link prediction based on non-negative matrix factorization. PLoS ONE 12(8), e0182968 (2017)CrossRefGoogle Scholar
  4. 4.
    Cukierski, W., Hamner, B., Yang, B.: Graph-based features for supervised link prediction. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 1237–1244. IEEE (2011)Google Scholar
  5. 5.
    Ermiş, B., Acar, E., Cemgil, A.T.: Link prediction in heterogeneous data via generalized coupled tensor factorization. Data Min. Knowl. Discov. 29(1), 203–236 (2015)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Hashimoto, T., Sun, Y., Jaakkola, T.: From random walks to distances on unweighted graphs. In: Advances in Neural Information Processing Systems (NIPS), pp. 3429–3437 (2015)Google Scholar
  7. 7.
    Juan, Y., Zhuang, Y., Chin, W.S., Lin, C.J.: Field-aware factorization machines for CTR prediction. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp. 43–50. ACM (2016)Google Scholar
  8. 8.
    Kim, Y., Srivastava, J.: Impact of social influence in e-commerce decision making. In: Proceedings of the Ninth International Conference on Electronic Commerce, pp. 293–302. ACM (2007)Google Scholar
  9. 9.
    Liben-Nowell, D., Kleinberg, J.: The link-prediction problem for social networks. J. Assoc. Inf. Sci. Technol. 58(7), 1019–1031 (2007)CrossRefGoogle Scholar
  10. 10.
    Lichtenwalter, R.N., Lussier, J.T., Chawla, N.V.: New perspectives and methods in link prediction. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 243–252. ACM (2010)Google Scholar
  11. 11.
    Liu, J., Xu, B., Xu, X., Xin, T.: A link prediction algorithm based on label propagation. J. Comput. Sci. 16, 43–50 (2016)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Lu, Z., Savas, B., Tang, W., Dhillon, I.S.: Supervised link prediction using multiple sources. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), pp. 923–928. IEEE (2010)Google Scholar
  13. 13.
    Martínez, V., Berzal, F., Cubero, J.C.: A survey of link prediction in complex networks. ACM Comput. Surv. (CSUR) 49(4), 69 (2017)Google Scholar
  14. 14.
    Menon, A.K., Elkan, C.: Link prediction via matrix factorization. In: Gunopulos, D., Hofmann, T., Malerba, D., Vazirgiannis, M. (eds.) ECML PKDD 2011. LNCS (LNAI), vol. 6912, pp. 437–452. Springer, Heidelberg (2011). Scholar
  15. 15.
    Moody, J.: Peer influence groups: identifying dense clusters in large networks. Soc. Netw. 23(4), 261–283 (2001)CrossRefGoogle Scholar
  16. 16.
    Panzarasa, P., Opsahl, T., Carley, K.M.: Patterns and dynamics of users’ behavior and interaction: network analysis of an online community. J. Am. Soc. Inf. Sci. Technol. 60(5), 911–932 (2009)CrossRefGoogle Scholar
  17. 17.
    Rendle, S.: Factorization machines. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), pp. 995–1000. IEEE (2010)Google Scholar
  18. 18.
    Rendle, S., Gantner, Z., Freudenthaler, C., Schmidt-Thieme, L.: Fast context-aware recommendations with factorization machines. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 635–644. ACM (2011)Google Scholar
  19. 19.
    Roweis, S.: NIPS Conference Papers Vols 0-12.
  20. 20.
    Sarkar, P., Chakrabarti, D., Moore, A.W.: Theoretical justification of popular link prediction heuristics. In: International Joint Conference on Artificial Intelligence, vol. 22, p. 2722 (2011)Google Scholar
  21. 21.
    Tsuda, K., Noble, W.S.: Learning kernels from biological networks by maximizing entropy. Bioinformatics 20(Suppl. 1), i326–i333 (2004)CrossRefGoogle Scholar
  22. 22.
    Watts, D.J., Strogatz, S.H.: US Power Grid Network - KONECT, April 2017.
  23. 23.
    Yang, Y., Lichtenwalter, R.N., Chawla, N.V.: Evaluating link prediction methods. Knowl. Inf. Syst. 45(3), 751–782 (2015)CrossRefGoogle Scholar
  24. 24.
    Yin, H., Benson, A.R., Leskovec, J., Gleich, D.F.: Local higher-order graph clustering. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 555–564. ACM (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.School of Software, Faculty of Engineering and Information TechnologyUniversity of Technology SydneySydneyAustralia

Personalised recommendations