Abstract
As most real-world networks evolve over time, link prediction over such dynamic networks has become a challenging issue. Recent researches focus towards network embedding to improve the performance of link prediction task. Most of the network embedding methods are only applicable to static networks and therefore cannot capture the temporal variations of dynamic networks. In this work, we propose a time-aware network embedding method which generates node embeddings by capturing the temporal dynamics of evolving networks. Unlike existing works which use deep architectures, we design an evolving skip-gram architecture to create dynamic node embeddings. We use the node embedding similarities between consecutive snapshots to construct a univariate time series of node similarities. Further, we use times series forecasting using auto regressive integrated moving average (ARIMA) model to predict the future links. We conduct experiments using dynamic network snapshot datasets from various domains and demonstrate the advantages of our system compared to other state-of-the-art methods. We show that, combining network embedding with time series forecasting methods can be an efficient solution to improve the quality of link prediction in dynamic networks.
Similar content being viewed by others
References
Ahmed NM, Chen L, Wang Y, Li B, Li Y, Liu W (2018) DeepEye: link prediction in dynamic networks based on non-negative matrix factorization. Big Data Min Anal 1(1):19–33
Al Hasan M, Zaki MJ (2011) A survey of link prediction in social networks. In: Social network data analytics, Springer, pp 243–275
Belkin M, Niyogi P (2002) Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv Neural Inf Process Syst 14:585–591
Blonder B, Wey TW, Dornhaus A, James R, Sih A (2012) Temporal dynamics and network analysis. Methods Ecol Evol 3(6):958–972
Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, Springer, pp 177–186
Brockwell Peter J, Davis RA (2016) Introduction to time series and forecasting. Springer, Berlin
Cai H, Zheng Vincent W, Chang K (2018) A comprehensive survey of graph embedding: problems, techniques and applications. IEEE Trans Knowl Data Eng 30(9):1616–1637
Cao S, Lu W, Xu Q (2015) Grarep: learning graph representations with global structural information. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp 891–900
Casteigts A, Flocchini P, Quattrociocchi W, Santoro N (2012) Time-varying graphs and dynamic networks. Int J Parallel Emerg Distrib Syst 27(5):387–408
Chaintreau A, Hui P, Crowcroft J, Diot C, Gass R, Scott J (2007) Impact of human mobility on opportunistic forwarding algorithms. IEEE Trans Mobile Comput 6:606–620
Chang S, Han W, Tang J, Qi G-J, Aggarwal CC, Huang TS (2015) Heterogeneous network embedding via deep architectures. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 119–128
Chung F, Zhao W (2010) PageRank and random walks on graphs. In: Fete of combinatorics and computer science, Springer, pp 43–62
Dong Y, Chawla NV, Swami A (2017) metapath2vec: Scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 135–144
Fu T-y, Lee W-C, Lei Z (2017) HIN2Vec: explore meta-paths in heterogeneous information networks for representation learning. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 1797–1806
Gehrke J, Ginsparg P, Kleinberg J (2003) Overview of the 2003 KDD cup. Acm SIGKDD Explor Newslett 5(2):149–151
Goldberg Y, Levy O (2014) word2vec Explained: deriving Mikolov et al.’s negative-sampling word-embedding method. arXiv preprint arXiv:1402.3722
Goyal P, Ferrara E (2017) Graph embedding techniques, applications, and performance: a survey. Knowl-Based Syst 151:78–94
Goyal P, Kamra N, He X, Liu Y (2018) DynGEM: deep embedding method for dynamic graphs. arXiv preprint arXiv:1805.11273
Grover A, Leskovec J (2016) node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 855–864
Güneş İ, Gündüz-Öğüdücü Ş, Çataltepe Z (2016) Link prediction using time series of neighborhood-based node similarity scores. Data Min Knowl Discov 30(1):147–180
Gupta C, Jain A, Tayal DK, Castillo O (2018) ClusFuDE: forecasting low dimensional numerical data using an improved method based on automatic clustering, fuzzy relationships and differential evolution. Eng Appl Artif Intell 71:175–189
Jo H-H, Hiraoka T (2019) Bursty time series analysis for temporal networks. In: Temporal Network Theory, Springer, pp 161–179
Klimt B, Yang Y (2004) The enron corpus: a new dataset for email classification research. In: European conference on machine learning, Springer, pp 217–226
Li T, Jiawei Zhang SY, Philip YZ, Yan Y (2018) Deep dynamic network embedding for link prediction. IEEE Access 6:29219–29230
Liben-Nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inf Sci Technol 58(7):1019–1031
Liu Z, Zhang Q-M, Lü L, Zhou T (2011) Link prediction in complex networks: a local naïve Bayes model. EPL Europhys Lett 96(4):48007
Lü L, Zhou T (2011) Link prediction in complex networks: a survey. Phys A Stat Mech Appl 390(6):1150–1170
Ma X, Sun P, Qin G (2017) Nonnegative matrix factorization algorithms for link prediction in temporal networks using graph communicability. Pattern Recognit 71:361–374
Martínez V, Berzal F, Cubero J-C (2017) A survey of link prediction in complex networks. ACM Comput Surv 49(4):69
Michalski R, Palus S, Kazienko P (2011) Matching organizational structure and social network extracted from email communication. In: International conference on business information systems, Springer, pp 197–206
Mikolov T, Chen K, Corrado G, Dean J (2013a) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013b) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst 26:3111–3119
Morin F, Bengio Y (2005) Hierarchical probabilistic neural network language model. In: Aistats, vol 5, pp 246–252
Ou M, Cui P, Pei J, Zhang Z, Zhu W (2016) Asymmetric transitivity preserving graph embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1105–1114
Özcan A, Öğüdücü ŞG (2016) Temporal link prediction using time series of quasi-local node similarity measures. In: 2016 15th IEEE international conference on machine learning and applications (ICMLA), pp 381–386
Özcan A, Öğüdücü ŞG (2017) Supervised temporal link prediction using time series of similarity measures. In: 2017 Ninth international conference on ubiquitous and future networks (ICUFN), pp 519–521
Pan S, Jia W, Zhu X, Zhang C, Wang Y (2016) Tri-party deep network representation. Network 11(9):12
Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 701–710
Pons P, Latapy M (2005) Computing communities in large networks using random walks. In: International symposium on computer and information sciences, Springer, pp 284–293
Ribeiro LFR, Saverese PHP, Figueiredo DR (2017) struc2vec: Learning node representations from structural identity. In: Proceedings of the 23rd ACM sigkdd international conference on knowledge discovery and data mining, pp 385–394
Rossi RA, Zhou R, Ahmed NK (2017) Deep feature learning for graphs. arXiv preprint arXiv:1704.08829
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Soto J, Melin P, Castillo O (2018) A new approach for time series prediction using ensembles of IT2FNN models with optimization of fuzzy integrators. Int J Fuzzy Syst 20(3):701–728
Soto J, Castillo O, Melin P, Pedrycz W (2019) A new approach to multiple time series prediction using mimo fuzzy aggregation models with modular neural networks. Int J Fuzzy Syst 21(5):1629–1648
Spielman DA, Teng S-H (2004) Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In: Proceedings of the thirty-sixth annual ACM symposium on theory of computing, pp 81–90
Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1225–1234
Wu T, Cheng-Shang C, Wanjiun L (2018) Tracking network evolution and their applications in structural network analysis. IEEE Trans Netw Sci Eng 6(3):562–575
Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: IJCAI, pp 2111–2117
Yasami Y, Safaei F (2018) A novel multilayer model for missing link prediction and future link forecasting in dynamic complex networks. Phys A Stat Mech Appl 492:2166–2197
Zhou L, Yang Y, Ren X, Wu F, Zhuang Y (2018) Dynamic network embedding by modeling triadic closure process. In: Proceedings of the 32nd AAAI conference on artificial intelligence, pp 571–578
Zhu L, Guo D, Yin J, Steeg GV, Galstyan A (2016) Scalable temporal latent space inference for link prediction in dynamic social networks. IEEE Trans Knowl Data Eng 28(10):2765–2777
Zou Y, Donner RV, Marwan N, Donges JF, Kurths J (2019) Complex network approaches to nonlinear time series analysis. Phys Rep 787:1–97
Funding
Not applicable.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there are no known conflicts of interest associated with this work and there has been no significant financial support or funding for this work that could have influenced its outcome.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mohan, A., Pramod, K.V. Link prediction in dynamic networks using time-aware network embedding and time series forecasting. J Ambient Intell Human Comput 12, 1981–1993 (2021). https://doi.org/10.1007/s12652-020-02289-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-02289-0