Abstract
The Spreading Process Classification (SPC) is a popular application of temporal graph classification. The aim of SPC is to classify different spreading patterns of information or pestilence within a community represented by discrete-time temporal graphs. Recently, a reservoir computing-based model named Dynamical Graph Echo State Network (DynGESN) has been proposed for processing temporal graphs with relatively high effectiveness and low computational costs. Inspired by DynGESN, we propose a novel reservoir computing-based model called the Grouped Dynamical Graph Echo State Network (GDGESN) for dealing with SPC tasks. In this model, a novel augmentation strategy named the snapshot merging strategy is designed for forming new snapshots by merging neighboring snapshots over time, and then multiple reservoir encoders are set for capturing spatiotemporal features from merged snapshots. After those, the logistic regression is adopted for decoding the sum-pooled embeddings into the classification results. Experimental results on six benchmark SPC datasets show that our proposed model has better classification performances than the DynGESN and several kernel-based models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, J., Wang, X., Xu, X.: Gc-lstm: graph convolution embedded lstm for dynamic link prediction. arXiv preprint arXiv:1812.04206 (2018)
Cho, K., Van Merriënboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches. arXiv preprint arXiv:1409.1259 (2014)
Gallicchio, C., Micheli, A., Pedrelli, L.: Deep reservoir computing: a critical experimental analysis. Neurocomputing 268, 87–99 (2017)
Gärtner, T., Flach, P., Wrobel, S.: Graph kernels for chemical informatics. In: Proceedings of the 16th International Conference on Neural Information Processing Systems, pp. 505–512. MIT Press (2003)
Guo, S., Lin, Y., Feng, N., Song, C., Wan, H.: Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 922–929 (2019)
Hearst, M.A., Dumais, S.T., Osuna, E., Platt, J., Scholkopf, B.: Support vector machines. IEEE Intell. Syst. Appl. 13(4), 18–28 (1998)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Jaeger, H.: Tutorial on training recurrent neural networks, covering bppt, rtrl, ekf and the “echo state network” approach (2002)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Li, M., Zhu, Z.: Spatial-temporal fusion graph neural networks for traffic flow forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 4189–4196 (2021)
Li, Z., Liu, Y., Tanaka, G.: Multi-reservoir echo state networks with hodrick-prescott filter for nonlinear time-series prediction. Appl. Soft Comput., 110021 (2023)
Li, Z., Tanaka, G.: Multi-reservoir echo state networks with sequence resampling for nonlinear time-series prediction. Neurocomputing 467, 115–129 (2022)
Lukoševičius, M.: A practical guide to applying echo state networks. In: Montavon, G., Orr, G.B., Müller, K.-R. (eds.) Neural Networks: Tricks of the Trade. LNCS, vol. 7700, pp. 659–686. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-35289-8_36
Micheli, A., Tortorella, D.: Discrete-time dynamic graph echo state networks. Neurocomputing 496, 85–95 (2022)
Nowzari, C., Preciado, V.M., Pappas, G.J.: Analysis and control of epidemics: a survey of spreading processes on complex networks. IEEE Control Syst. Mag. 36(1), 26–46 (2016)
Oettershagen, L., Kriege, N.M., Morris, C., Mutzel, P.: Temporal graph kernels for classifying dissemination processes. In: Proceedings of the 2020 SIAM International Conference on Data Mining, pp. 496–504. SIAM (2020)
Shervashidze, N., Schweitzer, P., Van Leeuwen, E.J., Mehlhorn, K., Borgwardt, K.M.: Weisfeiler-lehman graph kernels. J. Mach. Learn. Res. 12(9) (2011)
Tanaka, G., et al.: Recent advances in physical reservoir computing: a review. Neural Netw. 115, 100–123 (2019)
Tortorella, D., Micheli, A.: Dynamic graph echo state networks. arXiv preprint arXiv:2110.08565 (2021)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems 30 (2017)
Acknowledgements
We thank Bing Wang for valuable comments. This work was partly supported by JST CREST Grant Number JPMJCR19K2, Japan (ZL, FK, GT) and JSPS KAKENHI Grant Numbers 23H03464 (GT), 20H00596 (KF), and Moonshot R &D Grant No. JPMJMS2021(KF).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, Z., Fujiwara, K., Tanaka, G. (2024). Dynamical Graph Echo State Networks with Snapshot Merging for Spreading Process Classification. In: Luo, B., Cheng, L., Wu, ZG., Li, H., Li, C. (eds) Neural Information Processing. ICONIP 2023. Communications in Computer and Information Science, vol 1964. Springer, Singapore. https://doi.org/10.1007/978-981-99-8141-0_39
Download citation
DOI: https://doi.org/10.1007/978-981-99-8141-0_39
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8140-3
Online ISBN: 978-981-99-8141-0
eBook Packages: Computer ScienceComputer Science (R0)