Abstract
Multivariate time series forecasting is an important topic in various disciplines. Many deep learning architectures have been proposed for accurate multivariate forecasting. However, most existing models fail to learn the dependencies between different time series. Lately, studies have shown that implementations of Graph Neural Networks in the field of Natural Language, Computer Vision, and Time Series have achieved exceptional performance. In this paper, we propose an attention-based Multivariate Dependency Learning Graph Neural Network, which aims to better learn the dependencies among variables of a multivariate dataset. The attention scores corresponding to each variable complement the construction process of the graph adjacency matrix to model the spatial dependencies. Our experiments on benchmark datasets show that the proposed architecture improves accuracy on different benchmark datasets compared with the state-of-the-art baseline models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abu-El-Haija, S., et al.: Mixhop: higher-order graph convolutional architectures via sparsified neighborhood mixing. In: ICML. PMLR (2019)
Fan, C., et al.: Multi-horizon time series forecasting with temporal attention learning. In: Proceedings of the 25th ACM SIGKDD, pp. 2527–2535 (2019)
Guo, T., Lin, T., Antulov-Fantulin, N.: Exploring interpretable LSTM neural networks over multi-variable data 97, 2494–2504 (2019)
Huang, S., Wang, D., Wu, X., Tang, A.: Dsanet: dual self-attention network for multivariate time series forecasting. In: ACM CIKM, pp. 2129–2132 (2019)
Klicpera, J., Bojchevski, A., Guunnemann, S.: Combining neural networks with personalized pagerank for classification on graphs. In: ICLR (2019)
Lai, G., Chang, W.C., Yang, Y., Liu, H.: Modeling long and short-term temporal patterns with deep neural networks. In: ACM SIGIR, pp. 95–104 (2018)
Lim, B., Arik, S.O., Loeff, N., Pfister, T.: Temporal fusion transformers for interpretable multi-horizon time series forecasting (2019)
Sen, R., Yu, H.F., Dhillon, I.S.: Think globally, act locally: a deep neural network approach to high-dimensional time series forecasting. In: NeurIPS 32 (2019)
Shih, S.Y., Sun, F.K., Lee, H.Y.: Temporal pattern attention for multivariate time series forecasting. 108(8–9), 1421–1441 (2019)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems 30, pp. 5998–6008. Curran Associates, Inc. (2017)
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Yu, P.S.: A comprehensive survey on graph neural networks. IEEE TNNLS, pp. 1–21 (2020)
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., Zhang, C.: Connecting the dots: multivariate time series forecasting with graph neural networks. In: Proceedings of the 26th ACM SIGKDD (2020)
Yan, S., Xiong, Y., Lin, D.: Spatial temporal graph convolutional networks for skeleton-based action recognition. In: AAAI, pp. 7444–7452 (2018)
Zhang, G.P.: Time series forecasting using a hybrid arima and neural network model. Neurocomputing 50, 159–175 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Patel, A., Sriramulu, A., Bergmeir, C., Fourrier, N. (2021). Dependency Learning Graph Neural Network for Multivariate Forecasting. In: Mantoro, T., Lee, M., Ayu, M.A., Wong, K.W., Hidayanto, A.N. (eds) Neural Information Processing. ICONIP 2021. Communications in Computer and Information Science, vol 1516. Springer, Cham. https://doi.org/10.1007/978-3-030-92307-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-92307-5_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92306-8
Online ISBN: 978-3-030-92307-5
eBook Packages: Computer ScienceComputer Science (R0)