Abstract
Long Short-Term Memory (LSTM) neural network is widely used to deal with various temporal modelling problems, including financial Time Series Forecasting (TSF) task. However, accurate forecasting of financial time series remains a difficult problem due to its implicit complex information and lack of labeled training data. To alleviate the limitation of overfitting caused by insufficient clean data, a new approach using LSTM based on transfer learning is proposed in our study for financial TSF task, termed as ADA-LSTM for short. Concretely, we not only implement a typical Adversarial Domain Adaptation architecture, but also tactfully introduce a smoothed formulation of Dynamic Time Warping (soft-DTW) in adversarial training phase to measure the shape loss during the transfer of sequence knowledge. Compared to many existing methods of selecting potential source domain during transfer learning in TSF, in our study, appropriate source dataset is selected from a novel perspective using temporal causal discovery method via transfer entropy instead of using statistical similarity across different time series. The feasibility and effectiveness of ADA-LSTM are validated by the empirical experiments conducting on different financial datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sezer, O.B., Gudelek, U., Ozbayoglu, M.: Financial time series forecasting with deep learning: a systematic literature review: 2005–2019. Appl. Soft Comput. 90, 106181 (2020)
Mohan, B.H.: Krishna: a review of two decades of deep learning hybrids for financial time series prediction. Int. J. Emerging Technol. 10(1), 324–331 (2019)
Tan, C., Sun, F., Kong, T., et al.: A Survey on Deep Transfer Learning. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING (ICANN). PT III, 270–279 (2018)
Pan, S.J., Qiang, Y.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Jiang, J., Shu, Y., Wang, J., et al.: Transferability in Deep Learning: A Survey. arXiv:2201.05867 (2022)
Amaral, T., Silva, L.M., Alexandre, L.A., Kandaswamy, C., de Sá, J.M., Santos, J.M.: Transfer learning using rotated image data to improve deep neural network performance. In: Campilho, A., Kamel, M. (eds.) ICIAR 2014. LNCS, vol. 8814, pp. 290–300. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11758-4_32
Vu, N.T., Imseng, D., Povey, D., et al.: Multilingual deep neural network based acoustic modelling for rapid language adaptation. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7639–7643. IEEE(2014). https://doi.org/10.1109/ICASSP.2014.6855086
Ye, R., Dai, Q.: A novel transfer learning framework for time series forecasting. Knowl.-Based Syst. 156(sep.15), 74–99 (2018)
Gu, Q., Dai, Q., Yu, H., et al.: Integrating multi-source transfer learning, active learning and metric learning paradigms for time series prediction. Appl. Soft Comput. 109(3), 107583- (2021)
Gu, Q., Dai, Q.: A novel active multi-source transfer learning algorithm for time series forecasting. Appl. Intell. 51(2), 1–25 (2021)
Ye, R., Dai, Q.: Implementing transfer learning across different datasets for time series forecasting. Pattern Recogn. 109, 107617 (2020)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Zhang, Y., Yan, B., Aasma, M.: A novel deep learning framework: prediction and analysis of financial time series using CEEMD and LSTM. Expert Systems with Applications. 113609 (2020)
Niu, T., Wang, J., Lu, H., et al.: Developing a deep learning framework with two-stage feature selection for multivariate financial time series forecasting. Expert Syst. Appl. 148, 113237 (2020)
Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85(2), 461–464 (2000)
Ganin, Y., Ustinova, E., Ajakan, H., et al.: Domain-adversarial training of neural networks. J. Mach. Learn. Res. 17(1), 2096–2030 (2016)
Smola, A., Gretton, A., Le, S., et al.: A hilbert space embedding for distributions. Discovery Sci. 4754, 13–31 (2007)
Cuturi, M., Blondel, M.: Soft-DTW: a differentiable loss function for time-series. In: International Conference on Machine Learning, pp. 894–903 (2017)
Mariano, D.R.S.: Comparing predictive accuracy. J. Bus. Econ. Stat. 20(1), 134–144 (2002)
Acknowledgments
This work was supported by the National Natural Science Foundation of China (71971089, 72001083) and Natural Science Foundation of Guangdong Province (No. 2022A1515011612)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lin, R., Zhang, D., Ling, L., Huang, J., Cai, G. (2023). Transfer Learning Based Long Short-Term Memory Network for Financial Time Series Forecasting. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Communications in Computer and Information Science, vol 1793. Springer, Singapore. https://doi.org/10.1007/978-981-99-1645-0_1
Download citation
DOI: https://doi.org/10.1007/978-981-99-1645-0_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-1644-3
Online ISBN: 978-981-99-1645-0
eBook Packages: Computer ScienceComputer Science (R0)