Abstract
In recent years, deep artificial neural networks can have better forecasting performance than many other artificial neural networks. The long short-term memory (LSTM) is one of the deep artificial neural networks. There have been a few fuzzy time series forecasting model based on LSTM in the literature. However, LSTM has not been used in an intuitionistic fuzzy time series (IFTS) forecasting method until now. In this paper, determining the fuzzy relations is made by using the LSTM artificial neural network and so, a new intuitionistic fuzzy time series forecasting method based on LSTM is proposed. In the proposed method, obtaining the membership and non-membership values is performed by using intuitionistic fuzzy c-means. Then, the inputs of the LSTM are merged membership and non-membership values by a minimum operator. In this way, lagged crisp values are inputs of the long short-term memory. So, the proposed method is a high-order IFTS model. The architecture of the LSTM artificial neural network includes multiple inputs and a single output. The proposed method and some other methods in the literature are applied to the Giresun Temperature data and the Nikkei 225 stock exchange time series, and the forecasting performance of these methods is compared.
Similar content being viewed by others
References
Kadılar C (2005) Introduction to time series analysis with SPSS applications. Bizim Press, Turkey
Song Q, Chissom BS (1993a) Fuzzy time series and its models. Fuzzy Sets Syst 54(3):269–277
Song Q, Chissom BS (1993b) Forecasting enrollments with fuzzy time series. Fuzzy Sets Syst 54(1):1–9
Chen SM (1996) Forecasting enrollments based on fuzzy time-series. Fuzzy Sets Syst 81(3):311–319
Chen SM (2002) Forecasting enrollments based on high order fuzzy time series. Cybern Syst 33(1):1–16
Chen SM, Chen CD (2011) Handling forecasting problems based on high-order fuzzy logical relationships. Expert Syst Appl 38(4):3857–3864
Chen SM, Tanuwijaya K (2013) Fuzzy forecasting on high-order relationships and automatic clustering techniques. Expert Syst Appl 38(12):15425–15437
Kocak C (2013) First-order ARMA type fuzzy time series method based on fuzzy logic relation tables. Math Prob Eng 769125:12
Cheng SH, Chen SM, Jian WS (2016) Fuzzy time series forecasting based on fuzzy logical relationships and similarity measures. Inf Sci 327(C):272–287
Kocak C (2017) ARMA(p, q) type high order fuzzy time series forecast method based on fuzzy logic relations. Appl Soft Comput 58:92–103
Rumelhart DE (1986) Parallel distributed processing: Explorations in the microstructure of cognition. Learn Internal Represent Error Propagation 1:318–362
Shin Y, Ghosh J (1991) The pi-sigma network: An efficient higher-order neural network for pattern classification and function approximation. In: IJCNN-91-seattle international joint conference on neural networks IEEE. 1:13–18
Yolcu U, Egrioglu E, Aladag CH (2013) A new linear and nonlinear artificial neural network model for time series forecasting. Decis Support Syst 54(3):1340–2134
Aladag CH, Yolcu U, Egrioglu E (2014) Robust multilayer neural network based on median neuron model. Neural Comput Appl 24(3–4):945–956
Zhou T, Gao S, Wang J, Chu C, Todo Z (2016) Financial time series prediction using a dendritic neuron model. Knowl-Based Syst 105:214–224
Egrioglu E, Yolcu U, Bas E, Dalar AZ (2017) Median-Pi artificial neural network for forecasting. Neural Comput Appl 31(1):307–316
Bas E, Egrioglu E, Aladag CH, Yolcu U (2015) Fuzzy-time-series network used to forecast linear and nonlinear time series. Appl Intell 43(2):343–355
Aladag CH (2013) Using multiplicative neuron model to establish fuzzy logic relationships. Expert Syst Appl 40(3):850–853
Bas E, Grosan C, Egrioglu E, Yolcu U (2018) High order fuzzy time series method based on Pi-Sigma neural network. Eng Appl Artif Intell 72:350–356
Aladag CH, Basaran MA, Egrioglu E, Yolcu U, Uslu VR (2009) Forecasting in high order fuzzy time series by using neural networks to define fuzzy relations. Expert Syst Appl 36(3):4228–4231
Egrioglu E, Aladag U, Yolcu U, Uslu VR, Basaran MA (2009) A new approach based on artificial neural networks for high order multivariate fuzzy time series. Expert Syst Appl 36(7):10589–10594
Yu THK, Huarng KHA (2010) A neural network-based fuzzy time series model to improve forecasting. Expert Syst Appl 37(4):3366–3372
Kocak C (2015) A new high order fuzzy ARMA time series forecasting method by using neural networks to define fuzzy relations. Math Prob Eng 2015(3):1–14
Zheng KQ, Lei YJ, Wang R, Wang YF (2013a) Modeling and application of IFTS. Control Decis 28(10):1525–1530
Zheng KQ, Lei YJ, Wang R, Wang Y (2013b) Prediction of IFTS based on deterministic transition. J Appl Sci Electr Inf Eng 31(2):204–211
Chaira T (2011) A novel intuitionistic fuzzy C means clustering algorithm and its application to medical images. Appl Soft Comput 11(2):1711–1717
Zheng KQ, Lei YJ, Wang R, Xing YQ (2014) Method of long-term IFTS forecasting based on parameter adaptation. Syst Eng Electr 36(1):99–104
Zheng KQ, Lei YJ, Wang R, Yu XD (2014) Long-term intuitionistic fuzzy time series forecasting based on vector quantization. Jilin Daxue Xuebao (Gongxueban)/J Jilin Univ (Engineering and Technology Edition) 44(3): 795–800
Fan X, Wang Y, Zhang M (2020) Network traffic forecasting model based on long-term intuitionistic fuzzy time series. Inf Sci 506:131–147
Wang Y, Lei Y, Lei Y, Fan X (2006) Multi-factor high-order intuitionistic fuzzy time series forecasting model. J Syst Eng Electr 27(5):1054–1062
Fan X, Lei Y, Wang Y, Lu Y (2016) Long-term intuitionistic fuzzy time series forecasting model based on vector quantisation and curve similarity measure. IET Signal Proc 10(7):805–814
Kumar S, Gangwar SS (2015) Intuitionistic fuzzy time series: an approach for handling nondeterminism in time series forecasting. IEEE Trans Fuzzy Syst 24(6):1270–1281
Fan X, Lei Y, Wang Y (2017) Adaptive partition intuitionistic fuzzy time series forecasting model. J Syst Eng Electr 28(3):585–596
Abhishekh SSG, Singh SR (2018) A score function-based method of forecasting using intuitionistic fuzzy time series. New Math Nat Comput 14(1):91–111
Egrioglu E, Yolcu U, Bas E (2019) Intuitionistic high-order fuzzy time series forecasting method based on Pi-Sigma artificial neural networks trained by artificial bee colony. Granul Comput 4(4):639–654
Kim HG, Jang GJ, Oh YH, Choi HJ (2019) Speech and music pitch trajectory classification using recurrent neural networks for monaural speech segregation. J Supercomput pp 1–21
Sundermeyer M, Schlüter R, Ney H (2012) LSTM neural networks for language modeling. In Thirteenth Annual Conference of The International Speech Communication Association
Gao L, Guo Z, Zhang H, Xu X, Shen HT (2017) Video captioning with attention-based LSTM and semantic consistency. IEEE Trans Multimedia 19(9):2045–2055
Tan YH, Chan CS (2016) Phi-LSTM: a phrase-based hierarchical LSTM model for image captioning. Asian conference on computer vision. Springer, Cham, pp 101–117
Pei S, Qin H, Zhang Z, Yao L, Wang Y, Wang C et al (2019) Wind speed prediction method based on empirical wavelet transform and new cell update long short-term memory network. Energy Convers Manage 196:779–792
Ni L, Wang D, Singh VP, Wu J, Wang Y, Tao Y, Zhan J (2019) Streamflow and rainfall forecasting by two long short-term memory-based models. J Hydrol 583:124296
Zhou C, Fang Z, Xu X, Zhang X, Ding Y, Jiang X (2020) Using long short-term memory networks to predict energy consumption of air-conditioning systems. Sustain Cities Soc 55:102000
Zhang Y, Chu G, Shen D (2020) The role of investor attention in predicting stock prices: The long short-term memory networks perspective. Finance Research Letters. (In Press)
Huang Y, Gao Y, Gan Y, Ye M (2020) A new financial data forecasting model using genetic algorithm and long short-term memory network. Neurocomputing. (In Press)
Coelho IM, Coelho VN, Luz EJS, Ochi LS, Rios E (2017) A GPU deep learning metaheuristic based model for time series forecasting. Appl Energy 202:412–418
Kanarachos S, Christopoulos SRG, Chroneos A, Fitzpatrick ME (2017) Detecting anomalies in time series data via a deep learning algorithm combining wavelets, neural networks and Hilbert transform. Expert Syst Appl 85:292–304
Choi JY, Lee B (2018) Combining LSTM network ensemble via adaptive weighting for improved time series forecasting. Math Prob Eng 247017:8
Ni L, Li Y, Wang X, Zhan J, Yu J, Qi C (2019) Forecasting of forex time series data based on deep learning. Proc Comput Sci 147:647–652
Sagheer A, Kotb M (2019) Time series forecasting of petroleum production using deep LSTM recurrent networks. Neurocomputing 323:203–213
Cao J, Li Z, Li J (2019) Financial time series forecasting model based on CEEMDAN and LSTM. Phys A 519:127–139
Wang ZH, Horng GJ, Hsu TH, Aripriharta A, Jong G (2019) Heart sound signal recovery based on time series signal prediction using a recurrent neural network in the long short-term memory model. J Supercomput pp 1–18
Zhao K, Li L, Cai S, Sun R (2019) An optimized time series combined forecasting method based on neural networks. J Supercomput pp 1–27
Lee SI, Yoo SJ (2019) Multimodal deep learning for finance: integrating and forecasting international stock markets. J Supercomput pp 1–19
Yang CT, Chen YA, Chan YW, Lee CL, Tsan YT, Chan WC, Liu PY (2020). Influenza-like illness prediction using a long short-term memory deep learning model with multiple open data sources. J Supercomput pp 1–27
Tran N, Nguyen T, Nguyen BM, Nguyen G (2018) A multivariate fuzzy time series resource forecast model for clouds using LSTM and data correlation analysis. Proc Comput Sci 126:636–645
Sadaei HJ, Silva PCL, Guimaraes FG, Lee MH (2019) Short-term load forecasting by using a combined method of convolutional neural networks and fuzzy time series. Energy 175:365–377
Hochreiter S, Silva PCL, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kocak, C., Egrioglu, E. & Bas, E. A new deep intuitionistic fuzzy time series forecasting method based on long short-term memory. J Supercomput 77, 6178–6196 (2021). https://doi.org/10.1007/s11227-020-03503-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-020-03503-8