Skip to main content

Advertisement

SpringerLink
Log in

The two-stage machine learning ensemble models for stock price prediction by combining mode decomposition, extreme learning machine and improved harmony search algorithm

  • S.I.: Data-Driven OR in Transportation and Logistics
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

As stock data is characterized by highly noisy and non-stationary, stock price prediction is regarded as a knotty problem. In this paper, we propose new two-stage ensemble models by combining empirical mode decomposition (EMD) (or variational mode decomposition (VMD)), extreme learning machine (ELM) and improved harmony search (IHS) algorithm for stock price prediction, which are respectively named EMD–ELM–IHS and VMD–ELM–IHS. Furthermore, to demonstrate the efficiency and performance of the proposed models, the results were compared with those obtained by other methods, including EMD based ELM (EMD–ELM), VMD based ELM (VMD–ELM), autoregressive integrated moving average (ARIMA), ELM, multi-layer perception (MLP), support vector regression (SVR), and long short-term memory (LSTM) models. The results show that the proposed models have superior performance in terms of its accuracy and stability as compared to the other models. Also, we find that the sizes of sliding window and training set have a significant impact on the predictive performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  • Abu Doush, I., Al-Betar, M. A., Awadallah, M. A., Santos, E., Hammouri, A. I., Mafarjeh, M., et al. (2019). Flow shop scheduling with blocking using modified harmony search algorithm with neighboring heuristics methods. Applied Soft Computing, 85, 105861.

    Google Scholar 

  • Alatas, B. (2010). Chaotic harmony search algorithms. Applied Mathematics & Computation, 216(9), 2687–2699.

    Google Scholar 

  • Alia, O. M., & Mandava, R. (2011). The variants of the harmony search algorithm: An overview. Artificial Intelligence Review, 36, 49–68.

    Google Scholar 

  • Ané, T., & Ureche-Rangau, L. (2006). Stock market dynamics in a regime-switching asymmetric power GARCH model. International Review of Financial Analysis, 15(2), 109–129.

    Google Scholar 

  • Asl, A. A., & Manaman, N. S. (2018). Locating magnetic sources by empirical mode decomposition. Journal of Applied Geophysics, 159, 329–340.

    Google Scholar 

  • Assad, A., & Deep, K. (2018). A hybrid harmony search and simulated annealing algorithm for continuous optimization. Information Sciences, 450, 246–266.

    Google Scholar 

  • Bagheri, A., Ozbulut, O. E., & Harris, D. K. (2018). Structural system identification based on variational mode decomposition. Journal of Sound and Vibration, 417, 182–197.

    Google Scholar 

  • Baldini, G., Steri, G., Giuliani, R., & Dimc, F. (2019). Radiometric identification using variational mode decomposition. Computers & Electrical Engineering, 76, 364–378.

    Google Scholar 

  • Bisoi, R., Dash, P., & Parida, A. (2019). Hybrid Variational Mode Decomposition and evolutionary robust kernel extreme learning machine for stock price and movement prediction on daily basis. Applied Soft Computing, 74, 652–678.

    Google Scholar 

  • Boryczka, U., & Szwarc, K. (2019). The harmony search algorithm with additional improvement of harmony memory for asymmetric traveling salesman problem. Expert Systems with Applications, 122, 43–53.

    Google Scholar 

  • Burlando, P., Rosso, R., Cadavid, L. G., & Salas, J. D. (1993). Forecasting of short-term rainfall using ARMA models. Journal of Hydrology, 144(1), 193–211.

    Google Scholar 

  • Cao, J., Zhao, Y., Lai, X., Ong, M. E. H., Yin, C., Koh, Z. X., et al. (2015). Landmark recognition with sparse representation classification and extreme learning machine. Journal of the Franklin Institute, 352(10), 4528–4545.

    Google Scholar 

  • Chen, Z., Chen, W., & Shi, Y. (2020). Ensemble learning with label proportions for bankruptcy prediction. Expert Systems with Applications, 146, 113155.

    Google Scholar 

  • Contreras, J., Espinola, R., Nogales, F. J., & Conejo, A. J. (2003). ARIMA models to predict next-day electricity prices. IEEE Transactions on Power Systems, 18(3), 1014–1020.

    Google Scholar 

  • Dash, R., Dash, P., & Bisoi, R. (2014). A self adaptive differential harmony search based optimized extreme learning machine for financial time series prediction. Swarm and Evolutionary Computation, 19, 25–42.

    Google Scholar 

  • Dragomiretskiy, K., & Zosso, D. (2014). Variational mode decomposition. IEEE Transactions on Signal Processing, 62(3), 531–544.

    Google Scholar 

  • Efendi, R., Arbaiy, N., & Deris, M. M. (2018). A new procedure in stock market forecasting based on fuzzy random auto-regression time series model. Information Sciences, 441, 113–132.

    Google Scholar 

  • El-Abd, M. (2013). An improved global-best harmony search algorithm. Applied Mathematics and Computation, 222, 94–106.

    Google Scholar 

  • Fischer, T., & Krauss, C. (2018). Deep learning with long short-term memory networks for financial market predictions. European Journal of Operational Research, 270(2), 654–669.

    Google Scholar 

  • Geem, Z. W. (2000). Optimal design of water distribution networks using harmony search. Ph.D. thesis, Korea University.

  • Girish, G. (2016). Spot electricity price forecasting in Indian electricity market using autoregressive-GARCH models. Energy Strategy Reviews, 11–12, 52–57.

    Google Scholar 

  • Hosni, M., Idri, A., Nassif, A., & Abran, A. (2016). Heterogeneous ensembles for software development effort estimation. In 2016 3rd international conference on soft computing & machine intelligence (ISCMI) (pp. 174–178). https://doi.org/10.1109/ISCMI.2016.15.

  • Huang, G., Zhu, Q., & Siew, C. (2006). Extreme learning machine: Theory and applications designs. Neurocomputing, 70(1), 489–501.

    Google Scholar 

  • Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2004). Extreme learning machine: A new learning scheme of feedforward neural networks. In 2004 IEEE international joint conference on neural networks (IEEE Cat. No.04CH37541) (Vol. 2, pp. 985–990).

  • Huang, G., Huang, G. B., Song, S., & You, K. (2015). Trends in extreme learning machines: A review. Neural Networks, 61, 32–48.

    Google Scholar 

  • Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., et al. (1998). The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings: Mathematical, Physical and Engineering Sciences, 454(1971), 903–995.

    Google Scholar 

  • Jawadi, F., Chlibi, S., & Cheffou, A. I. (2019). Computing stock price comovements with a three-regime panel smooth transition error correction model. Annals of Operations Research, 274, 331–345.

    Google Scholar 

  • Jianwei, E., Bao, Y., & Ye, J. (2017). Crude oil price analysis and forecasting based on variational mode decomposition and independent component analysis. Physica A: Statistical Mechanics and its Applications, 484, 412–427.

    Google Scholar 

  • Keshtegar, B., Ozbakkaloglu, T., & Gholampour, A. (2017). Modeling the behavior of FRP-confined concrete using dynamic harmony search algorithm. Engineering with Computers, 33(3), 415–430.

    Google Scholar 

  • Kim, M., Chun, H., Kim, J., Kim, K., Yu, J., Kim, T., et al. (2019). Data-efficient parameter identification of electrochemical lithium-ion battery model using deep Bayesian harmony search. Applied Energy, 254, 113644.

    Google Scholar 

  • Krawczyk, B., & Cano, A. (2018). Online ensemble learning with abstaining classifiers for drifting and noisy data streams. Applied Soft Computing, 68, 677–692.

    Google Scholar 

  • Laboissiere, L. A., Fernandes, R. A., & Lage, G. G. (2015). Maximum and minimum stock price forecasting of Brazilian power distribution companies based on artificial neural networks. Applied Soft Computing, 35, 66–74.

    Google Scholar 

  • Lahmiri, S. (2016). Intraday stock price forecasting based on variational mode decomposition. Journal of Computational Science, 12, 23–27.

    Google Scholar 

  • Lee, J., Wang, W., Harrou, F., & Sun, Y. (2020). Reliable solar irradiance prediction using ensemble learning-based models: A comparative study. Energy Conversion and Management, 208, 112582.

    Google Scholar 

  • Lei, L. (2018). Wavelet neural network prediction method of stock price trend based on rough set attribute reduction. Applied Soft Computing, 62, 923–932.

    Google Scholar 

  • Li, J., Zhu, S., & Wu, Q. (2019). Monthly crude oil spot price forecasting using variational mode decomposition. Energy Economics, 83, 240–253.

    Google Scholar 

  • Li, X., & Wei, Y. (2018). The dependence and risk spillover between crude oil market and China stock market: New evidence from a variational mode decomposition-based copula method. Energy Economics, 74, 565–581.

    Google Scholar 

  • Liu, C. F., Yeh, C. Y., & Lee, S. J. (2012). Application of type-2 neuro-fuzzy modeling in stock price prediction. Applied Soft Computing, 12(4), 1348–1358.

    Google Scholar 

  • Liu, H., Xu, Y., & Chen, C. (2019). Improved pollution forecasting hybrid algorithms based on the ensemble method. Applied Mathematical Modelling, 73, 473–486.

    Google Scholar 

  • Manjarres, D., Landa-Torres, I., Gil-Lopez, S., Ser, J. D., Bilbao, M., Salcedo-Sanz, S., et al. (2013). A survey on applications of the harmony search algorithm. Engineering Applications of Artificial Intelligence, 26(8), 1818–1831.

    Google Scholar 

  • Mohammed, A., Minhas, R., Wu, Q. J., & Sid-Ahmed, M. (2011). Human face recognition based on multidimensional PCA and extreme learning machine. Pattern Recognition, 44(10), 2588–2597.

    Google Scholar 

  • Ouyang, H. B., Gao, L. Q., Li, S., Kong, X. Y., Wang, Q., & Zou, D. X. (2017). Improved harmony search algorithm: LHS. Applied Soft Computing, 53, 133–167.

    Google Scholar 

  • Poole, D. J., & Allen, C. B. (2019). Constrained niching using differential evolution. Swarm and Evolutionary Computation, 44, 74–100.

    Google Scholar 

  • Rahmati, S. H. A., Ahmadi, A., & Govindan, K. (2018). A novel integrated condition-based maintenance and stochastic flexible job shop scheduling problem: Simulation-based optimization approach. Annals of Operations Research, 269, 583–621.

    Google Scholar 

  • Razzaghi, T., Safro, I., Ewing, J., Sadrfaridpour, E., & Scott, J. D. (2019). Predictive models for bariatric surgery risks with imbalanced medical datasets. Annals of Operations Research, 280(1–2), 1–18.

    Google Scholar 

  • Rilling, G., & Flandrin, P. (2008). One or two frequencies? The empirical mode decomposition answers. IEEE Transactions on Signal Processing, 56(1), 85–95.

    Google Scholar 

  • Sarantis, N. (2001). Nonlinearities, cyclical behaviour and predictability in stock markets: International evidence. International Journal of Forecasting, 17(3), 459–482.

    Google Scholar 

  • Sezer, O. B., & Ozbayoglu, A. M. (2018). Algorithmic financial trading with deep convolutional neural networks: Time series to image conversion approach. Applied Soft Computing, 70, 525–538.

    Google Scholar 

  • Shen, S., Sadoughi, M., Li, M., Wang, Z., & Hu, C. (2020). Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries. Applied Energy, 260, 114296.

    Google Scholar 

  • Tang, L., Wang, S., He, K., & Wang, S. (2015). A novel mode-characteristic-based decomposition ensemble model for nuclear energy consumption forecasting. Annals of Operations Research, 234, 111–132.

    Google Scholar 

  • Ticknor, J. L. (2013). A Bayesian regularized artificial neural network for stock market forecasting. Expert Systems with Applications, 40(14), 5501–5506.

    Google Scholar 

  • Wang, G., Jia, R., Liu, J., & Zhang, H. (2020). A hybrid wind power forecasting approach based on Bayesian model averaging and ensemble learning. Renewable Energy, 145, 2426–2434.

    Google Scholar 

  • Wang, Z., Wang, Y., & Srinivasan, R. S. (2018). A novel ensemble learning approach to support building energy use prediction. Energy and Buildings, 159, 109–122.

    Google Scholar 

  • Wei Liu, Y. C., & Cao, Siyuan. (2016). Applications of variational mode decomposition in seismic time-frequency analysis. Geophysics, 81(5), 365–378.

    Google Scholar 

  • Weng, B., Lu, L., Wang, X., Megahed, F. M., & Martinez, W. (2018). Predicting short-term stock prices using ensemble methods and online data sources. Expert Systems with Applications, 112, 258–273.

    Google Scholar 

  • Xiao, W., Zhang, J., Li, Y., Zhang, S., & Yang, W. (2017). Class-specific cost regulation extreme learning machine for imbalanced classification. Neurocomputing, 261, 70–82.

    Google Scholar 

  • Yang, L., Zhao, L., & Wang, C. (2019). Portfolio optimization based on empirical mode decomposition. Physica A: Statistical Mechanics and its Applications, 531, 121813.

    Google Scholar 

  • Yeh, C. Y., Huang, C. W., & Lee, S. J. (2011). A multiple-kernel support vector regression approach for stock market price forecasting. Expert Systems with Applications, 38(3), 2177–2186.

    Google Scholar 

  • Yu, Z., Wang, D., You, J., Wong, H. S., Wu, S., Zhang, J., et al. (2016). Progressive subspace ensemble learning. Pattern Recognition, 60, 692–705.

    Google Scholar 

  • Zhang, J., Teng, Y. F., & Chen, W. (2019). Support vector regression with modified firefly algorithm for stock price forecasting. Applied Intelligence, 49(5), 1658–1674.

    Google Scholar 

  • Zhang, T., & Geem, Z. W. (2019). Review of harmony search with respect to algorithm structure. Swarm and Evolutionary Computation, 48, 31–43.

    Google Scholar 

  • Zhou, F., min, Zhou H., Yang, Z., & Yang, L. (2019). EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction. Expert Systems with Applications, 115, 136–151.

    Google Scholar 

  • Zhou, Y., & Wang, P. (2019). An ensemble learning approach for XSS attack detection with domain knowledge and threat intelligence. Computers & Security, 82, 261–269.

    Google Scholar 

  • Zhu, B., Ye, S., He, K., Chevallier, J., & Xie, R. (2019a). Measuring the risk of European carbon market: An empirical mode decomposition-based value at risk approach. Annals of Operations Research, 281, 373–395.

    Google Scholar 

  • Zhu, J., Wu, P., Chen, H., Liu, J., & Zhou, L. (2019b). Carbon price forecasting with variational mode decomposition and optimal combined model. Physica A: Statistical Mechanics and Its Applications, 519, 140–158.

    Google Scholar 

  • Zhu, Q., Tang, X., Li, Y., & Yeboah, M. O. (2020). An improved differential-based harmony search algorithm with linear dynamic domain. Knowledge-Based Systems, 187, 104809.

    Google Scholar 

  • Zhukov, A., Tomin, N., Kurbatsky, V., Sidorov, D., Panasetsky, D., & Foley, A. (2019). Ensemble methods of classification for power systems security assessment. Applied Computing and Informatics, 15(1), 45–53.

    Google Scholar 

  • Zou, D., Gao, L., Wu, J., Li, S., & Li, Y. (2010). A novel global harmony search algorithm for reliability problems. Computers & Industrial Engineering, 58(2), 307–316.

    Google Scholar 

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China (No.71720107002), the Project of High-level Teachers in Beijing Municipal Universities in the Period of 13th Five-year Plan (CIT&TCD20190338), and the Humanity and Social Science Foundation of Ministry of Education of China (No. 19YJAZH005), and the Young Academic Innovation Team of Capital University of Economics and Business of China (No. QNTD202002).

Author information

Authors and Affiliations

  1. School of Management and Engineering, Capital University of Economics and Business, Beijing, China

    Manrui Jiang, Lifen Jia, Zhensong Chen & Wei Chen

Authors
  1. Manrui Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lifen Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhensong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, M., Jia, L., Chen, Z. et al. The two-stage machine learning ensemble models for stock price prediction by combining mode decomposition, extreme learning machine and improved harmony search algorithm. Ann Oper Res 309, 553–585 (2022). https://doi.org/10.1007/s10479-020-03690-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-020-03690-w

Keywords

Search

Navigation