Abstract
Input variable selection plays a key role in data-driven streamflow forecasting models. In this study, we propose a two-stage wrapper model to drive one-month-ahead streamflow forecasting in the context of high-dimensional candidate input variables. Initially, the Boruta algorithm, a feature selection method, was applied to select all the relevant input variables for the streamflow series. Then, a novel binary grey wolf optimizer (BGWO)-regularized extreme learning machine (RELM) wrapper was derived. We carried out experiments on two US catchments with 132 candidate input variables, including local meteorological information, global climatic indices, and lags of the streamflow series. Furthermore, the sensitivities of the proposed model in terms of the optimal objective function were compared. The results indicate two important findings. First, the proposed model outperformed commonly used models in terms of four error evaluation criteria. Second, for the proposed model, the root mean square error is a more suitable criterion than the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) for the optimal objective function. These findings are of great reference value for developing ELM models for streamflow forecasting.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
None.
References
Addor N, Newman AJ, Mizukami N, Clark MP (2017) The CAMELS data set: catchment attributes and meteorology for large-sample studies. Hydrol Earth Syst Sci 21:5293–5313. https://doi.org/10.5194/hess-21-5293-2017
Adnan RM, Yuan X, Kisi O, et al (2018) Stream flow forecasting of poorly gauged mountainous watershed by least square support vector machine , fuzzy genetic algorithm and m5 model tree using climatic data from nearby station. Water Resour Manag. https://doi.org/10.1007/s11269-018-2033-2 Stre.
Atiquzzaman M, Kandasamy J (2018) Robustness of extreme learning machine in the prediction of hydrological flow series. Comput Geosci 120:105–114. https://doi.org/10.1016/j.cageo.2018.08.003
Bai Y, Bezak N, Sapač K, Klun M, Zhang J (2019) Short-term Streamflow forecasting using the feature-enhanced regression model. Water Resour Manag 33:4783–4797. https://doi.org/10.1007/s11269-019-02399-1
Behzad M, Asghari K, Eazi M, Palhang M (2009) Generalization performance of support vector machines and neural networks in runoff modeling. Expert Syst Appl 36:7624–7629. https://doi.org/10.1016/j.eswa.2008.09.053
Chai T, Draxler RR (2014) Root mean square error (RMSE) or mean absolute error (MAE)? -arguments against avoiding RMSE in the literature. Geosci Model Dev 7:1247–1250. https://doi.org/10.5194/gmd-7-1247-2014
Chandrashekar G, Sahin F (2014) A survey on feature selection methods. Comput Electr Eng 40:16–28. https://doi.org/10.1016/j.compeleceng.2013.11.024
Chen Y-h, Chang FJ (2009) Evolutionary artificial neural networks for hydrological systems forecasting. J Hydrol 367:125–137. https://doi.org/10.1016/j.jhydrol.2009.01.009
Choubin B, Solaimani K, Rezanezhad F, Habibnejad Roshan M, Malekian A, Shamshirband S (2019) Streamflow regionalization using a similarity approach in ungauged basins: application of the geo-environmental signatures in the Karkheh River basin, Iran. Catena 182:104128. https://doi.org/10.1016/j.catena.2019.104128
Chu H, Wei J, Qiu J (2018) Monthly streamflow forecasting using EEMD-Lasso-DBN method based on multi-scale predictors selection. Water (Switzerland) 10:10. https://doi.org/10.3390/w10101486
Chyzhyk D, Savio A, Graña M (2014) Evolutionary ELM wrapper feature selection for Alzheimer’s disease CAD on anatomical brain MRI. Neurocomputing 128:73–80. https://doi.org/10.1016/j.neucom.2013.01.065
da Silva Melo Honorato AG, da Silva GBL, Guimarães Santos CA (2018) Monthly streamflow forecasting using neuro-wavelet techniques and input analysis. Hydrol Sci J 63:2060–2075. https://doi.org/10.1080/02626667.2018.1552788
Deng W, Zheng Q, Chen L (2009) Regularized extreme learning machine. In: 2009 IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2009 - Proceedings. IEEE, pp 389–395
Ding S, Zhao H, Zhang Y, Xu X, Nie R (2015) Extreme learning machine: algorithm, theory and applications. Artif Intell Rev 44:103–115. https://doi.org/10.1007/s10462-013-9405-z
Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381. https://doi.org/10.1016/j.neucom.2015.06.083
Galelli S, Humphrey GB, Maier HR, Castelletti A, Dandy GC, Gibbs MS (2014) An evaluation framework for input variable selection algorithms for environmental data-driven models. Environ Model Softw 62:33–51. https://doi.org/10.1016/j.envsoft.2014.08.015
Gupta HV, Kling H, Yilmaz KK, Martinez GF (2009) Decomposition of the mean squared error and NSE performance criteria: implications for improving hydrological modelling. J Hydrol 377:80–91. https://doi.org/10.1016/j.jhydrol.2009.08.003
Hadi SJ, Tombul M (2018a) Streamflow forecasting using four wavelet transformation combinations approaches with data-driven models: a comparative study. Water Resour Manag 32:4661–4679. https://doi.org/10.1007/s11269-018-2077-3
Hadi SJ, Tombul M (2018b) Monthly streamflow forecasting using continuous wavelet and multi-gene genetic programming combination. J Hydrol 561:674–687. https://doi.org/10.1016/j.jhydrol.2018.04.036
He RR, Chen Y, Huang Q et al (2020) Predictability of monthly streamflow time series and its relationship with basin characteristics: an empirical study based on the MOPEX basins. Water Resour Manag 4991–5007. https://doi.org/10.1007/s11269-020-02708-z
Hu Z, Bao Y, Xiong T, Chiong R (2015) Hybrid filter-wrapper feature selection for short-term load forecasting. Eng Appl Artif Intell 40:17–27. https://doi.org/10.1016/j.engappai.2014.12.014
Jiang Y, Bao X, Hao S, Zhao H, Li X, Wu X (2020) Monthly Streamflow forecasting using ELM-IPSO based on phase space reconstruction. Water Resour Manag 34:3515–3531. https://doi.org/10.1007/s11269-020-02631-3
Kagoda PA, Ndiritu J, Ntuli C, Mwaka B (2010) Application of radial basis function neural networks to short-term streamflow forecasting. Phys Chem Earth 35:571–581. https://doi.org/10.1016/j.pce.2010.07.021
Kalteh AM (2016) Improving forecasting accuracy of streamflow time series using least squares support vector machine coupled with data-preprocessing techniques. Water Resour Manag 30:747–766. https://doi.org/10.1007/s11269-015-1188-3
Kisi O, Choubin B, Deo RC, Yaseen ZM (2019) Incorporating synoptic-scale climate signals for streamflow modelling over the Mediterranean region using machine learning models. Hydrol Sci J 64:1240–1252. https://doi.org/10.1080/02626667.2019.1632460
Krause P, Boyle DP, Bäse F (2005) Comparison of different efficiency criteria for hydrological model assessment. Adv Geosci 5:89–97. https://doi.org/10.5194/adgeo-5-89-2005
Kursa MB, Rudnicki WR (2010) Feature selection with the boruta package. J Stat Softw 36:1–13. https://doi.org/10.18637/jss.v036.i11
Li PH, Kwon HH, Sun L, Lall U, Kao JJ (2010) A modified support vector machine based prediction model on streamflow at the Shihmen reservoir, Taiwan. Int J Climatol 30:1256–1268. https://doi.org/10.1002/joc.1954
May RJ, Maier HR, Dandy GC, Fernando TMKG (2008) Non-linear variable selection for artificial neural networks using partial mutual information. Environ Model Softw 23:1312–1326. https://doi.org/10.1016/j.envsoft.2008.03.007
May R, Dandy G, Maier H (2011) Review of input variable selection methods for artificial neural networks. INTECH Open Access Publisher
McCuen RH, Knight Z, Cutter AG (2006) Evaluation of the Nash-Sutcliffe efficiency index. J Hydrol Eng 11:597–602. https://doi.org/10.1061/(ASCE)1084-0699(2006)11:6(597)
Miche Y, Sorjamaa A, Bas P et al (2010) OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21:158–162. https://doi.org/10.1109/TNN.2009.2036259
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007
Mohammadi B, Ahmadi F, Mehdizadeh S, Guan Y, Pham QB, Linh NTT, Tri DQ (2020) Developing novel robust models to improve the accuracy of daily Streamflow modeling. Water Resour Manag 34:3387–3409. https://doi.org/10.1007/s11269-020-02619-z
Mosavi A, Sajedi Hosseini F, Choubin B, Taromideh F, Ghodsi M, Nazari B, Dineva AA (2020) Susceptibility mapping of groundwater salinity using machine learning models. Environ Sci Pollut Res. https://doi.org/10.1007/s11356-020-11319-5
Newman AJ, Clark MP, Sampson K, Wood A, Hay LE, Bock A, Viger RJ, Blodgett D, Brekke L, Arnold JR, Hopson T, Duan Q (2015) Development of a large-sample watershed-scale hydrometeorological data set for the contiguous USA: data set characteristics and assessment of regional variability in hydrologic model performance. Hydrol Earth Syst Sci 19:209–223. https://doi.org/10.5194/hess-19-209-2015
Noori R, Karbassi AR, Moghaddamnia A, Han D, Zokaei-Ashtiani MH, Farokhnia A, Gousheh MG (2011) Assessment of input variables determination on the SVM model performance using PCA, gamma test, and forward selection techniques for monthly stream flow prediction. J Hydrol 401:177–189. https://doi.org/10.1016/j.jhydrol.2011.02.021
Parisouj P, Mohebzadeh H, Lee T (2020) Employing machine learning algorithms for Streamflow prediction: a case study of four river basins with different climatic zones in the United States. Water Resour Manag 34:4113–4131. https://doi.org/10.1007/s11269-020-02659-5
Quilty J, Adamowski J, Khalil B, Rathinasamy M (2016) Bootstrap rank-ordered conditional mutual information (broCMI): a nonlinear input variable selection method for water resources modeling. Water Resour Res 52:2299–2326. https://doi.org/10.1002/2015WR016959
Rasouli K, Hsieh WW, Cannon AJ (2012) Daily streamflow forecasting by machine learning methods with weather and climate inputs. J Hydrol 414–415:284–293. https://doi.org/10.1016/j.jhydrol.2011.10.039
Ren K, Fang W, Qu J, Zhang X, Shi X (2020) Comparison of eight filter-based feature selection methods for monthly streamflow forecasting – three case studies on CAMELS data sets. J Hydrol 586:124897. https://doi.org/10.1016/j.jhydrol.2020.124897
Rezaie-Balf M, Naganna SR, Kisi O, El-Shafie A (2019) Enhancing streamflow forecasting using the augmenting ensemble procedure coupled machine learning models: case study of Aswan high dam. Hydrol Sci J 64:1629–1646. https://doi.org/10.1080/02626667.2019.1661417
Shanmugapriya D, Padmavathi G (2013) A wrapper based feature subset selection using ACO-ELM-ANP and GA-ELM-ANP approaches for keystroke dynamics authentication. In: International Conference on Signal Processing, Image Processing and Pattern Recognition 2013, ICSIPR 2013. IEEE, pp 157–162
Sharma S, Srivastava P, Fang X, Kalin L (2015) Performance comparison of adoptive neuro fuzzy inference system (ANFIS) with loading simulation program C++ (LSPC) model for streamflow simulation in El Niño southern oscillation (ENSO)-affected watershed. Expert Syst Appl 42:2213–2223. https://doi.org/10.1016/j.eswa.2014.09.062
Shi X, Lei X, Huang Q, Huang S, Ren K, Hu Y (2018) Hourly day-ahead wind power prediction using the hybrid model of variational model decomposition and long short-term memory. Energies 11. https://doi.org/10.3390/en11113227
Taormina R, Chau KW (2015) Data-driven input variable selection for rainfall-runoff modeling using binary-coded particle swarm optimization and extreme learning machines. J Hydrol 529:1617–1632. https://doi.org/10.1016/j.jhydrol.2015.08.022
Thornton PE, Thornton MM, Mayer BW, et al (2014) Daymet: Daily surface weather data on a 1-km grid for North America, version 2. Data set: Oak Ridge National Laboratory Distributed Active Archive Center , Oak Ridge, Tennessee, USA. Temporal range: 1980/01/01–2014/12/31. Spacial range (decimal degrees): Oak Ridge National Lab.(ORNL), Oak Ridge, TN (United States)
Tyralis H, Papacharalampous GA (2018) Large-scale assessment of prophet for multi-step ahead forecasting of monthly streamflow. Adv Geosci 45:147–153. https://doi.org/10.5194/adgeo-45-147-2018
Woldemeskel F, McInerney D, Lerat J et al (2018) Evaluating residual error approaches for post-processing monthly and seasonal streamflow forecasts. Hydrol Earth Syst Sci Discuss:1–40. https://doi.org/10.5194/hess-2018-214
Xue X, Yao M, Wu Z (2018) A novel ensemble-based wrapper method for feature selection using extreme learning machine and genetic algorithm. Knowl Inf Syst 57:389–412. https://doi.org/10.1007/s10115-017-1131-4
Yaseen ZM, Jaafar O, Deo RC, Kisi O, Adamowski J, Quilty J, el-Shafie A (2016) Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq. J Hydrol 542:603–614. https://doi.org/10.1016/j.jhydrol.2016.09.035
Funding
This work was financially supported by the Doctoral Research Fund of North China University of Water Resources and Electric Power, China (40464).
Author information
Authors and Affiliations
Contributions
JQ: Figure, data collection, Methodology, Software, Writing.
KR: Conceptualization, Software, Writing.
XS: Reviewing, English editing.
Corresponding author
Ethics declarations
Ethical Approval
Compliance with Ethical Standards.
Consent to Participate
Not applicable.
Consent to Publish
All authors agree to publish.
Competing Interests
None.
Rights and permissions
About this article
Cite this article
Qu, J., Ren, K. & Shi, X. Binary Grey Wolf Optimization-Regularized Extreme Learning Machine Wrapper Coupled with the Boruta Algorithm for Monthly Streamflow Forecasting. Water Resour Manage 35, 1029–1045 (2021). https://doi.org/10.1007/s11269-021-02770-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11269-021-02770-1