Abstract
A two-level modeling strategy is formulated to predict groundwater levels (GWL) within a portion of Lake Urmia’s aquifer in NW Iran during 14 years (2001–2015), which both aquifer and lake suffer significant water decline. At Level 1, three artificial intelligence (AI) models were trained and tested, which comprise artificial neural network (ANN), Sugeno fuzzy logic (SFL), and neuro-fuzzy (NF). At Level 2, a novel formulation was employed, referred to as the Shannon entropy model averaging (EMA). This formulation combines the results at Level 1 by calculating the weights of Level 1 models based on an innovative approach, which incorporates performance, stability, and parsimony criteria. The results indicate that the models at Level 1 are fit-for-purpose and can capture the water table decline in GWL, but EMA improves RMSE by 5% in the testing phase. Although EMA does not significantly increase the performance of the models, the results of the homoscedastic test in models’ residuals indicate that EMA increases the reliability of prediction owing to the homoscedastic residuals with the highest p value compared to Level 1 models. The p values as per Breusch–Pagan and White tests are 0.88 and 1, respectively, which indicates further information does not remain in the EMA residual. The EMA formulation can be applied to other water resource management problems.
Similar content being viewed by others
Availability of data and material
Data are available on request (data transparency).
Code availability
The codes are available if requested (software application or custom code).
Abbreviations
- AI:
-
Artificial Intelligence
- ANN:
-
Artificial Neural Network
- BMA:
-
Bayesian Model Averaging
- BT:
-
Boosted regression Tree
- CC:
-
Correlation Coefficient
- CV:
-
Coefficient of Variation
- EAWA:
-
East Azerbaijan Water Authority
- EMA:
-
Shannon Entropy Model Averaging
- ET:
-
Entropy Theory
- FL:
-
Fuzzy Logic
- GEP:
-
Gene Expression Programming
- GP:
-
Genetic Programming
- GWL:
-
Groundwater Level
- kNN:
-
K Nearest Neighbor
- LFL:
-
Larsen Fuzzy Logic
- LM:
-
Levenberg–Marquardt
- LSBoost:
-
Least Squares Boosting
- LS-SVM:
-
Least Square Support Vector Machine
- MARS:
-
Multivariate Adaptive Regression Spline
- MF:
-
Membership Functions
- MFL:
-
Mamdani Fuzzy Logic
- MLP:
-
Multi-Layer Perceptron
- NF:
-
Neuro-Fuzzy
- NOP:
-
Number Of model Parameters
- R2 :
-
Determination Coefficient
- RF:
-
Random Forest
- RMSE:
-
Root-Mean-Square Error
- SC:
-
Subtractive Clustering
- SFL:
-
Sugeno Fuzzy Logic
- SVM:
-
Support Vector Machine
- SVR:
-
Support Vector Regression
- Xgboost:
-
Extreme gradient boosting
References
Aeschbach-Hertig W, Gleeson T (2012) Regional strategies for the accelerating global problem of groundwater depletion. Nat Geosci 5:853–861. https://doi.org/10.1038/ngeo1617
Al-Hamdan OZ, Cruise JF (2010) Soil moisture profile development from surface observations by principle of maximum entropy. J Hydrol Eng 15:327–337. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000196
Alvisi S, Mascellani G, Franchini M, Bardossy A (2006) Water level forecasting through fuzzy logic and artificial neural network approaches. Hydrol Earth Syst Sci Discuss 10:1–17. https://doi.org/10.5194/hess-10-1-2006
ASCE (American Society of Civil Engineers) (2000) Task committee on application of artificial neural networks in hydrology, artificial neural network in hydrology. I: preliminary concepts. J Hydrol Eng 5:115–123. https://doi.org/10.1061/(ASCE)1084-0699(2000)5:2(115)
Banadkooki FB, Ehteram M, Ahmed AN, Teo FY, Fai CM, Afan HA, Sapitang M, El-Shafie A (2020) Enhancement of groundwater-level prediction using an integrated machine learning model optimized by whale algorithm. Nat Resour Res 29:3233–3252. https://doi.org/10.1007/s11053-020-09634-2
Barzegar R, Fijani E, Moghaddam AA, Tziritis E (2017) Forecasting of groundwater level fluctuations using ensemble hybrid multi-wavelet neural network-based models. Sci Total Environ 599:20–31. https://doi.org/10.1016/j.scitotenv.2017.04.189
Barzegar R, Moghaddam AA, Deo R, Fijani E, Tziritis E (2018) Mapping groundwater contamination risk of multiple aquifers using multi-model ensemble of machine learning algorithms. Sci Total Environ 621:697–712. https://doi.org/10.1016/j.scitotenv.2017.11.185
Bui DT, Khosravi K, Karimi M, Busico G, Khozani ZS, Nguyen H, Mastrocicco M, Tedesco D, Cuoco E, Kazakis N (2020a) Enhancing nitrate and strontium concentration prediction in groundwater by using new data mining algorithm. Sci Total Environ 715(136836):1–13. https://doi.org/10.1016/j.scitotenv.2020.136836
Bui DT, Khosravi K, Tiefenbacher J, Nguyen H, Kazakis N (2020b) Improving prediction of water quality indices using novel hybrid machine-learning algorithms. Sci Total Environ 721(137612):1–15. https://doi.org/10.1016/j.scitotenv.2020.137612
Chen MS, Wang SW (1999) Fuzzy clustering analysis for optimizing fuzzy membership functions. Fuzzy Sets System 103:239–254. https://doi.org/10.1016/S0165-0114(98)00224-3
Chiu CL (1987) Entropy and probability concepts in hydraulics. J Hydraul Eng 113:583–599. https://doi.org/10.1061/(ASCE)0733-9429(1987)113:5(583)
Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2:267–278. https://doi.org/10.3233/IFS-1994-2306
Choo TH (2000) An efficient method of the suspended sediment-discharge measurement using entropy concept. Water Eng Res 1:95–105
Chung ES, Abdulai PJ, Park H, Kim Y, Ahn SR, Kim SJ (2016) Multi-criteria assessment of spatial robust water resource vulnerability using the TOPSIS method coupled with objective and subjective weights in the Han River basin. Sustainability 9(1):1–17. https://doi.org/10.3390/su9010029
Coppola E Jr, Szidarovszky F, Poulton M, Charles E (2003) Artificial neural network approach for predicting transient water levels in a multilayered groundwater system under variable state, pumping, and climate conditions. J Hydrol Eng 8:348–360. https://doi.org/10.1061/(ASCE)1084-0699(2003)8:6(348)
Daliakopoulos IN, Coulibaly P, Tsanis IK (2005) Groundwater level forecasting using artificial neural networks. J Hydrol 309:229–240. https://doi.org/10.1016/j.jhydrol.2004.12.001
Derbela M, Issam N (2020) Intelligent approach to predict future groundwater level based on artificial neural networks (ANN). Euro Mediterranean J Environ Integrat 5:1–11. https://doi.org/10.1007/s41207-020-00185-9
Dong F, Javed A, Saber A, Neumann A, Arnillas CA, Kaltenecker G, Arhonditsis G (2021) A flow-weighted ensemble strategy to assess the impacts of climate change on watershed hydrology. J Hydrol 594(125898):1–17. https://doi.org/10.1016/j.jhydrol.2020.125898
East Azerbaijan Regional Water Authority (2016) Annual report of water balance of Tasuj plain (in Persian). East Azerbaijan Regional Water Authority
Ehteram M, Afan HA, Dianatikhah M, Ahmed AN, Fai CM, Hossain MS, Allay MF, Elshafie A (2019) Assessing the predictability of an improved ANFIS model for monthly streamflow using lagged climate indices as predictors. Water 11(6):1–21. https://doi.org/10.3390/w11061130
Emamgholizadeh S, Moslemi K, Karami G (2014) Prediction the groundwater level of Bastam plain (Iran) by artificial neural network (ANN) and adaptive neuro-fuzzy inference system (ANFIS). Water Resour Manage 28:5433–5446. https://doi.org/10.1007/s11269-014-0810-0
Fallah-Mehdipour E, Haddad OB, Marĩno MA (2014) Genetic programming in groundwater modeling. J Hydrol Eng 19(04014031):1–63. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000987
Gorzalczany MB (2001) Computational Intelligence Systems and Applications. Physica-Verlag, Heidelberg. https://doi.org/10.1007/978-3-7908-1801-7
Iqbal N, Khan AN, Rizwan A, Ahmad R, Kim BW, Kim K, Kim DH (2021) Groundwater level prediction model using correlation and difference mechanisms based on boreholes data for sustainable hydraulic resource management. IEEE Access 9:96092–96113. https://doi.org/10.1109/ACCESS.2021.3094735
Kadkhodaie-ilkhichi A, Amini A (2009) A fuzzy logic approach to estimating hydraulic flow units from well log data: a case study from the Ahwaz oilfield, South Iran. J Pet Geol 32:67–78. https://doi.org/10.1111/j.1747-5457.2009.00435.x
Kasiviswanathan KS, Saravanan S, Balamurugan M, Saravanan K (2016) Genetic programming based monthly groundwater level forecast models with uncertainty quantification. Model Earth Syst Environ 2(27):1–11. https://doi.org/10.1007/s40808-016-0083-0
Khaki M, Yusoff I, Islami N (2015) Simulation of groundwater level through artificial intelligence system. Environ Earth Sci 73:8357–8367. https://doi.org/10.1007/s12665-014-3997-8
Khatibi R, Nadiri AA (2021) Inclusive Multiple Models (IMM) for predicting groundwater levels and treating heterogeneity. Geosci Front 12:713–724. https://doi.org/10.1016/j.gsf.2020.07.011
Kholghi M, Hosseini SM (2009) Comparison of groundwater level estimation using neuro-fuzzy and ordinary kriging. Environ Model Assess 14:729–737. https://doi.org/10.1007/s10666-008-9174-2
Knoll L, Breuer L, Bach M (2019) Large scale prediction of groundwater nitrate concen-trations from spatial data using machine learning. Sci Total Environ 668:1317–1327. https://doi.org/10.1016/j.scitotenv.2019.03.045
Lin GF, Chen GR (2006) An improved neural network approach to the determination of aquifer parameters. J Hydrol 316:281–289. https://doi.org/10.1016/j.jhydrol.2005.04.023
Mastrocicco M, Busico G, Colombani N, Vigliotti M, Ruberti D (2019) Modelling actual and future seawater intrusion in the Variconi coastal wetland (Italy) due to climate and landscape changes. Water Switzerland 11(7):1–15. https://doi.org/10.3390/w11071502
Melesse AM, Ahmad S, McClain ME, Wang X, Lim YH (2011) Suspended sediment load prediction of river systems: an artificial neural network approach. Agric Water Manag 98:855–866. https://doi.org/10.1016/j.agwat.2010.12.012
Mirarabi A, Nassery HR, Nakhaei M, Adamowski J, Akbarzadeh AH, Alijani F (2019) Evaluation of data-driven models (SVR and ANN) for groundwater-level prediction in confined and unconfined systems. Environ Earth Sci 78(489):1–15. https://doi.org/10.1007/s12665-019-8474-y
Moazamnia M, Hassanzadeh Y, Nadiri AA, Khatibi R, Sadeghfam S (2019) Formulating a strategy to combine artificial intelligence models using Bayesian model averaging to study a distressed aquifer with sparse data availability. J Hydrol 571:765–781. https://doi.org/10.1016/j.jhydrol.2019.02.011
Moazamnia M, Hassanzadeh Y, Nadiri AA, Sadeghfam S (2020) Vulnerability indexing to saltwater intrusion from models at two levels using artificial intelligence multiple model (AIMM). J Environ Manage 255(109871):1–11. https://doi.org/10.1016/j.jenvman.2019.109871
Moghaddam HK, Hossein KM, Zahra RK, Masoud B, Mohamad JA (2019) Developing comparative mathematic models, BN and ANN for forecasting of groundwater levels. Groundw Sustain Dev 9(100237):1–11. https://doi.org/10.1016/j.gsd.2019.100237
Mohanty S, Jha MK, Kumar A, Sudheer KP (2010) Artificial neural network modeling for groundwater level forecasting in a river island of eastern India. Water Resour Manage 24(9):1845–1865. https://doi.org/10.1007/s11269-009-9527-x
Mustafa SMT, Nossent J, Ghysels G, Huysmans M (2020) Integrated bayesian multi-model approach to quantify input, parameter and conceptual model structure uncertainty in groundwater modeling. Environ Model Softw 126(104654):1–17. https://doi.org/10.1016/j.envsoft.2020.104654
Nadiri AA, Asgharimoghaddam A, Tsai FTC, Fijani E (2013) Hydro geochemical analysis for Tasuj Plain aquifer. Iran J Earth Syst Sci 122(4):1091–1105. https://doi.org/10.1007/s12040-013-0329-4
Nadiri AA, Chitsazan N, Tsai FTC, Moghaddam AA (2014) Bayesian artificial intelligence model averaging for hydraulic conductivity estimation. J Hydrol Eng 19:520–532. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000824
Nadiri AA, Naderi K, Khatibi R, Gharekhani M (2019) Modelling groundwater level variations by learning from multiple models using fuzzy logic. Hydrol Sci J 64:210–226. https://doi.org/10.1080/02626667.2018.1554940
Nadiri AA, Sedghi Z, Khatibi R, Sadeghfam S (2018) Mapping specific vulnerability of multiple confined and unconfined aquifers by using artificial intelligence to learn from multiple DRASTIC frameworks. J Environ Manage 227:415–428. https://doi.org/10.1016/j.jenvman.2018.08.019
Nadiri AA, Razzagh S, Khatibi R, Sedghi Z (2021) Predictive groundwater levels modelling by Inclusive Multiple Modelling (IMM) at multiple levels. Earth Sci Inform 14:749–763. https://doi.org/10.1007/s12145-021-00572-y
Naghibi SA, Pourghasemi HR, Pourtaghi ZS, Rezaei A (2015) Groundwater qanat potential mapping using frequency ratio and Shannon’s entropy models in the Moghan watershed. Iran Earth Sci Inform 8:171–186. https://doi.org/10.1007/s12145-014-0145-7
Nguyen PT, Ha DH, Avand M, Jaafari A, Nguyen HD, Al-Ansari N, Phong TV, Sharma R, Kumar R, Le HP, Ho LS, Prakash I, Pham BT (2020) Soft computing ensemble models based on logistic regression for groundwater potential mapping. Appl Sci 10(7):1–24. https://doi.org/10.3390/app10072469
Nourani V, Asgharimogaddam A, Nadiri AA, Sing VP (2008a) Forecasting spatiotemporal water levels of Tabriz Aquifer. Trend Appl Sci Res 3:319–329
Nourani V, Asgharimogaddam A, Nadiri AA (2008b) An ANN-based model for spatiotemporal groundwater level forecasting. Hydrol Process 22:5054–5066. https://doi.org/10.1002/hyp.7129
Nourani V, Mousavi S (2016) Spatiotemporal groundwater level modeling using hybrid artificial intelligence-meshless method. J Hydrol 536:10–25. https://doi.org/10.1016/j.jhydrol.2016.02.030
Nourani V, Behfar N, Uzelaltinbulat S, Sadikoglu F (2020) Spatiotemporal precipitation modeling by artificial intelligence-based ensemble approach. Environ Earth Sci 79(1):1–20. https://doi.org/10.1007/s12665-019-8755-5
Nourani V, Gokcekus H, Gelete G (2021a) Estimation of suspended sediment load using artificial intelligence-based ensemble model. Complexity 2021(6633760):1–19. https://doi.org/10.1155/2021/6633760
Nourani V, Gökçekuş H, Gichamo T (2021b) Ensemble data-driven rainfall-runoff modeling using multi-source satellite and gauge rainfall data input fusion. Earth Science Informatics (in press) 1–22.https://doi.org/10.1007/s12145-021-00615-4
Osman AIA, Ahmed AN, Chow MF, Huang YF, El-Shafie A (2021) Extreme gradient boosting (Xgboost) model to predict the groundwater levels in Selangor Malaysia. Ain Shams Eng J 12:1545–1556. https://doi.org/10.1016/j.asej.2020.11.011
Pham BT, Jaafari A, Prakash I, Singh SK, Quoc NK, Bui DT (2019) Hybrid computational intelligence models for groundwater potential mapping. CATENA 182(104101):1–13. https://doi.org/10.1016/j.catena.2019.104101
Pulido-Calvo I, Gutierrez-Estrada JC (2009) Improved irrigation water demand forecasting using a soft-computing hybrid model. Biosys Eng 102:202–218. https://doi.org/10.1016/j.biosystemseng.2008.09.032
Sadat-Noori M, Glamore W, Khojasteh D (2020) Groundwater level prediction using genetic programming: The importance of precipitation data and weather station location on model accuracy. Environ Earth Sci 79(37):1–10. https://doi.org/10.1007/s12665-019-8776-0
Sadeghfam S, Ehsanitabar A, Khatibi R, Daneshfaraz R (2018) Investigating ‘risk’ of groundwater drought occurrences by using reliability analysis. Ecol Ind 94:170–184. https://doi.org/10.1016/j.ecolind.2018.06.055
Sadeghfam S, Daneshfaraz R, Khatibi R, Minaei O (2019a) Experimental studies on scour of supercritical flow jets in upstream of screens and modelling scouring dimensions using artificial intelligence to combine multiple models (AIMM). J Hydroinform 21:893–907. https://doi.org/10.2166/hydro.2019.076
Sadeghfam S, Hassanzadeh Y, Khatibi R, Nadiri AA, Moazamnia M (2019b) Groundwater remediation through pump-treat-inject technology using optimum control by artificial intelligence (OCAI). Water Resour Manage 33:1123–1145. https://doi.org/10.1007/s11269-018-2171-6
Sadeghfam S, Nourbakhsh Khiyabani F, Khatibi R, Daneshfaraz R (2020) A study of land subsidence problems by ALPRIFT for vulnerability indexing and risk indexing and treating subjectivity by strategy at two levels. J Hydroinf 22:1640–1662. https://doi.org/10.2166/hydro.2020.247
Sahoo M, Das T, Kumari K, Dhar A (2016) Space–time forecasting of groundwater level using a hybrid soft computing model. Hydrol Sci J 62:561–574. https://doi.org/10.1080/02626667.2016.1252986
Shannon CE (1948) A mathematical theory of communication, Part I, Part II. Bell Syst Tech J 27:623–656. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
Shiri J, Kisi O (2011) Comparison of genetic programming with neuro-fuzzy systems for predicting short-term water table depth fluctuations. Comput Geosci 37:1692–1701. https://doi.org/10.1016/j.cageo.2010.11.010
Shiri J, Kisi O, Yoon H, Lee KK, Nazemi A (2013) Predicting groundwater level fluctuations with meteorological effect implications. A comparative study among soft computing techniques. Comput Geosci 56:32–44. https://doi.org/10.1016/j.cageo.2013.01.007
Shiri J, Kisi O, Yoon H, Kazemi MH, Shiri N, Poorrajabali M, Karimi S (2020) Prediction of groundwater level variations in coastal aquifers with tide and rainfall effects using heuristic data driven models. ISH J Hydraul Eng. https://doi.org/10.1080/09715010.2020.1729876
Singh VP (2010) Entropy theory for derivation of infiltration equations. Water Resour Res 46(W03527):1–20. https://doi.org/10.1029/2009WR008193
Singh VP (2011) Hydrologic synthesis using entropy theory: review. J Hydrol Eng 16:421–433. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000332
Sivapragasam C, Kannabiran K, Karthik G, Raja S (2015) Assessing suitability of GP modeling for groundwater level. Aquatic Procedia 4:693–699. https://doi.org/10.1016/j.aqpro.2015.02.089
Srdjevic B, Medeiros Y, Faria A (2004) An objective multi-criteria evaluation of water management scenarios. Water Resour Manage 18:35–54. https://doi.org/10.1023/B:WARM.0000015348.88832.52
Tang Y, Zang C, Wei Y, Jiang M (2019) Data-driven modeling of groundwater level with Least-Square support vector machine and spatial–temporal analysis. Geotech Geol Eng 37:1661–1670. https://doi.org/10.1007/s10706-018-0713-6
Wan S (2009) A spatial decision support system for extracting the core factors and thresholds for landslide susceptibility map. Eng Geol 108:237–251. https://doi.org/10.1016/j.enggeo.2009.06.014
Yadav B, Gupta PK, Patidar N, Himanshu SK (2020) Ensemble modelling framework for groundwater level prediction in urban areas of India. Sci Total Environ 712(135539):1–13. https://doi.org/10.1016/j.scitotenv.2019.135539
Yoon H, Jun SC, Hyun Y, Bae GO, Lee KK (2011) A comparative study of artificial neural networks and support vector machines for predicting groundwater levels in a coastal aquifer. J Hydrol 396:128–138. https://doi.org/10.1016/j.jhydrol.2010.11.002
Zheng C, Hill MC, Hsieh PA (2001) MODFLOW-2000, the US Geological Survey modular ground-water model: User guide to the LMT6 package, the linkage with MT3DMS for multi-species mass transport modeling. U.S. Geological Survey (No. 2001–82). https://doi.org/10.3133/ofr0182
Acknowledgements
The funders had no role in this study design.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
S.R., S.S. and A.A.N. contributed to the formulation of modeling strategies, data collection, literature review and preliminary. The study was supervised and drafted by S.S. and A.A.N. The vision and review of the drafted manuscript at all of its stages were done by B.G., N.M.-M. and N.K. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics approval
The manuscript investigates a set of technical issue and does not breach any ethical standard.
Consent for publication
The authors will issued their consent for publication when the manuscript is accepted.
Additional information
Editorial responsibility: Samareh Mirkia.
Rights and permissions
About this article
Cite this article
Razzagh, S., Sadeghfam, S., Nadiri, A.A. et al. Formulation of Shannon entropy model averaging for groundwater level prediction using artificial intelligence models. Int. J. Environ. Sci. Technol. 19, 6203–6220 (2022). https://doi.org/10.1007/s13762-021-03793-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13762-021-03793-2