Skip to main content
SpringerLink
Log in

Similarity Metrics-Based Uncertainty Analysis of River Water Quality Models

  • Published:
Water Resources Management Aims and scope Submit manuscript

Abstract

Uncertainty analysis (UA) is essential to reinforce the decisions made by water resource engineers and managers. In this study, the stepwise multiple linear regression procedure assessed the relationship between water quality parameters and physical characteristics of 48 catchments in the southwestern basin of the Caspian Sea, Iran. The results of the modeling showed that the coefficient of determination ranged between 0.47 and 0.68 and indicated a positive relationship between the area (%) of agricultural lands and the sodium adsorption ratio (SAR), potassium (K) and total dissolved solids (TDS). A negative relationship was also found between bicarbonate (HCO3−) and the area (%) of the intermediate-density forest. In contrast to previous studies focusing on analyzing the uncertainty of the model parameters, we addressed the uncertainty of the model variables. The results of the GLUE-based uncertainty analysis (UA) performed on the model’s variables indicated that the measures of the R-factor for all models were between 0.13 and 0.98. The lowest R-factor was obtained for the HCO3− model (0.13) suggesting it performed well when predicting HCO3−. To increase the degree of objectivity in the GLUE-UA method, a set of similarity metrics, including Czekanowski, Motyka, Ruzicka, Cosine, Kumar-Hassebrook, Jaccard and Dice was applied to determine the degree of proximity and or similarity between the probability density functions of the measured and simulated water quality parameters. The measures of the similarity metrics for the HCO3− model were generally close to 1, indicating good performance and low uncertainty, while it showed higher uncertainty (between 0.2487 and 0.897) for the other three models (SAR, K, and TDS).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Abbaspour KC, Johnson C, Van Genuchten MT (2004) Estimating uncertain flow and transport parameters using a sequential uncertainty fitting procedure. Vadose Zone J 3:1340–1352

    Article  Google Scholar 

  • Ahearn DS, Sheibley RW, Dahlgren RA, Anderson M, Johnson J, Tate KW (2005) Land use and land cover influence on water quality in the last free-flowing river draining the western Sierra Nevada, California. J Hydrol 313:234–247

    Article  Google Scholar 

  • Ajami NK, Duan Q, Sorooshian S (2007) An integrated hydrologic Bayesian multimodel combination framework: confronting input, parameter, and model structural uncertainty in hydrologic prediction. Water Resour Res 43:W01403

    Article  Google Scholar 

  • Amiri BJ (2017) Environmnetal modeling. University of Tehran Press, Tehran, pp 139

  • Amiri BJ, Nakane K (2006) Modeling the relationship between land cover and river water quality in the Yamaguchi prefecture of Japan. J Ecology Environ 29:343–352

    Article  Google Scholar 

  • Andersson J-O, Nyberg L (2009) Using official map data on topography, wetlands and vegetation cover for prediction of stream water chemistry in boreal headwater catchments. Hydrol Earth Syst Sci 13:537–549

    Article  Google Scholar 

  • Annear T, Chisholm I, Beecher H, Locke A, Aarrestad P, Burkardt N, Coomer C, Estes C, Hunt J, Jacobson R, Jobsis G (2002) Instream flows for riverine resource stewardship. Instream Flow Council, Cheyenne, WY

  • Arabi M, Govindaraju RS, Hantush MM (2007) A probabilistic approach for analysis of uncertainty in the evaluation of watershed management practices. J Hydrol 333:459–471

    Article  Google Scholar 

  • Basseville M (1989) Distance measures for signal processing and pattern recognition. Signal Process 18:349–369

    Article  Google Scholar 

  • Becker H, Naaman M, Gravano L (2010) Learning similarity metrics for event identification in social media. In: Proceedings of the third ACM international conference on web search and data mining. ACM, pp 291–300

  • Beven K, Binley A (2014) GLUE: 20 years on. Hydrol Process 28:5897–5918

    Article  Google Scholar 

  • Blasone R-S, Madsen H, Rosbjerg D (2008) Uncertainty assessment of integrated distributed hydrological models using GLUE with Markov chain Monte Carlo sampling. J Hydrol 353:18–32

    Article  Google Scholar 

  • Borgonovo E, Castaings W, Tarantola S (2011) Moment independent importance measures: new results and analytical test cases. Risk Analysis 31:404–428

    Article  Google Scholar 

  • Bray JR, Curtis JT (1957) An ordination of the upland forest communities of southern Wisconsin. Ecological monographs 27:325–349

  • Brooks KN, Ffolliott PF, Gregersen HM, DeBano LF (2003) Hydrology and the management of watersheds. Vol Ed. 3. Iowa State University Press, Ames

    Google Scholar 

  • Butts MB, Payne JT, Kristensen M, Madsen H (2004) An evaluation of the impact of model structure on hydrological modelling uncertainty for streamflow simulation. J Hydrol 298:242–266

    Article  Google Scholar 

  • Camacho RA, Martin JL, McAnally W, Díaz-Ramirez J, Rodriguez H, Sucsy P, Zhang S (2015) A comparison of Bayesian methods for uncertainty analysis in hydraulic and hydrodynamic modeling. J American Water Resources Association 51:1372–1393. https://doi.org/10.1111/1752-1688.12319

    Article  Google Scholar 

  • Campbell EP, Fox DR, Bates BC (1999) A Bayesian approach to parameter estimation and pooling in nonlinear flood event models. Water Resour Res 35:211–220

    Article  Google Scholar 

  • Cha S-H (2007) Comprehensive survey on distance/similarity measures between probability density functions. International Journal of Mathematical Models and Methods in Applied Science 1(1):300–307

    Google Scholar 

  • Charkhabi A, Sakizadeh M (2006) Assessment of spatial variation of water quality parameters in the most polluted branch of the Anzali Wetland, Northern Iran. Pol J Environ Stud 15:395–403

    Google Scholar 

  • Chatterjee S, Hadi AS (2015) Regression analysis by example. Wiley, New York

    Google Scholar 

  • Cheng C-t, Chau K-w, Li X-y (2007) Hydrologic uncertainty for Bayesian probabilistic forecasting model based on BP ANN. In: Natural computation, 2007. ICNC 2007. Third international conference on. IEEE, pp 197–201

  • Choi S-SS (2008) Correlation analysis of binary similarity and dissimilarity measures

  • Culka M (2016) Uncertainty analysis using Bayesian model averaging: a case study of input variables to energy models and inference to associated uncertainties of energy scenarios. Energy, Sustainability and Society 6:7. https://doi.org/10.1186/s13705-016-0073-0

    Article  Google Scholar 

  • Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302

  • Du X, Chen W (2001) A most probable point-based method for efficient uncertainty analysis. J Des Manuf Autom 4:47–66

    Google Scholar 

  • Emam AR, Kappas M, Fassnacht S, Linh NHK (2018) Uncertainty analysis of hydrological modeling in a tropical area using different algorithms. Front Earth Sci:1–11

  • Freer J, Beven K, Ambroise B (1996) Bayesian estimation of uncertainty in runoff prediction and the value of data: an application of the GLUE approach. Water Resour Res 32:2161–2173

    Article  Google Scholar 

  • Gan Y, Liang X-Z, Duan Q, Ye A, Di Z, Hong Y, Li J (2018) A systematic assessment and reduction of parametric uncertainties for a distributed hydrological model. J Hydrol 564:697–711

    Article  Google Scholar 

  • Garen DC, Burges SJ (1981) Approximate error bounds for simulated hydrographs. J Hydraul Div 107:1519–1534

    Google Scholar 

  • Girard A (2004) Approximate methods for propagation of uncertainty with Gaussian process models. University of Glasgow, Glasgow

    Google Scholar 

  • Gowda T, Mattmann CA (2016) Clustering web pages based on structure and style similarity (application paper). In: 2016 IEEE 17th international conference on information reuse and integration (IRI). IEEE, pp 175–180

  • Haidary A, Amiri BJ, Adamowski J, Fohrer N, Nakane K (2013) Assessing the impacts of four land use types on the water quality of wetlands in Japan. Water Resour Manag 27:2217–2229

    Article  Google Scholar 

  • Hariri BB, Abolhassani H, Khodaei A (2006) A new structural similarity measure for ontology alignment. In: SWWS, pp 36–42

  • Harrel RC, Dorris TC (1968) Stream order, morphometry, physico-chemical conditions, and community structure of benthic macroinvertebrates in an intermittent stream system. Am Midl Nat 80:220–251

    Article  Google Scholar 

  • He J, Jones JW, Graham WD, Dukes MD (2010) Influence of likelihood function choice for estimating crop model parameters using the generalized likelihood uncertainty estimation method. Agric Syst 103:256–264

    Article  Google Scholar 

  • Helton JC, Johnson JD, Sallaberry CJ, Storlie CB (2006) Survey of sampling-based methods for uncertainty and sensitivity analysis. Reliab Eng Syst Saf 91:1175–1209

    Article  Google Scholar 

  • Honti M, Scheidegger A, Stamm C (2014) The importance of hydrological uncertainty assessment methods in climate change impact studies. Hydrol Earth Syst Sci 18:3301–3317

    Article  Google Scholar 

  • Hosack GR, Hayes KR, Dambacher JM (2008) Assessing model structure uncertainty through an analysis of system feedback and Bayesian networks. Ecol Appl 18:1070–1082

    Article  Google Scholar 

  • Huang J, Zhan J, Yan H, Wu F, Deng X (2013) Evaluation of the impacts of land use on water quality: a case study in the Chaohu Lake basin. Sci World J 2013:1–7

    Google Scholar 

  • Jaccard P (1901) Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines. Bull Soc Vaudoise Sci Nat 37:241–272

  • Jin X, Xu C-Y, Zhang Q, Singh V (2010) Parameter and modeling uncertainty simulated by GLUE and a formal Bayesian method for a conceptual hydrological model. J Hydrol 383:147–155

    Article  Google Scholar 

  • Johnston CA, Detenbeck NE, Niemi GJ (1990) The cumulative effect of wetlands on stream water quality and quantity. A landscape approach. Biogeochemistry 10:105–141

    Article  Google Scholar 

  • Jousselme A-L, Grenier D, Bossé É (2001) A new distance between two bodies of evidence. Inf Fusion 2:91–101. https://doi.org/10.1016/S1566-2535(01)00026-4

    Article  Google Scholar 

  • Kacker R, Jones A (2003) On use of Bayesian statistics to make the guide to the expression of uncertainty in measurement consistent. Metrologia 40:235

    Article  Google Scholar 

  • Kang D, Pasha M, Lansey K (2009) Approximate methods for uncertainty analysis of water distribution systems. Urban Water J 6:233–249

    Article  Google Scholar 

  • Kavetski D, Franks SW, Kuczera G (2003) Confronting input uncertainty in environmental modelling calibration of watershed models. Water Sci Appl 6:49–68

    Article  Google Scholar 

  • Kay A, Davies H, Bell V, Jones R (2009) Comparison of uncertainty sources for climate change impacts: flood frequency in England. Clim Chang 92:41–63

    Article  Google Scholar 

  • Kuczera G, Parent E (1998) Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the Metropolis algorithm. J Hydrol 211:69–85

    Article  Google Scholar 

  • Kuczera G, Kavetski D, Franks S, Thyer M (2006) Towards a Bayesian total error analysis of conceptual rainfall-runoff models: characterising model error using storm-dependent parameters. J Hydrol 331:161–177

    Article  Google Scholar 

  • Kuehne RA (1962) A classification of streams, illustrated by fish distribution in an eastern Kentucky creek. Ecology 43:608–614

    Article  Google Scholar 

  • Kumar BV, Hassebrook L (1990) Performance measures for correlation filters Applied optics 29:2997–3006

  • Lane EW (1955) Importance of fluvial morphology in hydraulic engineering. Proceedings (American Society of Civil Engineers), vol 81, paper no 745

  • Lecomte K, García M, Fórmica S, Depetris P (2009) Influence of geomorphological variables on mountainous stream water chemistry (Sierras Pampeanas, Córdoba, Argentina). Geomorphology 110:195–202

    Article  Google Scholar 

  • Maillard P, Santos NAP (2008) A spatial-statistical approach for modeling the effect of non-point source pollution on different water quality parameters in the Velhas river watershed–Brazil. J Environ Manag 86:158–170

    Article  Google Scholar 

  • Mannina G, Viviani G (2010) Water quality modelling for ephemeral rivers: model development and parameter assessment. J Hydrol 393:186–196

    Article  Google Scholar 

  • Manohar M (2011) A study on similarity measure functions on engineering materials selection. Computer Science and Inf Technology 03:157–167. https://doi.org/10.5121/csit.2011.1314

  • Mantovan P, Todini E (2006) Hydrological forecasting uncertainty assessment: incoherence of the GLUE methodology. J Hydrol 330:368–381

    Article  Google Scholar 

  • Marshall L, Nott D, Sharma A (2004) A comparative study of Markov chain Monte Carlo methods for conceptual rainfall-runoff modeling. Water Resour Res 40:W02501

    Article  Google Scholar 

  • Mirzaei M, Galavi H, Faghih M, Huang YF, Lee TS, El-Shafie A (2013) Model calibration and uncertainty analysis of runoff in the Zayanderood River basin using generalized likelihood uncertainty estimation (GLUE) method. J Water Supply Res Technol AQUA 62:309–320

    Article  Google Scholar 

  • Mirzaei M, Huang YF, El-Shafie A, Shatirah A (2015) Application of the generalized likelihood uncertainty estimation (GLUE) approach for assessing uncertainty in hydrological models: a review. Stoch Env Res Risk A 29:1265–1273

    Article  Google Scholar 

  • Motyka J (1947) O celach i metodach badan geobotanicznych. Sur les buts et les méthodes des recherches géobotaniques. Nakladem universytftu Marii Curie-Sklodowskiej

  • Nayyeri H, Zandi S (2018) Evaluation of the effect of river style framework on water quality: application of geomorphological factors. Environ Earth Sci 77:343

    Article  Google Scholar 

  • Nelson J, Grubesic T (2017) A repeated sampling method for oil spill impact uncertainty and interpolation. International J Disaster Risk Reduct 22:420–430

    Article  Google Scholar 

  • Palomba F, Cesari G, Pelillo R, Petroselli A (2018) An empirical model for river ecological management with uncertainty evaluation. Water Resour Manag 32:897–912

    Article  Google Scholar 

  • Pasha M, Lansey K (2005) Analysis of uncertainty on water distribution hydraulics and water quality. In: Impacts of global climate change. Anchorage, Alaska, United States, pp 1–12

  • Pathak CS et al (2015) Uncertainty analyses in hydrologic/hydraulic modeling: challenges and proposed resolutions. J Hydrol Eng 20:02515003

    Article  Google Scholar 

  • Pianosi F, Wagener T (2015) A simple and efficient method for global sensitivity analysis based on cumulative distribution functions. Environ Model Softw 67:1–11

    Article  Google Scholar 

  • Pielou EC (1984) The interpretation of ecological data: a primer on classification and ordination. John Wiley & Sons

  • Rustomji P, Wilkinson S (2008) Applying bootstrap resampling to quantify uncertainty in fluvial suspended sediment loads estimated using rating curves. Water Resour Res 44:W09435

    Google Scholar 

  • Saleh A (2008) Uncertainty analysis of hydrological models. Dissertation, Nzoia river case study. Delft University, Delft

  • Sangani MH, Amiri BJ, Shabani AA, Sakieh Y, Ashrafi S (2015) Modeling relationships between catchment attributes and river water quality in southern catchments of the Caspian Sea. Environ Sci Pollut Res 22:4985–5002

    Article  Google Scholar 

  • Sharafati A, Azamathulla H (2018) Assessment of dam overtopping reliability using SUFI based overtopping threshold curve. Water Resour Manag 32:2369–2383

    Article  Google Scholar 

  • Sharafati A, Zahabiyoun B (2014) Rainfall threshold curves extraction by considering rainfall-runoff model uncertainty. Arab J Sci Eng 39:6835–6849

    Article  Google Scholar 

  • Sheikholeslami R, Razavi S (2017) Progressive Latin hypercube sampling: an efficient approach for robust sampling-based analysis of environmental models. Environ Model Softw 93:109–126

    Article  Google Scholar 

  • Shen Z, Chen L, Chen T (2012) Analysis of parameter uncertainty in hydrological and sediment modeling using GLUE method: a case study of SWAT model applied to three gorges reservoir region, China. Hydrol Earth Syst Sci 16:121–132

    Article  Google Scholar 

  • Singh A, Imtiyaz M, Isaac R, Denis D (2014) Assessing the performance and uncertainty analysis of the SWAT and RBNN models for simulation of sediment yield in the Nagwa watershed, India. Hydrol Sci J 59:351–364

    Article  Google Scholar 

  • Srivastava PK, Han D, Rico-Ramirez MA, Islam T (2014) Sensitivity and uncertainty analysis of mesoscale model downscaled hydro-meteorological variables for discharge prediction. Hydrol Process 28:4419–4432

    Article  Google Scholar 

  • Talebizadeh M, Morid S, Ayyoubzadeh SA, Ghasemzadeh M (2010) Uncertainty analysis in sediment load modeling using ANN and SWAT model. Water Resour Manag 24:1747–1761

    Article  Google Scholar 

  • Toman B (2005) Bayesian approach to assessing uncertainty and calculating a reference value in key comparison experiments. Journal of research of the National Institute of Standards and Technology 110:605

    Article  Google Scholar 

  • Ulary AL (2013) Analysis of model uncertainty in hydraulic modeling: the BSTEM application to the Osage River. Missouri University of Science and Technology

  • Uusitalo L, Lehikoinen A, Helle I, Myrberg K (2015) An overview of methods to evaluate uncertainty of deterministic models in decision support. Environ Model Softw 63:24–31

    Article  Google Scholar 

  • van Griensven A, Meixner T (2006) Methods to quantify and identify the sources of uncertainty for river basin water quality models. Water Sci Technol 53:51–59

    Article  Google Scholar 

  • Varanka S, Hjort J, Luoto M (2015) Geomorphological factors predict water quality in boreal rivers. Earth Surf Process Landf 40:1989–1999

    Article  Google Scholar 

  • Versace V, Ierodiaconou D, Stagnitti F, Hamilton A, Walter M, Mitchell B, Boland A-M (2008) Regional-scale models for relating land cover to basin surface-water quality using remotely sensed data in a GIS. Environ Monit Assess 142:171–184

    Article  Google Scholar 

  • Vrugt JA, Gupta HV, Bouten W, Sorooshian S (2003) A shuffled complex evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour Res 39:1201

    Google Scholar 

  • Wang Y, Dietrich J, Voss F, Pahlow M (2007) Identifying and reducing model structure uncertainty based on analysis of parameter interaction. Adv Geosci 11:117–122

    Article  Google Scholar 

  • Wen L, Fan X, Chen Y Geometrical expression of the angular resolution of a network of gravitationalwave detectors and improved localization methods. In: Journal of Physics: Conference Series, 2008. vol 1. IOP Publishing, p 012038

  • Yang J, Reichert P, Abbaspour KC (2007) Bayesian uncertainty analysis in distributed hydrologic modeling: a case study in the Thur River basin (Switzerland). Water Resour Res 43:W10401

    Google Scholar 

  • Yang X, Liu Q, Luo X, Zheng Z (2017) Spatial regression and prediction of water quality in a watershed with complex pollution sources. Sci Rep 7:8318

    Article  Google Scholar 

  • Yatheendradas S, Wagener T, Gupta H, Unkrich C, Goodrich D, Schaffner M, Stewart A (2008) Understanding uncertainty in distributed flash flood forecasting for semiarid regions. Water Resour Res 44:W05S19

    Article  Google Scholar 

  • Zhang X-L, Huang H-Z, Wang Z-L, Xiao N-C, Li Y-F (2012) Uncertainty analysis method based on a combination of the maximum entropy principle and the point estimation method metoda analizy niepewności oparta na połączeniu zasady maksymalnej entropii i metody oceny punktowej. Eksploatacja I Niezawodnosc 14:114–119

    Google Scholar 

  • Zhang Z, Lu W, Chu H, Cheng W, Zhao Y (2014) Uncertainty analysis of hydrological model parameters based on the bootstrap method: a case study of the SWAT model applied to the Dongliao River watershed, Jilin Province, northeastern China. SCIENCE CHINA Technol Sci 57:219–229

    Article  Google Scholar 

  • Zhao B, Tung Y-K, Yeh K-C, Yang J-C (1997) Reliability analysis of hydraulic structures considering unit hydrograph uncertainty. Stoch Hydrol Hydraul 11:33

    Article  Google Scholar 

  • Zhu Z, Zhao C, Hou Y (2012) Research on similarity measurement for texture image retrieval. PLoS One 7:e45302

    Article  Google Scholar 

Download references

Acknowledgments

We are grateful for the Iranian Water Resources Management Company, the Forests, Rangelands, and Watershed Management Organization, the Geological Survey of Iran and the Soil and Water Research Institute for providing this study with initial data sets. The assistance provided by Drs. F. Sarmadian and M. Mirzaei were greatly appreciated and Dr. Lydia Mckenzie for her help in the proofreading of the manuscript.

Author information

Authors and Affiliations

  1. Department of Environmental Science, Faculty of Natural Resources, University of Tehran, Karaj, Iran

    Shirin Karimi & Bahman Jabbarian Amiri

  2. Department of Reclamation of Arid and Mountainous Regions, Faculty of Natural Resources, University of Tehran, Karaj, Iran

    Arash Malekian

Authors
  1. Shirin Karimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bahman Jabbarian Amiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arash Malekian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bahman Jabbarian Amiri.

Ethics declarations

Conflict of Interest

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karimi, S., Amiri, B.J. & Malekian, A. Similarity Metrics-Based Uncertainty Analysis of River Water Quality Models. Water Resour Manage 33, 1927–1945 (2019). https://doi.org/10.1007/s11269-019-02205-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11269-019-02205-y

Keywords

Search

Navigation