Skip to main content
Log in

Evaluating multiple performance criteria to calibrate the distributed hydrological model of the upper Neckar catchment

  • Special Issue
  • Published:
Environmental Earth Sciences Aims and scope Submit manuscript

Abstract

Performance criteria are used in the automated calibration of hydrological models to determine and minimise the misfit between observations and model simulations. In this study, a multiobjective model calibration framework is used to analyse the trade-offs between Nash–Sutcliffe efficiency of flows (NSE), the NSE of log-transformed flows (NSElogQ), and the sum-squared error of monthly discharge sums (SSEMQ). These criteria are known to put different emphasis on average and high flows, low flows, and average volume-balance components. Twenty-two upper Neckar subbasins whose catchment area ranges from 56 to 3,976 km2 were modelled with the distributed mesoscale hydrological model (mHM) to investigate these trade-offs. The 53 global parameters required for each instance of the mHM model were estimated with the global search algorithm AMALGAM. Equally weighted compromise solutions based on the selected criteria and extreme ends of all bi-criterion Pareto fronts were used after each calibration run to analyse the trade-off between different performance criteria. Calibration results were further analysed with ten additional criteria commonly used for evaluating hydrological model performance. Results showed that the trade-off patterns were similar for all subbasins irrespective of catchment size and that the largest trade-offs were consistently observed between the NSE and NSElogQ criteria. Simulations with the compromise solution provided a well-balanced fit to individual characteristics of the streamflow hydrographs and exhibited improved volume balance. Other performance criteria such as bias, the Pearson correlation coefficient, and the relative variability remained largely unchanged between compromise solutions and Pareto extremes. Parameter sets of the best NSE fit and the compromise solution of the largest basin (gauge at Plochingen) were used to simulate streamflow at the other 21 internal subbasins for a 10-year evaluation period without re-calibration. Both parameter sets performed well in the individual basins with median NSE values of 0.74 and 0.72, respectively. The compromise solution resulted in similar NSElogQ-ranges and a 14.6 % lower median volume-balance error which indicates an overall better model performance. The results demonstrate that the performance criteria for hydrological model calibration should be selected in accordance with the anticipated model predictions. The compromise solution provides an advance to the use of single criteria in model calibration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Bergström S, Carlsson B, Grahn G, Johansson B (1997) A more consistent approach to catchment response in the HBV model. Vannet i Norden 4:1–7

    Google Scholar 

  • Beven K (1993) Prophecy, reality and uncertainty in distributed hydrological modelling. Adv Water Resour 16(1):41–51

    Article  Google Scholar 

  • Beven KJ, Cloke HL (2011) Defining grand challenges in hydrology: a comment on Wood et al. (2011) Hyperresolution global land surface modeling: Meeting a grand challenge for monitoring Earth’s terrestrial water. Water Resour Res 48(1):W01801

    Article  Google Scholar 

  • Brooks RH, Corey AT (1964) Hydraulic properties of porous media. Technical Report 3, Colorado State University, Fort Collins

  • Dann R, Bidwell V, Thomas S, Wöhling Th, Close M (2010) Modeling of nonequilibrium bromide transport through alluvial gavel vadose zones. Vadose Zone J 9:731–746

    Article  Google Scholar 

  • Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chicester

    Google Scholar 

  • Denmead OT, Shaw RH (1962) Availability of soil water to plants as affected by soil moisture content and meteorological conditions. Agron J 54:385–390

    Article  Google Scholar 

  • Dickinson R (1984) Modelling evapotranspiration for three-dimensional global climate models. In: Hansen JE, Takahashi T (eds) Climate processes and climate sensitivity, geophysical monograph series, vol 29. AGU, Washington, pp 58–72

  • Dumedah G, Berg AA, Wineberg M (2012) Pareto-optimality and a search for robustness: choosing solutions with desired properties in objective space and parameter space. J Hydrol 14(2):270–285

    Google Scholar 

  • Efstratiadis A, Koutsoyiannis D (2010) One decade of multi-objective calibration approaches in hydrological modelling: a review. Hydrol Sci J 55(1):58–78

    Article  Google Scholar 

  • Fenicia F, McDonnell JJ, Savenije HHG (2008) Learning from model improvement: On the contribution of complementary data to process understanding. Water Resour Res 44:W06419

    Google Scholar 

  • Flügel W-A (1995) Delineating hydrological response units by geographical information system analyses for regional hydrological modelling using prms/mms in the drainage basin of the river brol, germany. Hydrol Process 9(3-4):423–436

    Article  Google Scholar 

  • Grathwohl P, Rügner H, Wöhling Th, Osenbrück K, Schwientek M, Gayler S, Wollschläger U, Selle B, Pause M, Delfs J-O, Grzeschik M, Weller U, Ivanov M, Cirpka O, Maier U, Kuch B, Nowak W, Wulfmeyer V, Warrach-Sagi K, Streck T, Attinger S, Bilke L, Dietrich P, Fleckenstein J, Kalbacher T, Kolditz O, Rink K, Samaniego L, Vogel H-J, Werban U, Teutsch G (2013) Catchments as Reactors: a comprehensive approach for water fluxes and solute turn-over. Environ Earth Sci 69(2):(this issue). doi:10.1007/s12665-013-2281-7

  • Gupta HV, Kling H, Yilmaz KK, Martinez GF (2009) Decomposition of the mean squared error and NSE performance criteria: implications for improving hydrological modelling. J Hydrol 377(1–2):80–91

    Article  Google Scholar 

  • Gupta HV, Sorooshian S, Yapo PO (1998) Toward improved calibration of hydrologic models: multiple and noncommensurable measures of information. Water Resour Res 34(4):751–764. doi:10.1029/97WR03495

    Article  Google Scholar 

  • Hall JM (2001) How well does your model fit the data? J Hydroinformatics 3(1):49–55

    Google Scholar 

  • Hargreaves GH, Samani ZA (1985) Reference crop evapotranspiration from temperature. Appl Eng Agric 1:96–99

    Google Scholar 

  • Hoeting JA, Madigan D, Raftery AE, Volinsky CT (1999) Bayesian model averaging: a tutorial. Stat Sci 14(4):382–417

    Article  Google Scholar 

  • Köhne JM, Wöhling Th, Pot V, Benoit P, Leguédois S, Le Bissonnais Y, Šimůnek J (2011) Coupled simulation of surface runoff and soil water flow using multi-objective parameter estimation. J Hydrol 403:141–156

    Article  Google Scholar 

  • Kollat JB, Reed PM, Wagener T (2012) When are multiobjective calibration trade-offs in hydrologic models meaningful? Water Resour Res 48:W03520

    Article  Google Scholar 

  • Krause P, Boyle DP, Bäse F (2005) Comparison of different efficiency criteria for hydrological model assessment. Adv Geosci 5:89–97

    Article  Google Scholar 

  • Krauße T, Cullmann J, Saile P, Schmitz GH (2012) Robust multi-objective calibration strategies—possibilities for improving flood forecasting. Hydrol Earth Syst Sci 16(10):3579–3606

    Article  Google Scholar 

  • Kumar R, Samaniego L, Attinger S (2010) The effects of spatial discretization and model parameterization on the prediction of extreme runoff characteristics. J Hydrol 392(1–2):54–69

    Article  Google Scholar 

  • Liang X, Lettenmaier D, Wood E, Burgers S (1994) A simple hydrologically based model of land-surface water and energy fluxes for general-circulation models. J Geophys Res Atmospheres 99(D7):14415–14428

    Article  Google Scholar 

  • Liang X, Wood EF, Lettenmaier DP (1996) Surface soil moisture parameterization of the VIC-2L model: Evaluation and modification. Global Planetary Change 13(1–4):195–206

    Article  Google Scholar 

  • Linsley RK (1943) A simple procedure for day-to-day forecast of runoff from snow melt. Trans Am Geophys Union 24:62–67

    Article  Google Scholar 

  • Liu Y, Sun F (2010) Sensitivity analysis and automatic calibration of a rainfall—runoff model using multi-objectives. Ecol Inform 5(4):304–310

    Article  Google Scholar 

  • Madsen H (2003) Parameter estimation in distributed hydrological catchment modelling using automatic calibration with multiple objectives. Adv Water Resour 26(2):205–216

    Article  Google Scholar 

  • Mahrt L, Pan H (1984) A two-layer model of soil hydrology. Boundary-Layer Meteorol 29:1–20

    Article  Google Scholar 

  • Merz R, Parajka J, Blöschl G (2009) Scale effects in conceptual hydrological modeling. Water Resour Res 45(9):W09405

    Article  Google Scholar 

  • Moriasi DN, Arnold JG, Van Liew MW, Bingner RL, Harmel RD, Veith TL (2007) Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Trans ASABE 50(3):885–900

    Google Scholar 

  • Nash JE, Sutcliffe JV (1970) River flow forecasting through: Part I—a conceptual models discussion of principles. J Hydrol 10:282–290

    Article  Google Scholar 

  • Oudin L, Andréassian V, Mathevet T, Perrin C, Michel C (2006) Dynamic averaging of rainfall-runoff model simulations from complementary model parameterizations. Water Resour Res 42(7):W07410

    Article  Google Scholar 

  • Parajka J, Merz R, Bloschl G (2005) A comparison of regionalisation methods for catchment model parameters. Hydrol Earth Syst Sci 9(3):157–171

    Article  Google Scholar 

  • Pushpalatha R, Perrin C, Le Moine N, Andreassian V (2012) A review of efficiency criteria suitable for evaluating low-flow simulations. J Hydrol 420:171–182

    Article  Google Scholar 

  • Reusser DE, Blume T, Schaefli B, Zehe E (2009) Analysing the temporal dynamics of model performance for hydrological models. Hydrol Earth Syst Sci 13(7):999–1018

    Article  Google Scholar 

  • Samaniego L, Kumar R, Attinger S (2010) Multiscale parameter regionalization of a grid-based hydrologic model at the mesoscale. Water Resour Res 46(5):W05523

    Article  Google Scholar 

  • Schoups G, Hopmans J, Young C, Vrugt J, Wallender W (2005) Multi-criteria optimization of a regional spatially-distributed subsurface water flow model. J Hydrol 311(1–4):20–48

    Article  Google Scholar 

  • Tang Y, Reed P, Wagener T (2006) How effective and efficient are multiobjective evolutionary algorithms at hydrologic model calibration? Hydrol Earth Syst Sci 10:289–307

    Article  Google Scholar 

  • Vazquez RF, Willems P, Feyen J (2008) Improving the predictions of a MIKE SHE catchment-scale application by using a multi-criteria approach. Hydrol Process 22(13):2159–2179

    Article  Google Scholar 

  • Vrugt JA, Gupta HV, Bastidas LA, Bouten W, Sorooshian S (2003) Effective and efficient algorithm for multiobjective optimization of hydrologic models. Water Resources Research 39(5):1–19 doi:10.1029/2002WR001746

    Google Scholar 

  • Vrugt JA, Robinson BA (2007) Improved evolutionary optimization from genetically adaptive multimethod search. In Proceedings of the National Academy of Sciences of the United States of America (PNAS), volume 104, pp 708–711

  • Wöhling Th, Vrugt JA (2008) Combining multiobjective optimization and Bayesian model averaging to calibrate forecast ensembles of soil hydraulic models. Water Resources Research 44(12):W12432

    Article  Google Scholar 

  • Wöhling Th, Vrugt JA (2011) Multiresponse multilayer vadose zone model calibration using Markov chain Monte Carlo simulation and field water retention data. Water Resources Research 47:W04510

    Article  Google Scholar 

  • Wöhling Th, Vrugt JA, Barkle GF (2008) Comparison of three multiobjective algorithms for inverse modeling of vadose zone hydraulic properties. Soil Science Society of America Journal 72(2):305–319

    Article  Google Scholar 

  • Yapo P, Gupta H, Sorooshian S (1998) Multi-objective global optimization for hydrologic models. Journal of Hydrology 204(1-4):83–97

    Article  Google Scholar 

  • Zhu J, Mohanty BP (2002) Spatial Averaging of van Genuchten Hydraulic Parameters for Steady-State Flow in Heterogeneous Soils: A Numerical Study. Vadose Zone J 1(2):261–272

    Google Scholar 

Download references

Acknowledgments

This work was funded by the Helmholtz-Centre for Environmental Research, UFZ, and the Ministry for Science, Research and Arts, Baden-Württemberg, Germany.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thomas Wöhling.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wöhling, T., Samaniego, L. & Kumar, R. Evaluating multiple performance criteria to calibrate the distributed hydrological model of the upper Neckar catchment. Environ Earth Sci 69, 453–468 (2013). https://doi.org/10.1007/s12665-013-2306-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12665-013-2306-2

Keywords

Navigation