Abstract
Performance criteria are used in the automated calibration of hydrological models to determine and minimise the misfit between observations and model simulations. In this study, a multiobjective model calibration framework is used to analyse the trade-offs between Nash–Sutcliffe efficiency of flows (NSE), the NSE of log-transformed flows (NSElogQ), and the sum-squared error of monthly discharge sums (SSEMQ). These criteria are known to put different emphasis on average and high flows, low flows, and average volume-balance components. Twenty-two upper Neckar subbasins whose catchment area ranges from 56 to 3,976 km2 were modelled with the distributed mesoscale hydrological model (mHM) to investigate these trade-offs. The 53 global parameters required for each instance of the mHM model were estimated with the global search algorithm AMALGAM. Equally weighted compromise solutions based on the selected criteria and extreme ends of all bi-criterion Pareto fronts were used after each calibration run to analyse the trade-off between different performance criteria. Calibration results were further analysed with ten additional criteria commonly used for evaluating hydrological model performance. Results showed that the trade-off patterns were similar for all subbasins irrespective of catchment size and that the largest trade-offs were consistently observed between the NSE and NSElogQ criteria. Simulations with the compromise solution provided a well-balanced fit to individual characteristics of the streamflow hydrographs and exhibited improved volume balance. Other performance criteria such as bias, the Pearson correlation coefficient, and the relative variability remained largely unchanged between compromise solutions and Pareto extremes. Parameter sets of the best NSE fit and the compromise solution of the largest basin (gauge at Plochingen) were used to simulate streamflow at the other 21 internal subbasins for a 10-year evaluation period without re-calibration. Both parameter sets performed well in the individual basins with median NSE values of 0.74 and 0.72, respectively. The compromise solution resulted in similar NSElogQ-ranges and a 14.6 % lower median volume-balance error which indicates an overall better model performance. The results demonstrate that the performance criteria for hydrological model calibration should be selected in accordance with the anticipated model predictions. The compromise solution provides an advance to the use of single criteria in model calibration.
Similar content being viewed by others
References
Bergström S, Carlsson B, Grahn G, Johansson B (1997) A more consistent approach to catchment response in the HBV model. Vannet i Norden 4:1–7
Beven K (1993) Prophecy, reality and uncertainty in distributed hydrological modelling. Adv Water Resour 16(1):41–51
Beven KJ, Cloke HL (2011) Defining grand challenges in hydrology: a comment on Wood et al. (2011) Hyperresolution global land surface modeling: Meeting a grand challenge for monitoring Earth’s terrestrial water. Water Resour Res 48(1):W01801
Brooks RH, Corey AT (1964) Hydraulic properties of porous media. Technical Report 3, Colorado State University, Fort Collins
Dann R, Bidwell V, Thomas S, Wöhling Th, Close M (2010) Modeling of nonequilibrium bromide transport through alluvial gavel vadose zones. Vadose Zone J 9:731–746
Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chicester
Denmead OT, Shaw RH (1962) Availability of soil water to plants as affected by soil moisture content and meteorological conditions. Agron J 54:385–390
Dickinson R (1984) Modelling evapotranspiration for three-dimensional global climate models. In: Hansen JE, Takahashi T (eds) Climate processes and climate sensitivity, geophysical monograph series, vol 29. AGU, Washington, pp 58–72
Dumedah G, Berg AA, Wineberg M (2012) Pareto-optimality and a search for robustness: choosing solutions with desired properties in objective space and parameter space. J Hydrol 14(2):270–285
Efstratiadis A, Koutsoyiannis D (2010) One decade of multi-objective calibration approaches in hydrological modelling: a review. Hydrol Sci J 55(1):58–78
Fenicia F, McDonnell JJ, Savenije HHG (2008) Learning from model improvement: On the contribution of complementary data to process understanding. Water Resour Res 44:W06419
Flügel W-A (1995) Delineating hydrological response units by geographical information system analyses for regional hydrological modelling using prms/mms in the drainage basin of the river brol, germany. Hydrol Process 9(3-4):423–436
Grathwohl P, Rügner H, Wöhling Th, Osenbrück K, Schwientek M, Gayler S, Wollschläger U, Selle B, Pause M, Delfs J-O, Grzeschik M, Weller U, Ivanov M, Cirpka O, Maier U, Kuch B, Nowak W, Wulfmeyer V, Warrach-Sagi K, Streck T, Attinger S, Bilke L, Dietrich P, Fleckenstein J, Kalbacher T, Kolditz O, Rink K, Samaniego L, Vogel H-J, Werban U, Teutsch G (2013) Catchments as Reactors: a comprehensive approach for water fluxes and solute turn-over. Environ Earth Sci 69(2):(this issue). doi:10.1007/s12665-013-2281-7
Gupta HV, Kling H, Yilmaz KK, Martinez GF (2009) Decomposition of the mean squared error and NSE performance criteria: implications for improving hydrological modelling. J Hydrol 377(1–2):80–91
Gupta HV, Sorooshian S, Yapo PO (1998) Toward improved calibration of hydrologic models: multiple and noncommensurable measures of information. Water Resour Res 34(4):751–764. doi:10.1029/97WR03495
Hall JM (2001) How well does your model fit the data? J Hydroinformatics 3(1):49–55
Hargreaves GH, Samani ZA (1985) Reference crop evapotranspiration from temperature. Appl Eng Agric 1:96–99
Hoeting JA, Madigan D, Raftery AE, Volinsky CT (1999) Bayesian model averaging: a tutorial. Stat Sci 14(4):382–417
Köhne JM, Wöhling Th, Pot V, Benoit P, Leguédois S, Le Bissonnais Y, Šimůnek J (2011) Coupled simulation of surface runoff and soil water flow using multi-objective parameter estimation. J Hydrol 403:141–156
Kollat JB, Reed PM, Wagener T (2012) When are multiobjective calibration trade-offs in hydrologic models meaningful? Water Resour Res 48:W03520
Krause P, Boyle DP, Bäse F (2005) Comparison of different efficiency criteria for hydrological model assessment. Adv Geosci 5:89–97
Krauße T, Cullmann J, Saile P, Schmitz GH (2012) Robust multi-objective calibration strategies—possibilities for improving flood forecasting. Hydrol Earth Syst Sci 16(10):3579–3606
Kumar R, Samaniego L, Attinger S (2010) The effects of spatial discretization and model parameterization on the prediction of extreme runoff characteristics. J Hydrol 392(1–2):54–69
Liang X, Lettenmaier D, Wood E, Burgers S (1994) A simple hydrologically based model of land-surface water and energy fluxes for general-circulation models. J Geophys Res Atmospheres 99(D7):14415–14428
Liang X, Wood EF, Lettenmaier DP (1996) Surface soil moisture parameterization of the VIC-2L model: Evaluation and modification. Global Planetary Change 13(1–4):195–206
Linsley RK (1943) A simple procedure for day-to-day forecast of runoff from snow melt. Trans Am Geophys Union 24:62–67
Liu Y, Sun F (2010) Sensitivity analysis and automatic calibration of a rainfall—runoff model using multi-objectives. Ecol Inform 5(4):304–310
Madsen H (2003) Parameter estimation in distributed hydrological catchment modelling using automatic calibration with multiple objectives. Adv Water Resour 26(2):205–216
Mahrt L, Pan H (1984) A two-layer model of soil hydrology. Boundary-Layer Meteorol 29:1–20
Merz R, Parajka J, Blöschl G (2009) Scale effects in conceptual hydrological modeling. Water Resour Res 45(9):W09405
Moriasi DN, Arnold JG, Van Liew MW, Bingner RL, Harmel RD, Veith TL (2007) Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Trans ASABE 50(3):885–900
Nash JE, Sutcliffe JV (1970) River flow forecasting through: Part I—a conceptual models discussion of principles. J Hydrol 10:282–290
Oudin L, Andréassian V, Mathevet T, Perrin C, Michel C (2006) Dynamic averaging of rainfall-runoff model simulations from complementary model parameterizations. Water Resour Res 42(7):W07410
Parajka J, Merz R, Bloschl G (2005) A comparison of regionalisation methods for catchment model parameters. Hydrol Earth Syst Sci 9(3):157–171
Pushpalatha R, Perrin C, Le Moine N, Andreassian V (2012) A review of efficiency criteria suitable for evaluating low-flow simulations. J Hydrol 420:171–182
Reusser DE, Blume T, Schaefli B, Zehe E (2009) Analysing the temporal dynamics of model performance for hydrological models. Hydrol Earth Syst Sci 13(7):999–1018
Samaniego L, Kumar R, Attinger S (2010) Multiscale parameter regionalization of a grid-based hydrologic model at the mesoscale. Water Resour Res 46(5):W05523
Schoups G, Hopmans J, Young C, Vrugt J, Wallender W (2005) Multi-criteria optimization of a regional spatially-distributed subsurface water flow model. J Hydrol 311(1–4):20–48
Tang Y, Reed P, Wagener T (2006) How effective and efficient are multiobjective evolutionary algorithms at hydrologic model calibration? Hydrol Earth Syst Sci 10:289–307
Vazquez RF, Willems P, Feyen J (2008) Improving the predictions of a MIKE SHE catchment-scale application by using a multi-criteria approach. Hydrol Process 22(13):2159–2179
Vrugt JA, Gupta HV, Bastidas LA, Bouten W, Sorooshian S (2003) Effective and efficient algorithm for multiobjective optimization of hydrologic models. Water Resources Research 39(5):1–19 doi:10.1029/2002WR001746
Vrugt JA, Robinson BA (2007) Improved evolutionary optimization from genetically adaptive multimethod search. In Proceedings of the National Academy of Sciences of the United States of America (PNAS), volume 104, pp 708–711
Wöhling Th, Vrugt JA (2008) Combining multiobjective optimization and Bayesian model averaging to calibrate forecast ensembles of soil hydraulic models. Water Resources Research 44(12):W12432
Wöhling Th, Vrugt JA (2011) Multiresponse multilayer vadose zone model calibration using Markov chain Monte Carlo simulation and field water retention data. Water Resources Research 47:W04510
Wöhling Th, Vrugt JA, Barkle GF (2008) Comparison of three multiobjective algorithms for inverse modeling of vadose zone hydraulic properties. Soil Science Society of America Journal 72(2):305–319
Yapo P, Gupta H, Sorooshian S (1998) Multi-objective global optimization for hydrologic models. Journal of Hydrology 204(1-4):83–97
Zhu J, Mohanty BP (2002) Spatial Averaging of van Genuchten Hydraulic Parameters for Steady-State Flow in Heterogeneous Soils: A Numerical Study. Vadose Zone J 1(2):261–272
Acknowledgments
This work was funded by the Helmholtz-Centre for Environmental Research, UFZ, and the Ministry for Science, Research and Arts, Baden-Württemberg, Germany.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wöhling, T., Samaniego, L. & Kumar, R. Evaluating multiple performance criteria to calibrate the distributed hydrological model of the upper Neckar catchment. Environ Earth Sci 69, 453–468 (2013). https://doi.org/10.1007/s12665-013-2306-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12665-013-2306-2