Advertisement

Heterogeneous parallel computing accelerated generalized likelihood uncertainty estimation (GLUE) method for fast hydrological model uncertainty analysis purpose

  • Guangyuan KanEmail author
  • Xiaoyan He
  • Liuqian Ding
  • Jiren Li
  • Yang Hong
  • Ke Liang
Original Article

Abstract

The generalized likelihood uncertainty estimation (GLUE) is a famous and widely used sensitivity and uncertainty analysis method. It provides a new way to solve the “equifinality” problem encountered in the hydrological model parameter estimation. In this research, we focused on the computational efficiency issue of the GLUE method. Inspired by the emerging heterogeneous parallel computing technology, we parallelized the GLUE in algorithmic level and then implemented the parallel GLUE algorithm on a multi-core CPU and many-core GPU hybrid heterogeneous hardware system. The parallel GLUE was implemented using OpenMP and CUDA software ecosystems for multi-core CPU and many-core GPU systems, respectively. Application of the parallel GLUE for the Xinanjiang hydrological model parameter sensitivity analysis proved its much better computational efficiency than the traditional serial computing technology, and the correctness was also verified. The heterogeneous parallel computing accelerated GLUE method has very good application prospects for theoretical analysis and real-world applications.

Keywords

GLUE Xinanjiang model OpenMP CUDA GPU 

Notes

Acknowledgements

This research was funded by Beijing Natural Science Foundation (8184094), IWHR Research and Development Support Program (JZ0145B022018, JZ0145B022017), the Third Sub-Project: Flood Forecasting, Controlling and Flood Prevention Aided Software Development—Flood Control Early Warning Communication System and Flood Forecasting, Controlling and Flood Prevention Aided Software Development for Poyang Lake Area of Jiangxi Province (0628-136006104242, JZ0205A432013, SLXMB200902), and Construction project of Shaanxi province medium and small river hydrological monitoring and forecast system—construction of Guanzhong and north of Shaanxi flood forecast scheme (JZ0205A112015). We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Tesla K40 GPU used for this research.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no competing interests.

References

  1. 1.
    Barca E, Porcu E, Bruno D, Passarella G (2017) An automated decision support system for aided assessment of variogram models. Environ Model Softw 87:72–83CrossRefGoogle Scholar
  2. 2.
    Beven K, Binley A (1992) The future of distributed models: model calibration and predictive uncertainty. Hydrol Process 6:297–298Google Scholar
  3. 3.
    Beven K (1993) Prophecy, reality and uncertainty in distributed hydrological modeling. Adv Water Resour 16:41–51CrossRefGoogle Scholar
  4. 4.
    Beven K (2006) A manifesto for the equifinality thesis. J Hydrol 320(1–2):18–36CrossRefGoogle Scholar
  5. 5.
    Cameron D, Beven K, Tawn J, Blazkova S, Naden P (1999) Flood frequency estimation by continuous simulation for a gauged upland catchment (with uncertainty). J Hydrol 219:169–187CrossRefGoogle Scholar
  6. 6.
    Cameron D, Beven K, Tawn J (2001) Modelling extreme rainfalls using a modified random pulse Bartlett–Lewis stochastic rainfall model (with uncertainty). Adv Water Resour 24:203–211CrossRefGoogle Scholar
  7. 7.
    Campbell E, Fox D et al (1999) A Bayesian approach to parameter estimation and pooling in nonlinear flood event models. Water Resour Res 35(1):211–230CrossRefGoogle Scholar
  8. 8.
    Chen S, Kang E et al (2003) Review of the hydrological model researches. J Desert Res 23(3):221–229 (in Chinese) Google Scholar
  9. 9.
    Chen S, Kan G, Li J, Ke H, Liang K (2018) Investigation of China urban air condition using big data, information theory and machine learning, 2018. Polish J Environ Stud 27(2):565–578CrossRefGoogle Scholar
  10. 10.
    Chen Z, Hartmann A, Goldscheider N (2017) A new approach to evaluate spatiotemporal dynamics of controlling parameters in distributed environmental models. Environ Model Softw 87:1–16CrossRefGoogle Scholar
  11. 11.
    Dong J, Zheng C, Kan G, Wen J, Zhao M, Yu J (2015) Applying the ensemble artificial neural network-based hybrid data-driven model to daily total load forecasting. Neural Comput Appl 26(3):603–611CrossRefGoogle Scholar
  12. 12.
    Fan YR, Huang GH, Baetz BW, Li YP, Huang K, Li Z, Chen X, Xiong LH (2017) Parameter uncertainty and temporal dynamics of sensitivity for hydrologic models: A hybrid sequential data assimilation and probabilistic collocation method. Environ Model Softw 86:30–49CrossRefGoogle Scholar
  13. 13.
    Franks S, Gineste P, Beven K, Merot P (1998) On constraining the predictions of a distributed model: the incorporation of fuzzy estimates of saturated areas into the calibration process. Water Resour Res 34(4):787–797CrossRefGoogle Scholar
  14. 14.
    Costa D, Burlando P, Liong SY (2017) Coupling spatially distributed river and groundwater transport models to investigate contaminant dynamics at river corridor scales. Environ Model Softw 86:91–110CrossRefGoogle Scholar
  15. 15.
    Groeneveld J, Muller B, Buchmann CM, Dressler G, Guo C, Hase N, Hoffmann F, John F, Klassert C, Lauf T, Liebelt V, Nolzen H, Pannicke N, Schulze J, Weise H, Schwarz N (2017) Theoretical foundations of human decision-making in agent-based land use models—a review. Environ Model Softw 87:39–48CrossRefGoogle Scholar
  16. 16.
    Hornberger GM, Spear RC (1981) An approach to the preliminary analysis of environmental systems. J Environ Manag 12:7–18Google Scholar
  17. 17.
    Kan G, Yao C, Li Q, Li Z, Yu Z, Liu Z, Ding L, He X, Liang K (2015) Improving event-based rainfall-runoff simulation using an ensemble artificial neural network based hybrid data-driven model. Stoch Environ Res Risk Assess 29:1345–1370CrossRefGoogle Scholar
  18. 18.
    Kan G, Li J, Zhang X, Ding L, He X, Liang K, Jiang X, Ren M, Li H, Wang F, Zhang Z, Hu Y (2015) A new hybrid data-driven model for event-based rainfall-runoff simulation. Neural Comput Appl.  https://doi.org/10.1007/s00521-016-2200-4 CrossRefGoogle Scholar
  19. 19.
    Kan G, He X, Li J, Ding L, Zhang D, Lei T, Hong Y, Liang K, Zuo D, Bao Z, Zhang M (2016) A novel hybrid data-driven model for multi-input single-output system simulation. Neural Comput Appl.  https://doi.org/10.1007/s00521-016-2534-y CrossRefGoogle Scholar
  20. 20.
    Kan G, Liang K, Li J, Ding L, He X, Hu Y, Amo-Boateng M (2016) Accelerating the SCE-UA global optimization method based on multi-core CPU and many-core GPU. Adv Meteorol 2016:8483728.  https://doi.org/10.1155/2016/8483728 CrossRefGoogle Scholar
  21. 21.
    Kan G, Lei T, Liang K, Li J, Ding L, He X, Yu H, Zhang D, Zuo D, Bao Z,, Hu Y, Zhang M (2016) Mark Amo-boateng. A multi-core CPU and many-core GPU based fast parallel shuffled complex evolution global optimization approach. IEEE Trans Parallel Distrib Syst.  https://doi.org/10.1109/TPDS.2016.2575822 CrossRefGoogle Scholar
  22. 22.
    Kan G, Zhang M, Liang K, Wang H, Jiang Y, Li J, Ding L, He X, Hong Y, Zuo D, Bao Z, Li C (2016) Improving water quantity simulation and forecasting to solve the energy-water-food nexus issue by using heterogeneous computing accelerated global optimization method. Appl Energy.  https://doi.org/10.1016/j.apenergy.2016.08.017 CrossRefGoogle Scholar
  23. 23.
    Kan G, He X, Li J, Ding L, Hong Y, Zhang H, Liang K, Zhang M (2017) Computer aided numerical methods for hydrological model calibration: an overview and recent development. Arch Comput Methods Eng.  https://doi.org/10.1007/s11831-017-9224-5 CrossRefGoogle Scholar
  24. 24.
    Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) Study on applicability of conceptual hydrological models for flood forecasting in humid, semi-humid semi-arid and arid basins in China. Water 9(10):719CrossRefGoogle Scholar
  25. 25.
    Kan G, Tang G, Yang Y, Hong Y, Li J, Ding L, He X, Liang K, He L, Li Z, Hu Y, Cui Y (2017) An improved coupled routing and excess storage (CREST) distributed hydrological model and its verification in Ganjiang river basin, China. Water 9(11):904CrossRefGoogle Scholar
  26. 26.
    Kan G, He X, Ding L, Li J, Liang K, Hong Y (2017) A heterogeneous computing accelerated SCE-UA global optimization method using OpenMP, CUDA and OpenACC. Water Sci Technol 76(7):1640–1651CrossRefGoogle Scholar
  27. 27.
    Kan G, He X, Ding L, Li J, Hong Y, Ren M, Lei T, Liang K, Zuo D, Huang P (2017) Daily streamflow simulation based on improved machine learning method. Tecnologia y Ciencias del Agua 8(2):51–60CrossRefGoogle Scholar
  28. 28.
    Kan G, He X, Ding L, Li J, Hong Y, Zuo D, Ren M, Lei T, Liang K (2018) Fast hydrological model calibration based on the heterogeneous parallel computing accelerated shuffled complex evolution method. Eng Optim 50(1):106–449MathSciNetCrossRefGoogle Scholar
  29. 29.
    Li C, Cheng X, Li N, Du X, Yu Q, Kan G (2016) A framework for flood risk analysis and benefit assessment of flood control measures in urban areas. Int J Environ Res Public Health 13:787.  https://doi.org/10.3390/ijerph13080787 CrossRefGoogle Scholar
  30. 30.
    Li K, Kan G, Ding L, Dong Q, Liu K, Liang L (2018) A novel flood forecasting method based on initial state variable correction. Water 10(1):12CrossRefGoogle Scholar
  31. 31.
    Li Z, Kan G, Yao C, Liu Z, Li Q, Yu S (2014) An improved neural network model and its application in hydrological simulation. J Hydrol Eng 19(10):04014019CrossRefGoogle Scholar
  32. 32.
    Liu W, Chen Y, Wu C (2016) OpenCL heterogeneous parallel computing: from principle to practice. China Machine Press, Beijing (in Chinese) Google Scholar
  33. 33.
    Locatelli T, Tarantola S, Gardiner B, Patenaude G (2017) Variance-based sensitivity analysis of a wind risk model—model behavior and lessons for forest modelling. Environ Model Softw 87:84–109CrossRefGoogle Scholar
  34. 34.
    Mo X, Beven K (2004) Multi-objective parameter conditioning of a three-source wheat canopy model. Agric For Meteorol 122:39–63CrossRefGoogle Scholar
  35. 35.
    Ratto M, Tarantola S, Saltelli A (2001) Sensitivity analysis in model calibration: GSA-GLUE approach. Comput Phys Commun 126:212–224CrossRefGoogle Scholar
  36. 36.
    Susan K, Beven K (1999) Equifinality, sensitivity and predictive uncertainty in the estimation of critical loads. Sci Total Environ 236:191–214CrossRefGoogle Scholar
  37. 37.
    Tan B (1996) Comparison and analysis of hydrological model parameter automatic optimization methods. J China Hydrol 5:8–14 (in Chinese) Google Scholar
  38. 38.
    Uhlenbrook S, Sieber A (2005) On the value of experimental data to reduce the prediction uncertainty of a process-oriented catchment model. Environ Model Softw 20:19–32CrossRefGoogle Scholar
  39. 39.
    Wu YP, Liu SG, Qiu LJ, Sun YZ (2017) SWAT-DayCent coupler: An integration tool for simultaneous hydro-biogeochemical modelling using SWAT and DayCent. Environ Model Softw 86:81–90CrossRefGoogle Scholar
  40. 40.
    Zhao R (1983) Watershed hydrological model-Xinanjiang model and Northern Shaanxi model. Water Resources and Electric Power Press, BeijingGoogle Scholar
  41. 41.
    Zhao R (1994) Anthology of hydrological forecasting. Water Resources and Electric Power Press, BeijingGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Guangyuan Kan
    • 1
    • 2
    Email author
  • Xiaoyan He
    • 1
  • Liuqian Ding
    • 1
  • Jiren Li
    • 1
  • Yang Hong
    • 2
    • 3
  • Ke Liang
    • 4
  1. 1.State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin, Research Center on Flood and Drought Disaster Reduction of the Ministry of Water ResourcesChina Institute of Water Resources and Hydropower ResearchBeijingPeople’s Republic of China
  2. 2.State Key Laboratory of Hydroscience and Engineering, Department of Hydraulic EngineeringTsinghua UniversityBeijingPeople’s Republic of China
  3. 3.Hydrometeorology and Remote Sensing (HyDROS) Laboratory, School Civil Engineering and Environmental Science, and Advanced Radar Research CenterUniversity of OklahomaNormanUSA
  4. 4.State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin, China Institute of Water Resources and Hydropower ResearchBeijing IWHR CorporationBeijingPeople’s Republic of China

Personalised recommendations