Skip to main content
Log in

Integrated Artificial Neural Network (ANN) and Stochastic Dynamic Programming (SDP) Model for Optimal Release Policy

  • Published:
Water Resources Management Aims and scope Submit manuscript

Abstract

Complexicity in reservoir operation poses serious challenges to water resources planners and managers. These challenges of water reservoir operation are illustrated using a simulation to aid the development of an optimal operation policy for dam and reservoir. To achieve this, a Comprehensive Stochastic Dynamic Programming with Artificial Neural Network (SDP-ANN) model were developed and tested at Sg. Langat Reservoir in Malaysia. The nonlinearity of the natural physical processes was a major problem in determining the simulation of the reservoir parameters (elevation, surface-area, storage). To overcome water shortages resulting from uncertainty, the SDP-ANN model was used to evaluate the input variable and the performance outcome of the Model were compared with the Stochastic Dynamic Programming integrated with auto-regression (SDP-AR) model. The objective function of the models was set to minimize the sum of squared deviation from the desired targeted supply. Comparison result on the performance between SDP-AR model policy with SDP-ANN model found that the SDP-ANN model is a reliable and resilience model with a lesser supply deficit. The study concludes that the SDP-ANN model performs better than the SDP-AR model in deriving an optimal operating policy for the reservoir.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Ahmadi A, Karamouz M, Moridi A (2010) Robust methods for identifying optimal reservoir operation strategies using deterministic and stochastic formulations. Water Resour Manag 24(11):2527–2552

    Article  Google Scholar 

  • Barron AR (1993) Universal approximation bounds for superposition of a sigmoid al function. IEEE Trans Inf Theory 39:930–945

    Article  Google Scholar 

  • Brandão JL (2010) Performance of the equivalent reservoir modelling technique for multi-reservoir hydropower systems. Water Resour Manag 24(12):3101–3114

    Article  Google Scholar 

  • Chandramouli V, Deka P (2005) Neural network based decision support model for optimal reservoir operation. Water Resour Manag 19(4):447–464

    Article  Google Scholar 

  • Chang NB (2005) Sustainable water resources management under uncertainty. Stoch Environ Resour Risk Assess 9(2):97–98

    Article  Google Scholar 

  • Chen SC, Cowan FN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2(2):302–309

    Article  Google Scholar 

  • EL-Shafie A, El-Manadely MS (2011) An integrated neural network stochastic dynamic programming model for optimizing the operation policy of Aswan High Dam. Hydrol Res 42(1):50–67

    Article  Google Scholar 

  • Eum H, Simonovic SP (2010) Integrated reservoir management system for adaptation to climate change: the nakdong river basin in Korea. Water Resour Manag 24(13):3397–3417

    Article  Google Scholar 

  • Eum H, Vasan A, Simonovic SP (2012) Integrated reservoir management system for flood risk assessment under climate change. Water Resour Manag 26(13):3785–3802

    Article  Google Scholar 

  • Fausett L (1994) Fundamentals of neural networks. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Fayaed S, El-Shafie A, Jaafar O (2011) Adaptive neuro-fuzzy inference system–based model for elevation–surface area–storage interrelationships. Neural Comput & Applic 22(5):987–998

    Google Scholar 

  • Flood I, Kartam N (1994) Neural networks in civil engineering. I: principles and understanding. J Comput Civ Eng 8(2):131–148

    Article  Google Scholar 

  • Hashimoto T, Loucks DP, Stedinger J (1982) Reliability, resilience and vulnerability for water resources system performance evaluation. Water Resour Res 18(1):14–20

    Article  Google Scholar 

  • Homayounfar M, Ganji A, Martinez CJ (2011) A novel solution for stochastic dynamic game of water allocation from a reservoir using collocation method. Water Resour Manag 25(13):3427–3444

    Article  Google Scholar 

  • Jinno K, Zongxue X, Kawamura A, Tajiri K (1995) Risk assessment of a water supply system during drought. Water Resour Dev 11(2):185–204

    Article  Google Scholar 

  • Johnson D, King M (1988) Basic forecasting techniques. Butterworth, London

    Google Scholar 

  • Jothiprakash V, Shanthi G (2006) Single reservoir operating policies using genetic algorithm. Water Resour Manag 20:917–929

    Article  Google Scholar 

  • Karamouz M, Houck MH (1987) Comparison of stochastic and deterministic dynamic programming for reservoir operating rule generation. Water Resour Bull 23(1):1–8

    Article  Google Scholar 

  • Kothari R, Agyepong K (1996) On lateral connections in feedforward neural networks. Proc., IEEE Int. Conf. on Neural Networks, Institute of Electrical and Electronics Engineers, New York. 13–18

  • Kumar ARS, Goyal MK, Ojha CSP, Singh RD, Swamee PK, Nema R (2013) Application of ANN, fuzzy logic and decision tree algorithms for the development of reservoir operating rules. Water Resour Manag 27(3):911–925

    Article  Google Scholar 

  • Labadie JW (2004) Optimal operation of multi-reservoir systems: State-of-the-art review. J Water Resour Plan Manag ASCE 130(2):93–111

    Article  Google Scholar 

  • Li YP, Huang GH, Nie SL (2006) An interval-parameter multistage stochastic programming model for water resources management under uncertainty. Adv Water Resour 29:776–789

    Article  Google Scholar 

  • Li YP, Huang GH, Nie SL, Liu L (2008) Inexact multistage stochastic integer programming for water resources management under uncertainty. J Environ Manag 88(1):93–107

    Article  Google Scholar 

  • Li L, Xu H, Chen X, Simonovic SP (2010) Streamflow forecast and reservoir operation performance assessment under climate change. Water Resour Manag 24(1):83–104

    Article  Google Scholar 

  • Li FF, Wei JH, Fu XD, Wan XY (2012) An effective approach to long-term optimal operation of large-scale reservoir systems: case study of the three gorges system. Water Resour Manag 26(14):4073–4090

    Article  Google Scholar 

  • Lv Y, Huang GH, Li YP, Yang ZF, Liu Y, Cheng GH (2010) Planning regional water resources system using an interval fuzzy bi-level programming method. J Environ Inform 16(2):43–56

    Article  Google Scholar 

  • Maqsood I, Huang GH, Huang YF, Chen B (2005) ITOM: an interval parameter two-stage optimization model for stochastic planning of water resources systems. Stoch Environ Resour Risk Assess 19(2):125–133

    Article  Google Scholar 

  • McCulloch WS, Pitts W (1943) A logic calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133

    Article  Google Scholar 

  • Michalland B, Parent E, Duckstein L (1997) Bi-objective dynamic programming for trading off hydropower and irrigation. Appl Math Comput 88(1):53–76

    Article  Google Scholar 

  • Moy WS, Cohon JL, ReVelle CS (1986) A programming model for analysis of the reliability, resilience, and vulnerability of a water supply reservoir. Water Resour Res 22(4):489–498

    Article  Google Scholar 

  • Najah AA, El-Shafie A, Karim OA, Jaafar O (2012) Water quality prediction model utilizing integrated wavelet-ANFIS model with cross-validation. Neural Comput & Applic 21:833–841

    Article  Google Scholar 

  • Olsson O, Ikramova M, Bauer M, Froebrich J (2010) Applicability of Adapted Reservoir Operation for Water Stress Mitigation Under Dry Year Conditions. Water Resour Manag 24(2):277–297

    Article  Google Scholar 

  • Ostadrahimi L, Mariño MA, Afshar A (2012) Multi-reservoir operation rules: multi-swarm PSO-based optimization approach. Water Resour Manag 26(2):407–427

    Article  Google Scholar 

  • Rani D, Moreira MM (2010) Simulation–optimization modeling: a survey and potential application in reservoir systems operation. Water Resour Manag 24(6):1107–1138.33

    Article  Google Scholar 

  • Shahin M, Van Oorschot HJL, De Lange SJ (1993) Statistical analysis in water resources engineering. A. AaBalkema, Rotterdam

    Google Scholar 

  • Simonovic SP (1992) Reservoir systems analysis: closing gap between theory and practice. J Water Resour Plan Manag 118(3):262–80

    Article  Google Scholar 

  • Sreekanth J, Datta B, Mohapatra PK (2012) Optimal short-term reservoir operation with integrated long-term goals. Water Resour Manag 26(10):2833–2850

    Article  Google Scholar 

  • Ticlavilca AM, McKee M (2011) Multivariate Bayesian regression approach to forecast releases from a system of multiple reservoirs. Water Resour Manag 25(2):523–543

    Article  Google Scholar 

  • Wang H, Liu J (2013) Reservoir operation incorporating hedging rules and operational inflow forecasts. Water Resour Manag 27(5):1427–1438

    Article  Google Scholar 

  • Wang Y, Chang JX, Huang Q (2010) Simulation with RBF neural network model for reservoir operation rules. Water Resour Manag 24(11):2597–2610

    Article  Google Scholar 

  • Wurbs R (1993) Reservoir system simulation and optimization models. J Water Resour Plan Manag ASCE 119(4):455–472

    Article  Google Scholar 

  • Yeh W (1985) Reservoir management and operation models: a state-of-the-art review. Water Resour Res 21(12):1797–1818

    Article  Google Scholar 

  • Zarghami M, Szidarovszky F (2009) Stochastic-fuzzy multi criteria decision making for robust water resources management. Stoch Environ Resour Risk Assess 23(3):329–339

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by a research grant to the second author by Ministry of Higher Education, University Kebangsaan Malaysia, and project leader FRGS/1/2012/TK03/UKM/02/4. The authors would like to thank the Puncak Niaga (M) SDN BHD for providing the data for Sg. Langat reservoir.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sabah S. Fayaed.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fayaed, S.S., El-Shafie, A. & Jaafar, O. Integrated Artificial Neural Network (ANN) and Stochastic Dynamic Programming (SDP) Model for Optimal Release Policy. Water Resour Manage 27, 3679–3696 (2013). https://doi.org/10.1007/s11269-013-0373-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11269-013-0373-5

Keywords

Navigation