Abstract
We model an energy system with a storage device, a renewable energy source and with market access as a Markov decision process. We have identified four classes of pure policies (PFAs, CFAs, VFAs and lookaheads), each of which may work best depending on the characteristics of the system (volatility of prices, stationarity, accuracy of forecasts). We demonstrate that each of the four classes can work best on a particular instance of the problem. We describe the problem characteristics that bring out the best of each policy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Banos R, Manzano-Agugliaro F, Montoya F, Gil C, Alcayde A, Gomez J (2011) Optimization methods applied to renewable and sustainable energy: A review. Renewable and Sustainable Energy Reviews 15(4):1753–1766
Beaudin M, Zareipour H, Schellenberglabe A, Rosehart W (2010) Energy storage for mitigating the variability of renewable electricity sources: An updated review. Renewable and Sustainable Energy Reviews 14(4):302–314
Brown PD, Lopes JAP, Matos MA (2008) Optimization of pumped storage capacity in an isolated power system with large renewable penetration. IEEE Transactions on Power Systems 23(2):523–531
Garca-Gonzalez J, Moraga Ruiz de la Muela R, Matres Santos L, Mateo Gonzalez A (2008) Stochastic joint optimization of wind generation and pumped-storage units in an electricity market. IEEE Transactions on Power Systems 23(2):460–468
Harsha P, Dahleh M (2015) Optimal management and sizing of energy storage under dynamic pricing for the efficient integration of renewable energy. IEEE Transactions on Power Systems 30(3):1164–1181
Kall P, Wallace S (1994) Stochastic programming. John Wiley & Sons
Kim JH, Powell W (2011) Optimal energy commitments with storage and intermittent supply. Operations Research 59(6):1347–1360
Lai G, Margot F, Secommandi N (2010) An approximate dynamic programming approach to benchmark practice-based heuristics for natural gas storage valuation. Operations Research 58(3):564–582
Löhndorf N, Minner S (2010) Optimal day-ahead trading and storage of renewable energiesan approximate dynamic programming approach. Energy Systems 1(1):61–77
Löhndorf N, Wozabal D, Minner S (2013) Optimizing trading decisions for hydro storage systems using approximate dual dynamic programming. Operations Research 61(4):810–823
Lund PD, Lindgren J, Mikkola J, Salpakari J (2015) Review of energy system flexibility measures to enable high levels of variable renewable electricity. Renewable and Sustainable Energy Reviews 45(C):785–807
Meisel S (2011) Anticipatory Optimization for Dynamic Decision Making, Operations Research/Computer Science Interfaces Series, vol 51. Springer New York
Powell W (2011) Approximate Dynamic Programming: Solving the curses of dimensionality. John Wiley & Sons, Hoboken, NJ
Powell W, Meisel S (2016) Tutorial on stochastic optimization in energy I: Modeling and policies. IEEE Transactions on Power Systems 31(2):1459–1467
Powell W, Meisel S (2016) Tutorial on stochastic optimization in energy II: An energy storage illustration. IEEE Transactions on Power Systems 31(2):1468–1475
Puterman M (2005) Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Hoboken, NJ
Salas D, Powell W (2015) Benchmarking a scalable approximate dynamic programming algorithm for stochastic control of multidimensional energy storage problems. Tech. rep., Department of Operations Research and Financial Engineering, Princeton University
Xi X, Sioshansi R (2014) A stochastic dynamic programming model for co-optimization of distributed energy storage. Energy Systems 5(3):474–505
Acknowledgements
The work of the first author was supported by the German Academic Exchange Service (DAAD).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Meisel, S., Powell, W.B. (2017). Dynamic Decision Making in Energy Systems with Storage and Renewable Energy Sources. In: Bertsch, V., Fichtner, W., Heuveline, V., Leibfried, T. (eds) Advances in Energy System Optimization. Trends in Mathematics. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-51795-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-51795-7_6
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-319-51794-0
Online ISBN: 978-3-319-51795-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)