Abstract
A crucial challenge in future smart energy grids is the large-scale coordination of distributed energy generation and demand. In the last years several Demand Side Management approaches have been developed. A major drawback of these approaches is that they mainly focus on realtime control and not on planning, and hence cannot fully exploit the flexibility of e.g. electric vehicles over longer periods of time.
In this chapter we investigate the optimization of charging an electric vehicle (EV). More precisely, the problem of charging an EV overnight is formulated as a Stochastic Dynamic Programming (SDP) problem. We derive an analytic solution for this SDP problem which in turn leads to a simple short-term bidding strategy. From an MDP point of view this solution has a number of special features:
-
It leads to analytic optimal results based on order statistics.
-
It allows for a more practical rule which can be shown to be nearly optimal.
-
It is robust with respect to the modeling assumptions, showing little room for further improvement even when compared to a solution with perfect foresight.
Numerical results with real-world data from the Belgium network show a substantial performance improvement compared to standard demand side management strategies, without significant additional complexity. (This chapter is based on Kempker et al. (Proceedings of the 9th EAI international conference on performance evaluation methodologies and tools, Valuetools 2015, Berlin, 14–16 December 2015, pp 1–8, 2016).)
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
C. Block, D. Neumann, C. Weinhardt, A market mechanism for energy allocation in micro-CHP grids, in 41st Hawaii International Conference on System Sciences (2008), pp. 172–180
ELIA, Data download (2015). http://www.elia.be/nl/grid-data/data-download
P. Kempker, M. van Dijk, W. Scheinhardt, J. van den Berg, J. Hurink, Optimization of charging strategies for electric vehicles in powermatcher-driven smart energy grids, in Proceedings of the 9th EAI International Conference on Performance Evaluation Methodologies and Tools, Valuetools 2015, Berlin, 14–16 December 2015 (2016), pp. 1–8
K. Kok, The PowerMatcher: smart coordination for the smart electricity grid. Ph.D. thesis, Vrije Universiteit, Amsterdam, 2013
A. Molderink, V. Bakker, M. Bosman, J.L. Hurink, G.J.M. Smit, Management and control of domestic smart grid technology. IEEE Trans. Smart Grid 1 (2), 109–119 (2010)
A. Molderink, V. Bakker, J.L. Hurink, G.J.M. Smit, Comparing demand side management approaches, in IEEE PES Innovative Smart Grid Technologies Conference (ISGT Europe) (2012), pp. 1–8
J. Oyarzabal, J. Jimeno, J. Ruela, A. Englar, C. Hardt, Agent based micro grid management systems. in International Conference on Future Power Systems 2005. IEEE (2005), pp. 6–11
M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley, New York, 2014)
S. Rafiei, A. Bakhshai, A review on energy efficiency optimization in smart grid, in 38th Annual Conference on IEEE Industrial Electronics Society (IECON) (2012), pp. 5916–5919
V. Silva et al., Estimation of innovative operational processes and grid management for the integration of EV. Project deliverable D6.2 (2011)
Acknowledgements
We acknowledge the contributions of Yvonne Prins, Pamela MacDougall, Koen Kok, and Leon Kester (all affiliated with TNO) to the research leading to this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix
Appendix
1.1 Energy Terminology
Demand Side Management (DSM): Use of the flexibility of electric devices in households or offices to influence the electricity demand profile. Shiftable devices: Electricity consuming devices, for which the demand of electricity can be shifted in time. Examples are washing machines, dryers and dishwashers. Electric vehicles (EV): Vehicles like e.g., cars, busses, trucks or bicycles, which use electricity from batteries to drive or to support driving. PowerMatcher: A DSM technology using dynamic pricing and a hierarchical bidding process to support the matching of supply and demand of electricity.
1.2 Notation
S | State space (discrete/continuous) |
T | Number of periods, time t = 0, 1, . . . , T − 1 |
s t = (x t , p t ) | State, with: |
x t | Amount still to be charged after time t |
p t | Price per unit of energy at time t |
a t = u t | Action/amount to be charged at time t |
c a(s) = u t p t | Expected one step cost in state s t = (x t , p t ), under charge action a = u t |
A(s t ): u ≤ u max | Set of actions available in state s t |
δ t | Decision rule at time t: u t (x t , p t ) |
P(j | (s; a)) | \(\mathbb{P}(x_{t} - u_{t}\vert (x_{t},p_{t}))\) One step transition probability under action u t (x t , p t ) = u t in state s t = (x t , p t ) |
V t (s) | V t (x t , p t ) Optimal value function of expected cumulative costs over remaining T − t steps up to time T, starting in state s t = (x t , p t ) at time t |
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Kempker, P.L., van Dijk, N.M., Scheinhardt, W., van den Berg, H., Hurink, J. (2017). Smart Charging of Electric Vehicles. In: Boucherie, R., van Dijk, N. (eds) Markov Decision Processes in Practice. International Series in Operations Research & Management Science, vol 248. Springer, Cham. https://doi.org/10.1007/978-3-319-47766-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-47766-4_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47764-0
Online ISBN: 978-3-319-47766-4
eBook Packages: Business and ManagementBusiness and Management (R0)