Skip to main content
Log in

A Stochastic Multi-agent Optimization Model for Energy Infrastructure Planning under Uncertainty in An Oligopolistic Market

  • Published:
Networks and Spatial Economics Aims and scope Submit manuscript

Abstract

This paper presents a mathematical model for analyzing long-term infrastructure investment decisions in a deregulated electricity market, such as the case in the United States. The interdependence between different decision entities in the system is captured in a network-based stochastic multi-agent optimization model, where new entrants of investors compete among themselves and with existing generators for natural resources, transmission capacities, and demand markets. To overcome computational challenges involved in stochastic multi-agent optimization problems, we have developed a solution method by combining stochastic decomposition and variational inequalities, which converts the original problem to many smaller problems that can be solved more easily.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Any node in the power grid can be an access point as long as there is supporting transmission infrastructure.

  2. For a small example illustrating these flow conservation constraints, please refer to Appendix 1.

  3. Note that since the wholesale prices depend on the production quantities, chain rule of differentiation should be used while taking derivatives to arrive at the VI.

  4. Symmetric assumption and separable investment cost are not required in our model and algorithm.

  5. For the same scenario-dependent problems, PATH, a general-purpose optimization solver for complementarity problems, was unable to obtain solutions.

  6. In this example, ISO is allowed to make short term revenues from transmission services. But eventually, this revenue will be used for transmission investment so that ISO keeps long term profit neutral.

References

  • Abrell J, Kunz F (2015) Integrating intermittent renewable wind generation - a stochastic multi-market electricity model for the european electricity market. Networks and Spatial Economics 15:117–147

    Article  Google Scholar 

  • Abrell J, Weigt H (2012) Combining energy networks. Networks and Spatial Economics 12:377–401

    Article  Google Scholar 

  • Bar-Gera H (2010) Traffic assignment by paired alternative segments. Transportation Research Part B 44:1022–1046

    Article  Google Scholar 

  • Birge JR, Louveaux F (2011) Introduction to stochastic programming. Springer

  • Bushnell JB, Mansur ET, Saravia C (2007) Vertical Arrangements, Market Structure, and Competition An Analysis of Restructured US Electricity Markets. Technical Report, National Bureau of Economic Research

  • CalISO (2013). About us. http://www.caiso.com/about/Pages/default.aspx

  • Chen C, Fan Y (2012) Bioethanol supply chain system planning under supply and demand uncertainties. Transportation Research Part E: Logistics and Transportation Review 48:150–164

    Article  Google Scholar 

  • Conejo AJ, Carrión M, Morales JM (2010) Decision making under uncertainty in electricity markets, vol 1. Springer

  • Cournot AA, Fisher I (1897) Researches into the Mathematical Principles of the Theory of Wealth, Macmillan Co.

  • Csercsik D (2015) Competition and cooperation in a bidding model of electrical energy trade. Networks and Spatial Economics:1–31. doi:10.1007/s11067-015-9310-x

  • Day CJ, Hobbs B, Pang JS (2002) Oligopolistic competition in power networks: a conjectured supply function approach. IEEE Transactions on Power Systems 17:597–607

    Article  Google Scholar 

  • Do Chung B, Yao T, Xie C, Thorsen A (2011) Robust optimization model for a dynamic network design problem under demand uncertainty. Networks and Spatial Economics 11:371–389

    Article  Google Scholar 

  • Fan Y, Liu C (2010) Solving stochastic transportation network protection problems using the progressive hedging-based method. Networks and Spatial Economics 10:193–208

    Article  Google Scholar 

  • Genc TS, Reynolds SS, Sen S (2007) Dynamic oligopolistic games under uncertainty: A stochastic programming approach. J Econ Dyn Control 31:55–80

    Article  Google Scholar 

  • Hamdouch Y, Qiang QP, Ghoudi K (2016) A closed-loop supply chain equilibrium model with random and price-sensitive demand and return. Networks and Spatial Economics:1–45. doi:10.1007/s11067-016-9333-y

  • Hearn DW, Yildirim MB (2002) A toll pricing framework for traffic assignment problems with elastic demand. Springer

  • Hobbs B, Metzler C, Pang JS (2000) Strategic gaming analysis for electric power systems: an mpec approach. IEEE Transactions on Power Systems 15:638–645. doi:10.1109/59.867153

    Article  Google Scholar 

  • Hobbs B, Drayton G, Fisher E, Lise W (2008) Improved transmission representations in oligopolistic market models: quadratic losses, phase shifters, and dc lines. IEEE Transactions on Power Systems 23:1018–1029

    Article  Google Scholar 

  • Hobbs B, Pang JS (2007) Nash-cournot equilibria in electric power markets with piecewise linear demand functions and joint constraints. Oper Res 55:113–127

    Article  Google Scholar 

  • Hu X, Ralph D, Ralph EK, Bardsley P, Ferris MC (2004) Electricity generation with looped transmission networks: Bidding to an ISO. Department of Applied Economics, University of Cambridge

  • IEA (2006) Wind Energy Annual Report. Technical Report. International Energy Association

  • Jofre A, Wets R (2014) Variational convergence of bifunctions: Motivating applications. SIAM J Optim. (to appear)

  • Kagiannas AG, Askounis DT, Psarras J (2004) Power generation planning: a survey from monopoly to competition. Int J Electr Power Energy Syst 26:413–421

    Article  Google Scholar 

  • Kazempour SJ, Conejo AJ (2012) Strategic generation investment under uncertainty via benders decomposition. IEEE Transactions on Power Systems 27:424–432

    Article  Google Scholar 

  • Kazempour SJ, Conejo AJ, Ruiz C (2013) Generation investment equilibria with strategic producers—part i: Formulation. IEEE Transactions on Power Systems 28:2613–2622

    Article  Google Scholar 

  • LeBlanc LJ, Morlok EK, Pierskalla WP (1975) An efficient approach to solving the road network equilibrium traffic assignment problem. Transp Res 9:309–318

    Article  Google Scholar 

  • Leuthold FU, Weigt H, Von Hirschhausen C (2012) A large-scale spatial optimization model of the european electricity market. Networks and spatial economics 12:75–107

    Article  Google Scholar 

  • Li M, Gabriel SA, Shim Y, Azarm S (2011) Interval uncertainty-based robust optimization for convex and non-convex quadratic programs with applications in network infrastructure planning. Networks and Spatial Economics 11:159–191

    Article  Google Scholar 

  • Liu Z, Nagurney A (2009) An integrated electric power supply chain and fuel market network framework: Theoretical modeling with empirical analysis for new england. Naval Research Logistics 56:600–624

    Article  Google Scholar 

  • Liu Z, Nagurney A (2011) Supply chain outsourcing under exchange rate risk and competition. Omega 39:539–549

    Article  Google Scholar 

  • Liu C, Fan Y, Ordóñez F (2009) A two-stage stochastic programming model for transportation network protection. Comput Oper Res 36:1582–1590

    Article  Google Scholar 

  • Løkketangen A., Woodruff D (1996) Progressive hedging and tabu search applied to mixed integer (0, 1) multistage stochastic programming. J Heuristics 2:111–128

    Article  Google Scholar 

  • Louveaux F (1986) Discrete stochastic location models. Ann Oper Res 6:21–34

    Article  Google Scholar 

  • Matsypura D, Nagurney A, Liu Z (2007) Modeling of electric power supply chain networks with fuel suppliers via variational inequalities. International Journal of Emerging Electric Power Systems 8

  • Melese Y, Heijnen P, Stikkelman R, Herder P (2016) An approach for integrating valuable flexibility during conceptual design of networks. Networks and Spatial Economics:1–25

  • Metzler C, Hobbs B, Pang JS (2003) Nash-cournot equilibria in power markets on a linearized dc network with arbitrage: Formulations and properties. Networks and Spatial Economics 3:123–150

    Article  Google Scholar 

  • Mulvey JM, Vladimirou H (1991) Applying the progressive hedging algorithm to stochastic generalized networks. Ann Oper Res 31:399–424

    Article  Google Scholar 

  • Mulvey JM, Vladimirou H (1992) Stochastic network programming for financial planning problems. Manage Sci 38:1642–1664. doi:10.1287/mnsc.38.11.1642

    Article  Google Scholar 

  • Murphy FH, Smeers Y (2005) Generation capacity expansion in imperfectly competitive restructured electricity markets. Oper Res 53:646–661

    Article  Google Scholar 

  • Murphy FH, Sherali HD, Soyster AL (1982) A mathematical-programming approach for determining oligopolistic market equilibrium. Math Program 24:92–106

    Article  Google Scholar 

  • Nagurney A (2006) On the relationship between supply chain and transportation network equilibria: A supernetwork equivalence with computations. Transportation Research Part E-Logistics and Transportation Review 42:293–316

    Article  Google Scholar 

  • Nagurney A, Matsypura D (2007) A supply chain network perspective for electric power generation, supply, transmission, and consumption. Springer, pp 3–27

  • Pineau PO, Murto P (2003) An oligopolistic investment model of the finnish electricity market. Ann Oper Res 121:123–148

    Article  Google Scholar 

  • Ralph D, Smeers Y (2006) Epecs as models for electricity markets. In: Power Systems Conference and Exposition. PSCE’06. 2006 IEEE PES. IEEE, pp 74–80

  • Rinaldi SM, Peerenboom JP, Kelly TK (2001) Identifying, understanding, and analyzing critical infrastructure interdependencies. IEEE Control Syst 21:11–25

    Article  Google Scholar 

  • Rockafellar R (1976) Augmented lagrangians and applications of the proximal point algorithm in convex programming. Math Oper Res 1:97–116

    Article  Google Scholar 

  • Rockafellar RT, Wets RJB (1991) Scenarios and policy aggregation in optimization under uncertainty. Math Oper Res 16:119–147

    Article  Google Scholar 

  • Ventosa M, Denis R, Redondo C (2002) Expansion planning in electricity markets. two different approaches. In: Proceeding of 14th PSCC, Sevilla, pp 24–28

  • Waston J, Woodruff D (2010) Progressive hedging innovations for a class of stochastic mixed-integer resource allocation problems. CMS 8:355–370

    Google Scholar 

  • Willems B, Rumiantseva I, Weigt H (2009) Cournot versus supply functions: What does the data tell us? Energy Econ 31:38–47

    Article  Google Scholar 

  • Wogrin S, Centeno E, Barquin J (2011) Generation capacity expansion in liberalized electricity markets: A stochastic mpec approach. IEEE Transactions on Power Systems 26:2526–2532

    Article  Google Scholar 

  • Wogrin S, Hobbs B, Ralph D, Centeno E, Barquín J (2013) O electricity markets under perfect and oligopolistic competition. Math Program B 140:295–322

    Article  Google Scholar 

Download references

Acknowledgments

This work is partially supported by the Sustainable Transportation Energy Pathways (STEPS) program and the National Transportation Center on Sustainability (NTCS) at University of California, Davis (UC Davis). The authors are grateful to Prof. Roger Wets at UC Davis and Mr. Obadiah Bartholomy at the Sacramento Municipal Utility District (SMUD) for helpful discussion.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yueyue Fan.

Appendices

Appendix 1: Small Example Illustrating Flow Conservation Constraint (3b)–(3e)

1.1 Network Structure

Fig. 9
figure 9

Small example structure

1.2 OD and Path Information

Table 7 Small example structure

1.3 Network Flow

figure h

1.4 Incidence Matrix

figure i

Appendix 2: Subroutine Pseudocode

figure j

Appendix 3: Data for Example 2

Table 8 Capacity cost data
Table 9 Generation cost data
Table 10 Demand function parameters d b and d a (demand function is d=−d a w + d b )
Table 11 Transmission capacity c t (link transmission cost function is ϕ t =10∗[1+(v/c t )4)]

Appendix 4: Calculation of \(\protect \frac {\partial \rho _{k^{\prime }}}{\partial {g_{i}^{j}}}\)

\({\partial \rho _{k^{\prime }}}/{\partial {g_{i}^{j}}}\) can be computed from the ISO’s optimization problem (3a), where ρ is the dual variables of constraint (3a) and g is parameters. \({\partial \rho _{k^{\prime }}}/{\partial {g_{i}^{j}}}\) is essentially the derivative of dual variables with respect to right-hand side constants. We use the standard notations for convex optimization with linear constraints:

$$\begin{array}{@{}rcl@{}} \min_{\boldsymbol{x}} && f(\boldsymbol{x}) \end{array} $$
(18a)
$$\begin{array}{@{}rcl@{}} \text{s.t.} \quad (\boldsymbol{\lambda}) && A\boldsymbol{x}=\boldsymbol{b} \end{array} $$
(18b)

where f(x) is a convex function and \(\boldsymbol {x} \in \mathbb {R}^{n}, \boldsymbol {\lambda }, \boldsymbol {b} \in \mathbb {R}^{m}\), to illustrate the calculating process and our goal is to calculate the Jacobian matrix J λ (b).

Lagrangian of problem (18b) is \(\mathcal {L} = f(\boldsymbol {x}) - \boldsymbol {\lambda }^{T}(A\boldsymbol {x}-\boldsymbol {b})\). The optimality conditions of problem (18b) is:

$$\begin{array}{@{}rcl@{}} \nabla f(\boldsymbol{x}) - A^{T}\boldsymbol{\lambda} &=& \boldsymbol{0} \end{array} $$
(19a)
$$\begin{array}{@{}rcl@{}} A\boldsymbol{x}-\boldsymbol{b} &=& \boldsymbol{0} \end{array} $$
(19b)

Take implicit derivatives of Eq. (4) with respect to b :

$$\begin{array}{@{}rcl@{}} \nabla^{2}_{\boldsymbol{x}} f(\boldsymbol{x}^{\ast}(\boldsymbol{b})) J_{\boldsymbol{x}}(\boldsymbol{b}) - A^{T} J_{\boldsymbol{\lambda}}(\boldsymbol{b}) &=& \boldsymbol{0} \end{array} $$
(20a)
$$\begin{array}{@{}rcl@{}} AJ_{\boldsymbol{x}}(\boldsymbol{b})-\boldsymbol{I} &=& \boldsymbol{0} \end{array} $$
(20b)

The unknown variables in Eq. 20a are two Jacobian matrices, J x (b) and J λ (b). The total number of equations is equal to the total number of variables in Eq. 20a, which is n m + m 2. Therefore, as long as these equations are consistent and independent, J λ (b) can be calculated uniquely. Clearly, if function f(x) is in quadratic form of x, \(\nabla ^{2}_{\boldsymbol {x}} f(\boldsymbol {x})\) then only involves constants, in which case J λ (b) can be computed analytically. For general form of f(x), one can solve J λ (b) numerically; one can take an initial guess of b based on historical data and then solve (20a) and Algorithm 2 iteratively until J λ (b) converged.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, Z., Fan, Y. A Stochastic Multi-agent Optimization Model for Energy Infrastructure Planning under Uncertainty in An Oligopolistic Market. Netw Spat Econ 17, 581–609 (2017). https://doi.org/10.1007/s11067-016-9336-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11067-016-9336-8

Keywords

Navigation