Abstract
The multistage stochastic variational inequality is reformulated into a variational inequality with separable structure through introducing a new variable. The prediction–correction ADMM which was originally proposed in He et al. (J Comput Math 24:693–710, 2006) for solving deterministic variational inequalities in finite-dimensional spaces is adapted to solve the multistage stochastic variational inequality. Weak convergence of the sequence generated by that algorithm is proved under the conditions of monotonicity and Lipschitz continuity. When the sample space is a finite set, the corresponding multistage stochastic variational inequality is actually defined on a finite-dimensional Hilbert space and the strong convergence of the algorithm naturally holds true. Some numerical examples are given to show the efficiency of the algorithm.
Similar content being viewed by others
References
Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhäuser, Boston (2009)
Borwein, J., Goebel, R.: Notions of relative interior in Banach spaces. J. Math. Sci. 115, 2542–2553 (2003)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)
Castaing, C., Valadier, M.: Convex Analysis and Measurable Multifunctions. Springer, Berlin (1977)
Chen, X., Fukushima, M.: Expected residual minimization method for stochastic linear complementarity problems. Math. Oper. Res. 30, 1022–1038 (2005)
Chen, X., Pong, T.K., Wets, R.J.-B.: Two-stage stochastic variational inequalities: an ERM-solution procedure. Math. Program. 165, 71–111 (2017)
Chen, X., Shapiro, A., Sun, H.: Convergence analysis of sample average approximation of two-stage stochastic generalized equations. SIAM J. Optim. 29, 135–161 (2019)
Chen, X., Sun, H., Xu, H.: Discrete approximation of two-stage stochastic and distributionally robust linear complementarity problems. Math. Program. 177, 255–289 (2019)
Chen, X., Wets, R.J.-B., Zhang, Y.: Stochastic variational inequalities: residual minimization smoothing sample average approximations. SIAM J. Optim. 22, 649–673 (2012)
Facchinei, F., Pang, J.-S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, vol. I. Springer, New York (2003)
Facchinei, F., Pang, J.-S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, vol. II. Springer, New York (2003)
Glowinski, R., Marrocco, A.: Sur l’approximation, par éléments finis d’ordre un, et la r solution, par pénalisation-dualité, d’une classe de problèmes de Dirichlet non linéaires. Rev. Française Automat. Informat. Recherche Opérationnelle Sér. Rouge Anal. Numér. (French) 9, 41–76 (1975)
Gürkan, G., Özge, A.Y., Robinson, S.M.: Sample-path solution of stochastic variational inequalities. Math. Program. 84, 313–333 (1999)
He, B.S.: My 20 years research on alternating directions method of multipliers. Oper. Res. Trans. Chin. 22, 1–31 (2018)
He, B.S., Liao, L.-Z., Qian, M.-J.: Alternating projection based prediction–correction methods for structured variational inequalities. J. Comput. Math. 24, 693–710 (2006)
Karatzas, I., Shreve, S.E.: Brownian Motion and Stochastic Calculus. Springer, New York (1991)
Li, X., Zhou, X.Y., Lim, A.E.B.: Dynamic mean-variance portfolio selection with no-shorting constraints. SIAM J. Control Optim. 40, 1540–1555 (2002)
Mordukhovich, B.S., Nam, N.M.: Convex Analysis and Beyond, vol. 1. Basic Theory. Springer, Cham (2022)
Mu, Z., Yang, J.: Convergence analysis of a stochastic progressive hedging algorithm for stochastic programming. Stat. Optim. Inf. Comput. 8, 656–667 (2020)
Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton (1970)
Rockafellar, R.T.: On the maximality of sums of nonlinear monotone operators. Trans. Am. Math. Soc. 149, 75–88 (1970)
Rockafellar, R.T., Sun, J.: Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging. Math. Program. 174, 453–471 (2019)
Rockafellar, R.T., Sun, J.: Solving Lagrangian variational inequalities with applications to stochastic programming. Math. Program. 181(Ser. B) 435–451 (2020)
Rockafellar, R.T., Wets, R.J.-B.: Stochastic convex programming: relatively complete recourse and induced feasibility. SIAM J. Control Optim. 14, 574–589 (1976)
Rockafellar, R.T., Wets, R.J.-B.: Scenario and policy aggregation in optimization under uncertainty. Math. Oper. Res. 16, 119–147 (1991)
Rockafellar, R.T., Wets, R.J.-B.: Stochastic variational inequalities: single-stage to multistage. Math. Program. 165, 331–360 (2017)
Shapiro, A., Dentcheva, D., Ruszczyński, A.: Lectures on Stochastic Programming, Modeling and theory, 2nd ed. Society for Industrial and Applied Mathematics (SIAM), Philadelphia (2014)
Shiryaev, A.N.: Probability. Springer, New York (1996)
Sun, H., Chen, X.: Two-stage stochastic variational inequalities: theory, algorithms and applications. J. Oper. Res. Soc. China 9, 1–32 (2021)
Sun, J., Xu, H., Zhang, M.: A new interpretation of the progressive hedging algorithm for multistage stochastic minimization problems. J. Ind. Manag. Optim. 16, 1655–1662 (2020)
Sun, J., Yang, X., Yao, Q., Zhang, M.: Risk minimization, regret minimization and progressive hedging algorithms. Math. Program. 181(Ser. B), 509–530 (2020)
Wang, T., Zhang, H.: Optimal control problems of forward–backward stochastic Volterra integral equations with closed control regions. SIAM J. Control Optim. 55, 2574–2602 (2017)
Yong, J., Zhou, X.Y.: Stochastic Controls: Hamiltonian Systems and HJB Equations. Springer, New York (1999)
Zhang, M., Sun, J., Xu, H.: Two-stage quadratic games under uncertainty and their solution by progressive hedging algorithms. SIAM J. Optim. 29, 1799–1818 (2019)
Acknowledgements
Both authors would like to thank the referees and the Associate Editor for their critical comments and helpful suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Xinmin Yang.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was supported by the NSF of China under Grants 12071324 and 11931011.
Appendix A: Proof of Lemma 2.5
Appendix A: Proof of Lemma 2.5
In the appendix, we shall give the proof of Lemma 2.5. The main idea of the proof comes from [32, Lemma 4.6].
Proof
It is clear that (2.10) implies (2.9). Then we only need to prove that the converse is also true.
Define
To prove that (2.10) holds, we only need to prove that \(P(A)=0\). Let
Then G is \({\mathscr {F}}\otimes {\mathscr {B}}(R^n)\)-measurable.By [4, Theorem III.23], A is \({\mathscr {F}}\)-measurable.
Take \(k,r=1,2,\cdots \), define
and
Here \({\bar{B}}(0,r)\) is the closed ball in \(R^n\) of center 0 and radius r. Similarly, \(A_{k,r}\) is \({\mathscr {F}}\)-measurable. In addition, \(\Phi _{k,r}\) is an \({\mathscr {F}}\)-measurable set-valued map and
To prove \(P(A)=0\), we only need to prove that for any k, r, \(P(A_{k,r})=0\). Assume that there exist k, r such that \(P(A_{k,r})>0\). By Lemma 2.2, there exists \(\eta \in {\mathcal {L}}^2(\Omega ,{\mathscr {F}},P)\) such that
Define \({\tilde{\eta }}=\eta \chi _{A_{k,r}}+x^* \chi _{\Omega {\setminus } A_{k,r}}\), then \({\tilde{\eta }}\in {\mathcal {C}}\), and
contradicting (2.9). Thus \(P(A)=0\). \(\square \)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
You, Z., Zhang, H. A Prediction–Correction ADMM for Multistage Stochastic Variational Inequalities. J Optim Theory Appl 199, 693–731 (2023). https://doi.org/10.1007/s10957-023-02296-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-023-02296-z
Keywords
- Multistage stochastic variational inequality
- Monotonicity
- Alternating direction method of multiplier
- Nonanticipativity
- Weak convergence