Abstract
One of the main methods for solving stochastic programs is approximation by discretizing the probability distribution. However, discretization may lose differentiability of expectational functionals. The complexity of discrete approximation schemes also increases exponentially as the dimension of the random vector increases. On the other hand, stochastic methods can solve stochastic programs with larger dimensions but their convergence is in the sense of probability one. In this paper, we study the differentiability property of stochastic two-stage programs and discuss continuous approximation methods for stochastic programs. We present several ways to calculate and estimate this derivative. We then design several continuous approximation schemes and study their convergence behavior and implementation. The methods include several types of truncation approximation, lower dimensional approximation and limited basis approximation.
Similar content being viewed by others
References
J. Birge, Decomposition and partitioning methods for multi-stage stochastic linear programs, Oper. Res. 33 (1985) 989–1007.
J.R. Birge and L. Qi, Computing block-angular Karmarkar projections with applications to stochastic programming, Manag. Sci. 34 (1988) 1472–1479.
J.R. Birge and L. Qi, Semiregularity and generalized subdifferentials with applications for optimization, Math. Oper. Res. 18 (1993) 982–1005.
J.R. Birge and L. Qi, Subdifferentials in approximation for stochastic programs, SIAM J. Optim., to appear.
J.R. Birge and S.W. Wallace, PA separable piecewise linear upper bound for stochastic linear programs, SIAM J. Contr. Optim. 26 (1988) 725–739.
J.R. Birge and R.J-B. Wets, Designing approximation schemes for stochastic optimization problems, in particular, for stochastic programs with recourse, Math. Progr. Study 27 (1986) 54–102.
J.R. Birge and R.J-B. Wets, Computing bounds for stochastic programming problems by means of a generalized moment problem, Math. Oper. Res. 12 (1987) 149–162.
J.R. Birge and R.J-B. Wets, Sublinear upper bounds for stochastic programs with recourse, Math. Progr. 43 (1989) 131–149.
F.H. Clarke,Optimization and Nonsmooth Analysis (Wiley, New York, 1983).
I. Deák, Three-digit accurate multiple normal probabilities, Numer. Math. 35 (1980) 369–380.
I. Deák,Random Number Generators and Simulation (Adadémiai Kiadó, Budapest, 1990).
Y. Ermoliev, Stochastic quasigradient methods and their application to system optimization, Stochastics 9 (1983) 1–36.
Y. Ermoliev and R. Wets,Numerical Techniques in Stochastic Programming (Springer, Berlin, 1988).
B.L. Fox, Implementation and relative efficiency of quasirandom sequence generators, ACM Trans. Math. Software 12 (1986) 362–376.
K. Frauendorfer,Stochastic Two-Stage Programming, Lecture Note Series (Springer, Berlin, 1992).
K. Frauendorfer and P. Kall, A solution method for SLP recourse problems with arbitrary multi-variate distributions — The independent case, Prob. Contr. Inf. Theory 17 (1988) 177–205.
H.I. Gassmann, Conditional probability and conditional expectation of a random vector, in:Numerical Techniques for Stochastic Optimization, eds. Y. Ermoliev and R. Wets (Springer, Berlin, 1988) pp. 237–254.
C.R. Givens and R.M. Shortt, A class of Wasserstein metrics for probability distributions, Michigan Math. J. 31 (1984) 231–240.
J.L. Higle and S. Sen, Stochastic decomposition: An algorithm for two-stage stochastic linear programs with recourse, Math. Oper. Res. 16 (1991) 650–669.
P. Kall,Stochastic Linear Programming (Springer, Berlin, 1976).
P. Kall, Stochastic programming — An introduction,6th Int. Conf. Stochastic Programming, Udine, Italy (September, 1992).
F.V. Louveaux and Y. Smeers, Optimal investments for electricity generation: A stochastic model and a test-problem, in:Numerical Techniques for Stochastic Optimization, eds. Y. Ermoliev and R. Wets (Springer, Berlin, 1988).
A. Prékopa, Boole-Bonferroni inequalities and linear programming, Oper. Res. 36 (1988) 145–162.
A. Prékopa and R.J-B. Wets,Stochastic Programming 84, Math. Progr. Study 27 & 28 (1986).
S.T. Rachev, The Monge-Kantorovich mass transference problem and its stochastic applications, Theory Probl. Appl. 29 (1984) 647–676.
W. Römisch and R. Schultz, Distribution sensitivity in stochastic programming, Math. Progr. 50 (1991) 197–226.
W. Römisch and R. Schultz, Stability analysis for stochastic programs, Ann. Oper. Res. 31 (1991) 241–266.
J. Wang, Distribution sensitivity analysis for stochastic programs with simple recourse, Math. Progr. 31 (1985) 286–297.
J. Wang, Lipschitz continuity of objective functions in stochastic programs with fixed recourse and its applications, Math. Progr. Study 27 (1986) 145–152.
R.J-B. Wets, Stochastic programming: Solution techniques and approximation schemes, in:Mathematical Programming: The State of the Art — Bonn 1982 eds. A. Bachem, M. Grötschel and B. Korte (Springer, Berlin, 1983) pp. 566–603.
Author information
Authors and Affiliations
Additional information
His work is supported by Office of Naval Research Grant N0014-86-K-0628 and the National Science Foundation under Grant ECS-8815101 and DDM-9215921.
His work is supported by the Australian Research Council.
Rights and permissions
About this article
Cite this article
Birge, J.R., Qi, L. Continuous approximation schemes for stochastic programs. Ann Oper Res 56, 15–38 (1995). https://doi.org/10.1007/BF02031698
Issue Date:
DOI: https://doi.org/10.1007/BF02031698