Skip to main content
Log in

Convergence analysis of stationary points in sample average approximation of stochastic programs with second order stochastic dominance constraints

  • Full Length Paper
  • Series A
  • Published:
Mathematical Programming Submit manuscript

Abstract

Sample average approximation (SAA) method has recently been applied to solve stochastic programs with second order stochastic dominance (SSD) constraints. In particular, Hu et al. (Math Program 133:171–201, 2012) presented a detailed convergence analysis of \(\epsilon \)-optimal values and \(\epsilon \)-optimal solutions of sample average approximated stochastic programs with polyhedral SSD constraints. In this paper, we complement the existing research by presenting convergence analysis of stationary points when SAA is applied to a class of stochastic minimization problems with SSD constraints. Specifically, under some moderate conditions we prove that optimal solutions and stationary points obtained from solving sample average approximated problems converge with probability one to their true counterparts. Moreover, by exploiting some recent results on large deviation of random functions and sensitivity analysis of generalized equations, we derive exponential rate of convergence of stationary points.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhauser, Boston (1990)

    MATH  Google Scholar 

  2. Aumann, R.J.: Integrals of set-valued functions. J. Math. Anal. Appl. 12, 1–12 (1965)

    Article  MATH  MathSciNet  Google Scholar 

  3. Athreya, K.B., Lahiri, S.N.: Measure Theory and Probability Theory. Springer Texts in Statistics. Springer, New York (2006)

  4. Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer Series in Operations Research. Springer, New York (2000)

  5. Borwein, J.M.: Stability and regular points of inequality systems. J. Optim. Theory Appl. 48, 9–52 (1986)

    MATH  MathSciNet  Google Scholar 

  6. Borwein, J.M., Zhu, Q.J.: A survey of subdifferential calculus with applications. Nonlinear Anal. Ser. A Theory Methods 38, 687–773 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  7. Castaing, C., Valadier, M.: Convex Analysis and Measurable Multifunctions. Lecture Notes in Mathematics. Springer, Berlin (1977)

    Book  Google Scholar 

  8. Clarke, F.H.: Optimization and Nonsmooth Analysis. Wiley, New York (1983)

    MATH  Google Scholar 

  9. Conejo, A., Carrión, M., Morales, J.: Decision Making Under Uncertainty in Electricity Markets. Internation Series in Operations Research & Management Science. Springer, New York (2010)

    Book  Google Scholar 

  10. Dentcheva, D., Ruszczyński, A.: Optimization with stochastic dominance constraints. SIAM J. Optim. 14, 548–566 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  11. Dentcheva, D., Ruszczyński, A.: Optimality and duality theory for stochastic optimization problems with nonlinear dominance constraints. Math. Program. 99, 329–350 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  12. Dentcheva, D., Ruszczyński, A.: Portfolio optimization with stochastic dominance constraints. J. Banking Financ. 30, 433–451 (2006)

    Article  Google Scholar 

  13. Dentcheva, D., Ruszczyński, A.: Composite semi-infinite optimization. Control Cybern. 36, 1–14 (2007)

    Google Scholar 

  14. Dentcheva, D., Ruszczyński, A.: Risk-averse portfolio optimization via stochastic dominance constraints. In: Lee, C., Lee, A., Lee, J. (eds.) Handbook of Quantitative Finance and Risk Management, vol. 1. Springer, New York (2010)

    Google Scholar 

  15. Fábián, C., Mitra, G., Roman, D.: Processing second-order stochastic dominance models using cutting-plane representations. Math. Program. 130, 33–57 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  16. Gugat, M.: A parametric review on the Mangasarian–Fromovitz constraint qualification. Math. Program. 85, 643–653 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  17. Hess, C.: Set-Valued Integration and Set-Valued Probability Theory: An Overview, Handbook of Measure Theory, vol. 1-2. North-Holland, Amsterdam (2002)

    Google Scholar 

  18. Homem-de-Mello, T.: A cutting surface method for uncertain linear programs with polyhedral stochastic dominance constraints. SIAM J. Optim. 20, 1250–1273 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  19. Hu, J., Homem-de-Mello, T., Mehrotra, S.: Sample average approximation for stochastic dominance constrained programs. Math. Program. 133, 171–201 (2012)

    Google Scholar 

  20. Liu Y., Römisch W., Xu H.: Quantitative Stability Analysis of Stochastic Generalized Equations, manuscript (2011)

  21. Liu, Y., Xu, H., Lin, G.H.: Stability analysis of two stage stochastic mathematical programs with complementarity constraints via NLP-regularization. SIAM J. Optim. 21, 669–705 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  22. Liu, Y., Xu, H.: Stability and sensitivity analysis of stochastic programs with second order dominance constraints. Math. Program. first online (2012)

  23. Meskarian, R., Xu, H., Fliege, J.: Numerical methods for stochastic programs with second order dominance constraints with applications to portfolio optimization. Eur. J. Oper. Res. 216, 376–385 (2011)

    Article  MathSciNet  Google Scholar 

  24. Papageorgiou, N.S.: On the theory of banach space valued multifunctions. I: integration and conditional expectation. J. Multivar. Anal. 17, 185–206 (1985)

    Article  MATH  Google Scholar 

  25. Polak, E.: On the mathematical foundations of nondifferentiable optimization in engineering design. SIAM Rev. 29, 21–91 (1987)

    Article  MathSciNet  Google Scholar 

  26. Qi, L., Shapiro, A., Ling, C.: Differentiability and semismoothness properties of integral functions and their applications. Math. Program. 102, 223–248 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  27. Robinson, S.M.: Analysis of sample-path optimization. Math. Oper. Res. 21, 513–528 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  28. Rudolf, G., Ruszczyński, A.: Optimization problems with second order stochastic dominance constraints: duality, compact formulations, and cut generation methods. SIAM J. Optim. 19, 1326–1343 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  29. Rusczyński, A., Shapiro, A.: Stochastic programming models. In: Rusczyński, A., Shapiro, A. (eds.) Stochastic Programming, Handbooks in OR & MS, vol. 10. North-Holland Publishing Company, Amsterdam (2003)

    Google Scholar 

  30. Shapiro, A.: Monte Carlo sampling methods. In: Rusczyński, A., Shapiro, A. (eds.) Stochastic Programming, Handbooks in OR & MS, vol. 10. North-Holland Publishing Company, Amsterdam (2003)

    Google Scholar 

  31. Shapiro, A., Xu, H.: Uniform laws of large numbers for set-valued mappings and subdifferentials of random functions. J. Math. Anal. Appl. 325, 1390–1399 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  32. Shapiro, A., Xu, H.: Stochastic mathematical programs with equilibrium constraints, modelling and sample average approximation. Optimization 57, 395–418 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  33. Sun, H., Xu, H.: A note on uniform exponential convergence of sample average approximation of random functions. J. Math. Anal. Appl. 385, 698–708 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  34. Terán, P.: On a uniform law of large numbers for random sets and subdifferentials of random functions. Stat. Probab. Lett. 78, 42–49 (2008)

    Article  MATH  Google Scholar 

  35. Xu, H.: Uniform exponential convergence of sample average random functions under general sampling with applications in stochastic programming. J. Math. Anal. Appl. 368, 692–710 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  36. Xu, H., Zhang, D.: Monte Carlo methods for mean-risk optimization and portfolio selection. Comput. Manag. Sci. 9, 3–29 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  37. Ye, J.J.: Constraint qualifications and necessary optimality conditions for optimization problems with variational inequality constraints. SIAM J. Optim. 10, 943–962 (2000)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgments

The authors are grateful to the three anonymous referees for their insightful comments which have significantly helped improve the quality of the paper. They are also thankful to Professor Henry Wolkowicz for organizing an effective review.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huifu Xu.

Additional information

Dedicated to Professor Jon Borwein on the occasion of his 60th birthday.

The first author was supported by China Scholarship Council, the National Natural Science Foundation of China No. 11171159 and the Specialized Research Fund of Doctoral Program of Higher Education of China No. 20103207110002.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sun, H., Xu, H. Convergence analysis of stationary points in sample average approximation of stochastic programs with second order stochastic dominance constraints. Math. Program. 143, 31–59 (2014). https://doi.org/10.1007/s10107-013-0711-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10107-013-0711-7

Keywords

Mathematics Subject Classification (2000)

Navigation