Abstract
For optimization problems involving probabilistic constraints it is important to be able to compute gradients of these constraints efficiently. For distribution functions of Gaussian random variables with positive definite covariance matrices, computing gradients can be done efficiently. Indeed, a formula, linking components of the partial derivative and other regular Gaussian distribution functions exists and has been frequently employed by Prékopa. Recently, Henrion and Möller provided not only sufficient conditions under which singular Gaussian distribution functions are differentiable, but also a formula akin to the regular case. The sufficient conditions, rule out a set of points having zero (Lebesgue) measure. We show here that in these points, the sub-differential (in the sense of Clarke) of a Gaussian distribution function can be fully characterized. We moreover provide sufficient and necessary conditions under which these distribution functions are differentiable.
Similar content being viewed by others
References
Clarke, F.H.: Optimisation and Nonsmooth Analysis. Classics in Applied Mathematics. Society for Industrial and Applied Mathematics (1987)
de Oliveira, W., Sagastizábal, C., Lemaréchal, C.: Convex proximal bundle methods in depth: a unified analysis for inexact oracles. Math. Program. Ser. B 148, 241–277 (2014)
Dentcheva, D.: Optimisation models with probabilistic constraints, chapter 4 in [25], MPS-SIAM series on optimization. SIAM and MPS, Philadelphia (2009)
Dentcheva, D., Martinez, G.: Regularization methods for optimization problems with probabilistic constraints. Math. Program. (series A) 138(1-2), 223–251 (2013)
Floudas, C.A.: In: Pardalos, P.M. (ed.): Encyclopedia of Optimization, 2nd edition. Springer (2009)
Genz, A.: Numerical computation of multivariate normal probabilities. J. Comp. Graph Stat. 1, 141–149 (1992)
Genz, A., Bretz, F.: Computation of multivariate normal and t probabilities. Number 195 in Lecture Notes in Statistics. Springer, Dordrecht (2009)
Henrion, R., Möller, A.: Optimization of a continuous distillation process under random inflow rate. Comput. Math. Appl. 45, 247–262 (2003)
Henrion, R., Möller, A.: A gradient formula for linear chance constraints under Gaussian distribution. Math. Oper. Res. 37, 475–488 (2012)
Henrion, R., Römisch, W.: Lipschitz and differentiability properties of quasi-concave and singular normal distribution functions. Ann. Oper. Res. 177, 115–125 (2010)
Hiriart-Urruty, J.B., Lemaréchal, C.: Convex analysis and Minimization Algorithms I. Number 305 in Grundlehren der mathematischen Wissenschaften. 2nd edition. Springer (1996)
Hiriart-Urruty, J.B., Lemaréchal, C.: Convex Analysis and Minimization Algorithms II. Number 306 in Grundlehren der mathematischen Wissenschaften. 2nd edition. Springer (1996)
Luedtke, J., Ahmed, S.: A sample approximation approach for optimization with probabilistic constraints. SIAM J. Optim. 19, 674–699 (2008)
Marti, K.: Differentiation of probability functions : The transformation method. Comput. Math. Appl. 30, 361–382 (1995)
Marti, K.: Differentiation of probability functions : The transformation method. Math. Program. 75(2), 201–220 (1996)
Mayer, J.: On the Numerical solution of jointly chance constrained problems, 1st edition. Chapter 12 in [30]. Springer (2000)
Morgan, D.R., Eheart, J.W., Valocchi, A.J.: Aquifer remediation design under uncertainty using a new chance constraint programming technique. Water Resour. Res. 29, 551–561 (1993)
Prėkopa, A.: On probabilistic constrained programming. In: H.W. Kuhn (ed.) Proceedings of the Princeton Symposium on Math. Prog., Vol. 28, pp 113–138 (1970)
Prėkopa, A.: Stochastic Programming. Kluwer, Dordrecht (1995)
Prékopa, A.: Probabilistic programming, in [24] (chapter 5). Elsevier, Amsterdam (2003)
Prékopa, A., Szántai, T.: Flood control reservoir system design using stochastic programming. Math. Program. 9, 138–151 (1978)
Prékopa, A., Szántai, T.: A new multivariate gamma distribution and its fitting to empirical streamflow data. Water Resour. Res. 14, 19–24 (1978)
Prékopa, A., Szántai, T.: On optimal regulation of a storage level with application to the water level regulation of a lake. Eur. J. Oper. Res. 3, 175–189 (1979)
Ruszczyński, A., Shapiro, A.: Stochastic Programming, volume 10 of Handbooks in Operations Research and Management Science. Elsevier, Amsterdam (2003)
Shapiro, A., Dentcheva, D., Ruszczyński, A.: Lectures on Stochastic Programming, Modeling and Theory, volume 9 of MPS-SIAM series on optimization. SIAM and MPS, Philadelphia (2009)
Szántai, T.: Numerical evaluation of probabilities concerning multi-dimensional probability distributions. Hungarian Academy of Sciences, PhD thesis (1985)
Uryas’ev, S.: Derivatives of probability functions and integrals over sets given by inequalities. J. Comput. Appl. Math. 56(1-2), 197–223 (1994)
Uryas’ev, S.: Derivatives of probability functions and some applications. Ann. Oper. Res. 56, 287–311 (1995)
Uryas’ev, S.: Derivatives of probability and Integral functions: General Theory and Examples Appearing in [5]. 2nd edition. Springer (2009)
Uryas’ev, S. (ed.): Probabilistic Constrained Optimization: Methodology and Applications. Kluwer Academic Publishers (2000)
van Ackooij, W., de Oliveira, W.: Level bundle methods for constrained convex optimization with various oracles. Comput. Optim. Appl. 57(3), 555–597 (2014)
van Ackooij, W., Henrion, R.: Gradient formulae for nonlinear probabilistic constraints with gaussian and gaussian-like distributions. SIAM J. Optim. 24(4), 1864–1889 (2014)
van Ackooij, W., Henrion, R., Möller, A., Zorgati, R.: Joint chance constrained programming for hydro reservoir management. Optimization and Engineering 15, 509–531 (2014)
van Ackooij, W., Sagastizábal, C.: Constrained bundle methods for upper inexact oracles with application to joint chance constrained energy problems. SIAM J. Sci. Comput. 24(2), 733–765 (2014)
van de Panne, C., Popp, W.: Minimum-cost cattle feed under probabilistic protein constraints. Manag. Sci. 9, 405–430 (1963)
Wilks, S.S.: Mathematical Statistics. John Wiley & Sons (1962)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
van Ackooij, W., Minoux, M. A Characterization of the Subdifferential of Singular Gaussian Distribution Functions. Set-Valued Var. Anal 23, 465–483 (2015). https://doi.org/10.1007/s11228-015-0317-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11228-015-0317-8