Abstract
The present paper is devoted to the computation of the Lipschitz modulus of the optimal value function restricted to its domain in linear programming under different types of perturbations. In the first stage, we study separately perturbations of the right-hand side of the constraints and perturbations of the coefficients of the objective function. Secondly, we deal with canonical perturbations, i.e., right-hand side perturbations together with linear perturbations of the objective. We advance that an exact formula for the Lipschitz modulus in the context of right-hand side perturbations is provided, and lower and upper estimates for the corresponding moduli are also established in the other two perturbation frameworks. In both cases, the corresponding upper estimates are shown to provide the exact moduli when the nominal (original) optimal set is bounded. A key strategy here consists in taking advantage of the background on calmness in linear programming and providing the aimed Lipschitz modulus through the computation of a uniform calmness constant.
Introduction
This paper deals with the Lipschitz continuity of the optimal value in linear programming (LP for short). Specifically, we consider the optimal value function restricted to its domain (where the value is finite), denoted by \(\vartheta ^{R},\) and analyze its behavior around a fixed (referred to as nominal) LP problem. Along this work different type of perturbations of the nominal problem are considered and, in each of these perturbation frameworks, our goal is to compute (or at least estimate) the Lipschitz modulus of the corresponding optimal value (see Sects. 2.1 and 2.2 for the formal definitions). Roughly speaking, this Lipschitz modulus provides a local measure of the greatest rate of variation of the optimal value with respect to data perturbations. In this sense, the present research is focussed on a local aspect of the sensitivity analysis in LP, in contrast to the classical theory of parametric linear optimization (see, e.g., [1] and [2]).
First, we consider the case of right-hand-side (RHS in brief) perturbations of the constraints, where a formula for the exact Lipschitz modulus of \(\vartheta ^{R}\) at a nominal problem is obtained. Secondly, we deal with linear perturbations of the objective function (c-perturbations, for simplicity). After that, we tackle the problem of computing the Lipschitz modulus of \(\vartheta ^{R}\) in the setting of the so-called canonical perturbations, i.e., RHS perturbations together with c-perturbations. In the last two settings, lower and upper estimates for the aimed moduli are derived. In both cases the upper estimates turn out to be the exact moduli when the nominal optimal set is bounded.
The systematic study of stability in LP with canonical perturbations started in the 1970s. Specifically, the continuity of \(\vartheta ^{R}\ \)was proved through different approaches (see [3,4,5,6]). One can find a second line of research based on variational analysis like Berge’s theory or Hoffman’s error bounds; see [4, 6,7,8,9,10,11,12].
The immediate antecedents of this work can be traced out from [13] and [14]. The first one, instead of \(\vartheta ^{R},\) deals with the optimal value function, \(\vartheta ,\) defined on the whole space (and, so, taking values in the extended real line). As a counterpart, the local study is made around a problem which is in the interior of the domain of \(\vartheta \). This interiority condition characterizes the Lipschitz continuity of \(\vartheta \) at such a problem (this fact is held in the more general setting of linear semi-infinite optimization; see [15, Lemma 10.2]) and it is equivalent to the well-known Slater constraint qualification together with the boundedness (and nonemptiness) of the nominal optimal set. Specifically, [13, Theorem 4.3] provides a formula for a particular Lipschitz constant for \(\vartheta \) in terms of the so-called distance to ill-posedness. (See also the pioneer works [16] and [17], developed in the context of conic linear problems.) Let us point out that the new results of the current paper constitute an improvement of [13, Theorem 4.3] in different directions: first, here we do not require any interiority assumption; moreover, the Lipschitz modulus provides—roughly speaking—the more accurate Lipschitz constant; and, finally, we also tackle the case of partial perturbations (RHS or c-perturbations).
Paper [14] is focussed on the calmness of \(\vartheta ^{R}\), which is known to be a weaker property than Lipschitz continuity. In that paper, the calmness of \(\vartheta ^{R}\) is approached through the calmness from above and calmness from below, which roughly speaking, measure the local rate of increase and decrease, respectively, with respect to the nominal problem. While calmness property compares the nominal optimal value with the optimal value of a perturbed problem, Lipschitz property involves the optimal values of two different perturbed problems around the nominal one. This fact entails notable differences between both properties and their moduli. In particular, the new contributions of the current paper are not direct consequences of the ones of [14], as we shall emphasize in the corresponding proofs. In any case, we take advantage of the background on calmness. In particular, a key strategy (inspired by [18, Section 2]) based on computing the aimed Lipschitz modulus through a uniform calmness constant is appealed to.
Finally, let us comment that both calmness and Lipschitz properties have extensions for multifunctions, closely related to metric regularity notions, which are important concepts in the field of variational analysis; see the monographs [19,20,21,22] for additional references and details. The analysis of pseudo-Lipschitz (Aubin) property for the particular case of the argmin mapping (resp. the feasible set mapping) has been addressed in [23, 24] (resp. [25]).
The structure of the paper is as follows. Section 2 introduces the model we are dealing with, the main goals of this work, as well as the necessary notation and preliminary results on calmness (from [14]) which are used later on. Section 3 is devoted to the study of the Lipschitz modulus of \(\vartheta ^{R}\) under RHS perturbations. The main result of this section is Theorem 3.1. Section 4 is developed in the context of c-perturbations, and mainly consists of Theorem 4.1, where the announced lower and upper estimates (exact value when the nominal optimal set is nonempty and bounded) for the aimed modulus are provided. Section 5 deals with canonical perturbations. Theorem 5.1 provides a lower estimate of the corresponding Lipschitz modulus, while Theorem 5.2 provides an upper estimate based on a certain uniform calmness constant which is established in Lemma 5.1. The last theorem also provides the exact Lipschitz modulus under the boundedness (and nonemptiness) of the nominal optimal set. Finally, Sect. 6 gathers some conclusions.
Preliminaries and Main Goals
This section is devoted to formalize the main goal of the paper and to connect it with the immediate antecedents. The section is divided into three subsections: First, we introduce the parameterized optimization model and the mappings which are dealt with in the paper; secondly, we make precise the main goal of this work, which consists in computing (or estimating) the Lipschitz modulus of the optimal value function under different type of perturbations. The third subsection gathers some results about calmness of the same function traced out from [14].
The Parameterized Model
We consider a parameterized linear optimization problem, in \(\mathbb {R}^{n},\) given in the form
where \(x\in \mathbb {R}^{n}\) is the vector of decision variables, \(\overline{a }\equiv (\overline{a}_{t})_{t\in T}\in (\mathbb {R}^{n})^{T}\) is fixed, \(c\in \mathbb {R}^{n}\) and \(b\equiv (b_{t})_{t\in T}\in \mathbb {R}^{T}\). Any \(z\in \mathbb {R}^{n}\) is considered as a column vector and \(z^{\prime }\) denotes its transpose. Our problem \(\pi \) is identified with the pair \(\left( c,b\right) \in \mathbb {R}^{n}\times \mathbb {R}^{T},\) which constitutes our parameter to be perturbed. So, as mentioned above, we are working in the setting of the so-called canonical perturbations.
The space of variables, \(\mathbb {R}^{n},\) is endowed with an arbitrary norm, \(\left\| \cdot \right\| ,\) while the parameter space \(\mathbb {R} ^{n}\times \mathbb {R}^{T}\) is endowed with the norm
where \(\left\| u\right\| _{*}:=\max _{\left\| x\right\| \le 1}\left| u^{\prime }x\right| ,\) and \(\left\| b\right\| _{\infty }:=\max _{t\in T}|b_{t}|\). Observe that, in relation to vector c of the objective function, we use the dual norm since it is seen as a functional.
Along the paper we deal with the following mappings: The feasible set mapping, \(\mathcal {F}:\mathbb {R}^{T}\rightrightarrows \mathbb {R} ^{n}\), defined as
the optimal value function, \(\vartheta :\mathbb {R}^{n}\times \mathbb {R }^{T}\rightarrow [-\infty ,+\infty ]\), given by
(with the convention \(\vartheta (\pi ):=+\infty \) when \(\mathcal {F} (b)=\emptyset );\) and the optimal set mapping, \(\mathcal {F}^{\mathrm{op}}: \mathbb {R}^{n}\times \mathbb {R}^{T}\rightrightarrows \mathbb {R}^{n}\), which assigns to each problem \(\pi \equiv \left( c,b\right) \) its optimal set
The domain of \(\mathcal {F},\) denoted by dom\(\mathcal {F},\) is formed by all \(b\in \mathbb {R}^{T}\), whose associated linear inequality systems are consistent; formally,
Analogously, the domain of \(\mathcal {F}^{\mathrm{op}},\) dom\(\mathcal {F}^{\mathrm{op}}, \) is formed by all problems \(\pi \equiv \left( c,b\right) \in \mathbb {R} ^{n}\times \mathbb {R}^{T}\) having a nonempty optimal set. It is known from standard arguments in LP that dom\(\mathcal {F}^{\mathrm{op}}\) coincides with the domain of \(\vartheta \). It is also known that both dom\(\mathcal { F}\subset \mathbb {R}^{T}\) and dom\(\mathcal {F}^{\mathrm{op}}\subset \mathbb {R} ^{n}\times \mathbb {R}^{T}\) are closed and convex sets.
This paper mainly deals with the optimal value function restricted to its domain, \(\vartheta ^{R}:\mathrm {dom}\mathcal {F} ^{\mathrm{op}}\rightarrow ] -\infty ,+\infty [\), i.e.,
and two other functions coming from considering perturbations of b and c independently. Specifically, given a nominal (fixed) \(\overline{\pi }\equiv \left( \overline{c},\overline{b}\right) \in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) we define
with
(where ‘\(\mathrm {cone}\)’ means conical convex hull) given, respectively, by
Observe that the previous two functions are finite valued, since we are not perturbing \(\overline{a},\) which entails that \(\{\overline{c}\}\times \mathrm {dom}\mathcal {F}\) and \(C\times \{\overline{b}\}\) are both included in dom\(\mathcal {F}^{\mathrm{op}}\) (recall that, in LP, optimality is equivalent to primal and dual feasibility).
One can find different proofs (from different approaches) for the next theorem; see, e.g., [4, Theorem 4.5.2], [5, Theorem 2.7] and [6, Theorem 14]; see also [11, p. 214] for a stronger version (\(\vartheta ^{R}\) is Lipschitz on bounded subsets of \(\mathrm {dom}\mathcal {F}^{\mathrm{op}})\) in the more general context of canonically perturbed convex quadratic problems; see also [6, p. 25] and [9] for (generally non-convex) quadratic programs.
Theorem 2.1
\(\vartheta ^{R}\) is continuous on \(\mathrm {dom} \mathcal {F}^{\mathrm{op}}\).
Finally, the following theorem is a well-known result of stability theory in LP (see, e.g., [26, p. 232] or [8, Chapter IX (Section 7)]). In it, we appeal to the Painlevé-Kuratowski convergence of sequences of sets. More in detail, given \(X_{r}\subset \mathbb {R}^{n},\)\( r\in \mathbb {N},\)\({\mathrm{Lim}}\inf _{r}X_{r}\) consists of all points which may be written as \(\lim _{r}x^{r}\) with \(x^{r}\in X_{r}\) for r large enough; whereas elements of \({\mathrm{Lim}}\sup _{r}X_{r}\) are those of the form \(\lim _{k}x^{k}\) with \(x^{k}\in X_{r_{k}}\) for some subsequence \( r_{1}<r_{2}<..\). Obviously, \({\mathrm{Lim}}\inf _{r}X_{r}\subset {\mathrm{Lim}} \sup _{r}X_{r},\) and when both coincide, we just write \({\mathrm{Lim}}_{r}X_{r}. \)
Theorem 2.2
Let \(\overline{c}\in C.\,\)For any \(\left\{ b^{r}\right\} _{r\in \mathbb {N}}\subset \mathrm {dom}\mathcal {F}\) converging to \(\overline{b}\), we have
Remark 2.1
In general, the boundedness of a Painlevé–Kuratowski limit of sets does not imply the boundedness of those sets. For instance, \( {\mathrm{Lim}}_{r}\{1\} \cup [r,+\infty [=\{1\}\). Nevertheless, in the previous theorem the boundedness of \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) does imply, indeed, the uniform boundedness of \(\left\{ \mathcal {F}^{\mathrm{op}}\left( \overline{c},b^{r}\right) \right\} _{r\in \mathbb {N}}\). This follows from the convexity of each \(\mathcal {F}^{\mathrm{op}}\left( \overline{c} ,b^{r}\right) \) or, alternatively, from [15, Corollary 6.2.1] together with Theorem 2.1.
Main Goals
This subsection is devoted to formalize the main goals of the current work and to integrate them in the existing literature. At this moment, we advance that our aim is focussed on the Lipschitzian behavior of the optimal value function in different frameworks of perturbations; specifically, on the Lipschitzian behavior of \(\vartheta ,\)\(\vartheta ^{R},\)\(\vartheta _{ \overline{c}}^{R},\) and \(\vartheta _{\overline{b}}^{R}\).
Recall that a function \(f:A\subset \mathbb {R}^{p}\rightarrow [-\infty ,+\infty ]\), \(p\in \mathbb {N}\), is said to be Lipschitz continuous at \(\overline{z}\in A,\) with \(f(\overline{z})\) finite, if there exist a constant \(\kappa \ge 0\) (called Lipschitz constant) and a neighborhood U of \(\overline{z}\) such that
The infimum of constants \(\kappa \) for which (3) holds, for some associated neighborhood, is the Lipschitz modulus of f at \( \overline{z},\) denoted by lip\(f(\overline{z})\). Observe that the Lipschitz modulus can be expressed as
(In the previous expressions, we do not exclude coincidences among z, \( \widetilde{z},\) and \(\overline{z}\), under the convention \(\frac{0}{0}:=0\) and \(\infty -\infty :=0\).)
In relation to the optimal value function, it is well known that \(\vartheta \) is Lipschitz continuous at \(\overline{\pi }\equiv \left( \overline{c}, \overline{b}\right) \) if and only if \(\overline{\pi }\in \mathrm {int}\) \( \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) (the interior of dom\(\mathcal {F}^{\mathrm{op}}\) ). In fact, as commented above, this characterization is held in the more general framework of linear semi-infinite problems (with—possibly—infinitely many constraints); see, [15, Lemma 10.2]. Moreover, it is also known (see, e.g., [15, Theorem 6.1 and Lemma 10.2]) that condition ‘\(\overline{\pi }\in \mathrm {int}\) \( \mathrm {dom}\mathcal {F}^{\mathrm{op}}\)’ is equivalent to the simultaneous fulfillment of two conditions: \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is nonempty and bounded, and the Slater constraint qualification (SCQ, in brief) is satisfied at \(\overline{b}\). Recall that SCQ is satisfied at \(\overline{b}\) if there exists \(\widehat{x}\in \mathbb {R}^{n}\), called a Slater point , such that \(\overline{a}_{t}^{\prime }\widehat{x}<\overline{b}_{t}\) for all \(t\in T\).
Remark 2.2
Observe that, in the case when \(\overline{\pi }\in \mathrm {int}\) \( \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) one clearly has \(\mathrm {lip}\vartheta (\overline{\pi })=\mathrm {lip}\vartheta ^{R}(\overline{\pi })\). On the other hand, if \(\overline{\pi }\in \mathrm {bd}\) \(\mathrm {dom}\mathcal {F} ^{\mathrm{op}}\) (\(\mathrm {bd}\) standing for boundary), one has \( \mathrm {lip}\vartheta (\overline{\pi })=+\infty \), whereas \(\mathrm { lip}\vartheta ^{R}(\overline{\pi })\) is still finite, as it is shown in the current work (as a consequence of Theorem 5.2).
The previous remark motivates that we focus this paper on computing (or at least estimating) \(\mathrm {lip}\vartheta ^{R}(\overline{\pi })\). For solvable problems, \(\mathrm {lip}\vartheta ^{R}(\overline{\pi })\) is always finite and provides a quantitative measure of the stability of the optimal value under data perturbations (provided that they yield solvable problems).
We advance that \(\mathrm {lip}\vartheta _{\overline{c}}^{R}(\overline{b})\) is completely determined through a point-based formula (depending only on the nominal data) without any assumption (see Theorem 3.1), while \(\mathrm {lip}\vartheta _{\overline{b}}^{R}(\overline{c})\) and \(\mathrm { lip}\vartheta ^{R}(\overline{\pi })\) are upper and lower estimated in general (see Theorems 4.1, 5.1, and 5.2). It is also shown that under the boundedness of \(\mathcal {F} ^{\mathrm{op}}(\overline{\pi }),\) both \(\mathrm {lip}\vartheta _{\overline{b}}^{R}( \overline{c})\) and \(\mathrm {lip}\vartheta ^{R}(\overline{\pi })\) are also completely determined. All the mentioned estimates (or exact values) are given exclusively in terms of \(\overline{\pi }\equiv \left( \overline{c}, \overline{b}\right) \).
Antecedents on Calmness
This subsection mainly gathers some results about the calmness of \(\vartheta ^{R},\) traced out from [14], which are used in the remaining sections.
Recall that the calmness property is weaker than the Lipschitz one, as far as it comes from fixing \(\widetilde{z}=\overline{z}\) in (3). With the notation before (3), the calmness modulus of f at \(\overline{z}\) is given by
Obviously, \(\mathrm {clm}f(\overline{z})\le \mathrm {lip}f(\overline{z})\).
At this moment, we introduce some necessary notation used along the paper. To start with, given \(X\subset \mathbb {R}^{p},\)\(p\in \mathbb {N},\) we denote by convX, \(\mathrm {span}X,\) and extrX the convex hull, the linear hull of X, and the set of extreme points of X, respectively. Recall that coneX stands for the conical convex hull of X.
For \(b\in \mathrm {dom}\mathcal {F}\) and \(x\in \mathcal {F}\left( b\right) ,\) we denote by \(T_{b}\left( x\right) \) the set of active indices at x; i.e.,
Associated with \(\pi \equiv \left( c,b\right) \in \mathrm {dom}\mathcal {F} ^{\mathrm{op}}\), we consider the following family of minimal Karush–Kuhn–Tucker (KKT) subsets of indices
for some \(x\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Observe that \(\mathcal {M}_{\pi }\) is correctly defined since the right member of (5) indeed does not depend on x (this comes from a standard fact in LP; see [14, Remark 2]). It is also standard that \(\{\overline{a}_{t},t\in D\}\) is linearly independent for any \(D\in \mathcal {M}_{\pi },\) and this fact justifies the well definedness of the following elements associated with our nominal problem \(\overline{\pi }\equiv \left( \overline{c},\overline{b} \right) \in \mathrm {dom}\mathcal {F}^{\mathrm{op}},\) which were already introduced in [14]:
where, for \(D\in \mathcal {M}_{\overline{\pi }},\)\(\lambda ^{D}=\left( \lambda _{t}^{D}\right) _{t\in T}\in \mathbb {R}_{+}^{T}\) is the unique element such that \(-\overline{c}=\sum _{t\in D}\lambda _{t}^{D}\overline{a} _{t}\) and \(\lambda _{t}^{D}=0\) for all \(t\in T{\setminus } D\), and \(\left\| \lambda ^{D}\right\| _{1} := \sum _{t \in T} \lambda _{t}^{D}\).
Paper [14] analyzes the calmness modulus of the optimal value function under right-hand-side perturbations, \(\mathrm {clm}\vartheta _{ \overline{c}}^{R}(\overline{b}),\) as well as the calmness modulus under canonical perturbations, \(\mathrm {clm}\vartheta ^{R}(\overline{\pi })\). In that paper, each of the moduli is studied by splitting it into the so-called calmness from above and calmness from below moduli. The reader is addressed to [14] for details, since these concepts do not have their counterpart for the Lipschitz modulus. Nevertheless, we need some tools from that paper.
Recall (see, e.g., [27, p. 65]) that any non-empty convex set F can be decomposed as the direct sum
where \(L_{F}\) is the lineality space of F and \(L_{F}^{\perp }\) is the orthogonal complement of \(L_{F}\). In our case, when either \(F=\mathcal {F}(b)\) for \(b\in \mathrm {dom}\mathcal {F}\) or \(F=\mathcal {F}^{\mathrm{op}}(\pi )\) for \(\pi \in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\), one has that \(L_{F}^{\perp }=\mathrm {span} \{\overline{a}_{t},t\in T\}\). In [14, Section 2.2] we appeal to the following set of extreme points:
which is clearly nonempty and finite.
The following lemmas will be used later on. The first one comes from [14, Lemma 2] together with a standard argument of LP. Specifically, the uniform boundedness of the sequence \(\left\{ \mathcal {E}^{\mathrm{op}}\left( \pi ^{r}\right) \right\} _{r\in \mathbb {N}}\) comes from the fact that any point of \(\mathcal {E}^{\mathrm{op}}\left( \pi ^{r}\right) ,\)\(r\in \mathbb {N},\) is the unique solution of a Cramer’s system. The proof of the second one can be directly extracted from the proof of [14, Theorem 5] (see equation (20) therein). The third comes from [14, Lemma 4].
Lemma 2.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). For any \( \left\{ \pi ^{r}\right\} _{r\in \mathbb {N}}\subset \mathrm {dom}\mathcal {F} ^{\mathrm{op}}\) converging to \(\overline{\pi },\) we have that \(\left\{ \mathcal {E} ^{\mathrm{op}}\left( \pi ^{r}\right) \right\} _{r\in \mathbb {N}}\) is uniformly bounded and
Lemma 2.2
Let \(\overline{\pi }\equiv (\overline{c},\overline{b} )\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) and \(\{\pi ^{r}\equiv (c^{r},b^{r})\}_{r\in \mathbb {N}}\) be a sequence converging to \(\overline{ \pi },\) with \(b^{r}\in \mathrm {dom}\mathcal {F}\) for all \(r\in \mathbb {N}\). If \(x\mapsto (c^{r})^{\prime }x\) is bounded from below on \(\mathcal {F}^{\mathrm{op}}( \overline{c},b^{r})\) for all r, then
for r large enough.
Lemma 2.3
Let \(\overline{\pi }\equiv (\overline{c},\overline{b})\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) and \(\{\pi ^{r}\equiv (c^{r},b^{r})\}_{r\in \mathbb {N}}\subset \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) be a sequence converging to \(\overline{\pi }\). Then
for r large enough.
From now on \(e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi }),0_{n}\right) \) denotes the Hausdorff excess of \(\mathcal {E}^{\mathrm{op}}(\overline{\pi })\) over \( \{0_{n}\}\), which may be written alternatively as \(\max _{x\in \mathcal {E} ^{\mathrm{op}}(\overline{\pi })}\left\| x\right\| \). On the other hand, \( d\left( 0_{n},\mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) \right) \) represents the distance from the origin to the set \(\mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) ;\) i.e., \(d\left( 0_{n},\mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) \right) =\min _{x\in \mathcal {F}^{\mathrm{op}}(\overline{\pi } )}\left\| x\right\| \).
Theorem 2.3
[14, Theorem 4, Corollary 3, and Section 5] Let \(\overline{\pi }\equiv (\overline{c},\overline{b})\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then
-
(i)
\(\mathrm {clm}\vartheta _{\overline{c}}^{R}(\overline{b} )\le k^{+},\) and equality holds when SCQ is satisfied at \(\overline{b}\).
-
(ii)
\(\mathrm {clm}\vartheta ^{R}(\overline{\pi })\le \max \{k^{-}+e\left( \mathcal {E}^{\mathrm{op}}\left( \overline{\pi }\right) ,0_{n}\right) ,k^{+}+d\left( 0_{n},\mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) \right) \},\) and equality holds when \(\overline{\pi }\in \mathrm {int}\) \(\mathrm {dom} \mathcal {F}^{\mathrm{op}}\).
Lipschitz Modulus Under RHS Perturbations
This section is devoted to compute the Lipschitz modulus of the optimal value under perturbations of b (RHS perturbations); i.e., to compute \( \mathrm {lip}\vartheta _{\overline{c}}^{R}(\overline{b})\). First, we recall a useful result which provides an explicit expression (as the maximum of a finite amount of linear functions) for the optimal value function in the current perturbation setting. Recall that we are considering a nominal problem \(\overline{\pi }\equiv \left( \overline{c},\overline{b}\right) \).
Lemma 3.1
[14, Lemma 3 and Corollary 1] Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F} ^{\mathrm{op}}\). There exists a neighborhood \(U_{\overline{b}}\subset \mathbb {R}^{T}\) of \(\overline{b}\) such that
Observe that, by the KKT conditions, with respect to the nominal problem, we have
The next proposition follows an analogous argument to the one used for establishing [14, Corollary 2]. Nevertheless, due to its simplicity, and for completeness purposes, we include its proof. Along this section, we use indistinctly \(\vartheta _{\overline{c}}^{R}(b)\) or \(\vartheta (\overline{c},b),\) provided that \(b\in \mathrm {dom}\mathcal {F}\). Indeed, for the sake of simplicity in the notation, we usually write \(\vartheta _{ \overline{c}}^{R}\) when referring to the function itself and \(\vartheta ( \overline{c},b),\)\(b\in \mathrm {dom}\mathcal {F},\) for its images.
Proposition 3.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) and let \(U_{\overline{b}}\) be as in the previous lemma. Then,
Consequently
Proof
Take \(b,\widetilde{b}\in \mathrm {dom}\mathcal {F}\cap U_{\overline{b}}\). Applying the previous lemma, we have
and let us assume the first maximum is reached at \(\widehat{D}\in \mathcal {M} _{\overline{\pi }}\), then
Since b and \(\widetilde{b}\) have been arbitrarily chosen, switching them in the preceding argument we obtain the aimed inequality. \(\Box \)
Theorem 3.1
Let \(\overline{\pi }\equiv \left( \overline{c},\overline{b}\right) \in \mathrm {dom}\mathcal {F} ^{\mathrm{op}}\). Then, \(\vartheta _{\overline{c}}^{R}\) is Lipschitz continuous at \( \overline{b}\) and
Proof
According to the previous proposition, it remains to prove \(\mathrm {lip} \vartheta _{\overline{c}}^{R}(\overline{b})\ge k^{+}\). To do that take any \( \overline{D}\in \mathcal {M}_{\overline{\pi }}\) such that \(\left\| \lambda ^{\overline{D}}\right\| _{1}=k^{+}\) and let us construct two sequences \( \left\{ b^{r}\right\} ,\)\(\{\widetilde{b}^{r}\}\subset \mathrm {dom}\mathcal {F }\) converging to \(\overline{b}\) such that
which will establish our aimed inequality.
Let \(\overline{x}\in \mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) \). Fix an arbitrary \(r\in \mathbb {N}\). Observe that
is a neighborhood of \(\overline{x}\). Now, since \(\overline{a}_{t}^{\prime } \overline{x}=\overline{b}_{t},\)\(t\in \overline{D},\) and \(\left\{ \overline{a }_{t},\text { }t\in \overline{D}\right\} \) is linearly independent, a standard argument in LP yields the existence of \(0<\delta _{r}<\frac{1}{r}\) such that the systems of linear equations
have solutions inside \(W_{r};\) pick \(x^{r}\) and \(\widetilde{x}^{r}\) as solutions of the respective systems in (11) and such that \(x^{r}, \widetilde{x}^{r}\in W_{r}\).
Now, let us define \(b^{r}=\left( b_{t}^{r}\right) _{t\in T}\) and \(\widetilde{ b}^{r}=\left( \widetilde{b}_{t}^{r}\right) _{t\in T}\) as follows
In particular, \(x^{r}\in \mathcal {F}\left( b^{r}\right) \) and \(\widetilde{x} ^{r}\)\(\in \mathcal {F}\left( \widetilde{b}^{r}\right) ;\) in fact, \( x^{r}\in \mathcal {F}^{\mathrm{op}}\left( \overline{c},b^{r}\right) \) and \(\widetilde{x }^{r}\)\(\in \mathcal {F}^{\mathrm{op}}\left( \overline{c},\widetilde{b}^{r}\right) ,\) since \(\overline{D}\subset T_{b^{r}}\left( x^{r}\right) \cap T_{\widetilde{b} ^{r}}\left( \widetilde{x}^{r}\right) \). Moreover, according to the KKT conditions and taking into account that \(\lambda ^{\overline{D}}\) is a vector of KKT multipliers associated with both problems \(\left( \overline{c} ,b^{r}\right) \) and \(\left( \overline{c},\widetilde{b}^{r}\right) ,\) by duality in LP we have that
In this way, and since clearly both sequences \(\left\{ b^{r}\right\} _{r\in \mathbb {N}}\) and \(\{\widetilde{b}^{r}\}_{r\in \mathbb {N}}\mathcal {\ }\) converge to \(\overline{b},\) by applying (12) and, recalling that \( \lambda _{t}^{\overline{D}}=0\) for \(t\in T{\setminus } \overline{D},\) we have
which finishes the proof. \(\Box \)
The following corollary is a direct consequence of the previous theorem, together with Theorem 2.3\(\left( i\right) \).
Corollary 3.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) and assume that SCQ holds at \(\overline{b}\). Then we have
The next example, inspired in [14, Example 1], shows that \( \mathrm {clm}\vartheta _{\overline{c}}^{R}(\overline{b})\) can be strictly less than \(\mathrm {lip}\vartheta _{\overline{c}}^{R}(\overline{b})\) when SCQ fails. Observe that in this example \(\mathrm {lip}\vartheta _{\overline{c}}(\overline{b}) = +\infty \), since \(\overline{b} \in \mathrm {bd}\) \(\mathrm {dom}\mathcal {F}\), while \(\mathrm {lip}\vartheta _{\overline{c}}^{R}(\overline{b})\) is finite.
Example 3.1
Consider the problem in \(\mathbb {R}\) given by
Observe that \(\overline{c}=1\) and \(\bar{b}=0_{3}\). Obviously, \(\vartheta \left( \overline{\pi }\right) =0\), \(\mathcal {M}_{ \overline{\pi }}=\{\{1\},\{2\}\}\), \(\lambda ^{\{1\}}=1\), \(\lambda ^{\{2\}}= \frac{1}{2}\), and so \(k^{+}=1=\mathrm {lip}\vartheta _{\overline{c} }^{R}(\overline{b})\). Let us check that \(\mathrm {clm}\vartheta _{ \overline{c}}^{R}(\overline{b})=\frac{1}{2}\).
According to Lemma 3.1 we have
where we have appealed to the fact that \(b\in \mathrm {dom}\mathcal {F}\) implies \(-b_{1}\le \tfrac{1}{2}b_{3}\). We may attain \(\frac{1 }{2}\) by considering \(\left( b^{r}\right) =\left( \frac{1}{r},\frac{1 }{r},\frac{1}{r}\right) ^{\prime }\), \(r\in \mathbb {N}\).
Lipschitz Modulus Under c-Perturbations
This section is devoted to study \(\mathrm {lip}\vartheta _{\overline{b}}^{R}( \overline{c})\), where \(\overline{b}\in \mathrm {dom}\mathcal {F}\) is fixed. Recall the notation \(C=-\mathrm {cone}\{\overline{a}_{t},t\in T\}\), and the standard fact (in LP) that \(c\in C\) if and only if \((c,\overline{b})\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Recall also that \(\vartheta _{\overline{b} }^{R}\left( c\right) :=\vartheta \left( c,\overline{b}\right) \), for any \(c\in C\).
The next proposition is intended to clarify the role played by the set of extreme points (7) when we deal with perturbations of parameter c.
Proposition 4.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then, there exists a neighborhood \(U_{\overline{c}}\) of \(\overline{c}\) such that
Proof
Clearly, for \(c \in C\), \(\mathcal {E}^{\mathrm{op}}(c,\overline{b}) \subset \mathrm {extr}\left( \mathcal {F}(\overline{b}) \cap \mathrm {span}\left\{ \overline{a}_{t},\text { } t\in T\right\} \right) \), which is a fixed finite set. This fact, combined with Lemma 2.1, yields \(\mathcal {E}^{\mathrm{op}}(c,\overline{b}) \subset \mathcal {E}^{\mathrm{op}}(\overline{\pi })\) for c in some neighborhood \(U_{\overline{c}}\) of \(\overline{c}\). Since \(\mathcal {E}^{\mathrm{op}}(\overline{\pi }) \subset \mathcal {F}(\overline{b})\), the thesis of the proposition holds. \(\Box \)
The following theorem provides a lower and an upper estimate for the aimed Lipschitz modulus. Moreover, it shows that the upper estimate becomes the exact modulus when \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded.
Theorem 4.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then,
Moreover, if we assume that \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded, then
Proof
First, let us see \(\mathrm {clm}\vartheta _{\overline{b}}^{R}(\overline{c} )\ge d(0_{n},\mathcal {F}^{\mathrm{op}}(\overline{\pi }))\) in the nontrivial case \( d(0_{n},\mathcal {F}^{\mathrm{op}}(\overline{\pi }))>0\). Let \(\overline{x}\in \mathcal { F}^{\mathrm{op}}(\overline{\pi })\) with \(\Vert \overline{x}\Vert =d\left( 0_{n,} \mathcal {F}^{\mathrm{op}}(\overline{\pi })\right) \). According to [28, Lemma 9], there exists \(u\in \mathbb {R}^{n}\) with \(\Vert u\Vert _{*}=1\) such that \(u^{\prime }x\ge u^{\prime }\overline{x}=\Vert \overline{x} \Vert \) for all \(x\in \mathcal {F}^{\mathrm{op}}(\overline{\pi })\). Define
For all \(x\in \mathcal {F}^{\mathrm{op}}(\overline{\pi })\) we have
This implies that \(x\mapsto \left( c^{r}\right) ^{\prime }x\) is bounded from below on \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) and, by Lemma 2.2, \((c^{r},\overline{b})\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) for r large enough (say for all r). Lemma 2.3 entails \(\mathcal {F} ^{\mathrm{op}}(c^{r},\overline{b})\subset \mathcal {F}^{\mathrm{op}}(\overline{\pi }),\) for r large enough, and indeed (13) yields \(\overline{x}\in \mathcal {F} ^{\mathrm{op}}(c^{r},\overline{b})\). Then, we have
Recall that \(\mathrm {clm}\vartheta _{\overline{b}}^{R}(\overline{c})\le \mathrm {lip}\vartheta _{\overline{b}}^{R}(\overline{c})\) is always true. Now let us check \(\mathrm {lip}\vartheta _{\overline{b}}^{R}(\overline{c} )\le e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi }),0_{n}\right) \). Write
for appropriate sequences \(\{c^{r}\}_{r},\)\(\{\widetilde{c}^{r}\}_{r}\subset C\) converging to \(\overline{c}\). Because of the symmetry of the quotients in (14), it is not restrictive to assume \(\vartheta (c^{r},\overline{b} )-\vartheta (\widetilde{c}^{r},\overline{b})\ge 0\) for all r.
According to Lemma 2.1, there exist a certain \(\overline{x}\in {\mathrm{Lim}}\sup \nolimits _{r}\mathcal {E}^{\mathrm{op}}(\widetilde{c}^{r},\overline{b})\) and associated \(x^{k}\in \mathcal {E}^{\mathrm{op}}(\widetilde{c}^{r_{k}},\overline{ b})\subset \mathcal {F}^{\mathrm{op}}(\widetilde{c}^{r_{k}},\overline{b})\), for \( r_{1}<r_{2}<\ldots<r_{k}<\ldots \), such that \(x^{k}\rightarrow \overline{x} \in \mathcal {E}^{\mathrm{op}}(\overline{\pi })\). Then, for all \(k\in \mathbb {N}\) we have
which implies
Finally, let us assume that \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded, which entails \(\text {span}\{\overline{a}_{t},t\in T\}=\mathbb {R}^{n}\), hence \(\mathcal {E}^{\mathrm{op}}\left( \overline{\pi }\right) =\mathrm {extr}\mathcal {F} ^{\mathrm{op}}\left( \overline{\pi }\right) \) and \(e\left( \mathrm {extr}\mathcal {F} ^{\mathrm{op}}(\overline{\pi }),0_{n}\right) =e\left( \mathcal {F}^{\mathrm{op}}(\overline{\pi } ),0_{n}\right) \) (this last follows a standard argument by using the convexity of the norm). Observe that we only have to prove \(\mathrm {clm} \vartheta _{\overline{b}}^{R}(\overline{c})\ge e\left( \mathcal {F}^{\mathrm{op}}( \overline{\pi }),0_{n}\right) \). Let \(\overline{x}\in \mathcal {F}^{\mathrm{op}}( \overline{\pi })\) with \(\Vert \overline{x}\Vert =e\left( \mathcal {F}^{\mathrm{op}}( \overline{\pi }),0_{n}\right) \). Take \(u\in \mathbb {R}^{n}\) with \(\Vert u\Vert _{*}=1\) be such that \(u^{\prime }\overline{x}=\Vert \overline{x} \Vert \). Define the perturbation \(c^{r}:=\overline{c}-\frac{1}{r}u\) for all r. Since \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded, from [15, Lemma 10.2] \((c^{r},\overline{b})\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) for r large enough. Then, since both problems \((c^{r},\overline{b})\) and \(\overline{\pi }\) have the same feasible set, we have
Therefore,
Finally, since
we get the aimed equality. \(\Box \)
The next two examples are intended to show that all the inequalities in the statement of Theorem 4.1 may be strict. The first example is concerned with the two first inequalities.
Example 4.1
Consider the nominal problem, in \(\mathbb {R}^{3}\) with the Euclidean norm,
Clearly, \(d(0_{3},\mathcal {F}^{\mathrm{op}}(\overline{\pi }))=1\), \(\mathcal {E }^{\mathrm{op}}\left( \overline{\pi }\right) =\left\{ \left( -1,-2,0\right) ^{\prime }\right\} \), and hence \(e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi } ),0_{3}\right) =\sqrt{5}\). Let us prove that \(\mathrm {clm} \vartheta _{\overline{b}}^{R}(\overline{c})=2\) and \(\mathrm {lip}\vartheta _{ \overline{b}}^{R}(\overline{c})=\sqrt{5}\). Consider any \(0<\varepsilon <1\) and any \(c\in \mathbb {R}^{3}\) with \(\left\| c-\overline{c}\right\| _{*}=\varepsilon ,\) which may be written as \(c=\left( \varepsilon _{1},\varepsilon _{2},1+\varepsilon _{3}\right) ^{\prime }\) with \( \varepsilon _{1}^{2}+\varepsilon _{2}^{2}+\varepsilon _{3}^{2}=\varepsilon ^{2}\). Then \(\left( c,\overline{b}\right) \in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) if and only if \(\varepsilon _{1}\le 0\) and \(\varepsilon _{2}\ge 0,\) in which case \(\vartheta \left( c,\overline{b}\right) =c^{\prime }\left( -1,-2,0\right) ^{\prime }=-\varepsilon _{1}-2\varepsilon _{2}\). Accordingly,
attained at \(c=\left( 0,\varepsilon ,1\right) ^{\prime }\). The corresponding maximum equals \(\varepsilon \) and is attained at \(c=\left( -\varepsilon ,0,1\right) ^{\prime }\). Consequently, for any \(0<\varepsilon <1,\)
which, clearly entails \(\mathrm {clm}\vartheta _{\overline{b}}^{R}(\overline{c })=2\). Now let us compute the Lipschitz modulus of \(\vartheta _{\overline{b} }^{R}\) at \(\overline{c}\). As a motivation of such computation note that
and this maximum is attained at \(\left( \varepsilon _{1},\varepsilon _{2}\right) =\left( -\varepsilon /\sqrt{5},-2\varepsilon /\sqrt{5}\right) \). Let us consider \(c:=\left( -\varepsilon /\sqrt{5},0,1\right) ^{\prime }\) and \(\widetilde{c}:=\left( 0,2\varepsilon /\sqrt{5},1\right) ^{\prime }\). Then
Since this happens for all \(0<\varepsilon <1,\) we conclude \(\mathrm {lip} \vartheta _{\overline{b}}^{R}(\overline{c})\ge \sqrt{5}\). The converse inequality comes from Theorem 4.1.
Next we provide an example where \(\mathrm {lip}\vartheta _{\overline{b}}^{R}( \overline{c})\le e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi }),0_{n}\right) \) holds strictly.
Example 4.2
Consider \(\mathbb {R}^{2}\) endowed with the norm given by
whose dual norm \(\left\| \cdot \right\| _{*}\) has as its closed unit ball the set
Alternatively, we may start by considering \(B_{*}\) and define \(\left\| \cdot \right\| \) as \(\left( \left\| \cdot \right\| _{*}\right) _{*}\). Consider the nominal problem in \(\mathbb {R}^{2}\)
i.e., \(\overline{c}=\left( 1,0\right) ^{\prime }\) and \( \overline{b}=-2\). Then \(\mathcal {E}^{\mathrm{op}}\left( \overline{\pi }\right) =\left\{ \left( 2,0\right) ^{\prime }\right\} \) and, accordingly, \( e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi }),0_{2}\right) =\)\( \left\| \left( 2,0\right) ^{\prime }\right\| =4\). On the other hand, \(\left( c,\overline{b}\right) \in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) if and only if \(c=\left( 1+\alpha ,0\right) ^{\prime }\) for some \( \alpha \ge -1,\) in which case \(\vartheta (c,\overline{b})=c^{\prime }\left( 2,0\right) ^{\prime }=2\alpha +2\). Therefore, recalling our convention \(\frac{0}{0}:=0,\)
since \(\left( 1,0\right) ^{\prime }\) is in the boundary of \( B_{*}\).
Remark 4.1
Note that the norm under consideration plays a key role in the previous example. If \(\mathbb {R}^{2}\) were endowed with the Euclidean norm, we would have \(\mathrm {lip}\vartheta _{\overline{b}}^{R}(\overline{c})=2=e\left( \mathcal {E}^{\mathrm{op}}(\overline{\pi }),0_{2}\right) \) (for the same \(\overline{\pi }\)). See [27, Theorem 15.2] for a characterization of all possible norms in \(\mathbb {R}^{n}\) in terms of their closed unit balls.
Lipschitz Modulus Under Canonical Perturbations
The objective of this section is to compute (or at least estimate) the Lipschitz modulus of the optimal value function, restricted to \(\text {dom} \mathcal {F}^{\mathrm{op}}\), at a nominal parameter \(\overline{\pi }\in \text {dom} \mathcal {F}^{\mathrm{op}}\) under canonical perturbations, i.e., when the RHS of the constraints and the coefficients of the objective function can be simultaneously perturbed.
The following theorem provides a lower bound of the Lipschitz modulus \( \mathrm {lip}\vartheta ^{R}(\overline{\pi })\).
Theorem 5.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then
Proof
The case \(0_{n}\in \mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is trivial due to the fact that \(\text {lip}\vartheta ^{R}(\overline{\pi })\ge \text {lip}\vartheta _{\overline{c}}^{R}(\overline{b})\). So, let us assume \(0_{n}\not \in \mathcal { F}^{\mathrm{op}}(\overline{\pi })\). Take \(\overline{x}\in \mathcal {F}^{\mathrm{op}}(\overline{ \pi })\) with \(\Vert \overline{x}\Vert =d\left( 0_{n},\mathcal {F}^{\mathrm{op}}( \overline{\pi })\right) \). Let us consider sequences \(\{b^{r}\}_{r},\{ \widetilde{b}^{r}\}_{r}\subset \text {dom}\mathcal {F}\) such that
The next step is analogous to its counterpart for calmness in the proof of [14, Theorem 5], so that we will focus on the differences. As in formula (18) in the referred proof, there exist sequences \(\{x^{r}\}_{r}\) and \(\{u^{r}\}_{r}\) in \(\mathbb {R}^{n}\), with \(\Vert x^{r}\Vert \rightarrow \Vert \overline{x}\Vert \), such that, for each r, \(x^{r}\in \mathcal {F} ^{\mathrm{op}}(\overline{c},b^{r})\), \(\Vert u^{r}\Vert _{*}=1\) and
Now, we define \(c^{r}:=\overline{c}+\Vert b^{r}-\widetilde{b}^{r}\Vert _{\infty }u^{r}\). For \(x\in \mathcal {F}^{\mathrm{op}}(\overline{c},b^{r})\) one has
so \(x\mapsto (c^{r})^{\prime }x\) is bounded from below on \(\mathcal {F}^{\mathrm{op}}( \overline{c},b^{r})\). Because of Lemma 2.2, there exists \( r_{0}\in \mathbb {N}\) such that \(\pi ^{r}\equiv (c^{r},b^{r})\in \text {dom} \mathcal {F}^{\mathrm{op}}\) for \(r\ge r_{0}\). Then Lemma 2.3 yields \(\mathcal {F }^{\mathrm{op}}(\pi ^{r})\subset \mathcal {F}^{\mathrm{op}}(\overline{c},b^{r})\) for \(r\ge r_{0}\) large enough. Accordingly, by the restriction of (16) to points \(x\in \mathcal {F}^{\mathrm{op}}(\pi ^{r})\), we get
Let us define \(\widetilde{\pi }^{r}:\equiv (\overline{c},\widetilde{b}^{r})\) which belongs to \(\text {dom}\mathcal {F}^{\mathrm{op}}\) (because \(\{\widetilde{b} ^{r}\}_{r}\subset \text {dom}\mathcal {F}\) and \(\overline{c}\in C\) ). Note that \(\left\| \pi ^{r}-\widetilde{\pi }^{r}\right\| =\left\| b^{r}- \widetilde{b}^{r}\right\| _{\infty }\).
Then we have
which completes the proof. \(\Box \)
In order to establish an upper bound for the Lipschitz modulus of \(\vartheta ^{R}\) at \(\overline{\pi }\), we appeal to the technique developed in [18, Section 2]. Specifically, Wu Li proved that if a set-valued mapping is Hausdorff lower semicontinuous, a uniform upper Lipschitz constant for that mapping in a convex neighborhood of the nominal parameter becomes a Lipschitz constant in such a neighborhood (see [18, Theorem 2.1] for details). Translating it into our context, a uniform calmness constant for \( \vartheta ^{R}\) in a neighborhood (relative to \(\mathrm {dom}\mathcal {F}^{\mathrm{op}}\) ) of \(\overline{\pi }\) becomes a Lipschitz constant at \(\overline{\pi }\). This technique was already applied in [24] for obtaining the so-called sharp Lipschitz constant for \(\mathcal {F}^{\mathrm{op}}\) under suitable hypotheses.
Lemma 5.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F} ^{\mathrm{op}}\). For all \(\varepsilon >0\), there exists \(\delta >0\) such that
is a calmness constant of \(\vartheta ^{R}\) at any \(\pi \in \left( \mathrm {dom }\mathcal {F}^{\mathrm{op}}\right) \cap B(\overline{\pi },\delta )\) (the closed ball centered at \(\overline{\pi }\) of radius \(\delta \)).
Proof
We start by observing that, from Lemma 2.1, \(\mathcal {E}^{\mathrm{op}}:\mathrm { dom}\mathcal {F}^{\mathrm{op}}\rightrightarrows \mathbb {R}^{n}\) is Hausdorff-upper semicontinuous at \(\overline{\pi };\) i.e., \(\lim _{\pi \rightarrow \overline{ \pi }}e\left( \mathcal {E}^{\mathrm{op}}\left( \pi \right) ,\mathcal {E}^{\mathrm{op}}\left( \overline{\pi }\right) \right) =0\).
Now, let us abuse the notation and identify also constant \(k^{+}\) as a function \(k^{+}:\mathrm {dom}\mathcal {F}^{\mathrm{op}}\longrightarrow \mathbb {R}_{+}\) defined as \(k^{+}(\pi )=\max _{D\in \mathcal {M}_{\pi }}\left\| \lambda ^{D}\right\| _{1}\), where \(k^{+}(\overline{\pi })\) is our original \(k^{+}\) as defined in (6). We need to prove that function \(k^{+}\) is also upper semicontinuous at \(\overline{\pi }\), that is, for all \( \varepsilon >0\) there exists \(\delta >0\) such that if \(\Vert \pi -\overline{ \pi }\Vert <\delta \), for \(\pi \in \text {dom}\mathcal {F}^{\mathrm{op}}\), then \( k^{+}(\pi )\le k^{+}(\overline{\pi })+\varepsilon \). Reasoning by contradiction, suppose that there exists a sequence \(\{\pi ^{r}\}_{r}\subset \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) converging to \(\overline{\pi }\) such that \( k^{+}(\pi ^{r})\ge k^{+}(\overline{\pi })+\varepsilon _{0}\) for a certain \( \varepsilon _{0}>0\). Suppose that the maximum defining \(k^{+}(\pi ^{r})\) is attained at a certain \(D^{r}\in \mathcal {M}_{\pi ^{r}}\). Since T is finite, we can assume the existence of a constant subsequence, say \(D^{r}=D\) for all r. The fact that \(-c^{r}\in \text {cone}\{\overline{a}_{t},t\in D\}\) entails \(-\overline{c}\in \text {cone}\{\overline{a}_{t},t\in D\}\), although we cannot ensure the minimality of D for \(\overline{\pi }\). Recall that \(\{ \overline{a}_{t}^{\prime },t\in D\}\) is linearly independent. Write
Using a standard argument it is easy to see that \(\left\{ \sum _{t\in D}\lambda _{t}^{r}\right\} _{r}\) is bounded so, taking a subsequence, if necessary, it may be assumed to converge to \(\sum _{t\in D}\lambda _{t}^{D}\). Although, we cannot assume \(D\in \mathcal {M}_{\overline{\pi }}\), we know that D contains at least a minimal element for \(\overline{\pi }\), so let \( \widetilde{D}\in \mathcal {M}_{\overline{\pi }}\) with \(\widetilde{D}\subset D\) and \(\lambda _{t}^{D}=0\) for all \(t\notin \widetilde{D}\). Therefore, we have
hence we attain a contradiction.
Applying the upper semicontinuity of both, \(\mathcal {E}^{\mathrm{op}}\) and \(k^{+}\), for any \(\varepsilon >0\), there exists \(\delta >0\) such that
for all \(\pi \in \text {dom}\mathcal {F}^{\mathrm{op}}\) with \(\Vert \pi -\overline{\pi } \Vert <\delta \), and therefore
taking Theorem 2.3\(\left( ii\right) \) into account. \(\Box \)
Theorem 5.2
Let \(\overline{\pi }\in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then
If, additionally, \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded, then equality hods in (17), which reads as
Proof
Recall that \(\mathrm {dom}\mathcal {F}^{\mathrm{op}}\) is convex in \(\mathbb {R} ^{n}\times \mathbb {R}^{T}\) and Theorem 2.1 establishes the continuity of \(\vartheta ^{R}\) on \(\mathrm {dom}\mathcal {F}^{\mathrm{op}}\). Then, the previous lemma and its preceding comments ensure that \(k^{+}+e\left( \mathcal {E}(\overline{\pi }),0_{n}\right) +\varepsilon \) is a Lipschitz constant of \(\vartheta ^{R}\) at \(\overline{\pi }\) for each \(\varepsilon >0\). Letting \(\varepsilon \downarrow 0\) we obtain (17).
Now, assume that \(\mathcal {F}^{\mathrm{op}}(\overline{\pi })\) is bounded. In order to establish the converse inequality, consider sequences \(\{b^{r}\}_{r},\{ \widetilde{b}^{r}\}_{r}\subset \mathrm {dom}\mathcal {F}\) such that
Apply Theorem 2.2 and Remark 2.1 to conclude that \(\mathcal {F}^{\mathrm{op}}(\overline{c},b^{r})\) is nonempty and bounded for r large enough (say for all r). For each \(r\in \mathbb {N}\) take \(x^{r}\in \mathcal {F}^{\mathrm{op}}(\overline{c},b^{r})\) such that \(\left\| x^{r}\right\| =e\left( \mathcal {F}^{\mathrm{op}}(\overline{c},b^{r}),0_{n}\right) \) and let \( u^{r}\in \mathbb {R}^{n}\) be such that \(\left\| u^{r}\right\| _{*}=1 \) and \(\left( u^{r}\right) ^{\prime }x^{r}=\left\| x^{r}\right\| \).
The sequence \(\left\{ x^{r}\right\} _{r\in \mathbb {N}}\) may not converge, although it has for sure a convergent subsequence, but we can ensure, again by Theorem 2.2, that \(\left\| x^{r}\right\| \rightarrow e\left( \mathcal {F}^{\mathrm{op}}(\overline{\pi }),0_{n}\right) \).
For each r let us define \(c^{r}:=\overline{c}-\Vert \widetilde{b} ^{r}-b^{r}\Vert _{\infty }u^{r}\). Obviously \(x\mapsto \left( c^{r}\right) ^{\prime }x\) is bounded from below on \(\mathcal {F}^{\mathrm{op}}(\overline{c},b^{r}),\) because this set is compact; so that, Lemma 2.2 yields \( \left( c^{r},b^{r}\right) \in \mathrm {dom}\mathcal {F}^{\mathrm{op}}\) for r large enough, and then
Therefore
which yields the asserted formula. \(\Box \)
Corollary 5.1
Let \(\overline{\pi }\in \mathrm {dom}\mathcal { F}^{\mathrm{op}}\), with \(\mathcal {F}^{\mathrm{op}}\left( \overline{\pi }\right) \) bounded. Then
Proof
Conclusions
The main original contributions of the present paper are focussed on the Lipschitz moduli of the optimal value functions restricted to their domains in different parametric contexts (\(\vartheta _{\overline{c}}^{R},\) in the context of RHS perturbations, \(\vartheta _{\overline{b}}^{R},\) in the one of c-perturbations, and \(\vartheta ^{R},\) for canonical perturbations; see Sect. 2.1 for the definitions). The analysis is developed around a nominal LP problem \(\overline{\pi }\), which is identified with the pair formed by a nominal vector of the objective function, \(\overline{c},\) and a nominal RHS, \(\overline{b}\). As a brief discussion about the convenience of dealing with such functions, restricted to their domains, we underline the fact that it allows us to avoid a typical interiority assumption under which some preliminary results are stated (see [15, Lemma 10.2] and [13]). Specifically, the nominal elements \(\overline{b},\)\( \overline{c},\) and \(\overline{\pi }\) are not required to be in the interior of the respective domains of \(\vartheta _{\overline{c}}^{R},\)\(\vartheta _{ \overline{b}}^{R},\) and \(\vartheta ^{R}\).
In contrast, [15, Lemma 10.2] and [13] deal with the optimal function \(\vartheta \) defined on the whole space, and in this case the condition ‘\(\overline{\pi }\) is in the interior of the domain of \(\vartheta \)’ is not avoidable as far as it characterizes the Lipschitz continuity of \(\vartheta \) at \(\overline{\pi }\) (so, the Lipschitz modulus of \(\vartheta \) is infinite when the interiority condition does not hold). It is known that this interiority condition is equivalent to the simultaneous fulfillment of the Slater CQ and the boundedness (and nonemptiness) of the nominal optimal set. In the next paragraphs, we comment the most important contributions of this work and, at the same time, we try to clarify the role played by the two assumptions, Slater CQ and boundedness, separately, in relation to the computation/estimation of our Lipschitz moduli. The boundedness of the optimal set does play an important role:
-
When \(\overline{\pi }\) is a solvable problem (without any extra assumption), the Lipschitz modulus of \(\vartheta _{\overline{c}}^{R}\) is completely determined (Theorem 3.1), and the corresponding moduli for \(\vartheta _{\overline{b}}^{R},\) and \(\vartheta ^{R} \) are lower and upper estimated (Theorems 4.1, 5.1, and 5.2). In particular, all these functions are always Lipschitz continuous at \(\overline{\pi }\).
-
When \(\overline{\pi }\) is solvable and Slater CQ holds, we additionally have that the Lipschitz modulus of \(\vartheta _{\overline{c} }^{R}\) does coincide with its calmness modulus (Corollary 3.1 ).
-
When \(\overline{\pi }\) is solvable and the nominal optimal set is bounded, the upper estimates of \(\vartheta _{\overline{b}}^{R}\) and \( \vartheta ^{R}\) turn out to be the exact moduli. Moreover, in this case, the Lipschitz modulus of \(\vartheta ^{R}\) coincides with the sum of the corresponding moduli of \(\vartheta _{\overline{c}}^{R}\) and \(\vartheta _{ \overline{b}}^{R}\) (Corollary 5.1).
-
When \(\overline{\pi }\) is in the interior of solvable problems (Slater CQ together with boundedness of the nominal optimal set), then, in addition to the previous statements, the Lipschitz modulus of \(\vartheta \) does coincide with the one of \(\vartheta ^{R}\). Moreover, the reader can easily check that the calmness modulus of \(\vartheta \) may be strictly less than the Lipschitz one from the exact expressions of both moduli (Theorems 2.3 and 5.2).
Finally, let us comment that all formulas obtained in this work for computing or estimating our aimed moduli are point-based, in the sense that all ingredients used in them only involve the nominal elements (the nominal point and problem’s data), not appealing to parameters or points in a neighborhood. In this way they are implementable in practice.
References
- 1.
Saaty, T., Gass, S.: Parametric objective function (part 1). J. Oper. Res. Soc. Am. 2, 316–319 (1954)
- 2.
Gass, S., Saaty, T.: Parametric objective function (part 2)-generalization. J. Oper. Res. Soc. Am. 3, 395–401 (1955)
- 3.
Nožička, F., Guddat, J., Hollatz, H., Bank, B.: Theorie der Linearen Parametrischen Optimierung. Akademie-Verlag, Berlin (1974)
- 4.
Bank, B., Guddat, J., Klatte, D., Kummer, B., Tammer, K.: Non-Linear Parametric Optimization. Akademie-Verlag, Berlin (1982). and Birkhäuser, Basel (1983)
- 5.
Klatte, D.: Lineare Optimierungsprobleme mit Parametern in der Koeffizientenmatrix der Restriktionen. In: Lommatzsch, K. (ed.) Anwendungen der Linearen Parametrischen Optimierung, pp. 23–53. Akademie-Verlag, Berlin (1979)
- 6.
Wets, R.J.-B.: On the continuity of the value of a linear program and of related polyhedral-valued multifunctions. Math. Progr. Study 24, 14–29 (1985)
- 7.
Dantzig, G.B., Folkman, J., Shapiro, N.: On the continuity of the minimum set of a continuous function. J. Math. Anal. Appl. 17, 519–548 (1967)
- 8.
Dontchev, A., Zolezzi, T.: Well-Posed Optimization Problems. Lecture Notes in Mathematics, vol. 1543. Springer, Berlin (1993)
- 9.
Kummer, B.: Globale Stabilität quadratischer Optimierungsprobleme. Wiss. Zeitschrift der Humboldt-Universität zu Berlin. Math.-Nat. R. XXVI(5), 565-569 (1977)
- 10.
Robinson, S.M.: Stability theory for systems of inequalities. Part I: linear systems. SIAM J. Numer. Anal. 12, 754–769 (1975)
- 11.
Robinson, S.M.: Some continuity properties of polyhedral multifunctions. Math. Progr. Study 14, 206–214 (1981)
- 12.
Walkup, D.W., Wets, R.J.-B.: A Lipschitzian characterization of convex polyhedra. Proc. Am. Math. Soc. 20, 167–173 (1969)
- 13.
Cánovas, M.J., López, M.A., Parra, J., Toledo, F.J.: Lipschitz continuity of the optimal value via bounds on the optimal set in linear semi-infinite optimization. Math. Oper. Res. 31, 478–489 (2006)
- 14.
Gisbert, M.J., Cánovas, M.J., Parra, J., Toledo, F.J.: Calmness of the optimal value in linear programming. SIAM J. Optim. 3, 2201–2221 (2018)
- 15.
Goberna, M.A., López, M.A.: Linear Semi-Infinite Optimization. Wiley, Chichester (1998)
- 16.
Renegar, J.: Some perturbation theory for linear programming. Math. Program. 65A, 73–91 (1994)
- 17.
Renegar, J.: Linear programming, complexity theory and elementary functional analysis. Math. Program. 70, 279–351 (1995)
- 18.
Li, W.: Sharp Lipschitz constants for basic optimal solutions and basic feasible solutions of linear programs. SIAM J. Control Optim. 32, 140–153 (1994)
- 19.
Dontchev, A.L., Rockafellar, R.T.: Implicit Functions and Solution Mappings: A View from Variational Analysis. Springer, New York (2009)
- 20.
Klatte, D., Kummer, B.: Nonsmooth equations in optimization: regularity, calculus, methods and applications. In: Pardalos, P. (ed.) Nonconvex Optimization Application, vol. 60. Kluwer Academic, Dordrecht (2002)
- 21.
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation, I: Basic Theory. Springer, Berlin (2006)
- 22.
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)
- 23.
Cánovas, M.J., Klatte, D., López, M.A., Parra, J.: Metric regularity in convex semi-infinite optimization under canonical perturbations. SIAM J. Optim. 18, 717–732 (2007)
- 24.
Cánovas, M.J., Gómez-Senent, F.J., Parra, J.: On the Lipschitz modulus of the argmin mapping in linear semi-infinite optimization. Set-Val. Var. Anal. 16, 511–538 (2008)
- 25.
Cánovas, M.J., Dontchev, A.L., López, M.A., Parra, J.: Metric regularity of semi-infinite constraint systems. Math. Prog. Ser. B 104, 329–346 (2005)
- 26.
Klatte, D.: Lipschitz continuity of infima and optimal solutions in parametric optimization: the polyhedral case. In: Guddat, J., Jongen, H.T., Kummer, B., Nožička, F. (eds.) Parametric Optimization and Related Topics, pp. 229–248. Akademie-Verlag, Berlin (1987)
- 27.
Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton, NJ (1970)
- 28.
Cánovas, M.J., López, M.A., Parra, J., Toledo, F.J.: Distance to ill-posedness and the consistency value of linear semi-infinite inequality systems. Math. Program. 103A, 95–126 (2005)
Acknowledgements
This research has been partially supported by project MTM2014-59179-C2-2-P and its associated grant BES-2015-073220, both from MINECO, Spain and FEDER, “Una manera de hacer Europa”, European Union. The authors wish to thank the referees for their suggestions and comments, which have improved the original version of the paper.
Author information
Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gisbert, M.J., Cánovas, M.J., Parra, J. et al. Lipschitz Modulus of the Optimal Value in Linear Programming. J Optim Theory Appl 182, 133–152 (2019). https://doi.org/10.1007/s10957-018-01456-w
Received:
Accepted:
Published:
Issue Date:
Keywords
- Lipschitz modulus
- Optimal value
- Linear programming
- Variational analysis
- Calmness
Mathematics Subject Classification
- 90C31
- 49J53
- 49K40
- 90C05