Abstract
It is well known that general variational inequalities provide us with a unified, natural, novel and simple framework to study a wide class of unrelated problems, which arise in pure and applied sciences. In this paper, we present a number of new and known numerical techniques for solving general variational inequalities and equilibrium problems using various techniques including projection, Wiener-Hopf equations, dynamical systems, the auxiliary principle and the penalty function. General variational-like inequalities are introduced and investigated. Properties of higher order strongly general convex functions have been discussed. The auxiliary principle technique is used to suggest and analyze some iterative methods for solving higher order general variational inequalities. Some new classes of strongly exponentially general convex functions are introduced and discussed. Our proofs of convergence are very simple as compared with other methods. Our results present a significant improvement of previously known methods for solving variational inequalities and related optimization problems. Since the general variational inequalities include (quasi) variational inequalities and (quasi) implicit complementarity problems as special cases, these results continue to hold for these problems. Some numerical results are included to illustrate the efficiency of the proposed methods. Several open problems have been suggested for further research in these areas.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Variational inequalities theory, which was introduced by Stampacchia [173] and Ficchera [38] independently, has emerged as an interesting and fascinating branch of applied mathematics with a wide range of applications in industry, finance, economics, social, pure and applied sciences. Variational inequalities may be viewed as novel generalization of the variational principles, the origin of which can be traced back to Euler, Lagrange and the Bernoulli brothers. Variational principles have played a crucial and important role in the development of various fields of sciences and have appeared as a unifying force. The ideas and techniques of variational inequalities are being applied in a variety of diverse areas of sciences and prove to be productive and innovative. Variational inequalities have been extended and generalized in several directions using novel and new techniques. The minimum of a differentiable convex function \(F\) on the convex set \(K\) is equivalent to finding \(u \in K \) such that
which is known as the variational inequality (1). Here \(F^{\prime }(u) \) is the Frechet differential. Stampacchia [173] proved that potential problems associated with elliptic equations can be studied by the variational inequality. This simple fact inspired a great interest in variational inequalities. Lions and Stampacchia [54] studied the existence of a solution of variational inequalities using essentially the auxiliary principle technique coupled with the projection idea.
Lemke [62] considered the problem of finding \(u\in R^{n}_{+} \) such that
which is called the linear complementarity problem. Here \(A \) is a linear operator. Lemke [62] proved that the two person game theory problems can be studied in the framework of linear complementarity problem (2). See also Lemke and Howson, Jr. [63] and Cottle al et [27] for the nonlinear complementarity problems.
It is worth mentioning that both problems (1) and (2) are different and have been studied in infinite dimensional spaces and finite dimensional spaces independently using quite different techniques. However. Karmardian [57] established that both problems (1) and (2) are equivalent, if the underlying set \(K \) is a convex cone. This equivalent formulation played an important role in developing several techniques for solving these problems.
If the convex set \(K\) depends upon the solution explicitly or implicitly, then the variational inequality is called the quasi variational inequality. Quasi variational inequalities were introduced and investigated by Bensoussan and Lions [15] in control theory. In fact, for a given operator \(T: H \longrightarrow H\), and a point-to-set mapping \(K : u \longrightarrow K(u) \), which associates a closed convex-valued set \(K\) with any element \(u \) of \(H\), we consider the problem of finding \(u \in K(u)\) such that
which is known as the quasi variational inequality. Chan and Pang [22] considered the generalized quasi variational inequalities for set-valued operators. Noor [84] established the equivalence between the quasi variational inequalities and the fixed point formulation and used this equivalence to suggest some iterative methods for solving (3). This equivalence was used to study the existence of a solution of quasi variational inequalities and develop numerical methods.
Related to the quasi variational inequality, we have the problem of finding \(u \in H \) such that
which is called the implicit (quasi) complementarity problem, where \(m \) is a point-to-point mapping. Using the technique of Karamardian [57], Pang [155] and Noor [84] established the equivalence between the problems (3) and (4). Noor [85, 86] has used the change of variables technique to prove that the implicit complementarity problems are equivalent to the fixed point problem. This alternative formulation played an important part in the development of iterative methods for solving various types of complementarity problems and related optimization problems. It is an interesting problem to extend this technique for solving variational inequalities.
Motivated and inspired by the ongoing research in these fields, Noor [87] introduced and investigated a new class of variational inequalities involving two operators. For given nonlinear operators \(T,g \), consider the problem of finding \(u \in H: g(u) \in K \), such that
which is known as the general (Noor) variational inequalities. It turned out that odd-order and nonsymmetric obstacle, free, unilateral and moving boundary value problems arising in pure and applied sciences can be studied via the general variational inequalities, cf. [87,88,89,90,91].
If \(K\) is a convex cone, then the implicit complementarity problem (5) is equivalent to finding \(u \in H \) such that
which is known as the general complementarity problem, where \(K^{*} \) is the dual (polar) cone. We would like to point out that for appropriate and suitable choice of the operators \(T, g \) and the convex sets \(K \), one can obtain several known and new classes of variational inequalities and complementarity problems as special cases of the problem (5).
During the years that have elapsed since its discovery, a number of numerical methods including the projection method and its variant forms, Wiener-Hopf equations, the auxiliary principle, and dynamical systems, have been developed for the solution of variational inequalities and related optimization problems. The projection method and its variants forms including the Wiener-Hopf equations, represent important tools for finding the approximate solution of variational inequalities, the origin of which can be traced back to Lions and Stampacchia [66]. The main idea in this technique is to establish the equivalence between the variational inequalities and the fixed-point problem by using the concept of projection. This alternative formulation has played a significant part in developing various projection-type methods for solving variational inequalities. It is well known that the convergence of the projection methods requires that the operator must be strongly monotone and Lipschitz continuous. Unfortunately these strict conditions rule out many applications of this method. This fact motivated the modification of the projection method or the development of other methods. The extragradient-type methods overcome this difficulty by performing an additional forward step and a projection at each iteration according to the double projection. These methods can be viewed as predictor-corrector methods. Their convergence requires only that a solution exists and the monotone operator is Lipschitz continuous. When the operator is not Lipschitz continuous or when the Lipschitz continuous constant is not known, the extragradient method and its variant forms require an Armijo-like line search procedure to compute the step size with a new projection needed for each trial, which leads to expansive computation. To overcomes these difficulties, several modified projection and extragradient-type methods have been suggested and developed for solving variational inequalities. See [6,7,8,9,10, 17, 18, 24, 36, 37, 39, 42,43,44, 49, 55, 63, 68, 71, 79, 82, 83, 90, 92, 95, 100,101,102,103,104, 106, 107, 110,111,112,113,114, 116, 117, 119, 120, 133,134,135, 137, 138, 143,144,145,146, 150, 152, 153, 160] and the references therein.
In Sect. 4, we present the concept of the general Wiener-Hopf equations, which was introduced by Noor [90]. As a special case, we obtain the original Wiener-Hopf equations, which were considered and studied by Shi [168] and Robinson [166] in conjunction with variational inequalities from different point of views. Using the projection technique, one usually establishes the equivalence between the variational inequalities and the Wiener-Hopf equations. It turned out that the Wiener-Hopf equations are more general and flexible. This approach has played not only an important part in developing various efficient projection-type methods, but also in studying the sensitivity analysis, dynamical systems as well as other concepts of variational inequalities. Noor, Wang and Xiu [152, 153] and Noor and Rassias [146] have suggested and analyzed some predictor-corrector type projection methods by modifying the Wiener-Hopf equations. These methods are also known as Forward-Backward methods, see Tseng [179, 180]. It has been shown that these predictor-corrector-type methods are efficient and robust. Some numerical examples are given to illustrate the efficiency and implementation of the proposed methods. Consequently, our results represent a refinement and improvement of the known results.
Section 5 is devoted to the concept of projected dynamical system in the context of variational inequalities, which was introduced by Dupuis and Nagurney [35] by using the fixed-point formulation of the variational inequalities. For the recent development and applications of the dynamical systems, see [13, 34, 35, 40, 41, 56, 75, 79, 109, 115, 116, 122]. In this technique, we reformulate the variational inequality problem as an initial value problem. Using the discretizing of the dynamical systems, we suggest some new iterative methods for solving the general variational inequalities.
It is a well known fact that in order to implement the projection-type methods, one has to evaluate the projection, which is itself a difficult problem. Secondly, the projection and Wiener-Hopf equations techniques can’t be extended and generalized for some classes of variational inequalities involving the nonlinear (non)differentiable functions, see [92, 94, 108]. These facts motivated to use the auxiliary principle technique. This technique deals with finding the auxiliary variational inequality and proving that the solution of the auxiliary problem is the solution of the original problem by using the fixed-point approach. It turned out that this technique can be used to find the equivalent differentiable optimization problems, which enables us to construct gap (merit) functions. Glowinski et al. [47] used this technique to study the existence of a solution of mixed variational inequalities. Noor [93,94,95, 100, 101, 114, 121, 122] has used this technique to suggest some predictor-corrector methods for solving various classes of variational inequalities. It is well known that a substantial number of numerical methods can be obtained as special cases from this technique. We use this technique to suggest and analyze some explicit predictor-corrector methods for general variational inequalities. In this paper, we give the basic idea of the inertial proximal methods and show that the auxiliary principle technique can be used to construct gap (merit) functions. We use the gap function to consider an optimal control problem governed by the general variational inequalities. The control problem as an optimization problem is also referred as a generalized bilevel programming problem or mathematical programming with equilibrium constraints. These results are mainly due to Deitrich [32, 33]. It is an open problem to compare the efficiency of the inertial methods with other methods and this is another direction for future research.
In Sect. 7, we discuss the application of the penalty function method, which was introduced by Lewy and Stampacchia [64] to study the regularity of the solutions of the variational inequalities. It is known that the finite difference and similar numerical methods cannot be applied to find the approximate solutions of the obstacle, free and moving value problems due to the presence of the obstacle and other constraint conditions. However, it is known that if the obstacle is known then these obstacle and unilateral problems can be characterized by a system of differential equations in conjunction with the general variational inequalities using the penalty function technique. Al-Said [3], Noor and Al-Said [112], Noor and Tirmizi [148] and Al-Said et al. [4, 5] used this technique to develop some numerical methods for solving these systems of differential equations. The main advantage of this technique is its simple applicability for solving systems of differential equations. We present here only the main idea of this technique for solving odd-order obstacle and unilateral problems.
In recent years, much attention has been given to the study of equilibrium problems, which were considered and studied by Blum and Oettli [19] as well as Noor and Oettli [142]. It is known that equilibrium problems include variational inequalities and complementarity problems as special cases. It is remarked that there are very few iterative methods for solving equilibrium problems, since the projection method and its variant forms including the Wiener-Hopf equations cannot be extended for these problems. We use the auxiliary principle technique to suggest and analyze some iterative type methods for solving general equilibrium problems, which is considered in Sect. 8.
Hanson [50] introduced the concept of the invex functions to study mathematical programming problems, which appeared to be significant generalization of the convex functions. Ben-Israel and Mond [14] considered the concepts of invex sets and preinvex functions. They proved that the differentiable preinvex functions are invex functions. Mohan and Neogy [74] proved that the converse is also true under certain conditions. Noor [93] proved that the optimality conditions can be characterized by a class of variational inequalities, which are called variational-like inequalities. Due to the inherent nonlinearity, one cannot use the projection type iterative methods for considering the existence results and numerical methods for variational-like inequalities. However, one uses the auxiliary principle technique to study the existence and numerical methods for variational-like inequalities. Fulga and Preda [43] as well as Awan et al [11] considered the general invex sets and general preinvex functions involving an arbitrary function and studied their basic properties. We show that the minimum of the differentiable general preinvex functions is characterized by a class of variational-like inequalities. This fact motivated us to introduce general variational-like inequalities and study their properties. We have used the auxiliary principle technique to analyze some iterative methods for solving the general variational-like inequalities. Several special cases are discussed as applications of the general variational-like inequalities. These aspects are discussed in Sect. 9.
In Sect. 10, we consider the concept of higher order strongly general convex functions involving an arbitrary function, which can be viewed as a novel and innovative extension of the strongly convex functions. Polyak [159] in 1966 introduced strongly convex functions in order to study optimization problems. Zu and Marcotte [201] discussed the role of the strongly convex functions in the analysis of the iterative methods for solving variational inequalities. Mohsen et al [75] introduced the higher order strongly convex functions involving bifunction, which can be viewed as a significant refinement of the higher order strongly convex function, which were considered by Lin and Fukushima [65] in mathematical programming with equilibrium constraints. They have shown that parallelogram laws for Banach spaces can be obtained as applications of the higher order strongly convex functions. Parallelogram laws for Banach spaces were analyzed by Bynum [21] and Chen at al [23,24,25], which are applied in prediction theory and information technology. We have investigated some basic properties of the higher order strongly general convex functions and have shown that the optimality conditions of the differentiable higher order strongly general convex functions can be expressed as higher order general variational inequalities.
Higher order general variational inequalities are introduced in Sect. 11. Some iterative methods are suggested and analyzed for solving higher order general variational inequalities. It is shown that general variational inequalities related to optimization problems can be obtained as applications.
Related to the convex functions, we have the concept of exponentially convex (concave) functions, which have important applications in information theory, big data analysis, machine learning and statistics. Exponentially convex functions have appeared as significant generalization of the convex functions, the origin of which can be traced back to Bernstein [16]. Avriel [9, 10] introduced the concept of \(r\)-convex functions, from which one can deduce the exponentially convex functions. Antczak [2] considered the \((r, p)\) convex functions and discussed their applications in mathematical programming and optimization theory. Alirazaie and Mahar [1] investigated the impact of exponentially concave functions in information theory. Zhao et al [200] discussed some characterizations of \(r\)-convex functions. Awan et al [5] also investigated some classes of exponentially convex functions. Noor and Noor [132,133,134,135,136,137,138] discussed the characterization of several classes of exponentially convex functions. In Sect. 12, we introduce the concept of strongly exponentially general convex functions and show that these enjoy some nice properties, which convex functions have.
The theory of general variational inequalities is quite broad, so we shall limit ourselves here to give the flavor of the ideas and techniques involved. The techniques used in the analysis of iterative methods and other results for general variational inequalities are a beautiful blend of ideas of pure and applied mathematical sciences. In this paper, we have presented some results regarding the development of various algorithms, their convergence analysis and the penalty computational technique. Although this paper is expository in nature, our choice has been rather to consider some interesting aspects of general variational inequalities. The framework chosen should be seen as a model setting for more general results for other classes of variational inequalities and variational inclusions. One of the main purposes of this expository paper is to demonstrate the close connection among various classes of algorithms for the solution of general variational inequalities and to point out that researchers in different fields of variational inequalities and optimization have been considering parallel paths. We would like to emphasize that the results obtained and discussed in this paper may motivate a large number of novel and innovative applications as well as extensions in these areas. The comparison of the proposed methods with other techniques needs further efforts and is itself an open interesting problem. We have given only a brief introduction of the general variational inequalities in the real Hilbert spaces. For some other aspects of the general variational inequalities, readers are referred to the articles of Noor [85,86,87, 89,90,91,92,93,94,95, 100,101,102,103,104,105, 110, 118,119,120,121,122, 124] and the references therein. The interested reader is advised to explore this field further and discover novel and fascinating applications of this theory in Banach and topological spaces.
It is perhaps part of the fascination of the subject that so many branches of pure and applied sciences are involved in the variational inequality theory. The task of becoming conversant with a wide spectrum of knowledge is indeed a real challenge. The general theory is quite technical, so we shall limit ourselves here to give the flavor of the main ideas involved. The techniques used to analyze the existence results and iterative algorithms for variational inequalities are a beautiful blend of ideas from different areas of pure and applied mathematical sciences. The framework chosen should be seen as a model setting for more general results. However, by just relying on these special results, interesting problems arising in applications can be dealt with easily. Our main motivation is for this paper to give a summary account of the basic theory of variational inequalities set in the framework of nonlinear operators defined on convex sets in a real Hilbert space. We focus our attention on the iterative methods for solving variational inequalities. The equivalence between the variational inequalities and the Wiener-Hopf equations has been used to suggest some new iterative methods. The auxiliary principle technique is applied to study the existence of the solution and to propose a novel and innovative general algorithm for the general variational inequalities, equilibrium problems and related optimization.
2 Preliminaries and Basic Concepts
Let \(H\) be a real Hilbert space, whose inner product and norm are denoted by \(\langle \cdot , \cdot \rangle \) and \(\| \cdot \|\) respectively.
Definition 1
The set \(K\) in \(H\) is said to be a convex set, if
Definition 2
A function \(F\) is said to be a convex function, if
It is well known that a function \(F \) is a convex function, if and only if, it satisfies the inequality
which is known as the Hermite-Hadamard type inequality. Such types of the inequalities provide us with the upper and lower bounds for the mean value integral.
If the convex function \(F \) is differentiable, then \(u \in K \) is the minimum of \(F \), if and only if, \(u\in K \) satisfies the inequality
which is called the variational inequality, introduced and studied by Stampacchia [173] in 1964. For applications, sensitivity, dynamical systems, generalizations, and other aspects of variational inequalities, see [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200] and references therein.
It is of course known that a set may not be a convex set. However, a set may be made a convex set with respect to an arbitrary function. Motivated by this fact, Youness [197] introduced the concept of a general convex set involving an arbitrary function.
Definition 3
The set \(K \) in \(H\) is said to be a general convex set, if there exists an arbitrary function \(g \), such that
Note that, if \(g =I \), the identity operator, then the general convex set reduces to the classical convex set. Clearly every convex set is a general convex set, but the converse is not true.
For the sake of simplicity, we always assume that \(\forall u,v \in H: g(u), g(v) \in K \), unless otherwise stated.
Definition 4
A function \(F\) is said to be a general convex function, if there exists an arbitrary function \(g \) such that
It is known that every convex function is a general convex function, but the converse is not true. For example, the function \(F(x) = e^{x^{2}} \) is a general convex function, but it is not convex.
We now define the general convex functions on \(I_{g}= [g(a),g(b)]\).
Definition 5
Let \(I_{g} =[g(a)g(b)]\). Then \(F\) is a general convex function, if and only if,
One can easily show that the following are equivalent:
-
1.
\(F\) is a general convex function.
-
2.
\(F(g(x))\leq F(g(a))+\frac{F(g(b))-F(g(a))}{g(b)-g(a)}(g(x)-g(a))\).
-
3.
\(\frac{F(g(x))-F(g(a)}{g(x)-g(a)}\leq \frac{F(g(b))-F(g(a))}{g(b)-g(a)}\).
-
4.
\((g(x)-g(a))F(g(a)) +(g(b)-g(a))F(g(x))+(g(a)-g(x))F(g(b))\geq 0\).
-
5.
\(\frac{F(g(a))}{(g(b)-g(a))(g(a)-g(x))}+ \frac{F(g(x))}{(g(x)-g(b))(g(a)-g(x))}+ \frac{F(g(b))}{(g(b)-g(a))(g(x)-g(b))}\geq 0\),
where \(g(x)= (1-t)g(a)+tg(b), \in [0,1]\).
We now show that the minimum of a differentiable general convex function on \(K\) in \(H\) can be characterized by the general variational inequality. This result is mainly due to Noor [110].
Theorem 1
[110] Let \(F: K \longrightarrow H\) be a differentiable general convex function. Then
\(u \in H: g(u) \in K\) is the minimum of a differentiable general convex function \(F\) on \(K\), if and only if, \(u \in : g(u) \in K\) satisfies the inequality
where \(F'\) is the differential of \(F\) at \(g(u)\in K\) in the direction \(g(v)-g(u)\).
Proof
Let \(u \in H: g(u) \in K\) be a minimum of the general convex function \(F\) on \(K\). Then
Since \(K\) is a general convex set, so, for all \(u,v \in K, t \in [0,1]\),
Setting \(g(v)= g(v_{t})\) in (8), we have
Dividing the above inequality by \(t\) and taking \(t \longrightarrow 0\), we have
which is the required result (7).
Conversely, let \(u \in H, g(u) \in K\) satisfy the inequality (7). Since \(F\) is a general convex function, so \(\forall g(u),g(v) \in K, t \in [0,1], g(u)+t(g(v)-g(u)) \in K \) and
which implies that
Letting \(t \longrightarrow 0\), we have
which implies that
showing that \(u \in H: g(u) K\) is the minimum of \(F\) on \(K\) in \(H\). □
Theorem 1 implies that general convex programming problems can be studied via the general variational inequality (9) with \(Tu = F'(g(u))\). In a similar way, one can show that the general variational inequality is the Fritz-John condition of the inequality constrained optimization problem.
In many applications, the general variational inequalities do not arise as the minimization of the differentiable general convex functions. Also, it is known that the variational inequality introduced by Stampacchia [173] can only be used to study the even-order boundary value problems. These facts motivated Noor [87] to introduce a more general variational inequality involving two distinct operators. General variational inequalities constitute a unified framework to study such type of problems.
Let \(K\) be a closed convex set in \(H\) and \(T,g: H \longrightarrow H\) be nonlinear operators. We now consider the problem of finding \(u \in H,g(u) \in K\) such that
Problem (9) is called the general variational inequality, which was introduced and studied by Noor [87] in 1988. It has been shown that a large class of unrelated odd-order and nonsymmetric obstacle, unilateral, contact, free, moving, and equilibrium problems arising in regional, physical, mathematical, engineering and applied sciences can be studied in the unified and general framework of the general variational inequalities (9). Luc and Noor [69] have studied the local uniqueness of solution of the general variational inequality (9) by using the concept of Frechet approximate Jacobian.
We now discus some special cases of the general variational inequality (9).
(I). For \(g \equiv I\), where \(I\) is the identity operator, problem (9) is equivalent to finding \(u \in K\) such that
which is known as the classical variational inequality introduced and studied by Stampacchia [173] in 1964. For recent state-of-the-art results in this field, see [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200] and the references therein.
In the sequel, we assume that \(g\) is onto \(K\) unless, otherwise specified.
(II). If \(N(u)= \{w \in H: \langle w,v-u \rangle \leq 0, \forall v \in K\}\) is a normal cone to the convex set \(K\) at \(u\), then the general variational inequality (9) is equivalent to finding \(u \in H, g(u) \in K\) such that
which are known as the generalized nonlinear equations, see [129, 130].
(III). If \(P^{tg}\) is the projection of \(-Tu\) at \(g(u) \in K\), then it has been shown that the general variational inequality problem (9) is equivalent to finding \(u \in H, g(u) \in K\) such that
which are known as the tangent projection equations. This equivalence has been used to discuss the local convergence analysis of a wide class of iterative methods for solving general variational inequalities (9).
(IV). If \(K^{*}= \{u \in H: \langle u, v \rangle \geq 0, \forall v \in K\}\) is a polar (dual) cone of a convex cone \(K\) in \(H\), then problem (9) is equivalent to finding \(u \in H\) such that
which is known as the general complementarity problem, see Noor [87]. For
where \(m\) is a point-to-point mapping, is called the implicit (quasi) complementarity problem. If \(g \equiv I\), then problem (11) is known as the generalized complementarity problems. Such problems have been studied extensively in recent years.
(V). If \(K=H \), then the general variational inequality (9) is equivalent to finding \(u\in H: g(u) \in H \) such that
which is called the weak formulation of the odd-order and nonsymmetric boundary value problems.
For suitable and appropriate choice of the operators and spaces, one can obtain several classes of variational inequalities and related optimization problems as special cases of the general variational inequalities (9).
We also need the following result, which plays a key role in the studies of variational inequalities and optimization theory.
Lemma 1
[59] For a given \(z \in H\), \(u \in K\) satisfies the inequality
if and only if
where \(P_{K}\) is the projection of \(H\) onto \(K\).
Also, the projection operator \(P_{K}\) is nonexpansive, that is,
and satisfies the inequality
2.1 Applications
We now discuss some applications of general variational inequalities (9). For this purpose, we consider the functional \(I[v] \), defined as
which is called the general energy or potential, virtual work functional. We remark that, if \(g \equiv I \), the identity operator, then the functional \(I[v] \) reduces to
which is known as the standard energy function.
It is known that, if the operator \(T : H \longrightarrow H \) is linear, symmetric and positive, then the minimum of the functional \(J[v] \) on the closed and convex set \(K\) in \(H\) is equivalent to finding \(u \in K \) such that
Inequalities of the type (14) are known as variational inequalities, which were introduced by Stampacchia [173] in the study of potential theory. See also Fichera [38]. It is clear that the symmetry and positivity of the operator \(T \) is necessary. On the other hand, there are many important problems, which are nonsymmetric and non-positive. For the nonsymmetric and odd-order problems, many methods have been developed by several authors including Filippov [39] and Tonti [177] to construct the energy functional of type (13) by introducing the concept of \(g\)-symmetry and \(g\)-positivity of the operator \(g \). We now recall the following concepts.
Definition 6
[39, 177] \(\forall u,v \in H \), the operator \(T : H \longrightarrow H \) is said to be:
(a). \(g\)-symmetric, if and only if,
(b). \(g\)-positive, if and only if,
(c). \(g\)-coercive (\(g\)-elliptic, if there exists a constant \(\alpha > 0 \) such that
Note that \(g\)-coercivity implies \(g\)-positivity, but the converse is not true. It is also worth mentioning that there are operators which are not \(g\)-symmetric but \(g\)-positive. On the other hand, there are \(g\)-positive, but not \(g\)-symmetric operators. Furthermore, it is well-known [39, 177] that if, for a linear operator \(T \), there exists an inverse operator \(T^{-1} \) operator on \(R(T) \) with \(\overline{R(T)} = H \), then one can find an infinite set of auxiliary operators \(g\) such that the operator \(T \) is both \(g\)-symmetric and \(g\)-positive.
We now consider the problem of finding the minimum of the functional \(I[v] \), defined by (13), on the convex set \(K \) in \(H \) and this is the main motivation of our next result.
Theorem 2
Let the operator \(T : H \longrightarrow H \) be linear, \(g\)-symmetric and \(g\)-positive. If the operator \(g: H \longrightarrow H \) is either linear or convex, then the function \(u \in H \) minimizes the functional \(I[v] \) defined by (13) on the convex set \(K \) in \(H \) if and only if \(u \in H, g(u) \in K \) such that
Proof
Let \(u \in H, g(u) \in K \) satisfy (15). Then, using the \(g\)-positivity of the operator \(T \), we have
Since \(K\) is a convex set, so for all \(t \in [0,1], u, w \in K, v_{t} = u +t(w-u) \in K \). Taking \(v = v_{t} \) in (16) and using the fact that \(g\) is linear (or convex), we have
We now define the function
such that
Thus it follows that \(h(t) \) is an increasing function on \([0,1] \) and so \(h(0) \leq h(1) \) gives us
that is,
which shows that \(u \in H \) minimizes the functional \(I[v] \), defined by (13), on the convex set \(K\) in \(H \).
Conversely, assume that \(u \in H \) is the minimum of \(I[v] \) on the convex set \(K \), then
Taking \(v = v_{t} \equiv u +t(w-u) \in K , \forall u, w \in K \) and \(t\in [0,1] \) in (18), we have
Using (13) and the linearity (or convexity) of \(g \), we obtain
from which, as \(t \longrightarrow 0 \), we have
This completes the proof. □
We remark that for \(g = I \), the identity operator, Theorem 2 reduces to the following well-known result in variational inequalities, which is due to Stampacchia [173].
Theorem 3
Let the operator \(T\) be linear, symmetric and positive. Then the minimum of the functional \(J[v]\) defined by (13) on the convex set \(K \) in \(H \) can be characterized by the variational inequality
Proof
Its proofs follows from Theorem 2. □
Example 1
We now show that a wide class of nonsymmetric and odd-order obstacle, unilateral, free, moving and general equilibrium problems arising in pure and applied sciences can be formulated in terms of (13). For simplicity and to illustrate the applications, we consider the obstacle boundary value of third order of the type: Find \(u \) such that
where \(\Omega = [a,b] \) is a domain, \(\psi (x) \) and \(f(x) \) are the given functions. The function \(\psi \) is known as the obstacle function. The region, where \(u(x) = \psi (x), \text{for } x \in \Omega \) is called the contact region (set).
We note that problem (19) is a generalization of the third-order boundary value problem
with boundary condition
which arises from a similarity solution of the so-called barotropic quasi-geostrophic potential vorticity equation for one layer ocean circulation. For the formulation of the equation, see [91] and the references therein.
To study the problem (19) in the general framework of the general variational inequality, we define
which is a closed convex set in \(H^{2}_{0}(\Omega ) \). For the definition and properties of the spaces \(H^{m}_{0} (\Omega ) \), see [50].
Using the technique of [39, 177], we can easily show that the energy functions associated with the problem (19) is
where
and
Here
are the linear operators.
It is clear that the operator \(T \) defined by the relation (21) is \(g\)-symmetric, \(g\)-positive and linear. Also we note that the operator \(g = \frac{d}{dx} \) is a linear operator. Consequently all the assumptions of Theorem 2 are satisfied. Thus it follows from Theorem 2 that the minimum of the functional \(I[v] \), defined by (20) is equivalent to finding \(u \in H \) such that \(g(u) \in K \) and the inequality (9) holds.
In fact, we conclude the problems equivalent to (19) are:
The Variational Problem. Find \(u \in H^{2}_{0}(\Omega ) \), which gives the minimum value to the functional
The Variational Inequality (Weak) Problem. Find \(u \in H^{2}_{0}(\Omega )\) such that \(g(u) \in K \) and
2.2 Quasi Variational Inequalities
We now show that quasi variational inequalities are a special case of general variational inequalities (9). If the convex set \(K\) depends upon the solution explicitly or implicitly, then the variational inequality problem is known as the quasi variational inequality. For a given operator \(T: H \longrightarrow H\), and a point-to-set mapping \(K : u \longrightarrow K(u) \), which associates a closed convex-valued set \(K(u)\) with any element \(u \) of \(H\), we consider the problem of finding \(u \in K(u)\) such that
The inequality of type (22) is called the quasi variational inequality. For the formulation, applications, numerical methods and sensitivity analysis of the quasi variational inequalities, see [15, 22, 84, 85, 102, 139, 147] and the references therein.
We can rewrite the equation (22), for \(\rho > 0 \), as
which is equivalent (using Lemma 1) to finding \(u \in K(u) \) such that
In many important applications, the convex-valued set \(K(u)\) is of the form
where \(m \) is a point-to-point mapping and \(K\) is a closed convex set.
From (23) and (24), we see that problem (22) is equivalent to
which implies that
which is equivalent to the general variational inequality (9) by an application of Lemma 1. We have shown that the quasi variational inequalities (22) with the convex-valued set \(K(u)\) defined by (24) are equivalent to the general variational inequalities (9).
We now recall the well known concepts.
Definition 7
For all \(u,v \in H\), the operator \(T: H \longrightarrow H\) is said to be (i). \(g\)-monotone, if
(ii). \(g\)-pseudomonotone, if
For \(g \equiv I\), Definition 7 reduces to the usual definition of monotonicity and pseudomonotonicity of the operator \(T\). Note that monotonicity implies pseudomonotonicity but the converse is not true, see [35].
Definition 8
A function \(F \) is said to be strongly general convex on the general convex set \(K \) with modulus \(\mu > 0 \), if, for all \(g(u),g(v) \in K_{g}, t \in [0,1] \),
For differentiable strongly general convex function \(F\), the following statements are equivalent.
It is well known that the general convex functions are not convex functions, but they have some nice properties which the convex functions have. Note that, for \(g = I \), the general convex functions are convex functions and definition (8) is the well known result in convex analysis.
3 Projection Methods
In this section, we use the fixed point formulation to suggest and analyze some new implicit methods for solving the variational inequalities. Using Lemma 1, one can show that the general variational inequalities are equivalent to the fixed point problems.
Lemma 2
[87] The function \(u\in H : g(u) \in K\) is a solution of the general variational inequalities (9), if and only if, \(u\in H: g(u) \in K\) satisfies the relation
where \(P_{K} \) is the projection operator and \(\rho >0\) is a constant.
Lemma 2 implies that the general variational inequality (9) is equivalent to the fixed point problem (25). This equivalent fixed point formulation was used to suggest some implicit iterative methods for solving the general variational inequalities. One uses the equivalent fixed point formulation (25) to suggest the following iterative methods for solving general variational inequalities (9).
Algorithm 1
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is known as the projection method and has been studied extensively.
Algorithm 2
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which can be viewed as the extragradient method, which was suggested and analyzed by Koperlevich [60] for solving the classical variational inequalities. Noor [114] has proved the convergence of the extragradient method for pseudomonotone operators.
Algorithm 3
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is known as the modified projection method and has been studied extensively, see Noor [103].
We can rewrite the equation (25) as:
This fixed point formulation was used to suggest the following implicit method for solving variational inequalities, which is due to Noor et al [110, 116]. We used this equivalent formulation to suggest implicit methods for the general variational inequality (9).
Algorithm 4
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
For the implementation of this Algorithm, one can use the predictor-corrector technique to suggest the following two-step iterative method for solving general variational inequalities.
Algorithm 5
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is a two-step iterative method:
From the equation (25), we have
This fixed point formulation is used to suggest the implicit method for solving the variational inequalities as
Algorithm 6
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is another implicit method, see Noor et al. [149].
To implement this implicit method, one can use the predictor-corrector technique to rewrite Algorithm 6 as an equivalent two-step iterative method.
Algorithm 7
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is known as the mid-point implicit method for solving general variational inequalities.
For the convergence analysis and other aspects of Algorithm 4, see Noor et al [149].
It is obvious that Algorithm 4 and Algorithm 6 have been suggested using different variants of the fixed point formulations (25). It is natural to combine these fixed point formulation to suggest a hybrid implicit method for solving the general variational inequalities and related optimization problems, which is the main motivation of this paper.
One can rewrite the equation (25) as
This equivalent fixed point formulation enables to suggest the following method for solving the general variational inequalities.
Algorithm 8
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is an implicit method.
We would like to emphasize that Algorithm 8 is an implicit method. To implement the implicit method, one uses the predictor-corrector technique. We use Algorithm 1 as the predictor and Algorithm 8 as corrector. Thus, we obtain a new two-step method for solving general variational inequalities.
Algorithm 9
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is a two step method.
For constants \(\lambda , \xi \in [ 0.1] \), we can rewrite the equation (25) as:
This equivalent fixed point formulation enables to suggest the following method for solving the general variational inequalities.
Algorithm 10
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is an implicit method.
Using the prediction-correction technique, Algorithm 10 can be written in the following form.
Algorithm 11
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme.
which is a two step method.
Remark 1
It is worth mentioning that Algorithm 11 is a unified one. For suitable and appropriate choice of the constant \(\lambda \) and \(\xi \), one can obtain a wide class of iterative methods for solving general variational inequalities and related optimization problems.
4 Wiener-Hopf Equations Technique
In this Section, we consider the problem of the general Wiener-Hopf equations. To be more precise, let \(Q_{K}= I-P_{K}\), where \(I\) is the identity operator and \(P_{K}\) is the projection of \(H\) onto \(K\). For given nonlinear operators \(T,g: H \rightarrow H\), consider the problem of finding \(z \in H\) such that
provided \(g^{-1} \) exists. Equations of the type (26) are called the general Wiener-Hopf equations, which were introduced and studied by Noor [90, 91]. For \(g = I\), we obtain the original Wiener-Hopf equations, which were introduced and studied by Shi [168] and Robinson [166] in different settings independently. Using the projection operators technique, one can show that the general variational inequalities are equivalent to the general Wiener-Hopf equations. This equivalent alternative formulation has played a fundamental and important role in studying various aspects of variational inequalities. It has been shown that Wiener-Hopf equations are more flexible and provide a unified framework to develop some efficient and powerful numerical techniques for solving variational inequalities and related optimization problems.
Lemma 3
The element \(u\in H: g(u) \in K\) is a solution of the general variational inequality (9), if and only if \(z\in H\) satisfies the Wiener-Hopf equation (26), where
where \(\rho >0\) is a constant.
From Lemma 3, it follows that the variational inequalities (9) and the Wiener–Hopf equations (26) are equivalent. This alternative equivalent formulation is used to suggest and analyze a wide class of efficient and robust iterative methods for solving general variational inequalities and related optimization problems, see [90, 91, 99, 109] and the references therein.
We use the general Wiener-Hopf equations (26) to suggest some new iterative methods for solving the general variational inequalities. From (27) and (28),
Thus, we have
Consequently, for a constant \(\alpha >0 \), we have
where
Using (29) and (30), we can suggest the following new predictor-corrector method for solving variational inequalities.
Algorithm 12
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
Algorithm 12 can be rewritten in the following equivalent form:
Algorithm 13
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which is an explicit iterative method that appears to be original.
If \(\alpha _{n} =1 \), then Algorithm 13 reduces to
Algorithm 14
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
which appears to be original.
We now consider another Algorithm for solving general variational inequalities (9). We also include some computational experiments of these special cases. See [122, 152, 153] for further details.
Algorithm 15
For a given \(u_{0} \in K \), compute
If \(\|R(u_{n}))\|=0\), where \(R(u_{n})= g(u_{n})-P_{K}[g(u_{n}) - Tu_{n}]\), stop; otherwise compute
where \(\eta _{n}=\gamma ^{m_{n}}\) with \(m_{n} \) being the smallest nonnegative integer satisfying
Compute
where
To obtain a larger decrease of the distance from the next iterative point to the solution set, we consider the following optimization problem
Following the technique of Wang et al [182], one can show that solution to the above optimization problem is just the root, denoted by \(\bar{\alpha _{n}} \).
If we choose \(\overline{\alpha }_{n}\) as step size in Algorithm 15, then we obtain another convergent algorithm. Obviously, \(\overline{\alpha }_{n}\) guarantees that the distance between the new iterative point and the solution set has a larger decrease, so we call \(\alpha _{n}\) the basic step and \(\overline{\alpha }_{n}\) the optimal step. However, in practice, if \(K \) does not possess any special structure, it is very expensive to compute \(\overline{\alpha }_{n}\). That is, we need to find a simple way to compute the projection \(P_{K}[u_{n}+\overline{\alpha }_{n} d_{n}]\). Following the proof of Lemma 4.2 in [188], we can show that \(u_{n}(\overline{\alpha }_{n})=P_{K\cap H_{n}}[u_{n}+\alpha _{n} d_{n}] \), where
Thus, we can obtain our improved double-projection method for solving general variational inequalities.
Algorithm 16
For a given \(u_{0} \in K \), compute
If \(\|R(u_{n})\|=0\), stop; otherwise compute
where \(\eta _{n}=\gamma ^{m_{n}}\) with \(m_{n}\) being the smallest nonnegative integer satisfying
Compute
where
Notice that at each iteration in Algorithm 16, the latter projection region is different from the former. More precisely, the latter projection region is an intersection of the domain set \(K \) and a hyperplane, so it does not increase the computation cost if \(K\) is a polyhedral.
For \(g=I \), we now give some numerical experiments for Algorithms 15 and 16 and some comparison with other double-projection methods. Throughout the computational experiments, the parameters used are set as \(\sigma =0.5,\gamma =0.8\), and we use \(\|R(u_{n})\| \leq 10^{-7}\) as stopping criteria. All computational results were undertaken on a PC-II by MATLAB. We use symbol \(e\) to denote the vector whose components are all ones.
Example 2
Consider the mapping \(T: R^{n}\to R^{n}\) defined by
with the domain set
Example 3
This example was tested by Sun [173.174]. Let \(T(x)=Mx+q\), where
with the domain set
It is easy to see that \(T\) is strongly monotone on \(R^{n}\).
Example 4
Define \(T(x)=Mx+q\), where
with the domain set \(K=\{x\in R^{n}_{+}~|~x_{i}\le 1,i=1,2\cdots ,n\}\), see [137].
Again \(T\) is strongly monotone on \(K \). The corresponding strongly monotonicity modulus depends on the dimension \(n\) and approaches zeros when \(n\) tends to infinity. Obviously, \(x=e\) is its unique solution. We choose the starting point \(u_{0}=e\) for Example 2 and choose \(u =(0,\ldots ,0)^{\top }\) as starting point for Examples 3 and 4 for different dimensions \(n\). For double-projection methods [124, 139, 153], there always exist two step size rules just as in Algorithms 15 and 16. In the following, we give numerical comparison for these methods using two different steps. The numerical results for double-projection methods using the basic step for Examples 2, 3, 4 are listed in Table 1, and the numerical results for double projection methods using the optimal step for Examples 2, 3, 4 are listed in Table 2 (the symbol “∖” denotes that the number of iterations exceeds 1000 times).
Obviously, optimal step \(\overline{\alpha }_{n}\) is better than the basic step \(\alpha _{n}\) for any direction. Compared with other double projection methods, Algorithm 16 also shows a better behavior. From Table 1 and Table 2, it is clear that our new methods are as efficient as the methods of Solodov and Svaiter [171, 172, 174]. This shows that our Algorithm 15 and Algorithm 16 can be considered as a practical alternative to the extragradient and other modified projection methods. The comparison of new methods developed in this paper with the recent methods is an interesting problem for future research.
5 Dynamical Systems Technique
In this section, we consider the projected dynamical systems associated with variational inequalities. We investigate the convergence analysis of these new methods involving only the monotonicity of the operator.
We now define the residue vector \(R(u)\) by the relation
Invoking Lemma 3, one can easily conclude that \(u\in H: g(u)\in K\) is a solution of (9), if and only if, \(u\in H: g(u) \in K\) is a zero of the equation
We now consider a projected dynamical system associated with the variational inequalities. Using the equivalent formulation (32), we suggest a class of projected dynamical systems as
where \(\lambda \) is a parameter. The system of type (33) is called the projected dynamical system associated with variational inequalities (9). Here the right hand side is related to the resolvent and is discontinuous on the boundary. From the definition, it is clear that the solution of the dynamical system always stays in \(H\). This implies that the qualitative results such as the existence, uniqueness and continuous dependence of the solution of (33) can be studied. These projected dynamical systems are associated with the general variational inequalities (9), which have been studied extensively.
We use the projected dynamical system (33) to suggest some iterative for solving variational inequalities (9). These methods can be viewed in the sense of Koperlevich [60] and Noor [122] involving the double resolvent operator.
For simplicity, we consider the dynamical system
We construct the implicit iterative method using the forward difference scheme. Discretizing the equation (34), we have
where \(h\) is the step size. Now, we can suggest the following implicit iterative method for solving the variational inequality (9).
Algorithm 17
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
This is an implicit method and is quite different from the known implicit method. Using Lemma 1, Algorithm 17 can be rewritten in an equivalent form as:
Algorithm 18
For a given \(u_{0}\in H\), compute \({u_{n+1}}\) by the iterative scheme
We now study the convergence analysis of Algorithm 18 under some mild conditions.
Theorem 4
Let \(u\in H: g(v) \in K\) be a solution of the general variational inequality (9). Let \(u_{n+1}\) be the approximate solution obtained from (36). If \(T\) is \(g\)-monotone, then
Proof
Let \(u\in H: g(v) \in K\) be a solution of (9). Then
since \(T\) is a \(g\)-monotone operator.
Set \(v=u_{n+1}\) in (38), to have
Taking \(v=u\) in (36), we have
From (41) and using \(2\langle a,b\rangle = \|a+b\|^{2}-\|a\|^{2}-\|b\|^{2}, \forall a,b \in H\), we obtain
the required result. □
Theorem 5
Let \(u\in K\) be the solution of the general variational inequality (9). Let \(u_{n+1}\) be the approximate solution obtained from (36). If \(T\) is a \(g\)-monotone operator and \(g^{-1}\) exists, then \(u_{n+1}\) converges to \(u\in H\) satisfying (9).
Proof
Let \(T\) be a \(g\)-monotone operator. Then, from (37), it follows that the sequence \(\{u_{i}\}^{\infty }_{i=1}\) is a bounded sequence and
which implies that
since \(g^{-1} \) exists.
Since the sequence \(\{u_{i}\}^{\infty }_{i=1}\) is bounded, there exists a cluster point \(\hat{u}\) to which the subsequence \(\{u_{ik}\}^{\infty }_{k=1}\) converges. Taking the limit in (36) and using (43), it follows that \(\hat{u}\in K\) satisfies
and
Using this inequality, one can show that the cluster point \(\hat{u}\) is unique and
□
We now suggest another implicit iterative method for solving (9). Discretizing (34), we have
where \(h\) is the step size.
This formulation enables us to suggest the following iterative method.
Algorithm 19
For a given \(u_{0}\in K\), compute \({u_{n+1}}\) by the iterative scheme
Using Lemma 1, Algorithm 19 can be rewritten in the equivalent form as:
Algorithm 20
For a given \(u_{0}\in K\), compute \({u_{n+1}}\) by the iterative scheme
Again using the dynamical systems, we can suggested some iterative methods for solving the variational inequalities and related optimization problems.
Algorithm 21
For a given \(u_{0}\in K\), compute \({u_{n+1}}\) by the iterative scheme
which can be written in the equivalent form as:
Algorithm 22
For a given \(u_{0}\in K\), compute \({u_{n+1}}\) by the iterative scheme
In a similar way, one can suggest a wide class of implicit iterative methods for solving variational inequalities and related optimization problems, the comparison of these methods with other methods is an interesting problem for future research.
6 Auxiliary Principle Technique
In the previous sections, we have considered and analyzed several projection-type methods for solving variational inequalities. It is well known that to implement such types of methods, one has to evaluate the projection, which is itself a difficult problem. Additionally, one can’t extend the technique of projection for solving some other classes of variational inequalities. These facts motivate us to consider other methods. One of these techniques is known as the auxiliary principle. This technique is basically due to Lions and Stampacchia [173]. Glowinski et al. [47] used this technique to study the existence of a solution of mixed variational inequalities. Noor [93,94,95, 114, 121, 122] has used this technique to develop some predictor-corrector methods for solving variational inequalities. It has been shown that various classes of methods including projection, Wiener-Hopf, decomposition and descent can be obtained from this technique as special cases.
For a given \(u \in H, g(u) \in K \) satisfying (9), consider the problem of finding a unique \(w \in H, g(w) \in K \) such that
where \(\rho > 0 \) is a constant.
Note that, if \(w = u \), then \(w \) is clearly a solution of the general variational inequality (9). This simple observation enables us to suggest and analyze the following predictor-corrector method.
Algorithm 23
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1}\) by the iterative schemes
where \(\rho > 0, \beta > 0 \) and \(\mu > 0 \) are constants
Algorithm 23 can be considered as a three-step predictor-corrector method, which was suggested and studied by Noor [110, 122].
If \(\mu = 0 \), then Algorithm 23 reduces to:
Algorithm 24
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1}\) by the iterative schemes:
which is known as the two-step predictor-corrector method, see [110, 122].
If \(\mu = 0 , \beta = 0 \), then Algorithm 23 becomes:
Algorithm 25
For a given \(u_{0} \in H \), compute \(u_{n+1}\) by the iterative scheme
Using the projection technique, Algorithm 23 can be written as
Algorithm 26
For a given \(u_{0} \in H \), compute \(u_{n+1}\) by the iterative schemes
or
or
which is a three-step forward-backward method. See also the two-step forward-backward splitting method of Tseng [179, 180] for solving classical variational inequalities.
Definition 9
For all \(u,v,z \in H \), the operator \(T:H \longrightarrow H \) is said to be:
(i). \(g\)-partially relaxed strongly monotone, if there exists a constant \(\alpha > 0 \) such that
(ii). \(g\)-cocoercive, if there exists a constant \(\mu > 0 \) such that
We remark that if \(z = u \), then \(g\)-partially relaxed strongly monotonicity is equivalent to monotonicity. For \(g = I \), Definition 9 reduces to the standard definition of partially relaxed strongly monotonicity and cocoercivity of the operator. We now show that \(g\)-cocoercivity implies \(g\)-partially relaxed strongly monotonicity. This result is due to Noor [110, 122]. To convey an idea, we include its proof.
Lemma 4
If \(T \) is a \(g\)-cocoercive operator with constant \(\mu > 0 \), then \(T\) is \(g\)-partially relaxed strongly monotone operator with constant \(\frac{-1}{4\mu } \).
Proof
For all \(u,v, z \in H \), consider
which shows that \(T \) is a \(g\)-partially relaxed strongly monotone operator. □
One can easily show that the converse is not true. Thus we conclude that the concept of \(g\)-partially relaxed strongly monotonicity is a weaker condition than \(g\)-cocoercivity.
One can study the convergence criteria of Algorithm 23 using the technique of Noor [104].
Remark 2
In the implementation of these algorithms, one does not have to evaluate the projection. Our method of convergence is very simple as compared with other methods. Following the technique of Tseng [179], one can obtained new parallel and decomposition algorithms for solving a number of problems arising in optimization and mathematical programming.
Remark 3
We note that, if the operator \(g \) is linear or convex, then the auxiliary problem (47) is equivalent to finding the minimum of the functional \(I[w] \) on the convex set \(K \), where
It can be easily shown that the optimal solution of (48) is the projection of the point \(( g(u)-\rho Tu )\) onto the convex set \(K \), that is,
which is the fixed-point characterization of the general variational inequality (9).
Based on the above observations, one can show that the general variational inequality (9) is equivalent to finding the minimum of the functional \(N[u] \) on \(K \) in \(H \), where
where \(g(w) = g(w(u)) \). The function \(N[u]\) defined by (50) is known as the gap (merit) function associated with the general variational inequality (9). This equivalence has been used to suggest and analyze a number of methods for solving variational inequalities and nonlinear programming, see, for example, Patriksson [156]. In this direction, we have:
Algorithm 27
For a given \(u_{0} \in H \), compute the sequence \(\{ u_{n}\} \) by the iterative scheme
where \(d_{n} = g(w(u_{n}))-g(u_{n}) = P_{K}[g(u_{n})-\rho Tu_{n}]- g(u_{n}) \), and \(t_{n} \in [0,1] \) are determined by the Armijo-type rule
It is worth noting that the sequence \(\{u_{n}\}\) generated by
is very much similar to that generated by the projection-type Algorithm 3. Based on the above observations and discussion, it is clear that the auxiliary principle approach is quite general and flexible. This approach can be used not only to study the existence theory but also to suggest and analyze various iterative methods for solving variational inequalities. Using the technique of Fukushima [42], one can easily study the convergence analysis of Algorithm 27.
We have shown that the auxiliary principle technique can be used to construct gap (merit) functions for general variational inequalities (9). We use the gap function to consider an optimal control problem governed by the general variational inequalities (9). The control problem is an optimization problem, which is also referred as a generalized bilevel programming problem or mathematical programming with equilibrium constraints. It is known that the techniques of the classical optimal control problems cannot be extended for variational inequalities, see Dietrich [22]. This has motivated us to develop some other techniques including the notion of conical derivatives, the penalty method and formulating the variational inequality as operator equation with a set-valued operator. Furthermore, one can construct a so called gap function associated with a variational inequality, so that the variational inequality is equivalent to a scalar equation of the gap function. Under suitable conditions such a gap function is Frechet differentiable and one may use a penalty method to approximate the optimal control problem and calculate a regularized gap function in the sense of Fukushima [42] to the general variational inequality (9) and determine their Frechet derivative. Dietrich [32, 33] has developed similar results for the general variational inequalities. We only give the basic properties of the optimal control problem and the associated gap functions to give an idea of the approach.
We now consider the following problem of optimal control for the general variational inequalities (9), that is, to find \(u \in H: g(u) \in K, z \in U \) such that
where \(H \) and \(U\) are Hilbert spaces. The sets \(K \) and \(E \) are closed convex sets in \(H \) and \(U \) respectively. Here \(H \) is the space of state and \(K \subset H \) is the set of state constraints for the problem. \(U \) is the space of control and the closed convex set \(E \subset U \) is the set of control constraints. \(T(.,.): H\times U \longrightarrow H \) is a an operator which is Frechet differentiable. The functional \(I(.,.) : H \times U \longrightarrow R\cup \{+\infty \} \) is a proper, convex and lower-semicontinuous function. Also we assume that the problem \({\mathcal{P }}\) has at least one optimal solution denoted by \((u^{*},z^{*}) \in H\times U \).
Related to the optimization problem \(({\mathbf{P }})\), we consider the regularized gap (merit) function \(h_{\rho }(u, z):H\times U \longrightarrow R \) as
We remark that the regularized function (51) is a natural generalization of the regularized gap function (50) for variational inequalities. It can be shown that the regularized gap function \(h _{\rho }(.,.) \) defined by (51) has the following properties. The analysis is in the spirit of Dietrich [33].
Theorem 6
The gap function \(h_{\rho }(.,.) \) defined by (51) is well-defined and
where \(d_{K} \) is the distance to \(K \) and
Proof
It is well-known that
Take \(v = u \) in (51). Then clearly (i) is satisfied.
Let \((u,z) \in H\times U \). Then
Setting \(g(u_{K}) = P_{K}[g(u)-\rho T(u,z)] \), we have
□
Theorem 7
If the set \(K\) is \(g\)-convex in \(H \), then the following are equivalent.
Proof
We show that \((ii) \Longrightarrow (i)\).
Let \(u \in H \) and \(z \in U \) be a solution of
Then we have
which implies that
Also for \(v\in H:g(v) \in K \), we know that
From these above inequalities, we have (i), that is, \(h_{\rho }(u,z) = 0 \).
Conversely, let (i) hold. Then
Since \(K\) is a \(g\)-convex set, so for all \(g(w),g(u) \in K, t \in [0,1]\),
Setting \(g(v)=g(v_{t}) \) in (52), we have
Letting \(t \longrightarrow 0 \), we have
the required (ii). Thus we conclude that (i) and (ii) are equivalent. Applying Lemma 1, we have \((ii) = (iii) \). □
From Theorem 6 and Theorem 7, we conclude that the optimization problem \({\mathcal{P}}\) is equivalent to
where \(h_{\rho }(u,z) \) is \({\mathcal{C}}^{1}\)-differentiable in the sense of Frechet, but is not convex.
If the operators \(T, g \) are Frechet differentiable, then the gap function \(h_{\rho }(u,z) \) defined by (51) is also Frechet differentiable. In fact,
where \([T^{\prime }(u,z)]^{\prime } \) is the adjoint operator of \(T^{\prime }(u,z) \). This implies the following connection at a point \((u_{1},z_{1}) \)
which is a solution of the general variational inequality (9), that is, for \((u_{1},z_{1}) \) with \(h_{\rho }(u_{1},z_{1}) = 0 \).
For the optimal problem \({\mathcal{P}}\), we have
We now consider a simple example of optimal control problem to illustrate
First, we solve the general variational inequality (9)
We obtain as the unique optimal solution of \({\mathbf{P}}_{1} (u_{opt},z_{opt})=( \frac{1}{2}\sqrt{2},\frac{1}{2})\) with \(\min ( { \mathcal{P}}_{1})= \frac{3}{4}\).
Next, we calculate the gap function of the general variational inequality problem (9).
This shows that equivalence between these problems.
7 Penalty Function Method
In this section, we consider a system of third-order boundary value problems, where the solution is required to satisfy some extra continuity conditions on the subintervals in addition to the usual boundary conditions. Such type of systems of boundary value arise in the study of obstacle, free, moving and unilateral problems and have important applications in various branches of pure and applied sciences. Despite of their importance, little attention has been given to develop efficient numerical methods for solving numerically these systems except for special cases. In particular, it is known that if the obstacle function is known then the general variational inequalities can be characterized by a system of odd-order boundary value problems by using the penalty method. This technique is called the penalty function method and was used by Lewy and Stampacchia [64] to study the regularity of a solution of variational inequalities. The computational advantage of this technique is its simple applicability for solving the system of differential equations. This technique has been explored and developed by Noor et al. to solve the systems of differential equations associated with even and odd-order obstacle problems. Our approach to these problems is to consider them in a general manner and specialize them later on. To convey an idea of the technique involved, we first introduce two numerical schemes for solving a system of third boundary value problems using the splines. An example involving the odd-order obstacle is given.
For simplicity, we consider a system of obstacle third-order boundary value problem of the type
with the boundary conditions
and the continuity conditions of \(u, u^{\prime } \) and \(u^{\prime \prime } \) at \(c\) and \(d \). Here \(f \) and \(p \) are continuous functions on \([a,b] \) and \([c,d]\) respectively. The parameters \(r, \alpha , \beta _{1} \) and \(\beta _{2}\) are real finite constants. Such type of systems arise in the study of obstacle, free, moving and unilateral boundary value problems and have important applications in other branches of pure and applied sciences. In general, it is not possible to obtain the analytical solutions of (53) for arbitrary choice of \(f(x) \) and \(p(x) \). We usually resort to numerical methods for obtaining the approximate solutions of (53). Here we use cubic spline functions to derive some consistency relations which are then used to develop a numerical technique for solving a system of third-order boundary value problems. Without loss of generality, we set
in order to derive a numerical method for approximating the solution of the system (53). For this purpose, we divide the interval [a,b] into \(n\) equal subintervals using the grid point
with
where \(n\) is a positive integer chosen such that both \(\frac{n+1}{4} \) and \(\frac{3(n+1)}{4}\) are also positive integers. Additionally, let \(u(x) \) be the exact solution of (53) and \(s_{i}\) be an approximation to \(u_{i} = u(x_{i}) \) obtained by the cubic \(P_{i}(x) \) passing through the points \((x_{i},s_{i})\) and \((x_{i+1},s_{i+1}) \). We write \(P_{i}(x) \) in the form
for \(i = 0,1,2, \ldots ,n-1 \). Then the cubic spline is defined by
We now develop explicit expressions for the four coefficients in (55). To do this, we first design
and
where \(f_{i} = f(x_{i}) \) and \(p_{i} = p(x_{i})\).
Using the above discussion, we obtain the following relations
Now from the continuity of the cubic spline \(s(x)\) and its derivatives up to order two at the point \((x_{i},s_{i}) \) where the two cubic \(P_{i_{1}}(x)\) and \(P_{i}(x) \) join, we can have
From the above relations, one can easily obtain the following consistency relations
Eliminating \(D_{i} \) from (63), (62) and (61), we have
for \(i = 2,3, \ldots ,n-1\). The recurrence relations (64) gives \((n-2)\) linear equations in the unknowns \(s_{i}, i = 1,2, \ldots ,n\). We need two more equations one at each end of the range of integration. These two equations are:
The cubic spline solution of (55) is based on the linear equations given by (63)-(64). The local truncation errors \(T_{i}, i =1,2, \ldots \) associated with the cubic spline method are given by
which indicates that this method is a second order convergent process.
To illustrate the applications of the numerical methods developed above, we consider the third order-order obstacle boundary value problem (19). Following the penalty function technique of Levy and Stampacchia [64], the variational inequality (65) can be written as
where \(\nu \{t\} \) is the discontinuous function defined by
is known as the penalty function and \(\psi < 0 \) on the boundary is the called the obstacle function. It is clear that problem (19) can be written in the form
with
where \(\nu \{t\}\) is defined by (68). If the obstacle function \(\psi \) is known and is given by the relation
then problem (19) is equivalent to the following system of third-order differential equations
with the boundary conditions
and the conditions of continuity of \(u, u^{\prime }\) and \(u^{\prime \prime } \) at \(x = \frac{1}{4} \) and \(\frac{3}{4}\). It is obvious that problem (71) is a special case of problem (53) with \(p(x) =1 \) and \(r =-1\).
Note that for \(f =0 \), the system of differential equations (71) reduces to
with the boundary condition (72).
The analytical solution for this problem is
To find the constants \(a_{i}, \; i = 1,2, \ldots , 6\), we apply the continuity conditions of \(u, u^{\prime }\) and \(u^{\prime \prime }\) at \(x = \frac{1}{4}\) and \(\frac{3}{4}\), which leads to the following system of linear equations
where
One can find the exact solution of this system of linear equations by using the Gaussian elimination method.
For various values of \(h\), the system of third-order of boundary value problem defined by (71) and (72) was solved using the numerical method developed in this section. A detailed comparison is given in Table 3.
From Table 3, it is clear that the quartic spline method gives better results than the cubic and quintic splines methods developed earlier for solving system of third-order boundary value systems.
For more details regarding solving various classes of obstacle boundary value problems using the penalty technique, see [3,4,5, 114, 150] and the references therein. In recent years, homotopy (analysis) perturbation method, Adomonian decomposition, Laplace transformation and variational iteration techniques are being used to find the analytical solutions of fractional unilateral and obstacle boundary value problems.
8 General Equilibrium Problems
In this section, we introduce and consider a class of equilibrium problems known as general equilibrium problems. It is known that equilibrium problems [19, 142] include variational and complementarity problems as special cases. We note that the projection and its variant forms including the Wiener-Hopf equations cannot be extended to equilibrium problems, since it is not possible to find the projection of the bifunction \(F (.,.)\). Noor [94, 95, 121] used the auxiliary principle technique to analyse some iterative methods for equilibrium problems. In this chapter, we introduce and study a class of equilibrium problems involving the arbitrary function, which is called the general equilibrium problem. We show that the auxiliary principle technique can be used to suggest and analyze some iterative methods for solving general equilibrium problems. We also study the convergence analysis of these iterative methods and discuss some special cases.
For given nonlinear function \(F(.,.) : H\times H \longrightarrow R\) and operator \(g : H \longrightarrow R \), we consider the problem of finding \(u \in H, g(u) \in K \) such that
which is known as the general equilibrium problem.
We now discuss some special cases of the general equilibrium problem (75).
(I). For \(g \equiv I \), the identity operator, problem (75) is equivalent to finding \(u \in K \) such that
which is called the equilibrium problem, that was introduced and studied by Blum and Oettli [19]. For the recent applications and development, see [102, 109, 153] and the references therein.
(II). If \(F(u,g(v)) = \langle Tu, \eta (g(v),g(u)) \rangle \) and the set \(K_{g\eta } \) is an invex set in \(H \), then problem (75) is equivalent to finding \(u \in K_{g\eta } \) such that
The inequality of type (77) is known as the general variational-like inequality, which arises as a minimum of general preinvex functions on the general invex set \(K_{g\eta } \).
(III). We note that, for \(F(u,g(v) \equiv \langle Tu, g(v)-g(u) \rangle \), problem (75) reduces to problem (9), that is, find \(u \in K, g(u) \in K \) such that
which is exactly the general variational inequality (9). Thus we conclude that general equilibrium problems (75) are quite general and unifying.
We now use the auxiliary principle technique as developed in Sect. 6 to suggest and analyze some iterative methods for solving general equilibrium problems (75).
For a given \(u \in H, g(u) \in K \) satisfying (75), consider the auxiliary equilibrium problem of finding \(w \in H, g(w) \in K \) such that
Obviously, if \(w = u \), then \(w \) is a solution of the general equilibrium problem (75). This fact allows us to suggest the following iterative method for solving (75).
Algorithm 28
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1} \) by the iterative scheme:
where \(\rho > 0 \) and \(\beta > 0 \) are constants.
Algorithm 28 is called the predictor-corrector method for solving general equilibrium problem (75).
For \(g = I \), where \(I \) is the identity operator, Algorithm 28 reduces to:
Algorithm 29
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1} \) by the iterative schemes
Algorithm 29 is also a predictor-corrector method for solving equilibrium problem and appears to be original.
If \(F(u,g(v)) = \langle Tu, g(v)-g(u) \rangle \), then Algorithm 28 becomes:
Algorithm 30
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1} \) by the iterative scheme
which is a two-step method for solving general variational inequalities (9).
In brief, for suitable and appropriate choice of the functions \(F(.,.) \) and the operators \(T, g \), one can obtain various algorithms developed in the previous sections.
For the convergence analysis of Algorithm 28, we need the following concepts.
Definition 10
The function \(F(.,.): H \times H \longrightarrow H \) is said to be:
(i). \(g\)-monotone, if
(ii). \(g\)-pseudomonotone, if
(iii). \(g\)-partially relaxed strongly monotone, if there exists a constant \(\alpha > 0 \) such that
Note that for \(u = z \), \(g\)-partially relaxed strongly monotonicity reduces to \(g\)-monotonicity of \(F(.,.)\).
For \(g = I \), Definition 10 coincides with the standard definition of monotonicity, pseudomonotonicity of the function \(F(.,.) \).
We now consider the convergence analysis of Algorithm 28.
Theorem 8
Let \(\bar{u} \in H \) be a solution of (75) and let \(u_{n+1} \) be an approximate solution obtained from Algorithm 28. If the bifunction \(F(.,.) \) is \(g\)-partially relaxed strongly monotone with constant \(\alpha > 0 \), then
Proof
Let \(g(\bar{u} ) \in H \) be a solution of (75). Then
where \(\rho > 0 \) and \(\beta > 0 \) are constants.
Now taking \(v= u_{n+1} \) in (79) and \(v = \bar{u} \) in (83), we have
and
where we have used the fact that \(F(.,.) \) is \(g\)-partially relaxed strongly monotone with constant \(\alpha > 0 \). Using the inequality
we obtain
Combining (87) and (88), we have
the required (81).
Taking \(v = \bar{u} \) in (80) and \(v = w_{n} \) in (84), we obtain
and
Adding (90), (91) and rearranging the terms, we have
since \(F(.,.) \) is \(g\)-partially strongly monotone with constant \(\alpha > 0 \).
Consequently, from (92), we have
the required (82). □
Theorem 9
Let \(H\) be a finite dimensional subspace and let \(0 < \rho < \frac{1}{2\alpha }\) and
\(0 < \beta < \frac{1}{2\alpha }\). If \(\bar{u} \in H :g(\bar{u}) \in K\) is a solution of (75) and \(u_{n+1}\) is an approximate solution obtained from Algorithm 28, then
Proof
Its proof is very much similar to that of Noor [122]. □
We again use the auxiliary principle technique to suggest an inertial proximal method for solving the general equilibrium problem (75). It is noted that the inertial proximal method includes the proximal method as a special case.
For a given \(u \in H, g(u) \in K \) satisfying (75), consider the auxiliary general equilibrium problem of finding \(w \in H, g(w) \in K \) such that
where \(\rho > 0 \) and \(\alpha _{n} > 0 \) are constants.
It is clear that if \(w = u \), then \(w\) is a solution of the general equilibrium problem (75). This fact enables us to suggest an iterative method for solving (75) as:
Algorithm 31
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1} \) by the iterative scheme
where \(\rho > 0 \) and \(\alpha _{n} > 0 \) are constants.
Algorithm 31 is called the inertial proximal point method. For \(\alpha _{n} =0 \), Algorithm 31 reduces to:
Algorithm 32
For a given \(u_{0} \in H \), find the approximate solution \(u_{n+1} \) by the iterative schemes
which is known as the proximal method and appears to be a new one. Note that for \(g \equiv I \), the identity operator, one can obtain an inertial proximal method for solving equilibrium problems (76). In a similar way, using the technique of Noor [122], one can suggest and analyze several new inertial type methods for solving general equilibrium problems. It is a challenging problem to compare the efficiency of these methods with other techniques for solving general equilibrium problems.
9 General Variational-Like Inequalities
It is well known that the minimum of the (non) differentiable preinvex functions on the invex set can be characterized by a class of variational inequalities, called variational-like inequalities. For the applications and numerical methods of variational-like inequalities, see [18, 93, 95, 106] and the references therein. In this section, we introduce the general variational-like inequalities with respect to an arbitrary function. Due the structure of the general variational inequalities, the projection method and its variant forms cannot be used to study the problem of the existence of the solution. This implies that the variational-like inequalities are not equivalent to the projection (resolvent) fixed-point problems. We use the auxiliary principle technique to suggest and analyze some implicit and explicit iterative methods for solving variational-like inequalities. We also show that the general variational-like inequalities are equivalent to the optimization problems, which can be used to study the associated optimal control problem. Such type of the problems have been not studied for general variational-like inequalities and this is another direction for future research.
We recall some known basic concepts and results.
Let \(F:K_{\eta } \rightarrow R\) be a continuous function and let \(\eta (.,.) :K_{\eta }\times K_{\eta } \rightarrow R\) be an arbitrary continuous bifunction. Let \(g(.)\) be a non-negative function.
Definition 11
[14] The set \(K_{\eta }\) in \(H\) is said to be invex set with respect to an arbitrary bifunction \(\eta (\cdot ,\cdot )\), if
The invex set \(K_{\eta }\) is also called \(\eta \)-connected set. Note that the invex set with \(\eta (v,u)=v-u\) is a convex set, but the converse is not true.
In the sequel, \(K_{\eta }\) is a nonempty closed invex set in \(H\) with respect to the bifunction \(\eta (\cdot ,\cdot )\), unless otherwise specified.
Definition 12
[14] The set \(K_{g\eta }\) in \(H\) is said to be a general invex set with respect to an arbitrary bifunction \(\eta (\cdot ,\cdot )\) and the function \(g \), if
The invex set \(K_{g\eta }\) is also called a \(g\eta \)-connected set. Note that the general invex set with \(\eta (g(v),g(u))=g(v)-g(u) \) is a general convex set, but the converse is not true. See Youness [197].
We now present the concept of the general preinvex function.
Definition 13
Let \(K_{g\eta } \subseteq H\) be a general invex set with respect to \(\eta (.,.): K_{\eta } \times K_{\eta } \longrightarrow R^{n}\) and \(g: H \longrightarrow H \). A function \(F: K_{g\eta } \longrightarrow R \) is said to be a general preinvex function, if,
Note that for \(g \equiv I\), the general preinvex functions are called the preinvex functions. For \(\eta (v,u) = g(v)-g(u)\), general preinvex functions are known as general convex functions. Every convex function is a general convex function and every general convex function is a general preinvex function, but the converse is not true, see [11, 43].
In the sequel, we assume that the set \(K_{g\eta } \) is a general invex set with respect to the functions \(\eta (.,.) : K_{g\eta } \times K_{g\eta } \longrightarrow H, g: K_{g \eta } \longrightarrow H \) , unless otherwise specified.
Definition 14
The function \(F \) is said to be general semi preinvex, if
For \(g \equiv I\), and \(t= 1\), we have
Definition 15
The function \(F \) is called general quasi preinvex, if
The function \(F\) is called strictly general quasi preinvex, if strict inequality holds for all \(g(u),g(v) \in K_{g\eta }, g(u) \neq g(v)\). The function \(F\) is said to be general quasi preconcave, if and only if, \(-F\) is general quasi preinvex. A function which is both general quasi preinvex and general quasi preconcave is called the general quasimonotone function.
Definition 16
The function \(F \) is said to be a general logarithmic preinvex on the general invex set \(K_{g\eta }\) with respect to the bifunction \(\eta (.,.) \) and the function \(g\), if
where \(F(.) > 0\).
Clearly for \(t = 1 \), and \(g = I \), we have
It follows that:
general logarithmic preinvexity ⟹ general preinvexity ⟹ general quasi preinvexity.
For appropriate and suitable choice of the operators and spaces, one can obtain several classes of generalized preinvexity.
In this section, we prove that the minimum of a differentiable general preinvex function on the general invex sets can be characterized by a class of variational-like inequalities, which is called the general variational-like inequality.
Theorem 10
Let \(F\) be a differentiable general preinvex function. Then \(u \in H: g(u) \in K_{g\eta } \) is a minimum of \(F\) on \(K_{\eta }\), if and only if, \(u \in H: g(u)\in K_{g\eta }\) satisfies
where \(F'\) is the Frechet derivative of \(F\) at \(g(u) \in K_{g\eta }\).
Proof
Let \(u\in H:g(u) \in K_{g\eta } \) be a minimum of \(F \). Then
Since the set \(K_{\eta } \) is a general invex set, so \(\forall g(u), g(v) \in K_{g\eta } \), and \(t \in [0,1] \),
Setting \(g(v) = g(v_{t}) \) in (95), we have
Dividing the above inequality by \(t\) and taking the limit as \(t \longrightarrow 0 \), we have
which is the required (94).
Conversely, let \(u \in H:g(u) \in K_{g\eta } \) satisfy the inequality (94). Then, using the fact that the function \(F \) is a general preinvex function, we have:
Dividing the above inequality by \(t\) and letting \(t \longrightarrow 0 \), we have
which implies that
which shows that \(u \in H: g(u)\in K_{g\eta } \) is a minimum of the general preinvex function on the general invex set \(K_{g\eta }\) in \(H \). □
Inequalities of the type (94) are called the general variational-like inequalities. For \(g \equiv I\), where \(I\) is the identity operator, Theorem 10 is mainly due to Noor [93]. From Theorem 10 it follows that the general variational-like inequalities (94) arise naturally in connection with the minimum of general preinvex functions over general invex sets. In many applications, problems like (94) do not arise as a result of minimization. This fact motivated us to consider a problem of finding a solution of a more general variational-like inequality of which (94) is a special case.
Given an (nonlinear) operator \(T: H \longrightarrow H\), and \(\eta :K_{g\eta }\times K_{g\eta } \longrightarrow R\), where \(K_{g\eta } \) is a nonempty general invex set in \(H \), we consider the problem of finding \(u \in H: g(u)\in K_{g\eta }\) such that
which is known as the general variational-like inequality.
If \(\eta (v,u) = g(v)-g(u) \), then the general invex set \(K_{g\eta }\) becomes a general convex set \(K_{g}\). In this case, problem (96) is equivalent to finding \(u \in H : g(u) \in K_{g} \) such that
which is exactly the general variational inequality (9). For formulation, numerical methods, sensitivity analysis, dynamical system and other aspects of general variational inequalities, see [109, 110, 122, 144] and the references therein.
For suitable and appropriate choice of the operators \(T\), \(\eta \), and the general invex set, one may derive a wide class of known and new variational inequalities as special cases of problem (96). It is clear that general variational-like inequalities provide us a framework to study a wide class of unrelated problems in a unified setting.
We now use the auxiliary principle technique to suggest and analyze some iterative methods for general variational-like inequalities (96).
For a given \(u \in H; g(u) \in K_{g\eta }\) satisfying (96), consider the problem of finding a solution \(w \in H: g(w) \in K_{g\eta }\) satisfying the auxiliary variational-like inequality
where \(\rho > 0 \) is a constant and \(E^{\prime } \) is the differential of a strongly general preinvex function \(E \). The inequality (97) is called the auxiliary general variational-like inequality.
Note that if \(w =u \), then clearly \(w\) is a solution of the general variational-like inequality (96). This observation enables us to suggest the following algorithm for solving (96).
Algorithm 33
For a given \(u_{0} \in H\), compute the approximate solution \(u_{n+1}\) by the iterative scheme
Algorithm 33 is called the proximal point algorithm for solving the general variational-like inequalities (96).
For \(\eta (g(v),g(u))= g(v)-g(u) \), the general preinvex function \(E\) is equivalent to the convex function and the invex set \(K_{g\eta } \) becomes the general convex set. Consequently Algorithm 33 reduces to:
Algorithm 34
For a given \(u_{0} \in K_{g}\), compute the approximate solution \(u_{n+1}\) by the iterative scheme
which is known as the proximal point algorithm for solving general variational inequalities.
Remark 4
The function
associated with the preinvex functions \(E(u) \) is called the general Bregman function. We note that, if \(\eta (g(v),g(u)) = g(v)-g(u) \), then
is the well known Bregman function. For the applications of the Bregman function in solving variational inequalities and related optimization problems, see [201].
We now study the convergence analysis of Algorithm 33. For this purpose, we recall the following concepts.
Definition 17
\(\forall u,v,z \in H\), an operator \(T: H \longrightarrow H \) is said, with respect to an arbitrary function \(g: H \longrightarrow H \), to be:
-
(i).
general \(g\eta \)-pseudomonotone, if
$$\begin{aligned} \langle Tu, \eta (g(v),g(u)) \rangle \geq 0 \quad \Longrightarrow \quad \langle Tv, \eta (g(v),g(u)) \rangle \geq 0. \end{aligned}$$ -
(ii).
general \(g\eta \)-Lipschitz continuous, if there exists a constant \(\beta > 0 \) such that
$$\begin{aligned} \langle Tu-Tv, \eta (g(u),g(v) \rangle \leq \beta \|g(u)-g(v)\|^{2}. \end{aligned}$$ -
(iii).
general \(g\eta \)-cocoercive, if there exists a constant \(\mu > 0 \) such that
$$\begin{aligned} \langle Tu-Tv, \eta (g(u),g(v)) \rangle \geq \mu \|T(g(u))-T(g(v))\|^{2}. \end{aligned}$$ -
(iv).
general \(g\eta \)-partially relaxed strongly monotone, if there exists a constant \(\alpha > 0 \) such that
$$\begin{aligned} \langle Tu-Tv, \eta (g(z),g(v)) \rangle \geq \mu \|g(z)-g(u)\|^{2}. \end{aligned}$$
For \(\eta (g(v),g(u)) = g(v)-g(u) \), definition 17 reduces to the definition of general monotonicity, general Lipschitz continuity, general co-coercivity and partially relaxed general strongly monotonicity of the operator \(T\). We note that for \(g(z)=g(u) \), partially strongly monotonicity reduces to monotonicity. One can easily show that general \(g\eta \)-cocoercivity implies general \(g\eta \)-partially relaxed general strongly monotonicity, but the converse is not true.
Definition 18
A function \(F \) is said to be a strongly general preinvex function on \(K_{g\eta } \) with respect to the function \(\eta (.,.)\) with modulus \(\mu > 0\) and function \(g \), if
\(\forall u,v \in H: g(u), g(v) \in K_{g\eta } , t \in [0,1] \), such that
We note that the differentiable strongly general preinvex function \(F \) implies the strongly general invex function, that is,
but the converse is also true under some conditions.
Assumption 1
\(\forall u,v,z \in H\), the operator \(\eta :H\times H \longrightarrow H \) and the function \(g \) satisfy the condition
In particular, from Assumption 1, we obtain
and
Assumption 1 has been used to study the existence of a solution of general variational-like inequalities.
Theorem 11
Let \(T\) be a general \(\eta \)-pseudomonotone operator. Let \(E\) be a strongly differentiable general preinvex function with modulus \(\beta \) and Assumption 1satisfied. Then the approximate solution \(u_{n+1}\) obtained from Algorithm 33converges to a solution of (96).
Proof
Since the function \(E\) is strongly general preinvex, so the solution \(u_{n+1}\) is unique. Let \(u \in H: g(u) \in K_{\eta } \) be a solution of the general variational-like inequality (96). Then
which implies that
since \(T\) is a general \(\eta \)-pseudomonotone. Taking \(v = u_{n+1} \) in (99), we have
We consider the Bregman function
using strongly general preinvexity.
Now
Using Assumption 1, we have
Combining (100), (101), (102) and (103), we have
If \(g(u_{n+1}) = g(u_{n}) \), then clearly \(g(u_{n})\) is a solution of the general variational-like inequality (96). Otherwise, it follows that \(B(u,u_{n})-B(u,u_{n+1}) \) is nonnegative, and we must have
Now using the technique of Zhu and Marcotte [201], one can easily show that the entire sequence \(\{u_{n}\}\) converges to the cluster point \(\bar{u}\) satisfying the variational-like inequality (96). □
To implement the proximal method, one has to calculate the solution implicitly, which is in itself a difficult problem. We again use the auxiliary principle technique to suggest another iterative method, the convergence of which requires only the \(g\eta \)-partially relaxed strongly general monotonicity.
For a given \(u \in H: g(u) \in K_{g\eta } \), satisfying (96), find a solution \(w \in H: g(w) \in K_{g\eta } \) such that
which is called the auxiliary general variational-like inequality, where \(E(u) \) is a differentiable strongly general preinvex function. It is clear that, if \(w = u \), then \(w\) is a solution of the general variational-like inequality (96). This fact allows us to suggest and analyze the following iterative method for solving (96).
Algorithm 35
For a given \(u_{0} \in H \), compute the approximate solution \(u_{n+1} \) by the iterative scheme
Note that for \(\eta (g(v),g(u) ) = g(v)-g(u) \), Algorithm 35 reduces to:
Algorithm 36
For a given \(u_{0} \in H_{g} \), find the approximate solution \(u_{n+1} \) by the iterative scheme
Algorithm 4 for solving general variational inequalities appears to be novel. In a similar way, one can obtain a number of new and known iterative methods for solving various classes of variational inequalities and complementarity problems.
We now study the convergence analysis of Algorithm 35. The analysis is in the spirit of Theorem 11. We only give the main points.
Theorem 12
Let \(T\) be a partially relaxed strongly general \(g\eta \)-monotone with a constant \(\alpha > 0 \). Let \(E\) be a differentiable strongly general preinvex function with modulus \(\beta \) and Assumption 1satisfied. If \(0 < \rho < \frac{\beta }{\alpha ,}\) then the approximate solution \(u_{n+1}\) obtained from Algorithm 35converges to a solution of (96).
Proof
Since the function \(E\) is strongly general preinvex, so the solution \(u_{n+1}\) of (96) is unique. Let \(u \in H: g(u) \in K_{g\eta }\) be a solution of the general variational-like inequality (96). Then
Taking \(v = u_{n+1} \) in the above inequality, we have
Combining (102), (105) and (106), we have
If \(g(u_{n+1}) = g(u_{n}) \), then clearly \(g(u_{n})\) is a solution of the general variational-like inequality (96). Otherwise, the assumption \(0 < \rho < \frac{\alpha }{\beta } \), implies that the sequence
is nonnegative, and we must have
Now by using the technique of Zhu and Marcotte [164], it can be shown that the entire sequence \(\{u_{n}\} \) converges to the cluster point \(\bar{u} \) satisfying the variational-like inequality (96). □
We now show that the solution of the auxiliary general variational-like inequality (104) is the minimum of the functional \(I[g(w)] \) on the general invex set \(K_{g\eta }\), where
is known as the auxiliary energy functional associated with the auxiliary general variational-like inequality (104), where \(B(g(w),g(u)) \) is a general Bregman function. We now prove that the minimum of the functional \(I[w] \), defined by (107), can be characterized by the general variational-like inequality (104).
Theorem 13
Let \(E \) be a differentiable general preinvex function. If Assumption 1holds and \(\eta (.,.)\) is prelinear in the first argument, then the minimum of \(I[w]\), defined by (107), can be characterized by the auxiliary general variational-like inequality (96).
Proof
Let \(w \in H: g(w) \in K_{\eta }\) be the minimum of \(I[w]\) on \(K_{g\eta } \). Then
Since \(K_{g\eta } \) is a general invex set, so for all
Replacing \(g(v) \) by \(g(v_{t}) \) in the above inequality, we have
Since \(\eta (.,.)\) is prelinear in the first argument, so, from (105) and (108), we have
which implies that
Now using Assumption 1, we have
From (108), (109), (110) and (111), we obtain
Dividing both sides by \(t\) and letting \(t \rightarrow 0\), we have
the required inequality (104).
Conversely, let \(u \in H: g(u) \in K_{\eta } \) be a solution of (104). Then
Thus it follows that \(I[g(w)] \leq I[g(v)]\), showing that \(g(v) \in K_{\eta } \) is the minimum of the functional \(I[g(w)]\) on \(K_{\eta } \), which is the required result. □
10 Higher Order Strongly General Convex Functions
We would like to point out that strongly convex functions were introduced and studied by Polyak [159]. Such functions play an important role in optimization theory and related areas. For example, Karmardian [57] used strongly convex functions to discuss the unique existence of a solution of nonlinear complementarity problems. Strongly convex functions also have played important role in convergence analysis of iterative methods for solving variational inequalities and equilibrium problems, cf. Zu and Marcotte [201]. Lin and Fukushima [65] introduced the concept of higher order strongly convex functions and used it in the study of mathematical programs with equilibrium constraints. These mathematical programs with equilibrium constraints are defined by a parametric variational inequality or complementarity system and play a crucial role in many fields such as engineering design, economic equilibrium and multilevel games. These facts and observations inspired Mohsen et al [75] to consider higher order strongly convex functions involving an arbitrary bifunction. Noor and Noor [139, 140] have introduced the higher order strongly general convex functions, which include the higher order strongly convex functions [65, 75] as a special cases.
In this chapter, we introduce concepts of higher order strongly general convex functions. Several new concepts of monotonicity are introduced. Our results represent a refinement and improvement of the results of Lin and Fukushima [65]. Higher order strongly general convex functions are used to obtain new characterizations of the uniformly reflex Banach spaces by the parallelogram laws. It is worth mentioning that the parallelogram laws have been discussed in [21,22,23,24, 190].
We now define the concept of higher order strongly general convex functions, which have been investigated in [139, 140].
Definition 19
A function \(F\) on the convex set \(K\) is said to be higher order strongly general convex with respect to the function \(g\), if there exists a constant \(\mu >0 \) such that
A function \(F\) is said to be higher order strongly general concave, if and only if, \(-F\) is higher order strongly general convex.
If \(t=\frac{1}{2} \), then
The function \(F\) is said to be a higher order strongly general \(J\)-convex function.
We now discuss some special cases.
I. If \(p=2\), then the higher order strongly convex function becomes a strongly convex function, that is,
For properties of strongly convex functions in variational inequalities and equilibrium problems, cf. Noor [95, 122, 129].
II. If \(g = I\), then Definition 19 reduces to:
Definition 20
A function \(F\) on the convex set \(K\) is said to be higher order strongly convex, if there exists a constant \(\mu >0 \), such that
which appears to be original.
For appropriate and suitable choice of the function \(g\) and \(p \), one can obtain various new and known classes of strongly convex functions. This shows that the higher order strongly convex function involving the function \(g \) is quite general and a unifying one. One can explore the applications of the higher order strongly general convex function, which constitutes another direction for further research.
Definition 21
A function \(F\) on the convex set \(K\) is said to be higher order strongly affine general convex with respect to the function \(g \), if there exists a constant \(\mu >0 \), such that
Note that if a function is both higher order strongly convex and higher order strongly concave, then it is a higher order strongly affine convex function.
Definition 22
A function \(F\) is called a higher order strongly quadratic equation with respect to the function \(g\), if there exists a constant \(\mu >0 \), such that
This function \(F\) is also called a higher order strongly affine general \(J\)-convex function.
Definition 23
A function \(F\) on the convex set \(K\) is said to be higher order strongly quasi convex, if there exists a constant \(\mu >0\) such that
Definition 24
A function \(F\) on the convex set \(K\) is said to be higher order strongly log-convex, if there exists a constant \(\mu >0\) such that
where \(F(\cdot )>0\).
From the above definitions, we have
This shows that every higher order strongly general log-convex function is a higher order strongly general convex function and every higher order strongly general convex function is a higher order strongly general quasi-convex function. However, the converse is not true.
For an appropriate and suitable choice of the arbitrary bifunction \(g \), one can obtain several new and known classes of strongly convex functions and their variant forms as special cases of generalized strongly convex functions. This shows that the class of higher order strongly general convex functions is quite broad and unifying.
Definition 25
An operator \(T:K\rightarrow H\) is said to be:
(i) higher order strongly monotone, if and only if, there exists a constant \(\alpha >0\) such that
(ii) higher order strongly pseudomonotone, if and only if, there exists a constant \(\nu > 0\) such that
(iii) higher order strongly relaxed pseudomonotone, if and only if, there exists a constant \(\mu > 0\) such that
Definition 26
A differentiable function \(F\) on the convex set \(K_{g}\) is said to be higher order strongly pseudoconvex function, if and only if there exists a constant \(\mu >0\) such that
We now consider some basic properties of higher order strongly general convex functions.
Theorem 14
Let \(F\) be a differentiable function on the convex set \(K_{g} \). Then the function \(F\) is a higher order strongly general convex function, if and only if
Proof
Let \(F\) be a higher order strongly general convex function on the convex set \(K_{g}\). Then
which can be written as
Taking the limit in the above inequality as \(t\rightarrow 0 \), we have
which is (112), the required result.
Conversely, let (112) hold true. Then, \(\forall g(u),g(v)\in K_{g}, t\in [0,1]\),
\(g(v_{t})=g(u)+t(g(v)-g(u))\in K_{g} \), we have
In a similar way, we have
Multiplying (113) by \(t\) and (114) by \((1-t)\) and adding the resultants, we have
showing that \(F\) is a higher order strongly general convex function. □
Theorem 15
Let \(F\) be a differentiable higher order strongly convex function on the convex set \(K_{g} \). Then
Proof
Let \(F\) be a higher order strongly general convex function on the convex set \(K_{g}\). Then, from Theorem 14, we have
Interchanging \(u\) and \(v\) in (116), we have
Adding (116) and (117), we have
which shows that \(F'(.)\) is a higher order strongly general monotone operator. □
We remark that the converse of Theorem 15 is not true. In this direction, we have the following result.
Theorem 16
If the differential operator \(F^{\prime }(.) \) of a differentiable higher order strongly general convex function \(F\) is a higher order strongly monotone operator, then
Proof
Let \(F'\) be a higher order strongly monotone operator. Then, from (118), we have
Since \(K\) is a convex set,
Setting \(g(v)= g(v_{t})\) in (120), we have
which implies that
Consider the auxiliary function
from which, we have
Then, from (122), we have
Integrating (123) between 0 and 1, we have
Thus it follows that
which is the required (119). □
We note that, if \(p=2 \), then Theorem 16 can be viewed as the converse of Theorem 15.
We now give a necessary condition for higher order strongly general pseudoconvex functions.
Theorem 17
Let \(F'(.)\) be a higher order strongly relaxed pseudomonotone operator. Then \(F\) is a higher order strongly pseudoconvex function.
Proof
Let \(F'(.)\) be a higher order strongly relaxed general pseudomonotone operator. Then, from (112), we have
which implies that
Since \(K_{g}\) is a convex set,
Setting \(g(v)=g( v_{t})\) in (124), we have
Consider the auxiliary function
which is differentiable, since \(F\) is a differentiable function. Then, using (126), we obtain that
Integrating the above relation between 0 to 1, we have
that is,
showing that \(F\) is a higher order strongly general pseudoconvex function. □
Definition 27
A function \(F\) is said to be sharply higher order strongly general pseudoconvex, if there exists a constant \(\mu >0\) such that
Theorem 18
Let \(F\) be a sharply higher order strongly general pseudoconvex function on the general convex set \(K_{g}\) with a constant \(\mu >0\). Then
Proof
Let \(F\) be a sharply higher order strongly general pseudoconvex function on the general convex set \(K_{g}\). Then
from which, we have
Taking the limit in the above inequality, as \(t \rightarrow 0\), we have
which is the required result. □
Definition 28
A function \(F\) is said to be a pseudoconvex function with respect to a strictly positive bifunction \(B(.,.)\), such that
Theorem 19
If the function \(F\) is a higher order strongly convex function such that
then the function \(F\) is higher order strongly pseudoconvex.
Proof
Since \(F(g(v))< F(g(u))\) and \(F\) is a higher order strongly convex function, then
\(\forall g(u),g(v)\in K_{g}, t\in [0,1] \), we have
where \(B(g(u), g(v)) = F(g(u)) - F(g(v)) > 0\), which is the required result. □
We now discuss the optimality for the differentiable strongly general convex functions, which is the main motivation of our next result.
Theorem 20
Let \(F \) be a differentiable higher order strongly general convex function with modulus \(\mu > 0 \). If \(u \in H: g(u)\in K_{g} \) is the minimum of the function \(F \), then
Proof
Let \(u \in H: g(u)\in K_{g} \) be a minimum of the function \(F \). Then
Since \(K \) is a general convex set, so, \(\forall g(u),g(v)\in K_{g}, t\in [0,1] \),
Setting \(g(v)= g(v_{t}) \) in (128), we have
Since \(F \) is a differentiable higher order strongly general convex function, it follows that
from which, using (129), we have
which is the required result (127). □
Remark
We would like to mention that, if \(u \in H: g(u) \in K_{g} \) satisfies the inequality
then \(u \in K_{g} \) is the minimum of the function \(F \). The inequality of the type (130) is called the higher order general variational inequality.
Theorem 21
Let \(f\) be a higher order strongly affine general convex function. Then \(F\) is a higher order strongly general convex function, if and only if, \(H= F-f \) is a general convex function.
Proof
Let \(f \) be a higher order strongly affine general convex function. Then
From the higher order strongly general convexity of \(F \), we have
from which it follows that
which show that \(H= F-f \) is a convex function. The inverse implication is obvious. □
It is worth mentioning that the higher order strongly convex function is also a higher order strongly Wright general convex function. From the definition, we have
which is called the higher order strongly Wright general convex function. One studies the properties and applications of the Wright higher order strongly convex functions in optimization and operations research.
Bynum [21] and Chen et al [22,23,24,25] have studied properties and applications of the parallelogram laws for Banach spaces. Xi [190] obtained new characteristics of \(p\)-uniform convexity and \(q\)-uniform smoothness of a Banach space via the functionals \(\|.\|^{p} \) and \(\|.\|^{q} \), respectively. These results can be obtained from the concepts of higher order strongly general convex (concave) functions, which can be viewed as novel applications. Setting \(F(u)= \|u\|^{p}\) in Definition 21, we have
Setting \(t=\frac{1}{2} \) in (134), we have
which implies that
which is known as the lower parallelogram for \(l^{p}\)-spaces. In a similar way, one can obtain the upper parallelogram law as
Similarly from Definition 23, we have
which is known as the parallelogram for \(l^{p}\)-spaces. For the applications of the parallelogram laws for Banach spaces in prediction theory and applied sciences, see [21,22,23,24] and the references therein.
In this section, we have introduced and studied a new class of convex functions, which is called the higher order strongly convex function. We have improved the results of Lin and Fukushima [65]. It is shown that several new classes of strongly convex functions can be obtained as special cases of these higher order strongly general convex functions. We have studied the basic properties of these functions. We have also shown that one can derive the parallelogram laws in Banach spaces, which are applied to prediction theory and stochastic analysis. These parallelogram laws can be used to characterize the \(p\)-uniform convexity and \(q\)-uniform smoothness of Banach spaces. The interested reader may explore the applications and other properties for the higher order strongly convex functions in various fields of pure and applied sciences. This is an interesting direction for future research.
11 Higher Order General Variational Inequalities
In this section, we consider a more general variational inequality of which (130) is a special case.
For given two operators \(T,g \), we consider the problem of finding \(u\in K \) for a constant \(\mu > 0 \), such that
which is called the higher order general variational inequality, see [140].
We note that, if \(\mu =0\), then (139) is equivalent to finding \(u \in K \), such that
which is known as the general variational inequality (9), which was introduced and studied by Noor [87] in 2008.
For suitable and appropriate choice of the parameters \(\mu \) and \(p\), one can obtain several new and known classes of variational inequalities (cf. [87, 88, 90, 110, 122, 123]) and the references therein. We note that the projection method and its variant forms can be used to study the higher order strongly general variational inequalities (139) due to its inherent structure. These facts motivated us to consider the auxiliary principle technique, which is mainly due to Glowinski et al [47] and Lions and Stampacchia [66], as developed by Noor [122]. We use this technique to suggest some iterative methods for solving the higher order general variational inequalities (139).
For given \(u\in K \) satisfying (139), consider the problem of finding \(w\in K \), such that
where \(\rho > 0 \) is a parameter. The problem (141) is called the auxiliary higher order strongly general variational inequality. It is clear that the relation (141) defines a mapping connecting the problems (139) and (141). We note that, if \(w= u \), then \(w\) constitutes a solution of the problem (139). This simple observation enables us to suggest an iterative method for solving (139).
Algorithm 37
. For given \(u\in K\), find the approximate solution \(u_{n+1} \) by the scheme
The Algorithm 37 is known as an implicit method. Such type of methods have been studied extensively for various classes of variational inequalities. See [11, 18, 19] and the reference therein. If \(\nu =0 \), then Algorithm 37 reduces to:
Algorithm 38
For given \(u_{0}\in K \), find the approximate solution \(u_{n+1} \) by the scheme
which appears to be novel even for solving the general variational inequalities (9).
To study the convergence analysis of Algorithm 37, we need the following concept.
Definition 29
The operator \(T\) is said to be pseudo \(g\)-monotone with respect to
if
If \(\mu =0 \), then Definition 29 reduces to:
Definition 30
The operator \(T\) is said to be pseudo \(g\)-monotone, if
which appears to be new.
We now study the convergence analysis of Algorithm 37.
Theorem 22
Let \(u\in K\) be a solution of (139) and \(u_{n+1} \) be the approximate solution obtained from Algorithm 37. If \(T\) is a pseudo \(g\)-monotone operator, then
Proof
Let \(u \in K \) be a solution of (139), then
implies that
Now taking \(v = u_{n+1} \) in (144), we have
Taking \(v = u\) in (139), we have
Combining (145) and (146), we have
Using the inequality
we obtain
which is the required result (143). □
Theorem 23
Let the operator \(T\) be pseudo \(g\)-monotone. If \(u_{n+1}\) is the approximate solution obtained from Algorithm 37and \(u \in K \) is the exact solution (139), then \(\lim _{n\rightarrow \infty }u_{n}=u \).
Proof
Let \(u\in K \) be a solution of (139). Then, from (143), it follows that the sequence \(\{\|u - u_{n}\|\}\) is nonincreasing and consequently \(\{u_{n}\}\) is bounded. From (143), we have
from which, it follows that
Let \(\hat{u} \) be a cluster point of \(\{u_{n}\}\) and the subsequence \(\{u_{n_{j}}\} \) of the sequence \(u_{n}\) converge to \(\hat{u} \in H\). Replacing \(u_{n}\) by \(u_{n_{j}}\) in (138), taking the limit \(n_{j} \rightarrow 0 \) and from (147), we have
This implies that \(\hat{u} \in K \) and
Thus it follows from the above inequality that the sequence \(u_{n}\) has exactly one cluster point \(\hat{u} \) and
□
In order to implement the implicit Algorithm 37, one uses the predictor-corrector technique. Consequently, Algorithm 37 is equivalent to the following iterative method for solving the higher order strongly general variational inequality (139).
Algorithm 39
For a given \(u_{0} \in K \), find the approximate solution \(u_{n+1} \) by the schemes
Algorithm 39 is called the two-step iterative method and appears to be new.
Using the auxiliary principle technique, on can suggest several iterative methods for solving higher order strongly general variational inequalities and related optimization problems. We have only given a glimpse of higher order strongly general variational inequalities. It is an interesting problem to explore the applications of such a type of variational inequalities in various fields of pure and applied sciences.
12 Strongly Exponentially General Convex Functions
Convexity theory describes a broad spectrum of very interesting developments establishing a link among various fields of mathematics, physics, economics and engineering sciences. The development of convexity theory can be viewed as the simultaneous pursuit of two different lines of research. On the one hand, it is related to integral inequalities. It has been shown that a function is a convex function, if and only if, it satisfies the Hermite-Hadamard type inequality. These inequalities help us to derive the upper and lower bounds of the integrals. On the other hand, the minimum of differentiable convex functions on the convex set can be characterized by variational inequalities, the origin of which can be traced back to the Bernoulli brothers, as well as Euler and Lagrange. Variational inequalities provide us a powerful tool to discuss the behavior of solutions (regarding existence, uniqueness and regularity) to important classes of problems. The theory of variational inequalities also enables us to develop highly efficient powerful new numerical methods to solve nonlinear problems. Recently various extensions and generalizations of convex functions and convex sets have been considered and studied using innovative ideas and techniques. It is known that more accurate inequalities can be obtained using logarithmically convex functions rather than convex functions. Closely related to log-convex functions, the concept of exponentially convex (concave) functions has important applications in information theory, big data analysis, machine learning and statistics. Exponentially convex functions have illustrated significant generalizations of convex functions, the origin of which can be traced back to Bernstein [16]. Avriel [9, 10] introduced the concept of \(r\)-convex functions, from which one can deduce exponentially convex functions. Antczak [2] considered the \((r, p)\) convex functions and discussed their applications in mathematical programming and optimization theory. It is worth mentioning that exponentially convex functions have important applications in information sciences, data mining and statistics, cf. [1, 2, 9, 10, 132,133,134,135,136,137,138, 154] and the references therein.
We would like to point out that general convex functions and exponentially general convex functions are two distinct generalizations of convex functions, which have played a crucial and significant role in the development of various branches of pure and applied sciences. It is natural to unify these concepts. Motivated by these facts and observations, we now introduce a new class of convex functions, which is called exponentially general convex functions involving an arbitrary function. We discuss the basic properties of exponentially general convex functions. It has been shown that exponentially general convex (concave) functions have nice properties which convex functions enjoy. Several new concepts have been introduced and investigated. We prove that the local minimum of exponentially general convex functions is also the global minimum.
Noor and Noor [132,133,134,135,136,137,138, 154] studied some classes of strongly exponentially convex functions. Inspired by the work of Noor and Noor [138], we introduce some new classes of higher order strongly exponentially convex functions. We establish the relationship between these classes and derive some new results. We have also investigated the optimality conditions for the higher order strongly exponentially convex functions. It is shown that the difference of strongly exponentially convex functions and strongly exponentially affine functions is again an exponentially convex function. The optimal conditions of the differentiable exponentially convex functions can be characterized by a class of variational inequalities, called the exponentially general variational inequality, which is itself an interesting problem.
We now define exponentially convex functions, which are mainly due to Noor and Noor [132,133,134,135,136,137,138, 154].
Definition 31
[132,133,134, 138] A function \(F\) is said to be exponentially convex function, if
It is worth mentioning that Avriel [9, 10] and Antczak [2] introduced the following concept:
Definition 32
[3, 4] A function \(F\) is said to be exponentially convex, if
Avriel [9, 10] and Antczak [2] discussed the application of 1-convex functions in mathematical programming. We note that the Definitions 7 and 8 are equivalent. A function \(f\) is called exponentially concave, if \(-f\) is an exponentially convex function.
For applications in communication theory and information theory, cf. Alirezaei and Mathar [1].
Example 5
[1] The error function
becomes an exponentially concave function in the form \(erf(\sqrt{x}), x \geq 0 \), which describes the bit/symbol error probability of communication systems depending on the square root of the underlying signal-to-noise ratio. This shows that exponentially concave functions can play an important role in communication theory and information theory.
For properties, generalizations and applications of the various classes of exponentially convex functions, cf. [1, 2, 9, 10, 132,133,134,135,136,137,138, 154]
It is clear that exponentially convex functions and general convex functions are two distinct generalizations of convex functions. It is natural to unify these concepts. Motivated by this fact, Noor and Noor [138] introduced some new concepts of exponentially general convex functions. We include these results for the sake of completeness and for the convenience of the interested readers.
Definition 33
A function \(F\) is said to be exponentially strongly general convex with respect to an arbitrary non-negative function \(g \), if
Or equivalently
Definition 34
A function \(F\) is said to be exponentially general convex function with respect to an arbitrary non-negative function \(g \), if,
A function \(f\) is called exponentially general concave, if \(-f\) is an exponentially general convex function.
Definition 35
A function \(F\) is said to be exponentially affine general convex with respect to an arbitrary non-negative function \(g \), if
If \(g= I \), the identity operator, then exponentially general convex functions reduce to exponentially convex functions.
Definition 36
The function \(F\) on the general convex set \(K_{g}\) is said to be exponentially general quasi-convex, if
Definition 37
The function \(F\) on the general convex set \(K_{g}\) is said to be exponentially general log-convex, if
where \(F(\cdot )>0\).
From the above definitions, we have
This shows that every exponentially general log-convex function is an exponentially general convex function and every exponentially general convex function is an exponentially general quasi-convex function. However, the converse is not true.
Let \(K_{g} =I_{g}=[g(a),g(b)]\) be the interval. We now define the exponentially general convex functions on \(I_{g}\).
Definition 38
Let \(I_{g} =[g(a),g(b)]\). Then \(F\) is exponentially general convex, if and only if,
One can easily show that the following are equivalent:
-
1.
\(F\) is exponentially general convex function.
-
2.
\(e^{F(g(x))}\leq e^{F(g(a))}+ \frac{e^{F(g(b))}-e^{F(g(a))}}{g(b)-g(a)}(g(x)-g(a))\).
-
3.
\(\frac{e^{F(g(x))}-e^{F(g(a)}}{g(x)-g(a)}\leq \frac{e^{F(g(b))}-e^{F(g(a))}}{g(b)-g(a)}\).
-
4.
\((g(x)-g(b))e^{F(g(a))} +(g(b)-g(a))e^{F(g(x))}+(g(a)-g(x))e^{F(g(b))}) \geq 0\).
-
5.
\(\frac{e^{F(g(a))}}{(g(b)-g(a))(g(a)-g(x))}+ \frac{e^{F(g(x))}}{(g(x)-g(b))(g(a)-g(x))}+ \frac{e^{F(g(b)}}{(g(b)-g(a))(g(x)-g(b))}\geq 0\),
where \(g(x)= (1-t)g(a)+tg(b) \in [g(a),g(b)]\).
Theorem 24
Let \(F\) be a strictly exponentially general convex function. Then, any local minimum of \(F \) is a global minimum.
Proof
Let the strictly exponentially convex function \(F\) have a local minimum at \(g(u) \in K_{g} \). Assume the contrary, that is, \(F(g(v))< F(g(u)) \) for some \(g(v) \in K_{g}\). Since \(F\) is a strictly exponentially general convex function, it follows that
Thus
from which it follows that
for arbitrarily small \(t > 0 \), contradicting the local minimum. □
Theorem 25
If the function \(F \) on the general convex set \(K_{g} \) is exponentially general convex, then the level set
is a general convex set.
Proof
Let \(g(u), g(v) \in L_{\alpha } \). Then \(e^{F(g(u))} \leq \alpha \) and \(e^{F(g(v))} \leq \alpha \).
We have that
since \(K_{g}\) is a general convex set. Thus, by the exponentially general convexity of \(F\), we obtain that
from which it follows that \(g(v) + t(g(u)-g(v)) \in L_{\alpha } \) Hence \(L_{\alpha } \) is a general convex set. □
Theorem 26
The function \(F\) is an exponentially general convex function, if and only if,
is a general convex set.
Proof
Assume that \(F\) is an exponentially general convex function. Let
Then it follows that \(e^{F(g(u))} \leq \alpha \) and \(e^{F(g(v))} \leq \beta \). Hence, we have
which implies that
Thus \(epi(F)\) is a general convex set.
Conversely, let \(epi(F)\) be a general convex set. Let \(g(u), g(v) \in K_{g} \). Then
Since \(epi(F) \) is a general convex set, we must have
which implies that
This shows that F is an exponentially general convex function. □
Theorem 27
The function \(F\) is exponentially general quasi-convex, if and only if, the level set
is a general convex set.
Proof
Let \(g(u), g(v) \in L_{\alpha } \). Then \(g(u), g(v) \in K_{g} \) and \(\max (e^{F(g(u))}, e^{F(g(v))}) \leq \alpha \).
Now for
We have to prove that \(g(u) + t(g(v)-g(u)) \in L_{\alpha } \). By the exponentially general convexity of \(F\), we have
which implies that \(g(u) + t(g(v)-g(u)) \in L_{\alpha } \), showing that the level set \(L_{\alpha } \) is indeed a general convex set.
Conversely, assume that \(L_{\alpha } \) is a general convex set. Then,
Let \(g(u), g(v) \in L_{\alpha } \) for
Then, from the definition of the level set \(L_{\alpha } \), it follows that
Thus \(F \) is an exponentially general quasi convex function. This completes the proof. □
Theorem 28
Let \(F\) be an exponentially general convex function. Let \(\mu =\inf _{u\in K}F(u)\). Then the set
is a general convex set of \(K_{g}\). If \(F \) is strictly exponentially general convex function, then \(E \) is a singleton.
Proof
Let \(g(u), g(v) \in E\). For \(0 < t < 1\), let \(g(w) = g(u) + t(g(v)-g(u))\). Since \(F\) is an exponentially general convex function, then
which implies \(g(w) \in E \), and hence \(E\) is a general convex set. For the second part, assume to the contrary that \(F(g(u)) = F(g(v)) = \mu \). Since \(K\) is a general convex set, then for \(0 < t < 1\),
Since \(F\) is strictly exponentially general convex, we have
This contradicts the fact that \(\mu = \inf _{g(u)\in K_{g} }F(u) \) and hence the result follows. □
We now introduce the concept of strongly exponentially general convex functions, which is the main motivation of this chapter.
Definition 39
A positive function \(F\) on the general convex set \(K_{g}\) is said to be strongly exponentially general convex with respect to an arbitrary non-negative function \(g \), if there exists a constant \(\mu >0 \), such that
The function \(F\) is said to be strongly exponentially general concave with respect to an arbitrary non-negative function \(g \), if and only if, \(-F\) is a strongly exponentially general convex function with respect to an arbitrary non-negative function \(g \).
If \(t=\frac{1}{2} \) and \(\mu =1 \), then
The function \(F\) is called strongly exponentially general \(J\)-convex with respect to an arbitrary non-negative function \(g \).
Definition 40
A positive function is said to be strongly exponentially affine general convex with respect to an arbitrary non-negative function \(g \), if there exists a constant \(\mu >0 \), such that
If \(t= \frac{1}{2} \), then
We then say that the function \(F\) is strongly exponentially affine general \(J\)-convex with respect to an arbitrary non-negative function \(g \).
For properties of strongly exponentially general convex functions in optimization, inequalities and equilibrium problems, cf. [4,5,6,7,8, 10,11,12,13,14,15,16,17,18,19,20,21] and the references therein.
Definition 41
A positive function \(F\) on the convex set \(K_{g}\) is said to be strongly exponentially general quasi-convex, if there exists a constant \(\mu >0\) such that
Definition 42
A positive function \(F\) on the general convex set \(K_{g}\) is said to be strongly exponentially general log-convex, if there exists a constant \(\mu >0\) such that
where \(F(\cdot )>0\).
From this Definition, we have
This shows that every strongly exponentially general log-convex function is a strongly exponentially general convex function, but the converse is not true.
From the above concepts, we have
This shows that every strongly exponentially general log-convex function is a strongly exponentially convex function and every strongly exponentially general convex function is a strongly exponentially general quasi-convex function. However, the converse is not true.
Definition 43
A differentiable function \(F\) on the convex set \(K_{g}\) is said to be a strongly exponentially general pseudoconvex function with respect to an arbitrary non-negative function \(g \), if and only if there exists a constant \(\mu >0\) such that
Theorem 29
Let \(F\) be a differentiable function on the convex set \(K\). Then the function \(F\) is strongly exponentially general convex function, if and only if,
Proof
Let \(F\) be a strongly exponentially general convex function. Then
which can be written as
Taking the limit in the above inequality as \(t\rightarrow 0\), we have
which is (148), the required result.
Conversely, let (148) hold. Then
we have
In a similar way, we have
Multiplying (148) by \(t\) and (150) by \((1-t)\) and adding the resultant, we have
showing that \(F\) is a strongly exponentially general convex function. □
Theorem 30
Let \(F\) be a differentiable strongly exponentially general convex function on the convex set \(K_{g} \). Then
Proof
Let \(F\) be a strongly exponentially general convex function. Then, from Theorem 29, we have
Interchanging \(u\) and \(v\) in (152), we have
Adding (153) and (152), we have
which is the required (151). □
We point out that the converse of Theorem 30 is not true expect for \(p=2\). In fact, we have the following result.
Theorem 31
If the differential of a strongly exponentially general convex function satisfies
then
Proof
Let \(F'(.)\) satisfy (154). Then
Since \(K_{g}\) is a general convex set,
Setting \(g(v)= g(v_{t})\) in (156), we have
which implies that
Consider the auxiliary function
from which, we have
Then, from (157) and (158), we have
Integrating (159) between 0 and 1, we have
Thus it follows that
which is the required (155). □
Theorem 29 and Theorem 30 enable us to introduce the following new concepts.
Definition 44
The differential \(F^{\prime }(.) \) of a strongly exponentially convex function is said to be strongly exponentially monotone, if there exists a constant \(\mu >0 \), such that
Definition 45
The differential \(F^{\prime }(.) \) of an exponentially convex function is said to be exponentially monotone, if
Definition 46
The differential \(F^{\prime }(.) \) of a strongly exponentially convex function is said to be strongly exponentially pseudomonotone, if
implies that
We now give a necessary condition for strongly exponentially pseudoconvex functions.
Theorem 32
Let \(F'\) be a strongly exponentially pseudomonotone operator. Then \(F\) is a strongly exponentially general pseudoinvex function.
Proof
Let \(F'\) be a strongly exponentially pseudomonotone operator. Then
implies that
Since \(K_{g}\) is a general convex set,
Setting \(g(v)=g( v_{t})\) in (160), we have
Consider the auxiliary function
which is differentiable, since \(F\) is a differentiable function. Thus, we have
Integrating the above relation between 0 to 1, we have
that is,
showing that \(F\) is a strongly exponentially general pseudoconvex function. □
Definition 47
The function \(F\) is said to be sharply strongly exponentially pseudoconvex, if there exists a constant \(\mu >0 \), such that
Theorem 33
Let \(F\) be a sharply strongly exponentially pseudoconvex function with a constant \(\mu >0\). Then
Proof
Let \(F\) be a sharply strongly exponentially general pseudoconvex function. Then
from which we have
Taking limit in the above inequality, as \(t \rightarrow 0\), we have
the required result. □
We now discuss the optimality condition for differentiable strongly exponentially convex functions.
Theorem 34
Let \(F \) be a differentiable strongly exponentially convex function. If \(u \in K \) is the minimum of the function \(F \), then
Proof
Let \(u \in H: g(u)\in K_{g} \) be a minimum of the function \(F \). Then
from which, we have
Since \(K _{g} \) is a convex set, so, \(\forall g(u),g(v) \in K_{g}, t\in [0,1] \),
Setting \(g(v) = g(v_{t}) \) in (163), we have
Since \(F \) is a differentiable strongly exponentially general convex function, it follows that
from which, using (164), we have
which is the required result (163). □
Remark 5
We would like to mention that, if \(u \in H: g(u)\in K_{g} \) satisfies
then \(u \in H: g(u)\in K_{g} \) is the minimum of the function \(F \). The inequality of the type (165) is called the strongly exponentially variational inequality. It is an interesting problem to study the existence of the inequality (165) and to develop numerical methods for solving strongly exponentially variational inequalities.
We would like to note that strongly exponentially convex functions are also strongly Wright general convex functions. From the definition 39, we have
which is known as the strongly Wright exponentially convex function. It is an interesting problem to study properties and applications of strongly Wright exponentially general convex functions.
13 Generalizations and Extensions
We would like to mention that some of the results obtained and presented in this paper can be extended for stronger general variational inequalities. To be more precise, for a given nonlinear operator \(T,A,g \), consider the problem of finding \(u\in H: g(u) \in K \) such that
which is called the strongly general variational inequality.
If \(\mu = 0 \), then problem (166) reduces to
which is called the general strongly variational inequality.
We would like to mention that one can obtain various classes of general variational inequalities for appropriate and suitable choices of the operators \(T, A, g \).
Using Lemma 1, one can show that the problem (167) is equivalent to finding \(u\in H: g(u) \in K \) such that
These alternative formulations can be used to suggest and analyze similar techniques for solving general strongly variational inequalities (167) as considered in this paper under certain extra conditions. A complete study of these algorithms for problem (167) will be the subject of subsequent research. The development of efficient and implementable algorithms for problems (167) requires further research efforts.
(I). For given nonlinear operators \(T,A,g \), consider the problem of finding \(u\in H: g(u) \in K \) such that
which is also called the strongly general variational inequality.
(III). For given nonlinear operators \(T,A,g \), consider the problem of finding \(u\in H: g(u) \in K \) such that
which is also known as the strongly general variational inequality.
Remark 6
We would like to point out that the problems (167), (169) and (170) are quite different from each other and have significant applications in various branches of pure and applied sciences. They are open and interesting problems for future research. We would like to emphasize that the problems (167), (169) and (170) are equivalent in various ways and share basic and fundamental properties. In particular, they have the same equivalent fixed-point formulations. Consequently, most of the results obtained in this paper continue to hold for these problems with minor modifications.
(IV). If \(K= H \), then the problem (166) is equivalent to finding \(u \in H: g(u) \in H \), such that
which can be viewed as the representation theorem for nonlinear functions involving an arbitrary function \(g\). For more details, see Noor and Noor [141].
(V). If \(A(u)= |u| \), then the problem (171) is equivalent to finding \(u \in H: g(u) \in H \), such that
which is known as the generalized absolute value equation. See Batool et al [13] for more details.
The theory of general variational inequalities does not appear to have developed to an extent that it provides a complete framework for studying these problems. Much more research is needed in all of these areas for the development of a sound basis for applications. We have not treated variational inequalities for time-dependent problems and spectrum analysis of variational inequalities. In fact, this field has been forstering and will continue to foster new, innovative and novel applications in various branches of pure and applied sciences. We have given only a brief introduction of this rapidly evolving field. The interested reader is advised to explore this field further. It is our hope that this brief introduction may inspire and motivate the reader to discover new and interesting applications of general variational inequalities as well as related optimization problems in other areas of sciences.
References
Alirezaei, G., Mazhar, R.: On exponentially concave functions and their impact in information theory. J. Inform. Theory Appl. 9(5), 265–274 (2018)
Antczak, T.: On \((p,r)\)-invex sets and functions. J. Math. Anal. Appl. 263, 355–379 (2001)
Al-Said, A.E.: A family of numerical methods for solving third-order boundary value problems. Int. J. Math. 1, 367–375 (2002)
Al-Said, E.A., Noor, M.A., Khalifa, A.K.: Finite difference schemes for variational inequalities. J. Optim. Theory Appl. 89, 453–459 (1996)
Al-Said, E.A., Noor, M.A., Rassias, T.M.: Numerical solutions of third-order obstacle problems. Int. J. Comput. Math. 69, 75–84 (1998)
Alvarez, F.: On the minimization property of a second order dissipative system in Hilbert space. SIAM J. Control Optim. 38, 1102–1119 (2000)
Alvarez, F., Attouch, H.: An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping. Set-Valued Anal. 9, 3–11 (2001)
Attouch, H., Alvarez, F.: The heavy ball with friction dynamical system for convex constrained minimization problems. Lect. Notes Econ. Math. Syst. 481, 25–35 (2000)
Avriel, M.: r-Convex functions. Math. Program. 2, 309–323 (1972)
Avriel, M.: Solution of certain nonlinear programs involving r-convex functions. J. Optim. Theory Appl. 11(20), 159 (1973)
Awan, M.U., Noor, M.A., Mishra, V.N., Noor, K.I.: Some characterizations of general preinvex functions, I. J. Anal. Appl. 15(1), 46–56 (2017)
Baiocchi, C., Capelo, A.: Variational and Quasi-Variational Inequalities. Wiley, New York (1984)
Batool, S., Noor, M.A., Noor, K.I.: Absolute value variational inequalities and dynamical systems. Int. J. Math. Anal. 18(3), 337–355 (2020)
Ben-Isreal, A., Mond, B.: What is invexity? J. Aust. Math. Soc. Ser. B 28(1), 1–9 (1986)
Bensoussan, A., Lions, L.: Applications des inequations variationelles en controle stochastique. Dunod, Paris (1978)
Bernstein, S.N.: Sur les fonctions absolument monotones. Acta Math. 52, 1–66 (1929)
Bertsekas, D.P., Tsitsiklis, J.: Parallel and Distributed Computation: Numerical Methods. Prentice-Hall, Englewood Cliffs (1989)
Bloach, M.I., Noor, M.A.: Perturbed mixed variational-like inequalities. AIMS Math. 5(3), 2153–2162 (2019)
Blum, E., Oettli, W.: From optimization adn variational inequalities to equilibrium problems. Math. Stud. 63, 123–145 (1994)
Burke, J.V., More, J.J.: On the identification of active constraints. SIAM J. Numer. Anal. 25, 1197–1211 (1988)
Bynum, W.L.: Weak parallelogram laws for Banach spaces. Can. Math. Bull. 19, 269–275 (1976)
Chan, P., Pang, J.S.: The generalized quasi-variational inequality problem. Math. Oper. Res. 7, 211–222 (1982)
Cheng, R., Harris, C.B.: Duality of the weak parallelogram laws on Banach spaces. J. Math. Anal. Appl. 404, 64–70 (2013)
Cheng, R., Ross, W.T.: Weak parallelogram laws on Banach spaces and applications to prediction. Period. Math. Hung. 71, 45–58 (2015)
Cheng, R., Mashreghi, J., Ross, W.T.: Optimal weak parallelogram constants for \(L_{p}\) space. Math. Inequal. Appl. 21(4), 1047–1058 (2018)
Clarke, F.H., Ledyaev, Y.S., Wolenski, P.R.: Nonsmooth Analysis and Control Theory. Springer, Berlin (1998)
Cottle, R.W., Pang, J.S., Stone, R.E.: The Linear Complementarity Problem. Academic Press, New York (1992)
Crank, J.: Free and Moving Boundary Problems. Clarendon Press, Oxford (1984)
Cristescu, G., Lupsa, L.: Non-connected Convexities and Applications. Kluwer Academic, Dordrecht (2002)
Dafermos, S.: Sensitivity analysis in variational inequalities. Math. Oper. Res. 13, 421–434 (1988)
Demyanov, V.F., Stavroulakis, G.E., Polyakova, L.N., Panagiotoulos, P.D.: Quasidifferentiability and Nonsmooth Modeling in Mechanics, Engineering and Economics. Kluwer Academic, Boston (1996)
Dietrich, H.: Optimal control problems for certain quasi variational inequalities. Optimization 49, 67–93 (2001)
Dietrich, H.: Optimal control problems for general variational inequalities. Preprint (2003)
Dong, J., Zhang, D., Nagurney, A.: A projected dynamical systems model of general financial equilibrium with stability analysis. Math. Comput. Model. 24(2), 35–44 (1996)
Dupuis, P., Nagurney, A.: Dynamical systems and variational inequalities. Ann. Oper. Res. 44, 19–42 (1993)
Duvaut, G., Lions, J.L.: Inequalities in Mechanics and Physics. Springer, Berlin (1976)
Ekland, I., Temam, R.: Convex Analysis and Variational Problems. North-Holland, Amsterdam (1976)
Fichera, G.: Problemi elastostatici con vincoli unilaterali: il problema di Signorini con ambique condizione al contorno. Atti. Acad. Naz. Lincei. Mem. Cl. Sci. Nat. Sez. Ia 7(8), 91–140 (1963–1964)
Filippov, V.M.: Variational Principles for Nonpotential Operators, vol. 77. Am. Math. Soc., Providence (1989)
Friesz, T.L., Bernstein, D.H., Mehta, N.J., Ganjliazadeh, S.: Day-to-day dynamic network disequilibria and idealized traveler information systems. Oper. Res. 42, 1120–1136 (1994)
Friesz, T.L., Bernstein, D.H., Stough, R.: Dynamic systems, variational inequalities and control theoretic models for predicting time-varying urban network flows. Transp. Sci. 30, 14–31 (1996)
Fukushima, M.: Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems. Math. Program. 53, 99–110 (1992)
Fulga, C., Preda, V.: Nonlinear programming with \(\varphi \)-preinvex and local \(\varphi \)-preinvex functions. Eur. J. Oper. Res. 192, 737–743 (2009)
Giannessi, F., Maugeri, A.: Variational Inequalities and Network Equilibrium Problems. Plenum Press, New York (1995)
Giannessi, F., Maugeri, A., Pardalos, P.M.: Equilibrium Problems: Nonsmooth Optimization and Variational Inequality Models. Kluwer Academic, Dordrecht (2001)
Glowinski, G.: Numerical Methods for Nonlinear Variational Problems. Springer, Berlin (1984)
Glowinski, R., Lions, J.J., Tremolieres, R.: Numerical Analysis of Variational Inequalities. North-Holland, Amsterdam (1981)
Goeleven, D., Mantague, D.: Well-posed hemivariational inequalities. Numer. Funct. Anal. Optim. 16, 909–921 (1995)
Han, D., Lo, H.K.: Two new self-adaptive projection methods for variational inequality problems. Comput. Math. Appl. 43, 1529–1537 (2002)
Hanson, M.A.: On sufficiency of the Kuhn-Tucker conditions. J. Math. Anal. Appl. 80, 545–550 (1980)
Harker, P.T., Pang, J.S.: Finite dimensional variational inequalities and nonlinear complementarity problems: a survey of theory, algorithms and applications. Math. Program. 48, 161–220 (1990)
Haubruge, S., Nguyen, V.H., Strodiot, J.J.: Convergence analysis and applications of the Glowinski-Le Tallec splitting method for finding a zero of the sum of two maximal monotone operators. J. Optim. Theory Appl. 97, 645–673 (1998)
He, B.S.: A class of projection and contraction methods for variational inequalities. Appl. Math. Optim. 35, 69–76 (1997)
He, B.S.: Inexact implicit methods for monotone general variational inequalities. Math. Program. 86, 199–217 (1999)
He, B.S., Liao, L.Z.: Improvement of some projection methods for monotone nonlinear variational inequalities. J. Optim. Theory Appl. 112, 111–128 (2002)
Jabeen, S., Noor, M.A., Noor, K.I.: Inertial iterative methods for general quasi variational inequalities and dynamical systems. J. Math. Anal. 11(3), 14–29 (2020)
Karamardian, S.: Generalized complementarity problems. J. Optim. Theory Appl. 8, 161–168 (1971)
Kikuchi, N., Oden, J.T.: Contact Problems in Elasticity. SIAM, Philadelphia (1988)
Kinderlehrer, D., Stampacchia, G.: An Introduction to Variational Inequalities and Their Applications. SIAM, Philadelphia (2000)
Korpelevich, G.M.: The extragradient method for finding saddle points and other problems. Matecon 12, 747–756 (1976)
Larsson, T., Patriksson, M.: A class of gap functions for variational inequalities. Math. Program. 64, 53–79 (1994)
Lemke, C.E.: Bimatrix equilibrium points and mathematical programming. Manag. Sci. 11, 681–689 (1965)
Lemke, C.E., Howson, J.T. Jr.: Equilibrium points of bimatrix games. J. Soc. Ind. Appl. Math. 12, 413–423 (1964)
Lewy, H., Stampacchia, G.: On the regularity of the solutions of the variational inequalities. Commun. Pure Appl. Math. 22, 153–188 (1969)
Lin, G.H., Fukushima, M.: Some exact penalty results for nonlinear programs and mathematical programs with equilibrium constraints. J. Optim. Theory Appl. 118(1), 67–80 (2003)
Lions, J.L., Stampacchia, G.: Variational inequalities. Commun. Pure Appl. Math. 20, 493–512 (1967)
Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two monotone operators. SIAM J. Numer. Anal. 16, 964–979 (1979)
Liu, J.: Sensitivity analysis in nonlinear programs and variational inequalities via continuous selection. SIAM J. Control Optim. 33, 1040–1068 (1995)
Luc, D.T., Noor, M.A.: Local uniqueness of solutions of general variational inequalities. J. Optim. Theory Appl. 117, 103–119 (2003)
Lucchetti, R., Patrone, F.: A characterization of Tykhonov well-posedness for minimum problems with applications to variational inequalities. Numer. Funct. Anal. Optim. 3, 461–476 (1981)
Luo, Z.Q., Tseng, P.: Error bounds and convergence analysis of feasible decent methods: a general approach. Ann. Oper. Res. 46, 157–178 (1993)
Martinet, B.: Regularization d’inequations variationnelles par approximations successive. Revue Fran. Inform. Rech. Opers. 4, 154–159 (1970)
Mignot, F., Puel, J.P.: Optimal control in some variational inequalities. SIAM J. Control Optim. 22, 466–476 (1984)
Mohan, M.S., Neogy, S.K.: On invex sets and preinvex functions. J. Math. Anal. Appl. 189, 901–908 (1995)
Mohsen, B.B., Noor, M.A., Noor, K.I., Postolache, M.: Strongly convex functions of higher order involving bifunction. Mathematics 7(11), 1028 (2019). https://doi.org/10.3390/math7111028
Mosco, U.: Implicit variational problems and quasi variational inequalities. In: Lecture Notes Math., vol. 543, pp. 83–126. Springer, Berlin (1976)
Moudafi, A., Noor, M.A.: Sensitivity analysis for variational inclusions by Wiener-Hopf equations technique. J. Appl. Math. Stoch. Anal. 12, 223–232 (1999)
Nagurney, A.: Network Economics, A Variational Inequality Approach. Kluwer Academic, Boston (1999)
Nagurney, A., Zhang, D.: Projected Dynamical Systems and Variational Inequalities with Applications. Kluwer Academic, Dordrecht (1996)
Noor, M.A.: The Riesz-Frechet Theorem and Monotonicity. M.Sc. Thesis, Queen’s University, Kingston, Canada (1971)
Noor, M.A.: Bilinear forms and convex set in Hilbert space. Boll. UMI 5, 241–244 (1972)
Noor, M.A.: On Variational Inequalities. Ph.D. Thesis, Brunel University, London (1975)
Noor, M.A.: Strongly nonlinear variational inequalities. C. R. Math. Rep. 4, 213–218 (1982)
Noor, M.A.: An iterative scheme for a class of quasi variational inequalities. J. Math. Anal. Appl. 110(2), 463–468 (1985)
Noor, M.A.: Generalized quasi complemetarity problems. J. Math. Anal. Appl. 120, 321–327 (1986)
Noor, M.A.: Fixed-point approach for complementarity problems. J. Math. Anal. Appl. 133, 437–448 (1988)
Noor, M.A.: General variational inequalities. Appl. Math. Lett. 1, 119–121 (1988)
Noor, M.A.: Quasi variational inequalities. Appl. Math. Lett. 1, 367–370 (1988)
Noor, M.A.: An iterative algorithm for variational inequalities. J. Math. Anal. Appl. 158, 448455 (1991)
Noor, M.A.: Wiener-Hopf equations and variational inequalities. J. Optim. Theory Appl. 79, 197–206 (1993)
Noor, M.A.: Variational inequalities in physical oceanography. In: Rahman, M. (ed.) Ocean Wave Engineering, pp. 201–226. Comput. Mechanics Publications, Southampton (1994)
Noor, M.A.: Fuzzy preinvex functions. Fuzzy Sets Syst. 64, 95–104 (1994)
Noor, M.A.: Variational-like inequalities. Optimization 30, 323–330 (1994)
Noor, M.A.: Invex equilibrium problems. J. Math. Anal. Appl. 302, 463–475 (2005)
Noor, M.A.: Fundamentals of equilibrium problems. Math. Inequal. Appl. 9(3), 529–566 (2006)
Noor, M.A.: Hermite-Hadamard integral inequalities for log-preinvex functions. J. Math. Anal. Approx. Theory 2, 126–131 (2007)
Noor, M.A.: Hadamard integral inequalities for productive of two preinvex functions. Nonlinear Anal. Forum 14, 167–173 (2009)
Noor, M.A.: Sensitivity analysis for quasi variational inequalities. J. Optim. Theory Appl. 95, 399–407 (1997)
Noor, M.A.: Wiener-Hopf equations techniques for variational inequalities. Korean J. Comput. Appl. Math. 7, 581–599 (2000)
Noor, M.A.: Some recent advances in variational inequalities, Part I, basic concepts. N.Z. J. Math. 26, 53–80 (1997)
Noor, M.A.: Some recent advances in variational inequalities, Part II, other concepts. N.Z. J. Math. 26, 229–255 (1997)
Noor, M.A.: Generalized quasi variational inequalities and implicit Wiener-Hopf equations. Optimization 45, 197–222 (1999)
Noor, M.A.: A modified extragradient method for general monotone variational inequalities. Comput. Math. Appl. 38, 19–24 (1999)
Noor, M.A.: Some algorithms for general monotone mixed variational inequalities. Math. Comput. Model. 29, 1–9 (1999)
Noor, M.A.: Set-valued mixed quasi variational inequalities and implicit resolvent equations. Math. Comput. Model. 29, 1–11 (1999)
Noor, M.A.: Merit functions for variational-like inequalities. Math. Inequal. Appl. 3, 117–128 (2000) <