Abstract
In this paper we use a matrix approach to approximate solutions of variational inequalities in Hilbert spaces. The methods studied combine new or well-known iterative methods (as the original Mann method) with regularized processes that involve regular matrices in the sense of Toeplitz. We obtain ergodic type results and convergence.
Similar content being viewed by others
1 Introduction and results
The results presented here will be proved in Section 2.
Let H be a Hilbert space and let \(f:H\to H\) be a ρ-contraction. It is well known that if \(T:H\to H\) is a quasi-nonexpansive mapping, the set of the fixed points \(\operatorname{Fix}(T)\) is closed and convex and the variational inequality problem (VIP)
admits a unique solution.
The interactions between fixed point theory and the calculus of variations are certainly not recent. In this direction Moudafi in 2000 [1], Xu in 2004 [2] and Marino and Xu [3] in 2006 have shown deep connections between the approximation of fixed points for nonlinear mappings and the approximation of solutions of variational inequalities.
In this paper our aim is to approximate on \(\operatorname{Fix}(T)\) the unique solution of a (VIP) when T is a nonspreading mapping, i.e.
The class of nonspreading mappings has been introduced recently by Kohsaka and Takahashi in [4]. They observed that it contains the class of firmly nonexpansive-type mappings, introduced by the same authors in [5]
Note that a nonspreading mapping T is quasi-nonexpansive [6].
The choice to consider quasi-nonexpansive mappings is made since these operators are widely used in the sub-gradient projection operator techniques to solve convex constrained problems (see Maingé [7] and the references contained therein). Nevertheless, the lack of continuity of a quasi-nonexpansive mapping makes it difficult to prove asymptotical stability of iterates of T (see, for example, [8]). This property is a key for the convergence analysis of sequences generated by well-known iterative methods.
To fill this gap, we employ regularizations that involve matrices \((b_{n,k})_{n,k\in\mathbb{N}}\), so-called triangular-Toeplitz matrices, satisfying the following properties:
-
(h0)
\(b_{n,k}\geq0\) for all \(n,k\in\mathbb{N}\);
-
(h1)
for any \(n\in\mathbb{N}\), \(b_{n,k}=0\) for \(k>n\) and for all \(n\in\mathbb{N}\), \((b_{n,k})_{k\in\mathbb{N}}\) is a nonincreasing sequence;
-
(h2)
for any \(n\in\mathbb{N}\), \(\sum_{k=1}^{n}b_{n,k}=1\), and
-
(h3)
for any \(k\in\mathbb{N}\), \(b_{n,k}\to0\), as \(n\to\infty\).
We will denote by \(\mathfrak{T}\) the set of the triangular-Toeplitz matrices; \(\mathfrak{T}\) is a subclass of the regular matrices in the sense of Toeplitz (see [9]). The weak limits of a regularized sequence that involves a nonspreading mapping and a triangular-Toeplitz matrix are fixed points of T; more precisely, we will prove the following.
Lemma 1.1
Let \(T:H\to H\) be a nonspreading mapping and let \((b_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{T}\).
Let \((x_{n})_{n\in\mathbb{N}}\) be a bounded sequence in H; we define
Then the weak limits of \((y_{n})_{n\in\mathbb{N}}\) are fixed points of T, i.e. \(\omega_{w}(y_{n})\subset \operatorname{Fix}(T)\).
In 1953 Mann [10], taking in account the works of Cesaro, Fejer and Toeplitz, considered the problem to construct a sequence in a convex and compact set C of a Banach space X that converges to a fixed point of a continuous transformation \(T:C\to C\).
Mann introduced an infinite triangular matrix \((a_{n,k})_{n,k\in\mathbb{N}}\),
such that
We will denote by \(\mathfrak{M}\) the set of matrices satisfying (M1) and (M2).
Let us observe that \(\mathfrak{T}\subset\mathfrak{M}\).
By using \((a_{n,k})_{n,k\in\mathbb{N}}\) Mann introduced the following iteration process:
It is very easy to check that the Cesaro matrix
belongs to \(\mathfrak{T}\). Moreover, by using C, (1.4) becomes
However, to the best of our knowledge, there are not also convergence results for the original Mann iterative method. Therefore, in light of the above facts, we study an iterative method that implements two matrices: \((a_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{M}\) to compute our iterations; and \((b_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{T}\) to regularize the mapping involved.
We will investigate on the following Mann-Toeplitz iteration process: let \(x_{1} \in H\)
where \((a_{n,k})_{n,k\in\mathbb{N}}\) satisfies (M1) and (M2), i.e. \((a_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{M}\), T is a nonspreading mapping, f is a ρ-contraction, and \(f_{\mu_{n}}\) is the averaged mapping \(f_{\mu_{n}}=\mu_{n}f+(1-\mu_{n})I\) (see [11] for the regularization properties of nonspreading and averaged mappings).
The matrix \((b_{n,k})_{n,k\in\mathbb{N}}\) in (1.6) plays a regularization role similar to the Cesaro matrix. It is well known that the Cesaro mean preserves (or it increases) the regularity of a sequence. Therefore many recent papers, concerning the approximation of fixed points of nonlinear mappings and sometimes solutions of a (VIP), combine well-known iterative methods (Mann-Dotson, viscosity, Halpern, and so on) with the Cesaro means.
The first nonlinear ergodic theorem in Hilbert space was established by Baillon in [12], who proved that, if C is a nonempty closed convex subset of a Hilbert space and \(T:C\to C\) is a nonexpansive mapping with \(\operatorname{Fix}(T)\neq\emptyset\), the Cesaro means
weakly converges to a fixed point of T.
Shimizu and Takahashi in [13] studied by Cesaro means the convergence of an iteration process for a family of nonexpansive mappings in a Hilbert space. This result has been extended by Shioji and Takahashi in [14], by Song and Chen in [15] in the setting of uniformly convex Banach spaces.
However, all the cited approximation methods are not suitable for nonexpansive nonself-mappings. In 2004 Matsushita and Kuroiwa in [16] and Su and Li in 2006 (see [17]) studied two iterative methods for a nonexpansive nonself-mapping in a Hilbert space; in [18] Wangkeeree extended the results in [16] in the more general setting of uniformly convex Banach spaces.
Many references can be cited dealing with the approximation of solutions of (VIPs) and equilibrium problems. For instance in [19, 20], and [21] the authors introduced iterative processes in Hilbert spaces by using the Cesaro means for finding a common element of the set of fixed points of a nonexpansive mapping and the set of solutions of an equilibrium problem.
In 2009 and in 2010 Song (see [22] and [23]) studied an implicit viscosity method for a continuous pseudocontractive mapping and a Mann iterations of its Cesaro mean for an asymptotically nonexpansive mapping in Banach spaces.
Nevertheless the Cesaro matrix is not the unique matrix with regularization properties. Toeplitz summability theorems proved that there exists a class of matrices including the Cesaro means with the same regularization property. Therefore we consider it relevant, in its generality, to put our attention on the class of triangular-Toeplitz matrices.
We denote by \(\mathfrak{M}^{*}\) an interesting subclass of \(\mathfrak{M}\) of matrices such that \(a_{n,n}\to1\) as \(n \to +\infty\). An example of such matrices is
In Section 2 for this subclass of matrices we will prove the following.
Theorem 1.2
Let \(f:H\to H\) be a ρ-contraction and let \(f_{\mu_{n}}\) be the averaged mapping \(f_{\mu_{n}}=\mu_{n}f+(1-\mu_{n})I\). Let T be a nonspreading mapping.
Let us choose \((a_{n,k})_{k,n\in\mathbb{N}}\in\mathfrak{M}^{*}\) and \((b_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{T}\).
Let us choose \(\mu<\frac{2(1-\rho)}{(1+\rho)^{2}}\) and \((\mu_{n})_{n\in\mathbb{N}}\subset(0,\mu)\) such that
-
(h4)
\(\lim_{n\to\infty}\mu_{n}=0\), \(\sum_{n\in\mathbb{N}}\mu_{n}=\infty\).
-
(h5)
\(\lim_{n\to\infty}\frac{1-a_{n,n}}{\mu_{n}}=0\).
Set \(\tau=1-\rho\).
Then the sequence generated by the Mann-Toeplitz iterative method (1.6) strongly converges to \(x^{*}\in \operatorname{Fix}(T)\), that is, a unique solution of the variational inequality
Remark 1.3
The assumption (h5) is easily satisfied. For example, choosing \(\mu_{n}=\frac{1}{n}\) and \(\tilde{A}\) as in (1.7), we see that it holds.
If \((\gamma_{n})_{n\in\mathbb{N}}\) is a sequence in \([0,1]\), we can define, recursively, a matrix \((\tilde {a}_{n,k})_{n,k\in\mathbb{N}}\) by
Then the Mann-Toeplitz iterative method (1.6) becomes
The use of this matrix of regularization will be that it permits us to improve the main theorem of Dotson [24], obtaining strong convergence instead of weak convergence. Indeed, we will prove the following.
Theorem 1.4
Let \(f:H\to H\) be a ρ-contraction and let \(f_{\mu_{n}}\) be the averaged mapping \(f_{\mu_{n}}=\mu_{n}f+(1-\mu_{n})I\). Let T be a nonspreading mapping. Let \((b_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{T}\) be a triangular-Toeplitz matrix.
Let us choose \(\mu<\frac{(1-\rho)}{(1+\rho)^{2}}\) and \((\mu _{n})_{n\in\mathbb{N}}\subset(0,\mu)\) such that
-
(h4)
\(\lim_{n\to\infty}\mu_{n}=0\), \(\sum_{n\in\mathbb{N}}\mu_{n}=\infty\).
Let us take \((\tilde{a}_{n,k})_{n,k\in\mathbb{N}}\in\mathfrak{M}\) defined by a sequence \((\gamma_{n})_{n\in\mathbb{N}}\subset[0,\alpha]\subset[0,1)\) (see (1.8)) such that
-
(h6)
\(\lim_{n\to\infty}\gamma_{n}=0\).
Then the sequence generated by \(v_{1}\in H\) and by the iteration (1.9) strongly converges to \(x^{*}\in \operatorname{Fix}(T)\), that is, the unique solution of the variational inequality
2 Proofs
First we prove Lemma 1.1, which is a fundamental tool to prove the convergence of our methods.
Proof of Lemma 1.1
Note that since \((b_{n,k})_{n,k\in N}\) is nonincreasing, \(0\leq b_{n,n}\leq b_{n,k}\), for any \(k\leq n\), so (h3) implies that \(b_{n,n}\to0\), as \(n\to\infty \).
Moreover, following [25], one easily obtains
Therefore the following inequality holds:
Firstly we work on the right side of the previous equation. Multiplying by \(b_{n,k+1}\) and summing up over k from 0 to \((n-1)\), by (h2) and (1.3) we obtain
We observe that
then, by the boundedness of \((x_{n})_{n\in\mathbb{N}}\) and by the quasi-nonexpansivity of T, there exists \(M=M(y)\) such that, by (h1), (2.2) becomes
In a similar manner, for the left side of (2.1), multiplying by \(b_{n,k+1}\), summing over k from 0 to \((n-1)\) and using (h1), we have
Therefore we have the following chain:
and so, by the positivity of \(b_{n,k}\), it follows that
Now, if \(w\in\omega_{w}(y_{n})\), by \(b_{n,n}\to0\) as \(n \to +\infty\), we have the result that, for every \(y\in H\),
so, choosing \(y=w\)
i.e. we have the thesis. □
To obtain our results we also need of the following (well-known) lemmas; the first is proved in [26], the second is the discrete Jensen inequality.
Lemma 2.1
[26]
Assume \((a_{n})_{n\in\mathbb {N}}\) is a sequence of nonnegative numbers for which
where \((s_{n})_{n\in\mathbb{N}}\) is a sequence in \((0,1)\) and \((\delta _{n})_{n\in\mathbb{N}}\) is a sequence in \(\mathbb{R}\) such that
-
(1)
\(\lim_{n\to\infty}s_{n}=0\) and \(\sum_{n=1}^{\infty }s_{n}=\infty\);
-
(2)
\(\lim\sup_{n\to\infty}\frac{\delta_{n}}{s_{n}}\leq 0\) or \(\sum_{n=1}^{\infty}|\delta_{n}|<\infty\).
Then \(\lim_{n\to\infty}a_{n}=0\).
Lemma 2.2
Let \(\psi:H\to\mathbb{R}\) be a convex function. Let \(\{x_{1},\ldots ,x_{n}\}\subset H\) and let positive weights \(\{a_{1},\ldots,a_{n}\}\subset \mathbb{R}\), we have the result that
Proof of Theorem 1.2
It is well known that (see [27])
where \(\tau:=1-\rho\).
Moreover, we will denote \(y_{n}=\sum_{k=0}^{n-1}b_{n,k+1}T^{k}v_{n}\). Since T is quasi-nonexpansive and (h2) holds, for every \(w \in \operatorname{Fix} (T)\), as a result one finds that
Set
we prove, by induction on n, that \((x_{n})_{n\in\mathbb{N}}\) and \((v_{n})_{n\in\mathbb{N}}\subset B(w,r)\). Let us observe the following:
Since \(x_{1}=v_{1} \in B(w,r)\), we immediately have \(x_{2}\in B(w,r)\) and then, by (M2), \(v_{2}\in B(w,r)\).
Let us suppose that \(x_{i}\in B(w,r)\), for every \(i=1,\ldots,n\). Then, by (M2), \(v_{n} \in B(w,r)\). Therefore by the previous results we have
and \(\|v_{n+1}-w\|\le r\).
The next step is to prove that the weak cluster points of \((x_{n})_{n\in \mathbb{N}}\) are fixed points of T. First we note that
so, since \((\mu_{n})_{n\in\mathbb{N}}\) is a null sequence (see (h4)), \(\omega_{w}(x_{n})=\omega_{w}(y_{n})\). By the boundedness of \((x_{n})_{n \in\mathbb{N}}\), Lemma 1.1 ensures that the weak limits of the sequence \((y_{n})_{n\in\mathbb{N}}\) are contained in the set fixed points of T. The previous inequality shows that \(\omega_{w}(x_{n})\subset \operatorname{Fix}(T)\).
Finally, if \(x^{*}\in \operatorname{Fix}(T)\) is the unique solution of a (VIP), as a result one finds that
Since \((x_{n})_{n\in\mathbb{N}}\) is bounded, there exists a subsequence \(x_{n_{k}}\rightharpoonup z_{0}\) such that
Since every weak cluster point of \((x_{n})_{n\in\mathbb{N}}\) is in \(\operatorname{Fix}(T)\),
By (h4), (h5), (h6), and by using Lemma 2.1 we obtain \(x_{n}\to x^{*}\). □
Proof of Theorem 1.4
Also here we will denote \(y_{n}=\sum_{k=0}^{n-1}b_{n,k+1}T^{k}v_{n}\). Since T is quasi-nonexpansive and (h2) holds, for all \(w \in \operatorname{Fix}(T)\), as a result one finds that
If
we prove, by induction on n, that \((v_{n})_{n\in \mathbb{N}}\subset B(w,r)\). Set \(\tau=1-\rho\), let us observe the following:
Now, \(v_{1} \in B(w,r)\). For induction, let us suppose that \(v_{i}\in B(w,r)\), for every \(i=1,\ldots,n\). Therefore by the previous results we have
and \(\|v_{n+1}-w\|\le r\).
Now we want to prove that the weak cluster points of \((v_{n})_{n\in \mathbb{N}}\) are fixed points of T. First we note that
thus, since \((\mu_{n})_{n\in\mathbb{N}}\), \((\gamma_{n})_{n\in\mathbb{N}}\) are null sequences (see (h4) and (h6)), \(\omega_{w}(v_{n})=\omega_{w}(y_{n})\). By the boundedness of \((v_{n})_{n \in \mathbb{N}}\), Lemma 1.1 guarantees that the weak limits of the sequence \((y_{n})_{n\in\mathbb{N}}\) are contained in the set of fixed points of T. The previous inequality shows that \(\omega_{w}(v_{n})\subset \operatorname{Fix}(T)\).
Lastly, if \(x^{*}\in \operatorname{Fix}(T)\) is the unique solution of a (VIP), as a result one finds that
Since \((v_{n})_{n\in\mathbb{N}}\) is bounded, there exists a subsequence \(v_{n_{k}}\rightharpoonup z_{0}\) such that
Since every weak cluster point of \((v_{n})_{n\in\mathbb{N}}\) is in \(\operatorname{Fix}(T)\),
By (h4) and (h6) and by using Lemma 2.1 we obtain \(v_{n}\to x^{*}\). □
Remark 2.3
If \((b_{n,k})_{n,k\in\mathbb{N}}\) is generated recursively by iteration (1.8) and by a sequence \((\eta_{n})_{n\in\mathbb {N}}\) such that
(e.g. \(\eta_{n}=\frac{1}{(n+1)^{\eta}}\) with \(\eta\geq1\)) then \((b_{n,k})_{n,k\in\mathbb{N}}\) belongs to \(\mathfrak{T}\).
References
Moudafi, A: Viscosity approximation methods for fixed-points problems. J. Math. Anal. Appl. 241, 46-55 (2000)
Xu, HK: Viscosity approximation methods for nonexpansive mappings. J. Math. Anal. Appl. 298, 279-291 (2004)
Marino, G, Xu, HK: A general iterative method for nonexpansive mappings in Hilbert spaces. J. Math. Anal. Appl. 318, 43-52 (2006)
Kohsaka, F, Takahashi, W: Fixed point theorems for a class of nonlinear mappings related to maximal monotone operators in Banach spaces. Arch. Math. (Basel) 91(2), 166-177 (2008)
Kohsaka, F, Takahashi, W: Existence and approximation of fixed points of firmly nonexpansive-type mappings in Banach spaces. SIAM J. Optim. 19(2), 824-835 (2008)
Iemoto, S, Takahashi, W: Approximating common fixed points of nonexpansive mappings and nonspreading mappings in a Hilbert space. Nonlinear Anal. 71(12), 2082-2089 (2009)
Maingé, PE: The viscosity approximation process for quasi-nonexpansive mappings in Hilbert spaces. Comput. Math. Appl. 59(1), 74-79 (2010)
Hussain, N, Takahashi, W: Weak and strong convergence theorems for semigroups of mappings without continuity in Hilbert spaces. J. Nonlinear Convex Anal. 14(4), 769-783 (2013)
Cooke, RS: Infinite Matrices and Sequence Spaces. Macmillan & Co., London (1950)
Mann, WR: Mean value methods in iteration. Proc. Am. Math. Soc. 4, 506-510 (1953)
Hussain, N, Marino, G, Abdou Afrah, AN: On Mann’s method with viscosity for nonexpansive and nonspreading mappings in Hilbert spaces. Abstr. Appl. Anal. 2014, Article ID 152530 (2014)
Baillon, JB: Un théorème de type ergodique pour les contractions non linéairs dans un espace de Hilbert. C. R. Acad. Sci. Paris Sér. A-B 280, 1511-1541 (1975)
Shimizu, T, Takahashi, W: Strong convergence theorem to common fixed points of families of nonexpansive mappings. J. Math. Anal. Appl. 211, 71-83 (1997)
Shioji, N, Takahashi, W: A strong convergence theorem for asymptotically nonexpansive mappings in Banach spaces. Arch. Math. 72, 354-359 (1999)
Song, Y, Chen, R: Viscosity approximative methods to Cesáro means for non-expansive mappings. Appl. Math. Comput. 186(2), 1120-1128 (2007)
Matsushita, S, Kuroiwa, D: Strong convergence of averaging iterations of nonexpansive nonself-mappings. J. Math. Anal. Appl. 294, 206-214 (2004)
Su, Y, Li, S: Strong convergence theorems on two iterative method for non-expansive mappings. Appl. Math. Comput. 181, 332-341 (2006)
Wangkeeree, R: Viscosity approximative methods to Cesáro means iterations for nonexpansive nonself-mappings in Banach spaces. Appl. Math. Comput. 201, 239-249 (2008)
Aoyama, K, Takahashi, W: Weak convergence theorems by Cesáro means for a nonexpansive mappings and an equilibrium problem. Pac. J. Optim. 3(3), 501-509 (2007)
Iiduka, H, Takahashi, W: Weak convergence theorems by Cesáro means for nonexpansive mappings and inverse-strongly-monotone mappings. J. Nonlinear Convex Anal. 7, 105-113 (2006)
Jitpeera, T, Katchang, P, Kumam, P: A viscosity of Cesáro mean approximation methods for a mixed equilibrium, variational inequalities, and fixed point problems. Fixed Point Theory Appl. 2011, Article ID 945051 (2011)
Song, Y: Iterative convergence to Cesáro means for continuous pseudocontractive mappings. Nonlinear Anal. 71, 2792-2800 (2009)
Song, Y: Mann iteration of Cesáro means for asymptotically non-expansive mappings. Nonlinear Anal. 72, 176-182 (2010)
Dotson, WG, Jr: On the Mann iterative process. Trans. Am. Math. Soc. 149, 65-73 (1970)
Osilike, MO, Isiogugu, FO: Weak and strong convergence theorems for nonspreading-type mappings in Hilbert spaces. Nonlinear Anal. 74(5), 1814-1822 (2011)
Xu, HK: An iterative approach to quadratic optimization. J. Optim. Theory Appl. 116(3), 659-678 (2003)
Xu, HK, Kim, TH: Convergence of hybrid steepest-descent methods for variational inequalities. J. Optim. Theory Appl. 119(1), 185-201 (2003)
Acknowledgements
This article was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah. Therefore, the first author acknowledges with thanks DSR, KAU, for financial support.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally and significantly in writing this article. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Marino, G., Cianciaruso, F. & Hussain, N. Ergodic approximations via matrix regularization approach. Fixed Point Theory Appl 2015, 73 (2015). https://doi.org/10.1186/s13663-015-0321-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13663-015-0321-6