1 Introduction

Let H be a real Hilbert space with a nonempty closed convex subset C. Let T:CC be a self-mapping defined on C. We denote by F(T) the set of fixed points of T. The mapping T is called quasi-nonexpansive if F(T) and

TxTyxyfor all xC and yF(T).

Takahashi et al. [17] gave the following definitions of nonlinear mappings and studied the existence and convergence theorems of fixed points for these mappings.

Definition 1.1 A mapping T:CC is called

  1. (i)

    nonspreading [1] if for every x,yC,

    2 T x T y 2 T x y 2 + T y x 2 ,
  2. (ii)

    TY [3] if for every x,yC,

    2 T x T y 2 x y 2 + T x y 2 ,
  3. (iii)

    hybrid [4] if for every x,yC,

    3 T x T y 2 x y 2 + T x y 2 + T y x 2 ,
  4. (iv)

    λ-hybrid (λR) [5] if for every x,yC,

    T x T y 2 x y 2 +2λxTx,yTy,
  5. (v)

    (α,β)-generalized hybrid (α,βR) [6] if for every x,yC,

    α T x T y 2 +(1α) T y x 2 β T x y 2 +(1β) x y 2 ,
  6. (vi)

    α-nonexpansive (α(,1)) [7] if for every x,yC,

    T x T y 2 α T x y 2 +α T y x 2 +(12α) x y 2 .

It is obvious that the mappings mentioned in Definition 1.1 are quasi-nonexpansive. Recently, Lin et al. [8] gave the following definition of a new class of nonlinear mappings.

Definition 1.2 [8]

Let a 1 [0,1], a 2 , a 3 [0,1), k 1 , k 2 [0,1 a 2 )[0,1 a 3 ) and a 1 + a 2 + a 3 =1. A mapping T:CC is called a ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mapping if for every x,yC,

T x T y 2 a 1 x y 2 + a 2 T x y 2 + a 3 T y x 2 + k 1 x T x 2 + k 2 y T y 2 .

This class of mappings are not necessary to be quasi-nonexpansive and contains nonexpansive mappings, nonspreading mappings, hybrid mappings, and TY mappings. Lin et al. [8] studied weak and strong convergence theorems of ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mappings, but existence theorems of fixed points for ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mapping are not discussed in [8]. On the other hand, Aoyama and Kohsaka [7] characterized the existence of fixed points of α-nonexpansive mappings in uniformly convex Banach spaces.

Motivated by the literatures above, we study existence theorems of fixed points for the mappings mentioned in Definitions 1.1 and 1.2 in an unified method. Precisely, we propose a new class of nonlinear mappings in Hilbert spaces.

Definition 1.3 Let a( 1 2 ,) and b(,a). A mapping T:CC is called an (a,b)-monotone mapping if for every x,yC,

xy,TxTya T x T y 2 +(1a) x y 2 b x T x 2 b y T y 2

or equivalently,

Remark 1.1 Let C be a nonempty, closed, and convex subset of a Hilbert space, and let α>0. Recall that a mapping T:CC is called α-inverse strongly monotone if

xy,TxTyα T x T y 2 for all x,yC.

A firmly nonexpansive mapping is an α-inverse strongly monotone mapping with α=1. Note that a firmly nonexpansive mapping (1-inverse strongly monotone mapping with α=1) is a (1,0)-monotone mapping.

Next, we give an example to show that a (a,b)-monotone mapping is not necessary to be a quasi-nonexpansive mapping.

Example 1.1 Let H= R 2 . Let ϕ:R×HH and T:HH be defined by

for all αR and for all x=(rcosθ,rsinθ)H. Then the following statements hold:

  1. (i)

    T is a (4,3)-monotone mapping;

  2. (ii)

    T is not a quasi-nonexpansive mapping.

Proof It’s obvious that F(T)={0}. We first prove part (i). For each xH,

Tx= 5 4 ϕ ( 3 4 π , x ) = 5 2 8 ϕ(π,x)+ 5 2 8 ϕ ( π 2 , x ) .

Then for each x,yH, we have

  1. (1)

    xy,TxTy= 5 2 8 x y 2 ,

  2. (2)

    T x T y 2 = 25 16 x y 2 ,(3)

    x T x 2 = x 2 + T x 2 2xTxcos 3 4 π= ( 41 16 + 5 2 4 ) x 2 .

Then

By parallelogram law, we have

Take a=4 and b=3. Then

Then T is a (4,3)-monotone mapping. Next we want to prove part (ii). Since TxT0= 5 4 x0, T is not a quasi-nonexpansive mapping. The proof of part (ii) is complete. □

Remark 1.2 Since T in Example 1.1 is not a quasi-nonexpansive mapping, T is not nonspreading, TY, hybrid, λ-hybrid, (α,β)-generalized hybrid, and α-nonexpansive. This example shows that an (a,b)-monotone mapping is not necessary to be a quasi-nonexpansive mapping, TY mapping, hybrid mapping, λ-hybrid mapping, (α,β)-generalized hybrid mapping, and α-nonexpansive mapping.

In this paper, we first show that the class of (a,b)-monotone mappings contains nonspreading mappings, hybrid mappings, TY mappings, firmly nonexpansive mappings, and ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mappings with a 1 <1. We also give an example to show that this class of mappings are not necessary to be quasi-nonexpansive mappings. We establish an existence theorem of fixed points and the demiclosed principle for the class of (a,b)-monotone mappings. As a special case of our result, we give an existence theorem of fixed points for ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mappings with a 1 <1. We also consider Mann’s type weak convergence theorem and CQ type strong convergence theorem for (a,b)-monotone mappings. An example of (a,b)-monotone mappings is given to show the Mann’s type weak convergence.

2 Preliminaries

In this paper, we use the following notations:

  1. (i)

    ⇀ for weak convergence and → for strong convergence.

  2. (ii)

    ω w ( x n )={x: x n j x} denotes the weak ω-limit set of { x n }.

Let us recall some known results, which will be used later.

Proposition 2.1 [8]

Let C be a nonempty, closed, and convex subset of a Hilbert space H. A mapping T:CC be a mapping.

  1. (i)

    If T is a nonexpansive mapping, then T is a (1,0,0,0,0)-generalized hybrid mapping;

  2. (ii)

    If T is a nonspreading mapping, then T is a (0, 1 2 , 1 2 ,0,0)-generalized hybrid mapping;

  3. (iii)

    If T is a hybrid mapping, then T is a ( 1 3 , 1 3 , 1 3 ,0,0)-generalized hybrid mapping;

  4. (iv)

    If T is a TY mapping, then T is a ( 1 2 , 1 2 ,0,0,0)-generalized hybrid mapping;

  5. (v)

    If T is an (α,β)-generalized hybrid mapping with α1β0 and α>β, then T is a ( 1 β α , β α ,1 1 α ,0,0)-generalized hybrid mapping.

Lemma 2.1 [3]

Let C be a nonempty, closed and convex subset of a Hilbert space H. Let T:CC be a mapping. Suppose that there exist xC and a Banach limit μ such that { T n x} is bounded and

μ n T n x T y 2 μ n T n x y 2 for allyC.

Then T has a fixed point.

Lemma 2.2 [9]

Let H be a real Hilbert space. Let C be a closed convex subset of H, let w,x,yH and let a be a real number. The set

D:= { v C : y v 2 x v 2 + w , v + a }

is closed and convex.

Lemma 2.3 Let K be a closed convex subset of a real Hilbert space H and let P K be the metric projection from H onto K. Let xH and zK. Then z= P K x if and only if

xz,yz0for allyK.

Lemma 2.4 [9]

Let K be a closed convex subset of a real Hilbert space H. Let { x n } be a sequence in H and uH. Let q= P K u. Suppose that ω w ( x n )K and

x n uuqfor allnN.

Then x n q.

Lemma 2.5 Let H be a real Hilbert space. Then

u v 2 = u 2 v 2 2uv,v,for allu,vH.

Theorem 2.1 [10]

Let H be a Hilbert space and let { x n } be a bounded sequence in H. Then { x n } is weakly convergent if and only if each weakly convergent subsequence of { x n } has the same weak limit, that is, for xH,

x n x( x n i yx=y).

3 Fixed point theorem of (a,b)-monotone mappings

Proposition 3.1 Let C be a nonempty, closed, and convex subset of a Hilbert space H. If T:CC is a ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mapping with a 1 <1, then T is a ( 1 1 a 1 , k 1 a 1 + 1 2 )-monotone mapping, where k=max{ k 1 , k 2 }.

Proof If T is an ( a 1 , a 2 , a 3 , k 1 , k 2 )-generalized hybrid mapping with a 1 <1, then for every x,yC,

and

where k=max{ k 1 , k 2 }.

Note that

We have

Without loss of generality, we may assume that a 2 a 3 .

Since k<min{1 a 2 ,1 a 3 }, we have that

k 1 a 1 + 1 2 1 1 a 1 = 1 2 ( 1 a 1 ) ( 2 k + ( 1 a 1 ) 2 ) < 1 2 ( 1 a 1 ) ( 2 ( 1 a 2 ) + ( 1 a 1 ) 2 ) = 1 2 ( 1 a 1 ) ( 1 a 1 2 a 2 ) 1 2 ( 1 a 1 ) ( 1 a 1 a 2 a 3 ) = 0 ,

that is, k 1 a 1 + 1 2 < 1 1 a 1 . Take a= 1 1 a 1 1> 1 2 and b= k 1 a 1 + 1 2 <a, we see that T is an (a,b)-monotone mapping. □

The following proposition follows immediately from Propositions 2.1 and 3.1.

Proposition 3.2 Let C be a nonempty, closed, and convex subset of a Hilbert space H. A mapping T:CC be a mapping.

  1. (i)

    If T is a nonspreading mapping, then T is a (1, 1 2 )-monotone mapping;

  2. (ii)

    If T is a hybrid mapping, then T is a ( 3 2 , 1 2 )-monotone mapping;

  3. (iii)

    If T is a TY mapping, then T is a (2, 1 2 )-monotone mapping;

  4. (vi)

    If T is an (α,β)-generalized hybrid mapping with α1β0, α>β and α+β>1, then T is an ( α α + β 1 , 1 2 )-monotone mapping.

Proposition 3.3 Let C be a closed convex subset of a Hilbert space. Let T be a (a,b)-monotone mapping defined on C. Then

x p 2 T x p 2 + 1 2 b 2 a 1 x T x 2 for allxCandpF(T).

Proof Since T is a (a,b)-monotone mapping, we have that for each xC and pF(T),

xp,Txpa T x p 2 +(1a) x p 2 b x T x 2 ,

that is,

Then

(2a1) x p 2 (2a1) T x p 2 +(12b) x T x 2 ,

that is,

x p 2 T x p 2 + 1 2 b 2 a 1 x T x 2 .

 □

Now we give a demiclosed principle of (a,b)-monotone mappings:

Theorem 3.1 Let C be a closed convex subset of a Hilbert space. Let T be a (a,b)-monotone mapping defined on C. If a sequence { x n }C with x n x and x n T x n 0. Then x =T x .

Proof Since T is a (a,b)-monotone mapping, we have that

that is,

Since x n x and x n T x n 0, { x n } and {T x n } are bounded. Taking limit on the inequality above, we have

b x T x 2 a x T x 2 .

Since b<a, we have that x T x =0, that is, x =T x . □

Corollary 3.1 [24]

Let C be a closed convex subset of a Hilbert space. Let T be a self-mapping defined on C and satisfies one of the following:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

If a sequence { x n }C with x n x and x n T x n 0, then x =T x .

Theorem 3.2 Let C be a closed convex subset of a Hilbert space. Let T be a (a,b)-monotone mapping defined on C. If F(T) is nonempty, then F(T) is closed and convex.

Proof First, we show that F(T) is closed. For each x F ( T ) ¯ , there exists a sequence { x n } n N F(T) with x n x. Since x n x and x n F(T) for all nN, we have that x n x and x n T x n =0 for all nN. By Theorem 3.1, x=Tx. Next, we want to show that F(T) is a convex subset of C. Take any u,vF(T) and t[0,1]. Let z t :=tu+(1t)v. By Proposition 3.3, we have

Since 2 b 1 2 a 1 <1, we have that z t =T z t . □

Theorem 3.3 Let C be a nonempty subset of a Hilbert space H. Let T:CC be a (a,b)-monotone mapping with b(, 1 2 ]. Suppose that { T n x} is bounded for some xC. Then μ n T n x T y 2 μ n T n x y 2 for all Banach limits μ and for all yC.

Proof Let μ be a Banach limit and let yC be given. Since T is a (a,b)-monotone mapping with b(, 1 2 ], we have that

that is,

1 2 T n x T y 2 + 1 2 y T n + 1 x a T n + 1 x T y 2 +(1a) T n x y 2 .

Then

μ n T y T n x 2 + μ n y T n x 2 2a μ n T y T n x 2 +2(1a) μ n y T n x 2 .

Hence (2a1) μ n y T n x 2 (2a1) μ n T y T n x 2 . Since a> 1 2 , we have that

μ n y T n x 2 μ n T y T n x 2 .

 □

As a direct consequence of Theorem 3.3 and Lemma 2.1, we have the following existence theorem of fixed points for (a,b)-monotone mappings.

Theorem 3.4 Let C be a nonempty, closed, and convex subset of a Hilbert space H. Let T:CC be a (a,b)-monotone mapping with b(, 1 2 ]. Then F(T) if and only if there exists xC such that { T n x} is bounded.

Corollary 3.2 [1, 3, 4]

Let C be a closed convex subset of a Hilbert space. Let T be a self-mapping defined on C and satisfies one of the following:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

Then F(T) if and only if there exists xC such that { T n x} is bounded.

4 Convergence theorems

In this section, we first prove a weak convergence theorem of Mann’s type for (a,b)-monotone mappings in a Hilbert space.

Theorem 4.1 Let C be a nonempty, closed, and convex subset of a real Hilbert space H. Let T:CC be a (a,b)-monotone mapping satisfies F(T). If a sequence { α n } n N (0,1) with α n > 2 b 1 2 a 1 and lim inf n (1 α n )( α n + 1 2 b 2 a 1 )>0, then for each x 1 C, the sequence { x n } with x n + 1 = α n x n +(1 α n )T x n for all nN weakly converges to some fixed point of T.

Proof We first show that there exists a sequence { α n } satisfies our assumptions. Since b<a, 2a>1, we have 2 b 1 2 a 1 <1, there exists a constant αR such that 2 b 1 2 a 1 <α<1. If we take α n =α for all nN, then { α n }(0,1) such that α n > 2 b 1 2 a 1 and lim inf n (1 α n )( α n + 1 2 b 2 a 1 )>0. Since T is a (a,b)-monotone mapping, by Proposition 3.3, we have that for each pF(T) and xC,

x p 2 T x p 2 + 1 2 b 2 a 1 x T x 2 .

Since α n > 2 b 1 2 a 1 , we have that

Then lim n x n p exists and sequence { x n } is bounded. Further, from the inequality above, we have that

(1 α n ) ( α n + 1 2 b 2 a 1 ) x n T x n 2 x n p 2 x n + 1 p 2 .

Since lim inf n (1 α n )( α n + 1 2 b 2 a 1 )>0, we have lim n x n T x n =0.

Therefore, lim n x n + 1 x n = lim n (1 α n ) x n T x n =0. Since { x n } is bounded, there exist a subsequence { x n j } of { x n } and a point x C such that x n j x . Since T is a (a,b)-monotone mapping, by Theorem 3.1, we have x =T x .

For each subsequence { x n k } of { x n } with x n k u for some uC, we follow the same argument as above, we see that u=Tu. We have to show that u= x . Otherwise, if u x , then by Optial condition,

lim inf j x n j x < lim inf j x n j u = lim n x n u = lim inf k x n k u < lim inf k x n k x = lim n x n x = lim inf j x n j x .

This leads to a contradiction. Therefore u= x . By Theorem 2.1, we have that x n x . □

Example 4.1 Let H, ϕ, T be the same as in Example 1.1. For any fixed x 1 H, take a sequence { x n } as in Theorem 4.1 with α n = 3 4 for all nN, that is,

x n + 1 = 3 4 x n + 1 4 T x n .

Then

x n + 1 = 3 4 x n + 5 16 ( 2 2 ϕ ( π , x n ) + 2 2 ϕ ( π 2 , x n ) ) = ( 3 4 5 2 32 ) x n + 5 2 32 ϕ ( π 2 , x n )

and hence

x n + 1 ( 3 4 5 2 32 ) x n + 5 2 32 x n 3 4 x n .

Therefore, x n 0F(T), and hence x n 0.

Corollary 4.1 Let C be a nonempty closed convex subset of a real Hilbert space H. Let T:CC be a mapping with F(T) and satisfies one of the following:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

If a sequence { α n } n N (0,1) satisfies lim inf n (1 α n )( α n )>0, then for each x 1 C, the sequence { x n } with x n + 1 = α n x n +(1 α n )T x n for all nN weakly converges to some fixed point of T.

Proof Since T is an (a,b)-monotone mapping with b= 1 2 , we have 2 b 1 2 a 1 =0. Then Corollary 4.1 follows from Theorem 4.1. □

Corollary 4.2 Let C be a nonempty, closed, and convex subset of real Hilbert space H. Let T:CC be a mapping with F(T) and satisfies one of the following:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

Then for each x 1 C, the sequence { x n } with x n + 1 = 1 2 x n + 1 2 T x n for all nN weakly converges to some fixed point of T.

Proof Take α n = 1 2  for all nN. Then Corollary 4.2 follows from Corollary 4.1. □

Next we prove a strong convergence theorem by hybrid method for (a,b)-monotone mappings in a Hilbert space.

Theorem 4.2 Let C be a nonempty, closed and convex subset of a real Hilbert space H. Let T:CC be a (a,b)-monotone mapping with F(T). Suppose that { x n } is a sequence generated by the following scheme:

{ x 0 C chosen arbitrarily ; y n = t n x n + ( 1 t n ) T x n ; C n = { v C : y n v 2 x n v 2 + ( 1 t n ) 2 b 1 2 a 1 x n T x n 2 } ; Q n = { v C : x n v , x n x 0 0 } ; x n + 1 = P C n Q n x 0 , where P C n Q n is the metric projection from H onto C n Q n .

If the sequence { t n } n N (0,1) satisfies lim sup n ( 2 b 1 2 a 1 + t n )<1, then x n P F ( T ) x 0 .

Proof By Lemma 2.2, we see that C n is closed and convex for all nN. For any pF(T), by Proposition 3.3, we have

y n p 2 = t n ( x n p ) + ( 1 t n ) ( T x n p ) 2 = t n x n p 2 + ( 1 t n ) T x n p 2 t n ( 1 t n ) x n T x n 2 t n x n p 2 + ( 1 t n ) T x n p 2 t n x n p 2 + ( 1 t n ) ( x n p 2 + 2 b 1 2 a 1 x n T x n 2 ) = x n p 2 + ( 1 t n ) 2 b 1 2 a 1 x n T x n 2 .

Hence, p C n . Then we have that F(T) C n for all n0.

Next, we show that F(T) Q n for all n0. We prove this by induction. For n=0, we have F(T)C= Q 0 . Assume that F(T) Q n . Since x n + 1 is the projection of x 0 onto C n Q n , by Lemma 2.3, we have x n + 1 z, x 0 x n + 1 0 for all z C n Q n . As F(T) C n Q n by the induction assumption, the last inequality holds, in particular, for all zF(T). This together with the definition of Q n + 1 implies that F(T) Q n + 1 . Hence F(T) Q n for all nN. Then the sequence { x n } is well defined.

The definition of Q n and Lemma 2.3 imply that x n = P Q n x 0 , which in turn implies that x n x 0 p x 0 for all pF(T), in particular, { x n } is bounded and x n x 0 q x 0 with q= P F ( T ) x 0 .

That x n + 1 Q n asserts that

x n x n + 1 , x n x 0 0.

It follows from Lemma 2.5 and the inequality above that

x n + 1 x n 2 = x n + 1 x 0 2 x n x 0 2 2 x n + 1 x n , x n x 0 x n + 1 x 0 2 x n x 0 2 .

The last inequality implies that { x n x 0 } is increasing. Since { x n } is bounded, we have that lim n x n x 0 exists and x n + 1 x n 0. Since x n + 1 C n ,

Note that

Then

Then

Without loss of generality, we may assume that x n T x n for all nN. Otherwise, x n F(T) for some nN and we complete the proof. Therefore,

x n T x n 2 x n x n + 1 ( 2 b 1 2 a 1 + t n ) x n T x n .

Hence,

lim sup n x n T x n lim sup n ( 2 b 1 2 a 1 + t n ) x n T x n .

By the choice of { t n }, lim sup n ( 2 b 1 2 a 1 + t n )<1. Therefore, lim n x n T x n =0. Consequently, ω w ( x n )F(T) by Theorem 3.1. Hence, applying Lemma 2.4 (to u:= x 0 and K:=F(T)), one can conclude that x n q. □

Corollary 4.3 Let C be a nonempty, closed, and convex subset of a real Hilbert space H. Let T:CC be a mapping with F(T) and satisfies one of the following conditions:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

Suppose that { x n } is a sequence generated by the following scheme:

{ x 0 C chosen arbitrarily ; y n = t n x n + ( 1 t n ) T x n ; C n = { v C : y n v 2 x n v 2 + ( 1 t n ) 2 b 1 2 a 1 x n T x n 2 } ; Q n = { v C : x n v , x n x 0 0 } ; x n + 1 = P C n Q n x 0 , where P C n Q n is the metric projection from H onto C n Q n .

If the sequence { t n } n N (0,1) satisfies lim sup n t n <1. Then x n P F ( T ) x 0 .

Proof Since T is a (a,b)-monotone mapping with b= 1 2 , we have 2 b 1 2 a 1 =0, then Corollary 4.3 follows from Theorem 4.2. □

Corollary 4.4 Let C be a nonempty, closed, and convex subset of a real Hilbert space H. Let T:CC be a mapping with F(T) and satisfies one of the following conditions:

  1. (i)

    T is a nonspreading mapping;

  2. (ii)

    T is a hybrid mapping;

  3. (iii)

    T is a TY mapping.

Suppose that { x n } is a sequence generated by the following scheme:

{ x 0 C chosen arbitrarily ; y n = 1 2 x n + 1 2 T x n ; C n = { v C : y n v 2 x n v 2 } ; Q n = { v C : x n v , x n x 0 0 } ; x n + 1 = P C n Q n x 0 , where P C n Q n is the metric projection from H onto C n Q n .

Then x n P F ( T ) x 0 .

Proof Take t n = 1 2 for all nN, then Corollary 4.4 follows from Corollary 4.3. □