1 Introduction

In recent years, Lyapunov’s second method has been a very important method to study the stability of a stochastic differential equation, which has attracted much attention since it is not only academically challenging, but also of practical importance, and has played an important role in many fields such as insurance, finance, population dynamic, control (see, e.g., Øsendal [1]). Recently, much work has been done on stochastic differential equations with Markovian switching (see, e.g., Mao and Yuan [2]). In particular, significant work has appeared on the stability of stochastic differential delay equations with Markovian switching (see, e.g., Kolmanovskii et al. [3], Luo [4], Luo et al. [5], Mao et al. [6], Yuan and Mao [7], Yuan et al. [8], Mao et al. [9], Liu [10, 11]).

On the other hand, many dynamical systems depend not only on present and past states, but also involve derivatives with delays. Motivated by chemical engineering systems as well as the theory of aero elasticity, many researchers have been interested in the neutral stochastic functional differential equations, and the neutral part, which has been used in investigating the qualitative properties of derivatives of delays for dynamical systems, has been added to all kinds of equations. In particular, the significant work has been done (see, e.g., Mao [12], Luo et al. [13]).

The global stability of SDEwMSs with respect to sample paths or moments, which is too strong for many cases, appeared in many more papers. So, the notion of the partial stability (see, e.g., Peiffer and Rouche [14], Rouche et al. [15]) has been involved, and the second method of Lyapunov as an indispensable tool has been used to investigate the partial stability (see, e.g., Sontag and Wang [16], Vorotnikov [17], Vorotnikov and Rumyantsev [18], Ignatyev [19, 20]).

However, in the process of investigating the qualitative properties of equilibria and boundedness properties of motions of dynamical systems, the partial stability as a new concept plays the key role, and the systems are often determined by all kinds of equations, including stochastic differential equations, of course. Motivated by the previously mentioned topic, and since the results of the partial stochastic asymptotic stability of neutral stochastic functional differential equations with Markovian switching are very few, we make the attempt to study this topic to fill the gap.

This paper is organized as follows. In Section 2, we present some basic preliminaries and the form of neutral stochastic functional differential equations with Markovian switching. In Section 3, the sufficient conditions for partial stochastic asymptotic stability have been obtained and proofs have been given. In Section 4, some well-known results are generalized in the remarks. In Section 5, there is the discussion about the main results.

2 Preliminaries and definitions

Let {Ω,F, { F } t 0 ,P} be a complete probability space with a filtration satisfying the usual conditions, i.e., the filtration is continuous on the right and F 0 contains all P-zero sets. B(t) is an m-dimensional Brownian motion defined on the probability space. Let C([τ,0]; R n ) denote the family of functions φ from [τ,0] to R n that are right-continuous and have limits on the left. C([τ,0]; R n ) is equipped with the norm φ= sup τ s 0 |φ(s)| and |x|= x T x for any x R n . If A is a vector or matrix, its trace norm is denoted by |A|= trace ( A T A ) , while its operator norm is denoted by A=sup{|Ax|:|x|=1}. Denote C F 0 b ([τ,0]; R n ) to be the family of all F 0 -measurable bounded C([τ,0]; R n )-valued random variables ξ={ξ(θ):τθ0}. Let p>0, t0, L F t p ([τ,0]; R n ) denote the family of all F t measurable, C([τ,0]; R n )-valued random variables φ={φ(θ):τθ0} such that sup τ θ 0 E | φ ( θ ) | p <.

Let {r(t),t R + =[0,+)} be a right-continuous Markov chain on the probability space {Ω,F, { F } t 0 ,P} taking values in a finite state space S={1,2,,N} with a generator Γ= ( γ i j ) N × N given by

P ( r ( t + Δ ) = j | r ( t ) = i ) ={ γ i j Δ + o ( Δ ) , if  i j , 1 + γ i i Δ + o ( Δ ) , if  i = j ,

where Δ>0. Here γ i j 0 is the transition rate from i to j, if ij, while

γ i i = j i γ i j .

We assume that the Markov chain r() is independent of the Brownian motion B(). It is known that almost every sample path of r(t) is a right-continuous step function with a finite number of simple jumps in any finite sub-interval of R + .

Consider the following neutral stochastic functional differential equation with Markovian switching:

d [ x ( t ) G ( x t ) ] =f ( t , x t , r ( t ) ) dt+g ( t , x t , r ( t ) ) dB(t),t>0,
(2.1)

with the initial condition x 0 =ξ= ( ξ 1 , ξ 2 ) T C F 0 b ([τ,0]; R n ), where ξ 1 R k and ξ 2 R p , k+p=n, which is independent of B(), and x t ={x(t+θ):τθ0}. Let x ( t ) ˜ =x(t)G( x t ). Here, we furthermore assume that

f : R + × C ( [ τ , 0 ] ; R n ) × S R n , g : R + × C ( [ τ , 0 ] ; R n ) × S R n × m , G : C ( [ τ , 0 ] ; R n ) R n .

For our purpose, we impose the following assumptions which can ensure the existence and uniqueness of a solution, denoted by x(t) on t>0, for equation (2.1). Let f and g satisfy the local Lipschitz and linear growth condition. That is, for each d>0, there exist constants h>0, C d >0 and κ(0,1) such that

| f ( t , φ 1 , i ) f ( t , φ 2 , i ) | 2 | g ( t , φ 1 , i ) g ( t , φ 2 , i ) | 2 C d φ 1 φ 2 2 , | f ( t , φ , i ) | 2 | g ( t , φ , i ) | 2 h ( 1 + φ 2 ) , | G ( φ ) | κ φ .

Denote x= ( x 1 , x 2 ) T R n , where x 1 R k and x 2 R p , k+p=n, and the definitions of x ˜ = ( x 1 ˜ , x 2 ˜ ) T R n and G( x t )= ( G 1 ( x t ) , G 2 ( x t ) ) T R n are similar to x= ( x 1 , x 2 ) T . The domain B K ={x R n :| x 1 |<K,| x 2 |<}, and the stopping time σ B is the first exit time from the B K of the sample path of the process x(t). Let K, then σ B . Denote the set of functions C:={ϕ: R + R + , continuous, monotonically increasing and ϕ(0)=0}.

Denote by C 1 , 2 ( R + × R n ×S; R + ) the family of all non-negative functions V(t,x,i) on R + × R n ×S, which are twice continuously differential with respect to x and once continuously differential with respect to t. For any (t,x,i) R + × R n ×S, define an operator LV by

L V ( t , x t , i ) = V t ( t , x ( t ) ˜ , i ) + V x ( t , x ( t ) ˜ , i ) f ( t , x t , i ) + 1 2 trace [ g T ( t , x t , i ) V x x ( t , x ( t ) ˜ , i ) g ( t , x t , i ) ] + j = 1 N γ i j V ( t , x ( t ) ˜ , j ) ,

where

V t = V ( t , x , i ) t , V x = ( V ( t , x , i ) x 1 , , V ( t , x , i ) x n ) , V x x = ( 2 V ( t , x , i ) x i x j ) n × n .

Definition 2.1 The trivial solution x(t) of equation (2.1) is said to be partial stochastic stability with respect to x 1 (t) if, for any ϵ>0 and ϵ 1 >0, there exists a δ=δ(ϵ, ϵ 1 )>0 such that

P { sup t 0 | x 1 ( t ) | > ϵ } < ϵ 1 ,
(2.2)

whenever ξ<δ.

Definition 2.2 The trivial solution x(t) of equation (2.1) is said to be partial stochastic asymptotic stability with respect to x 1 (t) if it is the x 1 (t)-stochastic stability and for any ϵ(0,1), there exists a δ 0 = δ 0 (ϵ) such that

P { lim t | x 1 ( t ) | = 0 } 1ϵ,
(2.3)

whenever ξ< δ 0 .

3 Main results

First of all, we should present Sharov’s theorem [21].

Theorem 3.1 (Sharov [21])

If in the domain B K × R + there exists a function V(x,t) which satisfies the following conditions:

  1. (I)

    α(| x 1 |)V(t,x)β(| x 1 |), where α,βC;

  2. (II)

    LVγ(| x 1 |), where γC;

then the trivial solution x(t)0 of system (2.1) is x 1 (t)-stochastic asymptotic stability.

The condition of Theorem 3.1 is more difficult to be satisfied, which is demonstrated by the following example.

Example 3.1 Consider the system of stochastic differential equations

d x 1 = a x 1 3 x 2 2 d t + a x 1 2 x 2 d B 1 ( t ) , d x 2 = b x 1 d t + c x 2 d B 2 ( t ) ,
(3.1)

where a, b, c are constants and abc0. The system has the trivial solution x 1 =0, x 2 =0.

Denote V:= x 1 2 , we have LV=2a x 1 4 x 2 2 +2a x 1 4 x 2 2 =0.

Now, by Theorem 3.1, we cannot give whether the solution of (3.1) is stochastic asymptotic stability or not. So, we present the main results of this paper as follows.

Theorem 3.2 Let there exist a non-negative functional V(t,x,i) C 1 , 2 ( R + × B K ×S; R + ) such that

  1. (I)

    μ 1 (| x 1 |)V(t,x,i) μ 2 (| x 1 |), where μ 1 , μ 2 C;

  2. (II)

    LV0;

  3. (III)

    (Boundary condition) For any sufficiently small η>0, θ>0, any solution x(t) of equation (2.1), beginning in the domain {η<| x 1 (t)|<θ}, is such that

    ρ=inf { t : x 1 ( t ) = η } <,a.s.

Then the trivial solution of equation (2.1) is said to be partial stochastic asymptotic stability with respect to x 1 (t).

Before giving the proof of Theorem 3.1, we should present the following lemma.

Lemma 3.1 Let V(t,x,i) be a function in the class C 1 , 2 ( R + × B K ×S; R + ), bounded in the domain ( R + × B K ×S), and suppose that LV0 in this domain. Then the process V( σ B t, x ( σ B t ) ˜ ,r( σ B t)) is a supermartingale so that EV( σ B t, x ( σ B t ) ˜ ,r( σ B t))V(0, x 0 , i 0 ), for x(t) B K .

Proof As the generalized Itô formula, we have

V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) ) =V(0, x 0 , i 0 )+ 0 σ B t LV ( s , x s , r ( s ) ) ds+M( σ B t),

where M( σ B t) is the martingale.

For any s 1 , 0 s 1 σ B t and LV0, we derive that

E V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) | F s 1 ) = V ( 0 , x 0 , i 0 ) + E ( 0 σ B t L V ( s , x s , r ( s ) ) d s | F s 1 ) + E ( M ( σ B t ) | F s 1 ) V ( 0 , x 0 , i 0 ) + E ( 0 s 1 L V ( s , x s , r ( s ) ) d s | F s 1 ) + M ( s 1 ) = V ( 0 , x 0 , i 0 ) + 0 s 1 L V ( s , x s , r ( s ) ) d s + M ( s 1 ) = V ( s 1 , x ( s 1 ) ˜ , r ( s 1 ) ) .

So, V( σ B t, x ( σ B t ) ˜ ,r( σ B t)) is a supermartingale. Moreover, due to LV0 in the domain,

E V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) ) = V ( 0 , x 0 , i 0 ) + E ( 0 σ B t L V ( s , x s , r ( s ) ) d s ) + E ( M ( σ B t ) ) V ( 0 , x 0 , i 0 ) ,

so the proof is completed. □

Proof of Theorem 3.2 By Lemma 3.1 and Doob’s supermartingale convergence theorem, the process V( σ B t, x ( σ B t ) ˜ ,r(t)) is a supermartingale, and we can get

lim t V ( σ B t , x ( σ B t ) ˜ , r ( t ) ) =c,a.s.
(3.2)

Denote Ω 1 ={ω: σ B =}. Owing to LV0 and the partial stochastic stability theorem (Sharov [21]), the solution of equation (2.1) is the partial stochastic stability with respect to x 1 (t), so we have

lim ξ 0 P( Ω 1 )=1.
(3.3)

Combining this with condition (III) and for all the paths of Ω 1 , then

inf t > 0 | x 1 ( t ) | =0.
(3.4)

By the lemma of Has’minskii [22], that is, the coefficients of equation (2.1) satisfy the local Lipschitz and linear growth condition in every domain bounded, and the process x(t) is regular, then the set {ω: x 1 (t,ω)=0} is inaccessible to any sample path of the process if ξ 1 0, where ξ= ( ξ 1 , ξ 2 ) T , so we get

lim inf t | x 1 ( t ) | =0.
(3.5)

Noting the similar definition of x ( t ) ˜ =x(t)G( x t ), obviously,

| x 1 ( t ) ˜ | ( | x 1 ( t ) | + | G 1 ( x t ) | ) ( | x 1 ( t ) | + κ x t 1 ) ,

and we get that

sup τ t < ( | x 1 ( t ) ˜ | ) sup τ t < [ ( 1 + κ ) | x 1 ( t ) | ] .

Therefore,

inf τ t < | x 1 ( t ) ˜ | inf τ t < (1+κ) | x 1 ( t ) | ,

and (3.4), we have

inf t > 0 | x 1 ( t ) ˜ | =0.
(3.6)

Similar to the proof of (3.5), we get

lim inf t | x 1 ( t ) ˜ | =0.
(3.7)

Combining this with condition (I) (V(t,x,i) μ 2 (| x 1 |)) and (3.7), we obtain

lim inf t V ( t , x ( t ) ˜ , r ( t ) ) =0.
(3.8)

Owing to (3.2), the limit

lim t V ( σ B t , x ( σ B t ) ˜ , r ( t ) ) = lim t V ( t , x ( t ) ˜ , r ( t ) ) =c
(3.9)

exists for almost all paths in Ω 1 . By (3.8) and (3.9), we have the limit of the above equation c=0, a.s., since the condition (I) ( μ 1 (| x 1 |)V(t,x,i)). For all the paths of Ω 1 , we can imply that

lim t | x 1 ( t ) ˜ | =0.
(3.10)

Moreover,

lim sup t | x 1 ( t ) ˜ | =0.
(3.11)

Noting the similar definition of x ( t ) ˜ =x(t)G( x t ), obviously,

| x 1 ( t ) | | x 1 ( t ) ˜ | + | G 1 ( x t ) | | x 1 ( t ) ˜ | +κ x t 1 ,

we get that

sup τ t < (1κ) | x 1 ( t ) | sup τ t < | x 1 ( t ) ˜ | .

By (3.11), then

lim sup t | x 1 ( t ) | =0.
(3.12)

Combining this with conditions (3.5) and (3.12) yields

lim t | x 1 ( t ) | =0.
(3.13)

So, we have obtained that the trivial solution of equation (2.1) is partial stochastic asymptotic stability with respect to x 1 with (3.3) and (3.13). □

4 Remarks

Remark 4.1 When G( x t )0, τ0 and r(t)0, equation (2.1) reduces to

dx(t)=f ( t , x ( t ) ) ds+g ( t , x ( t ) ) dB(t),t>0,
(4.1)

which has recently been studied in Ignatyev [23], that is to say, Theorem 3.1 of Ignatyev [23] has been generalized.

Remark 4.2 The operator LV of equation (4.1) of Theorem 3.1 (Sharov [21]) must be negative, but we can obtain the partial stochastic asymptotic stability of equation (2.1) under LV being non-positive (LV0), which makes the conditions of the solution more feasible to be satisfied.

5 Discussion of main results

Lyapunov methods have been developed to research the conditions of the partial asymptotic stochastic stability of neutral stochastic functional differential equations with Markovian switching. We have the non-positive Lyapunov operator and boundary condition to weaken the conditions of the previous theorems, but there is a small problem that the boundary condition of Theorem 3.2 is a stochastic domain. We will obtain the equivalent and practical results for the boundary condition in the future investigation.