1 Introduction

With the increasing development of microelectronics, wireless communication and computing, wireless sensor networks (WSNs) have been more widely used in such areas as robotics, surveillance, environment monitoring, information collection, and so on.

From a network-theoretic perspective, a WSN can be looked upon as a multi-agent system (MAS) with each node representing a sensor and each edge performing information exchange between sensors. In some cases, the agreement is a common value which may be the average of the initial states of the system, and which is often called average consensus and has wide application background in the areas such as formation control [1], distributed filtering [2] and distributed computation [3]. It means to achieve the accordance of the states of MAS. In [4], the authors considered the average consensus control for the directed and undirected networks with fixed and switching topologies. In [5], the authors extended the results of [4] to the discrete-time models and weakened the condition of instantaneous strong connectivity. In [6], the authors considered the distributed averaging consensus of the networks with fixed and undirected topologies.

In the real communication surroundings, the topology of the WSN will change among some modes along with the time. Due to the limited energy, the sensor nodes often switch the states between sleep and awake to save energy. So we make use of Markov switching topology to describe this situation. Zhang [7] designed a distributed consensus protocol to analyze the multi-agent systems in uncertain communication environments including the communication noises and Markov topology switches. The asymptotic unbiased mean square average consensus and asymptotic unbiased almost sure average consensus were obtained. Also they considered the effect of agent dependent gain functions on the consensus of multi-agent systems. Zhou et al. [8] studied the problem of the mode and delay-dependent adaptive exponential synchronization in p th moment for stochastic delayed neural networks with Markovian switching. By applying a novel nonnegative function and the M-matrix approach, several sufficient conditions to ensure the mode and delay dependent adaptive exponential synchronization in p th moment for stochastic delayed neural networks were derived. Zhou et al. [9] considered the problem of target synchronization for the WSNs with multiple time-varying delays, Markov switching topology and the stochastic disturbance. The communication topology graphs they studied in this paper were undirected.

In real networked control systems, the packet dropouts and channel delays usually arise in the communication among the sensor nodes. The situations can be modeled by the Markov chain with the assumption of completely known or incompletely known transition probabilities. Therefore, from control perspectives, it is important and necessary to discuss the systems with partly unknown transition probabilities. Zhang and Boukas [10] studied the stability and stabilization problems of a class of continuous-time and discrete-time Markovian jump linear systems with partly unknown transition probabilities. Zhang and Lam [11] considered the Markov jump linear system with incomplete transition descriptions and got the necessary and sufficient criteria in both continuous-time domain and discrete-time cases. Zhu et al. [12] discussed the asymptotic stability of nonlinear stochastic differential equations with Markovian switching. The transition jump rates matrix Γ is not precisely known for the equations.

Moreover, to study the average consensus for the WSNs with Markovian switching topology and stochastic noises, we take advantage of the p th moment exponential stability theory [13] which is widely applied to the system stability analysis [1416]. Specially, the case p=2 is the mean square exponential stability which is frequently used in different research works such as [1719]. In [19], the authors showed that a necessary and sufficient condition for asymptotically unbiased mean square average consensus is that the consensus gains satisfy the step rule similar to that of classical stochastic approximation.

Next, we introduce our main contributions. To the best of our knowledge, the method combining the Lyapunov function and the M-matrix is rarely used in the researching area of the average consensus in p th moment for WSNs with Markovian switching topology and stochastic noises. Also, the stochastic average consensus in the large for WSNs with Markovian switching topology, whose transition jump rates matrix is not precisely known, is rarely discussed. The present paper considers the consensus in p th moment for WSNs with Markovian switching topology and stochastic noises in communication. Making use of the p th moment exponential stability theory, we propose a sufficient condition of the p th moment exponential consensus for the WSNs. Different from [9], the communication topology graphs discussed are directed. We also consider the stochastic average consensus in the large for the WSN, whose transition jump rates matrix Γ is not precisely known.

The remainder of the paper is organized as follows. In Section 2, some concepts in graph theory are described, and the problem to be investigated is formulated. In Section 3, the main results are presented. In Section 4, two numerical examples show the reliability of the main results. In Section 5, some conclusions are given.

The following notations will be used throughout this paper : |x| represents the Euclidean norm of a vector x in R n , |A|:= trace ( A T A ) , i.e., the trace norm of a matrix A. ‘T’ represents the transpose of a matrix or a vector, I is an n×n dimensional identity matrix, 1 n is an n-dimensional column vector with all ones, E stands for the mathematical expectation operator. If A is a matrix, λ min (A) and λ max (A) denote the smallest and largest eigenvalues of A, respectively.

2 Problem formulation and preliminaries

2.1 Concepts in graph theory

Let G={V,E,A} be a weighted digraph, where V={1,2,,n} is the set of nodes, node i represents the i th sensor node, ℰ is the set of edges, and an edge in G is denoted by an ordered pair (j,i). (j,i)E if and only if the j th sensor node can send information to the i th sensor node directly. The neighborhood of the i th sensor node is denoted by N i ={jV|(j,i)E}.

A=[ a i j ] R n × n is called the weighted adjacency matrix of G. For any i,jV, a i j 0, and a i j >0j N i . deg i n (i)= j = 1 n a i j is called the in-degree of i; deg o u t (i)= j = 1 n a i j is called the out-degree of i; L=DA is called the Laplacian matrix of G, where D=diag( deg i n (1),, deg i n (n)).

2.2 Average consensus for WSNs

In this paper, we study the average consensus control for a WSN with dynamics

x ˙ i (t)= u i (t),
(1)

where x i (t)R is the state of the i th sensor, and u i (t)R is the control input. The initial state x i (0) is deterministic.

The i th sensor can receive information from its neighbors

y j i (t)= x j (t)+ σ j i ( x i ( t ) , t ) ω j i (t),
(2)

where y j i (t) denotes the measurement of the j th sensor’s state x j (t) by the i th sensors, { ω j i (t)|i,j=1,2,,n} are the communication noises, σ j i ( x i (t),t) is the noise intensity function.

Denote X(t)= ( x 1 ( t ) , x 2 ( t ) , , x n ( t ) ) T , (G,X) is called a dynamic network.

For the dynamic network (G,X), we use the distributed protocol

u i (t)= j N i a i j (t) ( y j i ( t ) x i ( t ) ) .
(3)

Substituting protocol (3) into system (1) leads to

dX(t)=L(t)X(t)dt+G ( X ( t ) , t ) dW(t),
(4)

where L(t) is the Laplacian matrix of G, G(X(t),t) is the noise intensity matrix, W(t)= ( W 1 ( t ) , , W n ( t ) ) T is an n-dimensional Brownian motion.

In WSNs, each sensor node communicates with other sensor nodes through the unreliable networks. If the communication channel between sensors i and j is (j,i) E f , E f is the set of the communication channel which probably lost the signal, then the time-varying topologies under link failure or creation can be described by Markov switching topology.

Let {r ( t ) t 0 } be a right-continuous Markovian chain on the probability space taking values in a finite state set S={1,2,,N} with generator Γ= ( γ i j ) N × N given by

P { r ( t + Δ ) = j | r ( t ) = i } = { γ i j Δ + o ( Δ ) if  i j , 1 + γ i i Δ + o ( Δ ) if  i = j ,
(5)

where Δ>0 and γ i j 0 is the transition rate from i to j if ij while

γ i i = j i γ i j

and r(0)= r 0 .

We denote the directed communication graph by G={G(1),G(2),,G(N)}, where G(k)={V, E G ( k ) , A G ( k ) } is the weighted digraph. Denote the topology graph as G t at moment t (t0), so r(t)=k if and only if G t =G(k).

Under Markovian switching topology, we have

dX(t)=L ( r ( t ) ) X(t)dt+G ( X ( t ) , r ( t ) ) dW(t).
(6)

Next, we consider the average consensus control protocol for system (6) as follows:

dδ(t)=L ( r ( t ) ) δ(t)dt+(IJ)G ( δ ( t ) , r ( t ) ) dW(t),
(7)

where δ(t)=X(t)JX(t), J= 1 n 1 n 1 n T .

If we define

f(δ,t,i)=L ( r ( t ) ) δ(t),g(δ,t,i)=(IJ)G ( δ ( t ) , r ( t ) ) ,
(8)

then (7) becomes

dδ(t)=f(δ,t,i)dt+g(δ,t,i)dW(t).
(9)

Definition 1 Dynamic system (6) is said to be average consensus in p th moment if error system (7) satisfies that lim sup t E|δ(t) | p =0. If p=2, we called it reach mean-square average consensus.

Definition 2 Dynamic system (6) is said to reach stochastic average consensus in the large if error system (7) is stochastic stable and, moreover,

P { lim t δ ( t ; t 0 , δ 0 , i ) = 0 } =1.

To get the main results, we need the following assumptions.

  • (A1) G is a balanced digraph;

  • (A2) The union of {G(i)|iS} contains a spanning tree.

  • (A3) There exists a positive constant H such that the noise intensity matrix g(,,) satisfies

    trace ( g T ( δ , t , i ) g ( δ , t , i ) ) H|δ(t) | 2 .

To this end, we introduce some concepts and lemmas which will be used in the proofs of our main results.

Consider an n-dimensional stochastic differential equation with Markovian switching

dx(t)= f ˜ ( x ( t ) , r t , t ) dt+ g ˜ ( x ( t ) , r t , t ) dW(t)
(10)

on t[0,) with the initial data x( t 0 )= x 0 L L 0 p (Ω; R n ) and r( t 0 )= r 0 .

For V C 2 , 1 ( R n ×S× R + ; R + ), define an operator ℒ from R n ×S× R + to R by

L V ( x ( t ) , i , t ) = V t ( x ( t ) , i , t ) + V x ( x ( t ) , i , t ) f ˜ ( x ( t ) , i , t ) + 1 2 trace ( g ˜ T ( x ( t ) , i , t ) V x x ( x ( t ) i , t ) g ˜ ( x ( t ) , i , t ) ) + j = 1 N γ i j V ( x ( t ) , j , t ) ,

where

V t ( x ( t ) , i , t ) = V ( x ( t ) , i , t ) t , V x ( x ( t ) , i , t ) = ( V ( x ( t ) , i , t ) x 1 , V ( x ( t ) , i , t ) x 2 , , V ( x ( t ) , i , t ) x n ) , V x x ( x ( t ) , i , t ) = ( 2 V ( x ( t ) , i , t ) x j x k ) n × n .

Lemma 1 [13]

Let V C 2 , 1 ( R n × R + ×S, R + ) and τ 1 , τ 2 be bounded stopping times such that 0 τ 1 τ 2 a.s. If V(x(t),t,r(t)) and LV(x(t),t,r(t)) etc., are bounded on t[ τ 1 , τ 2 ] with probability 1, then

E V ( τ 2 , r ( τ 2 ) , x ( τ 2 ) ) = E V ( τ 1 , r ( τ 1 ) , x ( τ 1 ) ) + E τ 1 τ 2 L V ( s , r ( s ) , x ( s ) ) d s .
(11)

Lemma 2 [20]

Let N r (t) be the number of switches on the interval ( t 0 ,t], then we have

P ( N r ( t ) = k ) e q ˜ t ( q ¯ t ) k k ! ,kN,

where q ˜ =max{ γ i j :i,jS}, q ¯ =max{| γ i i |:iS}.

Definition 3 [21]

A square matrix M= ( m i j ) n × n is called a nonsingular M-matrix if M can be expressed in the form of M=s I n G with some G0 (i.e., each element of G is nonnegative) and s>ρ(G), where ρ(G) is the spectral radius of G.

Lemma 3 [13]

If M= ( m i j ) n × n R n × n with m i j <0 (ij), then the following statements are equivalent:

  1. (1)

    M is a nonsingular M-matrix;

  2. (2)

    Every real eigenvalue of M is positive;

  3. (3)

    M is positive stable. That is, M 1 exists and M 1 >0 (i.e., M 1 0 and at least one element of M 1 is positive).

Lemma 4 [13] (Young inequality)

Let a,bR and β[0,1]. Then

|a | β |b | ( 1 β ) β|a|+(1β)|b|.

Lemma 5 [13] (Gronwall inequality)

Let T>0 and u() be a Borel measurable bounder nonnegative function on [0,T]. If

u(t)α(t)+ 0 t βu(s)ds,0tT

for the non-decreasing function α(t) and the constant β, then

u(t)α(t)exp(βt),0tT.

3 Main results

In this section, we give criteria of average consensus for system (6).

3.1 Average consensus in p th moment for the WSNs

Theorem 1 Assume that there is a function V(t,i,δ) C 2 , 1 ( R + ×S× R n ; R + ) and positive constants p, c 1 , c 2 , λ and η such that

c 1 |δ | p V(t,i,δ) c 2 |δ | p ,
(12)
LV(t,i,δ)λ|δ | p +η
(13)

for all t0. iS and δ R n . Then (7) is exponential stable in pth moment.

Proof For the function V(t,i,δ), applying Lemma 1 and using the above conditions, we obtain that

c 1 E | δ | p E V ( 0 , r 0 , ξ ( 0 ) ) + E 0 t L V ( s , r ( s ) , δ ( s ) ) d s E V ( 0 , r 0 , ξ ( 0 ) ) + E 0 t ( λ | δ | p + η ) d s .
(14)

So,

E | δ | p E V ( 0 , r 0 , ξ ( 0 ) ) c 1 + 0 t λ E | δ | p + η c 1 d s c ( t ) + 0 t v E | δ | p d s ,
(15)

where

c ( t ) = E V ( 0 , r 0 , ξ ( 0 ) ) + η t c 1 , v = λ c 1 .

It can be seen that c(t)>0 and v<0. By using Gronwall’s inequality, we have

E|δ | p c(t)exp(vt).

Therefore

lim sup t 1 t log ( E | δ ( t , ξ ) | p ) v<0.

Thus (7) is exponential stable in p th moment. This completes the proof. □

Now we give a criterion of average consensus in p th moment for system (6).

Theorem 2 Assume that for each iS, there is a pair of real numbers α>0 and β i such that

δ T f(δ,t,i)+ p 1 2 |g(δ,t,i) | 2 α+ β i |δ | 2

for all (δ,t) R n × R + , where p2.

Assume also that

M:=diag(p β 1 ,,p β N )Γ

is a nonsingular M-matrix, in this case,

( q 1 , , q n ) T := M 1 1 0,

where 1 = ( 1 , , 1 ) T . Then system (6) reaches average consensus in p th moment.

Proof We can see that

δ T f ( δ , t , i ) + p 1 2 | g ( δ , t , i ) | 2 = δ T L i δ + p 1 2 | ( I J ) G i | 2 ( p 1 2 | ( I J ) | 2 H λ min ( L i ) ) | δ | 2 α + β i | δ | 2 ,

where α R + and β i = p 1 2 |(IJ) | 2 H λ min ( L i ).

Define the function V: R + ×S× R n R + by

V(δ,t,i)= q i |δ | p .
(16)

Clearly, V obeys Theorem 1 with c 1 = min i S q i and c 2 = max i S q i , and c 1 |δ | p V(δ,t,i) c 2 |δ | p .

We compute the operator LV as follows:

L V ( δ , t , i ) = p q i | δ | p 2 δ T f ( δ , t , i ) + 1 2 p q i | δ | p 2 | g ( δ , t , i ) | 2 + 1 2 p ( p 2 ) q i | δ | p 4 | δ T g ( δ , t , i ) | 2 + j = 1 N γ i j q j | δ | p = p q i | δ | p 2 ( δ T f + p 1 2 | g | 2 ) + j = 1 N γ i j q j | δ | p p q i | δ | p 2 ( β i | δ | 2 + α ) + j = 1 N γ i j q j | δ | p ( p β i q i + j = 1 N γ i j q j ) | δ | p + α p q i | δ | p 2 = | δ | p + α p q i | δ | p 2 .
(17)

By Young’s inequality,

α p q i | δ | p 2 = α p q i 2 ( p 2 ) / p ( 1 2 | δ | p ) ( p 2 ) / p = [ ( α p q i ) p / 2 2 ( p 2 ) / 2 ] 2 / p ( 1 2 | δ | p ) ( p 2 ) / p 2 p ( α p q i ) p / 2 2 ( p 2 ) / 2 + ( p 2 ) 2 p | δ | p .
(18)

Substituting this into (17) gives

LV(t,i,δ) p + 1 p |δ | p + 2 p ( α p q i ) p / 2 2 ( p 2 ) / 2 .
(19)

Let

λ = p + 1 p , η = max i S [ 2 p ( α p q i ) p / 2 2 ( p 2 ) / 2 ] = 2 p ( α p c 2 ) p / 2 2 ( p 2 ) / 2 .

We can see that λ, η are constants, so by Theorem 1,

lim sup t 1 t log ( E | δ ( t , i , ξ ) | p ) v<0.

It means that

lim sup t E|δ(t,i,ξ) | p exp(vt) t 0.

So system (6) reaches the average consensus in p th moment. This completes the proof. □

Remark 1 In Theorem 2, we can easily check the condition obtained by using the new method if the dynamic system is given and the positive constant m is well chosen. To the best of our knowledge, the method combining the Lyapunov function and the M-matrix in this paper is rarely used in the researching area of the average consensus in p th moment for WSNs with Markovian switching topology and stochastic noises.

Corollary 1 If the functions f, g satisfy

δ T f k ( α + β i | δ | 2 ) , p 1 2 | g | 2 ( 1 k ) ( α + β i | δ | 2 ) ,

where 0<k<1, kR, then we get

δ T f(δ,t,i)+ p 1 2 |g(δ,t,i) | 2 α+ β i |δ | 2 .

Following Theorem  2, system (6) reaches consensus in pth moment.

3.2 The stochastic average consensus in the large for the WSNs under Γ is not precisely known

In the real communication networks, the part of the elements in the desired transition probabilities matrix are difficult to obtain. Therefore, it is important and necessary, from control perspectives, to further study the WSNs with partly unknown transition probabilities.

Consequently, in this part, we consider stochastic average consensus in the large for the system, even though the transition jump rates matrix Γ= ( γ i j ) N × N is not precisely known.

Theorem 3 Assume that there exist functions V C 2 ( R n ×S; R + ), positive constants α 1 , α 2 and for each iS, there exist a real number λ>0 and symmetric positive-definite matrices P i such that

  1. (i)
    α 1 |δ(t) | 2 V(δ,i) α 2 |δ(t) | 2 ,iS;
    (20)
  2. (ii)
    2 δ T P i f(δ,i)+trace ( g T ( δ , i ) P i g ( δ , i ) ) λ|δ | 2 ;
    (21)
  3. (iii)
    V(δ,i) α 2 α 1 V(δ,j),i,jS;
    (22)
  4. (iv)
    1< α 2 α 1 < λ + q ˜ q ¯ ,
    (23)

then the system reaches stochastic average consensus in the large.

Proof Define V(δ,i)= δ T P i δ for all iS. Let α 1 =min{ λ min ( P i ):iS}, α 2 =max{ λ max ( P i ):iS}. Obviously,

α 1 |δ(t) | 2 V(δ,i) α 2 |δ(t) | 2 .

Also we can see that

L ˜ V ( δ , i ) = 2 δ T P i f ( δ , i ) + trace ( g T ( δ , i ) P i g ( δ , i ) ) = 2 δ T P i L i δ + trace ( g T ( δ , i ) P i g ( δ , i ) ) 2 λ max ( P i ) λ min ( L i ) | δ | 2 + H λ max ( P i ) | δ | 2 = ( 2 λ min ( L i ) + H ) λ max ( P i ) | δ | 2 .

Let λ i =(2 λ min ( L i )+H) λ max ( P i ) and λ=min{ λ i :iS}, we have L ˜ V(δ,i)< λ i V(δ,i)<λV(δ,i).

On the other hand,

V(δ,i) α 2 α 1 V(δ,j),i,jS.

Obviously, 1<u= α 2 α 1 =max{ λ max ( P i ) λ min ( P j ) :i,jS}< λ + q ˜ q ¯ .

Consequently, according to Theorem 3.1 in [12], it is obtained that error system (7) is stochastic stable and

P { lim t δ ( t ; t 0 , δ 0 , i ) = 0 } =1.

It means that system (6) reaches stochastic average consensus in the large. This completes the proof. □

Remark 2 In contrast with the case that the transition probabilities of the underlying Markov chain are assumed to be completely known, the circumstance that transition jump rates matrix Γ is not precisely known for the equation (7) is more general in the real control systems.

Remark 3 There are several disadvantages associated with the result derived in Theorem 3. (1) Hypothesis (22), it may reduce the set of systems to which the results in this section can be used. (2) The constructive method for choosing the best Lyapunov functions is currently unknown.

4 Numerical examples

In this section, we give two examples to examine the average consensus of system (6).

Consider a WSN composed of three sensors in which each dynamic state of the sensor is x ˙ i = u i , where i=1,2,3 (see the topologies in Figure 1), the initial state is X(0)= ( 3 , 2 , 4 ) T , the switching topology of the three sensors is determined by the Markov chain r(t) whose state space is S={1,2,3}. The related topology graph is G(i)={V(i),E(i),A(i)}, the adjacent matrices are:

A(1)= ( 0 1 0 1 0 0 0 0 0 ) ,
(24)
A(2)= ( 0 0 0 0 0 1 0 1 0 ) ,A(3)= ( 0 0.5 0 1 0 0 0 0.5 0 ) .
(25)
Figure 1
figure 1

The topologies of the WSN in states 1, 2, 3.

The related Laplacian matrices are:

L(1)= ( 1 1 0 1 1 0 0 0 0 ) ,
(26)
L(2)= ( 0 0 0 0 1 1 0 1 1 ) ,L(3)= ( 0.5 0.5 0 1 1 0 0 0.5 0.5 ) .
(27)

Example 1 Suppose that the Markovian transition matrix is

Γ= ( 2 1 1 1 2 1 1 1 2 ) .
(28)

We let p=5, α=2.1|δ | 2 , β i =1, k= 1 2 , |g|=0.15|δ|, it can be checked that assumptions (A1), (A2), and the conditions of Corollary 1 are satisfied and the matrix M is a nonsingular M-matrix. So the WSN reaches average consensus by Corollary 1.

We can draw the dynamic curve of the states of the sensors by Matlab as Figure 2. It shows us that the three sensor nodes reach the average consensus in 5th moment.

Figure 2
figure 2

The trajectories of the state vectors x 1 (t) , x 2 (t) , x 3 (t) .

Example 2 Suppose that the Markovian transition matrix with partly unknown jump rates is

Γ= ( a b 0 1 2 1 0 1 1 ) ,
(29)

where a,b>0 denotes the unknown transition jump rates subject to a2, b1, respectively. We can see that q ˜ =2, q ¯ =1.

Letting |g|=0.25|δ| and according to Theorem 3, we can draw the dynamic curve of the states of the sensors by Matlab as Figure 3. It shows us that the three sensor nodes reach stochastic average consensus in the large.

Figure 3
figure 3

The trajectories of the state vectors x 1 (t) , x 2 (t) , x 3 (t) .

5 Conclusions

In this paper, we have dealt with the problem of average consensus in p th moment of the WSNs. By using the Lyapunov function and the M-matrix approach, we have obtained several sufficient conditions to ensure the average consensus in p th moment for WSNs with Markovian switching topology. Also, a sufficient condition for the stochastic average consensus in the large for the WSNs with partly known transition jump rates matrix Γ is derived. There are many other topics such as the time-delay cases and the adaptive control of the WSN’s consensus in p th moment, etc. worth investigating.