Fractional Order Estimation Schemes for Fractional and Integer Order Systems with Constant and Variable Fractional Order Colored Noise

The paper presents estimation schemes for discrete fractional and integer order state-space systems with fractional order colored noise. The fractional order colored noise is a generalization of the traditional colored noise (noise with dynamic dependency) for the case when the dynamics of noise is of fractional order. Proposed estimation algorithm additionally uses information about noise dynamics, which allows for obtaining better estimates of state vector. The numerical experiments of estimation integer order system with fractional noise are presented as well.


Introduction
Fractional calculus is a generalization of traditional integer order integration and differentiation actions onto non-integer order fundamental operator. The idea of such a generalization has been mentioned in 1695 by Leibniz and L'Hospital. At the end of 19th century, Liouville and Riemann introduced the first definition of fractional derivative. Theoretical background of fractional calculus can be found in [8,17,20,23,24]. This calculus was found to be a very useful tool for modelling the behavior of many materials and systems, especially those based on diffusion processes. One of devices that can be modeled more efficiently by fractional calculus are ultracapacitors. Models of these electronic storage devices, whose capacity can be even thousands of Farads, based on fractional order models were presented in [13,14]. Another process that can be successfully modeled using fractional calculus methods is heat transfer process in both homogeneous and non-homogeneous media. Experimental results were presented in [12,33].
The generalization of the Kalman Filter (KF) for Discrete Fractional Order Systems with stochastic disturbances was introduced in [29]. More advanced algorithms including case where measurements are obtained using a transmission network that introduces packet losses were presented in [32]. The paper [32] presents also an algorithm for joining estimation and smoothing action. A generalization of this algorithm based on Unscented Transformation was presented in [7]. A similar algorithm to the one presented in [29], that includes sampling time, is presented in [2]. Moreover, in [1] the generalization of such an algorithm for continuous time fractional order system is given.
The Fractional Kalman filter (FKF) algorithm has been used for estimation of unknown state variables in the system with ultracapacitor [11,14], or in a chaotic secure communication scheme [15]. Similar algorithm to FKF was also used in [4] for R-wave detection in electrocardiogram signal. Moreover, Fractional Kalman-like algorithm also has been used to improve measurement results from MEMS sensors [22]. One of the most interesting and useful generalizations of the KF algorithm is the one for the case, where the noise is dynamically correlated [6]. A such noise for an integer order case is called the colored noise. When the correlated dynamics is fractional, one can obtain noises of type of Fractional Brownian Motion, Fractional Noise, or in general Fractional Colored Noise [3,5,24]. A very good example of the fractional noise is a temperature noise. As it was presented in [30], the dynamics between the source heat flux and temperature in beam heating process is of fractional order type. In case when source heat flux is a white noise without correlated dynamics, the temperature will be a noise with fractional order dynamics. Also a pink noise, used in signal processing, is an example of fractional order colored noise. Based on the additional knowledge about type of the noise, it is possible to construct more accurate filtering and estimation algorithms.
In this paper, a generalization of Fractional Kalman Filter for fractional and integer order systems with fractional colored noises is presented. The article presents also numerical result that confirms better accuracy of proposed algorithms. Moreover, numerical results demonstrate a robustness analysis for parameters and order disturbances. It also introduced discrete fractional variable order noise and estimation algorithm for fractional variable order system and fractional variable order noise.
The paper is organized as follows. Section 2 contains a short introduction to the discrete fractional order state-space systems. Section 3 gives a generalization of colored noise to the fractional colored noise (the noise with fractional dynamical correlation). Next, Sect. 4 presents the main results of the paper, the FKF for fractional and integer order systems with fractional colored noises. Section 5 presents a generalization of the proposed algorithm for a case when the fractional order of noise or system is changing in time (variable order case). Finally, Sect. 6 presents the results of numerical experiments conducted using the proposed algorithms.

Basics of Discrete Fractional Calculus
In this paper, we will use the following definition of fractional difference [17,20]: The fractional order difference is given by the following equation where x k ∈ R is a signal applied to the difference process, n ∈ R is an order of the fractional difference, R is the set of real numbers, k ∈ Z + is a number of the sample for which the difference is calculated. The factor n j is given by: According to this definition, it is possible to obtain the discrete equivalent of derivative (when n is positive), the discrete equivalent of integration (when n is negative) or when n is equal to 0, the original function.
Remark 1 In ideal case, the fractional order difference is a weighted sum of the current and all previous samples. In practical implementation, the number of samples has to be limited to some predefined value N buff . In this case, the definition of fractional order difference has the following form: In all simulations included in this paper, the N buff was chosen in order to cover the whole time of simulation.
The Discrete Fractional Order State-Space System for the case when orders of equations are not identical, is given as follows:

Definition 2
The generalized discrete linear fractional order system with stochastic disturbances in a state-space representation is given by the following equations where m is a number of outputs and p is a number of inputs. Moreover, and n 1 , . . . , n N are the orders of system equations and N is the number of these equations.
Remark 2 Sometimes x k is also called pseudo-state [34], because the update x k+1 is obtained on the basis of the all past vectors x k− j . In this paper, for simplicity, we will call it shortly state, similar to the situation in the state-space system with delays in the state. It is due to the fact that discrete fractional order system can be interpreted as an infinite state delay system with strictly defined delay matrices.
The system properties such as observability and controllability given by Eqs. (3),(4) and (5) are discussed in [9]. The stability conditions for the commensurate case were introduced in [10]. The estimation algorithms were presented in [29], [32]. Numerical implementation of some discrete fractional order algorithms is included in the FSST Toolkit [27].

Fractional Order Colored Noise
The integer order time-correlated (colored) noise is given by the following relation: where μ k ∈ R is a time-correlated noise, f ∈ R is parameter of this noise, and ω k ∈ R is an uncorrelated noise, for example, white Gaussian noise. This can be rewritten in the difference form: where f = f − 1. This relation can be generalized onto a fractional order time-correlated noise. The colored fractional order noise is given as follows: where in this, case μ k is a fractional colored noise, α is an order of the noise and ω k is an uncorrelated noise. This equation is a discrete equivalent of fractional differential equation witch describe dynamics of the correlated noise. For a fractional or integer order discrete system in state-space description with fractional order colored noise, the Fractional Kalman Filter algorithm is given in this paper.

Remark 5
If the α is a vector, then each noise may be of different orders.

Remark 6
When μ k is a vector and there in no autocorrelation between particular noises, f becomes a diagonal matrix F.

Numerical Results
The original noise has the Gaussian distribution with variance equal to 1. Fractional order noise with variance equal to 2.42 is given by the equation: Figure 1 presents the Gaussian noise and fractional order noise. Fractional order was α = 0.5. Figures 2 and 3 present the chosen results of comparison of correlation between original noise and fractional noise, where N buff was equal to 1,500 for simulation obtained with the FSST Toolkit [27]. As it is shown, the autocorrelation function, in these cases, strongly depends on the noise order. This can be easily noticed taking into account that, for different orders different coefficients in fractional order definition are obtained. Moreover, coefficients for fractional order cases are significantly different those for integer order case, and such a dynamics can not be obtained for integer order noise.
Autocorrelation equation is given by

Fractional Kalman Filter for Systems with Fractional Colored Noise
The Fractional Kalman Filter for systems with independent noise (also dynamically independent) was introduced in [29] and has a following form:

Theorem 1 [29] For the discrete fractional order stochastic system in the state-space representation introduced by the Definition 2 the simplified Kalman Filter (called Fractional Kalman Filter) is given by the set of following equations
where with initial conditions and ν k and ω k are assumed to be independent and with zero expected value.
Let us assume the system given by the Definition 2 and fractional colored system noise. In this case, system equation has the following form: with the fractional colored noise given by the following equation: where ω k is a dynamically independent noise, and Λ is defined as follows: This system can be rewritten as follows: where For a system defined in this way, the equations of Fractional Kalman Filter are the same as in Theorem 1 with the following matrices of system variances: The ω k noise is usually with lower variance than noise μ k .

The Case of Integer Order System with Fractional Order Noise
The integer order system equation is it can be rewritten in the form of fractional order system In this case, the Eqs. (18), (19) and (20) are the same with the following matrices: and parameters matrices for Fractional Kalman Filter given in the same way to the fractional order system case.

Variable Order Case
The case when the order is changing in time recently is intensively developed. In [26], experimental studies of an electrochemical example of physical fractional variable order system are presented. In [21], the variable order equations were used to describe a history of drag expression. Papers [26,35] present methods for numerical realization of fractional variable order integrators or differentiators. The fractional variable order calculus can be also used to obtain variable order fractional noise [25], and to obtain new control algorithms [19]. Some properties of such systems are presented in [18]. In [31], the variable order interpretation of the analog realization of fractional orders integrators, realized as domino ladders, was presented. The applications of variable order derivatives and integrals can also be found in signal processing [24].
In the literature [16,36], three general types of variable order derivative definitions can be found, however, in this paper, the only one (first) definition of the generalization of fractional order difference for variable in time order will be used.

Definition 3
The fractional variable order difference is given by the following equation where α k ∈ R is an order of the fractional difference, which depends on discrete time, R is the set of real numbers and k is a number of the sample for which the derivative is calculated.

Definition 4 The linear Discrete Stochastic Fractional Variable
Order System in Statespace representation is given as follows: where where α i,k ∈ R are time dependent (variable) orders of system equations (where i is a number of state variable and k is a time of the order) and N is the number of these equations.
Basic properties for variable order DFOSS are presented in [28].
For a system defined in such a way that the Fractional Kalman filter for correlated noises is generalized as follows: Theorem 2 For the discrete fractional order stochastic system in a state-space representation given by the Definition 4 the simplified Kalman Filter(called VOFKF) is given by the set of following equations where with initial conditions and ν k and ω k are assumed to be independent and with zero expected value.

Fractional Variable Order Colored Noise and Its Estimation
The colored fractional order noise is given as follows where in this case μ k is a fractional variable order colored noise, α k is a variable order of the noise, and ω k is an uncorrelated noise. For a variable order case the system with fractional (possible) variable order noise is given by with the fractional colored noise given by This can be rewritten in the same way as in the constant order case: where For a system, defined in such a way, the equations of Fractional Kalman Filter are the same as presented in Theorem 2.

Numerical Results
Results of numerical experiments, presented in this section, were obtained in Matlab/Simulink environment using the FSST Toolkit [27].

Estimation of Fractional Order Systems
The numerical results were obtained for a fractional order system with fractional order colored noise for different values of fractional order of noise, for realization length (given by Remark 1) N buff = 1,000. The fractional order system has the following matrices: This system can be interpreted as discrete equivalence of fractional order inertial system. However, this system is quite simple, it will allow us to prepare a set of clear and valuable experiments. The fractional colored system noise is given by the following equation In this case, parameter f is equal to (−0.4 − α) and order of the colored fractional noise is equal to α. The variance value of original uncorrelated noise ω k is chosen to 1.06, the variance of colored noise depends on order α. The measurement noise is a Tables 1 and 2 present the results of the comparison of a proposed algorithm that included knowledge about dynamical correlation with the traditional Fractional Kalman Filter without this knowledge. The parameters of Fractional Kalman Filter for a system with fractional colored noise are: The parameters of the Fractional Kalman Filter without using knowledge about dynamical correlation are: where w(α) is the variance of the system noise ω k .
The results of numerical simulations are presented in Tables 1 and 2, where var FKF is the variance of the estimation error obtained by FKF algorithm for uncorrelated noises, and var cFKF is the variance of the estimation error obtained by proposed FKF algorithm for correlated noises, δ imp is improvement in variance and given as: As it could be seen from Tables 1 and 2, the proposed algorithm based on Fractional Kalman Filter, in all cases, is more accurate than the traditional Kalman Filter. It is also worth noticing that the variance of fractional colored noise strongly depends on the order of that noise.

Robustness Analysis for Parameter Perturbation
In this section, we will assume the situation that the estimation algorithm is based on the model with an additional parameter. This situation could happen when the model used for designed estimation algorithm contains perturbation in parameter.
The results of this analysis are presented in Tables 3 and 4, where δ A is additional parameter in matrix A, in the proposed filter: Value of the δ impA is calculated like as δ imp in previous section, but when the δ A parameter is equal to (−0.1, −0.05, 0.05, 0.1).
Moreover, δ diff is difference between improvement when the parameter is changing and calculated improvement with original A matrix: Table 3 Robustness results of fractional order system for negative orders of fractional system noise  Table 4 Robustness results of fractional order system for positive orders of fractional system noise

Robustness Analysis for Order Perturbation
In this section, we will assume the situation that the estimation algorithm based on the model with not accurate order. This situation could happen when the model used for designed estimation algorithm contains an error in the system order. The result of this analysis is presented in Table 5, where δ A is simulated perturbation in noise order, applied to estimation algorithm (martix Υ ).
The value of δ imp is calculated in the same way, as in Sect. 6.1. Differences in variance improvement for cases of perturbed filter order are not significant, despite of integer order case. This confirms the robustness of the proposed algorithm for order perturbation. The increase of improvement for negative perturbations does not seem to be a general rule, just the result of this particular case.

Estimation of Integer Order System
Let us consider the traditional discrete integer order system with fractional colored system noise ω k The fractional colored system noise is defined in the same way as in the previous experiment and given by the following equation The variance value of original uncorrelated noise ω k is chosen the same as for fractional order system, and was equal to 1.06, and the measurement noise is uncorrelated dynamically noise with variance equal to 4.
For a system defined in such a way, we can write system equations in a difference form (discrete fractional order) Tables 6 and 7 present the results of the comparison of the proposed algorithm with knowledge about dynamical correlation to the traditional Fractional Kalman Filter The parameters of the Fractional Kalman Filter without using knowledge about dynamical correlation are As it could be seen from Tables 6 and 7, the proposed algorithm based on Fractional Kalman Filter, in all cases, is more accurate than the traditional Kalman Filter. What is also worth noticing, the proposed algorithm is especially accurate when the variance of the fractional order noise is bigger than the variance of the original uncorrelated noise. The Fig. 4 presents chosen results of the estimation error for the proposed algorithm and the traditional Kalman Filter for the case of the integer order system with fractional colored noise with order equal to α = −0.5. The variance of the fractional colored noise is equal to 2.4 (which is more than the variance of original uncorrelated dynamical noise that was equal to 1.06.

Estimation of the Integer Order System with Variable Fractional Order Noise
In order to better present the behavior of the variable order noise, the constant integer order system will be taken into consideration in this example. The integer order system in the form of Definition 2, has the following matrices: The variable order fractional colored system noise is given by The variable order of the colored fractional noise is given by the following relation α k = 0.5 + 0.2 sin(0.006k   In Table 8 results of the integer order system with variable order noise estimation are presented. Moreover, results obtained by fractional variable order Kalman filter for correlated noise (cVOFKF) were compared with the results of variable order fractional order Kalman filter (VOFKF) and with the constant order fractional Kalman filter for correlated noise (cFKF). The order of cFKF algorithm was constant and equal to 0.5, which was an average value of variable system order. As it could be seen, proposed cVOFKF algorithm is the most accurate. What is also worth noticing, cFKF algorithm is also more accurate than VOFKF, but improvement is not significant. This can lead to conclusions, that variable order noise cannot be successfully approximate by constant order noise. Figures 5, 6, 7, 8, and 9 show a more advanced analysis of the fractional variable order noise itself. Figure 5 presents the original noise, the variable order fractional noise and a variable order. It is worth noticing that the variance of the variable fractional noise, in this case equal to 3.97, is higher than the variance of the original uncorrelated noise (equal to 1.0498). It is also worth mentioning that the variable order makes the noise nonstationary and the variance of the noise is changing with the order. Figure 6 presents the autocorrelation of fractional noise and original noise.  In Fig. 7, as it could be seen for interval (200, 400), when order is close to 0.7, high values of autocorrelation in time were obtained. However, for interval (600, 800), when the order is close to 0, values of time autocorrelation are high only for a very short time shifting and for the rest they are close to zero.
It is because the fractional order discrete state-space system for order 0 can be rewritten as the first order integer system. This implies that for order 0 fractional order noise stays the colored noise, with time dependency restricted only to one past sample. The interval (0,1,000) contains one whole cycle of order changing and is more regular and confirms very wide dynamical correlation in noise. In Figs. 8, 9 the time autocorrelation for system output is presented. As it can be seen, the autocorrelation has a similar character to the character of the fractional noise. Thus, we can consider the fractional noise as the only source of complicated time dependencies in the output signal. It is because the system is an integer order system.

Conclusions
In this paper, a generalization of the discrete fractional order colored noise was presented, and the algorithms based on Fractional Kalman Filter for fractional and integer order systems with such fractional colored system noises were introduced. Algorithm was also generalized for the case of variable fractional order noises and systems. Finally, the results of numerical experiments were presented. The numerical results confirm the efficiency of the introduced algorithm. It was observed that the proposed algorithm is especially accurate when the variance of the fractional order noise is bigger than the variance of the original uncorrelated noise. An especially interesting conclusion is that it is possible and reasonable to use the fractional order estimation algorithm for integer order system. The required integer order system with fractional order noise can be observed in many systems in biology, electronics, or heat transfer systems. For example, simple electronic or mechanical system with thermal sensors. These sensors will introduce fractional order noise into the system successfully modeled by integer order differential equations. Estimation algorithms introduced in this paper can also be easily extended onto non-linear systems. In our research, the linear system was considered only because of the fact that it provides a better way to show the comparisons among the results obtained.