Abstract
We present a novel and general methodology for modeling time-varying vector autoregressive processes which are widely used in many areas such as modeling of chemical processes, mobile communication channels and biomedical signals. In the literature, most work utilize multivariate Gaussian models for the mentioned applications, mainly due to the lack of efficient analytical tools for modeling with non-Gaussian distributions. In this paper, we propose a particle filtering approach which can model non-Gaussian autoregressive processes having cross-correlations among them. Moreover, time-varying parameters of the process can be modeled as the most general case by using this sequential Bayesian estimation method. Simulation results justify the performance of the proposed technique, which potentially can model also Gaussian processes as a sub-case.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Abbreviations
- d:
-
Dimension of the vector autoregressive process
- E t :
-
Index of performance in modified recursive least squares
- f t :
-
Process function
- h t :
-
Measurement function
- K:
-
Order of the vector autoregressive process
- m η :
-
Mean vector of normally distributed parameter η
- v t :
-
Process noise vector
- \({\tilde {w}_t^{(i)}}\) :
-
The normalized importance weight of the ith particle at time t
- W t :
-
Matrix containing delayed augmented measurement matrices in modified recursive least squares
- x t :
-
State variable vector at time t
- \({{\bf x}_{0:t}^{(i)}}\) :
-
Vector of ith particle from initial time up to time t
- X K,t :
-
Kth vector autoregressive coefficient matrix at time t
- y t :
-
Measurement vector (vector autoregressive process)
- Y t :
-
Augmented measurement matrix
- Z t :
-
Error matrix in modified recursive least squares
- p(.):
-
Probability density function (p.d.f)
- q(.):
-
Importance function
- η t :
-
Measurement noise vector
- Θ :
-
Parameter matrix in modified recursive least squares
- ξ:
-
Forgetting factor
- Σ ηt :
-
Time-varying covariance matrix of normally distributed parameter η
- AR:
-
Autoregressive
- MRLS:
-
Modified Recursive Least Squares
- VAR:
-
Vector autoregressive
- TVAR:
-
Time-varying autoregressive
References
Arulampalam, S., Maskell, S., Gordon, N., & Clapp, T. (2002, February). A tutorial on particle filters for on-line non-linear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50(2), 174–188.
Doucet, A., Freitas, N., Gordon, N. (eds) (2001) Sequential Monte Carlo methods in practice. Springer, New York, NY
Doucet A., Godsill S., Andrieu C. (2000) On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing 10: 197–208. doi:10.1023/A:1008935410038
Djuric P.M., Kotecha J.H., Esteve F., Perret E. (2002) Sequential parameter estimation of time- varying non-Gaussian autoregressive processes. EURASIP Journal on Applied Signal Processing 2002(8): 865–875
Djuric, P. M., Kotecha, J. H., Tourneret, J. Y., & Lesage, S. (2001). Adaptive signal processing by particle filters and discounting of old measurements. In Proceedings of IEEE international conference on acoustics, speech, signal processing (pp. 3733–3736), Salt Lake City, USA.
Gençağa D., Kuruoğlu E.E., Ertüzün A. (2008) Modeling of non-stationary autoregressive alpha-stable processes by particle filters. Digital Signal Processing 18: 465–478. doi:10.1016/j.dsp.2007.04.011
Hamilton J.D. (1994) Time series analysis. Princeton University Press, Princeton, NJ
Hsu K.J. (1997) Application of vector autoregressive time series analysis to aerosol studies. Tellus 49B: 327–342
Jachan, M., & Matz, G. (2005, June). Nonstationary vector AR modeling of wireless channels. In Proceedings of IEEE SPAWC-2005 (Vol. 1, pp. 648–652), New York.
Kuruoğlu, E. E., Molina, C., & Fitzgerald, W. J. (1998). Approximation of alpha-stable probability densities using finite mixtures of Gaussians. In Proceedings of European signal processing conference (pp. 989–992), Rhodes, Greece.
Lütkepohl H. (1993) Introduction to multiple time series analysis. Springer, Berlin
Möller E., Schack B., Arnold M., Witte H. (2001) Instantaneous multivariate EEG coherence analysis by means of adaptive high-dimensional autoregressive models. Journal of Neuroscience Methods 105: 143–158. doi:10.1016/S0165-0270(00)00350-2
Neumaier A.D., Schneider T. (2001) Estimation of parameters and eigenmodes of multivariate autoregressive models. ACM Transactions on Mathematical Software 27(1): 27–57. doi:10.1145/382043.382304
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by TÜBİTAK-CNR projects 104E101, 102E027 and by Boğaziçi University Scientific Research Fund project number: 04A201. The first author was supported by NATO-TÜBİTAK A2 fellowship, throughout his research at ISTI-CNR, Italy. This work was done when the first author was at the Electrical and Electronic Engineering Department, Boğaziçi University, İstanbul, Turkey
Rights and permissions
About this article
Cite this article
Gençağa, D., Kuruoğlu, E.E. & Ertüzün, A. Modeling non-Gaussian time-varying vector autoregressive processes by particle filtering. Multidim Syst Sign Process 21, 73–85 (2010). https://doi.org/10.1007/s11045-009-0081-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-009-0081-8