Noise Identification in Multivariate Time Series Modelling with Divergence Approach

  • Ryszard Szupiluk
Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 158)


In this paper we develop ensemble method based on multivariate decompositions taken from blind signal separation techniques. The main idea is to decompose prediction result into constructive and destructive (noises) components. Elimination of the noises from predictions should improve final prediction. One of the key issues in this method is the correct classification and distinction between destructive and constructive components, what provide to random noise detection problem. It can be interpreted in terms of signal similarity, in which the Bose-Einstein divergence can be applied.


noise reduction ensemble methods noise identification independent component analysis divergence function 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bollerslev, T., Engle, R.F., Nelson, D.: ARCH Models. In: McFadden, D.F., Engle III, R.F. (eds.) The Handbook of Econometrics, vol. IV. North-Holland (1994)Google Scholar
  2. 2.
    Box, G.E.P., Müller, M.E., Jenkins, G.M.: Time Series Analysis Forecasting and Control, 2nd edn. Holden Day, San Francisco (1976)Google Scholar
  3. 3.
    Breiman, L.: Bagging predictors. Machine Learning 24, 123–140 (1996)Google Scholar
  4. 4.
    Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing. John Wiley, Chichester (2002)CrossRefGoogle Scholar
  5. 5.
    Cichocki, A., Zdunek, R., Phan, A.-H., Amari, S.: Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis. John Wiley (2009)Google Scholar
  6. 6.
    Clements, T.: Combining forecasts: A review and annotated bibligraphy. International Journal of Forecasting 5, 559–581 (1989)CrossRefGoogle Scholar
  7. 7.
    Comon, P.: Independent component analysis, a new concept? Signal Processing 36 (1994)Google Scholar
  8. 8.
    Hamilton, J.D.: Time series analysis. Princeton University Press, Princeton (1994)Google Scholar
  9. 9.
    Haykin, S.: Neural networks: a comprehensive foundation. Macmillan, New York (1994)Google Scholar
  10. 10.
    Hoeting, J., Madigan, D., Raftery, A., Volinsky, C.: Bayesian model averaging: a tutorial. Statistical Science 14, 382–417 (1999)CrossRefGoogle Scholar
  11. 11.
    Hyvarinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. John Wiley, New York (2001)CrossRefGoogle Scholar
  12. 12.
    Lee, D.D., Seung, H.S.: Learning of the parts of objects by non-negative matrix factorization. Nature 401 (1999)Google Scholar
  13. 13.
    Li, Y., Cichocki, A., Amari, S.: Sparse component analysis for blind source separation with less sensors than sources. In: Fourth Int. Symp. on ICA and Blind Signal Separation, Nara, Japan, pp. 89–94 (2003)Google Scholar
  14. 14.
    Karvanen, J., Eriksson, J., Koivunen, V.: Adaptive Score Functions for Maximum Likelihood ICA. VLSI Signal Processing 32, 83–92 (2002)CrossRefGoogle Scholar
  15. 15.
    Shiryaev, A.N.: Essentials of stochastic finance: facts, models, theory. World Scientific, Singapore (1999)Google Scholar
  16. 16.
    Szupiluk, R., Wojewnik, P., Zabkowski, T.: Model Improvement by the Statistical Decomposition. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds.) ICAISC 2004. LNCS (LNAI), vol. 3070, pp. 1199–1204. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  17. 17.
    Szupiluk, R., Wojewnik, P., Ząbkowski, T.: Smooth Component Analysis as Ensemble Method for Prediction Improvement. In: Davies, M.E., James, C.J., Abdallah, S.A., Plumbley, M.D. (eds.) ICA 2007. LNCS, vol. 4666, pp. 277–284. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  18. 18.
    Szupiluk, R., Wojewnik, P., Zabkowski, T.: Noise detection for ensemble methods. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010, Part I. LNCS, vol. 6113, pp. 471–478. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  19. 19.
    Therrien, C.W.: Discrete Random Signals and Statistical Signal Processing. Prentice Hall, New Jersey (1992)Google Scholar
  20. 20.
    Vaseghi, S.V.: Advanced signal processing and digital noise reduction. John Wiley and Sons, B. G. Teubner, Chichester, Stuttgart (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ryszard Szupiluk
    • 1
  1. 1.Warsaw School of EconomicsWarsawPoland

Personalised recommendations