Extreme Value Model for Volatility Measure in Machine Learning Ensemble

  • Ryszard Szupiluk
  • Paweł RubachEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10841)


This paper presents a method of model aggregation using multivariate decompositions where the main problem is to properly identify the components that carry noise. We develop a volatility measure which uses generalized extreme value decomposition. It is applied to destructive and constructive latent component classification. A practical experiment was conducted in order to validate the effectiveness of the introduced method.


Prediction Blind separation Ensemble models Noise detection Theta noise measure 


  1. 1.
    Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)zbMATHGoogle Scholar
  2. 2.
    Drucker, H.: Improving regressors using boosting techniques. In: ICML, vol. 97, pp. 107–115 (1997)Google Scholar
  3. 3.
    Hoeting, J., Madigan, D., Raftery, A., Volinsky, C.: Bayesian model averaging: a tutorial. Stat. Sci. 14, 382–417 (1999)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Szupiluk, R., Wojewnik, P., Ząbkowski, T.: Prediction improvement via smooth component analysis and neural network mixing. In: Kollias, S., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 133–140. Springer, Heidelberg (2006). Scholar
  5. 5.
    Szupiluk, R., Wojewnik, P., Zabkowski, T.: Noise detection for ensemble methods. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010. LNCS (LNAI), vol. 6113, pp. 471–478. Springer, Heidelberg (2010). Scholar
  6. 6.
    Comon, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Academic Press, Cambridge (2010)Google Scholar
  7. 7.
    Hyvärinen, A.: Independent component analysis: recent advances. Philos. Trans. R. Soc. A 371, 20110534 (2013)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Szupiluk, R., Wojewnik, P., Zabkowski, T.: The noise identification method based on divergence analysis in ensemble methods context. In: Dobnikar, A., Lotrič, U., Šter, B. (eds.) ICANNGA 2011. LNCS, vol. 6594, pp. 206–214. Springer, Heidelberg (2011). Scholar
  9. 9.
    Vasegi, S.V.: Advanced Signal Processing and Digital Noise Reduction. Wiley, Chichester (2008)CrossRefGoogle Scholar
  10. 10.
    Evans, M., Hastings, N., Peacock, B.: Statistical Distributions, 3rd edn. Wiley, Hoboken (2000)zbMATHGoogle Scholar
  11. 11.
    McFadden, D.: Modeling the choice of residential location. Transp. Res. Rec. 673, 72–77 (1978)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Warsaw School of EconomicsWarsawPoland

Personalised recommendations