Metrika

, Volume 79, Issue 8, pp 895–917 | Cite as

Qualitative robustness of estimators on stochastic processes

Article

Abstract

A lot of statistical methods originally designed for independent and identically distributed (i.i.d.) data are also successfully used for dependent observations. Still most theoretical investigations on robustness assume i.i.d. pairs of random variables. We examine an important property of statistical estimators—the qualitative robustness in the case of observations which do not fulfill the i.i.d. assumption. In the i.i.d. case qualitative robustness of a sequence of estimators is, according to Hampel (Ann Math Stat 42:1887–1896, 1971), ensured by continuity of the corresponding statistical functional. A similar result for the non-i.i.d. case is shown in this article. Continuity of the corresponding statistical functional still ensures qualitative robustness of the estimator as long as the data generating process satisfies a certain convergence condition on its empirical measure. Examples for processes providing such a convergence condition, including certain Markov chains or mixing processes, are given as well as examples for qualitatively robust estimators in the non-i.i.d. case.

Keywords

Qualitative robustness Stochastic process Statistical functional Weak dependence 

Notes

Acknowledgments

We would like to thank the Deutsche Forschungsgemeinschaft (DFG) which supported this work by grant CH 291/2-1 and we would like to thank the reviewer for the valuable comments to improve the work.

References

  1. Bickel PJ, Bühlmann P (1999) A new mixing notion and functional central limit theorems for a sieve bootstrap in time series. Bernoulli 5(3):413–446MathSciNetCrossRefMATHGoogle Scholar
  2. Boente G, Fraiman R, Yohai VJ (1982) Qualitative robustness for general stochastic processes. Department of Statistics, University of Washington, Tech. repGoogle Scholar
  3. Boente G, Fraiman R, Yohai VJ (1987) Qualitative robustness for stochastic processes. Ann Stat 15(3):1293–1312MathSciNetCrossRefMATHGoogle Scholar
  4. Bradley RC (2005) Basic properties of strong mixing conditions. A survey and some open questions. Prob Surv 2:107–144 (update of, and a supplement to, the 1986 original)MathSciNetCrossRefMATHGoogle Scholar
  5. Breiman L (1968) Probability. Addison-Wesley Publishing Company, ReadingMATHGoogle Scholar
  6. Bustos O (1980) On qualitative robustness for general processes, unpublished manuscripedGoogle Scholar
  7. Christmann A, Van Messem A, Steinwart I (2009) On consistency and robustness properties of support vector machines for heavy-tailed distributions. Stat Interface 2(3):311–327MathSciNetCrossRefMATHGoogle Scholar
  8. Conway JB (1985) A course in functional analysis, graduate texts in mathematics, vol 96. Springer, New YorkCrossRefGoogle Scholar
  9. Cox DD (1981) metrics on stochastic processes and qualitative robustness. Tech. rep., Department of Statistics, University of WashingtonGoogle Scholar
  10. Cuevas A (1988) Qualitative robustness in abstract inference. J Stat Plan Inference 18(3):277–289MathSciNetCrossRefMATHGoogle Scholar
  11. Dedecker J, Doukhan P, Lang G, León RJR, Louhichi S, Prieur C (2007) Weak dependence: with examples and applications, vol 190, Lecture Notes in Statistics, Springer, New YorkGoogle Scholar
  12. Doukhan P, Louhichi S (1999) A new weak dependence condition and applications to moment inequalities. Stoch Process Appl 84(2):313–342MathSciNetCrossRefMATHGoogle Scholar
  13. Dudley RM (1989) Real analysis and probability. Chapman&Hall, New YorkMATHGoogle Scholar
  14. Gray RM (1988) Probability, random processes, and ergodic properties. Springer, New YorkCrossRefMATHGoogle Scholar
  15. Hable R (2013) Universal consistency of localized versions of regularized kernel methods. J Mach Learn Res (JMLR) 14:153–186MathSciNetMATHGoogle Scholar
  16. Hable R, Christmann A (2011) On qualitative robustness of support vector machines. J Multivar Anal 102:993–1007MathSciNetCrossRefMATHGoogle Scholar
  17. Hampel FR (1968) Contributions to the theory of robust estimation. PhD thesis, Univ. California, BerkeleyGoogle Scholar
  18. Hampel FR (1971) A general qualitative definition of robustness. Ann Math Stat 42:1887–1896MathSciNetCrossRefMATHGoogle Scholar
  19. Hoffmann-Jørgensen J (1994) Probability with a view toward statistics, vol I. Chapman & Hall Probability Series, Chapman & Hall, New YorkCrossRefMATHGoogle Scholar
  20. Huber PJ (1981) Robust statistics. Wiley, Wiley Series in Probability and Mathematical Statistics, New YorkGoogle Scholar
  21. Huber PJ, Ronchetti EM (2009) Robust statistics, 2nd edn. Wiley Series in Probability and Statistics, Wiley, HobokenCrossRefMATHGoogle Scholar
  22. Jurečková J, Picek J (2006) Robust statistical methods with \(R\). Chapman & Hall/CRC, Boca RatonMATHGoogle Scholar
  23. Krengel U (1985) Ergodic theorems, de Gruyter studies in mathematics, vol 6. Walter de Gruyter & Co., Berlin with a supplement by Antoine BrunelCrossRefGoogle Scholar
  24. Maronna RA, Martin RD, Yohai VJ (2006) Robust statistics. Wiley Series in Probability and Statistics, Wiley, Chichester theory and methodsCrossRefMATHGoogle Scholar
  25. Papantoni-Kazakos P, Gray RM (1979) Robustness of estimators on stationary observations. Ann. Probab. 7(6):989–1002MathSciNetCrossRefMATHGoogle Scholar
  26. Steinwart I, Hush D, Scovel C (2009) Learning from dependent observations. J Multivar Anal 100:175–194MathSciNetCrossRefMATHGoogle Scholar
  27. van der Vaart AW (1998) Asymptotic statistics, Cambridge Series in Statistical and Probabilistic Mathematics, vol 3. Cambridge University Press, CambridgeGoogle Scholar
  28. Zähle H (2014) Qualitative robustness of von Mises statistics based on strongly mixing data. Stat Pap 55:157–167MathSciNetCrossRefMATHGoogle Scholar
  29. Zähle H (2015) Qualitative robustness of statistical functionals under strong mixing. Bernoulli 21(3):1412–1434MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.Mathematisches InstitutUniversität BayreuthBayreuthGermany
  2. 2.Technologie Campus GrafenauTechnische Hochschule DeggendorfDeggendorfGermany

Personalised recommendations