Skip to main content
Log in

Consistency of the kernel density estimator: a survey

  • Survey Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

Various consistency proofs for the kernel density estimator have been developed over the last few decades. Important milestones are the pointwise consistency and almost sure uniform convergence with a fixed bandwidth on the one hand and the rate of convergence with a fixed or even a variable bandwidth on the other hand. While considering global properties of the empirical distribution functions is sufficient for strong consistency, proofs of exact convergence rates use deeper information about the underlying empirical processes. A unifying character, however, is that earlier and more recent proofs use bounds on the probability that a sum of random variables deviates from its mean.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Büning H, Trenkler G (1994) Nichtparametrische Statistische Methoden, 2nd edn. de Gruyter, Berlin

    MATH  Google Scholar 

  • Deheuvels P, Mason D (2004) General asymptotic confidence bands based on kernel-type function estimators. Stat Inference Stoch Proces 7: 225–277

    Article  MathSciNet  MATH  Google Scholar 

  • Dette H, Gefeller O (1995) Definitions of nearest neighbour distances for censored data on the nearest neighbour kernel estimators of the hazard rate. J Nonparametr Stat 4: 271–282

    Article  MathSciNet  MATH  Google Scholar 

  • Diehl S, Stute W (1988) Kernel density and hazard function estimation in the presence of censoring. J Multivar Anal 25: 299–310

    Article  MathSciNet  MATH  Google Scholar 

  • Dvoretzky A, Kiefer J, Wolfowitz J (1956) Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Annal Math Stat 27: 642–669

    Article  MathSciNet  MATH  Google Scholar 

  • Einmahl U, Mason D (2005) Uniform in bandwidth consistency of kernel-type function estimators. Annal Stat 33: 1380–1403

    Article  MathSciNet  MATH  Google Scholar 

  • Hall P (1978) Cross-validation in density estimation. Biometrika 69: 383–390

    Article  Google Scholar 

  • Hall P, Marron J (1995) Improved variable window kernel estimates of probability densities. Annal Stat 23: 1–10

    Article  MathSciNet  MATH  Google Scholar 

  • Hall P, Sheather S, Jones M, Marron J (1991) On optimal data-based bandwidth selection in kernel density estimation. Biometrika 78: 263–269

    Article  MathSciNet  MATH  Google Scholar 

  • Härdle W (1991) Smoothing techniques. Springer, New York

    Book  MATH  Google Scholar 

  • Marron J, Gonzàlez-Manteiga W, Cao R (1996) Bootstrap selection of the smoothing parameter in nonparametric hazard rate estimation. J Am Stat Assoc 91: 1130–1140

    Article  MATH  Google Scholar 

  • Massart P (1990) The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Annal Probab 18: 1269–1283

    Article  MathSciNet  MATH  Google Scholar 

  • Nadaraja E (1964) On estimating regression. Theory Probabil Appl 9(1): 141–142

    Article  Google Scholar 

  • Nadaraja E (1965) On nonparametric estimates of density functions and regression curves. Theory Probabil Appli 10: 186–190

    Article  MathSciNet  Google Scholar 

  • Parzen E (1962) On estimation of a probability density function and mode. Annal Math Stat 33: 1065–1076

    Article  MathSciNet  MATH  Google Scholar 

  • Rosenblatt M (1956) Remarks on some nonparametric estimates of a density function. Annal Math Stat 27: 832–835

    Article  MathSciNet  MATH  Google Scholar 

  • Schäbe H, Tiedge J (1995) Kernel estimation for characteristics of pure jump processes. Stat Paper 36: 131–144

    Article  MATH  Google Scholar 

  • Schäfer H (1986) Local convergence of empirical measures in the random censorship situation with application to density and rate estimators. Annal Stat 14: 1240–1245

    Article  MATH  Google Scholar 

  • Silverman B (1986) Density estimation. Chapman and Hall, London

    MATH  Google Scholar 

  • Stute W (1982a) A law of the logarithm for kernel density estimators. Annal Probabil 10: 414–422

    Article  MathSciNet  MATH  Google Scholar 

  • Stute W (1982b) The oscillation behavior of empirical processes. Annal Probabil 10: 86–107

    Article  MathSciNet  MATH  Google Scholar 

  • Stute W (1984) The oscillation behavior of empirical processes: The multivariate case. Annal Probabil 12: 361–379

    Article  MathSciNet  MATH  Google Scholar 

  • Talagrand M (1994) Sharper bounds for gaussian and empirical processes. Annal Probabil 22: 28–76

    Article  MathSciNet  MATH  Google Scholar 

  • Wagner T (1975) Nonparametric estimates of probability densities. IEEE Trans Inf Theory 21: 438–440

    Article  MATH  Google Scholar 

  • Wand M, Jones M (1995) Kernel smoothing. Chapman and Hall, London

    MATH  Google Scholar 

  • Watson G (1964) Smooth regression analysis. Sankhya A 26: 101–116

    MATH  Google Scholar 

  • Weißbach R (2006) A general kernel functional estimator with general bandwidth—strong consistency and applications. J Nonparametr Stat 18: 1–12

    Article  MathSciNet  MATH  Google Scholar 

  • Weißbach R, Pfahlberg A, Gefeller O (2008) Double-smoothing in kernel hazard rate estimation. Method Inf Med 47: 167–173

    Google Scholar 

  • Wheeden R, Zygmund A (1977) Measure and integral—an introduction to real analysis. Marcel Dekker, New York

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dominik Wied.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wied, D., Weißbach, R. Consistency of the kernel density estimator: a survey. Stat Papers 53, 1–21 (2012). https://doi.org/10.1007/s00362-010-0338-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-010-0338-1

Keywords

Mathematics Subject Classification (2000)

Navigation