Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
  1. Home
  2. Probability Theory and Related Fields
  3. Article
An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation
Download PDF
Download PDF
  • Published: 29 January 2008

An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation

  • Evarist Giné1 &
  • Richard Nickl1 

Probability Theory and Related Fields volume 143, pages 569–596 (2009)Cite this article

  • 543 Accesses

  • 39 Citations

  • 3 Altmetric

  • Metrics details

Abstract

It is shown that the uniform distance between the distribution function \(F_n^K(h)\) of the usual kernel density estimator (based on an i.i.d. sample from an absolutely continuous law on \({\mathbb{R}}\)) with bandwidth h and the empirical distribution function F n satisfies an exponential inequality. This inequality is used to obtain sharp almost sure rates of convergence of \(\|F_n^K(h_n)-F_n\|_\infty\) under mild conditions on the range of bandwidths h n , including the usual MISE-optimal choices. Another application is a Dvoretzky–Kiefer–Wolfowitz-type inequality for \(\|F_n^{K}(h)-F\|_\infty\) , where F is the true distribution function. The exponential bound is also applied to show that an adaptive estimator can be constructed that efficiently estimates the true distribution function F in sup-norm loss, and, at the same time, estimates the density of F—if it exists (but without assuming it does)—at the best possible rate of convergence over Hölder-balls, again in sup-norm loss.

Download to read the full article text

Working on a manuscript?

Avoid the common mistakes

References

  • Balabdaoui F. and Wellner J.A. (2007). A Kiefer–Wolfowitz theorem for convex densities. IMS Lect. Notes Monogr. Ser. 55: 1–31

    Article  MathSciNet  Google Scholar 

  • Bickel J.P. and Ritov Y. (2003). Nonparametric estimators which can be ’plugged-in’. Ann. Stat. 31: 1033–1053

    Article  MATH  MathSciNet  Google Scholar 

  • Bousquet O. (2003). Concentration inequalities for sub-additive functions using the entropy method. In: Giné, E., Houdré, C. and Nualart, D. (eds) Stochastic inequalities and applications, Progr. Probab., vol 56, pp 213–247. Birkhäuser, Boston

    Google Scholar 

  • Butucea C. (2001). Exact adaptive pointwise estimation on Sobolev classes of densities. ESAIM Probab. Stat. 5: 1–31

    Article  MATH  MathSciNet  Google Scholar 

  • Dalalyan A.S., Golubev G.K. and Tsybakov A.B. (2006). Penalized maximum likelihood and semiparametric second-order efficiency. Ann. Stat. 34: 169–201

    Article  MATH  MathSciNet  Google Scholar 

  • de la Peña, V., Giné, E.: Decoupling From Dependence to Independence. Springer, New York (1999)

    Google Scholar 

  • Donoho D.L., Johnstone I.M., Kerkyacharian G. and Picard D. (1996). Density estimation by wavelet thresholding. Ann. Stat. 24: 508–539

    Article  MATH  MathSciNet  Google Scholar 

  • Dümbgen, L., Rufibach, K.: Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency. Preprint (2007)

  • Durot C. and Tocquet A.S. (2003). On the distance between the empirical process and its concave majorant in a monotone regression framework. Ann. Inst. H. Poincaré Probab. Stat. 39: 217–240

    Article  MATH  MathSciNet  Google Scholar 

  • Dvoretzky A., Kiefer J. and Wolfowitz J. (1956). Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann. Math. Stat. 27: 642–669

    Article  MATH  MathSciNet  Google Scholar 

  • Einmahl U. and Mason D.M. (2000). An empirical process approach to the uniform consistency of kernel-type function estimators. J. Theor. Probab. 13: 1–37

    Article  MATH  MathSciNet  Google Scholar 

  • Folland G.B. (1999). Real Analysis. Wiley, New York

    MATH  Google Scholar 

  • Giné E. and Guillou A. (2001). On consistency of kernel density estimators for randomly censored data: rates holding uniformly over adaptive intervals. Ann. Inst. H. Poincaré Probab. Stat. 37: 503–522

    Article  MATH  Google Scholar 

  • Giné E. and Guillou A. (2002). Rates of strong uniform consistency for multivariate kernel density estimators. Ann. Inst. H. Poincaré Probab. Stat. 38: 907–921

    Article  MATH  Google Scholar 

  • Giné E. and Koltchinskii V. (2006). Concentration inequalities and asymptotic results for ratio type empirical processes. Ann. Probab. 34: 1143–1216

    Article  MATH  MathSciNet  Google Scholar 

  • Giné E. and Mason D.M. (2007). Laws of the iterated logarithm for the local U-statistic process. J. Theor. Probab. 20: 457–486

    Article  MATH  Google Scholar 

  • Giné, E., Nickl, R.: Uniform limit theorems for wavelet density estimators. preprint (2007)

  • Giné, E., Nickl, R.: Uniform central limit theorems for kernel density estimators. Probab. Theory Related Fields (forthcoming) (2008)

  • Hall P., Kerkyacharian G. and Picard D. (1998). Block threshold rules for curve estimation using kernel and wavelet methods. Ann. Stat. 26: 922–942

    Article  MATH  MathSciNet  Google Scholar 

  • Ibragimov I.A. and Khasminski R.Z. (1980). On estimation of distribution density. Zap. Nauchnyh Seminarov LOMI 98: 61–86

    MATH  Google Scholar 

  • Juditsky A. and Lambert-Lacroix S. (2004). On minimax density estimation on \(\mathbb R\) Bernoulli 10: 187–220

    Article  MATH  MathSciNet  Google Scholar 

  • Kerkyacharian G., Picard D. and Tribouley K (1996). L p adaptive density estimation. Bernoulli 2: 229–247

    MATH  MathSciNet  Google Scholar 

  • Kiefer J. and Wolfowitz J. (1976). Asymptotically minimax estimation of concave and convex distribution functions. Z. Wahr. verw. Gebiete. 34: 73–85

    Article  MATH  MathSciNet  Google Scholar 

  • Ledoux M. and Talagrand M. (1991). Probability in Banach spaces. Springer, Berlin

    MATH  Google Scholar 

  • Lepski O.V. (1991). Asymptotic minimax adaptive estimation. 1. Upper bounds. Theory Probab. Appl. 36: 682–697

    Article  Google Scholar 

  • Lepski O.V., Mammen E. and Spokoiny V.G. (1997). Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors. Ann. Stat. 25: 929–947

    Article  MATH  MathSciNet  Google Scholar 

  • Lepski O.V. and Spokoiny V.G. (1997). Optimal pointwise adaptive methods in nonparametric estimation. Ann. Stat. 25: 2512–2546

    Article  MATH  MathSciNet  Google Scholar 

  • Marron J.S. and Wand M.P. (1992). Exact mean integrated squared error. Ann. Stat. 20: 712–736

    Article  MATH  MathSciNet  Google Scholar 

  • Nickl R. (2007). Donsker-type theorems for nonparametric maximum likelihood estimators. Probab. Theory Related Fields 138: 411–449

    Article  MATH  MathSciNet  Google Scholar 

  • Rio E. (2002). Une inégalité de Bennett pour les maxima de processus empiriques. Ann. Inst. H. Poincaré Probab. Stat. 38: 1053–1057

    Article  MATH  MathSciNet  Google Scholar 

  • Talagrand M. (1994). Sharper bounds for Gaussian and empirical processes. Ann. Probab. 22: 28–76

    Article  MATH  MathSciNet  Google Scholar 

  • Talagrand M. (1996). New concentration inequalities in product spaces. Invent. Math. 126: 505–563

    Article  MATH  MathSciNet  Google Scholar 

  • Tsybakov A.B. (1998). Pointwise and sup-norm sharp adaptive estimation of the functions on the Sobolev classes. Ann. Stat. 26: 2420–2469

    Article  MATH  MathSciNet  Google Scholar 

  • Wellner J.A. and Vaart A.W. (1996). Weak Cconvergence and Empirical Processes. Springer, New York

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, University of Connecticut, Storrs, CT, 06269-3009, USA

    Evarist Giné & Richard Nickl

Authors
  1. Evarist Giné
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Richard Nickl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Evarist Giné.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Giné, E., Nickl, R. An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation. Probab. Theory Relat. Fields 143, 569–596 (2009). https://doi.org/10.1007/s00440-008-0137-y

Download citation

  • Received: 13 August 2007

  • Revised: 14 December 2007

  • Published: 29 January 2008

  • Issue Date: March 2009

  • DOI: https://doi.org/10.1007/s00440-008-0137-y

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Keywords

  • Kernel density estimator
  • Exponential inequalities
  • Adaptive estimation
  • Sup-norm
  • Plug-in property

Mathematics Subject Classification (2000)

  • Primary: 62G07
  • Secondary: 60F05
Download PDF

Working on a manuscript?

Avoid the common mistakes

Advertisement

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature