Abstract
Let \({\mathbb{P}}_{n} \ast K_{h_{n}}(x) = n^{-1}h_{n}^{-d}\sum_{i=1}^{n}K\left((x-X_{i})/h_{n}\right)\) be the classical kernel density estimator based on a kernel K and n independent random vectors X i each distributed according to an absolutely continuous law \({\mathbb{P}}\) on \({\mathbb{R}}^{d}\) . It is shown that the processes \(f \longmapsto \sqrt{n}\int fd({\mathbb{P}}_{n} \ast K_{h_{n}}-{\mathbb{P}})\) , \(f \in {\mathcal{F}}\) , converge in law in the Banach space \(\ell ^{\infty }({\mathcal{F}})\) , for many interesting classes \({\mathcal{F}}\) of functions or sets, some \({\mathbb{P}}\) -Donsker, some just \({\mathbb{P}}\) -pregaussian. The conditions allow for the classical bandwidths h n that simultaneously ensure optimal rates of convergence of the kernel density estimator in mean integrated squared error, thus showing that, subject to some natural conditions, kernel density estimators are ‘plug-in’ estimators in the sense of Bickel and Ritov (Ann Statist 31:1033–1053, 2003). Some new results on the uniform central limit theorem for smoothed empirical processes, needed in the proofs, are also included.
Article PDF
Similar content being viewed by others
References
Alexander K.S. (1987). Central limit theorems for stochastic processes under random entropy conditions. Probab. Theory Relat. Fields 75: 351–378
Bergh J. and Löfström J. (1976). Interpolation Spaces. Springer, Berlin
Bickel J.P. and Ritov Y. (2003). Nonparametric estimators which can be ‘plugged-in’. Ann. Statist. 31: 1033–1053
Giné E. and Peña V. (1999). Decoupling. From Dependence to Independence. Springer, New York
Devroye L. and Györfi L. (1985). Nonparametric Density Estimation. The L 1 View. Wiley, New York
Dudley R.M. (1973). Sample functions of the Gaussian process. Ann. Probab. 1: 66–103
Dudley, R.M.: An extended Wichura theorem, definition of Donsker class, and weighted empirical distributions. Lecture Notes in Mathematics, vol. 1153, pp. 141–178. Springer, New York (1985)
Dudley R.M. (1999). Uniform Central Limit Theorems. Cambridge University Press, Cambridge, England
Folland G.B. (1999). Real Analysis. Wiley, New York
Giné E. and Koltchinskii V. (2006). Concentration inequalities and asymptotic results for ratio type empirical processes. Ann. Probab. 34: 1143–1216
Giné E. and Zinn J. (1984). Some limit theorems for empirical processes. Ann. Probab. 12: 929–989
Giné E. and Zinn J. (1986). Empirical processes indexed by Lipschitz functions. Ann. Probab. 14: 1329–1338
Giné E. and Zinn J. (1991). Gaussian characterization of uniform Donsker classes. Ann. Probab. 19: 758–782
Ledoux M. and Talagrand M. (1991). Probability in Banach Spaces. Springer, Berlin
Malliavin P. (1995). Integration and Probability. Springer, New York
Marcus D.J. (1985). Relationships between Donsker classes and Sobolev spaces. Z. Wahrsch. Verw. Gebiete 69: 323–330
Nickl, R.: Empirical and Gaussian processes on Besov classes. In: Giné, E., Koltchinskii, V., Li, W., Zinn, J. (eds.): High dimensional probability IV, IMS Lecture Notes, vol. 51, pp. 185–195 (2006a)
Nickl, R.: Uniform central limit theorems for density estimators. preprint (2006b)
Nickl R. (2007). Donsker-type theorems for nonparametric maximum likelihood estimators. Probab. Theory Relat. Fields 138: 411–449
Nickl R. and Pötscher B.M. (2007). Bracketing metric entropy rates and empirical central limit theorems for function classes of Besov- and Sobolev-type. J. Theoret. Probab. 20: 177–199
Radulović D. and Wegkamp M. (2000). Weak convergence of smoothed empirical processes. Beyond Donsker classes. In: Giné, E., Mason, D.M. and Wellner, J.A. (eds) High dimensional probability II, Progr. Probab. 47, pp 89–105. Birkhäuser, Boston
Richards J.I. and Youn H.K. (1990). Theory of Distributions. Cambridge University Press, Cambridge England
Rost D. (2000). Limit theorems for smoothed empirical processes. In: Giné, E., Mason, D.M. and Wellner, J.A. (eds) High Dimensional Probability II, Progr. Probab. 47, pp 107–113. Birkhäuser, Boston
Schaefer H.H. (1971). Topological Vector Spaces. Springer, New York
Schwartz L. (1966). Théorie des Distributions. Hermann, Paris
Triebel H. (1983). Theory of Function Spaces. Birkhäuser, Basel
Triebel H. (1995). Interpolation Theory, Function Spaces, Differential Operators. Barth, Heidelberg
Vaart A.W. (1994). Weak convergence of smoothed empirical processes. Scand. J. Statist. 21: 501–504
Vaart A.W. (1998). Asymptotic Statistics. Cambridge University Press, Cambridge
Wellner J.A. and Vaart A.W. (1996). Weak Convergence and Empirical Processes. Springer, New York
Yukich J.E. (1992). Weak convergence of smoothed empirical processes. Scand. J. Statist. 19: 271–279
Ziegler K. (1997). Functional central limit theorems for triangular arrays of function-indexed processes under uniformly integrable entropy conditions. J. Multivar. Anal. 62: 233–272
Ziemer W.P. (1989). Weakly Differentiable Functions. Springer, New York
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Giné, E., Nickl, R. Uniform central limit theorems for kernel density estimators. Probab. Theory Relat. Fields 141, 333–387 (2008). https://doi.org/10.1007/s00440-007-0087-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00440-007-0087-9