Advances in Computational Mathematics

, 30:355

Entropy conditions for Lr-convergence of empirical processes

  • Andrea Caponnetto
  • Ernesto De Vito
  • Massimiliano Pontil
Article

DOI: 10.1007/s10444-008-9072-9

Cite this article as:
Caponnetto, A., De Vito, E. & Pontil, M. Adv Comput Math (2009) 30: 355. doi:10.1007/s10444-008-9072-9
  • 67 Downloads

Abstract

The law of large numbers (LLN) over classes of functions is a classical topic of empirical processes theory. The properties characterizing classes of functions on which the LLN holds uniformly (i.e. Glivenko–Cantelli classes) have been widely studied in the literature. An elegant sufficient condition for such a property is finiteness of the Koltchinskii–Pollard entropy integral, and other conditions have been formulated in terms of suitable combinatorial complexities (e.g. the Vapnik–Chervonenkis dimension). In this paper, we endow the class of functions \(\mathcal F\) with a probability measure and consider the LLN relative to the associated Lr metric. This framework extends the case of uniform convergence over \(\mathcal F\), which is recovered when r goes to infinity. The main result is a Lr-LLN in terms of a suitable uniform entropy integral which generalizes the Koltchinskii–Pollard entropy integral.

Keywords

Empirical processesUniform entropyRademacher averagesGlivenko–Cantelli classes

Mathematics Subject Classifications (2000)

Primary 60G1560G51

Copyright information

© Springer Science+Business Media, LLC. 2008

Authors and Affiliations

  • Andrea Caponnetto
    • 1
  • Ernesto De Vito
    • 2
  • Massimiliano Pontil
    • 3
  1. 1.Department of MathematicsCity University of Hong KongKowloon TongHong Kong
  2. 2.DSAUniversità di GenovaGenovaItaly
  3. 3.Department of Computer ScienceUniversity College LondonLondonUK