Entropy conditions for Lr-convergence of empirical processes

  • Andrea Caponnetto
  • Ernesto De Vito
  • Massimiliano Pontil

DOI: 10.1007/s10444-008-9072-9

Cite this article as:
Caponnetto, A., De Vito, E. & Pontil, M. Adv Comput Math (2009) 30: 355. doi:10.1007/s10444-008-9072-9


The law of large numbers (LLN) over classes of functions is a classical topic of empirical processes theory. The properties characterizing classes of functions on which the LLN holds uniformly (i.e. Glivenko–Cantelli classes) have been widely studied in the literature. An elegant sufficient condition for such a property is finiteness of the Koltchinskii–Pollard entropy integral, and other conditions have been formulated in terms of suitable combinatorial complexities (e.g. the Vapnik–Chervonenkis dimension). In this paper, we endow the class of functions \(\mathcal F\) with a probability measure and consider the LLN relative to the associated Lr metric. This framework extends the case of uniform convergence over \(\mathcal F\), which is recovered when r goes to infinity. The main result is a Lr-LLN in terms of a suitable uniform entropy integral which generalizes the Koltchinskii–Pollard entropy integral.


Empirical processes Uniform entropy Rademacher averages Glivenko–Cantelli classes 

Mathematics Subject Classifications (2000)

Primary 60G15 60G51 

Copyright information

© Springer Science+Business Media, LLC. 2008

Authors and Affiliations

  • Andrea Caponnetto
    • 1
  • Ernesto De Vito
    • 2
  • Massimiliano Pontil
    • 3
  1. 1.Department of MathematicsCity University of Hong KongKowloon TongHong Kong
  2. 2.DSAUniversità di GenovaGenovaItaly
  3. 3.Department of Computer ScienceUniversity College LondonLondonUK

Personalised recommendations