Entropy conditions for Lr-convergence of empirical processes
- First Online:
- Cite this article as:
- Caponnetto, A., De Vito, E. & Pontil, M. Adv Comput Math (2009) 30: 355. doi:10.1007/s10444-008-9072-9
- 68 Downloads
The law of large numbers (LLN) over classes of functions is a classical topic of empirical processes theory. The properties characterizing classes of functions on which the LLN holds uniformly (i.e. Glivenko–Cantelli classes) have been widely studied in the literature. An elegant sufficient condition for such a property is finiteness of the Koltchinskii–Pollard entropy integral, and other conditions have been formulated in terms of suitable combinatorial complexities (e.g. the Vapnik–Chervonenkis dimension). In this paper, we endow the class of functions \(\mathcal F\) with a probability measure and consider the LLN relative to the associated Lr metric. This framework extends the case of uniform convergence over \(\mathcal F\), which is recovered when r goes to infinity. The main result is a Lr-LLN in terms of a suitable uniform entropy integral which generalizes the Koltchinskii–Pollard entropy integral.