, Volume 15, Issue 2, pp 271-344

Regularization in statistics

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access


This paper is a selective review of the regularization methods scattered in statistics literature. We introduce a general conceptual approach to regularization and fit most existing methods into it. We have tried to focus on the importance of regularization when dealing with today's high-dimensional objects: data and models. A wide range of examples are discussed, including nonparametric regression, boosting, covariance matrix estimation, principal component estimation, subsampling.