Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
  1. Home
  2. Probability Theory and Related Fields
  3. Article
On the role of the shrinkage parameter in local linear smoothing
Download PDF
Download PDF
  • Published: August 1997

On the role of the shrinkage parameter in local linear smoothing

  • Peter Hall1 &
  • J. Stephen Marron1 

Probability Theory and Related Fields volume 108, pages 495–516 (1997)Cite this article

  • 84 Accesses

  • 11 Citations

  • Metrics details

Summary.

It has been shown that local linear smoothing possesses a variety of very attractive properties, not least being its mean square performance. However, such results typically refer only to asymptotic mean squared error, meaning the mean squared error of the asymptotic distribution, and in fact, the actual mean squared error is often infinite. See Seifert and Gasser (1996). This difficulty may be overcome by shrinking the local linear estimator towards another estimator with bounded mean square. However, that approach requires information about the size of the shrinkage parameter. From at least a theoretical viewpoint, very little is known about the effects of shrinkage. In particular, it is not clear how small the shrinkage parameter may be chosen without affecting first-order properties, or whether infinitely supported kernels such as the Gaussian require shrinkage in order to achieve first-order optimal performance. In the present paper we provide concise and definitive answers to such questions, in the context of general ridged and shrunken local linear estimators. We produce necessary and sufficient conditions on the size of the shrinkage parameter that ensure the traditional mean squared error formula. We show that a wide variety of infinitely-supported kernels, with tails even lighter than those of the Gaussian kernel, do not require any shrinkage at all in order to achieve traditional first-order optimal mean square performance.

Download to read the full article text

Working on a manuscript?

Avoid the common mistakes

Author information

Authors and Affiliations

  1. Centre for Mathematics and its Applications, Australian National University, Canberra, ACT 0200, Australia, , , , , , AU

    Peter Hall & J. Stephen Marron

Authors
  1. Peter Hall
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Stephen Marron
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Received: 22 May 1995 / In revised form: 23 January 1997

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Hall, P., Marron, J. On the role of the shrinkage parameter in local linear smoothing. Probab Theory Relat Fields 108, 495–516 (1997). https://doi.org/10.1007/s004400050118

Download citation

  • Issue Date: August 1997

  • DOI: https://doi.org/10.1007/s004400050118

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Key words: Bandwidth
  • kernel
  • local polynomial smoothing
  • local regression
  • mean squared error
  • ridge regression
  • nonparametric regression
  • variance.
  • Mathematics Subject Classification (1991): Primary 62G07; Secondary 62G20
Download PDF

Working on a manuscript?

Avoid the common mistakes

Advertisement

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature