Skip to main content

Some Worked-Out Examples

  • 2751 Accesses

Part of the Lecture Notes in Mathematics book series (LNMECOLE,volume 2159)

Abstract

The sharp oracle inequalities for the Lasso, the square-root Lasso and other structured sparsity estimators are completed with a probability statement saying the result holds with confidence at least 1 −α (say), with α > 0 a fixed error level. Also a sharp oracle inequality for projection estimators of a density are given. As a “representative” example for the case of non-linear M-estimation with an 1-penalty, a sharp oracle inequality is presented for logistic regression. For trace regression with nuclear norm penalty, a sharp oracle is given when least squares loss is used, and a non-sharp one when least absolute deviations loss is used. In the latter case, the design is taken as in the matrix completion problem. As final example sparse principal component analysis is addressed.

Keywords

  • Logistic Regression
  • Matrix Completion
  • Nuclear Norm
  • Group Lasso
  • Oracle Inequality

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Q. Berthet, P. Rigollet, Complexity theoretic lower bounds for sparse principal component detection, in Conference on Learning Theory (2013)

    MATH  Google Scholar 

  • L. Dümbgen, S. van de Geer, M. Veraar, J. Wellner, Nemirovski’s inequalities revisited. Am. Math. Mon. 117, 138–160 (2010)

    CrossRef  MATH  Google Scholar 

  • V. Koltchinskii, Oracle Inequalities in Empirical Risk Minimization and Sparse Recovery Problems: École d’Été de Probabilités de Saint-Flour XXXVIII-2008, vol. 38 (Springer, Heidelberg, 2011)

    CrossRef  MATH  Google Scholar 

  • J. Lafond, Low rank matrix completion with exponential family noise, in Conference on Learning Theory (2015)

    Google Scholar 

  • G. Watson, Characterization of the subdifferential of some matrix norms. Linear Algebra Appl. 170, 33–45 (2015)

    CrossRef  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

van de Geer, S. (2016). Some Worked-Out Examples. In: Estimation and Testing Under Sparsity. Lecture Notes in Mathematics(), vol 2159. Springer, Cham. https://doi.org/10.1007/978-3-319-32774-7_12

Download citation