Skip to main content

General Loss with Norm-Penalty

  • 2747 Accesses

Part of the Lecture Notes in Mathematics book series (LNMECOLE,volume 2159)

Abstract

Results obtained for least-squares loss are now extended to general convex loss. The regularization penalty is again a norm, and the concept of weak decomposability and “allowedness” is extended as well: the norm used in the penalty is required to have the triangle property. The generalized notion of compatibility will be effective sparsity. The oracle results obtained require almost-differentiability of the loss. It is moreover assumed that the population version of the problem, the theoretical risk function has strict convexity properties. This will be called the (two point) margin condition.

Keywords

  • Triangle Property
  • Weak Decomposability
  • Effective Sparsity
  • General Convex Loss
  • Sharp Oracle Inequalities

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    An example where this is not the case is where \(\mathcal{B}\) is a lower-dimensional subspace of \(\bar{\mathcal{B}}\). This is comparable to the situation where one approximates a function (an -dimensional object) by a p-dimensional linear function (with p large).

References

  • S. van de Geer, Empirical Processes in M-Estimation (Cambridge University Press, Cambridge, 2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

van de Geer, S. (2016). General Loss with Norm-Penalty. In: Estimation and Testing Under Sparsity. Lecture Notes in Mathematics(), vol 2159. Springer, Cham. https://doi.org/10.1007/978-3-319-32774-7_7

Download citation