Skip to main content

Brouwer’s Fixed Point Theorem and Sparsity

  • 2746 Accesses

Part of the Lecture Notes in Mathematics book series (LNMECOLE,volume 2159)

Abstract

In the generalized linear model and its relatives, the loss depends on the parameter via a transformation (the inverse link function) of the linear function (or linear predictor). In this chapter such a structure is not assumed. Moreover, the chapter hints at cases where the effective parameter space is very large and the localization arguments discussed so far cannot be applied. (The graphical Lasso is an example.) With the help of Brouwer’s fixed point theorem it is shown that when \(\dot{R}(\beta )\) is Ω -close to its linear approximation when β is Ω -close to the target β 0, then also the Ω-structured sparsity M-estimator \(\hat{\beta }\) is Ω -close to the target. Here, the second derivative inverse matrix \(\ddot{R}^{-1}(\beta ^{0})\) is assumed to have Ω-small enough rows, where Ω is the dual norm of Ω . Next, weakly decomposable norms Ω are considered. A generalized irrepresentable condition on a set S of indices yields that there is a solution \(\tilde{\beta }_{S}\) of the KKT-conditions with zeroes outside the set S. At such a solution \(\tilde{\beta }_{S}\) the problem is under certain conditions localized, so that one can apply the linear approximation of \(\dot{R}(\beta )\). This scheme is carried out for exponential families and in particular for the graphical Lasso.

Keywords

  • Fixed Point Theorem
  • Exponential Family
  • Remainder Term
  • Empirical Risk
  • Structure Sparsity

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • L. Dümbgen, S. van de Geer, M. Veraar, J. Wellner, Nemirovski’s inequalities revisited. Am. Math. Mon. 117, 138–160 (2010)

    CrossRef  MATH  Google Scholar 

  • J. Friedman, T. Hastie, R. Tibshirani, Sparse inverse covariance estimation with the graphical Lasso. Biostatistics 9, 432–441 (2008)

    CrossRef  MATH  Google Scholar 

  • P. Ravikumar, M. Wainwright, G. Raskutti, B. Yu, High-dimensional covariance estimation by minimizing 1-penalized log-determinant divergence. Electron. J. Stat. 5, 935–980 (2011)

    CrossRef  MathSciNet  MATH  Google Scholar 

  • A. Rothmann, P. Bickel, E. Levina, J. Zhu, Sparse permutation invariant covariance estimation. Electron. J. Stat. 2, 494–515 (2008)

    CrossRef  MathSciNet  MATH  Google Scholar 

  • J. Schauder, Der Fixpunktsatz in funktionalräumen. Studia 2, 171–180 (1930)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

van de Geer, S. (2016). Brouwer’s Fixed Point Theorem and Sparsity. In: Estimation and Testing Under Sparsity. Lecture Notes in Mathematics(), vol 2159. Springer, Cham. https://doi.org/10.1007/978-3-319-32774-7_13

Download citation