Advertisement

Time Varying Quantile Lasso

  • Wolfgang Karl Härdle
  • W. Wang
  • L. Zboňáková
Chapter
Part of the Statistics and Computing book series (SCO)

Abstract

In the present chapter we study the dynamics of penalization parameter \(\lambda \) of the least absolute shrinkage and selection operator (Lasso) method proposed by Tibshirani (J Roy Stat Soc Series B 58:267–288, 1996) and extended into quantile regression context by Li and Zhu (J Comput Graph Stat 17:1–23, 2008). The dynamic behaviour of the parameter \(\lambda \) can be observed when the model is assumed to vary over time and therefore the fitting is performed with the use of moving windows. The proposal of investigating time series of \(\lambda \) and its dependency on model characteristics was brought into focus by Härdle et al. (J Econom 192:499–513, 2016), which was a foundation of FinancialRiskMeter. Following the ideas behind the two aforementioned projects, we use the derivation of the formula for the penalization parameter \(\lambda \) as a result of the optimization problem. This reveals three possible effects driving \(\lambda \); variance of the error term, correlation structure of the covariates and number of nonzero coefficients of the model. Our aim is to disentangle these three effects and investigate their relationship with the tuning parameter \(\lambda \), which is conducted by a simulation study. After dealing with the theoretical impact of the three model characteristics on \(\lambda \), empirical application is performed and the idea of implementing the parameter \(\lambda \) into a systemic risk measure is presented.

Notes

Acknowledgements

Financial support from Deutsche Forschungsgemeinschaft via CRC “Economic Risk” and IRTG 1792 “High Dimensional Non Stationary Time Series”, Humboldt-Universität zu Berlin, is gratefully acknowledged.

References

  1. Adrian, T., & Brunnermeier, M. K. (2016). CoVaR. American Economic Review, 106, 1705–1741.CrossRefGoogle Scholar
  2. Belloni, A., & Chernozhukov, V. (2011). \(\mathit{l}_1\)-penalized quantile regression in high-dimensional sparse models. The Annals of Statistics, 39, 82–130.MathSciNetCrossRefzbMATHGoogle Scholar
  3. Chand, S. (2012). On tuning parameter selection of lasso-type methods - a monte carlo study. In Proceedings of 9th International Bhurban Conference on Applied Sciences & Technology (pp. 120–129).Google Scholar
  4. Chen, K., & Chan, K. S. (2011). Subset ARMA selection via the adaptive lasso. Statistics and Its Interface, 4, 197–205.MathSciNetCrossRefzbMATHGoogle Scholar
  5. Diebold, F. X., & Yilmaz, K. (2014). On the network topology of variance decompositions: Measuring the connectedness of financial firms. Journal of Econometrics, 182, 119–134.MathSciNetCrossRefzbMATHGoogle Scholar
  6. Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004). Least angle regression. The Annals of Statistics, 32, 407–499.MathSciNetCrossRefzbMATHGoogle Scholar
  7. Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its Oracle properties. Journal of the American Statistical Association, 96, 1348–1360.MathSciNetCrossRefzbMATHGoogle Scholar
  8. Giglio, S., Kelly, B., & Pruitt, S. (2016). Systemic risk and the macroeconomy: An empirical evaluation. Journal of Financial Economics, 119, 457–471.CrossRefGoogle Scholar
  9. Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference and prediction (2nd ed.). New York: Springer.CrossRefzbMATHGoogle Scholar
  10. Hautsch, N., Schaumburg, J., & Schienle, M. (2015). Financial network systemic risk contributions. Review of Finance, 19, 685–738.CrossRefGoogle Scholar
  11. Härdle, W. K., Wang, W., & Yu, L. (2016). TENET: Tail-event driven NETwork risk. Journal of Econometrics, 192, 499–513.MathSciNetCrossRefzbMATHGoogle Scholar
  12. Hsu, N. J., Hung, H. L., & Chang, Y. M. (2008). Subset selection for vector autoregressive processes using lasso. Computational Statistics and Data Analysis, 52, 3645–3657.MathSciNetCrossRefzbMATHGoogle Scholar
  13. Holló, D., Kremer, M., & Lo Duca, M. (2012). CISS - a composite indicator of systemic stress in the financial system, ECB Working Paper Series No. 1426.Google Scholar
  14. Johansen, S. (1991). Estimation and hypothesis testing of cointegration vectors in gaussian vector autoregressive models. Econometrica, 59, 1551–1580.MathSciNetCrossRefzbMATHGoogle Scholar
  15. Koenker, R., & Basset, G. (1978). Regression quantiles. Econometrica, 46, 33–50.MathSciNetCrossRefzbMATHGoogle Scholar
  16. Koenker, R., Ng, P., & Portnoy, S. (1994). Quantile smoothing splines. Biometrica, 81, 673–680.MathSciNetCrossRefzbMATHGoogle Scholar
  17. Kritzman, M., & Li, Y. (2010). Skulls. Financial Turbulence, ans Risk Management, Financial Analysts Journal, 66, 30–41.Google Scholar
  18. Lee, E. R., Noh, H., & Park, B. U. (2014). Model selection via Bayesian information criterion for quantile regression models. Journal of the American Statistical Association, 109, 216–229.MathSciNetCrossRefzbMATHGoogle Scholar
  19. Leng, C., Lin, Y., & Wahba, G. (2006). A note on the lasso and related procedures in model selection. Statistica Sinica, 16, 1273–1284.MathSciNetzbMATHGoogle Scholar
  20. Li, Y., & Zhu, J. (2008). \(L_1\)-norm quantile regression. Journal of Computational and Graphical Statistics, 17, 1–23.MathSciNetCrossRefGoogle Scholar
  21. Nardi, Y., & Rinaldo, A. (2011). Autoregressive process modeling via the lasso procedure. Journal of Multivariate Analysis, 102, 528–549.MathSciNetCrossRefzbMATHGoogle Scholar
  22. Osborne, M. R. (1985). Finite algorithms in optimization and data analysis, Wiley series in probability and mathematical statistics. Chichester: Wiley.Google Scholar
  23. Osborne, M. R., Presnell, B., & Turlach, B. A. (2000). On the LASSO and its dual. Journal of Computational and Graphical Statistics, 9, 319–337.MathSciNetGoogle Scholar
  24. R Core Team (2014). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/. Accessed 15 April 2015.
  25. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B, 58, 267–288.MathSciNetzbMATHGoogle Scholar
  26. Wang, H., & Leng, C. (2007). Unified LASSO estimation by least squares approximation. Journal of the American Statistical Association, 102, 1039–1048.MathSciNetCrossRefzbMATHGoogle Scholar
  27. Wang, H., Li, G., & Tsai, C. L. (2007). Regression coefficient and autoregressive order shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B, 69, 63–78.MathSciNetGoogle Scholar
  28. Wang, H., Li, B., & Leng, C. (2009). Shrinkage tuning parameter selection with a diverging number of parameters. Journal of the Royal Statistical Society: Series B, 71, 671–683.MathSciNetCrossRefzbMATHGoogle Scholar
  29. Yuan, M. (2006). GACV for quantile smoothing splines. Computational Statistics & Data Analysis, 50, 813–829.MathSciNetCrossRefzbMATHGoogle Scholar
  30. Zhao, P., & Yu, B. (2006). On model selection consistency of lasso. Journal of Machine Learning Research, 7, 2541–2563.MathSciNetzbMATHGoogle Scholar
  31. Zou, H. (2006). The adaptive lasso and its Oracle properties. Journal of the American Statistical Association, 101, 1418–1429.MathSciNetCrossRefzbMATHGoogle Scholar
  32. Zou, H., Hastie, T., & Tibshirani, R. (2007). On the degrees of freedom of the lasso. The Annals of Statistics, 35, 2173–2192.MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Wolfgang Karl Härdle
    • 1
    • 2
  • W. Wang
    • 1
    • 3
  • L. Zboňáková
    • 1
  1. 1.C.A.S.E.-Center of Applied Statistics and EconomicsHumboldt-Universität zu BerlinBerlinGermany
  2. 2.Singapore Management UniversitySingaporeSingapore
  3. 3.Department of EconomicsCity, University of LondonLondonUK

Personalised recommendations