Time Varying Quantile Lasso

Chapter
Part of the Statistics and Computing book series (SCO)

Abstract

In the present chapter we study the dynamics of penalization parameter \(\lambda \) of the least absolute shrinkage and selection operator (Lasso) method proposed by Tibshirani (J Roy Stat Soc Series B 58:267–288, 1996) and extended into quantile regression context by Li and Zhu (J Comput Graph Stat 17:1–23, 2008). The dynamic behaviour of the parameter \(\lambda \) can be observed when the model is assumed to vary over time and therefore the fitting is performed with the use of moving windows. The proposal of investigating time series of \(\lambda \) and its dependency on model characteristics was brought into focus by Härdle et al. (J Econom 192:499–513, 2016), which was a foundation of FinancialRiskMeter. Following the ideas behind the two aforementioned projects, we use the derivation of the formula for the penalization parameter \(\lambda \) as a result of the optimization problem. This reveals three possible effects driving \(\lambda \); variance of the error term, correlation structure of the covariates and number of nonzero coefficients of the model. Our aim is to disentangle these three effects and investigate their relationship with the tuning parameter \(\lambda \), which is conducted by a simulation study. After dealing with the theoretical impact of the three model characteristics on \(\lambda \), empirical application is performed and the idea of implementing the parameter \(\lambda \) into a systemic risk measure is presented.

Notes

Acknowledgements

Financial support from Deutsche Forschungsgemeinschaft via CRC “Economic Risk” and IRTG 1792 “High Dimensional Non Stationary Time Series”, Humboldt-Universität zu Berlin, is gratefully acknowledged.

References

  1. Adrian, T., & Brunnermeier, M. K. (2016). CoVaR. American Economic Review, 106, 1705–1741.CrossRefGoogle Scholar
  2. Belloni, A., & Chernozhukov, V. (2011). \(\mathit{l}_1\)-penalized quantile regression in high-dimensional sparse models. The Annals of Statistics, 39, 82–130.MathSciNetCrossRefMATHGoogle Scholar
  3. Chand, S. (2012). On tuning parameter selection of lasso-type methods - a monte carlo study. In Proceedings of 9th International Bhurban Conference on Applied Sciences & Technology (pp. 120–129).Google Scholar
  4. Chen, K., & Chan, K. S. (2011). Subset ARMA selection via the adaptive lasso. Statistics and Its Interface, 4, 197–205.MathSciNetCrossRefMATHGoogle Scholar
  5. Diebold, F. X., & Yilmaz, K. (2014). On the network topology of variance decompositions: Measuring the connectedness of financial firms. Journal of Econometrics, 182, 119–134.MathSciNetCrossRefMATHGoogle Scholar
  6. Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004). Least angle regression. The Annals of Statistics, 32, 407–499.MathSciNetCrossRefMATHGoogle Scholar
  7. Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its Oracle properties. Journal of the American Statistical Association, 96, 1348–1360.MathSciNetCrossRefMATHGoogle Scholar
  8. Giglio, S., Kelly, B., & Pruitt, S. (2016). Systemic risk and the macroeconomy: An empirical evaluation. Journal of Financial Economics, 119, 457–471.CrossRefGoogle Scholar
  9. Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference and prediction (2nd ed.). New York: Springer.CrossRefMATHGoogle Scholar
  10. Hautsch, N., Schaumburg, J., & Schienle, M. (2015). Financial network systemic risk contributions. Review of Finance, 19, 685–738.CrossRefGoogle Scholar
  11. Härdle, W. K., Wang, W., & Yu, L. (2016). TENET: Tail-event driven NETwork risk. Journal of Econometrics, 192, 499–513.MathSciNetCrossRefMATHGoogle Scholar
  12. Hsu, N. J., Hung, H. L., & Chang, Y. M. (2008). Subset selection for vector autoregressive processes using lasso. Computational Statistics and Data Analysis, 52, 3645–3657.MathSciNetCrossRefMATHGoogle Scholar
  13. Holló, D., Kremer, M., & Lo Duca, M. (2012). CISS - a composite indicator of systemic stress in the financial system, ECB Working Paper Series No. 1426.Google Scholar
  14. Johansen, S. (1991). Estimation and hypothesis testing of cointegration vectors in gaussian vector autoregressive models. Econometrica, 59, 1551–1580.MathSciNetCrossRefMATHGoogle Scholar
  15. Koenker, R., & Basset, G. (1978). Regression quantiles. Econometrica, 46, 33–50.MathSciNetCrossRefMATHGoogle Scholar
  16. Koenker, R., Ng, P., & Portnoy, S. (1994). Quantile smoothing splines. Biometrica, 81, 673–680.MathSciNetCrossRefMATHGoogle Scholar
  17. Kritzman, M., & Li, Y. (2010). Skulls. Financial Turbulence, ans Risk Management, Financial Analysts Journal, 66, 30–41.Google Scholar
  18. Lee, E. R., Noh, H., & Park, B. U. (2014). Model selection via Bayesian information criterion for quantile regression models. Journal of the American Statistical Association, 109, 216–229.MathSciNetCrossRefMATHGoogle Scholar
  19. Leng, C., Lin, Y., & Wahba, G. (2006). A note on the lasso and related procedures in model selection. Statistica Sinica, 16, 1273–1284.MathSciNetMATHGoogle Scholar
  20. Li, Y., & Zhu, J. (2008). \(L_1\)-norm quantile regression. Journal of Computational and Graphical Statistics, 17, 1–23.MathSciNetCrossRefGoogle Scholar
  21. Nardi, Y., & Rinaldo, A. (2011). Autoregressive process modeling via the lasso procedure. Journal of Multivariate Analysis, 102, 528–549.MathSciNetCrossRefMATHGoogle Scholar
  22. Osborne, M. R. (1985). Finite algorithms in optimization and data analysis, Wiley series in probability and mathematical statistics. Chichester: Wiley.Google Scholar
  23. Osborne, M. R., Presnell, B., & Turlach, B. A. (2000). On the LASSO and its dual. Journal of Computational and Graphical Statistics, 9, 319–337.MathSciNetGoogle Scholar
  24. R Core Team (2014). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/. Accessed 15 April 2015.
  25. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B, 58, 267–288.MathSciNetMATHGoogle Scholar
  26. Wang, H., & Leng, C. (2007). Unified LASSO estimation by least squares approximation. Journal of the American Statistical Association, 102, 1039–1048.MathSciNetCrossRefMATHGoogle Scholar
  27. Wang, H., Li, G., & Tsai, C. L. (2007). Regression coefficient and autoregressive order shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B, 69, 63–78.MathSciNetGoogle Scholar
  28. Wang, H., Li, B., & Leng, C. (2009). Shrinkage tuning parameter selection with a diverging number of parameters. Journal of the Royal Statistical Society: Series B, 71, 671–683.MathSciNetCrossRefMATHGoogle Scholar
  29. Yuan, M. (2006). GACV for quantile smoothing splines. Computational Statistics & Data Analysis, 50, 813–829.MathSciNetCrossRefMATHGoogle Scholar
  30. Zhao, P., & Yu, B. (2006). On model selection consistency of lasso. Journal of Machine Learning Research, 7, 2541–2563.MathSciNetMATHGoogle Scholar
  31. Zou, H. (2006). The adaptive lasso and its Oracle properties. Journal of the American Statistical Association, 101, 1418–1429.MathSciNetCrossRefMATHGoogle Scholar
  32. Zou, H., Hastie, T., & Tibshirani, R. (2007). On the degrees of freedom of the lasso. The Annals of Statistics, 35, 2173–2192.MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Wolfgang Karl Härdle
    • 1
    • 2
  • W. Wang
    • 1
    • 3
  • L. Zboňáková
    • 1
  1. 1.C.A.S.E.-Center of Applied Statistics and EconomicsHumboldt-Universität zu BerlinBerlinGermany
  2. 2.Singapore Management UniversitySingaporeSingapore
  3. 3.Department of EconomicsCity, University of LondonLondonUK

Personalised recommendations