Abstract
We study variable selection in quantile regression with multiple responses. Instead of applying conventional penalized quantile regression to each response separately, it is desired to solve them simultaneously when the sparsity patterns of the regression coefficients for different responses are similar, which is often the case in practice. In this paper, we propose employing a hierarchical penalty that enables us to detect a common sparsity pattern shared between different responses as well as additional sparsity patterns within the selected variables. We establish the oracle property of the proposed method and demonstrate it offers better performance than existing approaches.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bang, S., & Jhun, M. (2014). Adaptive sup-norm regularized simultaneous multiple quantiles regression. Statistics, (ISSN: 0233-1888) 48(5), 17–33.
Bang, S., Kang, J., Jhun, M., & Kim, E. (2017). Hierarchically penalized support vector machine with grouped variables. International Journal of Machine Learning and Cybernetics, (ISSN: 1868-8071) 8(5), 1211–1221.
Breiman, L. (1995). Better subset regression using the nonnegative Garrote. Technometrics, (ISSN: 0040-1706) 37(5), 373–384.
Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(5), 1348–1360.
Kang, J., Bang, S., & Jhun, M. (2016). Hierarchically penalized quantile regression. Journal of Statistical Computation and Simulation, (ISSN: 0094-9655) 86(5), 340–356.
Knight, K. (1999). Asymptotics for L-1-estimators of regression parameters under heteroscedasticity. Canadian Journal of Statistics-Revue Canadienne de Statistique, (ISSN: 0319-5724) 27(5), 497–507.
Koenker, R. (2005). Econometric Society Monographs. Quantile Regression. Cambridge: Cambridge University Press, ISBN: 9780521845731, 0521845734, 9780521608275, 0521608279.
Koenker, R., & Bassett, G. (1978). Regression quantiles. Econometrica, (ISSN: 0012-9682) 46(5), 33–50.
Li, Y. J., & Zhu, J. (2008). L-1-norm quantile regression. Journal of Computational and Graphical Statistics, (ISSN: 1061-8600) 17(5), 163–185.
Tsanas, A., Little, M. A., McSharry, P. E., & Ramig, L. O. (2010). Accurate telemonitoring of parkinsons disease progression by noninvasive speech tests. IEEE Trans. Biomed. Eng., (ISSN: 0018-9294) 57(5), 884–893.
Wang, S., Nan, B., Zhu, N., & Zhu, J. (2009). Hierarchically penalized Cox regression with grouped variables. Biometrika, (ISSN: 0006-3444) 96(5), 307–322.
Wu, Y. C., & Liu, Y. F. (2009). Variable selection in quantile regression. Statistica Sinica, (ISSN: 1017-0405) 19(5), 801–817.
Yeh, I.C.(2007). Modeling slump flowofconcrete using second-order regressions and artificial neural networks. Cement & Concrete Composites, (ISSN: 0958-9465) 29(5), 474–480.
Yu, K. M., Lu, Z. D., & Stander, J. (2003). Quantile regression: applications and current research areas. Journal of the Royal Statistical Society Series D-the Statistician, (ISSN: 0039-0526) 52, 331–350.
Zhang, C. H. (2010). Nearly unbiased variable selection under minimax concave penalty. The Annals of Statistics, 38(5), 894–942.
Zou, H., & Yuan, M. (2008). Regularized simultaneous model selection in multiple quantiles regression. Computational Statistics & Data Analysis, (ISSN: 0167-9473) 52(5), 5296–5304.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kang, J., Shin, S.J., Park, J. et al. Hierarchically penalized quantile regression with multiple responses. J. Korean Stat. Soc. 47, 471–481 (2018). https://doi.org/10.1016/j.jkss.2018.05.004
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1016/j.jkss.2018.05.004