Simultaneous estimation and variable selection in median regression using Lasso-type penalty
- 259 Downloads
We consider the median regression with a LASSO-type penalty term for variable selection. With the fixed number of variables in regression model, a two-stage method is proposed for simultaneous estimation and variable selection where the degree of penalty is adaptively chosen. A Bayesian information criterion type approach is proposed and used to obtain a data-driven procedure which is proved to automatically select asymptotically optimal tuning parameters. It is shown that the resultant estimator achieves the so-called oracle property. The combination of the median regression and LASSO penalty is computationally easy to implement via the standard linear programming. A random perturbation scheme can be made use of to get simple estimator of the standard error. Simulation studies are conducted to assess the finite-sample performance of the proposed method. We illustrate the methodology with a real example.
KeywordsVariable selection Median regression Least absolute deviations Lasso Perturbation Bayesian information criterion
Unable to display preview. Download preview PDF.
- Chen, S., Donoho, D. (1994). Basis pursuit. In 28th Asilomar Conference Signals. Asilomar: Systems Computers.Google Scholar
- Pollard, D. (1990). Empirical Processes: Theory and Applications, Reginal Conference Series Probability and Statistics: Vol. 2. Hayward: Institute of Mathematical Statistics.Google Scholar
- Stamey T., Kabalin J., McNeal J., Johnstone I., Freiha F., Redwine E., Yang N. (1989) Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate, ii: Radical prostatectomy treated patients. Journal of Urology 16: 1076–1083Google Scholar
- Xu, J. (2005). Parameter estimation, model selection and inferences in L 1-based linear regression. PhD dissertation. Columbia University.Google Scholar