Mixing partially linear regression models
- 168 Downloads
In semiparametric modeling, often the main interest is on the parametric part. When a model selection step is performed to choose important variables for the parametric part, the selection uncertainty may or may not be negligible. If it is high, not only the identified model is not trustworthy but also the resulting estimator may have unnecessarily high variability. We propose model selection diagnostic measures both for variable selection and for regression estimation, which provide crucial information on reliability of the selected model and choice between model selection and model averaging for regression estimation. We study a model mixing method for estimating the linear function in a partially linear regression model and derive oracle inequalities that show the mixed estimators perform nearly as well as the best estimator from the candidate models. Simulation and data examples are encouraging.
Keywords and phrasesAdaptive regression by mixing Model selection Model selection diagnostics Partially linear model Semi-parametric modeling
AMS (2000) subject classificationPrimary 62G08 62G10 Secondary 62G20
- dalalyan, a.s. and tsybakov, a.b. (2007). Aggregation by Exponential Weighting and Sharp Oracle Inequalities. In Lecture Notes in Computer Science 4539 LNAI, pp 97–111.Google Scholar
- wahba, g. (1984). Partial Spline Models for the Semiparametric Estimation of Functions of Several Variables. In Statistical Analysis of Time Series. Institute of Statistical Mathematics, Tokyo, pp 312–329.Google Scholar