Abstract
We study partial linear single index models when the response and the covariates in the parametric part are measured with errors and distorted by unknown functions of commonly observable confounding variables, and propose a semiparametric covariate-adjusted estimation procedure. We apply the minimum average variance estimation method to estimate the parameters of interest. This is different from all existing covariate-adjusted methods in the literature. Asymptotic properties of the proposed estimators are established. Moreover, we also study variable selection by adopting the coordinate-independent sparse estimation to select all relevant but distorted covariates in the parametric part. We show that the resulting sparse estimators can exclude all irrelevant covariates with probability approaching one. A simulation study is conducted to evaluate the performance of the proposed methods and a real data set is analyzed for illustration.
Similar content being viewed by others
References
Akaike H. (1973) Maximum likelihood identification of Gaussian autoregressive moving average models. Biometrika 60: 255–265
Breiman L. (1996) Heuristics of instability and stabilization in model selection. The Annals of Statistics 24: 2350–2383
Carroll R., Fan J., Gijbels I., Wand M.P. (1997) Generalized partially linear single-index models. Journal of the American Statistical Association 92: 477–489
Carroll, R. J., Ruppert, D., Stefanski, L. A., Crainiceanu, C. M. (2006). Nonlinear measurement error models: A modern perspective (2nd ed.). New York: Chapman and Hall.
Chen H. (1988) Convergence rates for parametric components in a partly linear model. The Annals of Statistics 16: 136–146
Chen X., Zou C., Cook R.D. (2010) Coordinate-independent sparse sufficient dimension reduction and variable selection. The Annals of Statistics 38: 3696–3723
Cui X., Guo W., Lin L., Zhu L. (2009) Covariate-adjusted nonlinear regression. The Annals of Statistics 37: 1839–1870
Efron B., Hastie T., Johnstone I., Tibshirani R. (2004) Least angle regression. The Annals of Statistics 32: 407–499
Fan J., Gijbels I. (1996) Local polynomial modelling and its applications. Chapman & Hall, London
Fan J., Li R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96: 1348–1360
Fan J., Zhang W. (1999) Statistical estimation in varying coefficient models. The Annals of Statistics 27: 1491–1518
Härdle W., Hall P., Ichimura H. (1993) Optimal smoothing in single-index models. The Annals of Statistics 21: 157–178
Härdle W., Liang H., Gao J.T. (2000) Partially linear models. Springer Physica, Heidelberg
Härdle W., Müller M., Sperlich S., Werwatz A. (2004) Nonparametric and semiparametric models. Springer-Verlag, New York
Hastie T., Tibshirani R. (1993) Varying-coefficient models. Journal of the Royal Statistical Society, Series B 55: 757–796
Heckman N.E. (1986) Spline smoothing in partly linear models. Journal of the Royal Statistical Society, Series B 48: 244–248
Horowitz J. L. (2009) Semiparametric and nonparametric methods in econometrics. Springer, New York
Horowitz J. L., Härdle W. (1996) Direct semiparametric estimation of single-index models with discrete covariates. Journal of the American Statistical Association 91: 1632–1640
Ichimura H. (1993) Semiparametric least squares (SLS) and weighted SLS estimation of single-index models. Journal of Econometrics 58: 71–120
Kato T. (1983) Perturbation theory for linear operation. (2nd ed.). Springer, New York
Kaysen G.A., Dubin J.A., Müller H.-G., Mitch W.E., Rosales L.M., Nathan W. Levin the Hemo Study Group (2002) Relationships among inflammation nutrition and physiologic mechanisms establishing albumin levels in hemodialysis patients. Kidney International 61: 2240–2249
Li L. (2007) Sparse sufficient dimension reduction. Biometrika 94: 603–613
Li R., Liang H. (2008) Variable selection in semiparametric regression modeling. The Annals of Statistics 36: 261–286
Liang H., Li R. (2009) Variable selection for partially linear models with measurement errors. Journal of the American Statistical Association 104: 234–248
Liang H., Liu X., Li R., Tsai C.L. (2010) Estimation and testing for partially linear single-index models. The Annals of Statistics 38: 3811–3836
Mack Y.P., Silverman B.W. (1982) Weak and strong uniform consistency of kernel regression estimates. Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete 61: 405–415
Mallows C.L. (1973) Some comments on C P . Technometrics 15: 661–675
Schwarz G. (1978) Estimating the dimension of a model. The Annals of Statistics 6: 461–464
Şentürk D., Müller H.-G. (2005) Covariate-adjusted regression. Biometrika 92: 75–89
Şentürk D., Müller H.-G. (2006) Inference for covariate adjusted regression via varying coefficient models. The Annals of Statistics 34: 654–679
Şentürk D., Müller H.-G. (2009) Covariate-adjusted generalized linear models. Biometrika 96: 357–370
Serfling R.J. (1980) Approximation theorems of mathematical statistics. Wiley, New York
Speckman P.E. (1988) Kernel smoothing in partial linear models. Journal of the Royal Statistical Society, Series B 50: 413–436
Stute W., Zhu L.-X. (2005) Nonparametric checks for single-index models. The Annals of Statistics 33: 1048–1083
Tibshirani R. (1996) Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 58: 267–288
Wahba, G. (1984). Partial spline models for the semiparametric estimation of functions of several variables. Statistical Analyses for Time Series, Institute of Statistical Mathematics, Tokyo (pp. 319–329). Japan-US Joint Seminar.
Wang J.-L., Xue L., Zhu L., Chong Y.S. (2010) Estimation for a partial-linear single-index model. The Annals of Statistics 38: 246–274
Wang L., Liu X., Liang H., Carroll R.J. (2011) Estimation and variable selection for generalized additive partial linear models. The Annals of Statistics 39: 1827–1851
Xia Y., Härdle W. (2006) Semi-parametric estimation of partially linear single-index models. Journal of Multivariate Analysis 97: 1162–1184
Xia Y., Tong H., Li W.K., Zhu L.-X. (2002) An adaptive estimation of dimension reduction space. Journal of the Royal Statistical Society, Series B 64: 363–410
Yu Y., Ruppert D. (2002) Penalized spline estimation for partially linear single-index models. Journal of the American Statistical Association 97: 1042–1054
Zhang J., Zhu L.-P., Zhu L.-X. (2012) On a dimension reduction regression with covariate adjustment. Journal of Multivariate Analysis 104: 39–55
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Zhang, J., Yu, Y., Zhu, LX. et al. Partial linear single index models with distortion measurement errors. Ann Inst Stat Math 65, 237–267 (2013). https://doi.org/10.1007/s10463-012-0371-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-012-0371-z