Skip to main content
Log in

Partial linear single index models with distortion measurement errors

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We study partial linear single index models when the response and the covariates in the parametric part are measured with errors and distorted by unknown functions of commonly observable confounding variables, and propose a semiparametric covariate-adjusted estimation procedure. We apply the minimum average variance estimation method to estimate the parameters of interest. This is different from all existing covariate-adjusted methods in the literature. Asymptotic properties of the proposed estimators are established. Moreover, we also study variable selection by adopting the coordinate-independent sparse estimation to select all relevant but distorted covariates in the parametric part. We show that the resulting sparse estimators can exclude all irrelevant covariates with probability approaching one. A simulation study is conducted to evaluate the performance of the proposed methods and a real data set is analyzed for illustration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Akaike H. (1973) Maximum likelihood identification of Gaussian autoregressive moving average models. Biometrika 60: 255–265

    Article  MathSciNet  MATH  Google Scholar 

  • Breiman L. (1996) Heuristics of instability and stabilization in model selection. The Annals of Statistics 24: 2350–2383

    Article  MathSciNet  MATH  Google Scholar 

  • Carroll R., Fan J., Gijbels I., Wand M.P. (1997) Generalized partially linear single-index models. Journal of the American Statistical Association 92: 477–489

    Article  MathSciNet  MATH  Google Scholar 

  • Carroll, R. J., Ruppert, D., Stefanski, L. A., Crainiceanu, C. M. (2006). Nonlinear measurement error models: A modern perspective (2nd ed.). New York: Chapman and Hall.

  • Chen H. (1988) Convergence rates for parametric components in a partly linear model. The Annals of Statistics 16: 136–146

    Article  MathSciNet  MATH  Google Scholar 

  • Chen X., Zou C., Cook R.D. (2010) Coordinate-independent sparse sufficient dimension reduction and variable selection. The Annals of Statistics 38: 3696–3723

    Article  MathSciNet  MATH  Google Scholar 

  • Cui X., Guo W., Lin L., Zhu L. (2009) Covariate-adjusted nonlinear regression. The Annals of Statistics 37: 1839–1870

    Article  MathSciNet  MATH  Google Scholar 

  • Efron B., Hastie T., Johnstone I., Tibshirani R. (2004) Least angle regression. The Annals of Statistics 32: 407–499

    Article  MathSciNet  MATH  Google Scholar 

  • Fan J., Gijbels I. (1996) Local polynomial modelling and its applications. Chapman & Hall, London

    MATH  Google Scholar 

  • Fan J., Li R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96: 1348–1360

    Article  MathSciNet  MATH  Google Scholar 

  • Fan J., Zhang W. (1999) Statistical estimation in varying coefficient models. The Annals of Statistics 27: 1491–1518

    Article  MathSciNet  MATH  Google Scholar 

  • Härdle W., Hall P., Ichimura H. (1993) Optimal smoothing in single-index models. The Annals of Statistics 21: 157–178

    Article  MathSciNet  MATH  Google Scholar 

  • Härdle W., Liang H., Gao J.T. (2000) Partially linear models. Springer Physica, Heidelberg

    Book  MATH  Google Scholar 

  • Härdle W., Müller M., Sperlich S., Werwatz A. (2004) Nonparametric and semiparametric models. Springer-Verlag, New York

    Book  MATH  Google Scholar 

  • Hastie T., Tibshirani R. (1993) Varying-coefficient models. Journal of the Royal Statistical Society, Series B 55: 757–796

    MathSciNet  MATH  Google Scholar 

  • Heckman N.E. (1986) Spline smoothing in partly linear models. Journal of the Royal Statistical Society, Series B 48: 244–248

    MathSciNet  MATH  Google Scholar 

  • Horowitz J. L. (2009) Semiparametric and nonparametric methods in econometrics. Springer, New York

    Book  Google Scholar 

  • Horowitz J. L., Härdle W. (1996) Direct semiparametric estimation of single-index models with discrete covariates. Journal of the American Statistical Association 91: 1632–1640

    Article  MathSciNet  Google Scholar 

  • Ichimura H. (1993) Semiparametric least squares (SLS) and weighted SLS estimation of single-index models. Journal of Econometrics 58: 71–120

    Article  MathSciNet  MATH  Google Scholar 

  • Kato T. (1983) Perturbation theory for linear operation. (2nd ed.). Springer, New York

    Google Scholar 

  • Kaysen G.A., Dubin J.A., Müller H.-G., Mitch W.E., Rosales L.M., Nathan W. Levin the Hemo Study Group (2002) Relationships among inflammation nutrition and physiologic mechanisms establishing albumin levels in hemodialysis patients. Kidney International 61: 2240–2249

    Article  Google Scholar 

  • Li L. (2007) Sparse sufficient dimension reduction. Biometrika 94: 603–613

    Article  MathSciNet  MATH  Google Scholar 

  • Li R., Liang H. (2008) Variable selection in semiparametric regression modeling. The Annals of Statistics 36: 261–286

    Article  MathSciNet  MATH  Google Scholar 

  • Liang H., Li R. (2009) Variable selection for partially linear models with measurement errors. Journal of the American Statistical Association 104: 234–248

    Article  MathSciNet  Google Scholar 

  • Liang H., Liu X., Li R., Tsai C.L. (2010) Estimation and testing for partially linear single-index models. The Annals of Statistics 38: 3811–3836

    Article  MathSciNet  MATH  Google Scholar 

  • Mack Y.P., Silverman B.W. (1982) Weak and strong uniform consistency of kernel regression estimates. Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete 61: 405–415

    Article  MathSciNet  MATH  Google Scholar 

  • Mallows C.L. (1973) Some comments on C P . Technometrics 15: 661–675

    MATH  Google Scholar 

  • Schwarz G. (1978) Estimating the dimension of a model. The Annals of Statistics 6: 461–464

    Article  MathSciNet  MATH  Google Scholar 

  • Şentürk D., Müller H.-G. (2005) Covariate-adjusted regression. Biometrika 92: 75–89

    Article  MathSciNet  MATH  Google Scholar 

  • Şentürk D., Müller H.-G. (2006) Inference for covariate adjusted regression via varying coefficient models. The Annals of Statistics 34: 654–679

    MATH  Google Scholar 

  • Şentürk D., Müller H.-G. (2009) Covariate-adjusted generalized linear models. Biometrika 96: 357–370

    Article  MathSciNet  MATH  Google Scholar 

  • Serfling R.J. (1980) Approximation theorems of mathematical statistics. Wiley, New York

    Book  MATH  Google Scholar 

  • Speckman P.E. (1988) Kernel smoothing in partial linear models. Journal of the Royal Statistical Society, Series B 50: 413–436

    MathSciNet  MATH  Google Scholar 

  • Stute W., Zhu L.-X. (2005) Nonparametric checks for single-index models. The Annals of Statistics 33: 1048–1083

    Article  MathSciNet  MATH  Google Scholar 

  • Tibshirani R. (1996) Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 58: 267–288

    MathSciNet  MATH  Google Scholar 

  • Wahba, G. (1984). Partial spline models for the semiparametric estimation of functions of several variables. Statistical Analyses for Time Series, Institute of Statistical Mathematics, Tokyo (pp. 319–329). Japan-US Joint Seminar.

  • Wang J.-L., Xue L., Zhu L., Chong Y.S. (2010) Estimation for a partial-linear single-index model. The Annals of Statistics 38: 246–274

    MathSciNet  MATH  Google Scholar 

  • Wang L., Liu X., Liang H., Carroll R.J. (2011) Estimation and variable selection for generalized additive partial linear models. The Annals of Statistics 39: 1827–1851

    Article  MathSciNet  MATH  Google Scholar 

  • Xia Y., Härdle W. (2006) Semi-parametric estimation of partially linear single-index models. Journal of Multivariate Analysis 97: 1162–1184

    Article  MathSciNet  MATH  Google Scholar 

  • Xia Y., Tong H., Li W.K., Zhu L.-X. (2002) An adaptive estimation of dimension reduction space. Journal of the Royal Statistical Society, Series B 64: 363–410

    MathSciNet  MATH  Google Scholar 

  • Yu Y., Ruppert D. (2002) Penalized spline estimation for partially linear single-index models. Journal of the American Statistical Association 97: 1042–1054

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang J., Zhu L.-P., Zhu L.-X. (2012) On a dimension reduction regression with covariate adjustment. Journal of Multivariate Analysis 104: 39–55

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hua Liang.

About this article

Cite this article

Zhang, J., Yu, Y., Zhu, LX. et al. Partial linear single index models with distortion measurement errors. Ann Inst Stat Math 65, 237–267 (2013). https://doi.org/10.1007/s10463-012-0371-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-012-0371-z

Keywords

Navigation