Science China Mathematics

, Volume 61, Issue 9, pp 1677–1694 | Cite as

Penalized profile least squares-based statistical inference for varying coefficient partially linear errors-in-variables models

  • Guo-liang Fan
  • Han-ying Liang
  • Li-xing Zhu


The purpose of this paper is two fold. First, we investigate estimation for varying coefficient partially linear models in which covariates in the nonparametric part are measured with errors. As there would be some spurious covariates in the linear part, a penalized profile least squares estimation is suggested with the assistance from smoothly clipped absolute deviation penalty. However, the estimator is often biased due to the existence of measurement errors, a bias correction is proposed such that the estimation consistency with the oracle property is proved. Second, based on the estimator, a test statistic is constructed to check a linear hypothesis of the parameters and its asymptotic properties are studied. We prove that the existence of measurement errors causes intractability of the limiting null distribution that requires a Monte Carlo approximation and the absence of the errors can lead to a chi-square limit. Furthermore, confidence regions of the parameter of interest can also be constructed. Simulation studies and a real data example are conducted to examine the performance of our estimators and test statistic.


diverging number of parameters varying coefficient partially linear model penalized likelihood SCAD variable selection 


62G08 62G20 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



This work was supported by National Natural Science Foundation of China (Grant Nos. 11401006, 11671299 and 11671042), a grant from the University Grants Council of Hong Kong, the China Postdoctoral Science Foundation (Grant No. 2017M611083), and the National Statistical Science Research Program of China (Grant No. 2015LY55). The authors thank two referees for their insightful comments.


  1. 1.
    Candès E, Tao T. The Dantzig selector: Statistical estimation when p is much larger than n. Ann Statist, 2007, 35: 2313–2351MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Fan G L, Liang H Y, Shen Y. Penalized empirical likelihood for high-dimensional partially linear varying coefficient model with measurement errors. J Multivariate Anal, 2016, 147: 183–201MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Fan G L, Xu H X, Huang Z S. Empirical likelihood for semivarying coefficient model with measurement error in the nonparametric part. AStA Adv Stat Anal, 2016, 100: 21–41MathSciNetCrossRefGoogle Scholar
  4. 4.
    Fan J, Huang T. Profile likelihood inferences on semiparametric varying-coefficient partially linear models. Bernoulli, 2005, 11: 1031–1057MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Fan J, Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. J Amer Statist Assoc, 2001, 96: 1348–1360MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Fan J, Peng H. Nonconcave penalized likelihood with a diverging number of parameters. Ann Statist, 2004, 32: 928–961MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Feng S, Xue L. Bias-corrected statistical inference for partially linear varying coefficient errors-in-variables models with restricted condition. Ann Inst Statist Math, 2014, 66: 121–140MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Härdle W, Liang H, Gao J. Partially Linear Models. Heidelberg: Physica-Verlag, 2000CrossRefzbMATHGoogle Scholar
  9. 9.
    Huang J, Horowitz J, Ma S. Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann Statist, 2008, 36: 587–613MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Kai B, Li R, Zou H. New effcient estimation and variable selection methods for semiparametric varying-coefficient partially linear models. Ann Statist, 2011, 39: 305–332MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Li G, Lin L, Zhu L. Empirical likelihood for a varying coefficient partially linear model with diverging number of parameters. J Multivariate Anal, 2012, 105: 85–111MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Li R, Liang H. Variable selection in semiparametric regression modeling. Ann Statist, 2008, 36: 261–286MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Liang H, Härdle W, Carroll R J. Estimation in a semiparametric partially linear errors-in-variables model. Ann Statist, 1999, 27: 1519–1535MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Long W, Ouyang M, Shang Y. Effcient estimation of partially linear varying coefficient models. Econom Lett, 2013, 121: 79–81MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Matsui H, Misumi T. Variable selection for varying-coefficient models with the sparse regularization. Comput Statist, 2015, 30: 43–55MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    van der Vaart A W. Asymptotic Statistics. New York: Cambridge University Press, 1998CrossRefzbMATHGoogle Scholar
  17. 17.
    Wang G, Wang L. Spline estimation and variable selection for single-index prediction models with diverging number of index parameters. J Statist Plann Inference, 2015, 162: 1–19MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Wang H, Li R, Tsai C L. Tuning parameter selectors for the smoothly clipped absolute deviation method. Biometrika, 2007, 94: 553–568MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Wang L, Lai P, Lian H. Polynomial spline estimation for generalized varying coefficient partially linear models with a diverging number of components. Metrika, 2013, 76: 1083–1103MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Wang T, Xu P R, Zhu L X. Variable selection and estimation for semi-parametric multiple-index models. Bernoulli, 2015, 21: 242–275MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Wu Y, Li L. Asymptotic properties of suffcient dimension reduction with a diverging number of predictors. Statist Sinica, 2011, 2011: 707–730CrossRefzbMATHGoogle Scholar
  22. 22.
    Yang H, Guo C, Lv J. SCAD penalized rank regression with a diverging number of parameters. J Multivariate Anal, 2015, 133: 321–333MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Yeh I C. Modeling of strength of high performance concrete using artificial neural networks. Cement Concrete Res, 1998, 28: 1797–1808CrossRefGoogle Scholar
  24. 24.
    You J, Zhou Y. Empirical likelihood for semiparametric varying-coefficient partially linear regression models. Statist Probab Lett, 2006, 76: 412–422MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Zhang W, Lee S Y, Song X. Local polynomial fitting in semivarying coefficient model. J Multivariate Anal, 2002, 82: 166–188MathSciNetCrossRefzbMATHGoogle Scholar
  26. 26.
    Zhu L, Ng K. Checking the adequacy of a partial linear model. Statist Sinica, 2003, 13: 763–781MathSciNetzbMATHGoogle Scholar
  27. 27.
    Zhu L, Zhu L. On distribution-weighted partial least squares with diverging number of highly correlated predictors. J R Stat Soc Ser B Stat Methodol, 2009, 71: 525–548MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Zhu L, Zhu L. Stable direction recovery in single-index models with a diverging number of predictors. Sci China Math, 2010, 53: 1817–1826MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Zou H, Li R. One-step sparse estimates in nonconcave penalized likelihood models (with discussion). Ann Statist, 2008, 36: 1509–1566MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    Zou H, Zhang H. On the adaptive elastic-net with a diverging number of parameters. Ann Statist, 2009, 37: 1733–1751MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Science China Press and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Institute of Statistics and Big DataRenmin University of ChinaBeijingChina
  2. 2.School of Mathematics and PhysicsAnhui Polytechnic UniversityWuhuChina
  3. 3.School of Mathematical ScienceTongji UniversityShanghaiChina
  4. 4.Department of MathematicsHong Kong Baptist UniversityHong KongChina
  5. 5.School of StatisticsBeijing Normal UniversityBeijingChina

Personalised recommendations