Skip to main content
Log in

An M-estimation-based Criterion for Simultaneous Change Point Analysis and Variable Selection in a Regression Problem

  • Published:
Journal of Statistical Theory and Practice Aims and scope Submit manuscript

Abstract

In this paper, an M-estimation-based criterion is proposed for carrying out change point analysis and variable selection simultaneously in linear models with a possible change point, which includes the criterion proposed in Wu (2008) as its special case. Under certain mild conditions, this criterion is shown to be strongly consistent in the sense that with probability one, it chooses the smallest true model for large n. Its byproducts include strongly consistent estimates of the regression coefficients regardless if there is a change point. In case that there is a change point, its byproducts also include a strongly consistent estimate of the change point parameter. In addition, an algorithm is given in light of the algorithm in Wu (2008), which has significantly reduced the computation time needed by the proposed criterion for the same precision for a sample of large size. Data examples including a simulation study and a real data example are also provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Chen, J., Gupta, A.K., Pan, J., 2006. Information criterion and change point problem for regular models. Sankhyā, 68, Part 2, 252–282.

    MathSciNet  MATH  Google Scholar 

  • Fan, J., Li, R., 2006. Statistical challenges with high dimensionality: Feature selection in knowledge discovery. In: Proceedings of the International Congress of Mathematicians, Madrid, August 22–30, 2006, Vol. III, 595–622.

    Google Scholar 

  • Garcia, R., Perron, P., 1996. An analysis of the real interest rate under regime shifts. The Review of Economics and Statistics, 78, 111–125.

    Article  Google Scholar 

  • Huber, P.J., 1973. Robust regression. Ann. Statist., 1, 799–821.

    Article  MathSciNet  Google Scholar 

  • Pan, J., Chen, J., 2006. Application of modified information criterion to multiple change point problems. J. Multivariate Anal., 97, 2221–2241.

    Article  MathSciNet  Google Scholar 

  • Rao, C.R., Wu, Y., 1989. A strongly consistent procedure for model selection in regression problem. Biometrika, 76, 369–374.

    Article  MathSciNet  Google Scholar 

  • Wu, Y., 2008. Simultaneous change point analysis and variable selection in a regression problem. J. Multi-variate Anal., 99, 2154–2171.

    Article  MathSciNet  Google Scholar 

  • Wu, Y., Zen, M.M., 1999. A strongly consistent information criterion for linear model selection based on M-estimation. Probab. Theory and Related Fields, 113, 599–625.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to C. R. Rao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rao, C.R., Wu, Y. & Shi, X. An M-estimation-based Criterion for Simultaneous Change Point Analysis and Variable Selection in a Regression Problem. J Stat Theory Pract 4, 773–801 (2010). https://doi.org/10.1080/15598608.2010.10412018

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1080/15598608.2010.10412018

AMS Subject Classification

Key-words

Navigation