Abstract
In this paper, an M-estimation-based criterion is proposed for carrying out change point analysis and variable selection simultaneously in linear models with a possible change point, which includes the criterion proposed in Wu (2008) as its special case. Under certain mild conditions, this criterion is shown to be strongly consistent in the sense that with probability one, it chooses the smallest true model for large n. Its byproducts include strongly consistent estimates of the regression coefficients regardless if there is a change point. In case that there is a change point, its byproducts also include a strongly consistent estimate of the change point parameter. In addition, an algorithm is given in light of the algorithm in Wu (2008), which has significantly reduced the computation time needed by the proposed criterion for the same precision for a sample of large size. Data examples including a simulation study and a real data example are also provided.
Similar content being viewed by others
References
Chen, J., Gupta, A.K., Pan, J., 2006. Information criterion and change point problem for regular models. Sankhyā, 68, Part 2, 252–282.
Fan, J., Li, R., 2006. Statistical challenges with high dimensionality: Feature selection in knowledge discovery. In: Proceedings of the International Congress of Mathematicians, Madrid, August 22–30, 2006, Vol. III, 595–622.
Garcia, R., Perron, P., 1996. An analysis of the real interest rate under regime shifts. The Review of Economics and Statistics, 78, 111–125.
Huber, P.J., 1973. Robust regression. Ann. Statist., 1, 799–821.
Pan, J., Chen, J., 2006. Application of modified information criterion to multiple change point problems. J. Multivariate Anal., 97, 2221–2241.
Rao, C.R., Wu, Y., 1989. A strongly consistent procedure for model selection in regression problem. Biometrika, 76, 369–374.
Wu, Y., 2008. Simultaneous change point analysis and variable selection in a regression problem. J. Multi-variate Anal., 99, 2154–2171.
Wu, Y., Zen, M.M., 1999. A strongly consistent information criterion for linear model selection based on M-estimation. Probab. Theory and Related Fields, 113, 599–625.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rao, C.R., Wu, Y. & Shi, X. An M-estimation-based Criterion for Simultaneous Change Point Analysis and Variable Selection in a Regression Problem. J Stat Theory Pract 4, 773–801 (2010). https://doi.org/10.1080/15598608.2010.10412018
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1080/15598608.2010.10412018