Skip to main content
Log in

A comparison of estimators for regression models with change points

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

We consider two problems concerning locating change points in a linear regression model. One involves jump discontinuities (change-point) in a regression model and the other involves regression lines connected at unknown points. We compare four methods for estimating single or multiple change points in a regression model, when both the error variance and regression coefficients change simultaneously at the unknown point(s): Bayesian, Julious, grid search, and the segmented methods. The proposed methods are evaluated via a simulation study and compared via some standard measures of estimation bias and precision. Finally, the methods are illustrated and compared using three real data sets. The simulation and empirical results overall favor both the segmented and Bayesian methods of estimation, which simultaneously estimate the change point and the other model parameters, though only the Bayesian method is able to handle both continuous and dis-continuous change point problems successfully. If it is known that regression lines are continuous then the segmented method ranked first among methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Andrews, D.W.K.: Tests for parameter instability and structural change with unknown change point. Econometrica 61, 821–856 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Andrews, D.W.K., Ploberger, W.: Optimal tests when a nuisance parameter is present only under the alternative. Econometrica 62, 1383–1414 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  • Bacon, D.W., Watts, D.G.: Estimating the transition between two intersecting straight lines. Biometrika 58, 525–534 (1971)

    Article  MATH  Google Scholar 

  • Bai, J.: Estimation of a change point in multiple regressions models. Rev. Econ. Stat. 79, 551–563 (1997)

    Article  Google Scholar 

  • Carlin, B.P., Gelfand, A.E., Smith, A.F.M.: Hierarchical Bayesian analysis of change point problems. Appl. Stat. 41, 389–405 (1992)

    Article  MATH  Google Scholar 

  • Chen, C.W.S., Lee, J.C.: Bayesian inference of threshold autoregressive models. J. Time Ser. Anal. 16, 483–492 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  • Chen, C.W.S., Gerlach, R., Lin, A.M.H.: Falling and explosive, dormant and rising markets via multiple-regime financial time series models. Appl. Stoch. Models Bus. Ind. 26, 28–49 (2010).

    Article  MathSciNet  MATH  Google Scholar 

  • Chib, S.: Bayes regression with autoregressive errors: a Gibbs sampling approach. J. Econom. 58, 275–294 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Chow, G.: Tests of equality between sets of coefficients in two linear regressions. Econometrica 28, 591–605 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  • Fearnhead, P.: Exact and efficient Bayesian inference for multiple changepoint problems. Stat. Comput. 16, 203–213 (2006)

    Article  MathSciNet  Google Scholar 

  • Ferreira, P.E.: A Bayesian analysis of a switching regression model: a known number of regimes. J. Am. Stat. Assoc. 70, 370–374 (1975)

    Article  MATH  Google Scholar 

  • Hastings, W.K.: Monte-Carlo sampling methods using Markov chains and their applications. Biometrika 57, 97–109 (1970)

    Article  MATH  Google Scholar 

  • Hinkley, D.: Bootstrap methods (with discussion). J. R. Stat. Soc., Ser. B. 50, 321–337 (1988)

    MathSciNet  MATH  Google Scholar 

  • Hinkley, D., Schechtman, E.: Conditional bootstrap methods in the mean-shift model. Biometrika 74, 85–93 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  • Julious, S.A.: Inference and estimation in a changepoint regression problem. J. R. Stat. Soc. Ser. D, Stat. 50, 51–61 (2001)

    Article  MathSciNet  Google Scholar 

  • Kim, H.J., Siegmund, D.: The likelihood ratio test for a changepoint in simple linear regression. Biometrika 76, 409–423 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  • Lerman, P.M.: Fitting segmented regression models by grid search. Appl. Stat. 29, 77–84 (1980)

    Article  Google Scholar 

  • Loader, C.R.: Change point estimation using nonparametric regression. Ann. Stat. 24, 1667–1678 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  • MacNeill, I.B., Mao, Y.: Change-point analysis for mortality and morbidity rate. In: Sinha, B., Rukhin, A., Ahsanullah, M. (eds.) Applied Change Point Problems in Statistics, pp. 37–55 (1995)

  • Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equations of state calculations by fast computing machines. J. Chem. Phys. 21, 1087–1091 (1953)

    Article  Google Scholar 

  • Muggeo, V.M.R.: Estimating regression models with unknown break-points. Stat. Med. 22, 3055–3071 (2003)

    Article  Google Scholar 

  • Muggeo, V.M.R.: Segmented: an R package to fit regression models with broken-line relationships. News. R Proj. 8(1), 20–25 (2008)

    Google Scholar 

  • Pastor, R., Guallar, E.: Use of two-segmented logistic regression to estimate change-points in epidemiologic studies. Am. J. Epidemiol. 148, 631–642 (1998)

    Article  Google Scholar 

  • Quandt, R.E.: The estimation of the parameters of a linear regression system obeying two separate regimes. J. Am. Stat. Assoc. 53, 873–880 (1958)

    Article  MathSciNet  MATH  Google Scholar 

  • Quandt, R.E.: Tests of the hypotheses that a linear regression system obeys two separate regimes. J. Am. Stat. Assoc. 55, 324 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  • Seber, G.A.F., Wild, C.J.: Nonlinear Regression. Wiley, New York (1989)

    Book  MATH  Google Scholar 

  • Smith, A.F.M., Cook, D.G.: Straight lines with a change-point: a Bayesian analysis of some renal transplant data. Appl. Stat. 29, 180–189 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  • Stephens, D.A.: Bayesian retrospective multiple-changepoint identification. Appl. Stat. 43, 159–178 (1994)

    Article  MATH  Google Scholar 

  • Ulm, K.: A statistical method for assessing a threshold in epidemiological studies. Stat. Med. 10, 341–349 (1991)

    Article  Google Scholar 

  • Vostrikova, L.J.: Detecting “disorder” in multidimensional random process. Soviet Math. Dokl. 24, 55–59 (1981)

    MATH  Google Scholar 

  • Zhou, H.L., Liang, K.Y.: On estimating the change point in generalized linear models. In: IMS Collections Beyond Parametrics in Interdisciplinary Research: Festschrift in Honor of Professor Pranab K. Sen, vol. 1, pp. 305–320 (2008)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cathy W. S. Chen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, C.W.S., Chan, J.S.K., Gerlach, R. et al. A comparison of estimators for regression models with change points. Stat Comput 21, 395–414 (2011). https://doi.org/10.1007/s11222-010-9177-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11222-010-9177-0

Keywords

Navigation