Skip to main content
Log in

On statistical models for regression diagnostics

  • Regression
  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

In regression diagnostics, the case deletion model (CDM) and the mean shift outlier model (MSOM) are commonly used in practice. In this paper we show that the estimates of CDM and MSOM are equal in a wide class of statistical models, which include LSE, MLE, Bayesian estimate andM-estimate in linear and nonlinear regression models; MLE in generalized linear models and exponential family nonlinear models; MLEs of transformation parameters of explanatory variables in a Box-Cox regression models and so on. Furthermore, we study some models, in which, the estimates are not exactly equal but are approximately equal for CDM and MSOM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Beckman, R. J. and Cook, R. D. (1983). Outlier⋯s,Technometrics,25, 119–149.

    Google Scholar 

  • Box, G. E. P. and Tiao, G. C. (1973).Bayesian Inference in Statistical Analysis, Addison-Weley, Reading, Massachusetts.

    Google Scholar 

  • Cook, R. D. and Tsai, C. L. (1990). Diagnostics for assessing the accuracy of normal approximations in exponential family nonlinear models,J. Amer. Statist. Assoc.,85, 770–777.

    Google Scholar 

  • Cook, R. D. and Wang, P. C. (1983). Transformation and influential cases in regression,Technometrics,25, 337–343.

    Google Scholar 

  • Cook, R. D. and Weisberg, S. (1982).Residuals and Influence in Regression, Chapman and Hall, New York.

    Google Scholar 

  • Cox, D. R. and Oakes, D. (1984).Analysis of Survival Data, Chapman and Hall, London.

    Google Scholar 

  • Davison, A. C. and Tsai, C. L. (1992). Regression model diagnostics,Internat. Statist. Rev.,60, 337–353.

    Google Scholar 

  • Dzieciolowski, K. and Ross, W. H. (1990). Assessing case influence on confidence intervals in nonlinear regression,Canad. J. Statist.,18, 127–139.

    Google Scholar 

  • Fang, K. T., Kotz, S. and Ng, K. W. (1990).Symmetric Multivariate and Related Distributions, Chapman and Hall, London.

    Google Scholar 

  • Gay, D. M. and Welsch, R. E. (1988). Maximum likelihood and quasi-likelihood for nonlinear exponential family regression models,J. Amer. Statist. Assoc.,83, 990–998.

    Google Scholar 

  • Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model,J. Roy. Statist. Soc. Ser. B,34, 1–42.

    Google Scholar 

  • McCullagh, P. and Nelder, J. A. (1989).Generalized Linear Models, Chapman and Hall, London.

    Google Scholar 

  • Pregibon, D. (1981). Logistic regression diagnostics,Ann. Statist.,9, 705–724.

    Google Scholar 

  • Ross, W. H. (1987). The geometry of case deletion and the assessment of influence in nonlinear regression,Canad. J. Statist.,15, 91–103.

    Google Scholar 

  • Storer, B. E. and Crowley, J. (1985). A diagnostic for Cox regression and general conditional likelihoods,J. Amer. Statist. Assoc.,80, 139–147.

    Google Scholar 

  • Tsai, C. L. and Wu, X. (1990). Diagnostics in transformation and weighted regression,Technometrics,32, 315–322.

    Google Scholar 

  • Weisberg, S. (1985).Applied Linear Regression, 2nd ed., John Wiley, New York.

    Google Scholar 

  • Williams, D. A. (1987). Generalized linear model diagnostics using the deviance and single case deletions,Appl. Statist.,36, 181–191.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Wei, BC., Shih, JQ. On statistical models for regression diagnostics. Ann Inst Stat Math 46, 267–278 (1994). https://doi.org/10.1007/BF01720584

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01720584

Key words and phrases

Navigation