Abstract
In regression diagnostics, the case deletion model (CDM) and the mean shift outlier model (MSOM) are commonly used in practice. In this paper we show that the estimates of CDM and MSOM are equal in a wide class of statistical models, which include LSE, MLE, Bayesian estimate andM-estimate in linear and nonlinear regression models; MLE in generalized linear models and exponential family nonlinear models; MLEs of transformation parameters of explanatory variables in a Box-Cox regression models and so on. Furthermore, we study some models, in which, the estimates are not exactly equal but are approximately equal for CDM and MSOM.
Similar content being viewed by others
References
Beckman, R. J. and Cook, R. D. (1983). Outlier⋯s,Technometrics,25, 119–149.
Box, G. E. P. and Tiao, G. C. (1973).Bayesian Inference in Statistical Analysis, Addison-Weley, Reading, Massachusetts.
Cook, R. D. and Tsai, C. L. (1990). Diagnostics for assessing the accuracy of normal approximations in exponential family nonlinear models,J. Amer. Statist. Assoc.,85, 770–777.
Cook, R. D. and Wang, P. C. (1983). Transformation and influential cases in regression,Technometrics,25, 337–343.
Cook, R. D. and Weisberg, S. (1982).Residuals and Influence in Regression, Chapman and Hall, New York.
Cox, D. R. and Oakes, D. (1984).Analysis of Survival Data, Chapman and Hall, London.
Davison, A. C. and Tsai, C. L. (1992). Regression model diagnostics,Internat. Statist. Rev.,60, 337–353.
Dzieciolowski, K. and Ross, W. H. (1990). Assessing case influence on confidence intervals in nonlinear regression,Canad. J. Statist.,18, 127–139.
Fang, K. T., Kotz, S. and Ng, K. W. (1990).Symmetric Multivariate and Related Distributions, Chapman and Hall, London.
Gay, D. M. and Welsch, R. E. (1988). Maximum likelihood and quasi-likelihood for nonlinear exponential family regression models,J. Amer. Statist. Assoc.,83, 990–998.
Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model,J. Roy. Statist. Soc. Ser. B,34, 1–42.
McCullagh, P. and Nelder, J. A. (1989).Generalized Linear Models, Chapman and Hall, London.
Pregibon, D. (1981). Logistic regression diagnostics,Ann. Statist.,9, 705–724.
Ross, W. H. (1987). The geometry of case deletion and the assessment of influence in nonlinear regression,Canad. J. Statist.,15, 91–103.
Storer, B. E. and Crowley, J. (1985). A diagnostic for Cox regression and general conditional likelihoods,J. Amer. Statist. Assoc.,80, 139–147.
Tsai, C. L. and Wu, X. (1990). Diagnostics in transformation and weighted regression,Technometrics,32, 315–322.
Weisberg, S. (1985).Applied Linear Regression, 2nd ed., John Wiley, New York.
Williams, D. A. (1987). Generalized linear model diagnostics using the deviance and single case deletions,Appl. Statist.,36, 181–191.
Author information
Authors and Affiliations
About this article
Cite this article
Wei, BC., Shih, JQ. On statistical models for regression diagnostics. Ann Inst Stat Math 46, 267–278 (1994). https://doi.org/10.1007/BF01720584
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01720584