Abstract
Goodness-of-fit evaluation of a parametric regression model is often done through hypothesis testing, where the fit of the model of interest is compared statistically to that obtained under a broader class of models. Nonparametric regression models are frequently used as the latter type of model, because of their flexibility and wide applicability. To date, this type of tests has generally been performed globally, by comparing the parametric and nonparametric fits over the whole range of the data. However, in some instances it might be of interest to test for deviations from the parametric model that are localized to a subset of the data. In this case, a global test will have low power and hence can miss important local deviations. Alternatively, a naive testing approach that discards all observations outside the local interval will suffer from reduced sample size and potential overfitting. We therefore propose a new local goodness-of-fit test for parametric regression models that can be applied to a subset of the data but relies on global model fits, and propose a bootstrap-based approach for obtaining the distribution of the test statistic. We compare the new approach with the global and the naive tests, both theoretically and through simulations, and illustrate its practical behavior in an application. We find that the local test has a better ability to detect local deviations than the other two tests.
Similar content being viewed by others
References
Alcalá JT, Cristobal JA and González-Manteiga W (1999). Goodness-of-fit test for linear models based on local polynomials. Stat Probab Lett 42: 39–46
Azzalini A, Bowman AW and Härdle W (1989). On the use of nonparametric regression for model checking. Biometrika 76: 1–12
Bjerve S, Doksum KA and Yandell BS (1985). Uniform confidence bounds for regression based on a simple moving average. Scand J Stat 12: 159–169
Cox D, Koh E, Wahba G and Yandell BS (1988). Testing the (parametric) null model hypothesis in (semiparametric) partial and generalized spline models. Ann Stat 16: 113–119
Dette H (1999). A consistent test for the functional form of a regression based on a difference of variance estimators. Ann Stat 27(3): 1012–1040
Eubank RL, Li CS and Wang S (2005). Testing lack-of-fit of parametric regression models using nonparametric regression techniques. Stat Sin 15(1): 135–152
Eubank RL and Spiegelman CH (1990). Testing the goodness of fit of a linear model via nonparametric regression techniques. J Am Stat Assoc 85: 387–392
Fan J and Gijbels I (1996). Local polynomial modelling and its applications. Chapman & Hall, London
Gijbels I and Rousson V (2001). A nonparametric least-squares test for checking a polynomial relationship. Stat Probab Lett 51(3): 253–261
Guerre E and Lavergne P (2002). Optimal minimax rates for nonparametric specification testing in regression models. Econom Theory 18(5): 1139–1171
Härdle W and Mammen E (1993). Comparing nonparametric versus parametric regression fits. Ann Stat 21: 1926–1947
Hart JD (1997). Nonparametric smoothing and lack-of-fit tests. Springer, New York
Horowitz JL and Spokoiny VG (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69(3): 599–631
Johnson, RW (1996) Fitting percentage of body fat to simple body measurements. J Stat Educ 4. http://www.amstat.org/publications/jse/v4nl/datasets.johnson.html
Noether GE (1955). On a theorem of Pitman. Ann Math Stat 26: 64–68
Penrose K, Nelson A and Fisher AA (1985). Generalized body composition prediction equation for men using simple measurement techniques (abstract). Med Sci Sports Exerc 17: 189
Shao J and Tu D (1995). The jacknife and bootstrap. Springer, New York
Spokoiny VG (1996). Adaptive hypothesis testing using wavelets. Ann Stat 24(6): 2477–2498
Staniswalis JG and Severini TA (1991). Diagnostics for assessing regression models. J Am Stat Assoc 86: 684–692
Stute W and González-Manteiga W (1996). NN goodness-of-fit tests for linear models. J Stat Plan Inference 53: 75–92
Tibshirani R and Hastie T (1987). Local likelihood estimation. J Am Stat Assoc 82: 559–567
Weirather G (1993). Testing a linear regression model against nonparametric alternatives. Metrika 40: 367–379
Zheng JH (1996). A consistent test of functional form via nonparametric estimation techniques. J Econom 75: 263–289
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Opsomer, J.D., Francisco-Fernández, M. Finding local departures from a parametric model using nonparametric regression. Stat Papers 51, 69–84 (2010). https://doi.org/10.1007/s00362-007-0116-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-007-0116-x