Skip to main content
Log in

Finding local departures from a parametric model using nonparametric regression

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

Goodness-of-fit evaluation of a parametric regression model is often done through hypothesis testing, where the fit of the model of interest is compared statistically to that obtained under a broader class of models. Nonparametric regression models are frequently used as the latter type of model, because of their flexibility and wide applicability. To date, this type of tests has generally been performed globally, by comparing the parametric and nonparametric fits over the whole range of the data. However, in some instances it might be of interest to test for deviations from the parametric model that are localized to a subset of the data. In this case, a global test will have low power and hence can miss important local deviations. Alternatively, a naive testing approach that discards all observations outside the local interval will suffer from reduced sample size and potential overfitting. We therefore propose a new local goodness-of-fit test for parametric regression models that can be applied to a subset of the data but relies on global model fits, and propose a bootstrap-based approach for obtaining the distribution of the test statistic. We compare the new approach with the global and the naive tests, both theoretically and through simulations, and illustrate its practical behavior in an application. We find that the local test has a better ability to detect local deviations than the other two tests.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alcalá JT, Cristobal JA and González-Manteiga W (1999). Goodness-of-fit test for linear models based on local polynomials. Stat Probab Lett 42: 39–46

    Article  MATH  Google Scholar 

  • Azzalini A, Bowman AW and Härdle W (1989). On the use of nonparametric regression for model checking. Biometrika 76: 1–12

    Article  MATH  MathSciNet  Google Scholar 

  • Bjerve S, Doksum KA and Yandell BS (1985). Uniform confidence bounds for regression based on a simple moving average. Scand J Stat 12: 159–169

    MATH  MathSciNet  Google Scholar 

  • Cox D, Koh E, Wahba G and Yandell BS (1988). Testing the (parametric) null model hypothesis in (semiparametric) partial and generalized spline models. Ann Stat 16: 113–119

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H (1999). A consistent test for the functional form of a regression based on a difference of variance estimators. Ann Stat 27(3): 1012–1040

    Article  MATH  MathSciNet  Google Scholar 

  • Eubank RL, Li CS and Wang S (2005). Testing lack-of-fit of parametric regression models using nonparametric regression techniques. Stat Sin 15(1): 135–152

    MATH  MathSciNet  Google Scholar 

  • Eubank RL and Spiegelman CH (1990). Testing the goodness of fit of a linear model via nonparametric regression techniques. J Am Stat Assoc 85: 387–392

    Article  MATH  MathSciNet  Google Scholar 

  • Fan J and Gijbels I (1996). Local polynomial modelling and its applications. Chapman & Hall, London

    MATH  Google Scholar 

  • Gijbels I and Rousson V (2001). A nonparametric least-squares test for checking a polynomial relationship. Stat Probab Lett 51(3): 253–261

    Article  MATH  MathSciNet  Google Scholar 

  • Guerre E and Lavergne P (2002). Optimal minimax rates for nonparametric specification testing in regression models. Econom Theory 18(5): 1139–1171

    Article  MATH  MathSciNet  Google Scholar 

  • Härdle W and Mammen E (1993). Comparing nonparametric versus parametric regression fits. Ann Stat 21: 1926–1947

    Article  MATH  Google Scholar 

  • Hart JD (1997). Nonparametric smoothing and lack-of-fit tests. Springer, New York

    MATH  Google Scholar 

  • Horowitz JL and Spokoiny VG (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69(3): 599–631

    Article  MATH  MathSciNet  Google Scholar 

  • Johnson, RW (1996) Fitting percentage of body fat to simple body measurements. J Stat Educ 4. http://www.amstat.org/publications/jse/v4nl/datasets.johnson.html

  • Noether GE (1955). On a theorem of Pitman. Ann Math Stat 26: 64–68

    Article  MATH  MathSciNet  Google Scholar 

  • Penrose K, Nelson A and Fisher AA (1985). Generalized body composition prediction equation for men using simple measurement techniques (abstract). Med Sci Sports Exerc 17: 189

    Google Scholar 

  • Shao J and Tu D (1995). The jacknife and bootstrap. Springer, New York

    Google Scholar 

  • Spokoiny VG (1996). Adaptive hypothesis testing using wavelets. Ann Stat 24(6): 2477–2498

    Article  MATH  MathSciNet  Google Scholar 

  • Staniswalis JG and Severini TA (1991). Diagnostics for assessing regression models. J Am Stat Assoc 86: 684–692

    Article  MATH  MathSciNet  Google Scholar 

  • Stute W and González-Manteiga W (1996). NN goodness-of-fit tests for linear models. J Stat Plan Inference 53: 75–92

    Article  MATH  Google Scholar 

  • Tibshirani R and Hastie T (1987). Local likelihood estimation. J Am Stat Assoc 82: 559–567

    Article  MATH  MathSciNet  Google Scholar 

  • Weirather G (1993). Testing a linear regression model against nonparametric alternatives. Metrika 40: 367–379

    Article  MathSciNet  Google Scholar 

  • Zheng JH (1996). A consistent test of functional form via nonparametric estimation techniques. J Econom 75: 263–289

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. D. Opsomer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Opsomer, J.D., Francisco-Fernández, M. Finding local departures from a parametric model using nonparametric regression. Stat Papers 51, 69–84 (2010). https://doi.org/10.1007/s00362-007-0116-x

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-007-0116-x

Keywords

Navigation