Statistical Papers

, 51:69 | Cite as

Finding local departures from a parametric model using nonparametric regression

  • J. D. OpsomerEmail author
  • M. Francisco-Fernández
Regular Article


Goodness-of-fit evaluation of a parametric regression model is often done through hypothesis testing, where the fit of the model of interest is compared statistically to that obtained under a broader class of models. Nonparametric regression models are frequently used as the latter type of model, because of their flexibility and wide applicability. To date, this type of tests has generally been performed globally, by comparing the parametric and nonparametric fits over the whole range of the data. However, in some instances it might be of interest to test for deviations from the parametric model that are localized to a subset of the data. In this case, a global test will have low power and hence can miss important local deviations. Alternatively, a naive testing approach that discards all observations outside the local interval will suffer from reduced sample size and potential overfitting. We therefore propose a new local goodness-of-fit test for parametric regression models that can be applied to a subset of the data but relies on global model fits, and propose a bootstrap-based approach for obtaining the distribution of the test statistic. We compare the new approach with the global and the naive tests, both theoretically and through simulations, and illustrate its practical behavior in an application. We find that the local test has a better ability to detect local deviations than the other two tests.


Cramér-von Mises test Wild bootstrap Local polynomial regression 


  1. Alcalá JT, Cristobal JA and González-Manteiga W (1999). Goodness-of-fit test for linear models based on local polynomials. Stat Probab Lett 42: 39–46 zbMATHCrossRefGoogle Scholar
  2. Azzalini A, Bowman AW and Härdle W (1989). On the use of nonparametric regression for model checking. Biometrika 76: 1–12 zbMATHCrossRefMathSciNetGoogle Scholar
  3. Bjerve S, Doksum KA and Yandell BS (1985). Uniform confidence bounds for regression based on a simple moving average. Scand J Stat 12: 159–169 zbMATHMathSciNetGoogle Scholar
  4. Cox D, Koh E, Wahba G and Yandell BS (1988). Testing the (parametric) null model hypothesis in (semiparametric) partial and generalized spline models. Ann Stat 16: 113–119 zbMATHCrossRefMathSciNetGoogle Scholar
  5. Dette H (1999). A consistent test for the functional form of a regression based on a difference of variance estimators. Ann Stat 27(3): 1012–1040 zbMATHCrossRefMathSciNetGoogle Scholar
  6. Eubank RL, Li CS and Wang S (2005). Testing lack-of-fit of parametric regression models using nonparametric regression techniques. Stat Sin 15(1): 135–152 zbMATHMathSciNetGoogle Scholar
  7. Eubank RL and Spiegelman CH (1990). Testing the goodness of fit of a linear model via nonparametric regression techniques. J Am Stat Assoc 85: 387–392 zbMATHCrossRefMathSciNetGoogle Scholar
  8. Fan J and Gijbels I (1996). Local polynomial modelling and its applications. Chapman & Hall, London zbMATHGoogle Scholar
  9. Gijbels I and Rousson V (2001). A nonparametric least-squares test for checking a polynomial relationship. Stat Probab Lett 51(3): 253–261 zbMATHCrossRefMathSciNetGoogle Scholar
  10. Guerre E and Lavergne P (2002). Optimal minimax rates for nonparametric specification testing in regression models. Econom Theory 18(5): 1139–1171 zbMATHCrossRefMathSciNetGoogle Scholar
  11. Härdle W and Mammen E (1993). Comparing nonparametric versus parametric regression fits. Ann Stat 21: 1926–1947 zbMATHCrossRefGoogle Scholar
  12. Hart JD (1997). Nonparametric smoothing and lack-of-fit tests. Springer, New York zbMATHGoogle Scholar
  13. Horowitz JL and Spokoiny VG (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69(3): 599–631 zbMATHCrossRefMathSciNetGoogle Scholar
  14. Johnson, RW (1996) Fitting percentage of body fat to simple body measurements. J Stat Educ 4.
  15. Noether GE (1955). On a theorem of Pitman. Ann Math Stat 26: 64–68 zbMATHCrossRefMathSciNetGoogle Scholar
  16. Penrose K, Nelson A and Fisher AA (1985). Generalized body composition prediction equation for men using simple measurement techniques (abstract). Med Sci Sports Exerc 17: 189 Google Scholar
  17. Shao J and Tu D (1995). The jacknife and bootstrap. Springer, New York Google Scholar
  18. Spokoiny VG (1996). Adaptive hypothesis testing using wavelets. Ann Stat 24(6): 2477–2498 zbMATHCrossRefMathSciNetGoogle Scholar
  19. Staniswalis JG and Severini TA (1991). Diagnostics for assessing regression models. J Am Stat Assoc 86: 684–692 zbMATHCrossRefMathSciNetGoogle Scholar
  20. Stute W and González-Manteiga W (1996). NN goodness-of-fit tests for linear models. J Stat Plan Inference 53: 75–92 zbMATHCrossRefGoogle Scholar
  21. Tibshirani R and Hastie T (1987). Local likelihood estimation. J Am Stat Assoc 82: 559–567 zbMATHCrossRefMathSciNetGoogle Scholar
  22. Weirather G (1993). Testing a linear regression model against nonparametric alternatives. Metrika 40: 367–379 CrossRefMathSciNetGoogle Scholar
  23. Zheng JH (1996). A consistent test of functional form via nonparametric estimation techniques. J Econom 75: 263–289 zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2008

Authors and Affiliations

  1. 1.Colorado State UniversityFort CollinsUSA
  2. 2.Universidad de A CoruñaCorunnaSpain

Personalised recommendations