Abstract
Consider a heteroscedastic regression model Y=m(X)+σ(X)ε, where m(X)=E(Y|X) and σ 2(X)=Var (Y|X) are unknown, and the error ε is independent of the covariate X. We propose a new type of test statistic for testing whether the regression curve m(⋅) belongs to some parametric family of regression functions. The proposed test statistic measures the distance between the empirical distribution function of the parametric and of the nonparametric residuals. The asymptotic theory of the proposed test is developed, and the proposed testing procedure is illustrated by means of a small simulation study and the analysis of a data set.
Similar content being viewed by others
References
Akritas MG, Van Keilegom I (2001) Nonparametric estimation of the residual distribution. Scand J Stat 28:549–568
Alcalá JT, Cristóbal JA, González Manteiga W (1999) Goodness-of-fit test for linear models based on local polynomials. Stat Probab Lett 42:39–46
Bellver C (1987) Influence of particulate pollution on the positions of neutral points in the sky in Seville (Spain). Atmos Environ 21:699–702
Chen SX, Härdle W, Li M (2003) An empirical likelihood goodness-of-fit test for time series. J Roy Stat Soc Ser B 65:663–678
Choi E, Hall P, Rousson V (2000) Data sharpening methods for bias reduction in nonparametric regression. Ann Stat 28:1339–1355
Cleveland WS (1993) Visualizing data. Hobart Press, Summit
Dette H (1999) A consistent test for the functional form of a regression based on a difference of variance estimators. Ann Stat 27:1012–1040
Dette H, Munk A (1998) Validation of linear regression models. Ann Stat 26:778–800
Dette H, Munk A, Wagner T (2000) Testing model assumptions in multivariate linear regression models. J Nonparametric Stat 12:309–342
Fan J, Zhang C, Zhang J (2001) Generalized likelihood ratio statistics and Wilks phenomenon. Ann Stat 29:153–193
González Manteiga W, Prada Sánchez JM, Romo J (1994) The bootstrap—a review. Comput Stat 9:165–205
Hall P, DiCiccio TJ, Romano JP (1989) On smoothing and the bootstrap. Ann Stat 17:692–704
Härdle W, Mammen E (1993) Comparing nonparametric versus parametric regression fits. Ann Stat 21:1926–1947
Hart JD (1997) Nonparametric smoothing and lack-of-fit tests. Springer, New York
Jennrich RI (1969) Asymptotic properties of non-linear least-squares estimators. Ann Math Stat 40:633–643
Koul HL, Lahiri SN (1994) On bootstrapping M-estimated residual processes in multiple linear regression models. J Multivar Anal 49:255–265
Mammen E (2000) Resampling methods for nonparametric regression. In: Schimek MG (ed) Smoothing and regression. Wiley, New York
Sánchez Sellero C (2001) Inferencia estadística en datos con censura y/o truncamiento. PhD thesis, University of Santiago de Compostela
Seber GAF, Wild CJ (1989) Nonlinear regression. Wiley, New York
Stute W (1997) Nonparametric model checks for regression. Ann Stat 25:613–641
Stute W, González Manteiga W, Presedo Quindimil M (1998) Bootstrap approximations in model checks for regression. J Am Stat Assoc 93:141–149
Van der Vaart AW (1998) Asymptotic statistics. Cambridge University Press, Cambridge
Van Keilegom I, Veraverbeke N (2002) Density and hazard estimation in censored regression models. Bernoulli 8:607–625
White H (1981) Consequences and detection of misspecified nonlinear regression models. J Am Stat Assoc 76:419–433
White H (1982) Maximum likelihood estimation of misspecified models. Econometrica 50:1–25
Wu CF (1981) Asymptotic theory of nonlinear least-squares estimation. Ann Stat 9:501–513
Zhang CM (2003) Adaptive tests of regression functions via multiscale generalized likelihood ratios. Can J Stat 31:151–171
Zhang CM, Dette H (2004) A power comparison between nonparametric regression tests. Stat Probab Lett 66:289–301
Zhu L-X (2003) Model checking of dimension-reduction type for regression. Stat Sin 13:283–296
Author information
Authors and Affiliations
Corresponding author
Additional information
I.V.K. is financially supported by the IAP research network nr. P5/24 of the Belgian government (Belgian Science Policy). W.G.M. and C.S.S. are financially supported by the Spanish Ministry of Science and Technology (with additional European FEDER support) through project MTM2005-00820 and from Xunta de Galicia through project PGIDIT03PXIC20702PN.
Rights and permissions
About this article
Cite this article
Van Keilegom, I., González Manteiga, W. & Sánchez Sellero, C. Goodness-of-fit tests in parametric regression based on the estimation of the error distribution. TEST 17, 401–415 (2008). https://doi.org/10.1007/s11749-007-0044-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11749-007-0044-z
Keywords
- Bootstrap
- Goodness-of-fit
- Heteroscedastic regression
- Model check
- Nonlinear regression
- Nonparametric regression
- Residual distribution