Skip to main content
Log in

Optimal testing for additivity in multiple nonparametric regression

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We consider the problem of testing for additivity in the standard multiple nonparametric regression model. We derive optimal (in the minimax sense) non- adaptive and adaptive hypothesis testing procedures for additivity against the composite nonparametric alternative that the response function involves interactions of second or higher orders separated away from zero in L 2([0, 1]d)-norm and also possesses some smoothness properties. In order to shed some light on the theoretical results obtained, we carry out a wide simulation study to examine the finite sample performance of the proposed hypothesis testing procedures and compare them with a series of other tests for additivity available in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Abramovich F., Antoniadis A., Sapatinas T., Vidakovic B. (2004). Optimal testing in a fixed-effects functional analysis of variance model. International Journal of Wavelets, Multiresolution and Information Processing 2:323–349

    Article  MATH  MathSciNet  Google Scholar 

  • Amato U., Antoniadis A. (2001). Adaptive wavelet series estimation in separable nonparametric regression models. Statistics and Computing 11:373–394

    Article  MathSciNet  Google Scholar 

  • Amato U., Antoniadis A., De Feis I. (2002). Fourier series approximation of separable models. Journal of Computational and Applied Mathematics 146:459–479

    Article  MATH  MathSciNet  Google Scholar 

  • Antoniadis A., Bigot J., Sapatinas T. (2001). Wavelet estimators in nonparametric regression: a comparative simulation study. Journal of Statistical Software 6(6):1–83

    Google Scholar 

  • Barry D. (1993). Testing for additivity of a regression function. Annals of Statistics 21:235–254

    Article  MATH  MathSciNet  Google Scholar 

  • Buja A., Hastie T., Tibshirani R. (1989). Linear smoothers and additive models (with discussion). Annals of Statistics 17:453–555

    Article  MATH  MathSciNet  Google Scholar 

  • De Canditiis D., Sapatinas T. (2004). Testing for additivity and joint effects in multivariate nonparametric regression using Fourier and wavelet methods. Statistics and Computing 14:235–249

    Article  MathSciNet  Google Scholar 

  • Derbort, S., Dette, H., Munk, A. (2002). A test for additivity in nonparametric regression. Annals of the Institute of Statistical Mathematics 54:60–82

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H., Derbort S. (2001). Analysis of variance in nonparametric regression models. Journal of Multivariate Analysis 76:110–137

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H., Wilkau C.V.U. (2001). Testing additivity by kernel-based methods—what is a reasonable test?. Bernoulli 7:669–697

    Article  MATH  MathSciNet  Google Scholar 

  • Dette H., Wilkau C.V.U., Sperlich S. (2005). A comparison of different nonparametric methods for inference on additive models. Journal of Nonparametric Statistics 17:57–81

    Article  MATH  MathSciNet  Google Scholar 

  • Donoho D.L., Johnstone I.M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika 81:425–455

    Article  MATH  MathSciNet  Google Scholar 

  • Eubank, R.L., Hart, J.D., Simpson, D.G., Stefanski, L.A. (1995). Testing for additivity in nonparametric regression. Annals of Statistics 23:1896–1920

    Article  MATH  MathSciNet  Google Scholar 

  • Fan J., Jiang J. (2005). Nonparametric inferences for additive models. Journal of the Americal Statistical Association 100:890–907

    Article  MATH  MathSciNet  Google Scholar 

  • Gozalo P.L., Linton O.B. (2001). Testing additivity in generalized nonparametric regression models with estimated parameters. Journal of Econometrics 104:1–48

    Article  MATH  MathSciNet  Google Scholar 

  • Guerre E., Lavergne P. (2002). Optimal minimax rates for nonparametric specification testing in regression models. Econometric Theory 18:1139–1171

    Article  MATH  MathSciNet  Google Scholar 

  • Härdle W., Sperlich S., Spokoiny V. (2001). Structural tests in additive regression. Journal of the American Statistical Association 96:1333–1347

    Article  MATH  MathSciNet  Google Scholar 

  • Hastie T.J., Tibshirani R.J. (1990). Generalized additive models. London, Chapman and Hall

    MATH  Google Scholar 

  • Horowitz J.L., Spokoiny V.G. (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69:599–631

    Article  MATH  MathSciNet  Google Scholar 

  • Ingster Yu. I. (1982). Minimax nonparametric detection of signals in white Gaussian noise. Problems of Information Transmission 18:130–140

    MATH  MathSciNet  Google Scholar 

  • Ingster, Yu. I. (1993). Asymptotically minimax hypothesis testing for nonparametric alternatives: I, II, III. Mathematical Methods of Statistics, 2, 85–114; 3, 171–189; 4, 249–268.

  • Ingster, Yu. I., Suslina, I. A. (2003). Nonparametric goodness-of-fit testing under Gaussian models. Lecture Notes in Statistics, 169, New York: Springer.

  • Ingster Yu. I., Suslina I.A. (2005). On estimation and detection of smooth functions of many variables. Mathematical Methods of Statistics 14:299–331

    MathSciNet  Google Scholar 

  • Johnstone I.M., Silverman B.W. (2004). Boundary coiflets for wavelet shrinkage in function estimation. Journal of Applied Probability 41A:81–98

    Article  MathSciNet  Google Scholar 

  • Johnstone I.M., Silverman B.W. (2005). Empirical Bayes selection of wavelet thresholds. Annals of Statistics 33:1700–1752

    Article  MATH  MathSciNet  Google Scholar 

  • Leadbetter M.R., Lindgren G., Rootzén H. (1986). Extremes and related properties of random sequences and processes. New York, Springer

    Google Scholar 

  • Lepski O.V., Spokoiny V.G. (1999). Minimax nonparametric hypothesis testing: the case of an inhomogeneous alternative. Bernoulli 5:333–358

    Article  MATH  MathSciNet  Google Scholar 

  • Li Q., Hsiao C., Zinn J. (2003). Consistent specification tests for semiparametric/nonparametric models based on series of estimation methods. Journal of Econometrics 112:295–325

    Article  MATH  MathSciNet  Google Scholar 

  • Linton O.B. (1997). Efficient estimation of additive nonparametric regression models. Biometrika 84:469–473

    Article  MATH  MathSciNet  Google Scholar 

  • Linton O.B., Nielsen J.P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82:93–100

    Article  MATH  MathSciNet  Google Scholar 

  • Mallat S.G. (1999). A wavelet tour of signal processing (2nd edn). San Diego, Academic Press.

    MATH  Google Scholar 

  • Meyer Y. (1992). Wavelets and operators. Cambridge, Cambridge University Press

    MATH  Google Scholar 

  • Opsomer J.D., Ruppert D. (1997). Fitting a bivariate additive model by local polynomial regression. Annals of Statistics 25: 186–211

    Article  MATH  MathSciNet  Google Scholar 

  • Opsomer J.D., Ruppert D. (1998). A fully automated bandwidth selection method for fitting additive models. Journal of the American Statistical Association 93:605–619

    Article  MATH  MathSciNet  Google Scholar 

  • Sardy S., Tseng P. (2004). AMlet, RAMlet, and GAMlet: automatic nonlinear fitting of additive models, robust and generalized, with wavelets. Journal of Computational and Graphical Statistics 13:283–309

    Article  MathSciNet  Google Scholar 

  • Shensa M.J. (1992). The discrete wavelet transform: wedding the á trous and Mallat algorithms. IEEE Transactions on Signal Processing 40:2464–2482

    Article  MATH  Google Scholar 

  • Sperlich S., Linton O.B., Härdle W. (1999). Integration and backfitting methods in additive models—finite sample properties and comparison. Test 8:419–458

    Article  MATH  Google Scholar 

  • Sperlich S., Tjøstheim D., Yang L. (2002). Nonparametric estimation and testing of interaction in additive models. Econometric Theory 18:197–251

    Article  MATH  MathSciNet  Google Scholar 

  • Spokoiny V.G. (1996). Adaptive hypothesis testing using wavelets. Annals of Statistics 24:2477–2498

    Article  MATH  MathSciNet  Google Scholar 

  • Stone C.J. (1985). Additive regression and other nonparametric models. Annals of Statistics 13:689–705

    Article  MATH  MathSciNet  Google Scholar 

  • Tukey J. (1949). One degree of freedom test for non-additivity. Biometrics 5:232–242

    Article  MathSciNet  Google Scholar 

  • Zhang S., Wong M.-Y. (2003). Wavelet threshold estimation for additive regression models. Annals of Statistics 31:152–173

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Felix Abramovich.

About this article

Cite this article

Abramovich, F., De Feis, I. & Sapatinas, T. Optimal testing for additivity in multiple nonparametric regression. Ann Inst Stat Math 61, 691–714 (2009). https://doi.org/10.1007/s10463-007-0164-y

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-007-0164-y

Keywords

Navigation