Abstract
We consider the problem of testing for additivity in the standard multiple nonparametric regression model. We derive optimal (in the minimax sense) non- adaptive and adaptive hypothesis testing procedures for additivity against the composite nonparametric alternative that the response function involves interactions of second or higher orders separated away from zero in L 2([0, 1]d)-norm and also possesses some smoothness properties. In order to shed some light on the theoretical results obtained, we carry out a wide simulation study to examine the finite sample performance of the proposed hypothesis testing procedures and compare them with a series of other tests for additivity available in the literature.
Similar content being viewed by others
References
Abramovich F., Antoniadis A., Sapatinas T., Vidakovic B. (2004). Optimal testing in a fixed-effects functional analysis of variance model. International Journal of Wavelets, Multiresolution and Information Processing 2:323–349
Amato U., Antoniadis A. (2001). Adaptive wavelet series estimation in separable nonparametric regression models. Statistics and Computing 11:373–394
Amato U., Antoniadis A., De Feis I. (2002). Fourier series approximation of separable models. Journal of Computational and Applied Mathematics 146:459–479
Antoniadis A., Bigot J., Sapatinas T. (2001). Wavelet estimators in nonparametric regression: a comparative simulation study. Journal of Statistical Software 6(6):1–83
Barry D. (1993). Testing for additivity of a regression function. Annals of Statistics 21:235–254
Buja A., Hastie T., Tibshirani R. (1989). Linear smoothers and additive models (with discussion). Annals of Statistics 17:453–555
De Canditiis D., Sapatinas T. (2004). Testing for additivity and joint effects in multivariate nonparametric regression using Fourier and wavelet methods. Statistics and Computing 14:235–249
Derbort, S., Dette, H., Munk, A. (2002). A test for additivity in nonparametric regression. Annals of the Institute of Statistical Mathematics 54:60–82
Dette H., Derbort S. (2001). Analysis of variance in nonparametric regression models. Journal of Multivariate Analysis 76:110–137
Dette H., Wilkau C.V.U. (2001). Testing additivity by kernel-based methods—what is a reasonable test?. Bernoulli 7:669–697
Dette H., Wilkau C.V.U., Sperlich S. (2005). A comparison of different nonparametric methods for inference on additive models. Journal of Nonparametric Statistics 17:57–81
Donoho D.L., Johnstone I.M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika 81:425–455
Eubank, R.L., Hart, J.D., Simpson, D.G., Stefanski, L.A. (1995). Testing for additivity in nonparametric regression. Annals of Statistics 23:1896–1920
Fan J., Jiang J. (2005). Nonparametric inferences for additive models. Journal of the Americal Statistical Association 100:890–907
Gozalo P.L., Linton O.B. (2001). Testing additivity in generalized nonparametric regression models with estimated parameters. Journal of Econometrics 104:1–48
Guerre E., Lavergne P. (2002). Optimal minimax rates for nonparametric specification testing in regression models. Econometric Theory 18:1139–1171
Härdle W., Sperlich S., Spokoiny V. (2001). Structural tests in additive regression. Journal of the American Statistical Association 96:1333–1347
Hastie T.J., Tibshirani R.J. (1990). Generalized additive models. London, Chapman and Hall
Horowitz J.L., Spokoiny V.G. (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69:599–631
Ingster Yu. I. (1982). Minimax nonparametric detection of signals in white Gaussian noise. Problems of Information Transmission 18:130–140
Ingster, Yu. I. (1993). Asymptotically minimax hypothesis testing for nonparametric alternatives: I, II, III. Mathematical Methods of Statistics, 2, 85–114; 3, 171–189; 4, 249–268.
Ingster, Yu. I., Suslina, I. A. (2003). Nonparametric goodness-of-fit testing under Gaussian models. Lecture Notes in Statistics, 169, New York: Springer.
Ingster Yu. I., Suslina I.A. (2005). On estimation and detection of smooth functions of many variables. Mathematical Methods of Statistics 14:299–331
Johnstone I.M., Silverman B.W. (2004). Boundary coiflets for wavelet shrinkage in function estimation. Journal of Applied Probability 41A:81–98
Johnstone I.M., Silverman B.W. (2005). Empirical Bayes selection of wavelet thresholds. Annals of Statistics 33:1700–1752
Leadbetter M.R., Lindgren G., Rootzén H. (1986). Extremes and related properties of random sequences and processes. New York, Springer
Lepski O.V., Spokoiny V.G. (1999). Minimax nonparametric hypothesis testing: the case of an inhomogeneous alternative. Bernoulli 5:333–358
Li Q., Hsiao C., Zinn J. (2003). Consistent specification tests for semiparametric/nonparametric models based on series of estimation methods. Journal of Econometrics 112:295–325
Linton O.B. (1997). Efficient estimation of additive nonparametric regression models. Biometrika 84:469–473
Linton O.B., Nielsen J.P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82:93–100
Mallat S.G. (1999). A wavelet tour of signal processing (2nd edn). San Diego, Academic Press.
Meyer Y. (1992). Wavelets and operators. Cambridge, Cambridge University Press
Opsomer J.D., Ruppert D. (1997). Fitting a bivariate additive model by local polynomial regression. Annals of Statistics 25: 186–211
Opsomer J.D., Ruppert D. (1998). A fully automated bandwidth selection method for fitting additive models. Journal of the American Statistical Association 93:605–619
Sardy S., Tseng P. (2004). AMlet, RAMlet, and GAMlet: automatic nonlinear fitting of additive models, robust and generalized, with wavelets. Journal of Computational and Graphical Statistics 13:283–309
Shensa M.J. (1992). The discrete wavelet transform: wedding the á trous and Mallat algorithms. IEEE Transactions on Signal Processing 40:2464–2482
Sperlich S., Linton O.B., Härdle W. (1999). Integration and backfitting methods in additive models—finite sample properties and comparison. Test 8:419–458
Sperlich S., Tjøstheim D., Yang L. (2002). Nonparametric estimation and testing of interaction in additive models. Econometric Theory 18:197–251
Spokoiny V.G. (1996). Adaptive hypothesis testing using wavelets. Annals of Statistics 24:2477–2498
Stone C.J. (1985). Additive regression and other nonparametric models. Annals of Statistics 13:689–705
Tukey J. (1949). One degree of freedom test for non-additivity. Biometrics 5:232–242
Zhang S., Wong M.-Y. (2003). Wavelet threshold estimation for additive regression models. Annals of Statistics 31:152–173
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Abramovich, F., De Feis, I. & Sapatinas, T. Optimal testing for additivity in multiple nonparametric regression. Ann Inst Stat Math 61, 691–714 (2009). https://doi.org/10.1007/s10463-007-0164-y
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-007-0164-y