Skip to main content

Nonparametric Estimation of Additive Separable Regression Models

  • Conference paper
Statistical Theory and Computational Aspects of Smoothing

Part of the book series: Contributions to Statistics ((CONTRIB.STAT.))

Summary

Additive regression models have been shown to be useful in many situations. Numerical estimation of these models is usually done using the iterative back-fitting technique. This paper proposes an estimator for additive models with an explicit ‘hat matrix’ which does not use iteration. The asymptotic normality of the estimator is proved. We also investigate a variable selection procedure using the proposed estimator and prove that asymptotically the procedure finds the correct variable set with probability 1. A simulation study is presented investigating the practical performance of the procedure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Buja, A, Hastie, T.J. and Tibshirani, R.J. (1989), Linear smoothers and additive models, Ann. Statist., 17, 453–510.

    Article  Google Scholar 

  2. Härdle, W. (1990). Applied Nonparametric Regression. Econometric Society Monograph 19, Cambridge University Press.

    Google Scholar 

  3. Härdle, W. and Hall, P. (1993) On the backfitting algorithm for additive regression models. Statistica Neerlandica, 47, 43–57.

    Article  Google Scholar 

  4. Härdle, W. Klinke, S. and Turlach, B.A. (1995) XploRe - an interactive statistical computing environment. Springer Verlag, New York

    Book  Google Scholar 

  5. Härdle, W and Marron, J.S. (1985), Optimal bandwidth selection in nonparametric regression function estimation. Ann. Statist, 13, 1465–1481

    Article  Google Scholar 

  6. Härdle, W, and Tsybakov, A.B (1995) Additive nonparametric regression on principal components, J. Nonparametric Statistics, in Press

    Google Scholar 

  7. Hastie, T. J. and R. J. Tibshirani (1990), Generalized additive models, Chapman and Hall: London

    Google Scholar 

  8. Linton, O. and J. P. Nielsen (1995) A kernel method of estimating structured nonparametric regression based on marginal integration, Biometrika82, 93–101.

    Article  Google Scholar 

  9. Leontief, W. (1947) Introduction to a theory of an internal structure of functional relationships. Econometrika, 15, 361–373.

    Article  Google Scholar 

  10. Maljutov, M.B. and Wynn, H.P. (1994) Sequential screening of significant variables of an additive model, in: Markov processes and applicazions. Festschrift for Dynkin, Birkhäuser Progress.

    Google Scholar 

  11. Masry, E. and Tjøstheim, D. (1993), Nonparametric estimation and identification of ARCH and ARX nonlinear time series. Convergence properties and rates, working paper, University of Bergen, Dept. of Math.

    Google Scholar 

  12. Nadaraya, E.A. (1964), On estimating regression. Theor. Probab. Appl., 9, 141–142.

    Article  Google Scholar 

  13. Parzen, E. (1962), On estimation of a probability density and mode. Ann. Math. Stat., 35, 1065–76.

    Article  Google Scholar 

  14. Severance-Lossin, E. (1994), Nonparametric Testing of Production assertions in Data with Random Shocks., PhD Thesis, University of Wisconsin-Madison.

    Google Scholar 

  15. Silverman, B.W. (1986), Density Estimation for Statistics and Data Analysis, Chapman and Hall, London.

    Google Scholar 

  16. Stone, C.J. (1985), Additive regression and other nonparametric models, Ann. Statist. 13, 689 - 705

    Article  Google Scholar 

  17. Stone, C.J. (1986), The dimensionality reduction principle for generalized additive models, Ann. Statist. 14, 590–606

    Article  Google Scholar 

  18. Tjøstheim, D. and Auestad, B.H. (1994), Nonparametric identification of nonlinear time series: projections, J. American Statistical Association, 89, 1398–1409

    Article  Google Scholar 

  19. Venables, W.N. and Ripley, B. (1994) Modern applied statistics with S-Plus. Springer Verlag, New York.

    Google Scholar 

  20. Watson, G.S. (1964), Smooth regression analysis. Sankhyā A, 26, 359–372

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Physica-Verlag Heidelberg

About this paper

Cite this paper

Chen, R., Härdle, W., Linton, O.B., Severance-Lossin, E. (1996). Nonparametric Estimation of Additive Separable Regression Models. In: Härdle, W., Schimek, M.G. (eds) Statistical Theory and Computational Aspects of Smoothing. Contributions to Statistics. Physica-Verlag HD. https://doi.org/10.1007/978-3-642-48425-4_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-48425-4_18

  • Publisher Name: Physica-Verlag HD

  • Print ISBN: 978-3-7908-0930-5

  • Online ISBN: 978-3-642-48425-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics