Abstract
Kernel estimators are by now well established for curve estimation in a broad variety of problems. Here the regression problem is studied. Basic properties are summarized and a comparison with other popular estimators is then made. The choice of bandwidth or smoothing parameter is decisive in many ways; a data-adaptive optimization of this choice offers many advantages. An iterative plug-in rule based on the asymptotic formula is introduced and contrasted with cross-validation type selectors. The latter prove to be inferior asymptotically and in simulations mainly due to their large variability. A difficult problem is then choosing the bandwidth appropriately when residuals are correlated. Introducing a second tuning parameter to adapt to the unknown correlation structure leads to a solution which shows good properties in theory and practice. It is important that this may be achieved without postulating some parametric model for the residual time series.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chiu, S.T. (1989) ‘Bandwidth selection for kernel estimate with correlated noise’, Statist. Probab. Lett. 8, 347–354.
Chu, C.K. and Marron, J.S. (1989) ‘Choosing a kernel regression estimator’, Report, University of North Carolina, Chapel Hill.
Gasser, Th. and Engel, J. (1990) ‘The choice of weights in kernel regression estimation’, Biometrika 77, 377–381.
Gasser, Th. and Kneip, A. (1989) Discussion of ‘Linear smoothers and additive models’ by A. Buja, T. Hastie and R. Tibshirani. Ann. Statist. 17, 532–535.
Gasser, Th.; Kneip, A. and Köhler, W. (1990) ‘A flexible and fast method for automatic smoothing’, J. Amer. Statist. Assoc., to appear.
Gasser, Th. and Müller, H.G. (1979) ‘Kernel estimation of regression functions’, in Th. Gasser and M. Rosenblatt (eds.). Smoothing techniques for curve estimation, Springer, Heidelberg, pp. 23–68.
Gasser, Th. and Müller, H.G. (1984) ‘Estimating regression functions and their derivatives by the kernel method’, Scand. J. Statist. 11, 171–185.
Gasser, Th.; Müller, H.G.; Köhler, W.; Molinari, L. and Prader, A. (1984) ‘Non-parametric regression analysis of growth curves,’ Ann. Statist. 12, 210–229.
Gasser, Th.; Müller, H.G. and Mammitzsch, V. (1985) ‘Kernels for nonparamtric curve estimation’, J. Roy. Statist. Soc. Ser. B 47, 238–252.
Gasser, Th.; Sroka, L. and Jennen-Steinmetz, Ch. (1986) ‘Residual variance and residual pattern in nonlinear regression’, Biometrika 73, 625–633.
Härdie, W.; Hall, P. and Marron, J.S. (1988) ‘How far are automatically chosen regression smoothing parameters from their optimum?’ J. Amer. Statist. Assoc. 83, 86–95.
Hart, J.D. (1988) ‘Kernel regression estimation with time series errors’, Report.
Hart, J.D. and Wehrly, T. E. (1986) ‘Kernel regression estimation using repeated measurements data’, J. Amer. Statist. Assoc. 81, 1080–1088.
Herrmann, E.; Gasser, Th. and Kneip, A. (1990) ‘Choice of bandwidth for kernel regression when residuals are correlated’, Report, Universität Heidelberg.
Herrmann, E.; Kneip, A. and Gasser, Th. (1990) ‘Differentiation with kernel estimators: choice of bandwidth’, Report, Universität Heidelberg.
Jennen-Steinmetz, Ch. and Gasser, Th. (1988) ‘A unifying approach to nonpara-metric regression estimation’, J. Amer. Statist. Assoc. 83, 1084–1089.
Mallows, C. (1973) ‘Some comments on C p’, Technometrics 15, 86–101.
Müller, H.G. and Stadtmüller, U. (1988) ‘Detecting dependencies in smooth regression models’, Biometrika 75, 639–650.
Nadaraya, E.A. (1964) ‘On estimating regression’, Theory Prob. Applic. 9, 141–142.
Nussbaum, B.W. (1985) ‘Spline smoothing in regression models and asymptotic efficiency in L2’, Ann. Statist. 13, 984–997.
Priestley, M.B. and Chao, M.T. (1972) ‘Nonparametric function fitting’, J. Roy. Statist. Soc. Ser. B 34, 385–392.
Silverman, B.W. (1984) ‘Spline smoothing: the equivalent variable kernel method’, Ann. Statist. 12, 898–916.
Speckman, P. (1985) ‘Spline smoothing and optimal rates of convergence in non-parametric regression’, Ann. Statist. 13, 970–984.
Vieu, P. and Hart, J. D. (1988) ‘Nonparametric regression under dependence: A class of asymptotically optimal data-driven bandwidths’, Report.
Wand, M.; Herrmann, E.; Engel, J. and Gasser, Th. (1990) ‘A bandwidth selector for bivariate kernel regression’, Report, Universität Heidelberg.
Watson, G.S. (1964) ‘Smooth regression analysis’, Sankhyâ Ser. A 26, 359–372.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Gasser, T., Herrmann, E. (1991). Data-Adaptive Kernel Estimation. In: Roussas, G. (eds) Nonparametric Functional Estimation and Related Topics. NATO ASI Series, vol 335. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3222-0_5
Download citation
DOI: https://doi.org/10.1007/978-94-011-3222-0_5
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-5420-1
Online ISBN: 978-94-011-3222-0
eBook Packages: Springer Book Archive