Abstract
We consider the problem of estimating the distribution of a nonparametric (kernel) estimator of the conditional expectation g(x; φ) = E(φ(X t+1) | Y t,m = x) of a strictly stationary stochastic process {X t , t ≥ 1}. In this notation φ(·) is a real-valued Borel function and Y t,m a segment of lagged values, i.e., Yt,m=(Xt-i 1,Xt-i 2,...,Xt-i m), where the integers i i , satisfy 0 ≤ i1<i2...<im∞>. We show that under a fairly weak set of conditions on {X t , t ≥ 1}, an appropriately designed and simple bootstrap procedure that correctly imitates the conditional distribution of X t+1 given the selective past Y t,m , approximates correctly the distribution of the class of nonparametric estimators considered. The procedure proposed is entirely nonparametric, its main dependence assumption refers to a strongly mixing process with a polynomial decrease of the mixing rate and it is not based on any particular assumptions on the model structure generating the observations.
Similar content being viewed by others
References
Auestad, B. and D. Tjøstheim (1990). Identification of nonlinear time series: first order characterization and order determination, Biometrika, 77, 669–687.
Cao-Abad, R. and Gonzalez-Manteiga, W. (1993). Bootstrap methods in regression smoothing, J. Nonparametr. Statist., 2, 379–388.
Chen, R. and Tsay, R. S. (1993). Nonlinear additive ARX models, J. Amer. Statist. Assoc., 88, 955–967.
Doukhan, P. (1994). Mixing. Properties and Examples, Lecture Notes in Statist., No. 85, Springer, New York.
Efron, B. (1979). Bootstrap methods: another look at the jackknife, Ann. Statist., 7, 1–26.
Efron, B. and Tibshirani, R. (1993). An Introduction to the Bootstrap, Chapman and Hall, New York.
Falk, M. and Reiss, R.-D. (1992). Bootstrapping conditional curves, Bootstrapping and Related Techniques (eds. K. H. Jöckel, G. Rothe and W. Sendler), Lecture Notes in Econom. and Math. Systems, No. 376, Springer, New York.
Franke, J. and Härdle, W. (1992). On bootstrapping kernel spectral estimates, Ann. Statist., 20, 121–145.
Franke, J., Kreiss, J.-P. and Mammen, E. (1996). Bootstrap of kernel smoothing in nonlinear time series (preprint).
Freedman, D. A. (1984). On bootstrapping two-stage least-squares estimates in stationary linear models, Ann. Statist., 12, 827–842.
Härdle, W. and Bowmann, A. (1988). Bootstrapping in nonparametric regression: local adaptive smoothing and confidence bands, J. Amer. Statist. Assoc., 83, 100–110.
Härdle, W. and Vieu, P. (1992). Kernel regression smoothing of time series, J. Time Ser. Anal., 13, 209–232.
Hart, J. (1996). Some automated methods of smoothing time-dependent data, J. Nonparametr. Statist., 6, 115–142.
Kim, T. Y. and Cox, D. D. (1996). Bandwidth selection in kernel smoothing of time series, J. Time Ser. Anal., 17, 49–63.
Künsch, H. R. (1989). The Jackknife and the bootstrap for general stationary observations, Ann. Statist., 17, 1217–1241.
Liu, R. Y. and Singh, K. (1992). Moving blocks jackknife and bootstrap capture weak dependence, Exploring the Limits of the Bootstrap (eds. R. LePage and L. Billard), 225–248, Wiley, New York.
Masry, E. and Tjøstheim, D. (1995). Nonparametric estimation and identification of nonlinear ARCH time series, Econometric Theory, 11, 258–289.
Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability, Springer, London.
Neumann, M. (1997). On robustness of model-based bootstrap schemes in nonparametric time series analysis, Discussion Paper No. 88/97, SFB 373, Humbolt University, Berlin.
Neumann, M. and Kreiss, J.-P. (1998). Regression-type inference in nonparametric autoregressions, Ann. Statist., 26, 1570–1613.
Paparoditis, E. and Politis, D. N. (1997). The local bootstrap for Markov processes (preprint).
Politis, D. N. and Romano, J. P. (1994). The stationary bootstrap, J. Amer. Statist. Assoc., 89, 1303–1313.
Rajarshi, M. B. (1990). Bootstrap in Markov-sequences based on estimates of transition density, Ann. Inst. Statist. Math., 42, 253–268.
Robinson, P. M. (1983). Nonparametric estimation for time series models, J. Time Ser. Anal., 4, 185–208.
Romano, J. P. (1988). Bootstrapping the mode, Ann. Inst. Statist. Math., 40, 565–586.
Rosenblatt, M. (1956). A central limit theorem and a strong mixing condition, Proc. Nat. Acad. Sci. U.S.A., 42, 43–47.
Rosenblatt, M. (1991). Stochastic Curve Estimation, NSF-CBMS Regional Conference Series in Probability and Statistics, Vol. 3, Institute of Mathematical Statistics, Alexandria, Virginia.
Shao, J. and Tu, D. (1995). The Jackknife and the Bootstrap, Springer, New York.
Shi, S. G. (1991). Local bootstrap, Ann. Inst. Statist. Math., 43, 667–676.
Tjøstheim, D. (1990). Nonlinear time series and Markov chains, Advances in Applied Probability, 22, 587–611.
Tjøstheim, D. (1994). Nonlinear time series: a selective review, Scand. J. Statist., 21, 97–130.
Tong, H. (1990). Nonlinear Time Series: A Dynamical Approach, Oxford University Press, New York.
Author information
Authors and Affiliations
About this article
Cite this article
Paparoditis, E., Politis, D.N. The Local Bootstrap for Kernel Estimators under General Dependence Conditions. Annals of the Institute of Statistical Mathematics 52, 139–159 (2000). https://doi.org/10.1023/A:1004193117918
Issue Date:
DOI: https://doi.org/10.1023/A:1004193117918