Abstract
A general class of conditionalU-statistics was introduced by W. Stute as a generalization of the Nadaraya-Watson estimates of a regression function. It was shown that such statistics are universally consistent. Also, universal consistentcies of the window andk n -nearest neighbor estimators (as two special cases of the conditionalU-statistics) were proved. In this paper, we extend these results from the independent case to dependent case. The result is applied to verify the Bayes risk consistency of the corresponding discrimination rules.
Similar content being viewed by others
References
Baum, L. E. and Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains,Annals of Mathematical Statistics,37, 1554–1563.
Bennett, G. (1962). Probability inequalities for the sum of independent random variables,Journal of the American Statistical Association,19, 33–45.
Cacoullos, T. (1966). Estimation of a multivariate density,Annals of the Institute of Statistical Mathematics,18, 179–189.
Devroye, L. P. and Wagner, T. J. (1980). Distribution-free consistency results in nonparametric discrimination and regression function estimation,Annals of Statistics,8, 231–239.
Harel, M. and Puri, M. L. (1996). ConditionalU-statistics for dependent random variables,Journal of Multivariate Analysis,57, 84–100.
Pham, T. D. and Tran, L. T. (1985). Some mixing properties of time series models,Stochastic Processes and Their Applications,19, 297–303.
Rabiner, L. R. and Juang, B. H. (1986). An introduction to hidden Markov models,I.E.E.E. A.S.S.P.,24, 4–16.
Spiegelman, C. and Sacks, J. (1980). Consistent window estimation in nonparametric regression,Annals of Statistics,8, 240–246.
Stone, C. (1977). Consistent nonparametric regression,Annals of Statistics,5, 595–620.
Stute, W. (1991). ConditionalU-statistics,Annals of Probability,19, 812–825.
Stute, W. (1994a). Universally consistent conditionalU-statistics,Annals of Statistics,22, 460–473.
Stute, W. (1994b).L p convergence of conditionalU-statistics,Journal of Multivariate Analysis,51, 71–82.
Yoshihara, K. I. (1976). Limiting behavior of U-statistics for stationary absolutely regular processes,Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete,35, 237–252.
Author information
Authors and Affiliations
Additional information
Research supported by the Office of Naval Research Contract N00014-91-J-1020.
About this article
Cite this article
Harel, M., Puri, M.L. Universally consistent conditionalU-statistics for absolutely regular processes and its applications for hidden Markov models. Ann Inst Stat Math 56, 819–832 (2004). https://doi.org/10.1007/BF02506491
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02506491