Summary
Substituting an estimator in a statistic will often affect its limiting distribution. Sukhatme (1958), Randles (1982), and Pierce (1982) all consider the changes, if any, in the statistic's limiting normal distribution. This paper gives conditions for a law of the iterated logarithm for U-statistics which have a kernel with an estimator substituted into it. It also gives conditions for both strong and weak convergence. Applications of the theory are illustrated by constructing a sequential test for scale differences with power one. The theory also produces convergence results for adaptive M-estimators and for cross-validation assessment statistics. In addition, it is shown how to extend LIL results to a broad class of statistics with estimators substituted into them by use of the differential. In particular, a law of the iterated logarithm is described for adaptive L-statistics and is illustrated by an example of de Wet and van Wyk (1979).
References
Butler, R., Rothman, E.D.: Predictive intervals based on reuse of the Sample. J. Am. Statist. Assoc. 75, 881–889 (1980)
Eastment, H.T., Krzanowski, W.J.: Cross validatory choice of the number of components from a principle component analysis. Technometrics 24, 73–77 (1982)
Boos, D.D.: The differential approach in statistical theory and robust inference. Unpublished dissertation, Florida State University (1977)
Boos, D.D.: A differential for L-statistics. Ann. Statist. 7, 955–959 (1979)
Boos, D.D., Serfling, R.J.: A note on differentials and the CLT and LIL for statistical functions, with applications to M-estimates. Ann. Statist. 8, 618–624 (1980)
Darling, D.A., Robbins, H.: Some nonparametric sequential tests with power 1. Proc. Nat. Acad. Sci. 61, 804–809 (1968)
de Wet, T., Van Wyk, J.W.J.: Some large sample properties of Hogg's adaptive trimmed means. South African Statist. J. 13, 53–69 (1979)
Ghosh, J.K.: A new proof of the Bahadur representation of quantiles and an application. Ann. Statist. 42, 1957–1961 (1971)
Iverson, H.K.: Asymptotic properties of U-statistics with estimated parameters. Unpublished Ph.D. thesis, Department of Statistics, University of Iowa (1982)
Iverson, H.K., Randles, R.H.: Large sample properties of cross-validation assessment statistics. J. Statist. Plan. Inf. 15, 43–62 (1986)
Lachenbruch, P.A.: An almost unbiased method of obtaining confidence intervals for the probability of misclassification in discriminant analysis. Ann. Statist. 10, 462–474 (1967)
Moberg, T.F., Ramberg, J.S., Randles, R.H.: An adaptive M-estimator and its application to a selection problem. Technometrics 20, 255–263 (1978)
Parr, W.C.: A note on adaptive L-statistics. Comm. Statist. — Theor. Meth. 11, 1511–1518 (1982)
Pierce, D.A.: The asymptotic effect of substituting estimators for parameters in certain types of statistics. Ann. Statist. 10, 475–478 (1982)
Randles, R.H., Wolfe, D.A.: Introduction to the theory of nonparametric statistics. New York: Wiley 1979
Randles, R.H.: On the asymptotic normality of statistics with estimated parameters. Ann. Statist. 10, 462–474 (1982)
Randles, R.H.: On tests applied to residuals. J. Am. Statist. Assoc. 79, 349–354 (1984)
Serfling, R.J.: Approximation theorems of mathematical statistics. New York: Wiley 1980
Stone, M.: Cross-validating choice and assessment of statistical predictions. J. Roy. Statist. Soc. B 36, 111–147 (1974)
Sukhatme, B.V.: Testing the hypotheses that two populations differ only in location. Ann. Math. Statist. 29, 60–78 (1958)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Iverson, H.K., Randles, R.H. The effects on convergence of substituting parameter estimates into U-statistics and other families of statistics. Probab. Th. Rel. Fields 81, 453–471 (1989). https://doi.org/10.1007/BF00340061
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00340061
Keywords
- Normal Distribution
- Parameter Estimate
- Stochastic Process
- Probability Theory
- Statistical Theory