Abstract
Often for a non-regular parametric hypothesis, a tractable test statistic involves a nuisance parameter. A common practice is to replace the unknown nuisance parameter by its estimator. The validality of such a replacement can only be justified for an infinite sample in the sense that under appropriate conditions the asymptotic distribution of the statistic under the null hypothesis is unchanged when the nuisance parameter is replaced by its estimator (Crowder M.J. 1990. Biometrika 77: 499–506). We propose a bootstrap method to calibrate the error incurred in the significance level, for finite samples, due to the replacement. Further, we have proved that the bootstrap method provides a more accurate estimator for the unknown actual significance level than the nominal level. Simulations demonstrate the proposed methodology.
Similar content being viewed by others
References
Crowder M.J. 1990. On some nonregular tests for a modified Weibull model. Biometrika 77: 499–506.
Crowder M.J. 1996. Some tests based on extreme values for a parametric survival model. J. Roy. Statist. Soc. B 58: 417–424.
Crowder M.J. 1998. Corrected P-values for tests based on estimated nuisance parameters. manuscript.
De Haan L. and Resnick S. 1996. Second-order regular variation and rates of convergence in extreme-value theory. Ann. Probab. 24: 97–124.
Hall P. 1992. The Bootstrap and Edgeworth Expansion. Springer-Verlag, New York.
Loh W.Y. 1987. Calibrating confidence coefficients. J. Amer. Statist. Assoc. 82: 155–162.
Loh W.Y. 1988. Discussion of “Theoretical comparison of bootstrap confidence intervals” by P. Hall. Ann. Statist. 16: 972–976.
Loh W.Y. 1991. Bootstrap calibration for confidence interval construction and selection. Statist. Sinica 1: 479–495.
Pierce D.A. 1982. The asymptotic effect of substituting estimators for parameters in certain types of statistics. Ann. Statist. 10:475–478.
Randles R.H. 1982. On the asymptotic normality of statistics with estimated parameters. Ann. Statist. 10: 462–474.
Smith R.L. 1985. Maximum likelihood estimation in a class of nonregular cases. Biometrika 72: 67–90.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Yao, Q., Zhang, W. & Tong, H. Bootstrap estimation of actual significance levels for tests based on estimated nuisance parameters. Statistics and Computing 11, 367–371 (2001). https://doi.org/10.1023/A:1011977221590
Issue Date:
DOI: https://doi.org/10.1023/A:1011977221590