Skip to main content
Log in

Smoothed nonparametric tests and approximations of p-values

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We propose new smoothed sign and Wilcoxon’s signed rank tests that are based on kernel estimators of the underlying distribution function of the data. We discuss the approximations of the p-values and asymptotic properties of these tests. The new smoothed tests are equivalent to the ordinary sign and Wilcoxon’s tests in the sense of Pitman’s asymptotic relative efficiency, and the differences between the ordinary and new tests converge to zero in probability. Under the null hypothesis, the main terms of the asymptotic expectations and variances of the tests do not depend on the underlying distribution. Although the smoothed tests are not distribution-free, making use of the specific kernel enables us to obtain the Edgeworth expansions, being free of the underlying distribution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Azzalini, A. (1981). A note on the estimation of a distribution function and quantiles by a kernel method. Biometrika, 68(1), 326–328.

    Article  MathSciNet  Google Scholar 

  • Bickel, P., Götze, F., Van Zwet, W. (1986). The edgeworth expansion for u-statistics of degree two. The Annals of Statistics, 14(4), 1463–1484.

  • Brown, B., Hall, P., Young, G. (2001). The smoothed median and the bootstrap. Biometrika, 88(2), 519–534.

  • Epanechnikov, V. A. (1969). Non-parametric estimation of a multivariate probability density. Theory of Probability and Its Applications, 14(1), 153–158.

    Article  MathSciNet  Google Scholar 

  • García-Soidán, P. H., González-Manteiga, W., Prada-Sánchez, J. (1997). Edgeworth expansions for nonparametric distribution estimation with applications. Journal of Statistical Planning and Inference, 65(2), 213–231.

  • Hájek, J., Šidák, Z., Sen, P. K. (1999). Theory of rank tests. San Diego: Academic press.

  • Huang, Z., Maesono, Y. (2014). Edgeworth expansion for kernel estimators of a distribution function. Bulletin of Informatics and Cybernetics, 46, 1–10.

  • Lee, A. (1990). U-statistics. Theory and practice. New York: Marcel Dekker.

    MATH  Google Scholar 

  • Lehmann, E. L., D’abrera, H. (2006). Nonparametrics: Statistical methods based on ranks. New York: Springer.

  • Maesono, Y., Moriyama, T., Lu, M. (2016). Smoothed nonparametric tests and their properties. arXiv preprint arXiv:1610.02145

Download references

Acknowledgements

The authors would like to thank the editor and two anonymous referees for their careful reading and valuable comments, which helped us to improve the manuscript significantly. The authors gratefully acknowledge JSPS KAKENHI Grant Nos. JP15K11995 and JP16H02790.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yoshihiko Maesono.

Appendix

Appendix

Appendix gives brief proofs of Theorems 1 and 3. The complete proofs are found in Maesono et al. (2016).

Proof of Theorem 1

For the ordinary sign test S, we have

$$\begin{aligned} V_{\theta }(S)=nF(\theta )[1-F(\theta )]. \end{aligned}$$

Then, it is sufficient to show that

$$\begin{aligned} E_{\theta }\left[ \left\{ S-F(\theta )\right\} \left\{ \widetilde{S}-E_{\theta }(\widetilde{S})\right\} \right] =n\left\{ F(\theta )[1-F(\theta )]+O(h_n)\right\} . \end{aligned}$$

Since S and \(\widetilde{S}\) are sums of i.i.d. random variables, we have

$$\begin{aligned}&E_{\theta }\left[ \left\{ S-E_{\theta }(S)\right\} \left\{ \widetilde{S}-E_{\theta }(\widetilde{S})\right\} \right] \\&\quad =nE_{\theta }\left[ \{I(X_1 \ge 0)-E_{\theta }(I(X_1 \ge 0))\}\left\{ 1-K\left( -\frac{X_1}{h_n}\right) -e_1(\theta )\right\} \right] . \end{aligned}$$

Using the transformation \(u=x/h_n\), integration by parts, and a Taylor expansion, we get

$$\begin{aligned} \int _{-\infty }^{\infty }I(x \ge 0)\left[ 1-K\left( -\frac{x}{h_n}\right) \right] f(x-\theta )\mathrm{d}x=F(\theta )+O(h_n). \end{aligned}$$

Since \(E_{\theta }(I(x \ge 0))=F(\theta )\) and \(E_{\theta }(1-K)=F(\theta )+O(h_n^2)\), we have

$$\begin{aligned} E_{\theta }\left[ \left\{ S-E_{\theta }(S)\right\} \left\{ \widetilde{S}-E_{\theta }(\widetilde{S})\right\} \right] =n\{F(\theta )-[F(\theta )]^2+O(h_n)\}. \end{aligned}$$

Thus, we get the desired result. \(\square \)

Similarly, we can show that the difference between W and \(\widetilde{W}\) goes to zero.

Proof of Theorem 3

Assuming that the density f is differentiable, we have

$$\begin{aligned} \frac{1}{n}E_0(\widetilde{S})= & {} 1-\int _{-\infty }^{\infty } K\left( -\frac{x}{h_n}\right) f(x)\mathrm{d}x=1-\int _{-\infty }^{\infty } k(u)F(-h_nu)\mathrm{d}u\\= & {} 1-F(0)+h_nf(0)A_{0,1}-\frac{h_n^2}{2}f'(0)A_{0,2}+\frac{h_n^3}{6}f''(0)A_{0,3}\\&-\frac{h_n^4}{24}f^{(3)}(0)A_{0,4}+\frac{h_n^5}{120}f^{(4)}(0)A_{0,5}+O(h_n^6). \end{aligned}$$

Similarly, we can show that

$$\begin{aligned} E_0\left\{ K^2\left( -\frac{X_1}{h_n}\right) \right\} =F(0)-2h_nf(0)A_{1,1}+h_n^2f'(0)A_{1,2}-\frac{h_n^3}{3}f''(0)A_{1,3}+O(h_n^4) \end{aligned}$$

and

$$\begin{aligned} \frac{1}{n}V_0(\widetilde{S})= & {} F(0)\{1-F(0)\}-2h_nf(0)A_{1,1}+h_n^2f'(0)\{A_{1,2}-F(0)A_{0,2}\}\\&-\frac{h_n^3}{3}f''(0)\{A_{1,3}-F(0)A_{0,3}\}+O(h_n^4). \end{aligned}$$

Note that \(k(-u)=k(u)\) yields \(A_{0,1}=A_{0,3}=A_{0,5}=0\). Furthermore, since \(f(-x)=f(x)\), we get

$$\begin{aligned} f'(0)=0,\quad f''(-x)=f''(x), \quad f^{(3)}(-x)=-f^{(3)}(x), \quad \mathrm{and}\quad f^{(3)}(0)=0. \end{aligned}$$

We can derive equations (1) and (2) in a similar manner (see Maesono et al. 2016). \(\square \)

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maesono, Y., Moriyama, T. & Lu, M. Smoothed nonparametric tests and approximations of p-values. Ann Inst Stat Math 70, 969–982 (2018). https://doi.org/10.1007/s10463-017-0614-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-017-0614-0

Keywords

Navigation