Applications of conditional power function of two-sample permutation test
- 136 Downloads
Permutation or randomization test is a nonparametric test in which the null distribution (distribution under the null hypothesis of no relationship or no effect) of the test statistic is attained by calculating the values of the test statistic overall permutations (or by considering a large number of random permutation) of the observed dataset. The power of permutation test evaluated based on the observed dataset is called conditional power. In this paper, the conditional power of permutation tests is reviewed. The use of the conditional power function for sample size estimation is investigated. Moreover, reproducibility and generalizability probabilities are defined. The use of these probabilities for sample size adjustment is shown. Finally, an illustration example is used.
KeywordsGeneralizability probability Permutation test Reproducibility probability Sample size adjustment Sample size estimation
The authors would like to thank the associated editor and referees for their comments that contribute in improving the paper. We also greatly appreciate Dr. Ibrahim Almasri, Department of Applied Mathematics and Physics - Palestine Polytechnic University, for being kind enough to read and improve the language of the paper.
- Aguirre-Urreta M, Rönkkö M (2015) Sample size determination and statistical power analysis in PLS using R: an annotated tutorial. Commun Assoc Inf Syst 36(3):33–51Google Scholar
- Cooper H, Hedges LV (1997) The handbook of research synthesis. Russell Sage Foundation, New YorkGoogle Scholar
- Fisher RA (1935) The design of experiments. Oliver and Boyd, EdinburghGoogle Scholar
- Hemelrijk J (1961) Experimental comparison of Student’s and Wilcoxon’s two sample test. Quantitative Methods in Pharmacology. Inter-science, New York, pp 118–133Google Scholar
- Kraemer HC, Thiemann S (1987) How many subjects? Statistical power analysis in research. Sage Publications, Newbury ParkGoogle Scholar
- Lenth RV (2007) Post hoc power: tables and commentary. Technical Report 378, The University of Iowa - Department of Statistics and Actuarial ScienceGoogle Scholar
- Lipsey MW (1990) Design sensitivity: statistical power for experimental research. Sage Publications, Newbury ParkGoogle Scholar
- McHugh RB (1961) Confidence interval inference and sample size determination. Am Stat 15:14–17Google Scholar
- Schmitt MC (1987) The effects on an elaborated directed reading activity on the metacomprehension skills of third graders. Ph.D. Thesis, Purdue UniversityGoogle Scholar