Abstract
This study is undertaken to apply a bootstrap method of controlling the false discovery rate (FDR) when performing pairwise comparisons of normal means. Due to the dependency of test statistics in pairwise comparisons, many conventional multiple testing procedures can’t be employed directly. Some modified procedures that control FDR with dependent test statistics are too conservative. In the paper, by bootstrap and goodness-of-fit methods, we produce independent p-values for pairwise comparisons. Based on these independent p-values, plenty of procedures can be used, and two typical FDR controlling procedures are applied here. An example is provided to illustrate the proposed approach. Extensive simulations show the satisfactory FDR control and power performance of our approach. In addition, the proposed approach can be easily extended to more than two normal, or non-normal, balance or unbalance cases.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Benjamini, Y., Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 57: 289–300 (1995).
Benjamini, Y., Krieger, A. and Yekutieli, D. Adaptive linear stepup procedures that control the false discovery rate. Biometrica, 93: 491–507 (2006).
Benjamini, Y., Yekutieli, D. The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 29: 1165–1188 (2001)
Benjamini, Y., Hochberg, Y., Kling, Y. False discovery rate control in pairwise comparisons. Research Paper, Department of Statistics and O.R., Tel Aviv University, 1993, 93–102
Blair, C.R., Hochberg, Y. Improved bonferroni for testing overall and pairwise homogeneity hypotheses. Journal of Statistical Computation and Simulation, 51: 281–289 (1995)
Erdman, L.W. Studies to determine if antibiosis occurs among Rhizobia: between Rhizobium meliloti and Rhizobium trifoli. J. Amer. Soc. Agron., 38: 251–258 (1946)
Gavrilov, Y., Benjamini, Y., Sarkar, S.K. An adaptive step-down procedure with proven FDR control under independence. Ann. Statist., 37: 619–629 (2009)
Hsu, J.C. Multiple Comparisons. Chapman & Hall, CRC, London, 1999
Kesselman, H.J., Cribbie, R., Holland, B. The pairwise multiple comparison multiplicity problem. An alternative approach to familywise and comparisonwise type I error control. Psychological Methods, 4(1): 58–69 (1999)
Tukey, J.W. The problem of multiple comparisons. Mimeographed monograph, appears in full. In: Braun, H. (Ed.), Collected work of J.W., 1953
Williams, V.S.L., Jones, L.V., Tukey, J.W. Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. Journal of Educational and Behavioral Statistics, 24(1): 42–69 (1999)
Yekutieli, D. False discovery rate control for non-positively regression dependent test statistics. Journal of Statistical Planning and Inference, 2007, doi:10.1016/j.jspi.2007.06.006
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Natural Science Foundation of China (No.11471030, 11471035, 71201160).
Rights and permissions
About this article
Cite this article
Jin, P., Xu, Xz. & Li, N. FDR control for pairwise comparisons of normal means based on goodness of fit test. Acta Math. Appl. Sin. Engl. Ser. 32, 701–712 (2016). https://doi.org/10.1007/s10255-016-0598-1
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10255-016-0598-1