Abstract
We present step-wise test procedures based on the Bonferroni-Holm principle for multi-way ANOVA-type models. It is shown for two plausible modifications that the multiple level α is preserved. These theoretical results are supplemented by a simulation study, in a two-way ANOVA setting, to compare the multiple procedures with respect to their simultaneous power and the relative frequency of correctly rejected false hypotheses.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bauer P, Röhmel J, Maurer W, Hothorn L (1998) Testing strategies in multidose experiments including active control. Statist. in Med. 17, 2133–2146.
Bergmann B, Hommel G (1988) Improvements of general multiple test procedures for redundant systems of hypotheses. In: Multiple hypotheses testing (Eds. Bauer P, Hommel G, Sonnemann E), 100–115. Springer Verlag, Berlin.
Bretz F (1999) Powerful modifications of Williams' test on trends. PhD-Thesis, University of Hannover.
Bretz F, Hayter AJ, Genz A (2001) Critical point and power calculations for the studentized range test for generally correlated means. J. Statist. Comput. and Simul. 71, 85–99.
Finner H (1988) Abgeschlossene multiple Spannweitentests. In: Multiple hypotheses testing (Eds. Bauer P, Hommel G, Sonnemann E), 10–32. Springer Verlag, Berlin.
Gabriel KR (1969) Simultaneous test procedures—some theory of multiple comparisons. Ann. Math. Statist. 40, 224–250.
Hartley HO (1955) Some recent developments in analysis of variance. Comm. Pure and Appl. Math. 8, 47–72.
Holm S (1977) Sequentially rejective multiple test procedures. Statistical Research Report 1977-1, Institute of Mathematics and Statistics, University of Umœa.
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6, 65–70.
Maurer W, Hothorn LA, Lehmacher W (1995) Multiple comparisons in drug clinical trials and preclinical assays: a—priori ordered hypotheses. In: Biometrie in der chmisch-pharmazeutischen Industrie, Vol. 6 (Ed. Vollmer J), 3–18. Fischer Verlag, Stuttgart.
Maurer W, Mellein B (1988) On new multiple tests based on independent p-values and the assessment of their power. In: Multiple hypotheses testing (Eds. Bauer P, Hommel G, Sonnemann E), 48–66. Springer Verlag, Berlin.
Moeschlin O, Pohl C, Grycki E, Steinert F (1995) Statistik und Experimentelle Stochastik. Birkhäuser, Basel.
Ottestad P (1960) On the use of the F-test in cases in which a number of variance ratios are computed by the same error mean square. Science Reports from the Agriculture College of Norway 39, 1–8.
Ottestad P (1970) Statistical models and their experimental application. Griffin, London.
Royen T (1987) Eine verschärfte Holm-Prozedur zum Vergleich aller Mittelwertpaare. EDV in Medizin und Biologie 18, 45–49.
Royen T (1988) The maximum range test—an improved step down procedure for the comparison of all pairs of means. EDV in Medizin und Biologie 19, 58–63.
Royen T (1990) A probability inequality for ranges and its application to maximum range test procedures. Metrika 37, 145–154.
Shaffer JP (1986) Modified sequentially rejective multiple test procedures. J. Amer. Statist. Assoc. 81, 826–831.
Sheffé H (1953) A method for judging all contrasts in the analysis of variance. Biometrika 40, 87–104.
Author information
Authors and Affiliations
Additional information
Financial support of the Deutsche Forschungsgemeinschaft is gratefully acknowledged.
Rights and permissions
About this article
Cite this article
Didelez, V., Pigeot, I. & Walter, P. Modifications of the Bonferroni-Holm procedure for a multi-way ANOVA. Statistical Papers 47, 181–209 (2006). https://doi.org/10.1007/s00362-005-0283-6
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/s00362-005-0283-6