Skip to main content
Log in

Global and multiple test procedures using ordered p-values—a review

  • Articles
  • Published:
Statistical Papers Aims and scope Submit manuscript

An Erratum to this article was published on 13 February 2013

Abstract

This paper reviews global and multiple tests for the combination ofn hypotheses using the orderedp-values of then individual tests. In 1987, Röhmel and Streitberg presented a general method to construct global level α tests based on orderedp-values when there exists no prior knowledge regarding the joint distribution of the corresponding test statistics. In the case of independent test statistics, construction of global tests is available by means of recursive formulae presented by Bicher (1989), Kornatz (1994) and Finner and Roters (1994). Multiple test procedures can be developed by applying the closed test principle using these global tests as building blocks. Liu (1996) proposed representing closed tests by means of “critical matrices” which contain the critical values of the global tests. Within the framework of these theoretical concepts, well-known global tests and multiple test procedures are classified and the relationships between the different tests are characterised.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bauer P (1989) Sequential tests of hypotheses in consecutive trials. Biom. J.31, 663–676

    Google Scholar 

  • Bicher A (1989) Alternativen zur Bonferroni-Abschätzung: Ansätze zur Verbesserung allgemeiner multipler Hypothesenüberprüfungen. Diploma thesis, University Mainz

  • Dalal SR, Mallows CL (1992) Buying with exact confidence. Ann. Appl. Prob.2, 752–765

    Article  MathSciNet  MATH  Google Scholar 

  • Falk RW (1989) Hommel’s Bonferroni-type inequality for unequally spaced levels. Biometrika76, 189–191

    Article  MathSciNet  MATH  Google Scholar 

  • Finner H, Roters M (1994) On the limit behaviour of the joint distribution function of order statistics. Ann. Inst. Statist. Math.46, 343–349

    Article  MathSciNet  MATH  Google Scholar 

  • Hochberg Y (1988) A sharper Bonferroni procedure for multiple tests of significance. Biometrika75, 800–802

    Article  MathSciNet  MATH  Google Scholar 

  • Hochberg Y, Tamhane AC (1987) Multiple Comparison Procedures, Wiley, New York

    Book  MATH  Google Scholar 

  • Holm S (1979) A simple sequentially rejective multiple test procedure. Scand. J. Statist.6, 65–70

    MathSciNet  MATH  Google Scholar 

  • Hommel G (1983) Tests of the overall hypothesis for arbitrary dependence structures. Biom. J.25, 423–430

    MathSciNet  MATH  Google Scholar 

  • Hommel G (1986) Multiple test procedures for arbitrary dependence structures. Metrika33, 321–336

    Article  MathSciNet  MATH  Google Scholar 

  • Hommel G (1988) A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika75, 383–386

    Article  MATH  Google Scholar 

  • hommel G (1989) A comparison of two modified Bonferroni procedures. Biometrika76, 624–625

    Article  MathSciNet  MATH  Google Scholar 

  • Klein M (1998) Multiple Testprozeduren: Step-down und Step-up. Diploma thesis, University Mainz

  • Kieser M, Reitmeir P, Wassmer G (1995) Test procedures for clinical trials with multiple endpoints, in Vollmar J (ed.): Biometrie in der chemischpharmazeutischen Industrie. Vol6, Fischer Verlag, Stuttgart, 41–60

    Google Scholar 

  • Kornatz C (1994) Allgemeine Schrankentests und ihre Anwendung bei aufeinan-derfolgenden Studien. Diploma thesis, University Mainz

  • Liu W (1996) Multiple tests of a non-hierarchical finite family of hypotheses. J. R. Statist. Soc. B58, 455–461

    MATH  Google Scholar 

  • Marcus R, Peritz E, Gabriel KR (1976) On closed testing procedures with special reference to ordered analysis of variance. Biometrika63, 655–660

    Article  MathSciNet  MATH  Google Scholar 

  • Maurer W, Mellein B (1988) On new multiple tests based on independent p-values and assessment of their power, in Bauer P, Hommel G, Sonnemann E (eds.): Multiple Hypothesenprüfungen—Multiple Hypotheses Testing, Springer, Berlin/Heidelberg/New York, 48–66

    Chapter  Google Scholar 

  • Röhmel G, Streitberg B (1987) Zur Konstruktion globaler Tests. EDV in Med. u. Biol.18, 7–11

    Google Scholar 

  • Rom DM (1990) A sequentially rejective test procedure based on a modified Bonferroni inequality. Biometrika77, 663–665

    Article  MathSciNet  Google Scholar 

  • Rüger B (1978) Das maximale Signifikanzniveau des Tests: “LehneH 0 ab, wenn k unter n gegebenen Tests zur Ablehnung führen”. Metrika25, 171–178

    Article  MathSciNet  MATH  Google Scholar 

  • Sarkar SK, Chang CK (1997) The Simes method for multiple test hypothesis testing with positively dependent test statistics. J. Am. Stat. Assoc.92, 1601–1608

    Article  MathSciNet  MATH  Google Scholar 

  • Shaffer JP (1986) Modified sequentially rejective multiple test procedures. J. Am. Stat. Assoc.81, 826–831

    Article  MATH  Google Scholar 

  • Simes RJ (1986) An improved Bonferroni procedure for multiple tests of significance. Biometrika73, 751–754

    Article  MathSciNet  MATH  Google Scholar 

  • Tippett LMC (1931) The Methods of Statistics. Williams & Norgate, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

An erratum to this article can be found online at http://dx.doi.org/10.1007/s00362-013-0505-2.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bernhard, G., Klein, M. & Hommel, G. Global and multiple test procedures using ordered p-values—a review. Statistical Papers 45, 1–14 (2004). https://doi.org/10.1007/BF02778266

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02778266

Key words

Navigation