Abstract
A method for computing simultaneous pairwise confidence intervals for location shift is presented, based on the permutation distribution of the maximum absolute pairwise difference among all pairs. The method guarantees strong control of familywise confidence, and does not require assumptions about the form of the population distribution. Simulations compare the permutation procedure to a bootstrap procedure, as well as to the Tukey–Kramer procedure. Simulation results suggest the proposed permutation method produces intervals that maintain simultaneous coverage, and that can be more precise for heavy-tailed distributions compared to competing methods. The permutation intervals may be preferred for data from heavy-tailed distributions.
Similar content being viewed by others
References
Bonnett, D.G., Price, R.M.: Statistical inference for a linear function of medians: confidence intervals, hypothesis testing, and sample size requirements. Psychol. Methods 7(3), 370–383 (2002)
Good, P.: Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses, 2nd edn. Springer, New York (2000)
Harrell, F.E., Davis, C.E.: A new distribution-free quantile estimator. Biometrika 69, 635–640 (1982)
Hoaglin, D.C.: Summarizing shape numerically: the g-and-h distribution. In: Hoaglin, D., Mosteller, F., Tukey, J. (eds.) Exploring Data Tables Trends and Shapes. Wiley, New York (1985)
Hochberg, Y., Tamhane, A.C.: Multiple Comparison Procedures. Wiley, New York (1987)
Lancaster, H.O.: Significance tests in discrete distributions. J. Am. Stat. Assoc. 56, 223–234 (1961)
Linton, L.R., Edgington, E.S., Davies, R.W.: A view of niche overlap amenable to statistical analysis. Can. J. Zool. 67, 55–60 (1989)
Manly, B.F.J.: Randomization, Bootstrap and Monte Carlo Methods in Biology. Chapman & Hall, London (1997)
Manly, B.F.J., Mcalevey, L., Stevens, D.: A randomization procedure for comparing group means on multiple measurements. Br. J. Math. Stat. Psychol. 39, 183–189 (1986)
McKean, J.W., Schrader, R.M.: A comparison of methods for studentizing the sample median. Commun. Stat. Simul. Comput. 13, 751–773 (1984)
Miller, R.G.: Simultaneous Statistical Inference, 2nd edn. Springer, New York (1981)
Powell, G.L., Russell, A.P.: The diet of the eastern short-horned lizard (Phrynosoma douglassi brevirostre) in Alberta and its relationship to sexual size dimorphism. Can. J. Zool. 62, 428–440 (1984)
Powell, G.L., Russell, A.P.: Growth and sexual size dimorphism in Alberta populations of the eastern short-horned lizard, Phrynosoma douglassi brevirostre. Can. J. Zool. 63, 139–154 (1985)
Price, R.M., Bonnett, D.G.: Estimating the variance of the sample median. J. Stat. Comput. Simul. 68, 295–305 (2001)
Richter, S.J., McCann, M.H.: Multiple comparisons using medians and permutation tests. J. Modern Appl. Stat. Methods 6(2), 399–412 (2007)
Rom, D.M.: A sequentially rejective test procedure based on a modified Bonferroni inequality. Biometrika 77, 663–666 (1990)
Romano, J.P.: On the behavior of randomization tests without a group invariance assumption. J. Am. Stat. Assoc. 85(411), 686–692 (1990)
Tukey, J.W.: Comparing individual means in the analysis of variance. Biometrics 5, 99–114 (1949)
Wheldon, M.C., Anderson, M.J., Johnson, B.W.: Identifying treatment effects in multi-channel measurements in electroencephalographic studies: multivariate permutation tests and multiple comparisons. Aust. N. Z. J. Stat. 49(4), 397–413 (2007)
Wilcox, R.R.: Comparing medians. Comput. Stat. Data Anal. 51, 1934–1943 (2006)
Wilcox, R.R.: Introduction to Robust Estimation and Hypothesis Testing, 3rd edn. Academic Press, Burlington (2012)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Richter, S.J., McCann, M.H. Resampling-based simultaneous confidence intervals for location shift using medians. AStA Adv Stat Anal 100, 189–205 (2016). https://doi.org/10.1007/s10182-015-0258-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10182-015-0258-4