Abstract
The generalization of the Behrens–Fisher problem to comparing more than two means from nonhomogeneous populations has attracted the attention of statisticians for many decades. Several approaches offer different approximations to the distribution of the test statistic. The question of statistical properties of these approximations is still alive. Here, we present a brief overview of several approaches suggested in the literature and implemented in software with a focus on investigating the accuracy of p values as well as their dependence on nuisance parameters and on the underlying assumption of normality. We illustrate by simulation the behavior of p values. In addition to the Satterthwaite–Fai–Cornelius test, the Kenward–Roger test, the simple ANOVA F test, the parametric bootstrap test, and the generalized F test will be briefly discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Brown MB, Forsythe AB (1974) The small sample behavior of some statistics which test the equality of several means. Technometrics 16: 129–132
Casella G, Berger RL (2002) Statistical inference, 2nd edn. Duxbury Press, Pacific Grove, CA
Fai AHT, Cornelius PL (1996) Approximate F-tests of multiple degree of freedom hypotheses in generalized least squares analyses of unbalanced split-plot experiments. J Stat Comput Simul 54: 363–378
Gamage J, Weerahandi S (1998) Size performance of some tests in one-way ANOVA. Commun Stat Simul Comput 27: 625–640
Giesbrecht FG, Burns JC (1985) Two-stage analysis based on a mixed model: large sample asymptotic theory and small sample simulation results. Biometrics 41: 477–486
Harville DA, Jeske DR (1992) Mean squared error of estimation or prediction under a general linear model. J Am Stat Assoc 87: 724–731
Kackar RN, Harville DA (1984) Approximation for standard errors of estimators of fixed and random effects in mixed linear models. J Am Stat Assoc 79: 853–862
Kenward MG, Roger JH (1997) Small sample inference for fixed effects from restricted maximum likelihood. Biometrics 53: 983–997
Krishnamoorthy K, Lu F, Mathew T (2007) A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random models. Comput Stat Data Anal 51: 5731–5742
LaMotte LR (2007) A direct derivation of the REML likelihood function. Stat Pap 48: 321–327
Lee S, Ahn ChH (2003) Modified ANOVA for unequal variances. Commun Stat Simul Comput 32: 987–1004
Rao CR, Kleffe J (1988) Estimation of variance components and applications. North-Holland, Amsterdam
Satterthwaite FE (1941) Synthesis of variance. Psychometrika 6: 309–316
Satterthwaite FE (1946) An approximate distribution of estimates of variance components. Biometrics Bull 2: 110–114
Tsui K-W, Weerahandi S (1989) Generalized p-values in significance testing of hypotheses in the presence of nuisance parameters. J Am Stat Assoc 84: 602–607
Volaufova J, LaMotte LR (2008) Comparison of approximate tests of fixed effects in linear repeated measures design models with covariates. Tatra Mountains Mathematical Publications 39: 17–25
Weerahandi S (1995) ANOVA under unequal variances. Biometrics 51: 589–599
Welch BL (1951) On the comparison of several mean values: an alternative approach. Biometrika 38: 330–336
Xu L, Wang S (2008) A new generalized p-value and its upper bound for ANOVA under unequal error variances. Commun Stat Theory Methods 37: 1002–1010
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Volaufova, J. Heteroscedastic ANOVA: old p values, new views. Stat Papers 50, 943–962 (2009). https://doi.org/10.1007/s00362-009-0262-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-009-0262-4