Analysis of variance for repeated measures designs with word materials as a nested random or fixed factor
This article is about analysis of data obtained in repeated measures designs in psycholinguistics and related disciplines with items (words) nested within treatment (5 type of words). Statistics tested in a series of computer simulations are:F 1,F 2,F 1 &F 2,F′, minF′, plus two decision procedures, the one suggested by Forster and Dickinson (1976) and one suggested by the authors of this article. The most common test statistic,F 1 &F 2, turns out to be wrong, but all alternative statistics suggested in the literature have problems too. The two decision procedures perform much better, especially the new one, because it systematically takes into account the subject by treatment interaction and the degree of word variability.
KeywordsVariance Component Common Variance Decision Procedure Psycholinguistic Research Repeat Measure Data
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Allison, P. D.
. Thousand Oaks, CA: Sage.Google Scholar
Baayen, R. H., Tweedie, F. J.
, &Schreuder, R.
(2002). The subjects as a simple random effect fallacy: Subject variability and morphological family effects in the mental lexicon.Brain & Language
, 55–65.CrossRefGoogle Scholar
Clark, H. H.
(1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research.Journal of Verbal Learning & Verbal Behavior
, 335–359.CrossRefGoogle Scholar
Coleman, E. B.
(1979). Generalization effects vs. random effects: Is σSL2
a source of Type 1 or Type 2 error?Journal of Verbal Learning & Verbal Behavior
, 243–256.CrossRefGoogle Scholar
Forster, K. I.
, &Dickinson, R. G.
(1976). More on the languageas-fixed-effect fallacy: Monte Carlo estimates of error rates forF1
, and MinF′
.Journal of Verbal Learning & Verbal Behavior
, 135–142.CrossRefGoogle Scholar
Gornbein, J. A., Lazaro, C. G.
, &Little, R. A.
(1992). Incomplete data in repeated measures analysis.Statistical Methods in Medical Research
, 275–295.CrossRefPubMedGoogle Scholar
, &Krystal, J. K.
(2004). More over ANOVA: Progress in analyzing repeated measures data and its reflection in papers published in the Archives of General Psychiatry.Archives of General Psychiatry
, 310–317.CrossRefPubMedGoogle Scholar
Huynh, H. S.
, &Feldt, L. S.
(1976). Estimation of the box correction for degrees of freedom.Journal of Educational Statistics
, 69–82.CrossRefGoogle Scholar
Kirk, R. E.
(1995).Experimental designs: Procedures for the behavioral sciences
(3rd ed.). Belmont: Brooks/Cole.Google Scholar
(1960). Robust tests for equality of variances. In I. Olkin (Ed.),Contributions to probability and statistics
(pp. 278–292). Stanford, CA: Stanford University Press.Google Scholar
Little, R. J. A.
, &Rubin, D. B.
(1987).Statistical analysis with missing data
. New York: Wiley.Google Scholar
Maxwell, S. E.
, &Bray, J. H.
(1986). Robustness of the quasiF
statistic to violations of sphericity.Psychological Bulletin
, 416–421.CrossRefGoogle Scholar
, &van den Bergh, H.
(2004). On multi-level modeling of data from repeated measures designs: A tutorial.Speech Communication
, 103–121.CrossRefGoogle Scholar
Raaijmakers, J. G. W., Schrijnemakers, J. M. C.
, &Gremmen, F.
(1999). How to deal with “the language-as-fixed-effect fallacy”: Common misconceptions and alternative solutions.Journal of Memory & Language
, 416–426.CrossRefGoogle Scholar
, &van Hout, R.
(2005).Statistics in language research: Analysis of variance
. Berlin: Mouton de Gruyter.CrossRefGoogle Scholar
Rietveld, T., van Hout, R.
, &Ernestus, M.
(2004). Pitfalls in corpus linguistics.Computers & the Humanities
, 343–362.CrossRefGoogle Scholar
Schreuder, R., Burani, C.
, &Baaijen, R. H.
(2003). Parsing and semantic opacity. In E. M. H. Assink & D. Sandra (Eds.),Reading complex words
(pp. 159–189). Dordrecht: Kluwer.Google Scholar
Wickens, T. D.
, &Keppel, G.
(1983). On the choice of design and of test statistics in the analysis of experiments with sampled materials.Journal of Verbal Learning & Verbal Behavior
, 296–309.CrossRefGoogle Scholar
Wilcox, R. R.
(1987). New designs in analysis of variance.Annual Review of Psychology
, 29–60.CrossRefGoogle Scholar
Winer, B. J., Brown, D. R.
, &Michels, K. M.
(1991).Statistical principles in experimental design
. New York: McGraw-Hill.Google Scholar
© Psychonomic Society, Inc. 2007