Abstract
The alleged robustness of Z, t, and F tests against nonnormality and, when sample sizes are equal, of t and F tests against heterogeneity as well was investigated in a large-scale sampling study under conditions realistic to experimentation and testing in the behavioral sciences. Factors varied were: population shape (L or bell), σ1/σ2 (1/2, 1, or 2), size N of smallest sample (2, 4, 8, 16, 32, 64, 128, 256, 512, or 1,024), N1/N2 (1/3,1/2,1, 2, or 3), α (.05,.01, or.001), and test tailedness (left, right, or two). In about 25% of the situations investigated, the test failed to meet a very lax criterion for robustness at every examined N value less than 100, and in 8% at every value less than 1,000; no test met the criterion in all of the situations studied before N=512. Robustness was strongly influenced by all of the factors investigated, and interactions among the influencing factors were often strong and complex.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Boneau, C. A. The effects of violations of assumptions underlying the t test. Psychological Bulletin, 1960, 57, 49–64.
Bradley, J. V. Distribution-free statistical tests. Englewood Cliffs, N.J: Prentice-Hall, 1968. (a)
Bradley, J. V. Studies in research methodology. Dissertation Abstracts, 1968, 28, 4815B–4816B. (Monograph) (b)
Bradley, J. V. Probability; decision; statistics. Englewood Cliffs, N.J: Prentice-Hall, 1976.
Bradley, J. V. A common situation conducive to bizarre distribution shapes. American Statistician, 1977, 31, 147–150.
Bradley, J. V. Robustness? British Journal of Mathematical and Statistical Psychology, 1978,31, 144–152.
Bradley, J. V. Nonrobustness in classical tests on means and variances: A large-scale sampling study. Bulletin of the Psychonomic Society, 1980, 15, 275–278. (a)
Bradley, J. V. Nonrobustness in one-sample Z and t tests: A large-scale sampling study. Bulletin of the Psychonomic Society, 1980, 15,29–32. (b)
Glass, G. V., & Stanley, J. C. Statistical methods in education and psychology. Englewood Cliffs, N.J: Prentice-Hall, 1970.
Scheffe, H. The analysis of variance. New York: Wiley, 1959.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bradley, J.V. Nonrobustness in Z, t, and F tests at large sample sizes. Bull. Psychon. Soc. 16, 333–336 (1980). https://doi.org/10.3758/BF03329558
Received:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BF03329558