Skip to main content
SpringerLink
Log in

Conducting tests of hypotheses: The need for an adequate sample size

  • Published:
The Australian Educational Researcher Aims and scope Submit manuscript

Abstract

This article addresses the importance of obtaining a sample of an adequate size for the purpose of testing hypotheses. The logic underlying the requirement for a minimum sample size for hypothesis testing is discussed, as well as the criteria for determining it. Implications for researchers working with convenient samples of a fixed size are also considered, and suggestions are given about the steps that should be taken when they are not able to obtain a large enough sample. Finally, the implications of not having an adequate sample size for hypothesis testing are discussed to highlight the importance of determining sample size prior to conducting one’s study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Psychological Association (1994)Publication Manual of the American Psychological Association, 4th ed., American Psychological Association, Washington, DC.

    Google Scholar 

  • American Psychological Association (2001)Publication Manual of the American Psychological Association, 5th ed., American Psychological Association, Washington, DC.

    Google Scholar 

  • Bakan, D. (1967)On Method: Toward a Reconstruction of Psychological Investigation, Jossey-Bass, San Francisco.

    Google Scholar 

  • Bracey, G. W. (1991) Sense, non-sense, and statistics,Phi Delta Kappan, vol. 73, no. 4, p. 335.

    Google Scholar 

  • Bradley, D. R., R. L. Russell and C. P. Reeve (1996) Statistical power in complex experimental designs,Behaviour Research Methods, Instruments, and Computers, vol. 28, pp. 319–26.

    Article  Google Scholar 

  • Brewer, J. K. (1972) On the power of statistical tests in theAmerican Educational Research Journal, American Educational Research Journal, vol. 9, pp. 391–401.

    Google Scholar 

  • Brewer, J. K. (1978) Effect size: the most troublesome of the hypothesis testing considerations,Center on Evaluation, Development, and Research Quarterly, vol. 11, no. 4, pp. 7–10.

    Google Scholar 

  • Brewer, J. K. (1985) Behavioral statistics textbooks: source of myths and misconceptions?,Journal of Educational Statistics, vol. 10, no. 3, pp. 252–6.

    Article  Google Scholar 

  • Brewer, J. K. (1988)Introductory statistics for researchers, 5th ed., Burgess International Group, Minnesota.

    Google Scholar 

  • Brewer, J. K. and P. W. Owen (1973) A note on the power of statistical tests in theJournal of Educational Measurement, Journal of Educational Measurement, vol. 10, no. 1, pp. 72–4.

    Article  Google Scholar 

  • Brewer, J. K. and P. T. Sindelar (1987) Adequate sample size: a priori and post hoc considerations,Journal of Special Education, vol. 21, no. 4, pp. 74–84.

    Article  Google Scholar 

  • Carver, R. P. (1978) The case against statistical significance testing,Harvard Educational Review, vol. 48, no. 3, pp. 378–99.

    Google Scholar 

  • Chase, L. J. and R. B. Chase (1976) A statistical power analysis of applied psychological research,Journal of Applied Psychology, vol. 61, pp. 234–7.

    Article  Google Scholar 

  • Chase, L. J. and R. K. Tucker (1975) A power-analytic examination of contemporary communication research,Speech Monographs, vol. 42, pp. 29–41.

    Article  Google Scholar 

  • Cohen, J. (1962) The statistical power of abnormal-social psychological research: a review,Journal of Abnormal and Social Psychology, vol. 65, pp. 145–53.

    Article  Google Scholar 

  • Cohen, J. (1965) Some statistical issues in psychological research, in B. B. Wolman, ed.,Handbook of Clinical Psychology, McGraw-Hill, New York.

    Google Scholar 

  • Cohen, J. (1988)Statistical Power Analysis for the Behavioral Sciences, 2nd ed., Lawrence Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Cohen, J. (1990) Things I have learned (so far),American Psychologist, vol. 45, pp. 1304–12.

    Article  Google Scholar 

  • Cohen, J. (1994) The earth is round (p <.05),American Psychologist, vol. 49, pp. 997–1003.

    Article  Google Scholar 

  • Crookes, G. (1991) The forum: research issues,TESOL Quarterly, vol. 25, no. 4, pp. 762–5.

    Article  Google Scholar 

  • Davies, O. L. (1961)Statistical Methods in Research and Production, Hafner Publishing Co, New York.

    Google Scholar 

  • Dixon, W. J. and F. J. Massey, Jr. (1957)Introduction to Statistical Analysis, 2nd ed., McGraw-Hill, New York.

    Google Scholar 

  • Friedman, H. (1968) Magnitude of experimental effect and a table for its rapid estimation,Psychological Bulletin, vol. 70, pp. 245–51.

    Article  Google Scholar 

  • Glass, G. V. and K. D. Hopkins (1984)Statistical Methods in Education and Psychology, 2nd ed., Prentice Hall, Englewood Cliffs, NJ.

    Google Scholar 

  • Gold, D. (1969) Statistical tests and substantive significance,American Sociologist, vol. 4, no. 1, pp. 42–6.

    Google Scholar 

  • Harcum, E. R. (1989) The highly inappropriate calibrations of statistical significance,American Psychologist, vol. 44, no. 6, p. 964.

    Article  Google Scholar 

  • Hays, W. L. (1994)Statistics for the Social Sciences, 5th ed., Holt, Rinehart and Winston, New York.

    Google Scholar 

  • Jones, B. and J. K. Brewer (1972) An analysis of the power of statistical tests reported in theResearch Quarterly, Research Quarterly, vol. 43, pp. 23–30.

    Google Scholar 

  • Katzer, J. and J. Sodt (1973) An analysis of the use of statistical testing in communication research,Journal of Communication, vol. 23, pp. 251–65.

    Article  Google Scholar 

  • Kirk, R. (1996) Practical significance: A concept whose time has come,Educational and Psychological Measurement, vol. 56, no. 5, pp. 746–59.

    Article  Google Scholar 

  • Kraemer, H. C. and S. Thiemann (1987)How Many Subjects: Statistical Power Analysis in Research, Sage, Beverly Hills, CA.

    Google Scholar 

  • Labovitz, S. (1968) Criteria for selecting a significance level: a note on the sacredness of.05,American Sociologist, vol. 3, no. 3, pp. 200–22.

    Google Scholar 

  • Lazaraton, A. (1991) The forum: research issues,TESOL Quarterly, vol. 25, no. 4, pp. 759–62.

    Article  Google Scholar 

  • Olejnik, S. F. (1984) Planning educational research: determining the necessary sample size,Journal of Experimental Education, vol. 53, no. 1, pp. 40–8.

    Google Scholar 

  • Patnaik, P. B. (1949) The non-central 94-1 and F-distributions and their applications,Biometrika, vol. 36, pp. 202–32.

    Google Scholar 

  • Penick J. E. and J. K. Brewer (1972) The power of statistical tests in science teaching research,Journal of Research in Science Teaching, vol. 9, no. 4, pp. 377–81.

    Article  Google Scholar 

  • Rosnow, R. L. and R. Rosenthal (1989) Statistical procedures and the justification of knowledge in psychological science,American Psychologist, vol. 44, no. 10, pp. 1276–84.

    Article  Google Scholar 

  • Sedlmeier, P. and G. Gigerenzer (1989) Do studies of statistical power have an effect on the power of studies?Psychological Bulletin, vol. 105, pp. 309–16.

    Article  Google Scholar 

  • Shaver, J. P. (1993) What statistical significance testing is, and what it is not,Journal of Experimental Education, vol. 61, no. 4, pp. 361–77.

    Google Scholar 

  • Snyder, P. and S. Lawson (1993) Evaluating results using corrected and uncorrected effect size estimates,Journal of Experimental Education, vol. 61, no. 4, pp. 334–49.

    Google Scholar 

  • Thomas, L. and C. J. Krebs (1997) A review of statistical power analysis software,Bulletin of the Ecological Society of America, vol. 78, no. 2, pp. 126–39, viewed 28 February 2003, 〈http://www.zoology.ubc.ca/~krebs/power.html〉

    Google Scholar 

  • Thompson, B. (1997) Computing effect sizes, viewed 15 January 2003, 〈http://www.coe.tamu.edu/~bthompson/effect.html〉

  • Wilkinson, L. and Task Force on Statistical Inference (1999) Statistical methods in psychology journals: guidelines and explanations,American Psychologist, vol. 54, pp. 594–604, viewed 28 February 2003, 〈http://www.apa.org/journals/amp/amp548594.html〉

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. International Islamic University Malaysia, Malaysia

    Ratnawati Mohd Asraf & James K. Brewer

  2. Florida State University, USA

    Ratnawati Mohd Asraf & James K. Brewer

Authors
  1. Ratnawati Mohd Asraf
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. James K. Brewer
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Asraf, R.M., Brewer, J.K. Conducting tests of hypotheses: The need for an adequate sample size. Aust. Educ. Res. 31, 79–94 (2004). https://doi.org/10.1007/BF03216806

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03216806

Keywords

Search

Navigation