Abstract
This chapter demonstrates the shortcomings of the widespread practice that consists of simply reporting effect size [ES] indicators in addition to NSHT (without interval estimates). It also questions the consequences of restricting the use of ES to standardized measures, as commonly done in psychology and related fields.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baguley, T.: Standardized or simple effect size: What should be reported? Brit. J. Psychol. 100, 603–617 (2009)
Baguley, T.: When correlations go bad. The Psychologist 23, 122–123 (2010)
Bird, K.: Analysis of Variance via Confidence Intervals. Sage, London (2004)
Cohen, J.: The statistical power of abnormal-social psychological research: A review. J. Abnorm. Soc. Psych. 65, 145–153 (1962)
Cohen, J.: Statistical Power Analysis for the Behavioral Sciences, revised edn. Academic Press, New York (1977)
Fidler, F., Thompson, B.: Computing correct confidence intervals for ANOVA fixed and random-effects effect sizes. Educ. Psychol. Meas. 61, 575–604 (2001)
Field, A., Miles, J.: Discovering Statistics Using SAS. Sage, London (2010)
Fleiss, J.L.: Estimating the magnitude of experimental effects. Psychol. Bull. 72, 273–276 (1969)
Gibbons, R.D., Hedeker, D.R., Davis, J.M.: Estimation of effect size from a series of experiments involving paired comparisons. J. Educ. Stat. 18, 271–279 (1993)
Glass, G.V.: Primary, secondary, and meta-analysis of research. Educ. Researcher 5, 3–8 (1976)
Hays, W.L.: Statistics for Psychologists. Holt, Rinehart and Winston, New York (1963)
Hedges, L.V.: Distribution theory for Glass’s estimator of effect size and related estimators. J. Educ. Stat. 7, 107–128 (1981)
Howell, D.C.: Fundamental Statistics for the Behavioral Sciences, 7th edn. Wadsworth, Belmont (2010)
Hunter, J.E., Schmidt, F.L.: Methods of Meta-Analysis: Correcting Error and Bias in Research Findings, 2nd edn. Sage, Thousand Oaks, CA (2004)
Jaccard, J., Guilamo-Ramos, V.: Analysis of variance frameworks in clinical child and adolescent psychology: Advances issues and recommendations. J. Clin. Child Adolesc. 31, 278–294 (2002)
Kirk, R.E.: Effect magnitude: A different focus. J. Stat. Plan. Infer. 137, 1634–1646 (2007)
Lecoutre, B., Derzko, G.: Intervalles de confiance et de crédibilité pour le rapport de taux d’évènements rares. 4èmes Journées de Statistique, SFdS, Bordeaux (2009). http://hal.inria.fr/docs/00/38/65/95/PDF/p40.pdf. Cited 13 March 2014
Lenth, R.V.: Some practical guidelines for effective sample size determination. Amer. Statist. 55, 187–193 (2001)
McMillan, J.H., Foley, J.: Reporting and discussing effect size: Still the road less traveled? Pract. Ass., Res. Eval. 16(14) (2011) Available http://pareonline.net/pdf/v16n14.pdf. Cited 13 March 2014
Olejnik, S., Algina, J.: Generalized eta and omega squared statistics: measures of effect size for some common research designs. Psychol. Methods 8, 434–447 (2003)
Robey, R.R.: Reporting point and interval estimates of effect-size for planned contrasts: fixed within effect analyses of variance (tutorial). J. Fluency Disord. 29, 307–341 (2004)
Rosnow, R.L., Rosenthal, R.: Effect sizes: Why, when, and how to use them. J. Psychol. 217, 6–14 (2009)
Rothman, K.J., Greenland S.: Modern Epidemiology, 2nd edn. Lippincott-Raven, Philadelphia (1998)
SAS Institute Inc.: SAS/SAT 9.22 User’s Guide. SAS Institute Inc., Cary, NC (2010)
Smithson, M.: Correct confidence intervals for various regression effect sizes and parameters: The importance of noncentral distributions in computing intervals. Educ. Psychol. Meas. 61, 605–632 (2001)
Smithson, M.: Confidence Intervals. Sage, Thousand Oaks (2003)
Steiger, J.H., Fouladi, R.T.: Noncentrality interval estimation and the evaluation of statistical models. In: Harlow, L.L., Mulaik, S.A., Steiger, J.H. (eds.) What If There Were No Significance Tests?, pp. 221–257. Erlbaum, Hillsdale (1997)
Steiger, J.H.: Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychol. Methods 9, 164–182 (2004)
Thompson, B.: Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. J. Exp. Educ. 70, 80–93 (2001)
Tukey, J.W.: Analyzing data: Sanctification or detective work? Am. Psychol. 24, 83–91 (1969)
Wilkinson, L., Task Force on Statistical Inference, APA Board of Scientific Affairs: Statistical methods in psychology journals: Guidelines and explanations. Am. Psychol. 54, 594–604 (1999)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 The Author(s)
About this chapter
Cite this chapter
Lecoutre, B., Poitevineau, J. (2014). Reporting Effect Sizes: The New Star System. In: The Significance Test Controversy Revisited. SpringerBriefs in Statistics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44046-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-662-44046-9_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44045-2
Online ISBN: 978-3-662-44046-9
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)