Analyzing Group Differences

  • Luke Wander AmorosoEmail author


Many research questions in applied linguistics involve comparisons of group performance. Analysis of variance (ANOVA) is the procedure of choice in the majority of such analyses. This chapter identifies appropriate uses of ANOVA, explains how to conduct a statistically sound ANOVA, and also discusses null hypothesis testing and the importance of reporting and interpreting effect sizes in the context of means-based analyses. Use of some other statistical tools that are part of the general linear model (t-tests and multiple regression) for group mean comparisons are described with worked hypothetical examples. The chapter also describes the process of checking statistical assumptions, interpreting statistical output, and calculating effect sizes.


Analysis of variance (ANOVA) Regression Quantitative research methods Second language acquisition 


  1. Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70(6), 426–443.CrossRefGoogle Scholar
  2. Cumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York: Routledge.Google Scholar
  3. Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Quantitative Psychology 402 and. Measurement, 5, 781.Google Scholar
  4. Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (Eds.). (1997). What if there were no significance tests? Mahwah, NJ: Erlbaum.Google Scholar
  5. Hollander, M., & Wolfe, D. A. (1999). Nonparametric statistical methods (2nd ed.). New York: Wiley.Google Scholar
  6. Lakens, D. (in press). Equivalence tests: A practical primer for t-tests, correlations, and meta-analyses. Social Psychology and Personality Science.Google Scholar
  7. Larson-Hall, J. (2006). What does more time buy you? Another look at the effects of long-term residence on production accuracy of English /ɹ/ and /l/ by Japanese speakers. Language and Speech, 49(4), 521–548.CrossRefGoogle Scholar
  8. Larson-Hall, J. (2016). A guide to doing statistics in second language research using SPSS and R (2nd ed.). New York: Routledge.Google Scholar
  9. Larson-Hall, J., & Plonsky, L. (2015). Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65(S1), 127–159.CrossRefGoogle Scholar
  10. Lomax, R., & Hahs-Vaughn, D. L. (2012). Statistical concepts: A second course (4th ed.). New York: Routledge.Google Scholar
  11. Lyster, R., & Saito, K. (2010). Oral feedback in classroom SLA: A meta-analysis. Studies in Second Language Acquisition, 32(2), 265–302.CrossRefGoogle Scholar
  12. Mackey, A., & Goo, J. (2007). Interaction research in SLA: A meta-analysis and research synthesis. In A. Mackey (Ed.), Conversational interaction in second language acquisition: A collection of empirical studies (pp. 407–449). Oxford: Oxford University Press.Google Scholar
  13. Marsden, E., Thompson, S., & Plonsky, L. (in press). A methodological synthesis of self-paced reading in second language research. Applied Psycholinguistics.Google Scholar
  14. Norouzian, R., de Miranda, M. A., & Plonsky, L. (in press). The Bayesian revolution in L2 research: An applied approach. Language Learning.Google Scholar
  15. Norouzian, R., & Plonsky, L. (2018). Eta- and partial eta-squared in L2 research: A cautionary review and guide to more appropriate usage. Second Language Research, 34, 257–271.CrossRefGoogle Scholar
  16. Norris, J. M. (2015). Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65(S1), 97–126.CrossRefGoogle Scholar
  17. Norris, J. M., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning, 50(3), 417–528.CrossRefGoogle Scholar
  18. Norris, J. M., & Ortega, L. (2006). The value and practice of research synthesis for language learning and teaching. In J. M. Norris & L. Ortega (Eds.), Synthesizing research on language learning and teaching (pp. 3–50). Philadelphia: John Benjamins.CrossRefGoogle Scholar
  19. Norris, J. M., Plonsky, L., Ross, S. J., & Schoonen, R. (2015). Guidelines for reporting quantitative methods and results in primary research. Language Learning, 65(2), 470–476.CrossRefGoogle Scholar
  20. Oshita, H. (2014). U-shaped development: Definition, exploration, and falsifiable hypotheses. In L. W. Amoroso & J. Connor-Linton (Eds.), Measured Language: Quantitative studies of acquisition, assessment, and variation (pp. 155–170). Washington, DC: Georgetown University Press.Google Scholar
  21. Plonsky, L. (2013). Study quality in SLA. Studies in Second Language Acquisition, 35(4), 655–687.CrossRefGoogle Scholar
  22. Plonsky, L. (2014). Study quality in quantitative L 2 research (1990–2010): A methodological synthesis and call for reform. Modern Language Journal, 98(1), 450–470.CrossRefGoogle Scholar
  23. Plonsky, L. (2015). Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp. 23–45). New York: Routledge.CrossRefGoogle Scholar
  24. Plonsky, L., Egbert, J., & LaFlair, G. T. (2015). Bootstrapping in applied linguistics: Assessing its potential using shared data. Applied Linguistics, 36(5), 591–610.Google Scholar
  25. Plonsky, L., & Gass, S. (2011). Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61(2), 325–366.CrossRefGoogle Scholar
  26. Plonsky, L., & Ghanbar, H. (in press). Multiple regression in L2 research: A methodological synthesis and guide to interpreting R2 values. Modern Language Journal.Google Scholar
  27. Plonsky, L., & Oswald, F. L. (2014). How big is ‘big’? Interpreting effect sizes in L2 research. Language Learning, 64(4), 878–912.CrossRefGoogle Scholar
  28. Plonsky, L., & Oswald, F. L. (2017). Multiple regression as a flexible alternative to ANOVA in L2 research. Studies in Second Language Acquisition, 39, 579–592.CrossRefGoogle Scholar
  29. Roever, C., & Phakiti, A. (2018). Quantitative methods for second language research: A problem-solving approach. New York: Routledge.Google Scholar
  30. Turner, J. L. (2014). Using statistics in small-scale language education research: Focus on non-parametric data. New York, NY: Routledge.CrossRefGoogle Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  1. 1.Truman State UniversityKirksvilleUSA

Personalised recommendations