Skip to main content
SpringerLink
Log in

Meta-analysis in the social sciences:

  • General Issues
  • Published:
Asia Pacific Education Review Aims and scope Submit manuscript

Abstract

Meta-analysis is a class of statistical methods for combining the results from a series of studies addressing the same research question. These methods can powerfully test hypotheses that cannot be answered clearly with one or a few studies and eliminates the ambiguity that results from narrative reviews of a research literature or from counting the number of studies that support a particular conclusion. The usefulness of meta-analysis is demonstrated by reviewing instances in psychotherapy, education, and medicine that show how meta-analysis was used successfully to end acrimonious debate and reach a firm and lasting conclusion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Andrews, G., and Harvey, R. (1981). Does psychotherapy benefit neurotic patients? A reanalysis of the Smith, Glass, & Miller data.Archives of General Psychiatry, 38, 1203–1208.

    Google Scholar 

  • Bergin, A. E. (1971). The evaluation of therapeutic outcomes. In A. E. Bergin and S. L. Garfield (Eds.),Handbook of psychotherapy and behavior change (pp. 217–270). New York: Wiley.

    Google Scholar 

  • Castonguay, L. G. (1993). “Common factors” and ”nonspecific variables”: Clarification of the two concepts and recommendations for research.Journal of Psychotherapy Integration, 3, 267–286.

    Google Scholar 

  • Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., Johnson, S. B., McCurry, S., Mueser, K. T., Pope, K. S., Sanderson, W. C, Shoham, V., Stickle, T., Williams, D. A., and Woody, S. R. (1998). Update on empirically validated therapies, II.The Clinical Psychologist, 51, 3–16.

    Google Scholar 

  • Chambless, D. L., and Hollon, S. D. (1998). Defining empirically supported therapies.Journal of Consulting and Clinical Psychology, 66, 7–18.

    Article  Google Scholar 

  • Cohen, J. (1988).Statistical Power Analysis for the Behavioral Sciences. (2nd Ed.). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Cooper, H., & Hedges, L. V. q. (Eds.). (1994).The handbook of research synthesis. New York: Russell Sage Foundation.

    Google Scholar 

  • Eysenck, H. J. (1952). The effects of psychotherapy: An evaluation.Journal of Consulting Psychology, 16, 319–324.

    Article  Google Scholar 

  • Eysenck, H. J. (1961). The effects of psychotherapy. In H. J. Eysenck (Ed.),Handbook of abnormal psychology. New York: Basic Books.

    Google Scholar 

  • Eysenck, H. J. (1966).The Effects of Psychotherapy. New York: International science press.

    Google Scholar 

  • Eysenck, H. J. (1978). An exercise in meta-silliness.American Psychologist, 33, 517.

    Article  Google Scholar 

  • Eysenck, H. J. (1984). Meta-analysis: An abuse of research integration.The Journal of Special Education, 18, 41–59.

    Article  Google Scholar 

  • Frank, J. D., and Frank, J. B. (1991).Persuasion and Healing: A Comparative Study of Psychotherapy. (3rd Ed.). Baltimore: Johns Hopkins University Press.

    Google Scholar 

  • Garfield, S. L. (1995).Psychotherapy: An Eclectic-Integrative Approach. New York: Wiley & Sons.

    Google Scholar 

  • Grissom, R. J. (1996). The magical number, 7+2 Meta-meta-analysis of the probability of superior outcome in comparisons involving therapy, placebo, and control.Journal of Consulting and Clinical Psychology, 64, 973–982.

    Article  Google Scholar 

  • Hanushek, E. A. (1989). The impact of differential expenditures on school performance.Educational Researcher, 18, 45–62.

    Google Scholar 

  • Hedges, L. V., Laine, R. D., and Greenwald, R. (1994a). Does money matter? A meta-analysis of studies of the effects of differential school inputs on student outcomes.Educational Researcher, 23, 5–14.

    Google Scholar 

  • Hedges, L. V., Laine, R. D., and Greenwald, R. (1994b). The effect of school resources on student achievement.Review of Educational Researcher, 66, 361–396.

    Google Scholar 

  • Hedges, L. V., & Olkin, I. (1985).Statistical Methods for Meta-Analysis. San Diego: Academic Press.

    Google Scholar 

  • Hunt, M. (1997).How science takes stock: The story of meta-analysis. New York: Russell Sage Foundation.

    Google Scholar 

  • Hunter, J. E., and Schmidt, F. L. (1990).Methods of meta-analysis: Correcting error bias in research findings. Newbury Park, CA: Sage.

    Google Scholar 

  • Lambert, M. J., and Bergin, A. E. (1994). The effectiveness of psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.),Handbook of psychotherapy and behavior change (4th Ed., pp. 143–189). New York: Wiley.

    Google Scholar 

  • Landman, J. T., & Dawes, R. M. (1982). Psychotherapy outcome: Smith and Glass’ conclusions stand up under scrutiny.American Psychologist, 37, 504–516.

    Article  Google Scholar 

  • Lau et al., J. (1992). Cumulative meta-analysis of therapeutic trials for myocardial infarction.New England Journal of Medicineq, 327, 248–254.

    Article  Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.American Psychologist 48, 1181–1209.

    Article  Google Scholar 

  • Luborsky, L. (1954). A note on Eysenck’s article “The effect of psychotherapy: An evaluation”.British Journal of Psychology, 45, 129–131.

    Google Scholar 

  • Luborsky, L., Singer, B. and Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that “Everyone has won and all must have prizes?”.Archives of General Psychiatry, 32, 995–1008.

    Google Scholar 

  • Meltzoff, J., and Kornreich, M. (1970).Research in Psychotherapy. Chicago: Adline.

    Google Scholar 

  • Norcross, J. C. & Newman, C. F. (1992). Psychotherapy integration: Setting the context. In J. C. Norcross & M. R. Goldfried (Eds.),Handbook of psychotherapy integration (pp. 3–45). New York: Basic Books.

    Google Scholar 

  • Rachman, S. (1971).The Effects of Psychotherapy. Oxford: Pergammon Press.

    Google Scholar 

  • Rachman, S. (1977). Double standards and single standards.Bulletin of the Bristish Psychological Society, 30, 295.

    Google Scholar 

  • Rosenthal, R. (1990). How are we doing in soft psychology?American Psychologist, 45, 755–757.

    Article  Google Scholar 

  • Rosenthal, R., and Rubin, D. B. (1984).Meta-Analytic Procedures for the Social Sciences. Beverly Hills, CA: Sage.

    Google Scholar 

  • Shapiro, D. A. & Shapiro, D. (1982). Meta-analysis of comparative therapy outcome studies: A replication and refinement.Psychological Bulletin, 92, 581–604.

    Article  Google Scholar 

  • Smith, M. L., and Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies.American Psychologist, 32, 752–760.

    Article  Google Scholar 

  • Smith, M. L., Glass, G. V., & Miller, T. I. (1980).The Benefits of Psychotherapy. Baltimore: The Johns Hopkins University Press.

    Google Scholar 

  • Stiles, W. B., Shapiro, D. A., and Elliott, R. (1986). Are all psychotherapies equivalent?.American Psychologist, 41, 165–180.

    Article  Google Scholar 

  • Task Force on Promotion and Dissemination of Psychological Procedures. (1995). Training in and dissemination of empirically-validated psychological treatment: Report and recommendations.The Clinical Psychologist, 48, 2–23.

    Google Scholar 

  • Wampold, B. E. (2000). Outcomes of individual counseling and psychotherapy: Empirical evidence addressing recommendations.The Clinical Psychologist, 48, 2–23.

    Google Scholar 

  • Wampold, B. E. (In press).The Great Psychotherapy Bebate. Hillsdale, NJ: Lawrence Erlbaum Associates.

  • Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, ”All must have prizes”.Psychological Bulletin, 122, 203–215.

    Article  Google Scholar 

  • Wilson, G. T. (1982). How useful is meta-analysis in evaluating the effects of different psychological therapies?Behavioural Psychotherapy, 10, 221–231.

    Article  Google Scholar 

  • Wilson, G. T. and Rachman, S. J. (1983). Meta-analysis and the evaluation of psychotherapy outcome: Limitations and liabilities.Journal of Consulting and Clinical Psychology, 51, 54–64.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Wisconsin-Madison, 53706, WI, USA

    Bruce E. Wampold, Hyunnie Ahn & Dongmin Kim

Authors
  1. Bruce E. Wampold
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyunnie Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dongmin Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bruce E. Wampold.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wampold, B.E., Ahn, H. & Kim, D. Meta-analysis in the social sciences:. Asia Pacific Educ. Rev. 1, 67–74 (2000). https://doi.org/10.1007/BF03026147

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03026147

Keywords

Search

Navigation