Skip to main content

Meta-analysis in Prevention Science

  • Chapter
  • First Online:
Defining Prevention Science

Part of the book series: Advances in Prevention Science ((Adv. Prevention Science))

Abstract

This chapter describes the fundamental elements of meta-analysis, with particular emphasis on its relevance to prevention science. The goal is to provide readers with a basic understanding of what a meta-analysis is, how to identify meta-analysis topics appropriate to prevention science, how to interpret results from meta-analysis, and how to identify some of the potential biases in meta-analysis; in short, our goal is to create intelligent consumers of meta-analysis. Armed with knowledge about some of the common ways that meta-analytic techniques can be used in prevention science research, we encourage readers interested in conducting a meta-analysis to seek more comprehensive resources on the statistical methods unique to this form of research (e.g., Borenstein, Hedges, Higgins, & Rothstein, 2009; Cooper, Hedges, & Valentine, 2009; Lipsey & Wilson, 2001).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bálint, S., Czobor, P., Komlósi, S., Mészáros, Á., Simon, V., & Bitter, I. (2009). Attention deficit and hyperactivity disorder (ADHD): Gender- and age-related differences in neurocognition. Psychological Medicine, 39, 1337–1345.

    Article  PubMed  Google Scholar 

  • Battin-Pearson, S., Newcomb, M. D., Abbott, R. D., Hill, K. G., Catalano, R. F., & Hawkins, J. D. (2000). Predictors of early high school dropout: A test of five theories. Journal of Educational Psychology, 92, 568–582.

    Article  Google Scholar 

  • Becker, B. J. (2005). Failsafe N or file-drawer number. In H. Rothstein, A. J. Sutton, & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 111–125). West Sussex, UK: Wiley.

    Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. West Sussex, UK: Wiley.

    Book  Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1, 97–111.

    Article  Google Scholar 

  • Catalano, R. F., Hawkins, J. D., Berglund, M. L., Pollard, J. A., & Arthur, M. W. (2002). Prevention science and positive youth development: Competitive or cooperative frameworks? Journal of Adolescent Health, 31(Suppl 6), 230–239.

    Article  PubMed  Google Scholar 

  • Chalmers, T. C. (2001). Using systematic reviews and registers of ongoing trials for scientific and ethical trial design, monitoring, and reporting. In M. Egger, D. Smith, & D. G. Altman (Eds.), Systematic reviews in health care: Meta-analysis in context (2nd ed., pp. 429–443). London, UK: BMJ Books.

    Chapter  Google Scholar 

  • Chalmers, T. C., Smith, H., Jr., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., et al. (1981). A method for assessing the quality of a randomized control trial. Controlled Clinical Trials, 2, 31–49.

    Article  CAS  PubMed  Google Scholar 

  • Cooper, H. (1984). The integrative research review: A systematic review. Newbury Park, CA: Sage.

    Google Scholar 

  • Cooper, H. (2010). Research synthesis and meta-analysis (Applied social research methods series 4th ed., Vol. 2). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Cooper, H., DeNeve, K., & Charlton, K. (1997). Finding the missing science: The fate of studies submitted for review by a human subjects committee. Psychological Methods, 2, 447–452.

    Article  Google Scholar 

  • Cooper, H., Hedges, L. V., & Valentine, J. C. (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage.

    Google Scholar 

  • Dickersin, K. (1997). How important is publication bias? A synthesis of available data. AIDS Education and Prevention, 9, 15–21.

    CAS  PubMed  Google Scholar 

  • Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Egger, M., Zellweger-Zahner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997). Language bias in randomized controlled trials published in English and German. Lancet, 350, 326–329.

    Article  CAS  PubMed  Google Scholar 

  • Ekeland, E., Heian, F., Hagen, K. B., Abbott, J., & Nordheim, L. (2005). Exercise to improve self-esteem in children and young people. Campbell Systematic Reviews, 4.

    Google Scholar 

  • Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3–8.

    Article  Google Scholar 

  • Gleser, L. J., & Olkin, I. (2008). Stochastically dependent effect sizes. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 357–376). New York: Russell Sage.

    Google Scholar 

  • Gotzsche, P. C. (1987). Reference bias in reports of drug trials. British Medical Journal, 195, 654–656.

    Article  Google Scholar 

  • Harbord, R. M., Egger, M., & Sterne, J. A. (2006). A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine, 25, 3443–3457.

    Article  PubMed  Google Scholar 

  • Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65.

    Article  Google Scholar 

  • Higgins, J. P. T., & Altman, D. G. (2008). Assessing risk of bias in included studies. In J. P. T. Higgins & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions (chapter 8 (pp. 187–241). Chichester, UK: Wiley.

    Chapter  Google Scholar 

  • Higgins J. P. T., & Green, S. (Eds.). (2011). Cochrane handbook for systematic reviews of interventions (Version 5.1.0, updated March 2011). The Cochrane Collaboration. Retrieved from http://www.cochrane-handbook.org

  • Hopewell, S., & Clarke, M. (2001). Methodologists and their methods: Do methodologists write up their conference presentations or is it just 15 minutes of fame? International Journal of Technology Assessment in Health Care, 17(4), 601–603.

    CAS  PubMed  Google Scholar 

  • Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.

    Google Scholar 

  • Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage.

    Google Scholar 

  • Kellam, S. G., Koretz, D., & Mościcki, E. K. (1999). Core elements of developmental epidemiologically based prevention research. American Journal of Community Psychology, 24, 463–482.

    Article  Google Scholar 

  • Kraemer, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1997). Coming to terms with the terms of risk. Archives of General Psychiatry, 54, 337–343.

    Article  CAS  PubMed  Google Scholar 

  • Lindberg, S. M., Hyde, J. S., Linn, M. C., & Petersen, J. L. (2010). New trends in gender and mathematics performance: A meta-analysis. Psychological Bulletin, 136, 1123–1135.

    Article  PubMed Central  PubMed  Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181–1209.

    Article  CAS  PubMed  Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Littell, J. A., Corcoran, J., & Pillai, V. (2008). Systematic reviews and meta-analysis. New York: Oxford University Press.

    Book  Google Scholar 

  • Matt, G. E., & Cook, T. D. (2009). Threats to the validity of research syntheses. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis (2nd ed., pp. 537–560). New York: Russell Sage Foundation.

    Google Scholar 

  • Mrazek, P. J., & Haggerty, R. J. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.

    Google Scholar 

  • Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2006). Comparison of two methods to detect publication bias in meta-analysis. Journal of the American Medical Association, 295, 676–680.

    Article  CAS  PubMed  Google Scholar 

  • Petrosino, A., Petrosino, C. T., & Buehler, J. (2004). “Scared Straight” and other juvenile awareness programs for preventing juvenile delinquency. Campbell Systematic Reviews, 2.

    Google Scholar 

  • Pittler, M. H., Abbot, N. C., Harkness, E. F., & Ernst, E. (2000). Location bias in controlled clinical trials: A survey of three medical journals. Journal of Clinical Epidemiology, 2000(53), 485–489.

    Article  Google Scholar 

  • Rennie, D. (1997). Thyroid storm. Journal of the American Medical Association, 277, 1238–1243.

    Article  CAS  PubMed  Google Scholar 

  • Reyes, M. M., Panza, K. E., Martin, A., & Bloch, M. H. (2011). Time-lag bias in trials of pediatric antidepressants: A systematic review and meta-analysis. Journal of the American Academy of Child and Adolescent Psychiatry, 50(1), 63–72.

    Article  PubMed Central  PubMed  Google Scholar 

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  • Rothstein, H. R., & Hopewell, S. (2008). Grey literature. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 103–125). New York: Russell Sage.

    Google Scholar 

  • Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005). Publication bias analysis: Prevention, assessment, and adjustments. West Sussex, UK: Wiley.

    Book  Google Scholar 

  • Rucker, G., Schwarzer, G., & Carpenter, J. (2008). Arcsine test for publication bias in meta-analyses with binary outcomes. Statistics in Medicine, 27, 746–763.

    Article  PubMed  Google Scholar 

  • Schmidt, F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173–1181.

    Article  Google Scholar 

  • Simes, R. J. (1986). Publication bias: The case for an international registry of clinical trials. Journal of Clinical Oncology, 4, 1529–1541.

    CAS  PubMed  Google Scholar 

  • Sterne, J. A. C. (Ed.). (2009). Meta-analysis in Stata: An updated collection from the Stata Journal. College Station, TX: Stata Press.

    Google Scholar 

  • Sterne, J. A. C., Egger, M., & Moher, D. (2008). Addressing reporting biases. In J. P. T. Higgins & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions (chapter 10). Chichester, UK: Wiley.

    Google Scholar 

  • Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology, 53, 1119–1129.

    Article  CAS  PubMed  Google Scholar 

  • Tanner-Smith, E. E., Wilson, S. J., & Lipsey, M. W. (2011). Risk factors and crime. In F. Cullen & P. Wilcox (Eds.), The Oxford handbook of criminological theory. New York: Oxford University Press.

    Google Scholar 

  • Tannock, I. F. (1996). False-positive results in clinical trials: Multiple significance tests and the problems of unreported comparisons. Journal of the National Cancer Institute, 88, 206–207.

    Article  CAS  PubMed  Google Scholar 

  • Valentine, J. C. (2009). Judging the quality of primary research. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 129–146). New York: Russell Sage.

    Google Scholar 

  • Wilson, D. B. (2009). Systematic coding. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 159–176). New York: Russell Sage.

    Google Scholar 

  • Wilson, S. J., & Lipsey, M. W. (2006). The effects of school-based social information processing interventions on aggressive behavior, part I: Universal programs. Campbell Systematic Reviews, 5.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sandra Jo Wilson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Wilson, S.J., Tanner-Smith, E.E. (2014). Meta-analysis in Prevention Science. In: Sloboda, Z., Petras, H. (eds) Defining Prevention Science. Advances in Prevention Science. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7424-2_19

Download citation

  • DOI: https://doi.org/10.1007/978-1-4899-7424-2_19

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4899-7423-5

  • Online ISBN: 978-1-4899-7424-2

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics