Abstract
Interventions to promote adolescent health have been widely implemented with a variety of goals, settings, populations, and approaches. Research evidence regarding effectiveness has been accumulating for some intervention approaches, yet the validity and integrity of this evidence and the way in which it is used require careful scrutiny. This chapter examines the scientific foundations for intervention effectiveness research and its use. The fundamental strategy of identifying and addressing plausible alternative explanations for research findings is emphasized, together with the importance of qualitative reasoning and well-justified argument. The essential roles of theory and demonstrated mechanisms of change, converging evidence, and research critique are discussed. Common threats to validity are reviewed, as are threats to research integrity potentially fueled by largely unintentional conflicts of interest and motivated reasoning. A case example critiquing research syntheses on the effectiveness of interventions to reduce adolescent sexual risk behaviors is used to illustrate frequently encountered issues and challenges.
Keywords
- Narrative Review
- Research Integrity
- Research Synthesis
- Motivate Reasoning
- Plausible Alternative Explanation
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
A separate question related to the meaning of effectiveness is how it differs from the concept of efficacy. Efficacy is used to refer to an intervention’s success under ideal and highly controlled conditions, whereas effectiveness refers to an intervention’s success under more typical real world conditions. Especially in medical research, efficacy studies are often conducted prior to effectiveness studies. While the focus of this chapter is on intervention effectiveness research, much of the discussion applies to efficacy studies as well.
References
Abel, U., & Koch, A. (1999). The role of randomization in clinical studies: Myths and beliefs. Journal of Clinical Epidemiology, 52, 487–497. doi:10.1016/S0895-4356(99)00041-4.
Abelson, R. (1995). Statistics as principled argument. Hillsdale, NJ: Erlbaum.
Abi-Jaoude, E., & Gorman, D. A. (2010). Disclosure: Only a first step. Canadian Medical Association Journal, 182, 1546. doi:10.1503/cmaj.110-2109.
Advocates for Youth. (2008). Science and success: Sex education and other programs that work to prevent teen pregnancy, HIV & sexually transmitted infections (2nd ed.). Retrieved June 6, 2011, from http://www.advocatesforyouth.org/storage/advfy/documents/sciencesuccess.pdf.
Altman, D. G. (2002). Poor quality medical research: What can journals do? Journal of the American Medical Association, 287, 2765–2767. doi:10.1001/jama.287.21.2765.
Anderson, N. H. (1963). Comparison of different populations: Resistance to extinction and transfer. Psychological Review, 70, 162–179. doi:10.1037/h0044858.
Bachrach, C., & Newcomer, S. F. (2002). Addressing bias in intervention research: Summary of a workshop. Journal of Adolescent Health, 31, 311–321. doi:10.1016/S1054-139X(02)00395-6.
Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology. Behavior Research Methods, 43, 666–678. doi:10.3758/s13428-011-0089-5.
Bearman, P. S., & Bruckner, H. (2001). Promising the future: Virginity pledges and first intercourse. American Journal of Sociology, 106, 859–912. doi:10.1086/320295.
Berle, D., & Starcevic, V. (2007). Inconsistencies between reported test statistics and p-values in two psychiatry journals. International Journal of Methods in Psychiatric Research, 16, 202–207. doi:10.1002/mpr.225.
Berliner, D. (2002). Comment: Educational research: The hardest science of all. Educational Researcher, 31(8), 18–20. doi:10.3102/0013189X031008018.
Brady, H. E., & Collier, D. (Eds.). (2010). Rethinking social inquiry: Diverse tools, shared standards (2nd ed.). Lanham, MD: Rowman and Littlefield.
Briggs, D. C. (2005). Meta-analysis: A case study. Evaluation Review, 29, 87–127. doi:10.1177/0193841X04272555.
Cain, D. M., & Detsky, A. S. (2008). Everyone’s a little bit biased (even physicians). Journal of the American Medical Association, 299, 2893–2895. doi:10.1001/jama.299.24.2893.
Campbell, D. T. (1953). Designs for social science experiments. Evanston, IL: Northwestern University.
Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297–312. doi:10.1037/h0040950.
Campbell, D. T. (1982). Experiments as arguments. In E. R. House, S. Mathison, J. A. Pearsol, & H. Preskill (Eds.), Evaluation studies review annual (Vol. 7, pp. 117–127). Beverly Hills, CA: Sage.
Campbell, D. T. (2009). Forward. In R. K. Yin (Ed.), Case study research: Design and methods (4th ed., pp. vii–viii). Thousand Oaks, CA: Sage.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton-Mifflin.
Carter, H. (2004). Presidential perspective. In M. T. Braverman, N. A. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy. San Francisco: Jossey-Bass.
Centers for Disease Control and Prevention. (2008). 10 steps to promoting science-based approaches to teen pregnancy prevention using Getting To Outcomes: A summary. Retrieved from http://www.cdc.gov/reproductivehealth/adolescentreprohealth/PDF/LittlePSBA-GTO.pdf.
Chan, A. W., Hrobjartsson, A., Haahr, M. T., Gotzsche, P. C., & Altman, D. G. (2004). Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457–2465. doi:10.1001/jama.291.20.2457.
Chen, S., & Chaiken, S. (1999). The heuristic-systematic model in its broader context. In S. Chaiken & Y. Trope (Eds.), Dual-process theories in social psychology (pp. 73–96). New York: Guilford.
Chinn, C. A., & Brewer, W. F. (2001). Models of data: A theory of how people evaluate data. Cognition and Instruction, 19, 323–393. Retrieved from http://www.jstor.org/stable/3233918.
Chugh, D., Banaji, M., & Bazerman, M. (2005). Bounded ethicality as a psychological barrier to recognizing conflicts of interest. In D. Moore, D. Cain, G. Loewenstein, & M. Bazerman (Eds.), Conflicts of interest: Challenges and solutions in business, law, medicine, and public policy. New York: Cambridge University Press.
Coalition for Evidence-Based Policy. (2010). HHS’s evidence-based teen pregnancy prevention program. Retrieved June 6, 2011, from http://coalition4evidence.org/wordpress/wp-content/uploads/Coalition-comments-HHS-Teen-Pregnancy-Prevention-May-2010.pdf.
Collins, J., Robin, L., Wooley, S., Fenley, D., Hunt, P., Taylor, J., et al. (2002). Programs-that-work: CDC’s guide to effective programs that reduce health-risk behavior of youth. Journal of School Health, 72, 93–99. doi:10.1111/j.1746-1561.2002.tb06523.x.
Constantine, N. A. (2008a). Converging evidence leaves policy behind: Effectiveness of and support for school-based sex education programs [Editorial]. Journal of Adolescent Health, 42, 324–326. doi:10.1016/j.jadohealth.2008.01.004.
Constantine, N. A. (2008b). The peer review process. In S. Boslaugh (Ed.), Encyclopedia of epidemiology (Vol. 1, pp. 794–796). Thousand Oaks, CA: Sage.
Constantine, N. A. (2008c). Publication bias. In S. Boslaugh (Ed.), Encyclopedia of epidemiology (Vol. 1, pp. 853–854). Thousand Oaks, CA: Sage.
Constantine, N. A. (2012). Regression analysis and causal inference: Cause for concern? Perspectives on Sexual and Reproductive Health, 44, 134–137. doi:10.1363/4413412.
Constantine, N. A., & Braverman, M. T. (2004). Appraising evidence on program effectiveness. In M. T. Braverman, N. A. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy (pp. 236–258). San Francisco: Jossey-Bass.
Cook, T. D. (2002). Randomized experiments in educational policy research: A critical examination of the reasons the educational evaluation community has offered for not doing them. Educational Evaluation and Policy Analysis, 24, 175–199. doi:10.3102/01623737024003175.
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand-McNally.
Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.
Dane, A. U., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi:10.1016/S0272-7358(97)00043-3.
Davey Smith, G., & Ebrahim, S. (2001). Epidemiology—is it time to call it a day? International Journal of Epidemiology, 30, 1–11. doi:10.1093/ije/30.1.1.
Dawson, E., Gilovich, T., & Regan, D. T. (2002). Motivated reasoning and performance on the Wason Selection Task. Personality and Social Psychology Bulletin, 28, 1379–1387. doi:10.1177/014616702236869.
DiCenso, A., Guyatt, G., Willan, A., & Griffith, L. (2002). Interventions to reduce unintended pregnancies among adolescents: Systematic review of randomized controlled trials. British Medical Journal, 324, 1426–1434. doi:10.1136/bmj.324.7351.1426.
Dishion, T. J., & Patterson, G. R. (1999). Model building in developmental psychopathology: A pragmatic approach to understanding and intervention. Journal of Clinical Child Psychology, 28, 502–512. doi:10.1207/S15374424JCCP2804_10.
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., et al. (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. Public Library of Science (PLoS) ONE, 3, e3081. doi:10.1371/journal.pone.0003081.
Egger, M., & Davey Smith, G. (1997). Meta-analysis: Potentials and promise. British Medical Journal, 315, 1371–1374.
Evans, J. (1989). Bias in human reasoning: Causes and consequences. London: Erlbaum.
Feinstein, A. R. (1988). Fraud, distortion, delusion, and consensus: The problems of human and natural deception in epidemiologic science. American Journal of Medicine, 84(3, Pt. 1), 475–478. doi:10.1016/0002-9343(88)90268-9.
Feuer, M. J., Towne, L., & Shavelson, R. J. (2002). Scientific culture and educational research. Educational Researcher, 31(8), 4–14. doi:10.3102/0013189X031008004.
Freedman, D. A. (2008). On types of scientific inquiry: The role of qualitative reasoning. In J. M. Box-Steffensmeier, H. E. Brady, & D. Collier (Eds.), The Oxford handbook of political methodology (pp. 300–318). New York: Oxford University Press.
Freedman, D. A. (2010). Statistical models and causal inference: A dialogue with the social sciences. Cambridge, UK: Cambridge University Press.
Friedlander, F. (1964). Type I and Type II bias. American Psychologist, 19, 198–199. doi:10.1037/h0038977.
Gandhi, A. G., Murphy-Graham, E., Petrosino, A., Chrismer, S. S., & Weiss, C. H. (2007). The devil is in the details: Examining the evidence for “proven” school-based drug abuse prevention programs. Evaluation Review, 31, 43–74. doi:10.1177/0193841X06287188.
Garcia-Berthou, E., & Alcaraz, C. (2004). Incongruence between test statistics and P values in medical papers. BMC Medical Research Methodology, 4, 13. doi:10.1186/1471-2288-4-13.
Gigerenzer, G. (1998). Surrogates for theories. Theories & Psychology, 8, 195–204. doi:10.1177/0959354398082006.
Gigerenzer, G. (2009). Surrogates for theory. Association for Psychological Science Observer, 22, 21–23.
Gigerenzer, G., & Selten, R. (Eds.). (2002). Bounded rationality: The adaptive toolbox. Cambridge, MA: The MIT Press.
Goldfarb, E. S., & Constantine, N. A. (2011). Sexuality education. In B. B. Brown & M. Prinstein (Eds.), Encyclopedia of adolescence. New York: Academic.
Gorman, D. M. (2002). Defining and operationalizing ‘research-based’ prevention: A critique (with case studies) of the US Department of Education’s Safe, Disciplined and Drug-Free Schools exemplary programs. Evaluation and Program Planning, 25, 295–302.
Gorman, D. M., & Conde, E. (2007). Conflict of interest in the evaluation and dissemination of “model” school-based drug and violence prevention programs. Evaluation and Program Planning, 30, 422–429. doi:10.1016/j.evalprogplan.2007.06.004.
Grossman, D. C., Neckerman, H. J., Koespell, T. D., Liu, P. Y., Asher, K. N., Beland, K., et al. (1997). Effectiveness of a violence prevention curriculum among children in elementary school: A randomized controlled trial. Journal of the American Medical Association, 277, 1605–1611. doi:10.1001/jama.1997.03540440039030.
Haack, S. (2003). Defending science—within reason: Between scientism and cynicism. New York: Prometheus.
Hahn, S., Williamson, P. R., & Hutton, J. L. (2002). Investigation of within-study selective reporting in clinical research: Follow-up of applications submitted to a local research ethics committee. Journal of Evaluation in Clinical Practice, 8, 353–359. doi:10.1046/j.1365-2753.2002.00314.x.
Hahn, S., Williamson, P. R., Hutton, J. L., Garner, P., & Flynn, V. (2000). Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Statistics in Medicine, 19, 3325–3336. doi:10.1002/1097-0258(20001230)19:24<3325::AID-SIM827>3.0.CO;2-D.
Hinshaw, S. P. (2002). Intervention research, theoretical mechanisms, and causal processes related to externalizing behavior patterns. Development and Psychopathology, 14, 789–818. doi:10.1017/S0954579402004078.
Hirsch, E. D. (2002). Classroom research and cargo cults. Policy Review, 115, 51–69.
Horton, R. (1998). The grammar of interpretive medicine. Canadian Medical Association Journal, 159, 245–249.
Howel, D., & Bhopal, R. (1994). Assessing cause and effect from trials: A cautionary note. Controlled Clinical Trials, 15, 331–334. doi:10.1016/0197-2456(94)90030-2.
Hughes, J. N. (2000). The essential role of theory in the science of treating children: Beyond empirically supported treatments. Journal of School Psychology, 38, 301–330. doi:10.1016/S0022-4405(00)00042-X.
Huston, P., & Moher, D. (1996). Redundancy, disaggregation, and the integrity of medical research. The Lancet, 347, 1024–1026. doi:10.1016/S0140-6736(96)90153-1.
Ioannidis, J. P. A. (2005). Why most published research findings are false. Library of Science (PLoS) Medicine, 2, 696–701. doi:10.1371/journal.pmed.0020124.
Ioannidis, J. P. A. (2007). Limitations are not properly acknowledged in the scientific literature. Journal of Clinical Epidemiology, 60, 324–329. doi:10.1016/j.jclinepi.2006.09.011.
Ioannidis, J. P. A. (2011). An epidemic of false claims: Competition and conflicts of interest distort too many medical findings. Scientific American, 304, 16. Retrieved from http://www.scientificamerican.com/article.cfm?id=an-epidemic-of-false-claims.
Ioannidis, J. P. A., & Karassa, F. B. (2010). The need to consider the wider agenda in systematic reviews and meta-analyses: Breadth, timing, and depth of the evidence. British Medical Journal, 341, c4875. doi:10.1136/bmj.c4875.
Ioannidis, J. P. A., Tatsioni, A., & Karassa, F. B. (2010). Who is afraid of reviewers’ comments? Or, why anything can be published and anything can be cited. European Journal of Clinical Investigation, 40, 285–287. doi:10.1111/j.1365-2362.2010.02272.x.
Jacobs, J. J., & Klaczynski, P. A. (2005). The development of judgment and decision making in children and adolescents. Mahwah, NJ: LEA.
Johnson, B. T., Scott-Sheldon, L. A. J., Huedo-Medina, T. B., & Carey, M. P. (2011). Interventions to reduce sexual risk for human immunodeficiency virus in adolescents: A meta-analysis of trials, 1985–2008. Archives of Pediatrics & Adolescent Medicine, 165, 77–84. doi:10.1001/archpediatrics.2010.251.
Kassirer, J. P., & Angell, M. (1995). Redundant publication: A reminder [Editorial]. New England Journal of Medicine, 333, 449–450. Retrieved from http://www.nejm.org/doi/pdf/10.1056/NEJM199508173330709.
Kazdin, A. E. (1997). A model for developing effective treatments: Progression and interplay of theory, research, and practice. Journal of Clinical Child Psychology, 26, 114–129.
Kerr, N. L. (1998). HARKing (hypothesizing after the results are known). Personality and Social Psychology Review, 2, 196–217. doi:10.1207/s15327957pspr0203_4.
Kirby, D. (2007). Emerging answers 2007: Research findings on programs to reduce teen pregnancy and sexually transmitted diseases. Washington, DC: National Campaign to Prevent Teen and Unplanned Pregnancy.
Kohler, P. K., Manhart, L. E., & Lafferty, W. E. (2008). Abstinence-only and comprehensive sex education and the initiation of sexual activity and teen pregnancy. Journal of Adolescent Health, 42, 344–351. doi:10.1016/j.jadohealth.2007.08.026.
Koslowski, B. (1996). Theory and evidence: The development of scientific reasoning. Cambridge, MA: MIT Press/Bradford Books.
Koslowski, B., & Thompson, S. (2002). Theorizing is important, and collateral information constrains how well it is done. In P. Carruthers, S. Stich, & M. Siegal (Eds.), The cognitive basis of science (pp. 171–192). Cambridge, UK: Cambridge University Press.
Kotchick, B. A., Shaffer, A., & Forehand, R. (2001). Adolescent sexual risk behavior: A multi-system perspective. Clinical Psychology Review, 21, 493–519. doi:10.1016/S0272-7358(99)00070-7.
Kraemer, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1997). Coming to terms with the terms of risk. Archives of General Psychiatry, 54, 337–343.
Kraemer, H. C., Lowe, K. K., & Kupfer, D. J. (2005). To your health: How to understand what research tells us about risk. Oxford, UK: Oxford University Press.
Krisberg, K. (2010). Teen pregnancy prevention focusing on evidence: Ineffective abstinence-only lessons being replaced with science. The Nation’s Health, 40, 1–14. Retrieved from http://thenationshealth.aphapublications.org/content/40/3/1.1.full.
Kumar, M. N. (2008). A review of the types of scientific misconduct in biomedical research. Journal of Academic Ethics, 6, 211–228. doi:10.1007/s10805-008-9068-6.
Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480–498. doi:10.1037/0033-2909.108.3.480.
Larzelere, R. E., Kuhn, B. R., & Johnson, B. (2004). The intervention selection bias: An underrecognized confound in intervention research. Psychological Bulletin, 130, 289–303. doi:10.1037/0033-2909.130.2.289.
Levy, D. A. (2010). Tools of critical thinking: Metathoughts for psychology (2nd ed.). Long Grove, IL: Waveland.
Light, R. J., Singer, J. D., & Willett, J. B. (1990). By design: Planning research on higher education. Cambridge, MA: Harvard University Press.
Lipsey, M. W. (2004). The 2004 Claremont debate: Lipsey vs. Scriven. Determining causality in program evaluation & applied research: Should experimental evidence be the gold standard? Retrieved October 31, 2010, from http://www.cgu.edu/include/SBOS_2004_Debate.pdf.
Lochman, J. E. (2000). Theory and empiricism in intervention research: A dialectic to be avoided. Journal of School Psychology, 38, 359–338. doi:10.1016/S0022-4405(00)00038-8.
Lochman, J. E. (2006). Translation of research into interventions. International Journal of Behavioral Development, 30, 31–38. doi:10.1177/0165025406059971.
Lord, F. M. (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 68, 304–305.
MacCoun, R. (1998). Biases in the interpretation and use of research results. Annual Review of Psychology, 49, 259–287. doi:10.1146/annurev.psych.49.1.259.
MacCoun, R. (2005). Conflicts of interest in public policy research. In D. A. Moore, D. M. Cain, G. Lowenstein, & M. H. Bazerman (Eds.), Conflicts of interest: Challenges and solutions in business, law, medicine, and public policy (pp. 233–262). Cambridge, UK: Cambridge University Press.
Machi, L. A., & McEvoy, B. T. (2009). The literature review. Thousand Oaks, CA: Corwin.
Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer-review system. Cognitive Therapy and Research, 1, 161–175. doi:10.1007/BF01173636.
Matt, G. E., & Cook, T. D. (2009). Threats to the validity of generalized inferences. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 537–556). New York: Russell Sage Foundation.
Maxwell, J. A. (2004). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33(2), 3–11. doi:10.3102/0013189X033002003.
Maxwell, J. A. (2005). Qualitative research design: An interactive approach (2nd ed.). Thousand Oaks, CA: Sage.
McCartney, K., & Rosenthal, R. (2000). Effect size, practical importance, and social policy for children. Child Development, 71, 173–180. doi:10.1111/1467-8624.00131.
Meinert, C. L. (1986). Clinical trials: Design, conduct, and analysis. Oxford, UK: Oxford University Press.
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.
Mills, J. L. (1993). Data torturing. New England Journal of Medicine, 329, 1196–1199.
Moore, D. A., Loewenstein, G., Tanlu, L., & Bazerman, M. H. (2003). Auditor independence, conflict of interest, and the unconscious intrusion of bias. Harvard Business School Working Paper #03-116. Retrieved October 7, 2011, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.2829&rep=rep1&type=pdf.
Moshman, D. (2011). Adolescent rationality and development: Cognition, morality, and identity. New York, NY: Psychology.
Moskowitz, J. M. (1993). Why reports of outcome evaluations are often biased or uninterpretable: Examples from evaluations of drug abuse prevention programs. Evaluation and Program Planning, 16, 1–9. doi:10.1016/0149-7189(93)90032-4.
National Research Council Committee on Assessing Integrity in Research Environments. (2002). Integrity in scientific research: Creating an environment that promotes responsible conduct. Washington, DC: National Academies Press.
National Research Council Committee on Scientific Principles for Educational Research. (2002). Scientific research in education. Washington, DC: National Academies Press.
Oringanje, C., Meremikwu, M. M., Eko, H., Esu, E., Meremikwu, A., & Ehiri, J. E. (2010). Interventions for preventing unintended pregnancies among adolescents. Cochrane Database of Systematic Reviews, 4. doi:10.1002/14651858.CD005215.pub2.
Petrosino, A. (2003). Standards for evidence and evidence for standards: The case of school-based drug prevention. Annals of the American Academy of Political and Social Science, 587, 180–207. doi:10.1177/0002716203251218.
Rennie, D. (1998). Freedom and responsibility in medical publication: Setting the balance right. Journal of the American Medical Association, 280, 300–302. doi:10.1001/jama.280.3.300.
Rennie, D. (1999). Fair conduct and fair reporting of clinical trials. Journal of the American Medical Association, 282, 1766–1768. doi:10.1001/jama.282.18.1766.
Reyna, V. F., & Rivers, S. E. (2008). Current theories of risk and rational decision making. Developmental Review, 28, 1–11. doi:10.1016/j.dr.2008.01.002.
Rosenthal, R. (1994). Science and ethics in conducting, analyzing, and reporting psychological research. Psychological Science, 5, 127–134. doi:10.1111/j.1467-9280.1994.tb00646.x.
Rothwell, P. M. (2005). External validity of randomised controlled trials: “To whom do the results of this trial apply?”. The Lancet, 365, 82–93. doi:10.1016/S0140-6736(04)17670-8.
Scher, S., Lin, J., & Constantine, N. A. (2009). Motivated translation of ambiguous scientific research findings: A case study from the sex education debates. Paper presented at the International Conference on Science in Society. United Kingdom: University of Cambridge.
Scher, L. S., Maynard, R. A., & Stagner, M. (2006). Interventions intended to reduce pregnancy- related outcomes among adolescents. Campbell Collaboration Systematic Reviews, 12. Campbell Collaboration. doi: 10.4073/csr.2006.12.
Schmidt, F. (2010). Detecting and correcting the lies that data tell. Perspectives on Psychological Science, 5, 233–242. doi:10.1177/1745691610369339.
Schneider, S. L., & Shanteau, J. (2003). Emerging perspectives on judgment and decision making. Cambridge, UK: Cambridge University Press.
Scientifically Based Evaluation Methods, 68 Fed. Reg. 62,445 (October 29, 2003).
Scriven, M. (2008). A summative evaluation of RCT methodology and an alternative approach to causal research. Journal of Multidisciplinary Evaluation, 5, 11–24.
Shadish, W. R., Jr., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
Shafer, G., & Tversky, A. (1985). Languages and designs for probability judgment. Cognitive Science, 9, 309–339. doi:10.1207/s15516709cog0903_2.
Shatz, D. (2001). Peer review: A critical inquiry. New York: Rowman and Littlefield.
Shavelson, R., & Towne, L. (2004). What drives scientific research in education? Questions, not methods, should drive the enterprise. American Psychological Society Observer, 17(4), 27–30. Retrieved from http://www.psychologicalscience.org/observer/getArticle.cfm?id=1557.
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. doi:10.1177/0956797611417632.
Slavin, R. E. (1995). Best evidence synthesis: An intelligent alternative to meta-analysis. Journal of Clinical Epidemiology, 48, 9–18. doi:10.1016/0895-4356(94)00097-A.
Smith, R., Feachem, R., Feachem, N. S., Koehlmoos, T. P., & Kinlaw, H. (2009). The fallacy of impartiality: Competing interest bias in academic publications. Journal of the Royal Society of Medicine, 102(2), 44–45. doi:10.1258/jrsm.2009.080400.
Suellentrop, K. (2010). Effective and promising teen pregnancy prevention programs for Latino youth. Science Says, 43. Retrieved June 6, 2011, from http://www.thenationalcampaign.org/resources/pdf/SS/SS43_TPPProgramsLatinos.pdf.
Trenholm, C., Devaney, B., Fortson, K., Clark, M., Quay, L., & Wheeler, J. (2008). Impacts of abstinence education on teen sexual activity, risk of pregnancy, and risk of sexually transmitted diseases. Journal of Policy Analysis and Management, 27, 255–276. doi:10.1002/pam.20324.
Trenholm, C., Devaney, B., Fortson, K., Quay, L., Wheeler, J., & Clark, M. (2007). Impacts of four Title V Section 510 abstinence education programs: Final report. Retrieved January 12, 2011, from http://www.mathematica-mpr.com/publications/pdfs/impactabstinence.pdf.
Trochim, M. K., & Donnelly, J. P. (2007). The research methods knowledge base (3rd ed.). Mason, OH: Thomson.
U.S. Department of Health and Human Services, Office of Adolescent Health. (2010). Overview of the teen pregnancy prevention research evidence review. Retrieved May 16, 2011, from http://www.hhs.gov/ash/oah/prevention/research/index.html.
Victora, C. G., Habicht, J., & Bryce, J. (2004). Evidence-based public health: Moving beyond randomized trials. American Journal of Public Health, 94, 400–405.
Weersing, V. R., & Weisz, J. R. (2002). Mechanisms of action in youth psychotherapy. Journal of Child Psychology and Psychiatry, 43, 3–29. doi:10.1111/1469-7610.00002.
Weiss, C. H. (1980). Social science research and decision-making. New York: Columbia University Press.
Weiss, C. H., Murphy-Graham, E., Petrosino, A., & Gandhi, A. G. (2008). The fairy godmother—and her warts: Making the dream of evidence-based policy come true. American Journal of Evaluation, 29, 29–47. doi:10.1177/1098214007313742.
West, S. G. (2009). Alternatives to randomized experiments. Current Directions in Psychological Science, 18, 299–304. doi:10.1111/j.1467-8721.2009.01656.x.
Westen, D., & Bradley, R. (2005). Empirically supported complexity: Rethinking evidence-based practice in psychotherapy. Current Directions in Psychological Science, 14, 266–271. doi:10.1111/j.0963-7214.2005.00378.x.
What Works Clearinghouse. (2008). Procedures and standards handbook (Version 2.0). Retrieved June 6, 2011, from http://ies.ed.gov/ncee/wwc/pdf/wwc_procedures_v2_standards_handbook.pdf.
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011). Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. Public Library of Science (PLoS) ONE, 6, e26828. doi:10.1371/journal.pone.0026828.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006). The poor availability of psychological research data for reanalysis. American Psychologist, 61, 726–728.
Wiers, R. W., Houben, K., Roefs, A., de Jong, P., Hofmann, W., & Stacy, A. W. (2010). Implicit cognition in health psychology: why common sense goes out of the window. In B. Gawronski & B. K. Payne (Eds.), Handbook of implicit social cognition (pp. 463–488). New York: Guilford.
Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604. doi:10.1037/0003-066X.54.8.594.
Williams, P. G., Holmbeck, G. M., & Greenley, R. N. (2002). Adolescent health psychology. Journal of Consulting and Clinical Psychology, 70, 828–842. doi:10.1037/0022-006X.70.3.828.
Wolins, L. (1962). Responsibility for raw data. American Psychologist, 17, 657–658. doi:10.1037/h0038819.
World Health Organization. (1946). Constitution of the World Health Organization. Retrieved July 28, 2011, from http://apps.who.int/gb/bd/PDF/bd47/EN/constitution-en.pdf.
Yin, R. K. (2008). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage.
Young, S. N. (2009). Bias in the research literature and conflict of interest: An issue for publishers, editors, reviewers and authors, and it is not just about the money [Editorial]. Journal of Psychiatry & Neuroscience, 34, 412–417.
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydi, O. (2009). Why current publication practices may distort science. Public Library of Science (PLoS) Medicine, 5, 1418–1422. doi:10.1371/journal.pmed.0050201.
Acknowledgments
The author thanks Eva Goldfarb, Petra Jerman, Wendy Constantine, and Jessica Lin for critical review and suggestions. Preparation of this chapter was facilitated by grants from the Ford Foundation and the William and Flora Hewlett Foundation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this chapter
Cite this chapter
Constantine, N.A. (2013). Intervention Effectiveness Research in Adolescent Health Psychology: Methodological Issues and Strategies. In: O'Donohue, W., Benuto, L., Woodward Tolle, L. (eds) Handbook of Adolescent Health Psychology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6633-8_20
Download citation
DOI: https://doi.org/10.1007/978-1-4614-6633-8_20
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-6632-1
Online ISBN: 978-1-4614-6633-8
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)