Advertisement

Prevention Science

, Volume 19, Issue 3, pp 358–365 | Cite as

Innovation and Integrity: Desiderata and Future Directions for Prevention and Intervention Science

  • Andreas Beelmann
  • Tina Malti
  • Gil G. Noam
  • Simon Sommer
Article

Abstract

This article summarizes essential implications of the papers within this special issue and discusses directions for future prevention and intervention research on conceptual issues, methodological and transfer-related challenges and opportunities. We identify a need to move from programs to principles in intervention research and encourage the implementation of research on potential mechanisms underlying intervention effectiveness. In addition, current methodological issues in intervention research are highlighted, including advancements in methodology and statistical procedures, extended outcome assessments, replication studies, and a thorough examination of potential biases. We further discuss transfer-related issues, for example the need for more research on the flexibility and adaptability of programs and intervention approaches as well as more general problems in knowledge translation reasoning the need for enhanced communication between practitioners, policy makers, and researchers. Finally, we briefly touch on the need to discuss the relation between single intervention programs, the mental health system, and changes of contextual conditions at the macro level.

Keywords

Research integrity Child and adolescent mental health Evidence-based intervention Knowledge translation Intervention theory 

Notes

Funding

The second author was funded, in part, by a New Investigator Award from the Canadian Institutes of Health Research.

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed Consent

Informed consent is not applicable.

References

  1. Aos, S., Cook, T. D., Elliott, D. S., Gottfredson, D. C., Hawkins, J. D., Lipsey, M. W., & Tolan, P. (2011). Commentary on Valentine, Jeffrey, et al. Replication in prevention science. Prevention Science, 12, 121–122.  https://doi.org/10.1007//s11121-011-0219-4.CrossRefPubMedGoogle Scholar
  2. APA Publications and Communication Board Working Group on Journal Article Reporting Standards. (2008). Reporting standards for research in psychology. Why do we need them? What might they be? American Psychologist, 63, 839–851.  https://doi.org/10.1037/0003-066X.63.9.839.CrossRefGoogle Scholar
  3. Bakker, M., van Dijk, A., & Wicherts, J. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543–554.  https://doi.org/10.1177/745691612459060.CrossRefPubMedGoogle Scholar
  4. Baumann, A. A., Powell, B. J., Kohl, P. L., Tabak, R. G., Penalba, V., Protor, E. K., Domenech-Rodriguez, M. M., & Cabassa, L. J. (2015). Cultural adaptation and implementation of evidence-based parent-training: A systematic review and critique of guiding evidence. Children and Youth Services Review, 53, 113–120.  https://doi.org/10.1016/j.childyouth.2015.03.025.
  5. Beelmann, A. (2011). The scientific foundation of prevention. The status quo and future challenges of developmental crime prevention. In T. Bliesener, A. Beelmann, & M. Stemmler (Eds.), Antisocial behavior and crime. Contributions of developmental and evaluation research to prevention and intervention (pp. 137–164). Cambridge: Hogrefe Publishing.Google Scholar
  6. Beelmann, A. (2017). The effects of parent training programms in the prevention and treatment of antisocial behavior in childhood and adolescence. An international comprehensive meta-analysis. Paper presented at the What Works Global Summit - Conference, London, UK.Google Scholar
  7. Beelmann, A., Maichrowitz, S., Schulz, S. & Arnold, L. (2015). Wirksamkeit von Programmen zur Prävention und Kompensation von Armuts- und Migrationsfolgen bei Kindern und Jugendlichen. Ein Forschungsüberblick und eine Meta-Analyse internationaler Evaluationsforschung [The effectiveness of programs for buffering negative consequences of poverty and migration in children and adolescents. A review and a meta-analysis of the international evaluation research]. Final report to the Federal Ministry of Education and Research, Berlin, Germany.Google Scholar
  8. Belfer, M. L. (2008). Child and adolescent mental disorders: the magnitude of the problem across the globe. Journal of Child Psychology and Psychiatry, 49 (3), 226–236.  https://doi.org/10.1111/j.1469-7610.2007.01855.x
  9. Biglan, A. (2016). The ultimate goal of prevention and the larger context for translation. Prevention Science.  https://doi.org/10.1007/s11121-016-0635-6.
  10. Bromme, R., & Beelmann, A. (2016). Transfer entails communication: The public understanding of (social) science as a stage and a play for implementing evidence-based prevention knowledge and programs. Prevention Science.  https://doi.org/10.1007/s11121-016-0686-8.
  11. Burkhardt, J. T., Schröter, D. C., Magura, S., Means, S. N., & Coryn, C. L. S. (2015). An overview of evidence-based program registers (EBPRs) for behavioral health. Evaluation and Program Planning, 48, 92–99.  https://doi.org/10.1016/j.evalprogplan.2014.09.006.CrossRefPubMedPubMedCentralGoogle Scholar
  12. Castro, F. G., & Yasui, M. (2017). Advances in EBI development for diverse populations: Towards a science of intervention adaption. Prevention Science, 18, 623–629.  https://doi.org/10.1007/s11121-017-0809-x.CrossRefPubMedGoogle Scholar
  13. Castro, F. G., Barrera Jr., M., & Holleran-Steiker, L. K. (2010). Issues and challenges in the design of culturally adapted evidence-based interventions. Annual Review of Clinical Psychology, 6, 213–239.  https://doi.org/10.1146/annurev-clinpsy-033109-132032.CrossRefPubMedPubMedCentralGoogle Scholar
  14. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schnellinger, K. B. (2011). The impact of enhancing students’social and emotional learning. A meta-analysis of school-based universal interventions. Child Development, 82, 405–432.  https://doi.org/10.1111/j.1467-8624.2010.01564.x.CrossRefPubMedGoogle Scholar
  15. Earp, B. D., & Trafimow, D. (2015). Replication, falsification, and the crisis of confidence in social psychology. Frontiers in Psychology, 6, article 621.  https://doi.org/10.3389/psyg.2015.0062f.
  16. Eisner, M. (2009). No effects in independent prevention trials: Can we reject the cynical view? Journal of Experimental Criminology, 5, 163–183.  https://doi.org/10.1007/s11292-009-9071.CrossRefGoogle Scholar
  17. Eisner, M., & Humphreys, D. (2011). Measuring conflict of interest in prevention and intervention research. A feasibility study. In T. Bliesener, A. Beelmann, & M. Stemmler (Eds.), Antisocial behavior and crime. Contributions of developmental and evaluation research to prevention and intervention (pp. 165–180). Cambridge: Hogrefe.Google Scholar
  18. Embry, D. D., & Biglan, A. (2008). Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Review, 11, 75–113.  https://doi.org/10.1007//s10567-008-0036-x.CrossRefGoogle Scholar
  19. Everett, J. A. C. & Earp, B. D. (2015). A tragedy of the (academic) commons: Interpreting the replication crisis in psychology as a social dilemma for early-career researchers. Frontiers in Psychology, 6, article 1152.  https://doi.org/10.3389/fpsyg.2015.01152.
  20. Farrington, D. P., Gaffnex, H., Lösel, F., & Ttofi, M. M. (2016). Systematic reviews of the effectiveness of developmental prevention programs in reducing delinquency, aggression, and bullying. Aggression and Violent Behavior, 33, 91–106.  https://doi.org/10.1016/j.avb.2016.11.003.CrossRefGoogle Scholar
  21. Ghate, D. (2016). From programs to systems: Deploying implementation science and practice for sustained real world effectiveness in services for children and families. Journal of Clinical Child and Adolescent Psychology, 45, 812–826.  https://doi.org/10.1080/15374416.2015.1077449.CrossRefPubMedGoogle Scholar
  22. Gorman, D. M. (2016). Can we trust positive findings of intervention research? The role of conflict of interest. Prevention Science.  https://doi.org/10.1007/s11121-016-0648-1.
  23. Gottfredsson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16, 893–926.  https://doi.org/10.1007/s11121-015-0555-x.CrossRefGoogle Scholar
  24. Gruner Gandhi, A., Murphy-Graham, E., Petrosino, A., & Weiss, C. H. (2007). The devil is in the detail. Examining the evidence for “proven” school-based drug abuse prevention programs. Evaluation Review, 31, 43–74.  https://doi.org/10.1177/019841X0687188.CrossRefGoogle Scholar
  25. Hallberg, K., Cook, T. D., Steiner, P. M., & Clark, M. H. (2016). Pretest measures of the study outcome and the elimination of selection bias: Evidence from three within study comparisons. Prevention Science.  https://doi.org/10.1007/s11121-016-0732-6.
  26. Henry, D., Tolan, P., Gorman-Smith, D., & Schoeny, M. (2017). Alternatives to randomized control trial designs for community-based prevention evaluation. Prevention Science, 18, 671–680.  https://doi.org/10.1007/s11121-016-0706-8.CrossRefPubMedGoogle Scholar
  27. Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2, 172–177.CrossRefGoogle Scholar
  28. Ioannidis, J. P. A., Munafo, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014). Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention. Trends in Cognitive Science, 18, 235–241.  https://doi.org/10.1016/j.tics.2014.02.010.CrossRefGoogle Scholar
  29. Kepes, S., Banks, G. C., & Oh, I.-S. (2014). Avoiding bias in publication bias research: The value of “null” findings. Journal of Business and Psychology, 29, 183–203.  https://doi.org/10.1007//s10869-012-9279-0.CrossRefGoogle Scholar
  30. Komro, K. A., Flay, B. R., Biglan, A., & Promise Neighborhoods Research Consortium. (2011). Creating nurturing environments: A science-based framework for promoting child health and development within high-poverty neighborhoods. Clinical Child and Family Psychology Review, 14, 111–134.CrossRefPubMedPubMedCentralGoogle Scholar
  31. Lang, K. M., & Little, T. D. (2016). Principled missing data treatments. Prevention Science.  https://doi.org/10.1007/s11121-016-0644-5.
  32. Leviton, L. C., & Hughes, E. F. X. (1981). Research on utilization of evaluations. A review and synthesis. Evaluation Review, 5, 525–548.CrossRefGoogle Scholar
  33. Lilienfeld, S. O. (2012). Public skepticism of psychology. Why many people perceive the study of human behavior as unscientific. American Psychologist, 67, 111–129.  https://doi.org/10.1037/a0023963.CrossRefPubMedGoogle Scholar
  34. Lilienfeld, S. O. (2017). Psychology’s replication crisis and the grant culture: Righting the ship. Perspectives on Psychological Science, 12, 660–664.  https://doi.org/10.1177/1745691616687745.CrossRefPubMedGoogle Scholar
  35. Malti, T., & Noam, G. G. (2016). Social-emotional development: From theory to practice. The European Journal of Developmental Psychology, 13, 652–665.  https://doi.org/10.1080/17405629.2016.1196178.CrossRefGoogle Scholar
  36. Malti, T., Chaparro, M. P., Zuffianò, A., & Colasante, T. (2016a). School-based interventions to promote empathy-related responding in children and adolescents: A developmental analysis. Journal of Clinical Child and Adolescent Psychology, 45, 718–731.  https://doi.org/10.1080/15374416.2015.1121822.CrossRefPubMedGoogle Scholar
  37. Malti, T., Noam, G. G., Beelmann, A., & Sommer, S. (2016b). Toward dynamic adaptation of psychological interventions of child and adolescent development and mental health. Journal of Clinical Child and Adolescent Psychology, 45, 827–836.  https://doi.org/10.1080/15374416.2016.1239539.CrossRefPubMedGoogle Scholar
  38. Malti, T., Zuffianò, A., & Noam, G. G. (2017). Knowing every child: Validation of the Holistic Student Assessment (HSA) as a measure of social-emotional development. Prevention Science.  https://doi.org/10.1007/s11121-017-0794-0.
  39. Means, S. N., Magura, S., Burkhardt, J. T., Schröter, D. C., & Coryn, C. L. S. (2015). Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs. Evaluation and Program Planning, 48, 100–116.  https://doi.org/10.1016/j.evalprogplan.2014.09.007
  40. Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50, 462–480.  https://doi.org/10.1007/s10464-012-9522-x.CrossRefPubMedGoogle Scholar
  41. Molloy, L. E., Moore, J. E., Trail, J., van Epps, J. J., & Hopfer, S. (2013). Understanding real-world implementation quality and “active ingredients” of PBIS. Prevention Science, 14, 593–605.  https://doi.org/10.1007/s11121-012-0343-9.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013). Examining adaptations of evidence-based programs in natural contexts. Journal of Primary Prevention, 34, 147–161.  https://doi.org/10.1007/s10935-013-0303-6.CrossRefPubMedGoogle Scholar
  43. Nosek, B. A., & Lakens, D. (2014). Registered reports. A method to increase the credibility of published results. Social Psychology, 45, 137–141.  https://doi.org/10.1027/1864-9335/a000192.CrossRefGoogle Scholar
  44. O’Connell, M. E., Boat, T., & Warner, K. E. (Eds.). (2009). Preventing mental, emotional, and behavioral disorders among young people. Progress and possibilities. Washington, DC: The National Academies Press.Google Scholar
  45. Ogden, C. L., Carroll, M. D., Curtin, L. R., Lamb, M. M., & Flegal, K. M. (2010). Prevalence of high body mass index in US children and adolescents. Journal of the American Medical Association, 303, 242–249.  https://doi.org/10.1001/jama.2009.2012.CrossRefPubMedGoogle Scholar
  46. Okamoto, S. K., Kulis, S., Marsiglia, F. F., Steiker, L. K. H., & Dustman, P. (2014). A continuum of approaches toward developing culturally focused prevention interventions: From adaption to grounding. Journal of Primary Prevention, 35, 103–112.  https://doi.org/10.1007/s10935-013-0333-z.CrossRefPubMedPubMedCentralGoogle Scholar
  47. Pawson, R., & Tilley, N. (1997). Realistic evaluation. London: Sage.Google Scholar
  48. Prentice, D. A., & Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin, 112, 160–164.  https://doi.org/10.1037/0033-2909.112.1.160.CrossRefGoogle Scholar
  49. Prochaska, J. O., Redding, C. A., & Evers, K. E. (2015). The transtheoretical model and stages of change. In K. Glanz, B. K. Rimer, & K. Viswanath (Eds.), Health behavior: Theory, research, and practice (5th ed., pp. 125–148). San Francisco: Jossey-Bass.Google Scholar
  50. Reiss, F. (2013). Socioeconomic inequalities and mental health problems in children and adolescents: A systematic review. Social Science & Medicine, 90, 24–31.  https://doi.org/10.1016/j.socscimed.2013.04.026.CrossRefGoogle Scholar
  51. Resnicow, K., Soler, R., Braithwaite, R. L., Ahluwalia, J. S., & Butler, J. (2000). Cultural sensitivity in substance use prevention. Journal of Community Psychology, 28, 271–290.CrossRefGoogle Scholar
  52. Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2005). Publication bias in meta-analysis: Prevention, assessment, and adjustment. Chichester: Wiley.Google Scholar
  53. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.  https://doi.org/10.1177/0956797611417632.CrossRefPubMedGoogle Scholar
  54. Spiel, C., Schober, B., & Strohmeier, D. (2016). Implementing intervention research into public policy—The “I3-approach.”. Prevention Science.  https://doi.org/10.1007/s11121-016-0638-3.
  55. Sundell, K., Beelmann, A., Hasson, H., & von Thiele Schwarz, U. (2016). Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. Journal of Clinical Child & Adolescent Psychology, 45, 784–796.  https://doi.org/10.1080/15374416.2015.1020540.CrossRefGoogle Scholar
  56. Tobler, N. S., Roona, M. R., Ochshorn, P., Marshall, D. G., Streke, A. V., & Stackpole, K. M. (2000). School-based adolescent drug prevention programs: 1998 meta-analysis. The Journal of Primary Prevention, 20, 275–336.  https://doi.org/10.1023/A:1021314704811.CrossRefGoogle Scholar
  57. Valentine, J. C., Biglan, A., Boruch, R. F., Castro, F. G., Collins, L. M., Flay, B. R., Kellam, S., Mościcki, E. K., & Schinke, S. P. (2011). Replication in prevention science. Prevention Science, 12, 103–117.  https://doi.org/10.1007//s11121-011-0217-6.CrossRefPubMedGoogle Scholar
  58. Wathen, C. N., & MacMillan, H. L. (2015). The role of integrated knowledge translation in intervention research. Prevention Science.  https://doi.org/10.1007/s11121-015-0564-9.
  59. Wilkenson, R. G., & Pickert, K. E. (2009). Income inequality and social dysfunction. Annual Review of Sociology, 35, 493–511.  https://doi.org/10.1146/annurev-soc-070308-115926.CrossRefGoogle Scholar
  60. Wilson, P., Rush, R., Hussey, S., Puckering, C., Sim, F., Allely, C. S., Allely, C. S., Doku, P., & Gillberg, C. (2012). How evidence-based is an “evidence-based parenting program”? A PRISMA systematic review and meta-analysis of Triple P. BMC Medicine, 10, 130.  https://doi.org/10.1186/1741-7015-10-130.CrossRefPubMedPubMedCentralGoogle Scholar
  61. Wilson, D. S., Hayes, S. C., Biglan, A., & Embry, D. D. (2014). Evolving the future: Toward a science of intentional change. Behavioral and Brain Sciences, 37, 395–460.  https://doi.org/10.1017/S0140525X13001593.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Society for Prevention Research 2018

Authors and Affiliations

  • Andreas Beelmann
    • 1
  • Tina Malti
    • 2
  • Gil G. Noam
    • 3
  • Simon Sommer
    • 4
  1. 1.Institute of Psychology, Department of Research Synthesis, Intervention, EvaluationFriedrich-Schiller-University JenaJenaGermany
  2. 2.Department of Psychology and Department of PsychiatryUniversity of TorontoMississaugaCanada
  3. 3.Harvard Medical SchoolHavard UniversityBostonUSA
  4. 4.Jacobs FoundationZürichSwitzerland

Personalised recommendations