Can We Trust Positive Findings of Intervention Research? The Role of Conflict of Interest
- 258 Downloads
In recent years, there has been increased attention to the issue of conflict of interest within prevention research. The aims of this paper are to discuss these developments and to relate them to discussions of conflict of interest in the broader scientific literature. Although there has been concern expressed about the extent to which conflicts of interest can be defined and measured, empirical research suggests that financial conflicts can be easily identified and assessed in meta-analyses focused on their effects on research quality. Research evidence also shows that conflict of interest is associated with use of flexible data analysis practices and the reporting of chance positive findings, both within prevention research and related disciplines such as public health and psychology. However, the overwhelming majority of published studies report positive results, and there are a number of other influences within academia (such as pressure to publish) that account for this and for the use of flexible data analysis practices. Accordingly, introducing measures to improve research quality in general, rather than just focusing on problems specific to research in which there is a clearly identifiable conflict of interest, may prove more effective and less controversial. Most such efforts focus on introducing greater transparency into research design, practice, and reporting. These both curtail employment of flexible data analysis practices and make their use transparent to investigators seeking to assess their effects on research quality. Also, requiring detailed disclosures of conflicts be reported by all investigators (not just senior authors) would improve current disclosure practices.
KeywordsPrevention Conflict of interest Research quality Research transparency
Compliance with Ethical Standards
Conflict of Interest
The author declares that he has no conflict of interest.
The article does not contain any studies with human participants or animals performed by the author.
Non-applicable, as no human subjects.
- Australian New Zealand Clinical Trial Registry. (2015). ANZCTR. Retrieved from http://www.anzctr.org.au
- Berkeley Initiative for Transparency in the Social Sciences. (2015). BITSS Catalyst Program: Pilot 2015–2018. Retrieved from: http://www.bitss.org/wp-content/uploads/2015/12/bitss_catalyst_program_cn.pdf
- Bierman, K. L., Nix, R. L., Maples, J. J., Murphy, S. A., & Conduct Problems Prevention Research Group. (2006). Examining clinical judgment in an adaptive intervention design: The Fast Track Program. Journal of Consulting and Clinical Psychology, 74, 468–481.CrossRefPubMedPubMedCentralGoogle Scholar
- Bierman, K.L., Coie, J., Dodge, K., Greenberg, M., Lochman, J., McMahon, R., Pinderhughes, E., & Conduct Problems Prevention Research Group. (2013). School outcomes of aggressive-disruptive children: Prediction from kindergarten risk factors and impact of the Fast Track Prevention Program. Aggressive Behavior, 39: doi:10.1002/ab.21467Google Scholar
- BioMed Central. (2015). ISRCTN Registry. Retrieved from http://www.isrctn.com
- Campbell, D. T. (1984). Can we be scientific in applied social science? In R. F. Connor, D. G. Altman, & C. Jackson (Eds.), Evaluation Studies: Review Annual (Vol. 9, pp. 26–48). Beverly Hills, CA: Sage.Google Scholar
- Center for Open Science. (n.d.) The $1,000,000 Preregistration Challenge: Eligible Journals. Retrieved from https://cos.io/prereg/
- Committee on Publication Ethics. (2011). Code of Conduct and Best Practices Guidelines for Journal Editors. Retrieved from http://publicationethics.org/files/Code_of_conduct_for_journal_editors_Mar11.pdf.
- Conduct Problems Prevention Research Group. (2010a). Fast Track intervention effects on youth arrests and delinquency. Journal of Experimental Criminology, 6, 131–157.Google Scholar
- Conduct Problems Prevention Research Group. (2010b). The difficulty of maintaining positive intervention effects: A look at disruptive behavior, deviant peer relations, and social skills during the middle school years. Journal of Early Adolescence, 30, 593–624.Google Scholar
- Conduct Problems Prevention Research Group. (2010c). The effects of a multi-year universal social-emotional learning program: The role of student and school characteristics. Journal of Consulting and Clinical Psychology, 78,156-168.Google Scholar
- CONSORT. (2015). Endorsers: Journals and Organizations. Retrieved from: http://www.consort-statement.org/about-consort/endorsers.Google Scholar
- Eisner, M. (2014). The South Carolina Triple P System Population Trial to Prevent Child Maltreatment: Seven reasons to be skeptical about the study results (Violence Research Centre - Working Paper. Institute of Criminology, University of Cambridge).Google Scholar
- Eisner, M., & Humphreys, D. (2011). Measuring conflict of interest in prevention and intervention research: A feasibility study. In T. Bliesener, A. Beelman, & M. Stemmler (Eds.), Antisocial behavior and crime: Contributions of developmental and evaluation research to prevention and intervention (pp. 165–180). Cambridge, MA: Hogrefe.Google Scholar
- Fanelli, D. (2010a). “Positive” results increase down the hierarchy of science. PLoS ONE, 5, e10068. doi: 10.1371/journal.pone.0010068.
- Fanelli, D. (2010b). Do pressures to publish increase scientists’ bias? An empirical support for US States data. PLoS ONE, 5, e10271. doi: 10.1371/journal.pone.0010271.
- Fast Track Project. (2011). Publications. Retrieved from http://www.fasttrackproject.org/publications.php
- Gorman, DM. (2015a). ‘Everything works’: The need to address confirmation bias in evaluations of drug misuse prevention interventions for adolescents. Addiction, 110, 1539–40Google Scholar
- Gorman, DM. (2015b). Analytic flexibility in the evaluation of the Drug Education in Victoria Schools (DEVS) programme. International Journal of Drug Policy, 26, 719–720Google Scholar
- Institute of Medicine. (2002). Integrity in scientific research: Creating an environment that promotes responsible conduct. Washington, DC: National Academies Press.Google Scholar
- International Committee of Medical Journal Editors. (2015). Conflicts of interest. Retrieved from http://www.icmje.org/conflicts-of-interest/http://www.icmje.org/conflicts-of-interest/
- Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani R. (2014a). Increasing value and reducing waste in research design, conduct, and analysis. Lancet, 383, 166–175.Google Scholar
- Ioannidis, J. P. A., Munafo, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014b). Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention. Trends in Cognitive Sciences, 18, 235–241.Google Scholar
- Kelling, G. L., Pate, T., Dieckman, D., & Brown, C. (1974). The Kansas City preventive patrol experiment: Summary report. Washington, DC: Police Foundation.Google Scholar
- Lipsey, M. (1995). What do we learn from 400 research studies on effectiveness of treatment with juvenile delinquents? In J. McGuiren (Ed.), What works? Reducing reoffending (pp. 63–78). New York: Wiley.Google Scholar
- Nix, R. L., Bierman, K. L., McMahon, R. J., & the Conduct Problems Prevention Research Group. (2009). How attendance and quality of participation affect treatment response to parent management training. Journal of Consulting and Clinical Psychology, 77, 429–438.CrossRefPubMedPubMedCentralGoogle Scholar
- Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific Utopia II. Restructuring incentives and practices to promote truth over publishability. Psychological Science, 7, 615–631.Google Scholar
- Okulicz-Kozaryn, K., & Foxcroft, D. R. (2012). Effectiveness of the Strengthening Families Programme 10–14 in Poland for the prevention of alcohol and drug misuse: Protocol for a randomized controlled trial. BMC Public Health, 12, 319. doi: 10.1186/1471-2458-12-319.CrossRefPubMedPubMedCentralGoogle Scholar
- Pasalich, D. S., Witkiewitz, K., McMahon, R. J., Pinderhughes, E. E., & the Conduct Problems Prevention Research Group. (2016). Indirect effects of the Fast Track intervention on conduct disorder symptoms and callous-unemotional traits: Distinct pathways involving discipline and warmth. Journal of Abnormal Child Psychology, 44, 587–597.CrossRefPubMedPubMedCentralGoogle Scholar
- Popper, K. (1974). Replies to my critics. In P. A. Schilpp (Ed.), The Philosophy of Karl Popper (pp. 961–1197). La Salle, Il: Open Court.Google Scholar
- Society for Prevention Research. (2015). Conflict of interest policy. Retrieved from http://www.preventionresearch.org/about-spr/conflict-of-interest-policy/
- Sterman, S. (2000). Business dynamics: Systems thinking and modeling for a complex world. New York: McGraw Hill.Google Scholar
- Sussman, S. (2009). Conflict of interest disclosure statement. Society for Prevention Research 17th Annual Meeting: Program Book, 121. Retrieved from http://www.preventionresearch.org/wp-content/uploads/2011/07/SPR2009program.pdf
- US National Institutes of Health. (2015). ClinicalTrials.gov. Retrieved from https://clinicaltrials.gov.