Skip to main content

Advertisement

SpringerLink
Log in

Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

The degree of reporting transparency in randomised controlled trials (RCTs) is an important factor when the validity of any results is being considered. The use of the Consolidated Standards of Reporting Trials (CONSORT) guidelines has improved the reporting standards of RCTs in many healthcare journals, but these guidelines have yet to be adopted universally. In this study, we applied the CONSORT Statement to RCTs identified from a systematic review of mental health provisions for juvenile offenders. We assessed the number of CONSORT items reported in each trial and investigated the extent of endorsement by journal editors. The findings showed that some items were fully endorsed (e.g., the aim of the study) whereas other items, such as sample size estimations, were not presented in any of the trials. A minority of journals supported the use of the CONSORT Statement in their journals’ instructions for authors. The overall reporting standard for this sample of trials was, therefore, mixed. Comparisons with trials conducted in other disciplines are discussed, and suggestions for improving reporting standards are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. PsychINFO, Applied Social Sciences Index and Abstracts, International Bibliography of the Social Sciences, Social Policy and Practice, Social Services Abstracts, Sociological Abstracts, ERIC, Criminal Justice Abstracts, PAIS International, C2 SPECTR, Swets wise, DARE and Cochrane Database of Systematic Reviews.

References

  • Adetugbo, K., & Williams, H. (2000). How well are randomized controlled trials reported in the dermatology literature? Archive of Dermatology, 136, 381–385.

    Article  Google Scholar 

  • Ahrens, J., & Rexford, L. (2002). Cognitive processing therapy for incarcerated adolescents with PTSD. In R. Greenwald (Ed.), Trauma, and juvenile delinquency: Theory, research, and intervention. Haworth Press.

  • Altman, D. G. (2001). The revised CONSORT Statement for reporting randomized trials: Explanation and elaboration. Annals of Internal Medicine, 134, 663–694.

    Google Scholar 

  • Altman, D. G. (2005). Endorsement of the CONSORT statement by high impact medical journal: A survey of instructions for authors. British Medical Journal, 330, 1056–1057.

    Article  Google Scholar 

  • Altman, D. G., & Dore, C. J. (1990). Randomization and baseline comparisons in clinical trials. Lancet, 335, 149–153.

    Article  Google Scholar 

  • Altman, D. G., Cuzick, J., & Peto, J. (1994). More on zidovudine in asymptomatic HIV infection. New England Journal of Medicine, 330, 1758–1759.

    Article  Google Scholar 

  • Armstrong, T. A. (2002). The effect of environment on the behaviour of youthful offenders. A randomized experiment. Journal of Criminal Justice, 30, 19–28.

    Article  Google Scholar 

  • Begg, C., Cho, M., Eastwood, S., Horton, D., Moher, I., Olkin, R., et al. (1996). Improving the quality of reporting of randomized controlled trials: The CONSORT statement. Journal of the American Medical Association, 276, 637–639.

    Article  Google Scholar 

  • Bhandari, M., Guyatt, G., Lochner, H., Sprague, S., & Tornetta, P. (2002). Application of the Consolidated Standards of Reporting Trials (CONSORT) in the fracture care literature. Journal of Bone Joint Surgery in America, 84, 485–489.

    Google Scholar 

  • Black, N. (1996). Why we need observational studies to evaluate the effectiveness of health care. British Medical Journal, 312, 1215–1218.

    Google Scholar 

  • Boutron, I., Moher, D., Tugwell, P., Giraudeau, B., Poiraudeau, S., Nizard, R., et al. (2005). A checklist to evaluate a report of a nonpharmocological trial (CLEAR NPT) was developed using consensus. Journal of Clinical Epidemiology, 58(12), 1233–12240.

    Article  Google Scholar 

  • Boutron, I., Tubach, F., Giraudeau, B., & Ravaud, P. (2004). Blinding was judged more difficult to achieve and maintain in non-pharmacological than pharmacological trials. Journal of Clinical Epidemiology, 57, 543–550.

    Article  Google Scholar 

  • Brooks, G., Miles, J. N. V., Torgerson, C. J., & Torgerson, D. J. (2006). Is an intervention using computer software effective in literacy learning? A randomized controlled trial. Educational Studies, 32(2), 133–143.

    Article  Google Scholar 

  • Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004). CONSORT statement: Extension to cluster randomized trials. British Medical Journal, 328, 702–708.

    Article  Google Scholar 

  • Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.

    Google Scholar 

  • Carney, M. M., & Buttell, F. (2003). Reducing juvenile recidivism: Evaluating the wraparound services model. Research on Social Work Practice, 13(5), 551–568.

    Article  Google Scholar 

  • Cheng, K., Smyth, R. L., Motley, J., O’Hea, U., & Ashby, D. (2000). Randomized controlled trials in cystic fibrosis (1966–1997) categorised by time, design and intervention. Paediatric Pulmonology, 29, 1–7.

    Article  Google Scholar 

  • Conniff, K. M., Scarlett, J. M., Goodman, S., & Appel, L. D. (2005). Effects of a pet visitation program on the behavior and emotional state of adjudicated female adolescents. Anthrozoos, 18(4), 379–395.

    Google Scholar 

  • Dembo, R., & Wothke, W. (2002). The impact of a family empowerment intervention on juvenile offender heavy drinking: A latent growth model analysis. Substance Use and Misuse, 37(11), 1359–1390.

    Article  Google Scholar 

  • Dersimonian, R., Charetter, L. J., McPeek, B., & Mosteller, F. (1982). Reporting on methods in clinical trials. New England Journal of Medicine, 306, 1332–1337.

    Google Scholar 

  • Devereaux, P. J., Manns, B. J., Ghali, W. A., Quan, H., & Guyatt, G. H. (2002). The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the Consolidated Standards of Reporting Trials (CONSORT) checklist. Control Clinical Trials, 23, 380–388.

    Article  Google Scholar 

  • Dirks-Linhorst, P. A. (2004). An evaluation of a family court diversion program for delinquent youth with chronic mental health needs Thesis. Dirks-Linhorst, P. Ann.

  • Egger, M., Jüni, P., Bartlett, C., & for the CONSORT group (2001). The value of flow diagrams in reports of randomised controlled trials: A bibliographic study. Journal of the American Medical Association, 285(15), 1996–1999.

    Article  Google Scholar 

  • Farrington, D. P. (1983). Randomized experiments on crime and justice. In M. Tonry, & N. Morris (Eds.) Crime and justice: An annual review of research, vol. 4 (pp. 257–308). Chicago: University of Chicago Press.

  • Farrington, D. P. (2003). Methodological quality standards for evaluation research. Annals of American Academy of Political and Social Science, 587(1), 49–68.

    Article  Google Scholar 

  • Farrington, D. P., & Welsh, B. C. (2006). Methodological quality and the evaluation of anticrime programs. Journal of Experimental Criminology, 2(3), 329–337.

    Article  Google Scholar 

  • Faunce, T. A., & Buckley, N. A. (2003). Of consents and CONSORTS: Reporting ethics, law, and human rights in RCTs involving monitored overdose of healthy volunteers pre and post the CONSORT guidelines. Journal of Toxicology Clinical Toxicology, 41, 93–99.

    Article  Google Scholar 

  • Freemantle, N. (2001). Interpreting the results of secondary end points and subgroup analyses in clinical trials: Should we lock the crazy aunt in the attic? British Medical Journal, 322(7292), 989–991.

    Article  Google Scholar 

  • Friedman, A. S., Terras, A., & Glassman, K. (2002). Multimodel substance use intervention program for male delinquents. Journal of Child and Adolescent Substance Abuse, 11(4), 43–65.

    Article  Google Scholar 

  • Gagnier, J. J., Boon, H., Rochon, P., Moher, D., Barnes, J., Bombardier, C., for the CONSORT Group (2006a). Reporting randomized, controlled trial of herbal interventions: An elaborated CONSORT statement. Annals of Internal Medicine, 144(5), 364–370.

    Google Scholar 

  • Gagnier, J. J., Boon, H., Rochon, P., Moher, D., Barnes, J., Bombardier, C., for the CONSORT Group (2006b). Recommendations for reporting randomized controlled trials of herbal interventions: Explanation and elaboration. Journal of Clinical Epidemiology, 59, 1134–1149.

    Article  Google Scholar 

  • Gil, A. G., Wagner, E. F., & Tubman, J. G. (2004). Culturally sensitive substance abuse intervention for Hispanic and African American adolescents: Empirical examples from the Alcohol Treatment Targeting Adolescents in Need (ATTAIN) Project. Addiction, 99, 140–150.

    Article  Google Scholar 

  • Halpern, S. H., Darani, R., Douglas, M. J., Wright, W., & Yee, J. (2004). Compliance with the CONSORT checklist in obstetric anaesthesia randomised controlled trials. International Journal of Obstetrics Anaesthesia, 13, 207–214.

    Article  Google Scholar 

  • Harper, G., & Chitty, C. (2005). The impact of corrections on re-offending: A review of what works. Third Edition. Home Office Research Study 291, Home Office Research, Development and Statistics Directorate. Home Office, UK.

  • Henggeler, S. W., Clingempeel, W., Brondino, M. J., & Pickrel, S. G. (2002). Four-year follow-up of multisystemic therapy with substance-abusing and substance-dependent juvenile offenders. Journal of the American Academy of Child & Adolescent Psychiatry, 41(7), 868–874.

    Article  Google Scholar 

  • Henggeler, S. W., Halliday-Boykins, C. A., Cunningham, P. B., Randall, J., Shapiro, S. B., & Chapman, J. E. (2006). Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments. Journal of Consulting and Clinical Psychology, 74(1), 45–54.

    Article  Google Scholar 

  • Hewitt, C., Hahn, S., Torgerson, D. J., Watson, J., & Bland, M. J. (2005). Adequacy and reporting of allocation concealment: Review of recent trials published in four general medical journals. British Medical Journal, 330, 1057–1058.

    Article  Google Scholar 

  • Hill, C. L., LaValley, M. P., & Felson, D. T. (2002). Secular changes in the quality of published randomized clinical trials in rheumatology. Arthritis Rheumatology, 46, 779–784.

    Article  Google Scholar 

  • Lachin, J. M. (2000). Statistical considerations in the intent-to-treat principle. Statistics in Medicine, 21(3), 167–189.

    Google Scholar 

  • Leve, L. D., Chamberlain, P., & Reid, J. B. (2005). Intervention outcomes for girls referred from juvenile justice: Effects on delinquency. Journal of Consulting and Clinical Psychology, 73, 1181–1114.

    Article  Google Scholar 

  • Little, M., Kogan, J., Bullock, R., & Van Der Laan, P. (2004). An experiment in multi-systemic responses to persistent young offenders known to children’s services. British Journal of Criminology, 44, 225–240.

    Article  Google Scholar 

  • Moher, D., Jones, A., & Lepage, L. (2001a). Use of the CONSORT statement and quality of reports of randomized trials: A comparative before and after evaluation. Journal of the American Medical Association, 285(15), 1992–1995.

    Article  Google Scholar 

  • Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., et al. (1998). Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses? Lancet, 352, 609–613.

    Article  Google Scholar 

  • Moher, D., Schulz, K. F., Altman, D., & for the CONSORT Group (2001b). The CONSORT Statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Journal of the American Medical Association, 285(15), 1987–1991.

    Article  Google Scholar 

  • Montori, V. M., Bhandari, M., Devereaux, P. J., Manns, B. J., Ghali, W. A., & Guyatt, G. H. (2002). In the dark: The reporting of blinding status in randomized controlled trials. Journal of Clinical Epidemiology, 55(8), 787–790.

    Article  Google Scholar 

  • Needles, K., James-Burdumy, S., & Burghardt, J. (2005). Community case management for former jail inmates: Its impacts on re-arrest, drug use and HIV risk. Journal of Urban Health, 82(3), 420–431.

    Google Scholar 

  • Perry, A. E., Gilbody, S., Akers, J., & Light, K. (2008) Access and provision of services for young people with mental health needs (in press). Youth Justice Board, England and Wales.

  • Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2002). Scared straight and other juvenile awareness programs for preventing juvenile delinquency: A systematic review of randomised experimental evidence. USA: Campbell Collaboration.

    Google Scholar 

  • Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., & Evans, S. J. W. (2006). Reporting of noninferiority and equivalence randomized trials. An extension of the CONSORT Statement. Journal of the American Medical Association, 295(10), 1147–1172.

    Article  Google Scholar 

  • Piggot, M., McGee, H., & Feuer, D. (2004). Has CONSORT improved the reporting of randomized controlled trials in palliative care literature? A systematic review. Palliative Medicine, 18, 32–38.

    Article  Google Scholar 

  • Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D., Hill, C., et al. (2006). Does the CONSORT checklist improve the quality of reporting randomized controlled trials? A systematic review. The Medical Journal of Australia, 185(5), 263–267.

    Google Scholar 

  • Rennie, D. (1996). How to report randomized controlled trials: The CONSORT Statement. Journal of the American Medical Association, 276, 649.

    Article  Google Scholar 

  • Rohde, P., Clarke, G. N., Mace, D. E., Jorgensen, J. S., & Seeley, J. R. (2004b). An efficacy/effectiveness study of cognitive-behavioral treatment for adolescents with comorbid major depression and conduct disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 43(6), 660–668.

    Article  Google Scholar 

  • Rohde, P., Jorgensen, J. S., Seeley, J. R., & Mace, D. E. (2004a). Pilot evaluation of the coping course: A cognitive-behavioral intervention to enhance coping skills in incarcerated youth. Journal of the American Academy of Child & Adolescent Psychiatry, 43(6), 669–676.

    Article  Google Scholar 

  • Sanchez-Thorin, J. C., Cortes, M. C., Montenegro, M., & Villate, N. (2001). The quality of reporting of randomized controlled trials published in Ophthalmology. Ophthalmology, 108, 410–415.

    Article  Google Scholar 

  • Scales, C. D., Norris, R. D., Keitz, S. A., Peterson, B. L., Preminger, G. M., Vieweg, J., et al. (2007). A critical assessment of the quality of reporting of randomized controlled trials in the urology literature. The Journal of Urology, 177(3), 1090–1095.

    Article  Google Scholar 

  • Schaeffer, C. M., & Borduin, C. M. (2005). Long-term follow-up to a randomized clinical trial of multisystemic therapy with serious and violent juvenile offenders. Journal of Consulting and Clinical Psychology, 73(3), 445–453.

    Article  Google Scholar 

  • Schulz, K. F., Chalmers, I., Hayes, R. J., & Altman, D. G. (1995). Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Journal of the American Medical Association, 273, 408–412.

    Article  Google Scholar 

  • Shaddish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi experimental designs for generalized casual inference. Boston: Houghton Mifflin.

    Google Scholar 

  • Sherman, L. W., Farrington, D. P., Welsh, B. C., & Mackenzie, D. L. (Eds.) (2002). Evidence-Based Crime Prevention. London: Routledge.

  • Steiner, H., Petersen, M. L., Saxena, K., Ford, S., & Matthews, Z. (2003). Divalproex sodium for the treatment of conduct disorder: A randomized controlled clinical trial. Journal of Clinical Psychiatry, 64(10), 1183–1191.

    Article  Google Scholar 

  • Timmons-Mitchell, J., Bender, M. B., Kishna, M. A., & Mitchell, C. C. (2006). An independent effectiveness trial of multisystemic therapy with juvenile justice youth. Journal of Clinical Child and Adolescent Psychology, 35(2), 227–236.

    Article  Google Scholar 

  • Torgerson, C. J., Brooks, G., & Hall, J. (2005). Literature review of phonic use. Report to the Department for Education and Skills.

  • Viney, L. L., & Henry, R. M. (2002). Evaluating personal construct and psychodynamic group work with adolescent offenders and non offenders. In R. A. Neimeyer, & G. J. Neimeyer (Eds.) Advances in personal construct psychology new directions and perspectives (pp. 259–294). Westport, CT: Praeger Publishers/Greenwood Publishing Group.

    Google Scholar 

  • Wells, C. (2001). The treatment of severe antisocial behaviour in young people. In G. Baruch (Ed.), Community based psychotherapy with young people: Evidence and innovation in practice (pp. 125–144). Florence, KY, USA: Brunner-Routledge.

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Carole Torgerson for her comments and advice on earlier drafts of this paper. The systematic review was supported by the Youth Justice Board in England and Wales (grant 12/06) and the searches by the Centre for Reviews and Dissemination at the University of York.

Note of interest

A report of this research was presented at the International Campbell Collaboration Conference, London, 14–16th May 2007.

Author information

Authors and Affiliations

  1. Centre for Criminal Justice Economics & Psychology, Wentworth College, University of York, Heslington, York, YO10 5DD, UK

    Amanda E. Perry & Mathew Johnson

Authors
  1. Amanda E. Perry
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mathew Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amanda E. Perry.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Perry, A.E., Johnson, M. Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note. J Exp Criminol 4, 165–185 (2008). https://doi.org/10.1007/s11292-008-9051-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11292-008-9051-7

Keywords

Search

Navigation