Abstract
Although not without their critics and limitations, randomized controlled trials (RCT) in clinical research are widely considered the highest methodological standard for establishing the feasibility, efficacy, and effectiveness of new and existing treatments in the field of substance abuse treatment as well as in all other areas of health-related care. This chapter reviews the basic design characteristics of RCTs after first considering the limitations of several large-scale, nonrandomized observational studies of substance abuse treatment to highlight the main benefits of the RCT design for making causal inferences. Important aspects of conducting an RCT are then discussed including: determining a research question; NIDA’s stage model of RCT studies; participant selection; choice of design; control/comparison groups; and alternative randomization strategies. Emerging issues and design developments are considered in each section. Throughout, important concepts are highlighted using examples from RCT studies many of which were conducted as part of the National Drug Abuse Treatment Clinical Trials Network (CTN), which has conducted a large number of multisite RCTs over the past 15 years. In the process, these studies have provided much valuable information not only on the efficacy–effectiveness of different substance abuse treatment interventions but also on improving RCT methodology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The acronym RCT can also be used to refer to randomized clinical trials when the subject area of the study is to compare clinical interventions using a randomized design. Most of the studies referenced in this paper are, in fact, randomized clinical trials for this reason. We use the term RCT in a general if technically incorrect sense to refer to both randomized controlled and randomized clinical trials throughout the chapter. All of the examples given, however, are randomized clinical trials that compare the effectiveness of one or more treatments.
- 2.
Available online at: http://sites.duke.edu/rethinkingclinicaltrials/.
- 3.
Arguably, this same design but without random assignment to condition is also the kind of design used most often in quasi-experimental research studies. In the quasi-experimental version, in place of random assignment, some other strategy such as matching is used to maximize the comparability of participant characteristics across the experimental conditions.
- 4.
References
Albert, R. K. (2013). “Lies, Damned Lies…” and observational studies in comparative effectiveness research. American Journal of Respiratory and Critical Care Medicine, 187, 1173–1177.
Baer, J. S., Ball, S. A., Campbell, B. K., Miele, G. M., Schoener, E. P., & Tracy, K. (2007). Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug and Alcohol Dependence, 16, 107–118.
Ball, S. A., Martino, S., Nich, C., Frankforter, T. L., Van Horn, D., Crits-Christoph, P., et al. (2007). Site matters: Multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. Journal of Consulting and Clinical Psychology, 75, 556–567.
Betty Ford Center. (March 1, 2008). 90 day treatment stay the new “gold standard”. Retrieved from http://www.bettyfordcenter.org/recovery/programs/90-day-treatment-stay-the-new-gold-standard.php
Bewick, B. M., West, R., Gill, J., O’May, F., Mulhern, B., Barkham, M., & Hill, A. J. (2010). Providing web-based feedback and social norms information to reduce student alcohol intake: A multisite investigation. Journal of Medical Internet Research, 12. Advance online publication. doi:10.2196/jmir.1461
Blair, E. (2004). Gold is not always good enough: The shortcomings of randomization when evaluating interventions in small heterogeneous samples. Journal of Clinical Epidemiology, 57, 1219–1222.
Blanco, C., Olfson, M., Okuda, M., Nunes, E. V., Liu, S.-M., & Hasin, D. S. (2008). Generalizability of clinical trials for alcohol dependence to community samples. Drug and Alcohol Dependence, 98, 123–128.
Blanco, C., Rafful, C., & Olfson, M. (2013). The use of clinical trials in comparative effectiveness research on mental health. Journal of Clinical Epidemiology, 66, S29–S36.
Bogen, D. L. (2011). Randomized clinical trial of high vs. standard-calorie formula for methadone-exposed infants [NIDA grant proposal]. Retrieved from http://projectreporter.nih.gov/project_info_description.cfm?aid=8049612&icde=22651899
Brigham, G. S., Feaster, D. J., Wakim, P. G., & Dempsey, C. L. (2009). Choosing a control group in effectiveness trials of behavioral drug abuse treatment. Journal of Substance Abuse Treatment, 37, 388–397.
Brorson, H. H., Arnevik, E. A., Rand-Hendriksen, K., & Duckert, F. (2013). Drop-out from addiction treatment: A systematic review of risk factors. Clinical Psychology Review, 33, 1010–1024.
Campbell, B. K., Guydish, J., Le, T., Wells, E. A., & McCarty, D. (2015). The relationship of therapeutic alliance and treatment delivery fidelity with treatment retention in a multisite trial of twelve-step facilities. Psychology of Addictive Behaviors. Advance online publication. doi:10.1037/adb0000008
Campbell, A. N. C., Nunes, E. V., Miele, G. M., Matthews, A., Polsky, D., Ghitza, U. E., et al. (2012). Design and methodological considerations of an effectiveness trial of a computer-assisted intervention: An example from the NIDA Clinical Trials Network. Contemporary Clinical Trials, 33, 386–395.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston, MA: Houghton Mifflin Company.
Carroll, K. M., Ball, S. A., Jackson, R., Martino, S., Petry, N. M., Stitzer, M. L., et al. (2011). Ten take home lessons from the first ten years of the CTN and ten recommendations for the future. American Journal of Drug and Alcohol Abuse, 37, 275–282.
Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., Nuro, K. F., et al. (2008). Computer-assisted delivery of cognitive-behavioral therapy for addiction: A randomized trial of CBT4CBT. American Journal of Psychiatry, 165, 881–888.
Carroll, K. M., & Rounsaville, B. J. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, 333–339.
Carroll, K. M., & Rounsaville, B. J. (2007). A vision of the next generation of behavioral therapies in the addictions. Addiction, 107, 850–869.
Coffey, C. S., Levin, B., Clark, C., Timmerman, C., Wittes, J., Gilbert, P., et al. (2012). Overview, hurdles, and future work in adaptive designs: Perspectives from a National Institute Health-funded workshop. Clinical Trials, 9, 671–680.
Del Boca, F. K., & Darkes, J. (2007a). Enhancing the validity and utility of randomized clinical trials in addictions treatment research: I. Participant samples and assessment. Addiction, 102, 1047–1056.
Del Boca, F. K., & Darkes, J. (2007b). Enhancing the validity and utility of randomized clinical trials in addictions treatment research: II. Participant samples and assessment. Addiction, 102, 1194–1203.
Evins, A. E., Cather, C., Pratt, S. A., Pachas, G. N., Hoeppner, S. S., Goff, D. C., et al. (2014). Maintenance treatment with varenicline for smoking cessation in patients with schizophrenia and bipolar disorder. Journal of the American Medical Association, 311, 145–154.
Feaster, D. J., Mikulich-Glibertson, S., & Brincks, A. M. (2011). Modeling site effects in the design and analysis of multisite trials. American Journal of Drug and Alcohol Abuse, 37, 383–391.
Fernández-Montalvo, J., López-Goñi, J. J., Illescas, C., Landa, N., & Norea, I. (2008). Evaluation of a therapeutic treatment program: A long-term follow-up study in Spain. Substance Use and Misuse, 43, 1362–1377.
Fletcher, B. W., Tims, F. M., & Brown, B. S. (1997). Drug abuse treatment outcome study (DATOS): Treatment evaluation research in the United States. Psychology of Addictive Behaviors, 11, 216–229.
Flynn, P. M., & Brown, B. S. (2008). Co-occurring disorders in substance abuse treatment: Issues and prospects. Journal of Substance Abuse Treatment, 34, 36–47.
Friedman, L. M., Furberg, C. D., & DeMets, D. L. (1998). Fundamentals of clinical trials (3rd ed.). New York, NY: Springer-Verlag.
Gerstein, D., Datta, R., Ingels, J., Johnson, R., Rasinski, K., Schildhaus, S., Talley, K., Jordan, K., Phillips, D. B., Anderson, D. W., Condelli, W. G., & Collins, J. S. (1997). National Treatment Improvement Evaluation Survey, Final Report, Center for Substance Abuse Treatment, Substance Abuse and Mental Health Services Administration. Washington, DC: US Department of Health and Human Services.
Gibbons, R. D., Hedeker, D., & DuToit, S. (2010). Advances in analysis of longitudinal data. Annual Review of Clinical Psychology, 6, 79–107.
Gossop, M., Marsden, J., Stewart, D., & Rolfe, A. (1999). Treatment retention and 1 year outcomes for residential programmes in England. Drug and Alcohol Dependence, 57, 89–98.
Grossman, J., & MacKenzie, F. J. (2005). The randomized controlled trial: Gold standard, or merely standard? Perspectives in Biology and Medicine, 48, 516–534.
Hawkins, N. G., Sanson-Fisher, R. W., Shakeshaft, A., D’Este, C., & Green, L. W. (2007). The multiple baseline design for evaluating population-based research. American Journal of Preventive Medicine, 33, 162–168.
Hedden, S. L., Woolson, R. F., Carter, R. E., Palesch, Y., Upadhyaya, H. P., & Malcom, R. J. (2009). The impact of loss to follow-up on hypothesis tests of the treatment for several statistical methods in substance abuse clinical trials. Journal of Substance Abuse Treatment, 37, 54–63.
Hedden, S. L., Woolson, R. F., & Malcolm, R. J. (2006). Randomization in substance abuse clinical trials. Substance Abuse Treatment, Prevention, and Policy, 1, 6. Epub. doi:10.1186/1747-597X-1-6
Hien, D. A., Wells, E. A., Jiang, H., Suarez-Morales, L., Campbell, A. N. C., Cohen, L. R., et al. (2009). Multi-site randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders. Journal of Consulting and Clinical Psychology, 77, 607–619.
Hser, Y.-I., Evans, E., Huang, D., Weiss, R. D., Saxon, A. J., Carroll, K. M., et al. (2015). Long-term outcomes after randomization to Buprenorphine/Naloxone versus Methadone in a multi-site trial. Addiction, 111(4), 695–705.
Hser, Y.-I., Saxon, A. J., Huang, D., Hasson, A., Thomas, C., Hillhouse, M., et al. (2014). Treatment retention among patients randomized to buprenorphine/naloxone compared to methadone in a multi-site trial. Addiction, 109, 79–87.
Hubbard, R. L., Craddock, S. G., & Anderson, J. (2003). Overview of 5-year follow-up outcomes in the Drug Abuse Treatment Outcome Studies (DATOS). Journal of Substance Abuse Treatment, 25, 125–134.
Humphreys, K., Horst, D., Joshi, A. A., & Finnery, J. W. (2005). Prevalence and predictors of research participant eligibility criteria in alcohol treatment outcome studies, 1970–98. Addiction, 100, 1249–1257.
Humpreys, K., Maisel, N. C., Blodgett, J. C., & Finney, J. W. (2013). Representativeness of patients enrolled in influential clinical trials: A comparison of substance dependence with other medical disorders. Journal of Studies on Alcohol and Drugs, 74, 889–893.
Jones, H. E., O’Grady, K. E., & Tuten, M. (2011). Reinforcement-based treatment improves the maternal treatment and neonatal outcomes of pregnant patients enrolled in comprehensive care treatment. The American Journal on Addictions, 20, 196–204.
Kahler, C. W., Metrik, J., LaChance, H. R., Ramsey, S. E., Abrams, D. B., Monti, P. M., et al. (2009). Addressing heavy drinking in smoking cessation treatment: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 76, 852–862.
Kao, L. S., Tyson, J. E., Blakely, M. L., & Lally, K. P. (2008). Clinical research methodology I: Introduction to randomized trials. Journal of the American College of Surgeons, 206, 361–369.
Kaptchuk, T. J. (2001). The double-blind, randomized, placebo-controlled trial: Gold standard or golden calf? Journal of Clinical Epidemiology, 54, 541–549.
Karlsson, P., & Bergmark, A. (2014). Compared with what? An analysis of control group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders. Addiction, 110, 420–428.
Kunz, R., Vist, G., Oxman, A. D. (2008). Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews, 2. doi:10.1002/14651858.MR000012.pub2
Ling, W., Amass, L., Shoptaw, S., Annon, J.J., Hillhouse, M., Babcock, D., Brigham, G., Harrer, J., Reid, M., Muir, J., Buchan, B., Orr, D., Woody, G., Krejci, J., Ziedonis, D, Buprenorphine Study Protocol Group. (2005). A multi-center randomized trial of burprenorphine-naloxone versus clonidine for opioid detoxification: Findings from the National Institute on Drug Abuse Clinical Trials Network. Addiction, 100, 1090–1100.
Machin, D., & Fayers, P. M. (2010). Randomized clinical trials design, practice and reporting. Hoboken, NJ: Wiley-Blackwell.
Marsch, L. A., Guarino, H., Asosta, M., Aponte-Melendez, Y., Cleland, C., Grabinski, M., et al. (2014). Web-based behavioral treatment for substance use disorders as a partial replacement of standard methadone maintenance treatment. Journal of Substance Abuse Treatment, 46, 43–51.
McGovern, M. P., Fox, T. S., Xie, H., & Drake, R. E. (2004). A survey of clinical practices and readiness to adopt evidence-based practices: Dissemination research in an addiction treatment system. Journal of Substance Abuse Treatment, 26, 305–312.
McMahon, R. C., Kouzekanani, K., & Malow, R. M. (1999). A comparative study of cocaine-treatment completers and dropouts. Journal of Substance Abuse Treatment, 16, 17–22.
McPherson, S., Barbosa-Leiker, C., Mamey, M. R., McDonell, M., Enders, C. K., & Roll, J. M. (2015). A ‘missing not at random’ (MNAR) and ‘missing at random (MAR) growth model comparison with a Buprenorphine/Naloxone clinical trial. Addiction, 110(1), 51–58.
Melberg, H. O., & Humphreys, K. (2010). Ineligibility and refusal to participate in randomised trials of treatments for drug dependence. Drug and Alcohol Review, 29, 193–201.
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007). Study designs for effectiveness and translation research. American Journal of Preventive Medicine, 33, 139–154.
Murphy, S. A., Lynch, K. G., Oslin, D., McKay, J. R., & TenHave, T. (2007). Developing adaptive treatment strategies in substance abuse research. Drug and Alcohol Dependence, 88(suppl. 2), S24–S30.
Nunes, E. V., Ball, S., Booth, R., Brigham, G., Calsyn, D. A., Carroll, K., et al. (2010). Multi-site effectiveness trials of treatments for substance abuse and co-occurring problems: Have we chosen the best designs? Journal of Substance Abuse Treatment, 38(suppl. 1), S97–S112.
Orford, J. (2008). Asking the right questions in the right way: The need for a shift in research on psychological treatments for addiction. Addiction, 103, 886–892.
Pagoto, S. L., Kozak, A. T., John, P., Bodenlos, J. S., Hedeker, D., Spring, B., et al. (2009). Intention-to-treat analyses in behavioral medicine in randomized clinical trials. International Journal of Behavioral Medicine, 16, 316–322.
Perron, B. E., Cordova, D., Salas-Wright, C., & Vaughn, M. G. (2017). Validity: Conceptual and methodological issues in substance abuse research. In J. B. VanGeest, T. P. Johnson, & S. Alemagno (Eds.), Research methods in the study of substance abuse (pp. XX–XX). New York, NY: Springer.
Petri, N. M., Peirce, J. M., Stitzer, M. L., Blaine, J., Roll, J. M., Cohen, A., et al. (2005). Effect of prize-based incentives on outcomes in stimulant abusers in outpatient psychosocial treatment programs. Archives of General Psychiatry, 62, 1148–1156.
Pettinati, H. M., Silverman, B. L., Battisti, J. J., Forman, R., Schweizer, E., & Gastfriend, D. R. (2011). Efficacy of extended-release naltrexone in patients with relatively higher severity of alcohol dependence. Alcoholism, Clinical and Experimental Research, 35, 1804–1811.
Retrosen, J., Leshner, A., Tai, B., Greenlick, M., Pencer, E., Trachtenberg, R., Woody, G. (2002). National Drug Abuse Clinical Trials Network—Challenges and opportunites. In L. S. Harris (Ed.), Problems of Drug Dependence, 2001: Proceedings of the 63rd Annual Scientific Meeting, the College on Problems or Drug Dependence, Inc. NIDA Research Monograph 182 (pp. 12–17). Bethesda, MD: National Institute on Drug Abuse.
Roan, S. (November 10, 2008). The 30-day myth. Los Angeles Times. Retrieved November 24, 2014 from http://articles.latimes.com/2008/nov/10/health/he-addiction10
Rosner, A. (2002). Reality-based evidence: Prospecting for the elusive gold standard. Dynamic Chiropractic, 20, 14–16.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). NIDA’s stage model of behavioral therapies research: Getting started and moving on from Stage I. Clinical Psychology: Science and Practice, 8, 133–142.
Scott, C. K. (2004). A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug and Alcohol Dependence, 74, 21–36.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized quasi-experimental inference (2nd ed.). New York, NY: Houghton Mifflin.
Solomon, P., Cavanaugh, M. M., & Draine, J. (2009). Randomized controlled trials: Design and implementation for community-based psychosocial interventions (pocket guides to social work research methods). New York, NY: Oxford University Press.
Stout, R. L., Wirtz, P. W., Carbonari, J. P., & Del Boca, F. K. (1994). Ensuring balanced distribution of prognostic factors in treatment outcome research. Journal of Studies on Alcohol (suppl. 12), 70–75.
Susikida, R., Crum, R. M., Stuart, E. A., Ebnesajjad, C., & Motjabai, R. (2016). Assessing sample representativeness in randomized clinical trials: Application to the National Institute on Drug Abuse Clinical Trials Network. Addiction, 111, 1226–1234.
Swartz, J. A. (2012). Substance Abuse in America: A documentary and reference guide. Santa Barbara, CA: ABC-Clio.
Tai, B., Sparenborg, D., Liu, D., & Straus, M. (2011). The national drug abuse treatment clinical trials network: Forging a partnership between research knowledge and community practice. Substance Abuse and Rehabilitation, 2, 21–28.
Tiffany, S. T., Friedman, L., Greenfield, S. F., Hasin, D. S., & Jackson, R. (2012). Beyond drug use: A systematic consideration of other outcomes in evaluations of treatments for substance use disorders. Addiction, 107, 709–718.
Wallace, P., Struzzo, P., della Vedova, R., Tersar, C., Verbano, L., Lygidakis, H., MacGregor, R., Freemantle, N., & Scafato, E. (2013). Randomised controlled non-inferiority trial of primary care based facilitated access to an alcohol reduction website (EFAR-FVG). Addiction Science & Clinical Practice, 8 (Suppl 1), A83.
Witkiewitz, K., Warner, K., Sully, B., Barricks, A., Stauffer, C., Thompson, B. L., et al. (2014). Randomized trial comparing mindfulness-based relapse prevention with relapse prevention for women offenders at a residential addiction treatment center. Substance Use and Misuse, 49, 536–546.
Wolff, N. (2000). Using randomized controlled trials to evaluate socially complex services: Problems, challenges and recommendations. The Journal of Mental Health Policy and Economics, 3, 97–109.
Woolf, S. H. (2008). The meaning of translational research and why it matters. Journal of the American Medical Association, 209, 211–213.
Zhang, Z., Friedmann, P. D., & Gerstein, D. R. (2002). Does retention matter? Treatment duration and improvement in drug use. Addiction, 98, 673–684.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Swartz, J.A. (2017). Randomized Controlled Trials in Substance Abuse Treatment Research: Fundamental Aspects and New Developments in Random Assignment Strategies, Comparison/Control Conditions, and Design Characteristics. In: VanGeest, J., Johnson, T., Alemagno, S. (eds) Research Methods in the Study of Substance Abuse. Springer, Cham. https://doi.org/10.1007/978-3-319-55980-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-55980-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55978-0
Online ISBN: 978-3-319-55980-3
eBook Packages: Social SciencesSocial Sciences (R0)