Skip to main content

Randomized Controlled Trials in Substance Abuse Treatment Research: Fundamental Aspects and New Developments in Random Assignment Strategies, Comparison/Control Conditions, and Design Characteristics

  • Chapter
  • First Online:
Research Methods in the Study of Substance Abuse
  • 962 Accesses

Abstract

Although not without their critics and limitations, randomized controlled trials (RCT) in clinical research are widely considered the highest methodological standard for establishing the feasibility, efficacy, and effectiveness of new and existing treatments in the field of substance abuse treatment as well as in all other areas of health-related care. This chapter reviews the basic design characteristics of RCTs after first considering the limitations of several large-scale, nonrandomized observational studies of substance abuse treatment to highlight the main benefits of the RCT design for making causal inferences. Important aspects of conducting an RCT are then discussed including: determining a research question; NIDA’s stage model of RCT studies; participant selection; choice of design; control/comparison groups; and alternative randomization strategies. Emerging issues and design developments are considered in each section. Throughout, important concepts are highlighted using examples from RCT studies many of which were conducted as part of the National Drug Abuse Treatment Clinical Trials Network (CTN), which has conducted a large number of multisite RCTs over the past 15 years. In the process, these studies have provided much valuable information not only on the efficacy–effectiveness of different substance abuse treatment interventions but also on improving RCT methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The acronym RCT can also be used to refer to randomized clinical trials when the subject area of the study is to compare clinical interventions using a randomized design. Most of the studies referenced in this paper are, in fact, randomized clinical trials for this reason. We use the term RCT in a general if technically incorrect sense to refer to both randomized controlled and randomized clinical trials throughout the chapter. All of the examples given, however, are randomized clinical trials that compare the effectiveness of one or more treatments.

  2. 2.

    Available online at: http://sites.duke.edu/rethinkingclinicaltrials/.

  3. 3.

    Arguably, this same design but without random assignment to condition is also the kind of design used most often in quasi-experimental research studies. In the quasi-experimental version, in place of random assignment, some other strategy such as matching is used to maximize the comparability of participant characteristics across the experimental conditions.

  4. 4.

    http://methodology.psu.edu/ra/smart/projects.

References

  • Albert, R. K. (2013). “Lies, Damned Lies…” and observational studies in comparative effectiveness research. American Journal of Respiratory and Critical Care Medicine, 187, 1173–1177.

    Article  Google Scholar 

  • Baer, J. S., Ball, S. A., Campbell, B. K., Miele, G. M., Schoener, E. P., & Tracy, K. (2007). Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug and Alcohol Dependence, 16, 107–118.

    Article  Google Scholar 

  • Ball, S. A., Martino, S., Nich, C., Frankforter, T. L., Van Horn, D., Crits-Christoph, P., et al. (2007). Site matters: Multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. Journal of Consulting and Clinical Psychology, 75, 556–567.

    Article  Google Scholar 

  • Betty Ford Center. (March 1, 2008). 90 day treatment stay the new “gold standard”. Retrieved from http://www.bettyfordcenter.org/recovery/programs/90-day-treatment-stay-the-new-gold-standard.php

  • Bewick, B. M., West, R., Gill, J., O’May, F., Mulhern, B., Barkham, M., & Hill, A. J. (2010). Providing web-based feedback and social norms information to reduce student alcohol intake: A multisite investigation. Journal of Medical Internet Research, 12. Advance online publication. doi:10.2196/jmir.1461

  • Blair, E. (2004). Gold is not always good enough: The shortcomings of randomization when evaluating interventions in small heterogeneous samples. Journal of Clinical Epidemiology, 57, 1219–1222.

    Article  Google Scholar 

  • Blanco, C., Olfson, M., Okuda, M., Nunes, E. V., Liu, S.-M., & Hasin, D. S. (2008). Generalizability of clinical trials for alcohol dependence to community samples. Drug and Alcohol Dependence, 98, 123–128.

    Article  Google Scholar 

  • Blanco, C., Rafful, C., & Olfson, M. (2013). The use of clinical trials in comparative effectiveness research on mental health. Journal of Clinical Epidemiology, 66, S29–S36.

    Article  Google Scholar 

  • Bogen, D. L. (2011). Randomized clinical trial of high vs. standard-calorie formula for methadone-exposed infants [NIDA grant proposal]. Retrieved from http://projectreporter.nih.gov/project_info_description.cfm?aid=8049612&icde=22651899

  • Brigham, G. S., Feaster, D. J., Wakim, P. G., & Dempsey, C. L. (2009). Choosing a control group in effectiveness trials of behavioral drug abuse treatment. Journal of Substance Abuse Treatment, 37, 388–397.

    Article  Google Scholar 

  • Brorson, H. H., Arnevik, E. A., Rand-Hendriksen, K., & Duckert, F. (2013). Drop-out from addiction treatment: A systematic review of risk factors. Clinical Psychology Review, 33, 1010–1024.

    Article  Google Scholar 

  • Campbell, B. K., Guydish, J., Le, T., Wells, E. A., & McCarty, D. (2015). The relationship of therapeutic alliance and treatment delivery fidelity with treatment retention in a multisite trial of twelve-step facilities. Psychology of Addictive Behaviors. Advance online publication. doi:10.1037/adb0000008

  • Campbell, A. N. C., Nunes, E. V., Miele, G. M., Matthews, A., Polsky, D., Ghitza, U. E., et al. (2012). Design and methodological considerations of an effectiveness trial of a computer-assisted intervention: An example from the NIDA Clinical Trials Network. Contemporary Clinical Trials, 33, 386–395.

    Article  Google Scholar 

  • Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston, MA: Houghton Mifflin Company.

    Google Scholar 

  • Carroll, K. M., Ball, S. A., Jackson, R., Martino, S., Petry, N. M., Stitzer, M. L., et al. (2011). Ten take home lessons from the first ten years of the CTN and ten recommendations for the future. American Journal of Drug and Alcohol Abuse, 37, 275–282.

    Article  Google Scholar 

  • Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., Nuro, K. F., et al. (2008). Computer-assisted delivery of cognitive-behavioral therapy for addiction: A randomized trial of CBT4CBT. American Journal of Psychiatry, 165, 881–888.

    Article  Google Scholar 

  • Carroll, K. M., & Rounsaville, B. J. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, 333–339.

    Article  Google Scholar 

  • Carroll, K. M., & Rounsaville, B. J. (2007). A vision of the next generation of behavioral therapies in the addictions. Addiction, 107, 850–869.

    Article  Google Scholar 

  • Coffey, C. S., Levin, B., Clark, C., Timmerman, C., Wittes, J., Gilbert, P., et al. (2012). Overview, hurdles, and future work in adaptive designs: Perspectives from a National Institute Health-funded workshop. Clinical Trials, 9, 671–680.

    Article  Google Scholar 

  • Del Boca, F. K., & Darkes, J. (2007a). Enhancing the validity and utility of randomized clinical trials in addictions treatment research: I. Participant samples and assessment. Addiction, 102, 1047–1056.

    Google Scholar 

  • Del Boca, F. K., & Darkes, J. (2007b). Enhancing the validity and utility of randomized clinical trials in addictions treatment research: II. Participant samples and assessment. Addiction, 102, 1194–1203.

    Google Scholar 

  • Evins, A. E., Cather, C., Pratt, S. A., Pachas, G. N., Hoeppner, S. S., Goff, D. C., et al. (2014). Maintenance treatment with varenicline for smoking cessation in patients with schizophrenia and bipolar disorder. Journal of the American Medical Association, 311, 145–154.

    Article  Google Scholar 

  • Feaster, D. J., Mikulich-Glibertson, S., & Brincks, A. M. (2011). Modeling site effects in the design and analysis of multisite trials. American Journal of Drug and Alcohol Abuse, 37, 383–391.

    Article  Google Scholar 

  • Fernández-Montalvo, J., López-Goñi, J. J., Illescas, C., Landa, N., & Norea, I. (2008). Evaluation of a therapeutic treatment program: A long-term follow-up study in Spain. Substance Use and Misuse, 43, 1362–1377.

    Article  Google Scholar 

  • Fletcher, B. W., Tims, F. M., & Brown, B. S. (1997). Drug abuse treatment outcome study (DATOS): Treatment evaluation research in the United States. Psychology of Addictive Behaviors, 11, 216–229.

    Article  Google Scholar 

  • Flynn, P. M., & Brown, B. S. (2008). Co-occurring disorders in substance abuse treatment: Issues and prospects. Journal of Substance Abuse Treatment, 34, 36–47.

    Article  Google Scholar 

  • Friedman, L. M., Furberg, C. D., & DeMets, D. L. (1998). Fundamentals of clinical trials (3rd ed.). New York, NY: Springer-Verlag.

    Book  Google Scholar 

  • Gerstein, D., Datta, R., Ingels, J., Johnson, R., Rasinski, K., Schildhaus, S., Talley, K., Jordan, K., Phillips, D. B., Anderson, D. W., Condelli, W. G., & Collins, J. S. (1997). National Treatment Improvement Evaluation Survey, Final Report, Center for Substance Abuse Treatment, Substance Abuse and Mental Health Services Administration. Washington, DC: US Department of Health and Human Services.

    Google Scholar 

  • Gibbons, R. D., Hedeker, D., & DuToit, S. (2010). Advances in analysis of longitudinal data. Annual Review of Clinical Psychology, 6, 79–107.

    Article  Google Scholar 

  • Gossop, M., Marsden, J., Stewart, D., & Rolfe, A. (1999). Treatment retention and 1 year outcomes for residential programmes in England. Drug and Alcohol Dependence, 57, 89–98.

    Article  Google Scholar 

  • Grossman, J., & MacKenzie, F. J. (2005). The randomized controlled trial: Gold standard, or merely standard? Perspectives in Biology and Medicine, 48, 516–534.

    Article  Google Scholar 

  • Hawkins, N. G., Sanson-Fisher, R. W., Shakeshaft, A., D’Este, C., & Green, L. W. (2007). The multiple baseline design for evaluating population-based research. American Journal of Preventive Medicine, 33, 162–168.

    Article  Google Scholar 

  • Hedden, S. L., Woolson, R. F., Carter, R. E., Palesch, Y., Upadhyaya, H. P., & Malcom, R. J. (2009). The impact of loss to follow-up on hypothesis tests of the treatment for several statistical methods in substance abuse clinical trials. Journal of Substance Abuse Treatment, 37, 54–63.

    Article  Google Scholar 

  • Hedden, S. L., Woolson, R. F., & Malcolm, R. J. (2006). Randomization in substance abuse clinical trials. Substance Abuse Treatment, Prevention, and Policy, 1, 6. Epub. doi:10.1186/1747-597X-1-6

  • Hien, D. A., Wells, E. A., Jiang, H., Suarez-Morales, L., Campbell, A. N. C., Cohen, L. R., et al. (2009). Multi-site randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders. Journal of Consulting and Clinical Psychology, 77, 607–619.

    Article  Google Scholar 

  • Hser, Y.-I., Evans, E., Huang, D., Weiss, R. D., Saxon, A. J., Carroll, K. M., et al. (2015). Long-term outcomes after randomization to Buprenorphine/Naloxone versus Methadone in a multi-site trial. Addiction, 111(4), 695–705.

    Article  Google Scholar 

  • Hser, Y.-I., Saxon, A. J., Huang, D., Hasson, A., Thomas, C., Hillhouse, M., et al. (2014). Treatment retention among patients randomized to buprenorphine/naloxone compared to methadone in a multi-site trial. Addiction, 109, 79–87.

    Article  Google Scholar 

  • Hubbard, R. L., Craddock, S. G., & Anderson, J. (2003). Overview of 5-year follow-up outcomes in the Drug Abuse Treatment Outcome Studies (DATOS). Journal of Substance Abuse Treatment, 25, 125–134.

    Article  Google Scholar 

  • Humphreys, K., Horst, D., Joshi, A. A., & Finnery, J. W. (2005). Prevalence and predictors of research participant eligibility criteria in alcohol treatment outcome studies, 1970–98. Addiction, 100, 1249–1257.

    Article  Google Scholar 

  • Humpreys, K., Maisel, N. C., Blodgett, J. C., & Finney, J. W. (2013). Representativeness of patients enrolled in influential clinical trials: A comparison of substance dependence with other medical disorders. Journal of Studies on Alcohol and Drugs, 74, 889–893.

    Article  Google Scholar 

  • Jones, H. E., O’Grady, K. E., & Tuten, M. (2011). Reinforcement-based treatment improves the maternal treatment and neonatal outcomes of pregnant patients enrolled in comprehensive care treatment. The American Journal on Addictions, 20, 196–204.

    Article  Google Scholar 

  • Kahler, C. W., Metrik, J., LaChance, H. R., Ramsey, S. E., Abrams, D. B., Monti, P. M., et al. (2009). Addressing heavy drinking in smoking cessation treatment: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 76, 852–862.

    Article  Google Scholar 

  • Kao, L. S., Tyson, J. E., Blakely, M. L., & Lally, K. P. (2008). Clinical research methodology I: Introduction to randomized trials. Journal of the American College of Surgeons, 206, 361–369.

    Article  Google Scholar 

  • Kaptchuk, T. J. (2001). The double-blind, randomized, placebo-controlled trial: Gold standard or golden calf? Journal of Clinical Epidemiology, 54, 541–549.

    Article  Google Scholar 

  • Karlsson, P., & Bergmark, A. (2014). Compared with what? An analysis of control group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders. Addiction, 110, 420–428.

    Article  Google Scholar 

  • Kunz, R., Vist, G., Oxman, A. D. (2008). Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews, 2. doi:10.1002/14651858.MR000012.pub2

  • Ling, W., Amass, L., Shoptaw, S., Annon, J.J., Hillhouse, M., Babcock, D., Brigham, G., Harrer, J., Reid, M., Muir, J., Buchan, B., Orr, D., Woody, G., Krejci, J., Ziedonis, D, Buprenorphine Study Protocol Group. (2005). A multi-center randomized trial of burprenorphine-naloxone versus clonidine for opioid detoxification: Findings from the National Institute on Drug Abuse Clinical Trials Network. Addiction, 100, 1090–1100.

    Article  Google Scholar 

  • Machin, D., & Fayers, P. M. (2010). Randomized clinical trials design, practice and reporting. Hoboken, NJ: Wiley-Blackwell.

    Book  Google Scholar 

  • Marsch, L. A., Guarino, H., Asosta, M., Aponte-Melendez, Y., Cleland, C., Grabinski, M., et al. (2014). Web-based behavioral treatment for substance use disorders as a partial replacement of standard methadone maintenance treatment. Journal of Substance Abuse Treatment, 46, 43–51.

    Article  Google Scholar 

  • McGovern, M. P., Fox, T. S., Xie, H., & Drake, R. E. (2004). A survey of clinical practices and readiness to adopt evidence-based practices: Dissemination research in an addiction treatment system. Journal of Substance Abuse Treatment, 26, 305–312.

    Article  Google Scholar 

  • McMahon, R. C., Kouzekanani, K., & Malow, R. M. (1999). A comparative study of cocaine-treatment completers and dropouts. Journal of Substance Abuse Treatment, 16, 17–22.

    Article  Google Scholar 

  • McPherson, S., Barbosa-Leiker, C., Mamey, M. R., McDonell, M., Enders, C. K., & Roll, J. M. (2015). A ‘missing not at random’ (MNAR) and ‘missing at random (MAR) growth model comparison with a Buprenorphine/Naloxone clinical trial. Addiction, 110(1), 51–58.

    Article  Google Scholar 

  • Melberg, H. O., & Humphreys, K. (2010). Ineligibility and refusal to participate in randomised trials of treatments for drug dependence. Drug and Alcohol Review, 29, 193–201.

    Article  Google Scholar 

  • Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007). Study designs for effectiveness and translation research. American Journal of Preventive Medicine, 33, 139–154.

    Article  Google Scholar 

  • Murphy, S. A., Lynch, K. G., Oslin, D., McKay, J. R., & TenHave, T. (2007). Developing adaptive treatment strategies in substance abuse research. Drug and Alcohol Dependence, 88(suppl. 2), S24–S30.

    Article  Google Scholar 

  • Nunes, E. V., Ball, S., Booth, R., Brigham, G., Calsyn, D. A., Carroll, K., et al. (2010). Multi-site effectiveness trials of treatments for substance abuse and co-occurring problems: Have we chosen the best designs? Journal of Substance Abuse Treatment, 38(suppl. 1), S97–S112.

    Article  Google Scholar 

  • Orford, J. (2008). Asking the right questions in the right way: The need for a shift in research on psychological treatments for addiction. Addiction, 103, 886–892.

    Article  Google Scholar 

  • Pagoto, S. L., Kozak, A. T., John, P., Bodenlos, J. S., Hedeker, D., Spring, B., et al. (2009). Intention-to-treat analyses in behavioral medicine in randomized clinical trials. International Journal of Behavioral Medicine, 16, 316–322.

    Article  Google Scholar 

  • Perron, B. E., Cordova, D., Salas-Wright, C., & Vaughn, M. G. (2017). Validity: Conceptual and methodological issues in substance abuse research. In J. B. VanGeest, T. P. Johnson, & S. Alemagno (Eds.), Research methods in the study of substance abuse (pp. XX–XX). New York, NY: Springer.

    Google Scholar 

  • Petri, N. M., Peirce, J. M., Stitzer, M. L., Blaine, J., Roll, J. M., Cohen, A., et al. (2005). Effect of prize-based incentives on outcomes in stimulant abusers in outpatient psychosocial treatment programs. Archives of General Psychiatry, 62, 1148–1156.

    Article  Google Scholar 

  • Pettinati, H. M., Silverman, B. L., Battisti, J. J., Forman, R., Schweizer, E., & Gastfriend, D. R. (2011). Efficacy of extended-release naltrexone in patients with relatively higher severity of alcohol dependence. Alcoholism, Clinical and Experimental Research, 35, 1804–1811.

    Article  Google Scholar 

  • Retrosen, J., Leshner, A., Tai, B., Greenlick, M., Pencer, E., Trachtenberg, R., Woody, G. (2002). National Drug Abuse Clinical Trials Network—Challenges and opportunites. In L. S. Harris (Ed.), Problems of Drug Dependence, 2001: Proceedings of the 63rd Annual Scientific Meeting, the College on Problems or Drug Dependence, Inc. NIDA Research Monograph 182 (pp. 12–17). Bethesda, MD: National Institute on Drug Abuse.

    Google Scholar 

  • Roan, S. (November 10, 2008). The 30-day myth. Los Angeles Times. Retrieved November 24, 2014 from http://articles.latimes.com/2008/nov/10/health/he-addiction10

  • Rosner, A. (2002). Reality-based evidence: Prospecting for the elusive gold standard. Dynamic Chiropractic, 20, 14–16.

    Google Scholar 

  • Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). NIDA’s stage model of behavioral therapies research: Getting started and moving on from Stage I. Clinical Psychology: Science and Practice, 8, 133–142.

    Google Scholar 

  • Scott, C. K. (2004). A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug and Alcohol Dependence, 74, 21–36.

    Article  Google Scholar 

  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized quasi-experimental inference (2nd ed.). New York, NY: Houghton Mifflin.

    Google Scholar 

  • Solomon, P., Cavanaugh, M. M., & Draine, J. (2009). Randomized controlled trials: Design and implementation for community-based psychosocial interventions (pocket guides to social work research methods). New York, NY: Oxford University Press.

    Book  Google Scholar 

  • Stout, R. L., Wirtz, P. W., Carbonari, J. P., & Del Boca, F. K. (1994). Ensuring balanced distribution of prognostic factors in treatment outcome research. Journal of Studies on Alcohol (suppl. 12), 70–75.

    Google Scholar 

  • Susikida, R., Crum, R. M., Stuart, E. A., Ebnesajjad, C., & Motjabai, R. (2016). Assessing sample representativeness in randomized clinical trials: Application to the National Institute on Drug Abuse Clinical Trials Network. Addiction, 111, 1226–1234.

    Google Scholar 

  • Swartz, J. A. (2012). Substance Abuse in America: A documentary and reference guide. Santa Barbara, CA: ABC-Clio.

    Google Scholar 

  • Tai, B., Sparenborg, D., Liu, D., & Straus, M. (2011). The national drug abuse treatment clinical trials network: Forging a partnership between research knowledge and community practice. Substance Abuse and Rehabilitation, 2, 21–28.

    Article  Google Scholar 

  • Tiffany, S. T., Friedman, L., Greenfield, S. F., Hasin, D. S., & Jackson, R. (2012). Beyond drug use: A systematic consideration of other outcomes in evaluations of treatments for substance use disorders. Addiction, 107, 709–718.

    Article  Google Scholar 

  • Wallace, P., Struzzo, P., della Vedova, R., Tersar, C., Verbano, L., Lygidakis, H., MacGregor, R., Freemantle, N., & Scafato, E. (2013). Randomised controlled non-inferiority trial of primary care based facilitated access to an alcohol reduction website (EFAR-FVG). Addiction Science & Clinical Practice, 8 (Suppl 1), A83.

    Google Scholar 

  • Witkiewitz, K., Warner, K., Sully, B., Barricks, A., Stauffer, C., Thompson, B. L., et al. (2014). Randomized trial comparing mindfulness-based relapse prevention with relapse prevention for women offenders at a residential addiction treatment center. Substance Use and Misuse, 49, 536–546.

    Article  Google Scholar 

  • Wolff, N. (2000). Using randomized controlled trials to evaluate socially complex services: Problems, challenges and recommendations. The Journal of Mental Health Policy and Economics, 3, 97–109.

    Article  Google Scholar 

  • Woolf, S. H. (2008). The meaning of translational research and why it matters. Journal of the American Medical Association, 209, 211–213.

    Google Scholar 

  • Zhang, Z., Friedmann, P. D., & Gerstein, D. R. (2002). Does retention matter? Treatment duration and improvement in drug use. Addiction, 98, 673–684.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to James A. Swartz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Swartz, J.A. (2017). Randomized Controlled Trials in Substance Abuse Treatment Research: Fundamental Aspects and New Developments in Random Assignment Strategies, Comparison/Control Conditions, and Design Characteristics. In: VanGeest, J., Johnson, T., Alemagno, S. (eds) Research Methods in the Study of Substance Abuse. Springer, Cham. https://doi.org/10.1007/978-3-319-55980-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-55980-3_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-55978-0

  • Online ISBN: 978-3-319-55980-3

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics