Advertisement

Prevention Science

, Volume 16, Issue 7, pp 967–977 | Cite as

Research Designs for Intervention Research with Small Samples II: Stepped Wedge and Interrupted Time-Series Designs

  • Carlotta Ching Ting FokEmail author
  • David Henry
  • James Allen
Article

Abstract

The stepped wedge design (SWD) and the interrupted time-series design (ITSD) are two alternative research designs that maximize efficiency and statistical power with small samples when contrasted to the operating characteristics of conventional randomized controlled trials (RCT). This paper provides an overview and introduction to previous work with these designs and compares and contrasts them with the dynamic wait-list design (DWLD) and the regression point displacement design (RPDD), which were presented in a previous article (Wyman, Henry, Knoblauch, and Brown, Prevention Science. 2015) in this special section. The SWD and the DWLD are similar in that both are intervention implementation roll-out designs. We discuss similarities and differences between the SWD and DWLD in their historical origin and application, along with differences in the statistical modeling of each design. Next, we describe the main design characteristics of the ITSD, along with some of its strengths and limitations. We provide a critical comparative review of strengths and weaknesses in application of the ITSD, SWD, DWLD, and RPDD as small sample alternatives to application of the RCT, concluding with a discussion of the types of contextual factors that influence selection of an optimal research design by prevention researchers working with small samples.

Keywords

Research design Small samples Stepped wedge design Interrupted time-series design 

Notes

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Brown, C. A., & Lilford, R. J. (2006). The stepped wedge trial design: A systematic review. BMC Medical Research Methodology, 6, 1–9. doi: 10.1186/1471-2288-6-54.CrossRefGoogle Scholar
  2. Brown, C. H., Wyman, P. A., Guo, J., & Pena, J. (2006). Dynamic wait-listed designs for randomized trials: New designs for prevention of youth suicide. Clinical Trials, 3, 259–271. doi: 10.1191/1740774506cn152oa.CrossRefPubMedGoogle Scholar
  3. Brown, C. H., Wyman, P. A., Brinales, J. M., & Gibbons, R. D. (2007). The role of randomized trials in testing interventions for the prevention of youth suicide. International Review of Psychiatry, 19, 617–631. doi: 10.1080/09540260701797779.CrossRefPubMedGoogle Scholar
  4. Campbell, D. T., Stanley, J. C., & Gage, N. L. (1963). Experimental and quasi-experimental designs for research. Boston, MA: Houghton, Mifflin and Company.Google Scholar
  5. Centers for Disease Control and Prevention (2013). Antibiotic resistance threats in the United States, 2013. http://www.cdc.gov/features/antibioticresistancethreats/.
  6. Dumsha, J. Z., DiTomasso, R. A., Gomez, F. C., Melucci, N. J., & Stouch, B. C. (2011). Changes in self-reported drinking behaviors among US teenagers associated with the introduction of flavored malt beverages: An interrupted time series quasi-experiment. Addiction Research and Theory, 19, 199–212. doi: 10.3109/16066359.2010.500064.CrossRefGoogle Scholar
  7. Franson, P. (2002). Fast-growing malternatives threaten grape expectations. Wine Business Online. Retrieved from http:/ /www.winebusiness.com/SalesMarketing /Webarticle. cfm?AID = 64002&IssueId = 63975.
  8. Gerritsen, D. L., Smalbrugge, M., Teerenstra, S., Adang Leontjevas, E. M., Vernooij-Dassen, M. J., & Koopmans, R. T. C. M. (2011). Act in case of depression: The evaluation of a care program to improve the detection and treatment of depression in nursing homes. Study protocol. BMC Psychiatry, 11(91), 1–7. doi: 10.1186/1471-244X-11-91.Google Scholar
  9. Glass, G. V. (1997). Interrupted time-series quasi-experiments. In R. M. Jaeger (Ed.), Complementary methods for research in education (pp. 589–608). Washington D. C: American Educational Research Association.Google Scholar
  10. Grant, A. D., Charalambous, S., Fielding, K. L., Day, J. H., Corbett, E. L., Chaisson, R. E., & Churchyard, G. J. (2005). Effect of routine isoniazid preventative therapy on tuberculosis incidence among HIV-infected men in South Africa: a novel randomized incremental recruitment study. Journal of the American Medical Association, 22, 2719–2725.CrossRefGoogle Scholar
  11. Hayden, M.K., Lin, M. K. Lolans, K., Blom, D., Weiner, S., Lyles, R. Weinstein, R. A. (2014). Prevention of colonization and infection by Klebsiella Pneumoniae Carbapenemase-Producing Enterobacteriaceae in long term acute care hospitals. Manuscript submitted for publication.Google Scholar
  12. Hussey, M. A., & Hughes, J. P. (2007). Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials, 28, 182–191. Retrieved from http://faculty.washington.edu/peterg/Vaccine2006/articles/HusseyHughes.2007.pdf.
  13. Kaptchuk, J. (2001). The double-blind, randomized, placebo-controlled trial: Gold standard or golden calf? Journal of Clinical Epidemiology, 54, 541–549.CrossRefPubMedGoogle Scholar
  14. Keane, R. (2003). Malternative maximization. Adams Beverage Group. Retrieved from http://www.beveragenet.net/bd/2003/0307/0307mlt.asp.Google Scholar
  15. Levy, R. W., Rayner, C. R., Fairley, C. K., Kong, D. C. M., Mijch, A., Costello, K., & McArthur, C. (2004). Multidisciplinary HIV adherence intervention: A randomized study. AIDS Patient Care and STDs, 18, 728–735. doi: 10.1089/apc.2004.18.728.CrossRefPubMedGoogle Scholar
  16. Mdege, N. D., Man, M. S., Taylor Nee Brown, C. A., & Torgerson, D. J. (2011). Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. Journal of Clinical Epidemiology, 64, 936–948.CrossRefPubMedGoogle Scholar
  17. Pridemore, A. W., & Snowden, A. J. (2009). Reduction in suicide mortality following a new national alcohol policy in Slovenia: An interrupted time-series analysis. American Journal of Public Health, 99(920), 915–920.PubMedCentralCrossRefPubMedGoogle Scholar
  18. Pridemore, A. W. A., Trahan, A., & Chamlin, M. B. (2009). No evidence of suicide increase following terrorist attacks in the United States: An interrupted time-series analysis of September 11 and Oklahoma City. Suicide and Life Threatening Behavior, 39, 659–670. doi: 10.1521/suli.2009.39.6.659.CrossRefPubMedGoogle Scholar
  19. Stallings-Smith, S., Zeka, A., Goodman, P., Kabir, Z., & Clancy, L. (2013). Reductions in cardiovascular, cerebrovascular, and respiratory mortality following the National Irish Smoking Ban: Interrupted time-series analysis. PLOSOne, 8(4), 1-–7.CrossRefGoogle Scholar
  20. The Gambia Hepatitis Study Group. (1987). The Gambia hepatitis intervention study. Cancer Research, 47, 5782–5787.Google Scholar
  21. Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross Degnan, D. (2002). Segmented regression analysis of interrupted time series studies in medication use research. Journal of Clinical Pharmacy and Therapeutics, 27, 299–309.CrossRefPubMedGoogle Scholar
  22. Wyman, P. A., Brown, C. H., Inman, J., Cross, W., Schmeelk-Cone, K., Guo, J., & Pena, J. B. (2008). Randomized trial of a gatekeeper program for suicide prevention: 1-year impact on secondary school staff. Journal of Consulting and Clinical Psychology, 76(1), 104–115. doi: 10.1037/0022-006X.76.1.104.PubMedCentralCrossRefPubMedGoogle Scholar
  23. Wyman, P. A., Brown, C. H., LoMurray, M., Schmeelk-Cone, K., Petrova, M., Yu, Q., & Wang, W. (2010). An outcome evaluation of the Sources of Strength suicide prevention program delivered by adolescent peer leaders in high schools. American Journal of Public Health, 100(9), 1653–1661. doi: 10.2105/AJPH.2009.190025.PubMedCentralCrossRefPubMedGoogle Scholar
  24. Wyman, P. A., Henry, D., Knoblauch, S., Brown, C. H. (2015). Designs for testing group-based interventions with limited numbers of social units: The dynamic wait-listed and regression point displacement designs. Prevention Science. Google Scholar

Copyright information

© Society for Prevention Research 2015

Authors and Affiliations

  • Carlotta Ching Ting Fok
    • 1
    Email author
  • David Henry
    • 2
  • James Allen
    • 3
  1. 1.University of Alaska FairbanksFairbanksUSA
  2. 2.University of Illinois at ChicagoChicagoUSA
  3. 3.University of Minnesota Medical School, Duluth CampusDuluthUSA

Personalised recommendations