Skip to main content

Advertisement

Log in

Designs for Testing Group-Based Interventions with Limited Numbers of Social Units: The Dynamic Wait-Listed and Regression Point Displacement Designs

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

The dynamic wait-listed design (DWLD) and regression point displacement design (RPDD) address several challenges in evaluating group-based interventions when there is a limited number of groups. Both DWLD and RPDD utilize efficiencies that increase statistical power and can enhance balance between community needs and research priorities. The DWLD blocks on more time units than traditional wait-listed designs, thereby increasing the proportion of a study period during which intervention and control conditions can be compared, and can also improve logistics of implementing intervention across multiple sites and strengthen fidelity. We discuss DWLDs in the larger context of roll-out randomized designs and compare it with its cousin the Stepped Wedge design. The RPDD uses archival data on the population of settings from which intervention unit(s) are selected to create expected posttest scores for units receiving intervention, to which actual posttest scores are compared. High pretest–posttest correlations give the RPDD statistical power for assessing intervention impact even when one or a few settings receive intervention. RPDD works best when archival data are available over a number of years prior to and following intervention. If intervention units were not randomly selected, propensity scores can be used to control for non-random selection factors. Examples are provided of the DWLD and RPDD used to evaluate, respectively, suicide prevention training (QPR) in 32 schools and a violence prevention program (CeaseFire) in two Chicago police districts over a 10-year period. How DWLD and RPDD address common threats to internal and external validity, as well as their limitations, are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Baer, D. M., Wolf, M. M., & Risely, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  • Biglan, A., Ary, D., & Wagenaar, A. C. (2000). The value of interrupted time-series experiments for community intervention research. Prevention Science, 1, 31–49.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  • Brown, C. H., & Liao, J. (1999). Principles for designing randomized preventive trials in mental health: an emerging developmental epidemiology paradigm. American Journal of Community Psychology, 27, 673–710.

    Article  CAS  PubMed  Google Scholar 

  • Brown, C. A., & Lilford, R. J. (2006). The stepped wedge design: A systematic review. BMC Medical Research Methodology, 6, 54. doi:10.1186/1471-2288-6-54.

    Article  PubMed Central  PubMed  Google Scholar 

  • Brown, C. H., Wyman, P. A., Guo, J., & Pena, J. (2006). Dynamic wait-listed designs for randomized trials: New designs for prevention of youth suicide. [Research Support, N.I.H., Extramural Research Support, U.S. Gov’t, P.H.S.]. Clinical Trials, 3, 259–271.

    Article  PubMed  Google Scholar 

  • Brown, C. H., Wyman, P. A., Brinales, J. M., & Gibbons, R. D. (2007). The role of randomized trials in testing interventions for the prevention of youth suicide. International Review of Psychiatry, 19, 617–631. doi:10.1080/0954026070179777.

    Article  PubMed  Google Scholar 

  • Brown, C. H., Ten Have, T. R., Jo, B., Dagne, G., Wyman, P. A., Muthén, B. O., & Gibbons, R. (2009). Adaptive designs in public health. Annual Review Public Health, 30, 1–25.

    Article  Google Scholar 

  • Brown, C.H., Mason, W.A., Brown, E.C. (2014). Translating the Intervention Approach into an Appropriate Research Design—The Next Generation Designs for Effectiveness and Implementation Research. In: Z Sloboda and H Petras (Eds.), Advances in Prevention Science: Defining Prevention Science. Springer Publishing.

  • Brown, C.H., Chamberlain, P., Saldana, L., Padgett, C., Wang W., Cruden G. (2014). Evaluation of two implementation strategies in fifty-one child county public service systems in two states: Results of a cluster randomized head-to-head implementation trial.

  • Campbell, D. T., Stanley, J. C., & Gage, N. L. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton, Mifflin and Company.

    Google Scholar 

  • Carr, J. E. (2005). Recommendations for reporting multiple-baseline designs across participants. Behavioral Interventions, 20, 219–224.

    Article  Google Scholar 

  • Catalano, R. F., Arthur, M. W., Hawkins, J. D., Berglund, L., & Olson, J. J. (1998). Comprehensive community- and school-based interventions to prevent antisocial behavior. In R. Loeber & D. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks: Sage.

    Google Scholar 

  • Chamberlain, P., Saldana, L., Brown, C. H., & Leve, L. (2010). Implementation of multidimensional treatment foster care in California: A randomized control trial of an evidence-based practice. In M. Roberts-DeGennaro & S. Fogel (Eds.), Using evidence to inform practice for community and organizational change (pp. 218–234). Chicago: Lyceum Books.

    Google Scholar 

  • Dymnicki, A., Henry, D., Quintana, E., Wisnieski, E., & Kane, C. (2013). Outreach worker perceptions of positive and negative critical incidents: Characteristics associated with successful and unsuccessful violence interruption. Journal of Community Psychology, 41, 200–217. doi:10.1002/jcop.21523.

    Article  Google Scholar 

  • Gibbons, R. D., Hur, K., Bhaumik, D. K., & Bell, C. C. (2007). Profiling of county-level foster care placements using random-effects Poisson regression models. Health Services and Outcomes Research Methodology, 7, 97–108.

    Article  Google Scholar 

  • Henry, D., Allen, J., Fok, C. C., Rasmus, S., Charles, B., & People Awakening Team. (2012). Patterns of protective factors in an intervention for the prevention of suicide and alcohol abuse with Yup’ik Alaska native youth (Early Online), 1–7. The American Journal of Drug and Alcohol Abuse. doi:10.3109/00952990.2012.704460.

    Google Scholar 

  • Hussey, M. A., & Hughes, J. P. (2007). Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials, 28, 182–191.

    Article  PubMed  Google Scholar 

  • Hutton, J. L. (2001). Are distinctive ethical principles required for cluster randomized controlled trials? Statistics in Medicine, 20, 473–488.

    Article  CAS  PubMed  Google Scholar 

  • Kegeles, S. M., Hays, R. B., & Coates, T. J. (1996). The Mpowerment Project: A community level HIV prevention intervention for young gay men. American Journal of Public Health, 86, 1129–1136.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  • Linden, A., Trochim, W. M. K., & Adams, J. L. (2006). Evaluating program effectiveness using the regression point displacement design. Evaluation and the Health Professions, 29, 407–423.

    Article  PubMed  Google Scholar 

  • Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004). Design and analysis of group-randomized trials: A review of recent methodological developments. American Journal of Public Health, 94, 423.

    Article  PubMed Central  PubMed  Google Scholar 

  • Quinby, R. K., Hanson, K., Brooke-Weiss, B., Arthur, M. W., Hawkins, J. D., & Fagan, A. A. (2008). Installing the communities that care prevention system: implementation progress and fidelity in a randomized controlled trial. Journal of Community Psychology, 36, 313–332. doi:10.1002/jcop.20194.

    Article  Google Scholar 

  • Quinnett, P. (1995). QPR: Ask a question, save a life. Spokane: QPR Institute and Suicide Awareness/Voices of Education.

    Google Scholar 

  • Rosenbaum, P. A., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.

    Article  Google Scholar 

  • Skogan, W. G., Hartnett, S. M., Bump, N., & Dubois, J. (2009). Evaluation of CeaseFire-Chicago. Evanston: Northwestern University.

    Google Scholar 

  • Trochim, W. M. K., & Campbell, D. T. (1996). The regression point displacement design for evaluating community-based pilot programs and demonstration projects. Retrieved from http://www.socialresearchmethods.net/research/RPD/RPD.pdf

  • Wyman, P. A., Brown, C. H., Inman, J., Cross, W., Schmeelk-Cone, K., Guo, J., & Pena, J. B. (2008). Randomized trial of a gatekeeper program for suicide prevention: 1-year impact on secondary school staff. Journal of Consulting and Clinical Psychology, 76, 104–115. doi:10.1037/0022-006X.76.1.104.

    Article  PubMed Central  PubMed  Google Scholar 

  • Wyman, P. A., Brown, C. H., LoMurray, M., Schmeelk-Cone, K., Petrova, M., Yu, Q., & Wang, W. (2010). An outcome evaluation of the Sources of Strength suicide prevention program delivered by adolescent peer leaders in high schools. American Journal of Public Health, 100, 1653–1661. doi:10.2105/AJPH.2009.190025.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

We thank the National Institute of Mental Health for support under grants R34MH071189 (P. Wyman, PI) and RO1MH091452 (P. Wyman, PI) and the National Institute on Drug Abuse (NIDA) under grants P30 DA027828 (C. H. Brown, PI) and R13040610 (C. T. Fok, PI).

Conflict of Interest

The authors declare that they have no conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter A. Wyman.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wyman, P.A., Henry, D., Knoblauch, S. et al. Designs for Testing Group-Based Interventions with Limited Numbers of Social Units: The Dynamic Wait-Listed and Regression Point Displacement Designs. Prev Sci 16, 956–966 (2015). https://doi.org/10.1007/s11121-014-0535-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11121-014-0535-6

Keywords

Navigation