Abstract
Background: Although the optimization of behavioral interventions offers the potential of both public health and research benefits, currently there is no widely agreed-upon principled procedure for accomplishing this.Purpose: This article suggests a multiphase optimization strategy (MOST) for achieving the dual goals of program optimization and program evaluation in the behavioral intervention field.Methods: MOST consists of the following three phases: (a) screening, in which randomized experimentation closely guided by theory is used to assess an array of program and/or delivery components and select the components that merit further investigation; (b) refining, in which interactions among the identified set of components and their interrelationships with covariates are investigated in detail, again via randomized experiments, and optimal dosage levels and combinations of components are identified; and (c) confirming, in which the resulting optimized intervention is evaluated by means of a standard randomized intervention trial. To make the best use of available resources, MOST relies on design and analysis tools that help maximize efficiency, such as fractional factorials.Results: A slightly modified version of an actual application of MOST to develop a smoking cessation intervention is used to develop and present the ideas.Conclusions: MOST has the potential to husband program development resources while increasing our understanding of the individual program and delivery components that make up interventions. Considerations, challenges, open questions, and other potential benefits are discussed.
Similar content being viewed by others
References
Flay BR: Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs.Preventive Medicine. 1986,15:451–474.
Cook TD, Campbell DT:Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally, 1979.
Shadish WR, Cook TD, Campbell DT:Experimental and Quasi-Experimental Designs for Generalized Causal Inference. New York: Houghton Mifflin, 2002.
Box GEP, Hunter WG, Hunter JS:Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building. New York: Wiley, 1978.
Box GEP, Draper NR:Empirical Model-Building and Response Surfaces. New York: Wiley, 1987.
Onken LS, Blaine JD, Battjes, RJ: Behavioral therapy research: A conceptualization of a process. In Henggeler SW, Santos AB (eds),Innovative Approaches for Difficult-to-Treat Populations. Washington, DC: American Psychiatric Press, 1997, 477–485.
Greenwald P, Cullen JW: The scientific approach to cancer control.CA: A Cancer Journal for Clinicians. 1984,34:328–332.
UK Medical Research Council:A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: Medical Research Council, 2000. Retrieved February 2, 2004, from http://www.mrc.ac.uk/mrc_cpr.pdf
Sussman S, Dent CW, Burton D, Stacy AW, Flay BR:Developing School-Based Tobacco Use Prevention and Cessation Programs. Thousand Oaks, CA: Sage, 1995.
Vogt WP:Dictionary of Statistics and Methodology: A Nontechnical Guide for the Social Sciences. Newbury Park, CA: Sage, 1993.
Strecher VJ. Computer-tailored smoking cessation materials: A review and discussion.Patient Education and Counseling. 1999,36:107–117.
Myers RH, Montgomery DC:Response Surface Methodology. New York: Wiley, 1995.
Collins LM, Murphy SA, Bierman KA: A conceptual framework for adaptive preventive interventions.Prevention Science. 2004,5:181–192.
West SG, Aiken LS: Toward understanding individual effects in multicomponent prevention programs: Design and analysis strategies. In Bryant KJ, Windle M, West SG (eds),The Science of Prevention: Methodological Advances from Alcohol and Substance Use Research. Washington, DC: American Psychological Association, 1997, 167–209.
Kreuter M, Strecher V, Glassman B: One size does not fit all: The case for tailoring print materials.Annals of Behavioral Medicine. 1999,21:276–283.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work has been supported by National Institute on Drug Abuse Grants P50 DA10075 (Dr. Collins and Dr. Murphy) and K02 DA15674 (Dr. Murphy), National Cancer Institute Grant P50 CA 101451 (Dr. Strecher, Dr. Murphy, and Dr. Nair), and National Science Foundation Grant DMS 0204247 (Dr. Nair). This article has benefited from discussion at the 2003 Snowbird Conference and the 2003 Society for Prevention Research Conference, particularly the comments of Gilbert Botvin, Richard Clayton, Delbert Eliot, Brian Flay, David Hawkins, Elizabeth Robertson, and Richard Spoth. It has also benefited from the comments of John Graham and many other colleagues at Penn State’s Methodology Center and Prevention Center.
About this article
Cite this article
Collins, L.M., Murphy, S.A., Nair, V.N. et al. A strategy for optimizing and evaluating behavioral interventions. ann. behav. med. 30, 65–73 (2005). https://doi.org/10.1207/s15324796abm3001_8
Issue Date:
DOI: https://doi.org/10.1207/s15324796abm3001_8