Skip to main content
Log in

A strategy for optimizing and evaluating behavioral interventions

  • Published:
Annals of Behavioral Medicine

Abstract

Background: Although the optimization of behavioral interventions offers the potential of both public health and research benefits, currently there is no widely agreed-upon principled procedure for accomplishing this.Purpose: This article suggests a multiphase optimization strategy (MOST) for achieving the dual goals of program optimization and program evaluation in the behavioral intervention field.Methods: MOST consists of the following three phases: (a) screening, in which randomized experimentation closely guided by theory is used to assess an array of program and/or delivery components and select the components that merit further investigation; (b) refining, in which interactions among the identified set of components and their interrelationships with covariates are investigated in detail, again via randomized experiments, and optimal dosage levels and combinations of components are identified; and (c) confirming, in which the resulting optimized intervention is evaluated by means of a standard randomized intervention trial. To make the best use of available resources, MOST relies on design and analysis tools that help maximize efficiency, such as fractional factorials.Results: A slightly modified version of an actual application of MOST to develop a smoking cessation intervention is used to develop and present the ideas.Conclusions: MOST has the potential to husband program development resources while increasing our understanding of the individual program and delivery components that make up interventions. Considerations, challenges, open questions, and other potential benefits are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Flay BR: Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs.Preventive Medicine. 1986,15:451–474.

    Article  PubMed  CAS  Google Scholar 

  2. Cook TD, Campbell DT:Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally, 1979.

    Google Scholar 

  3. Shadish WR, Cook TD, Campbell DT:Experimental and Quasi-Experimental Designs for Generalized Causal Inference. New York: Houghton Mifflin, 2002.

    Google Scholar 

  4. Box GEP, Hunter WG, Hunter JS:Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building. New York: Wiley, 1978.

    Google Scholar 

  5. Box GEP, Draper NR:Empirical Model-Building and Response Surfaces. New York: Wiley, 1987.

    Google Scholar 

  6. Onken LS, Blaine JD, Battjes, RJ: Behavioral therapy research: A conceptualization of a process. In Henggeler SW, Santos AB (eds),Innovative Approaches for Difficult-to-Treat Populations. Washington, DC: American Psychiatric Press, 1997, 477–485.

    Google Scholar 

  7. Greenwald P, Cullen JW: The scientific approach to cancer control.CA: A Cancer Journal for Clinicians. 1984,34:328–332.

    CAS  Google Scholar 

  8. UK Medical Research Council:A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: Medical Research Council, 2000. Retrieved February 2, 2004, from http://www.mrc.ac.uk/mrc_cpr.pdf

    Google Scholar 

  9. Sussman S, Dent CW, Burton D, Stacy AW, Flay BR:Developing School-Based Tobacco Use Prevention and Cessation Programs. Thousand Oaks, CA: Sage, 1995.

    Google Scholar 

  10. Vogt WP:Dictionary of Statistics and Methodology: A Nontechnical Guide for the Social Sciences. Newbury Park, CA: Sage, 1993.

    Google Scholar 

  11. Strecher VJ. Computer-tailored smoking cessation materials: A review and discussion.Patient Education and Counseling. 1999,36:107–117.

    Article  PubMed  CAS  Google Scholar 

  12. Myers RH, Montgomery DC:Response Surface Methodology. New York: Wiley, 1995.

    Google Scholar 

  13. Collins LM, Murphy SA, Bierman KA: A conceptual framework for adaptive preventive interventions.Prevention Science. 2004,5:181–192.

    Article  Google Scholar 

  14. West SG, Aiken LS: Toward understanding individual effects in multicomponent prevention programs: Design and analysis strategies. In Bryant KJ, Windle M, West SG (eds),The Science of Prevention: Methodological Advances from Alcohol and Substance Use Research. Washington, DC: American Psychological Association, 1997, 167–209.

    Chapter  Google Scholar 

  15. Kreuter M, Strecher V, Glassman B: One size does not fit all: The case for tailoring print materials.Annals of Behavioral Medicine. 1999,21:276–283.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Linda M. Collins Ph.D..

Additional information

This work has been supported by National Institute on Drug Abuse Grants P50 DA10075 (Dr. Collins and Dr. Murphy) and K02 DA15674 (Dr. Murphy), National Cancer Institute Grant P50 CA 101451 (Dr. Strecher, Dr. Murphy, and Dr. Nair), and National Science Foundation Grant DMS 0204247 (Dr. Nair). This article has benefited from discussion at the 2003 Snowbird Conference and the 2003 Society for Prevention Research Conference, particularly the comments of Gilbert Botvin, Richard Clayton, Delbert Eliot, Brian Flay, David Hawkins, Elizabeth Robertson, and Richard Spoth. It has also benefited from the comments of John Graham and many other colleagues at Penn State’s Methodology Center and Prevention Center.

About this article

Cite this article

Collins, L.M., Murphy, S.A., Nair, V.N. et al. A strategy for optimizing and evaluating behavioral interventions. ann. behav. med. 30, 65–73 (2005). https://doi.org/10.1207/s15324796abm3001_8

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1207/s15324796abm3001_8

Keywords

Navigation