Predicting Program Start-Up Using the Stages of Implementation Measure

  • Lisa Saldana
  • Patricia Chamberlain
  • Wei Wang
  • C. Hendricks Brown
Original Paper

Abstract

Recent efforts to better understand the process of implementation have been hampered by a lack of tools available to define and measure implementation progress. The Stages of Implementation Completion (SIC) was developed as part of an implementation trial of MTFC in 53 sites, and identifies the duration of time spent on implementation activities and the proportion of activities completed. This article examines the ability of the first three stages of the SIC (Engagement, Consideration of Feasibility, Readiness Planning) to predict successful program start-up. Results suggest that completing SIC stages completely, yet relatively quickly, predicts the likelihood of successful implementation.

Keywords

Implementation progress Stages Predictive validity MTFC 

Notes

Acknowledgments

This study and manuscript preparation was funded by NIMH R01MH076158; NIDA K23DA021603 and P30DA023920. The authors would like to thank all of the participating counties for their time and contribution to this study. Thank you to Michelle Baumann for her editorial assistance.

Disclosure

Chamberlain is a partner in Treatment Foster Care Consultants Inc., a company that provides consultation to systems and agencies wishing to implement MTFC.

References

  1. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2010). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.Google Scholar
  2. Blasé, K. A., Fixsen, D. L., Duda, M. A., Metz, A. J., Naoom, S. F., & Van Dyke, M. K. (2010). Implementation challenges and successes: Some big ideas. San Antonio: Blueprints for Violence Prevention Conference.Google Scholar
  3. Chamberlain, P. (2003). The Oregon multidimensional treatment foster care model: Features, outcomes, and progress in dissemination. In: S. Schoenwald & S. Henggeler (Eds.) Moving evidence-based treatments from the laboratory into clinical practice. Cognitive and Behavioral Practice, 10, 303–312.Google Scholar
  4. Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress: The stages of implementation completion (SIC). (Submitted for publication).Google Scholar
  5. Chamberlain, P., Leve, L. D., & DeGarmo, D. S. (2007). Multidimensional treatment foster care for girls in the juvenile justice system: 2-Year follow-up of a randomized clinical trial. Journal of Consulting and Clinical Psychology, 75, 187–193. doi: 10.1037/0022-006X.75.1.187.PubMedCrossRefGoogle Scholar
  6. Chamberlain, P., & Mihalic, S. F. (1998). Multidimensional treatment foster care. In D. S. Elliott (Ed.), Book eight: Blueprints for violence prevention. Boulder: Institute of Behavioral Science, University of Colorado at Boulder.Google Scholar
  7. Chamberlain, P., & Reid, J. (1998). Comparison of two community alternatives to incarceration for chronic juvenile offenders. Journal of Consulting and Clinical Psychology, 6, 624–633. doi: 10.1037/0022-006X.66.4.624.CrossRefGoogle Scholar
  8. Coalition for Evidence Based Policy (2009). http://evidencebasedprograms.org/wordpress/. Accessed 12 October 2009.
  9. Cox, D. R. (1972). Regression models and life tables (with discussion). Journal of the Royal Statistical Society, 34, 187–220.Google Scholar
  10. Fixsen, D., & Blase, K. (2009). Implementation: The missing link between research and practice. NIRN implementation brief, 1. Chapel Hill: The University of North Carolina.Google Scholar
  11. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.Google Scholar
  12. Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health, 89, 1322–1327.PubMedCrossRefGoogle Scholar
  13. Horowitz, S. M. & Landsverk, J. (2010). Methodological issues in child welfare and children’s mental health implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 1–3.Google Scholar
  14. Kaufman, L., & Rousseeuw, P. J. (1990). Finding groups in data: An introduction to cluster analysis. New York: Wiley.CrossRefGoogle Scholar
  15. Leve, L. D., & Chamberlain, P. (2007). A randomized evaluation of multidimensional treatment foster care: Effects on school attendance and homework completion in juvenile justice girls. Research on Social Work Practice, 17, 657–663. doi: 10.1177/1049731506293971.PubMedCrossRefGoogle Scholar
  16. Mihalic, S., Fagan, A., Irwin, K., Ballard, D., & Elliott, D. (2004). Blueprints for violence prevention. Washington, DC: US Department of Justice, Office of Justice Programs, OJJDP.Google Scholar
  17. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34.PubMedCrossRefGoogle Scholar
  18. Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2010). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Lisa Saldana
    • 1
  • Patricia Chamberlain
    • 1
  • Wei Wang
    • 2
  • C. Hendricks Brown
    • 3
  1. 1.Center for Research TO PracticeEugeneUSA
  2. 2.Department of Epidemiology and BiostatisticsCollege of Public Health, University of South FloridaTampaUSA
  3. 3.Department of Epidemiology and Public HealthCenter for Family Studies, Miller School of Medicine, University of MiamiCoral GablesUSA

Personalised recommendations