A Process Evaluation of the WV Smoking Cessation and Reduction in Pregnancy Treatment (SCRIPT) Dissemination Initiative: Assessing the Fidelity and Impact of Delivery for State-Wide, Home-Based Healthy Start Services
- 257 Downloads
Objectives Process evaluation data are essential to document the fidelity of program implementation by clinical staff and confirm patient behavior change. This report presents a process evaluation model applied to the Smoking Cessation and Reduction in Pregnancy Treatment Dissemination Initiative for the statewide, home-based West Virginia Right From The Start Project. Methods Trained RFTS Designated Care Coordinators, nurses and social workers, of 50+ primary care agencies in all 55 counties, delivered SCRIPT to Medicaid patients who smoked. Results The process evaluation defined the level of DCC delivery of seven core SCRIPT procedures to produce a Program Implementation Index: a summary performance metric. A SCRIPT PII > 0.80 was established as the RFTS adoption standard. The PII increased from 0.53 in 2004 to 0.65 in 2006–2007 to 0.77 in 2009–2010. Although the PII > 0.80 was not achieved, exposure rates were increased for all seven SCRIPT procedures. Agency and DCC turnover, a transient patient population, and recession of 2008–2010 were barriers to achieving the adoption metric and implementation of an experimental design. A quasi-experimental Stratified, Matched Comparison (C) Group Design was selected to evaluate behavioral impact differences between a RFTS-Comparison (C) Group from 2006 to 2007 and the RFTS-SCRIPT E Group from 2009 to 2010. Impact analyses of the DCC delivery of the SCRIPT Program with higher fidelity documented a statistically significant increase in the cessation rate from 4.6 % and significant reduction rate from 6.9 % for the (C) Group in 2006–2007 to 13.9 % and 11.22 % respectively for the E Group in 2009–2010. Conclusion The PEM can assist statewide, home-based prenatal care programs to improve the quality of delivery and evaluate counseling programs.
KeywordsProcess evaluation Smoking cessation program Dissemination Healthy start Home-based Care Prenatal care services
The Institutional Review Boards of the George Washington University and the West Virginia Bureau of Public Health approved this project. The leadership of the SCRIPT Dissemination Initiative recognizes the contributions of the following colleagues who assisted in planning and implementation: Sean Cleary, Kalpana Ramiah, Anne Williams, Pat Moss, and Jackie Newson (BPH). We would also like to recognize members of the Dissemination Committee for their contributions to the success of this project: Brenda Johnson, Dee Meadows, Beverly Kitchen, Sandra Ellard, Mary Christian, Joan Dayoub, Charlita Atha, Patsy Parker, Lori Meadows, Suellen Friend, Paula Darby, Bobbie Paris, Lenaa Ryan and Janeen Masker. A special thanks to Regina Grollman Windsor and Dr. Myra Crawford.
This work was supported by The National Cancer Institute RO1 CA 124429-01-A1 (2007-12).
Compliance with Ethical Standards
Conflict of interest
There are no competing interests for any Author.
- Cook, T., & Campbell, D. (1979). Quasi-experimentation: Design and analysis for field settings. Boston, MA: Houghton Mifflin.Google Scholar
- Fiore, M., Bailey, W., & Cohen, S. et al. (2000). Treating tobacco use and dependence: A clinical practice guideline. Rockville, MD: U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality. AHRQ publication No. 00-0032.Google Scholar
- Fiore, M., Jaen, C., Baker, T., et al. (2008). Treating tobacco use and dependence: 2008 Update. Rockville, MD: US Department of Health and Human Services, AHRQ.Google Scholar
- Goldenberg, R., Klerman, L., Windsor, R., & Whiteside Jr. H. (2000). Smoking in pregnancy: Final thoughts. Tobacco Control, 9(Suppl III), 85–86.Google Scholar
- Institute of Medicine (IOM). (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.Google Scholar
- Kharrazi, M., Delorenze, G., Kaufman, F., et al. (2006). Environmental tobacco smoke and pregnancy outcomes, Epidemiology, 15, 6, November, pp. 660–670.Google Scholar
- Li, C., Windsor, R., Lowe, J., & Goldenberg, R. (1992). Evaluation of the impact of dissemination of smoking cessation methods on the low birthweight rate and on health care costs: Achieving year 2000 objectives for the nation. American Journal of Preventive Medicine, 8(3), 171–177.PubMedGoogle Scholar
- Rogers, E. (2003). Diffusion of Innovation, 5th Ed. New York, NY.Google Scholar
- Tong, V., Jones, J., Dietz, P., D’Angelo, D., & Bombard, J. (2009). Centers for Disease Control and Prevention (CDC). Trends in smoking before, during, and after pregnancy–pregnancy risk assessment monitoring system (PRAMS), united states, 31 sites, 2000–2005. MMWR Surveillance Summary, 58(4), 1–29.Google Scholar
- Wedeles, J. (2014). DrPH Dissertation, Predictors of program participation and behavior change among pregnant women in the West Virginia-Smoking Cessation and Reduction In Pregnancy Treatment (SCRIPT) Dissemination Initiative, George Washington University, School Public Health and Health Services, Committee Chair: Dr. Richard Windsor.Google Scholar
- West Virginia Birth Score Office. (2008). Medicaid mothers who smoke during pregnancy, WV residents, CY 2006. Charleston, WV: West Virginia Department of Health and Human Resources, Office of Maternal, Child and Family Health.Google Scholar
- Windsor R. (2005). Commit to quit smoking during and after pregnancy, 2nd ed. [DVD]. Washington, DC: Society for Public Health Education.Google Scholar
- Windsor R. (2005). A pregnant woman’s guide to quit smoking, 5th edn. Washington, DC: Society for Public Health Education.Google Scholar
- Windsor, R. (2008). SCRIPT counseling guidelines. Washington, DC: George Washington University.Google Scholar
- Windsor, R. (2011). Behavioral treatment methods for pregnant smokers: The evidence-base for prenatal care programs and professional practice. In A. Handler, J. Kennelly, & N. Peacock (Eds.), Reducing racial/ethnic disparities in reproductive and perinatal outcomes: The evidence from population-based interventions (pp. 239–263). NY: Springer.CrossRefGoogle Scholar
- Windsor, R., Clark, J., Cleary, S., et al. (2014). Effectiveness of the smoking cessation and reduction in pregnancy treatment (SCRIPT) dissemination project: A science to prenatal care practice partnership. Maternal and Child Health J., 18(1), 180–190. doi: 10.1007/s10995-013-1252-7.CrossRefGoogle Scholar
- Windsor, R., Cleary, S., Ramiah, K., Clark, J., Abroms, L., & Davis, A. (2013). The smoking cessation and reduction in pregnancy treatment (SCRIPT) adoption scale: Evaluating the diffusion of a tobacco treatment innovation to a statewide prenatal care program and providers. Journal of Health Communication, 18(10), 1201–1220. doi: 10.1080/10810730.2013.778358.CrossRefPubMedGoogle Scholar
- Windsor, R., Woodby, L., Miller, T., et al. (2000b). Effectiveness of agency for health care policy and research clinical practice guideline and patient education methods for pregnant smokers in medicaid maternity care. American Journal of Obstetrics and Gynecology, 182(1 Pt 1), 68–75.CrossRefPubMedGoogle Scholar
- WV Department of Health and Human Resources. (2007). Reports on the Blueprint to Improve West Virginia perinatal health: Final report. Charleston, WV: Community Voices, Inc.Google Scholar
- The Affordable Care Act. (2014). US Department of Health and Human Services website. http://www.hhs.gov/healthcare/rights/law/idex.html. Accessed Oct 15, 2014.