Abstract
The degree to which evidence-based program outcomes are affected by modifications is a significant concern in the implementation of interventions. The ongoing national implementation of an evidence-based HIV prevention program targeting grade 6 students in The Bahamas [Focus on Youth in The Caribbean (FOYC)] offers an opportunity to explore factors associated with teachers’ modification of FOYC lessons and to examine the impact of types and degrees of modifications on student outcomes. Data were collected in 2012 from 155 teachers and 3646 students in 77 government elementary schools. Results indicate that teachers taught 16 of 30 core activities, 24.5 of 46 total activities and 4.7 of 8 sessions. Over one-half of the teachers made modifications to FOYC core activities; one-fourth of the teachers modified 25 % or more core activities that they taught (heavily modified FOYC). Omitting core activities was the most common content modification, followed by lengthening FOYC lessons with reading, writing assignments or role-play games, and shortening core activities or adding educational videos. Mixed-effects modeling revealed that omitting core activities had negative impacts on all four student outcomes. Shortening core activities and adding videos into lessons had negative impacts on HIV/AIDS knowledge and/or intention to use condom protection. Heavy modifications (>1/4 core activities) were associated with diminished program effectiveness. Heavy modifications and omitting or shortening core activities were negatively related to teachers’ level of implementation. We conclude that poorer student outcomes were associated with heavy modifications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K. K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275.
Chen, X., Stanton, B., Gomez, P., Lunn, S., Deveaux, L., Brathwaite, N., et al. (2010). Effects on condom use of an HIV prevention programme 36 months postintervention: A cluster randomized controlled trial among Bahamian youth. International Journal of STD & AIDS, 21, 622–630.
Deveaux, L., Stanton, B., Lunn, S., Cottrell, L., Yu, S., Brathwaite, N., et al. (2007). Reduction in human immunodeficiency virus risk among youth in developing countries. Archives of Pediatrics & Adolescent Medicine, 161, 1130–1139.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.
Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.
Fasula, A. M., Fogel, C. I., Gelaude, D., Carry, M., Gaiter, J., & Parker, S. (2013). Project power: Adapting an evidence-based HIV/STI prevention intervention for incarcerated women. AIDS Education and Prevention, 25, 203–215.
Feldman, M. B., Silapaswan, A., Schaefer, N., & Schermele, D. (2014). Is there life after DEBI? Examining health behavior maintenance in the diffusion of effective behavioral interventions initiative. American Journal of Community Psychology, 53, 286–313.
Galbraith, J. S., Stanton, B., Boekeloo, B., King, W., Desmond, S., Howard, D., et al. (2009). Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: Lessons learned from the focus on kids diffusion case study. Health Education & Behavior, 36, 532–549.
Gong, J., Stanton, B., Lunn, S., Deveaux, L., Li, X., Marshall, S., et al. (2009). Effects through 24 months of an HIV/AIDS prevention intervention program based on protection motivation theory among preadolescents in the Bahamas. Pediatrics, 123, e917–928.
Hill, L. G., Maucione, K., & Hood, B. K. (2007). A focused approach to assessing program fidelity. Prevention Science, 8, 25–34.
Kalichman, S. C., Kelly, J. A., Hunter, T. L., Murphy, D. A., & Tyler, R. (1993). Culturally tailored HIV-AIDS risk-reduction messages targeted to African-American urban women: Impact on risk sensitization and risk reduction. Journal of Consulting and Clinical Psychology, 61, 291–295.
Kennedy, M. G., Mizuno, Y., Hoffman, R., Baume, C., & Strand, J. (2000). The effect of tailoring a model HIV prevention program for local adolescent target audiences. AIDS Education and Prevention, 12, 225–238.
Kumpfer, K. L., Alvarado, R., Smith, P., & Bellamy, N. (2002). Cultural sensitivity and adaptation in family-based prevention interventions. Prevention Science, 3, 241–246.
Levitt, J. T., Malta, L. S., Martin, A., Davis, L., & Cloitre, M. (2007). The flexible application of a manualized treatment for PTSD symptoms and functional impairment related to the 9/11 world trade center attack. Behaviour Research and Therapy, 45, 1419–1433.
Lundgren, L., Amodeo, M., Cohen, A., Chassler, D., & Horowitz, A. (2011). Modifications of evidence-based practices in community-based addiction treatment organizations: A qualitative research study. Addictive Behaviors, 36, 630–635.
Lyles, C. M., Kay, L. S., Crepaz, N., Herbst, J. H., Passin, W. F., Kim, A. S., et al. (2007). Best-evidence interventions: Findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000-2004. American Journal of Public Health, 97, 133–143.
Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340.
Rebchook, G. M., Kegeles, S. M., Huebner, D., & Research Team, T. R. I. P. (2006). Translating research into practice: The dissemination and initial implementation of an evidence-based HIV prevention program. AIDS Education and Prevention, 18, 119–136.
Renju, J. R., Andrew, B., Medard, L., Kishamawe, C., Kimaryo, M., Changalucha, J., et al. (2011). Scaling up adolescent sexual and reproductive health interventions through existing government systems? A detailed process evaluation of a school-based intervention in Mwanza region in the northwest of Tanzania. Journal of Adolescent Health, 48, 79–86.
Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., et al. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30, 375–391.
Ringwalt, C., Ennett, S. T., Vincus, A., & Simons-Rudolph, A. (2004). Students’ special needs and problems as reasons for the adaptation of substance abuse prevention curricula in the nation’s middle schools. Prevention Science, 5, 197–206.
Solomon, J., Card, J. J., & Malow, R. M. (2006). Adapting efficacious interventions: Advancing translational research in HIV prevention. Evaluation & the Health Professions, 29, 162–194.
Stanton, B., Guo, J., Cottrell, L., Galbraith, J., Li, X., Gibson, C., et al. (2005). The complex business of adapting effective interventions to new populations: An urban to rural transfer. Journal of Adolescent Health, 37, 163.
Stanton, B., Deveaux, L., Lunn, S., Yu, S., Brathwaite, N., Li, X., et al. (2009). Condom-use skills checklist: A proxy for assessing condom-use knowledge and skills when direct observation is not possible. Journal of Health, Population, and Nutrition, 27, 406–413.
Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 17. doi:10.1186/1748-5908-7-17.
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8, 65. doi:10.1186/1748-5908-8-65.
Wang, B., Deveaux, L., Knowles, V., Koci, V., Rolle, G., Lunn, S., et al. (2015a). Fidelity of implementation of an evidence-based HIV prevention program among Bahamian sixth grade students. Prevention Science, 16, 110–121.
Wang, B., Stanton, B., Deveaux, L., Poitier, M., Lunn, S., Koci, V., et al. (2015b). Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program. Implementation Science, 10, 44. doi:10.1186/s13012-015-0236-y.
Compliance with Ethical Standards
ᅟ
Funding
This study was funded by the National Institute of Child Health and Human Development (R01HD064350).
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all participants included in the study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, B., Stanton, B., Lunn, S. et al. The Impact of Teachers’ Modifications of an Evidenced-Based HIV Prevention Intervention on Program Outcomes. Prev Sci 17, 122–133 (2016). https://doi.org/10.1007/s11121-015-0592-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-015-0592-5