ABSTRACT
The economic downturn of 2007 created significant fiscal losses for public and private agencies conducting behavioral prevention. Such macro-economic changes may influence program implementation and sustainability. We examined how public and private agencies conducting RESPECT, a brief HIV/STI (sexually transmitted infection) counseling and testing intervention, adapted to fiscal loss and how these adaptations impacted program fidelity. We collected qualitative and quantitative data in a national sample of 15 agencies experiencing fiscal loss. Using qualitative analyses, we examined how program fidelity varied with different types of adaptations. Agencies reported three levels of adaptation: agency-level, program-level, and direct fiscal remedies. Private agencies tended to use direct fiscal remedies, which were associated with higher fidelity. Some agency-level adaptations contributed to reductions in procedural fit, leading to negative staff morale and decreased confidence in program effectiveness, which in turn, contributed to poor fidelity. Findings describe a “work stress pathway” that links program fiscal losses to poor staff morale and low program fidelity.
Similar content being viewed by others
References
Office of National AIDS Policy. National HIV/AIDS Strategy: update of 2011–2012 federal efforts to implement the National HIV/AIDS Strategy. Washington D.C.: White House Office of National AIDS Policy; 2012.
Morin SF, Yamey G, Rutherford GW. HIV pre-exposure prophylaxis. BMJ. 2012;345.
Kippax S, Stephenson N. Beyond the distinction between biomedical and social dimensions of HIV prevention through the lens of a social public health. Am J Public Health. 2012; 102(5): 789-799.
Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998; 18(1): 23-45.
Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Eval Pract. 2003; 24(3): 315-340.
Collins C, Harshbarger C, Sawyer R, Hamdallah M. The diffusion of effective behavioral interventions project: development, implementation, and lessons learned. AIDS Educ Prev. 2006; 18(4 Suppl A): 5-20.
Rhodes F, Stein J, Fishbein M, Goldstein R, Rotheram-Borus M. Using theory to understand how interventions work: Project RESPECT, condom use, and the integrative model. AIDS Behav. 2007; 11(3): 393-407.
Kamb ML, Fishbein M, Douglas JM Jr, et al. Efficacy of risk-reduction counseling to prevent human immunodeficiency virus and sexually transmitted diseases: a randomized controlled trial. JAMA. 1998; 280(13): 1161-1167.
Metcalf CA, Douglas JM Jr, Malotte CK, et al. Relative efficacy of prevention counseling with rapid and standard HIV testing: a randomized, controlled trial (RESPECT-2). Sex Transm Dis. 2005; 32(2): 130-138.
National Association of County & City Health Officials. NACCHO Survey of Local Health Departments’ Budget Cuts and Workforce Reductions. 2009, January. http://www.naccho.org/advocacy/upload/JobLossProgramCuts_ResearchBrief_final.pdf. Accessed Verified 1/31/13.
National Association of County & City Health Officials. Local Health Department Job Losses and Program Cuts: findings from January/February 2010 Survey. 2010, May. http://www.naccho.org/topics/infrastructure/lhdbudget/upload/Job-Losses-and-Program-Cuts-5-10.pdf. Accessed Verified 1-31-13.
Arnold EA, Galindo GR, Gaffney S, Steward WT, Morin SF. Examining the impact of the HIV-related state budget cuts: comparing Alameda, Fresno, and Los Angeles Counties: California HIV/AIDS Research Program; 2010: http://ari.ucsf.edu/programs/policy/state_budget_cuts.pdf. Accessed Verified 1-31-13.
Kalichman SC, Hudd K, Diberto G. Operational fidelity to an evidence-based HIV prevention intervention for people living with HIV/AIDS. J Prim Prev. 2010; 31(4): 235-245.
Kegeles S, Rebchook G, Pollack L, et al. An intervention to help community-based organizations implement an evidence-based HIV prevention intervention: the Mpowerment Project Technology Exchange System. Am J Community Psychol. 2012; 49(1): 182-198.
Dolcini MM, Gandelman AA, Vogan SA, et al. Translating HIV interventions into practice: community-based organizations’ experiences with the diffusion of effective behavioral interventions (DEBIs). Soc Sci Med. 2010; 71(10): 1839-1846.
Planas LG. Intervention design, implementation, and evaluation. Am J Health Syst Pharm. 2008; 65(19): 1854-1863.
Hitt JC, Robbins AS, Galbraith JS, et al. Adaptation and implementation of an evidence-based prevention counseling intervention in Texas. AIDS Educ Prev. 2006; 18(4 Suppl A): 108-118.
Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012; 102(7): 1274-1281.
Wandersman A, Duffy J, Flaspohler P, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008; 41(3): 171-181.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008; 41(3–4): 327-350.
Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature 2005. http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf. Accessed 12/4/2012.
Massatti R, Sweeney H, Panzano P, Roth D. The De-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Health. 2008; 35(1): 50-65.
Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Eval Pract. 2005; 26(3): 320-347.
Harshbarger C, Simmons G, Coelho H, Sloop K, Collins C. An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. AIDS Educ Prev. 2006; 18(4 Suppl A): 184-197.
Galbraith JS, Stanton B, Boekeloo B, et al. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: lessons learned from the Focus on Kids diffusion case study. Health Educ Behav. 2009; 36(3): 532-549.
Iverson EF, Balasuriya D, Garcia GP, et al. The challenges of assessing fidelity to physician-driven HIV prevention interventions: lessons learned implementing Partnership for Health in a Los Angeles HIV clinic. AIDS Behav. 2008; 12(6): 978-988.
Gandelman A, Dolcini M. The influence of social determinants on evidence-based behavioral interventions—considerations for implementation in community settings. Transl Behav Med. 2012; 2(2): 137-148.
Veniegas RC, Kao UH, Rosales R. Adapting HIV prevention evidence-based interventions in practice settings: an interview study. Implement Sci. 2009; 4(1): 76.
Owczarzak J, Dickson-Gomez J. Provider perspectives on evidence-based HIV prevention interventions: barriers and facilitators to implementation. AIDS Patient Care STDS. 2011; 25(3): 171-179.
National Alliance of State and Territorial AIDS Directors, The Kaiser Family Foundation. The national HIV prevention inventory: the state of HIV prevention across the U.S. 2009; http://www.kff.org/hivaids/upload/7932.pdf. Accessed Verified 1-31-13.
Milliken FJ, Dutton JE, Beyer JM. Understanding organizational adaptation to change: the case of work-family issues. Human Resource Planning: Springer; 1992: 279-295.
Rose RA. Organizational adaptation from a rules theory perspective. West J Speech Commun. 1985; 49(4): 322-340.
Kamb ML, Dillon BA, Fishbein M, Willis KL. Quality assurance of HIV prevention counseling in a multi-center randomized controlled trial, Project RESPECT Study Group. Public Health Rep. 1996; 111(Suppl 1): 99-107.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 2008.
Stern PN. Are counting and coding a cappella appropriate in qualitative research? In: Morse JM, ed. Qualitative nursing research. Thousand Oaks, CA: Sage Publications; 1991: 146-163.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005; 15(9): 1277-1288.
Corbin J, Strauss A. Basics of qualitative research: techniques and procedures for developing grounded theory. 3rd ed. Thousand Oaks, CA: Sage Publications; 2008.
Bernell S, Dolcini M, Catania J. The cost of implementing an evidence-based HIV/STI intervention in practice. Washington, D.C.: Fourth annual NIH conference on the science of dissemination and implementation; 2011.
Golden SD, Earp JA. Social ecological approaches to individuals and their contexts: twenty years of Health Education & Behavior health promotion interventions. Health Educ Behav. 2012; 39(3): 364-372.
Bronfenbrenner U. Ecological systems theory. In: Vasta R, ed. Annals of child development. Six theories of child development: revised formulations and current issues, vol. 6. London: JAI Press; 1989: 187-249.
Bronfenbrenner U. The ecology of cognitive development: research models and fugitive findings. In: Wonziak R, Fischer K, eds. Development in context: acting and thinking in specific environments. Hillsdale, NJ: Erlbaum; 1993: 3-44.
Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998; 13(1): 87-108.
Ozer EM, Adams SH, Lustig JL, et al. Can it be done? Implementing adolescent clinical preventive services. Health Serv Res. 2001; 36(6 Pt 2): 150-165.
Ozer EM, Adams SH, Lustig JL, et al. Increasing the screening and counseling of adolescents for risky health behaviors: a primary care intervention. Pediatrics. 2005; 115(4): 960-968.
Johnson TD. Prevention and public health fund paying off in communities. Nations Health. 2012; 42(6): 1-31.
Acknowledgments
We would like to thank Lance Pollack, Ph.D. (University of California San Francisco), Kim Richards, Ph.D., Kathleen Conte, MA, Marcia Macomber, MS (Oregon State University) and Westat Corporation for assistance in data collection, extraction and analytical work, and Carla Cudmore and Natalie Tiexiera for help in manuscript preparation. This research was supported by a grant from NIMH MH085502 to Dr. Dolcini.
Author information
Authors and Affiliations
Corresponding author
Additional information
Implications
Practice: Agencies experiencing fiscal loss should consider the impact of adaptations on staff morale and program fidelity, and when possible, make choices that enhance implementation.
Policy: Economic factors have had a negative impact on implementation of behavioral HIV prevention programs, placing strain on the public health safety net.
Research: Implementation is influenced by economic factors and further research is needed to identify best practices for sustaining evidence-based programs in the face of fiscal loss.
About this article
Cite this article
Catania, J.A., Dolcini, M.M., Gandelman, A.A. et al. Fiscal loss and program fidelity: impact of the economic downturn on HIV/STI prevention program fidelity. Behav. Med. Pract. Policy Res. 4, 34–45 (2014). https://doi.org/10.1007/s13142-013-0242-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13142-013-0242-z