Skip to main content

Advertisement

Log in

Fiscal loss and program fidelity: impact of the economic downturn on HIV/STI prevention program fidelity

  • original research
  • Published:
Translational Behavioral Medicine

ABSTRACT

The economic downturn of 2007 created significant fiscal losses for public and private agencies conducting behavioral prevention. Such macro-economic changes may influence program implementation and sustainability. We examined how public and private agencies conducting RESPECT, a brief HIV/STI (sexually transmitted infection) counseling and testing intervention, adapted to fiscal loss and how these adaptations impacted program fidelity. We collected qualitative and quantitative data in a national sample of 15 agencies experiencing fiscal loss. Using qualitative analyses, we examined how program fidelity varied with different types of adaptations. Agencies reported three levels of adaptation: agency-level, program-level, and direct fiscal remedies. Private agencies tended to use direct fiscal remedies, which were associated with higher fidelity. Some agency-level adaptations contributed to reductions in procedural fit, leading to negative staff morale and decreased confidence in program effectiveness, which in turn, contributed to poor fidelity. Findings describe a “work stress pathway” that links program fiscal losses to poor staff morale and low program fidelity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Office of National AIDS Policy. National HIV/AIDS Strategy: update of 2011–2012 federal efforts to implement the National HIV/AIDS Strategy. Washington D.C.: White House Office of National AIDS Policy; 2012.

  2. Morin SF, Yamey G, Rutherford GW. HIV pre-exposure prophylaxis. BMJ. 2012;345.

  3. Kippax S, Stephenson N. Beyond the distinction between biomedical and social dimensions of HIV prevention through the lens of a social public health. Am J Public Health. 2012; 102(5): 789-799.

    Google Scholar 

  4. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998; 18(1): 23-45.

    Article  CAS  PubMed  Google Scholar 

  5. Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Eval Pract. 2003; 24(3): 315-340.

    Google Scholar 

  6. Collins C, Harshbarger C, Sawyer R, Hamdallah M. The diffusion of effective behavioral interventions project: development, implementation, and lessons learned. AIDS Educ Prev. 2006; 18(4 Suppl A): 5-20.

    Article  PubMed  Google Scholar 

  7. Rhodes F, Stein J, Fishbein M, Goldstein R, Rotheram-Borus M. Using theory to understand how interventions work: Project RESPECT, condom use, and the integrative model. AIDS Behav. 2007; 11(3): 393-407.

    Article  PubMed  Google Scholar 

  8. Kamb ML, Fishbein M, Douglas JM Jr, et al. Efficacy of risk-reduction counseling to prevent human immunodeficiency virus and sexually transmitted diseases: a randomized controlled trial. JAMA. 1998; 280(13): 1161-1167.

    Article  CAS  PubMed  Google Scholar 

  9. Metcalf CA, Douglas JM Jr, Malotte CK, et al. Relative efficacy of prevention counseling with rapid and standard HIV testing: a randomized, controlled trial (RESPECT-2). Sex Transm Dis. 2005; 32(2): 130-138.

    Article  PubMed  Google Scholar 

  10. National Association of County & City Health Officials. NACCHO Survey of Local Health Departments’ Budget Cuts and Workforce Reductions. 2009, January. http://www.naccho.org/advocacy/upload/JobLossProgramCuts_ResearchBrief_final.pdf. Accessed Verified 1/31/13.

  11. National Association of County & City Health Officials. Local Health Department Job Losses and Program Cuts: findings from January/February 2010 Survey. 2010, May. http://www.naccho.org/topics/infrastructure/lhdbudget/upload/Job-Losses-and-Program-Cuts-5-10.pdf. Accessed Verified 1-31-13.

  12. Arnold EA, Galindo GR, Gaffney S, Steward WT, Morin SF. Examining the impact of the HIV-related state budget cuts: comparing Alameda, Fresno, and Los Angeles Counties: California HIV/AIDS Research Program; 2010: http://ari.ucsf.edu/programs/policy/state_budget_cuts.pdf. Accessed Verified 1-31-13.

  13. Kalichman SC, Hudd K, Diberto G. Operational fidelity to an evidence-based HIV prevention intervention for people living with HIV/AIDS. J Prim Prev. 2010; 31(4): 235-245.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Kegeles S, Rebchook G, Pollack L, et al. An intervention to help community-based organizations implement an evidence-based HIV prevention intervention: the Mpowerment Project Technology Exchange System. Am J Community Psychol. 2012; 49(1): 182-198.

    Article  PubMed  Google Scholar 

  15. Dolcini MM, Gandelman AA, Vogan SA, et al. Translating HIV interventions into practice: community-based organizations’ experiences with the diffusion of effective behavioral interventions (DEBIs). Soc Sci Med. 2010; 71(10): 1839-1846.

    Article  PubMed Central  Google Scholar 

  16. Planas LG. Intervention design, implementation, and evaluation. Am J Health Syst Pharm. 2008; 65(19): 1854-1863.

    Article  PubMed  Google Scholar 

  17. Hitt JC, Robbins AS, Galbraith JS, et al. Adaptation and implementation of an evidence-based prevention counseling intervention in Texas. AIDS Educ Prev. 2006; 18(4 Suppl A): 108-118.

    Article  PubMed  Google Scholar 

  18. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012; 102(7): 1274-1281.

    Article  PubMed  Google Scholar 

  19. Wandersman A, Duffy J, Flaspohler P, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008; 41(3): 171-181.

    Article  PubMed  Google Scholar 

  20. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008; 41(3–4): 327-350.

    Article  PubMed  Google Scholar 

  21. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature 2005. http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf. Accessed 12/4/2012.

  22. Massatti R, Sweeney H, Panzano P, Roth D. The De-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Health. 2008; 35(1): 50-65.

    Article  PubMed  Google Scholar 

  23. Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Eval Pract. 2005; 26(3): 320-347.

    Google Scholar 

  24. Harshbarger C, Simmons G, Coelho H, Sloop K, Collins C. An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. AIDS Educ Prev. 2006; 18(4 Suppl A): 184-197.

    Article  PubMed  Google Scholar 

  25. Galbraith JS, Stanton B, Boekeloo B, et al. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: lessons learned from the Focus on Kids diffusion case study. Health Educ Behav. 2009; 36(3): 532-549.

    Article  PubMed Central  PubMed  Google Scholar 

  26. Iverson EF, Balasuriya D, Garcia GP, et al. The challenges of assessing fidelity to physician-driven HIV prevention interventions: lessons learned implementing Partnership for Health in a Los Angeles HIV clinic. AIDS Behav. 2008; 12(6): 978-988.

    Article  PubMed  Google Scholar 

  27. Gandelman A, Dolcini M. The influence of social determinants on evidence-based behavioral interventions—considerations for implementation in community settings. Transl Behav Med. 2012; 2(2): 137-148.

    Article  PubMed Central  PubMed  Google Scholar 

  28. Veniegas RC, Kao UH, Rosales R. Adapting HIV prevention evidence-based interventions in practice settings: an interview study. Implement Sci. 2009; 4(1): 76.

    Article  PubMed Central  PubMed  Google Scholar 

  29. Owczarzak J, Dickson-Gomez J. Provider perspectives on evidence-based HIV prevention interventions: barriers and facilitators to implementation. AIDS Patient Care STDS. 2011; 25(3): 171-179.

    PubMed  Google Scholar 

  30. National Alliance of State and Territorial AIDS Directors, The Kaiser Family Foundation. The national HIV prevention inventory: the state of HIV prevention across the U.S. 2009; http://www.kff.org/hivaids/upload/7932.pdf. Accessed Verified 1-31-13.

  31. Milliken FJ, Dutton JE, Beyer JM. Understanding organizational adaptation to change: the case of work-family issues. Human Resource Planning: Springer; 1992: 279-295.

    Google Scholar 

  32. Rose RA. Organizational adaptation from a rules theory perspective. West J Speech Commun. 1985; 49(4): 322-340.

    Article  Google Scholar 

  33. Kamb ML, Dillon BA, Fishbein M, Willis KL. Quality assurance of HIV prevention counseling in a multi-center randomized controlled trial, Project RESPECT Study Group. Public Health Rep. 1996; 111(Suppl 1): 99-107.

    PubMed Central  PubMed  Google Scholar 

  34. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 2008.

    Book  Google Scholar 

  35. Stern PN. Are counting and coding a cappella appropriate in qualitative research? In: Morse JM, ed. Qualitative nursing research. Thousand Oaks, CA: Sage Publications; 1991: 146-163.

    Google Scholar 

  36. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005; 15(9): 1277-1288.

    Article  PubMed  Google Scholar 

  37. Corbin J, Strauss A. Basics of qualitative research: techniques and procedures for developing grounded theory. 3rd ed. Thousand Oaks, CA: Sage Publications; 2008.

    Google Scholar 

  38. Bernell S, Dolcini M, Catania J. The cost of implementing an evidence-based HIV/STI intervention in practice. Washington, D.C.: Fourth annual NIH conference on the science of dissemination and implementation; 2011.

    Google Scholar 

  39. Golden SD, Earp JA. Social ecological approaches to individuals and their contexts: twenty years of Health Education & Behavior health promotion interventions. Health Educ Behav. 2012; 39(3): 364-372.

    Article  PubMed  Google Scholar 

  40. Bronfenbrenner U. Ecological systems theory. In: Vasta R, ed. Annals of child development. Six theories of child development: revised formulations and current issues, vol. 6. London: JAI Press; 1989: 187-249.

    Google Scholar 

  41. Bronfenbrenner U. The ecology of cognitive development: research models and fugitive findings. In: Wonziak R, Fischer K, eds. Development in context: acting and thinking in specific environments. Hillsdale, NJ: Erlbaum; 1993: 3-44.

    Google Scholar 

  42. Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998; 13(1): 87-108.

    Article  CAS  PubMed  Google Scholar 

  43. Ozer EM, Adams SH, Lustig JL, et al. Can it be done? Implementing adolescent clinical preventive services. Health Serv Res. 2001; 36(6 Pt 2): 150-165.

    CAS  PubMed Central  PubMed  Google Scholar 

  44. Ozer EM, Adams SH, Lustig JL, et al. Increasing the screening and counseling of adolescents for risky health behaviors: a primary care intervention. Pediatrics. 2005; 115(4): 960-968.

    Article  PubMed  Google Scholar 

  45. Johnson TD. Prevention and public health fund paying off in communities. Nations Health. 2012; 42(6): 1-31.

    Google Scholar 

Download references

Acknowledgments

We would like to thank Lance Pollack, Ph.D. (University of California San Francisco), Kim Richards, Ph.D., Kathleen Conte, MA, Marcia Macomber, MS (Oregon State University) and Westat Corporation for assistance in data collection, extraction and analytical work, and Carla Cudmore and Natalie Tiexiera for help in manuscript preparation. This research was supported by a grant from NIMH MH085502 to Dr. Dolcini.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joseph A Catania PhD.

Additional information

Implications

Practice: Agencies experiencing fiscal loss should consider the impact of adaptations on staff morale and program fidelity, and when possible, make choices that enhance implementation.

Policy: Economic factors have had a negative impact on implementation of behavioral HIV prevention programs, placing strain on the public health safety net.

Research: Implementation is influenced by economic factors and further research is needed to identify best practices for sustaining evidence-based programs in the face of fiscal loss.

About this article

Cite this article

Catania, J.A., Dolcini, M.M., Gandelman, A.A. et al. Fiscal loss and program fidelity: impact of the economic downturn on HIV/STI prevention program fidelity. Behav. Med. Pract. Policy Res. 4, 34–45 (2014). https://doi.org/10.1007/s13142-013-0242-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13142-013-0242-z

KEYWORDS

Navigation