Abstract
Background
The workplace has been suggested as an important arena for health promotion, but little is known about how the organizational setting influences the implementation of interventions.
Purpose
The aims of this study are to evaluate implementation fidelity in an organizational-level occupational health intervention and to investigate possible explanations for variations in fidelity between intervention units.
Method
The intervention consisted of an integration of health promotion, occupational health and safety, and a system for continuous improvements (Kaizen) and was conducted in a quasi-experimental design at a Swedish hospital. Implementation fidelity was evaluated with the Conceptual Framework for Implementation Fidelity and implementation factors used to investigate variations in fidelity with the Framework for Evaluating Organizational-level Interventions. A multi-method approach including interviews, Kaizen notes, and questionnaires was applied.
Results
Implementation fidelity differed between units even though the intervention was introduced and supported in the same way. Important differences in all elements proposed in the model for evaluating organizational-level interventions, i.e., context, intervention, and mental models, were found to explain the differences in fidelity.
Conclusion
Implementation strategies may need to be adapted depending on the local context. Implementation fidelity, as well as pre-intervention implementation elements, is likely to affect the implementation success and needs to be assessed in intervention research. The high variation in fidelity across the units indicates the need for adjustments to the type of designs used to assess the effects of interventions. Thus, rather than using designs that aim to control variation, it may be necessary to use those that aim at exploring and explaining variation, such as adapted study designs.
Similar content being viewed by others
References
Cohen WS. Health promotion in the workplace: a prescription for good health. Am Psychol. 1985;40(2):213–6.
Ilgen DR. Health issues at work. Opportunities for industrial/organizational psychology. Am Psychol. 1990;45(2):273–83.
Drach-Zahavy A. Workplace health friendliness: a cross-level model for predicting workers’ health. J Occup Health Psychol. 2008;13(3):197–213.
Bamberger P, Sonnensthul W. Tailoring union-wide innovations to local conditions: the case of member assistance program implementation in the airline industry. Labor Stud J. 1996;21:19–39.
Hays C, Hays SP, DeVille J, Mulhall PF. Capacity for effectiveness: the relationship between coalition structure and community impact. Eval Program Plan. 2000;23(3):373–9.
Wilson MG, Dejoy DM, Vandenberg RJ, Richardson HA, McGrath AL. Work characteristics and employee health and well‐being: test of a model of healthy work organization. J Occup Organ Psychol. 2004;77(4):565–88.
Nielsen K, Randall R, Holten A, Rial Gonzale E. Conducting organizational-level occupational health interventions: what works? Work Stress. 2010;24(3):234–59.
EU-OSHA. European survey of enterprises on new and emerging risks: managing safety and health at work. Luxembourg. 2010.
Semmer NK. Job stress interventions and the organization of work. Scand J Work Environ Health. 2006;32:515–27.
Kompier MAJ, Kristensen TS. Organizational work stress interventions in a theoretical, methodological and practical context. In: Dunham, editor. Stress in the workplace: past, present and future. London: Whurr Publishers; 2001.
Taris TW, Kompier MAJ, Geurts SA, Schreurs PJ, Schaufeli WB, de Boer E, et al. Stress management interventions in the Dutch domiciliary care sector: findings from 81 organizations. Int J Stress Manag. 2003;10(4):297–325.
Mikkelsen A, Saksvik PØ, Landsbergis P. The impact of a participatory organizational intervention on job stress in community health care institutions. Work Stress. 2000;14(2):156–70.
Ruotsalainen J, Serra C, Marine A, Verbeek J. Systematic review of interventions for reducing occupational stress in health care workers. Scand J Work Environ Health. 2008;34(3):169–78.
Briner RB, Reynolds S. The costs, benefits, and limitations of organizational level stress interventions. J Organ Behav. 1999;20(5):647–64.
Van der Klink J, Blonk R, Schene AH, Van Dijk F. The benefits of interventions for work-related stress. Am J Public Health. 2001;91(2):270–6.
Nielsen K, Taris T, Cox T. The future of organizational interventions: addressing the challenges of today’s organizations. Work Stress. 2010;24(3):219–33.
Egan M, Bambra C, Thomas S, Petticrew M, Whitehead M, Thomson H. The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control. J Epidemiol Community Health. 2007;61(11):945–54.
Nielsen K, Randall R. Opening the black box: presenting a model for evaluating organizational-level interventions. Eur J Work Organ Psychol. 2013;22(5):601–17.
Murta SG, Sanderson K, Oldenburg B. Process evaluation in occupational stress management programs: a systematic review. Am J Health Promot. 2007;21(4):248–54.
Bambra C, Egan M, Thomas S, Petticrew M, Whitehead M. The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions. J Epidemiol Community Health. 2007;61(12):1028–37.
Roen K, Arai L, Roberts H, Popay J. Extending systematic reviews to include evidence on implementation: methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006;63(4):1060–71.
Egan M, Bambra C, Petticrew M, Whitehead M. Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions. J Epidemiol Community Health. 2009;63(1):4–11.
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40).
Steckler AB, Linnan L. Process evaluation for public health interventions and research. Jossey-Bass; 2002.
Womack JP, Jones DT, Roos D. The machine that changed the world: the story of lean production. New York: Rawson Associates; 1990.
Jacobson GH, Mccoin NS, Lescallette R, Russ S, Slovis CM. Kaizen: a method of process improvement in the emergency department. Acad Emerg Med. 2009;16(12):1341–9.
Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.
Yin RK. Case study research: design and methods. Sage Publications Inc; 2003.
Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5(67).
Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7(23).
von Thiele Schwarz U, Hasson H, Lindfors P. Applying a fidelity framework to understand adaptations in an occupational health intervention. Work. 2014. doi:10.3233/WOR-141840.
Randall R, Nielsen K, Tvedt SD. The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work Stress. 2009;23(1):1–23.
Yang B, Watkins KE, Marsick VJ. The construct of the learning organization: dimensions, measurement, and validation. Hum Resour Dev Q. 2004;15(1):31–55.
Lien BYH, Hung RYY, Yang B, Li M. Is the learning organization a valid concept in the Taiwanese context? Int J Manpow. 2006;27(2):189–203.
Song JH, Joo BKB, Chermack TJ. The Dimensions of Learning Organization Questionnaire (DLOQ): a validation study in a Korean context. Hum Resour Dev Q. 2009;20(1):43–64.
Taylor JC, Bowers DG. Survey of organizations: a machine-scored standardized questionnaire instrument. Ann Arbour: University of Michigan, Institute for Social Research; 1972.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.
Ulhassan W. Westerlund H, Thor J, Sandahl C, von Thiele Schwarz U. How does Lean relate to teamwork? A prospective observational study in a Swedish hospital. Submitted for publication. 2013.
Frykman M. Hasson H, Atlin Muntlin Å, von Thiele Schwarz U. Functions of behavior change interventions when implementing multi-professional teamwork at an emergency department: a comparative case study. BMC Health Serv Res. 2014;14:218.
Nytrø K, Saksvik P, Mikkelsen A, Bohle P, Quinlan M. An appraisal of key factors in the implementation of occupational stress interventions. Work Stress. 2000;14(3):213–25.
Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3.
Randall R, Griffiths A, Cox T. Evaluating organizational stress-management interventions using adapted study designs. Eur J Work Organ Psychol. 2005;14(1):23–41.
Cox T, Karanika M, Griffiths A, Houdmont J. Evaluating organizational-level work stress interventions: beyond traditional methods. Work Stress. 2007;21(4):348–62.
Acknowledgments
The authors would like to thank all employees and managers participating in the study. The study was financed by AFA Insurance (Grant No. 110094).
Ethical Standards
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000 and 2008.
Conflict of Interest
Authors Hanna Augustsson, Ulrica von Thiele Schwarz, Terese Stenfors-Hayes, and Henna Hasson declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Augustsson, H., von Thiele Schwarz, U., Stenfors-Hayes, T. et al. Investigating Variations in Implementation Fidelity of an Organizational-Level Occupational Health Intervention. Int.J. Behav. Med. 22, 345–355 (2015). https://doi.org/10.1007/s12529-014-9420-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12529-014-9420-8