Implementing and Evaluating Interventions

Chapter

Abstract

Real-world implementation of injury prevention interventions and evaluation of their effectiveness need to take into account the broad ecological context in which they are introduced. This chapter provides perspectives and guidance on (1) the design, conduct, and evaluation of studies that are concerned with the effectiveness of injury prevention and safety promotion interventions and (2) research to better understand the context for intervention delivery. It begins with an overview of why research into intervention delivery and evaluation of its outcomes is necessary for the broad field of injury prevention and control. This includes a comparison of the aims and approaches of efficacy and effectiveness studies and the recognized gap between the two. The ecological context for injury prevention is summarized and the implications for intervention delivery and evaluation are described. The chapter then covers key theoretical, conceptual, and methodological issues involved in evaluation research and introduces some of the current thinking about translation research. Particular emphasis is given to Intervention Mapping as a tool to assist in the intervention development process, Diffusion of Innovations theory to guide efforts in the planning of intervention strategies and the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) health promotion framework and their reported applications to injury prevention interventions to date.

References

  1. Ajzen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Beckmann & J. Kuhl (Eds.), Action control: From cognition to behavior (pp. 11–39). Berlin: Springer.CrossRefGoogle Scholar
  2. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human, 50, 179–211.CrossRefGoogle Scholar
  3. Aldoory, L., & Bonzo, S. (2005). Using communication theory in injury prevention campaigns. Injury Prevention, 11, 260–263.PubMedCrossRefGoogle Scholar
  4. Allegrante, J., Hanson, D., Sleet, D., et al. (2010). Ecological approaches to the prevention of unintentional injuries. Italian Journal of Public Health, 7, 24–31.Google Scholar
  5. Allegrante, J., Marks, R., & Hanson, D. (2006). Ecological models for the prevention and control of unintentional injury. In A. Gielen, D. Sleet, & R. DiClemente (Eds.), Injury and violence prevention Behavioral science theories, methods, and applications (pp. 105–126). San Francisco: Wiley.Google Scholar
  6. Andersen, P. A., Buller, D. B., Scott, M. D., et al. (2004). Prevalence and diffusion of helmet use at ski areas in Western North America in 2001–02. Injury Prevention, 10, 358–362.PubMedCrossRefGoogle Scholar
  7. Armstrong, R., Clark, R., Murphy, S., et al. (2008). Strategies to support knowledge translation and exchange. Australasian Epidemiologist, 15, 24–27.Google Scholar
  8. Bandura, A. (1986). Social foundations of thought and action: a social cognitive theory. Reading, MA: Addison Wesley Publishing Company.Google Scholar
  9. Bartholomew, L., Parcel, G., & Kok, G. (1998). Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Education and Behavior, 1998, 545–563.CrossRefGoogle Scholar
  10. Bartholomew, L., Parcel, G., Kok, G., et al. (2006). Planning health promotion programs. An intervention mapping approach. San Francisco: Jossey-Bass.Google Scholar
  11. Bernstein, E., Topp, D., Shaw, E., et al. (2009). A preliminary report of knowledge translation: lessons learnt from taking screening and brief intervention techniques from the research setting into regional systems of care. Academic Emergency Medicine, 16, 1225–1233.PubMedCrossRefGoogle Scholar
  12. Besculides, M., Zaveri, H., Hanson, C., et al. (2008). Best practices in implementing lifestyle interventions in the WISEWOMAN program: adaptable strategies for public health programs. American Journal of Health Promotion, 22, 322–328.PubMedCrossRefGoogle Scholar
  13. Bierrman, G. (2006). Commentary on the pitfalls and pratfalls of evalution research with intervention and prevention programs. In R. Parker & C. Hudley (Eds.), New directions for evalaution No 110 (pp. 87–96). San Francisco: Jossey-Bass.Google Scholar
  14. Bowen, S., & Zwi, A. B. (2005). Pathways to “evidence-informed” policy and practice: a framework for action. PLoS Medicine, 2, 200–205.CrossRefGoogle Scholar
  15. Brosseau, L., Parker, D., Samant, Y., et al. (2007). Mapping safety interventions in metalworking shops. Journal of Occupational and Environmental, 49, 338–345.CrossRefGoogle Scholar
  16. Brussoni, M., Towner, E., & Hayes, M. (2006). Evidence into practice: combining the art and science of injury prevention. Injury Prevention, 12, 373–377.PubMedCrossRefGoogle Scholar
  17. Buse, K., Mays, N., & Walt, G. (2005). Making health policy. Berkshire, UK: Open University Press.Google Scholar
  18. Catford, J. (2009). Advancing the “science of delivery” of health promotion: not just the “science of discovery”. Health Promotion International, 24, 1–5.PubMedCrossRefGoogle Scholar
  19. Choi, B., Gupta, A., & Ward, B. (2009). Good thinking: Six ways to bridge the gap between scientists and policy makers. Journal of Epidemiology and Community Health, 63, 179–180.PubMedCrossRefGoogle Scholar
  20. Christoffel, T., Gallagher, S., (2006). Injury prevention and public health. Practical knowledge, skills, and strategies. Jones and Bartlett Publishers, Inc., Sudbury.Google Scholar
  21. Collard, D., Chinapaw, M., van Mechelen, W., et al. (2009a). Design of the iPlay study. Systematic development of a phsyical activity injury prevention program for primary school children. Sports Medicine, 29, 889–901.CrossRefGoogle Scholar
  22. Collard, D., Chinapaw, M., Verhagen, E., et al. (2010a). Process evaluation of a school based physical activity related injury prevention program using the RE-AIM framework. BMC Pediatrics, 10, 86.PubMedCentralPubMedCrossRefGoogle Scholar
  23. Collard, D., Singh, A., & Verhagen, E. (2009b). The behavioral approach. In E. Verhagen & W. van Mechelen (Eds.), Sports injury research (pp. 157–166). Oxford: Oxford University Press.CrossRefGoogle Scholar
  24. Collard, D., Verhagen, E., Chinapaw, M., et al. (2010b). Effectiveness of a school-based physical activity injury prevention program. A cluster randomized controlled trial. Archives of Pediatrics and Adolescent Medicine, 164, 145–150.PubMedCrossRefGoogle Scholar
  25. Connor, J. (2004). Risk factor identifcation: The role of epidemiology. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control (pp. 125–143). Melbourne: IP Communications.Google Scholar
  26. Day, L., Finch, C., Hill, K., et al. (2010). A protocol for evidence-based targeting and evaluation of statewide strategies for preventing falls among community-dwelling older people in Victoria, Australia. Injury Prevention. doi:10.1126/ip. 2010.03775.Google Scholar
  27. De Vries, H., Backbier, E., Kok, G., et al. (1995). The impact of social influence in the context of attitude, self-­efficacy, intention and previous behavior as predictors of smoking onset. Journal of Applied Social Psychology, 25, 237–257.CrossRefGoogle Scholar
  28. Dzewaltowski, D., Estabrooks, P., Klesges, L., et al. (2004). Behavior change intervention research in community settings: how generalizable are the results? Health Promotion International, 19, 235–245.PubMedCrossRefGoogle Scholar
  29. Eime, R., Finch, C., Wolfe, R., et al. (2005). The effectiveness of a squash eyewear promotion strategy. British Journal of Sports Medicine, 39, 681–685.Google Scholar
  30. Eime, R., Owen, N., Finch, C., (2004). Protective eyewear promotion: Applying principles of behavior change in the design of a squash injury prevention program. 34, 629–638Google Scholar
  31. Farley, C., Haddad, S., & Brown, B. (1996). The effects of a 4-year program promoting bicycle helmet use among children in Quebec. American Journal of Public Health, 86, 46–51.PubMedCrossRefGoogle Scholar
  32. Farley, C., Otis, J., & Benoit, M. (1997). Evaluation of a four year bicycle helmet promotion campaign in Quebec aimed at children aged 8 to 12 years: impact on attitudes, norms, and behviours. Canadian Journal of Public Health, 88, 62–66.PubMedGoogle Scholar
  33. Finch, C. (2006). A new framework for research leading to sports injury prevention. Journal of Science and Medicine in Sport, 9, 3–9.PubMedCrossRefGoogle Scholar
  34. Finch, C., (2009). Chapter 16: Implementing studies into real life. In: E. Verhagen, W. van Mechelen (Eds.), Sports injury research (pp. 213–235). Oxford University Press.Google Scholar
  35. Finch, C., Day, L., Donaldson, A., et al. (2009). Determining policy-relevant formats for the presentation of falls research evidence. Health Policy, 93, 207–213.Google Scholar
  36. Finch, C., & Donaldson, A. (2010). A sports setting matrix for understanding the implementation context for community sport. British Journal of Sports Medicine, 44, 973–978.PubMedCrossRefGoogle Scholar
  37. Finch, C., Gabbe, B., Lloyd, D., et al. (2011a). Towards a national sports safety strategy – addressing facilitators and barriers towards safety guideline uptake (the NoGAPS project). Injury Prevention. doi:10.1136/ip. 2010.031385.Google Scholar
  38. Finch, C., White, P., Twomey, D., et al. (2011b). Implementing an exercise training program to prevent lower limb injuries – considerations for the development of a randomized controlled trial intervention delivery plan. British Journal of Sports Medicine, 45, 791–795.Google Scholar
  39. Foster, M., Micthell, R., & McClure, R. (2004). Making policy. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control (pp. 267–282). Melbourne: IP Communications.Google Scholar
  40. Gielen, A., Sleet, D., DiClemente, C. C., et al. (2006a). Injury prevention and violence prevention Behavioral science theories, methods, and applications. San Francisco: Wiley.Google Scholar
  41. Gielen, A., Sleet, D., & Green, L. (2006b). Community models and approaches for interventions. In A. Gielen, D. Sleet, & R. DiClemente (Eds.), Injury and violence prevention: Behavior change theories, methods and applications (pp. 65–82). San Francisco, CA: Jossey-Bass.Google Scholar
  42. Glasgow, R. (2008). What types of evidence are most needed to advance behavioral medicine? Annals of Behavioral Medicine, 35, 19–25.PubMedCrossRefGoogle Scholar
  43. Glasgow, R., Klesges, L., Dzewaltowski, D., et al. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27, 3–12.PubMedCrossRefGoogle Scholar
  44. Glasgow, R., Klesges, L., Dzewaltowski, D., et al. (2006). Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Education Research, 21, 688–694.PubMedCrossRefGoogle Scholar
  45. Glasgow RE, Lichtenstein E, Marcus AC (2003) Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. 93, 1261–1267Google Scholar
  46. Glasgow, R., Vogt, T., & Boles, S. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327.PubMedCrossRefGoogle Scholar
  47. Green, L., & Kreuter, M. (1991). Health promotion planning: An educational and environmental approach (2nd ed.). Mountain View: Mayfield Publishing Company.Google Scholar
  48. Gyurcsik, N., Brittain, D., (2006). Partial examination of the public health impact of the People with Arthritis Can Exercise (PACE) Program: Reach, adoption, and maintainence. Public Health Nursing, 23, 516–522.Google Scholar
  49. Hanson, D., Hanson, J., Vardon, P., et al. (2005). The injury iceberg: An ecological approach to planning sustainable community safety interventions. 16, 5–10Google Scholar
  50. Henderson, J., MacKay, S., & Peterson-Badall, M. (2006). Closing the research-practice gap: Factors affecting adoption and implementation of children’s mental health program. Journal of Clinical Child and Adolescent Psychology, 35, 2–12.PubMedCrossRefGoogle Scholar
  51. Hendriks, M., Bleijlevens, M., van Haastregt, J., et al. (2008). Lack of effectiveness of a multidisciplinary fall-prevention program in elderly people at risk: A randomized, controlled trial. Journal of the American Geriatrics Society, 56, 390–1397.CrossRefGoogle Scholar
  52. Henley, N. (2004). Social marketing. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control (pp. 318–333). Melbourne: IP Communications.Google Scholar
  53. Hingson, R., Howland, J., Koepsell, T. D., et al. (2001). Ecologic studies. In (Ed.), Injury control: A guide to research and program evaluation (pp. 157–167) Cambridge University Press.Google Scholar
  54. Hoepsell, T., Zatzick, D., & Rivara, F. (2011). Estimating the population impact of preventive interventions from randomized trials. American Journal of Preventive Medicine, 40, 191–198.CrossRefGoogle Scholar
  55. Janz, N., & Becker, M. (1984). The health belief model: A decade later. Health Education Quarterly, 11, 1–47.PubMedCrossRefGoogle Scholar
  56. Jilcott, S., Ammerman, A., Sommers, J., et al. (2007). Applying the RE-AIM framework to assess the public health impact of policy change. Annals of Behavioral Medicine, 34, 105–114.Google Scholar
  57. Kendrick, D., Groom, L., Stewart, J., et al. (2007). “Risk watch”: cluster randomized controlled trial evaluating an injury prevention program. Injury Prevention, 13, 93–99.PubMedCrossRefGoogle Scholar
  58. Kilding, A. E., Tunstall, H., Kuzmic, D. (2008). Suitability of FIFA’s “The 11” training program for young football players-impact on physical performance. Journal of Sport Science and Medicine, 7, 320–326.Google Scholar
  59. Li, F., Harmer, P., Glasgow, R., et al. (2008). Translation of an effective tai chi intervention into a community-based falls-prevention program. American Journal of Public Health, 98, 1195–1198.PubMedCrossRefGoogle Scholar
  60. Logghe, I., Verhagen, A., Rademaker, A., et al. (2011). Explaining the ineffectiveness of a Tai Chi fall prevention training for community-living older people: a process evaluation alongisde a randomsied clinical trial (RCT). Archives of Gerontology and Geriatrics, 52, 357–362. doi:10.1016/j.archger.2010.1005.1013.Google Scholar
  61. MacKay, J. M., & Vincenten, J. (2009). Why isn’t more injury prevention evidence-based? International Journal of Injury Control and Safety Promotion, 16, 89–96.PubMedCrossRefGoogle Scholar
  62. Mallonee, S., Fowler, C., & Istre, G. R. (2006). Bridging the gap between research and practice: A continuing challenge. Injury Prevention, 12, 357–359.PubMedCrossRefGoogle Scholar
  63. McGlashan, A., & Finch, C. (2010). The extent to which behavioral and social sciences theories and models are used in sport injury prevention research. Sports Medicine, 40, 841–858.PubMedCrossRefGoogle Scholar
  64. Meyer, G. (2004). Diffusion methodology: Time to innovate? Journal of Health Communication, 9, 59–69.PubMedCrossRefGoogle Scholar
  65. Mitton, C., MacNab, Y., Smith, N., et al. (2008). Transferring injury data to decision makers in British Columbia. International Journal of Injury Control and Safety Promotion, 15, 41–43.PubMedCrossRefGoogle Scholar
  66. Morandi, L. (2009). Essential nexus: How to use research to inform and evaluate public policy. American Journal of Preventive Medicine, 36, S53.PubMedCrossRefGoogle Scholar
  67. Murray, N., Kelder, S., Parcel, G., et al. (1998). Development of an intervention map for a parent education intervention to prevent violence among Hispanic middle school students. Journal of School Health, 68, 46–52.PubMedCrossRefGoogle Scholar
  68. Murray, N., Kelder, S., Parcel, G., et al. (1999). Padres Trabajando por la Paz: A randomized trial of a parent education intervention to prevent violence among middle school students. Health Education Review, 14, 421–426.CrossRefGoogle Scholar
  69. Nelson, G., & Moffit, P. (1988). Safety belt promotion: Theory and practice. Accident; Analysis and Prevention, 20, 27–38.PubMedCrossRefGoogle Scholar
  70. Nilsen, P. (2004). What makes community based injury prevention work? In search of evidence of effectiveness. Injury Prevention, 10, 268–274.PubMedCrossRefGoogle Scholar
  71. Nilsen, P., (2005). Evaluation of community-based injury prevention programs: Methodological issues and challenges. International Journal of Injury Control and Safety Promotion, 12, 143–156Google Scholar
  72. Nilsen, P., (2006). The theory of community based health and safety programs: A critical examination. Injury Prevention, 12, 140–145Google Scholar
  73. Nilsen, P., & Yorkston, E. (2007). Uncovering evidence on community-based injury prevention: A review of program effectiveness and factors influencing effectiveness. International Journal of Injury Control Safety Promotion, 14, 241–250.PubMedCrossRefGoogle Scholar
  74. Nold, A., & Bochmann, F. (2010). Examples of evidence-based approaches in accident prevention. Safety Science, 48, 1044–1049.CrossRefGoogle Scholar
  75. Peterson, J., Rogers, E., Cunningham-Sabo, L., et al. (2007). A framework for research utilization applied to seven case studies. American Journal of Preventive Medicine, 33, S21–S34.PubMedCrossRefGoogle Scholar
  76. Pitt, R., & Spinks, D. (2004). Advocacy. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control (pp. 303–317). Melbourne: IP Communications.Google Scholar
  77. Prochaska, J., Evers, K., Prochaska, J., et al. (2007). Efficacy and effectiveness trials: examples from smoking cessation and bullying prevention. Journal of Health Psychology, 12, 170–177.PubMedCrossRefGoogle Scholar
  78. Prochaska, J. O., Redding, C. A., & Evers, K. E. (1997). Chapter 4 the transtheoretical model and stages of change. In K. Glanz, F. M. Lewis, & B. K. Rimer (Eds.), Health behavior and health education (pp. 60–84). San Francisco: Jossey-Bass Inc.Google Scholar
  79. Provvidenza, C. F., & Johnston, K. M. (2009). Knowledge transfer principles as applied to sport concussion education. British Journal of Sports Medicine, 43(Suppl 1), i68–i75.PubMedCrossRefGoogle Scholar
  80. Rivara, F. (2008). Evaluating the effect of an injury prevention intervention in a population. American Journal of Preventive Medicine, 34, S148–S152.PubMedCrossRefGoogle Scholar
  81. Robertson, L. (2007). Injury epidemiology. Research and control strategies. New York: Oxford University Press.Google Scholar
  82. Roen, K., Arai, L., Roberts, H., et al. (2006). Extending systematic reviews to include evidence on implementation: Methodological work on a review of community-based initiatives to prevent injuries. Social Science and Medicine, 63, 1060–1071.PubMedCrossRefGoogle Scholar
  83. Rogers, E. (2003). Diffusion of innovations (5th ed.). New York: Free Press.Google Scholar
  84. Rogers, E. (2004). A prospective and retrospective look at the diffusion model. Journal of Health Communication, 9, 3–19.CrossRefGoogle Scholar
  85. Saunders, N., Otago, L., Romiti, M., et al. (2010). Coaches’ perspectives on implementing an evidence-informed injury prevention program in junior community netball. British Journal of Sports Medicine, 44, 1128–1132.PubMedCrossRefGoogle Scholar
  86. Sawyer, R., Hamdallah, M., White, D., et al. (2010). High school coaches’ assessments, intentions to use, and use of a concussion prevention toolkit: Centres for Disease Control and Prevention’s heads up, concussion in high school sports. Health Promotion Practice, 11, 34–43.PubMedCrossRefGoogle Scholar
  87. Scott, I. (2004). Laws and rule-making. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control (pp. 283–302). Melbourne: IP Communications Pty Ltd.Google Scholar
  88. Sleet, D., & Gielen, A. (2004). Developing injury interventions: the role of behavioral science. In R. McClure, M. Stevenson, & S. McEvoy (Eds.), The scientific basis of injury prevention and control. Melbourne: IP Communications.Google Scholar
  89. Soligard, T., Myklebust, G., Steffen, K., et al. (2008). Comprehensive warm-up programe to prevent injuries in young female footballers: Cluster randomized controlled trial. British Medical Journal, 337, a2469.PubMedCentralPubMedCrossRefGoogle Scholar
  90. Stame, N. (2010). What doesn’t work? Three failures, many answers. Evaluation, 16, 371–387.CrossRefGoogle Scholar
  91. Steffen, K., Myklebust, G., Olsen, O., et al. (2008). Preventing injuries in female youth football – a cluster-randomized controlled trial. Scandinavian Journal of Medicine and Science in Sports, 18, 605–614.PubMedCrossRefGoogle Scholar
  92. Thompson, R., & Sacks, J. (2001). Evaluating an injury intervention or program. In F. Rivara, P. Cummings, T. Koepsell, et al. (Eds.), Injury control: A guide to research and program evaluation (pp. 196–216). Cambridge, UK: Cambridge University Press.Google Scholar
  93. Timpka, T., Ekstrand, J., & Svanstrom, L. (2006). From sports injury prevention to safety promotion in sports. Sports Medicine, 36, 733–745.PubMedCrossRefGoogle Scholar
  94. Tran, N., Hyder, A., Kulanthayan, S., et al. (2008). Engaging policy makers in road safety research in Malaysia: A theoretical and contextual analysis. Health Policy, 90, 58–65.PubMedCrossRefGoogle Scholar
  95. Trifiletti, L., Gielen, A., Sleet, D., et al. (2005). Behavioral and social sciences theories and models: Are they used in unintentional injury prevention research? Health Education Research, 20, 298–307.PubMedCrossRefGoogle Scholar
  96. van Tiggelen, D., Wickes, S., Stevens, V., et al. (2008). Effective prevention of sports injuries: A model integrating efficacy, efficiency, compliance and risk taking behavior. British Journal of Sports Medicine, 42, 648–652.PubMedCrossRefGoogle Scholar
  97. Ward, V. L., House, A. O., & Hamer, S. (2009). Knowledge brokering: Exploring the process of transferring knowledge into action. BMC Health Services Research. doi:10.1186/1472-6963-9-12.
  98. Winston, F., & Jacobsen, L. (2010). A practical approach for applying best practices in behavioral interventions to injury prevention. Injury Prevention, 16, 107–112.PubMedCentralPubMedCrossRefGoogle Scholar
  99. Zwarenstein, M., Treweek, S., Gagnier, J., et al. (2008). Improving the reporting of pragmatic trials: an extension of the CONSORT statement. British Medical Journal, 337, a2390.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.Australian Center for Research into Injury in Sport and its Prevention, Monash Injury Research InstituteMonash UniversityClaytonAustralia

Personalised recommendations