Advertisement

Mixed Methods’ Contribution to the Evaluation of Health Promotion Initiatives in the School Setting

  • Marie-Renée GuévelEmail author
  • Jeanine Pommier
  • Didier Jourdan
Chapter

Abstract

The development of suitable approaches for evaluating health promotion in schools to produce useful evidence to enhance sustainability and transferability is still a major topic of discussion. There is currently a trend among health promotion researchers to develop evaluation approaches that are able to measure the impact of an initiative as well as to understand how this impact is obtained in order to inform the implementation of sustainable health promotion initiatives by practitioners and decision-makers from both health and education sectors. This chapter sets out to illustrate the contribution of mixed methods to take into account the complexity of school health promotion initiatives to help address the challenges faced by the field of school health promotion especially those related to evaluation, sustainability and transferability. Empirical data gathered from an intervention research implemented in the French context are used to highlight the interest of such a research strategy.

Keywords

Evaluation School health promotion Mixed methods Teacher training 

Notes

Acknowledgements

The authors are very grateful to the National Institute for Health Education and Prevention (Inpes) for its financial support. They also wish to thank all those who took part in the project especially the members of the regional teams and the school communities involved. They thank Julie Pironom (IUFM d’Auvergne – Université de Blaise Pascal, France) for her help with the statistics analysis.

References

  1. Burton, C. (2002). Introduction to complexity. In K. Sweeney & F. Griffiths (Eds.), Complexity and health care. An introduction (pp. 1–18). Oxon: Redcliffe Medical Press Ltd.Google Scholar
  2. Cambon, L., Minary, L., Ridde, V., & Alla, F. (2012). Transferability of interventions in health education: A review. BMC Public Health, 12(497). doi:  10.1186/1471-2458-12-497.
  3. Chen, H. T. (1997). Applying mixed methods under the framework of theory-driven evaluation. New Directions for Evaluation, 74, 61–72.CrossRefGoogle Scholar
  4. Chen, H. T., & Rossi, P. H. (1983). Evaluating with sense – The theory driven approach. Evaluation Review, 7(3), 283–302.CrossRefGoogle Scholar
  5. Creswell, J. W. (2009). Research design: Qualitative, quantitative and mixed methods approaches (3rd ed.). Thousand Oaks: SAGE Publications.Google Scholar
  6. Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research (1st ed.). Thousand Oaks: SAGE Publications.Google Scholar
  7. Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2nd ed.). Thousand Oaks: SAGE Publications.Google Scholar
  8. Debarbieux, E. (1996). La violence en milieu scolaire, Tome 1. Nanterre: ESF.Google Scholar
  9. Debarbieux, E., & Blaya, C. (2001). Violence à l’école et politiques publiques. Nanterre: ESF.Google Scholar
  10. Donaldson, S. I. (2009). In search of the blueprint for an evidence-based global society. In S. I. Donaldson, C. A. Christie, & M. M. Mark (Eds.), What counts as credible evidence in applied research and evaluation practice? (pp. 2–18). Thousand Oaks: SAGE Publications.CrossRefGoogle Scholar
  11. Escofier, B., & Pagès, J. (2008). Analyses factorielles simples et multiples: objectifs, méthodes et interprétation (4th ed.). Paris: Dunod.Google Scholar
  12. Goigoux, R. (2007). Un modèle d’analyse des activités des enseignants. Education et didactique, 3, 3–11.Google Scholar
  13. Grieg Viig, N., & Wold, B. (2005). Facilitating teachers’ participation in school-based health promotion – A qualitative study. Scandinavian Journal of Educational Research, 49(1), 83–109.CrossRefGoogle Scholar
  14. Guével, M. R., Pommier, J., & Jourdan, D. (2010, September). L’apport des méthodes mixtes à l’évaluation de l’effet d’un dispositif de formation d’enseignants en éducation à la santé. AREF 2010, Genève (Suisse). URL: https://plone.unige.ch/aref2010
  15. Guével, M. R., Pommier, J., Jourdan, D. (2013a, August). School health promotion – Contexts and mechanisms influencing the implementation of health promotion approaches. 21st IUHPE world conference on health promotion. Pattaya (Thailand). URL: http://www.iuhpeconference.net/en/index.php
  16. Guével, M. R., Pironom, J., Pommier, J., Jourdan, D. (2013b, August). Etude de la diversité des effets observés suite à la participation d’écoles à un projet de promotion de la santé. 21st IUHPE world conference on health promotion. Pattaya (Thailand). Pattaya (Thaïlande). URL: http://www.iuhpeconference.net/en/index.php
  17. Hamel, M., Blanchet, L., & Martin, C. (2001). 6, 12, 17 Nous serons bien mieux! Les déterminants de la santé et du bien-être des enfants d’âge scolaire. Québec: Publications du Québec.Google Scholar
  18. Han, S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33(6), 665–679.CrossRefGoogle Scholar
  19. Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133.CrossRefGoogle Scholar
  20. Jourdan, D. (2011). Health education in schools – The challenge of teacher training. Saint-Denis: Inpes.Google Scholar
  21. Jourdan, D., Piec, I., Aublet-Cuvelier, B., Berger, D., Lejeune, M. L., Laquet-Riffaud, A., Geneix, C., & Glanddier, P. Y. (2002). Education à la santé à l’école: pratiques et représentations des enseignants du primaire. Santé Publique, 14(4), 403–423.CrossRefGoogle Scholar
  22. Julnes, G., & Rog, D. (2009). Evaluation methods for producing actionable evidence. In S. I. Donaldson, C. A. Christie, & M. M. Mark (Eds.), What counts as credible evidence in applied research and evaluation practice? (pp. 96–131). Thousand Oaks: SAGE Publications.CrossRefGoogle Scholar
  23. Knowlton, L. W., & Phillips, C. C. (2009). The logic model guidebook – Better strategies for great results. Thousand Oaks: SAGE Publications.Google Scholar
  24. Lee, A., St Léger, L., & Moon, A. (2005). Evaluating health promotion in schools: A case study of design, implementation and results from the Hong Kong School Award Scheme. Promotion & Education, 12(3–4), 123–130.CrossRefGoogle Scholar
  25. Li, J., Mattes, E., Stanley, F., McMurray, A., & Hertzman, C. (2009). Social determinants of child health and well-being. Health Sociology Review, 18(1), 3–11.CrossRefGoogle Scholar
  26. Lister-Sharp, D., Chapman, S., Stewart-Brown, S., & Sowden, A. (1999). Health promoting schools and health promotion in schools: Two systematic reviews. Health Technology Assessment, 3(22), 1–218.Google Scholar
  27. Mérini, C., Victor, P., & Bizzoni-Prévieux, C. (2009). Through a functioning typology in the school teams. In P. Masson & M. Pilo (Eds.), Partnership in education. Theoretical approach and case studiesLe partenariat en éducation. Approache théorique et études de cas (pp. 19–31). Lille: Book Edition.Google Scholar
  28. Mérini, C., Victor, P., & Jourdan, D. (2010). Le travail des enseignants en éducation à la santé: analyse des dynamiques collectives du dispositif. Travail et Formation en Education, 6. URL: http://tfe.revues.org/1334
  29. Mertens, D. & Hesse-Bider, S.(2013). Mixed methods and credibility of evidence in evaluation. New Directions for Evaluation, 2013(138), 5–13. doi:  10.1002/ev.20053.
  30. Merzel, C., & D’Afflitti, J. (2003). Reconsidering community-based health promotion: Promise, performance, and potential. American Journal of Public Health, 93(4), 557–574.CrossRefGoogle Scholar
  31. Morse, J. M. (2003). Principles of mixed methods and multimethod. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (1st ed., pp. 189–208). Thousand Oaks: SAGE Publications.Google Scholar
  32. Mukoma, W., & Flisher, A. J. (2004). Evaluations of health promoting schools: A review of nine studies. Health Promotion International, 19(3), 357–368.CrossRefGoogle Scholar
  33. Nutbeam, D. (1998). Evaluating health promotion – Progress, problems and solutions. Health Promotion International, 13(1), 27–44.CrossRefGoogle Scholar
  34. OECD. (2010). Improving health and social cohesion through education. Educational Research and Innovation. doi: 10.1787/9789264086319-en. OECD Publishing.Google Scholar
  35. Pawson, R., & Tilley, N. (1997). Realistic evaluation. London: SAGE Publications.Google Scholar
  36. Peters, L. W. H., Kok, G., TenDam, G. T. M., Buijs, G. J., & Paulussen, T. G. W. M. (2011). Effective elements of school health promotion across behavioral domains: A systematic review of reviews. BMC Public Health, 9(182). doi:  10.1186/1471-2458-9-182.
  37. Pluye, P., Grad, R. M., Levine, A., & Nicoleau, B. (2009). Understanding divergence of quantitative and qualitative data (or results) in mixed methods studies. International Journal of Multiple Research Approaches, 3(1), 58–72.CrossRefGoogle Scholar
  38. Pommier, J., Jourdan, D., Vandoorne, C., Pioreka, B., & Simoes de Carvalho, G. (2009). School health promotion: Organisation of services and roles of health professionals in seven European countries. European Journal of Public Health, 20(2), 182–188.CrossRefGoogle Scholar
  39. Pommier, J., Guével, M. R., & Jourdan, D. (2010). Evaluation of health promotion in schools: A realistic evaluation approach using mixed methods. BMC Public Health, 10(43). doi:  10.1186/1471-2458-10-43.
  40. Potvin, L., Bilodeau, A., & Gendron, S. (2008). Trois défis pour l’évaluation en promotion de la santé. Promotion & Education, 15(1), 17–21.CrossRefGoogle Scholar
  41. Rootman, I., Goodstadt, M., Hyndman, B., McQueen, D. V., Potvin, L., Springett, J., & Ziglio, E. (2001). Evaluation in health promotion: Principles and perspectives. Copenhagen: WHO Regional Publications.Google Scholar
  42. Rowling, L. (2009). Strengthening “school” in school mental health promotion. Health Education, 109(4), 357–368.CrossRefGoogle Scholar
  43. Rowling, L., & Jeffreys, V. (2006). Capturing complexity: Integrating health and education research to inform health-promoting schools policy and practice. Health Education Research, 21(5), 705–718.CrossRefGoogle Scholar
  44. Samdal, O., Nutbeam, D., Wold, B., & Kannas, L. (1998). Achieving health and educational goals through schools – A study of the importance of the school climate and the students satisfaction with school. Health Education Research, 13(3), 383–397.CrossRefGoogle Scholar
  45. Schoonbroodt, C., & Gélinas, A. (1996). Envisager la prévention par le changement émergent: apprendre à gérer ce qui fait problème. Education santé, 108, 3–10.Google Scholar
  46. Simar, C., & Jourdan, D. (2010a). Education à la santé à l’école: étude des déterminants des pratiques des enseignants du premier degré. Revue des Sciences de l’Education, 36(3), 739–760.CrossRefGoogle Scholar
  47. Simar, C., & Jourdan, D. (2010b). Education et santé: étude de l’impact d’un dispositif de formation et d’accompagnement sur l’implication des enseignants dans une démarche de promotion de la santé. Revue Recherches et Educations, 3. URL: http://rechercheseducations.revues.org/561
  48. Simar, C., & Jourdan, D. (2011). Analyse de l’activité d’enseignants du primaire en éducation à la santé. Nouveaux Cahiers de la Recherche en Education, 14(2), 7–26.CrossRefGoogle Scholar
  49. St Leger, L. H. (1999). The opportunities and effectiveness of the health promoting primary school in improving child health – A review of the claims and evidence. Health Education Research, 14(1), 51–69.CrossRefGoogle Scholar
  50. St Léger, L. (2004). What’s the place of schools in promoting health? Are we too optimistic? Health Promotion International, 19(4), 405–408.CrossRefGoogle Scholar
  51. St Leger, L. (2005). Protocoles et lignes directrices pour les Ecoles promotrices de santé. Promotion & Education, 12(3–4), 145–147.CrossRefGoogle Scholar
  52. St Leger, L., & Young, I. M. (2009). Creating the document ‘Promoting health in schools: From evidence to action’. Global Health Promotion, 16(4), 69–71.CrossRefGoogle Scholar
  53. St Leger, L., Kolbe, L., Lee, A., McCall, D. S., & Young, I. M. (2007). School health promotion: Achievements, challenges and priorities. In D. V. McQueen & C. M. Jones (Eds.), Global perspectives on health promotion effectiveness (pp. 107–124). Saint-Denis: Springer.CrossRefGoogle Scholar
  54. Stewart-Brown, S. (2006). What is the evidence on school health promotion in improving health or preventing disease and, specifically, what is the effectiveness of the health promoting schools approach? Copenhagen: WHO.Google Scholar
  55. Suhrcke, M., & de Paz Nieves, C. (2011). The impact of health and health behaviours on educational outcomes in high-income countries: A review of the evidence. Copenhagen: WHO Regional Office for Europe.Google Scholar
  56. Tashakkori, A., & Teddlie, C. (2003). Handbook of mixed methods in social and behavioral research (1st ed.). Thousand Oaks: SAGE Publications.Google Scholar
  57. Tones, K., & Tilford, S. (2001). Health promotion: Effectiveness, efficiency and equity (3rd ed.). Cheltenham: Nelson Thornes.Google Scholar
  58. WHO. (1993). Life skills education in school. Geneva: WHO.Google Scholar
  59. WHO. (1998). Health promotion evaluation: Recommendations to policy-makers. Geneva: WHO.Google Scholar
  60. WHO. (1999). Partners in life skills education – Conclusions from a United Nations Inter-Agency Meeting. Geneva: WHO.Google Scholar
  61. Younès, N., Debarbieux, E., & Jourdan, D. (2011). Le climat scolaire à l’école primaire – Etude de l’influence des variables de milieu sur sa perception par les élèves de 6 à 8 ans. International Journal of Violence and School, 12, 107–127. URL: http://www.ijvs.org/3-6224-Article.php?id=94&tarticle=0

Copyright information

© Springer Science+Business Media Dordrecht 2015

Authors and Affiliations

  • Marie-Renée Guével
    • 1
    Email author
  • Jeanine Pommier
    • 1
  • Didier Jourdan
    • 2
  1. 1.Department of Social and Human SciencesEHESP (French School of Public Health)RennesFrance
  2. 2.Faculty of EducationUniversity Blaise Pascal Clermont-FerrandClermont-FerrandFrance

Personalised recommendations