Journal of Genetic Counseling

, Volume 17, Issue 2, pp 170–179

The Importance of Program Evaluation: How Can it be Applied to Diverse Genetics Education Settings?

  • Sylvia A. Metcalfe
  • MaryAnne Aitken
  • Clara L. Gaff
Original Research

Abstract

The role of a genetic counselor often entails providing education to patient, community and/or health professional groups. While counseling supervision assists genetic counselors to be reflective about their clinical work and to enhance clinical skills, evaluation is a rather analogous process in the provision of education. Program evaluation of education activities can be applied to provide information about the needs of the target group (needs assessment), the delivery of the program (process evaluation) as well as determining the extent to which the education activity has met its intended aims (summative evaluation). Evaluation assists the educator to assess the impact of their program and provides an evidence base about genetics education. Although program evaluation can be a complex activity, the tools are ones that can be used by individuals to evaluate single or simple education activities. The components of evaluation are discussed with reference to genetic counseling practice and three very different examples of actual evaluations are provided to illustrate the diversity of evaluation strategy and programs to which it can be applied.

Keywords

Genetics education Program evaluation Program logic Needs assessment Genetic counselors Health professional genetics education Community genetics education 

References

  1. Burke, S., Bedward, J., Thomas, H., & Farndon, P. (2005). Genetic education for non-genetic SpRs: a needs analysis. The University of Birmingham.Google Scholar
  2. Burton, H. (2003). Addressing genetics, delivering health. A strategy for advancing the dissemination and application of genetics knowledge throughout our health professions. London, UK: The Wellcome Trust and Department of Health.Google Scholar
  3. Burton, H., & Zimmern, R. (2005). Education in the genetics era: Genetics education for health professionals—An essential component of genetics policy. Medical Education, 39, 243–244.PubMedCrossRefGoogle Scholar
  4. Delatycki, M. B., Allen, K. J., Nisselle, A. E., Collins, V., Metcalfe, S., du Sart, D., et al. (2005). Use of community genetic screening to prevent HFE-associated hereditary haemochromatosis. Lancet, 366, 314–316.PubMedCrossRefGoogle Scholar
  5. Emery, J., & Hayflick, S. (2001). The challenge of integrating genetic medicine into primary care. British Medical Journal, 322, 1027–1030.PubMedCrossRefGoogle Scholar
  6. Fitz-Gibbon, C. T., & Morris, L. L. (1996). Theory-based evaluation. Evaluation Practice, 17, 177–184.CrossRefGoogle Scholar
  7. Funnell, S. (1997). Program logic: An adaptable tool for designing and evaluating programs. Evaluation News & Comment, 6, 5–17.Google Scholar
  8. Gaff, G. L., Aitken, M., Flouris, A., & Metcalfe, S. A. (2007). A model for the development of genetics education programs for health professionals. Genetics in Medicine, 9, 451–457.PubMedCrossRefGoogle Scholar
  9. Godard, B., ten Kate, L., Evers-Kiebooms, G., & Ayme, S. (2003). Population genetic screening programmes: Principles, techniques, practices, and policies. European Journal of Human Genetics, 11(Suppl 2), S49–S87.PubMedCrossRefGoogle Scholar
  10. Hawe, P., Degeling, D., & Hall, J. (1990). Evaluating health promotion: A health worker’s guide. Sydney: MacLennan & Petty.Google Scholar
  11. Hawthorne, G. (2000). Introduction to health program evaluation. Melbourne: Centre for Health Program Evaluation.Google Scholar
  12. Hutchinson, L. (1999). Evaluating and researching the effectiveness of educational interventions. British Medical Journal, 318, 1267–1269.PubMedGoogle Scholar
  13. Khoury, M. J., McCabe, L. L., & McCabe, E. R. (2003). Population screening in the age of genomic medicine. New England Journal of Medicine, 348, 50–58.PubMedCrossRefGoogle Scholar
  14. Kirk, M., McDonald, K., Anstey, S., & Longley, M. (2003). Fit for practice in the genetics era. Final Report to Department of Health. Pontypridd, University of Glamorgan.Google Scholar
  15. Knowles, M. S. (Ed.) (1996). Andragogy: An emerging technology for adult learning. Boundaries of adult learning. London: Routledge.Google Scholar
  16. Koelen, M. A., & van den Ban, A. W. (2004). Health education and health promotion. The Netherlands: Wageningen Academic Publishers.Google Scholar
  17. Metcalfe, S., Hurworth, R., Newstead, J., & Robins, R. (2002). Needs assessment study of genetics education for general practitioners in Australia. Genetics in Medicine, 4, 71–77.PubMedCrossRefGoogle Scholar
  18. National Coalition of Health Professional Education in Genetics: http://www.nchpeg.org/. Accessed 10 July 2007.
  19. Newman, P., & Peile, E. (2002). Valuing learners’ experience and supporting further growth: Educational models to help experienced adult learners in medicine. British Medical Journal, 325, 200–202.PubMedCrossRefGoogle Scholar
  20. Nisselle, A. E., Collins, V. R., Gason, A. A., Flouris, A., Delatycki, M. B., Allen, K. J., et al. (2006). Educational outcomes of a workplace screening program for genetic susceptibility to hemochromatosis. Clinical Genetics, 69, 163–170.PubMedCrossRefGoogle Scholar
  21. Nisselle, A. E., Delatycki, M. B., Collins, V., Metcalfe, S., Aitken, M. A., du Sart, D., et al. (2004). Implementation of HaemScreen, a workplace-based genetic screening program for hemochromatosis. Clinical Genetics, 65, 358–367.PubMedCrossRefGoogle Scholar
  22. Olynyk, J. K., Cullen, D. J., Aquilia, S., Rossi, E., Summerville, L., & Powell, L. W. (1999). A population-based study of the clinical expression of the hemochromatosis gene. New England Journal of Medicine, 341, 718–724.PubMedCrossRefGoogle Scholar
  23. Ovretveit, J. (1998). Planning and managing an evaluation. In J. Ovretveit (Ed.), Evaluating health interventions: An introduction to evaluation of health treatments, services, policies and organizational interventions (pp. 158–180). Buckingham: Open University Press.Google Scholar
  24. Owen, J., & Rogers, P. (1999). Program evaluation: forms and approaches. Sydney: Allen & Unwin.Google Scholar
  25. Patton, M. (1986). Utilization-focused evaluation. Newbury Park: Sage.Google Scholar
  26. Robson, C. (2002). Real world research. A resource for social scientists and practitioner-researchers. Oxford, UK: Blackwell.Google Scholar
  27. Rossi, P., Freeman, H., & Lipsey, M. (1993). Evaluation: A systematic approach. Newbury Park: Sage.Google Scholar
  28. Scriven, M. (1991). Evaluation thesaurus. Newbury Park: Sage.Google Scholar
  29. Siebert, D. (2008). Secrets to creating effective and interesting education experiences: Tips and suggestions for clinical educators. Journal of Genetic Counselling, 17(2).Google Scholar
  30. Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2004). Handbook of practical program evaluation. San Francisco: Wiley.Google Scholar
  31. Wilson, J. M., & Jungner, G. (1968). Principles and practice of screening for disease. Geneva: World Health Organisation.Google Scholar

Copyright information

© National Society of Genetic Counselors, Inc. 2008

Authors and Affiliations

  • Sylvia A. Metcalfe
    • 1
    • 2
  • MaryAnne Aitken
    • 1
    • 2
  • Clara L. Gaff
    • 2
    • 3
  1. 1.Genetics Education and Health ResearchMurdoch Childrens Research InstituteParkvilleAustralia
  2. 2.Department of PaediatricsThe University of MelbourneMelbourneAustralia
  3. 3.Genetic Health Services VictoriaMelbourneAustralia

Personalised recommendations