Skip to main content
Log in

The Importance of Program Evaluation: How Can it be Applied to Diverse Genetics Education Settings?

  • Original Research
  • Published:
Journal of Genetic Counseling

Abstract

The role of a genetic counselor often entails providing education to patient, community and/or health professional groups. While counseling supervision assists genetic counselors to be reflective about their clinical work and to enhance clinical skills, evaluation is a rather analogous process in the provision of education. Program evaluation of education activities can be applied to provide information about the needs of the target group (needs assessment), the delivery of the program (process evaluation) as well as determining the extent to which the education activity has met its intended aims (summative evaluation). Evaluation assists the educator to assess the impact of their program and provides an evidence base about genetics education. Although program evaluation can be a complex activity, the tools are ones that can be used by individuals to evaluate single or simple education activities. The components of evaluation are discussed with reference to genetic counseling practice and three very different examples of actual evaluations are provided to illustrate the diversity of evaluation strategy and programs to which it can be applied.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Burke, S., Bedward, J., Thomas, H., & Farndon, P. (2005). Genetic education for non-genetic SpRs: a needs analysis. The University of Birmingham.

  • Burton, H. (2003). Addressing genetics, delivering health. A strategy for advancing the dissemination and application of genetics knowledge throughout our health professions. London, UK: The Wellcome Trust and Department of Health.

    Google Scholar 

  • Burton, H., & Zimmern, R. (2005). Education in the genetics era: Genetics education for health professionals—An essential component of genetics policy. Medical Education, 39, 243–244.

    Article  PubMed  Google Scholar 

  • Delatycki, M. B., Allen, K. J., Nisselle, A. E., Collins, V., Metcalfe, S., du Sart, D., et al. (2005). Use of community genetic screening to prevent HFE-associated hereditary haemochromatosis. Lancet, 366, 314–316.

    Article  PubMed  CAS  Google Scholar 

  • Emery, J., & Hayflick, S. (2001). The challenge of integrating genetic medicine into primary care. British Medical Journal, 322, 1027–1030.

    Article  PubMed  CAS  Google Scholar 

  • Fitz-Gibbon, C. T., & Morris, L. L. (1996). Theory-based evaluation. Evaluation Practice, 17, 177–184.

    Article  Google Scholar 

  • Funnell, S. (1997). Program logic: An adaptable tool for designing and evaluating programs. Evaluation News & Comment, 6, 5–17.

    Google Scholar 

  • Gaff, G. L., Aitken, M., Flouris, A., & Metcalfe, S. A. (2007). A model for the development of genetics education programs for health professionals. Genetics in Medicine, 9, 451–457.

    Article  PubMed  Google Scholar 

  • Godard, B., ten Kate, L., Evers-Kiebooms, G., & Ayme, S. (2003). Population genetic screening programmes: Principles, techniques, practices, and policies. European Journal of Human Genetics, 11(Suppl 2), S49–S87.

    Article  PubMed  Google Scholar 

  • Hawe, P., Degeling, D., & Hall, J. (1990). Evaluating health promotion: A health worker’s guide. Sydney: MacLennan & Petty.

    Google Scholar 

  • Hawthorne, G. (2000). Introduction to health program evaluation. Melbourne: Centre for Health Program Evaluation.

    Google Scholar 

  • Hutchinson, L. (1999). Evaluating and researching the effectiveness of educational interventions. British Medical Journal, 318, 1267–1269.

    PubMed  CAS  Google Scholar 

  • Khoury, M. J., McCabe, L. L., & McCabe, E. R. (2003). Population screening in the age of genomic medicine. New England Journal of Medicine, 348, 50–58.

    Article  PubMed  CAS  Google Scholar 

  • Kirk, M., McDonald, K., Anstey, S., & Longley, M. (2003). Fit for practice in the genetics era. Final Report to Department of Health. Pontypridd, University of Glamorgan.

  • Knowles, M. S. (Ed.) (1996). Andragogy: An emerging technology for adult learning. Boundaries of adult learning. London: Routledge.

    Google Scholar 

  • Koelen, M. A., & van den Ban, A. W. (2004). Health education and health promotion. The Netherlands: Wageningen Academic Publishers.

    Google Scholar 

  • Metcalfe, S., Hurworth, R., Newstead, J., & Robins, R. (2002). Needs assessment study of genetics education for general practitioners in Australia. Genetics in Medicine, 4, 71–77.

    Article  PubMed  Google Scholar 

  • National Coalition of Health Professional Education in Genetics: http://www.nchpeg.org/. Accessed 10 July 2007.

  • Newman, P., & Peile, E. (2002). Valuing learners’ experience and supporting further growth: Educational models to help experienced adult learners in medicine. British Medical Journal, 325, 200–202.

    Article  PubMed  Google Scholar 

  • Nisselle, A. E., Collins, V. R., Gason, A. A., Flouris, A., Delatycki, M. B., Allen, K. J., et al. (2006). Educational outcomes of a workplace screening program for genetic susceptibility to hemochromatosis. Clinical Genetics, 69, 163–170.

    Article  PubMed  CAS  Google Scholar 

  • Nisselle, A. E., Delatycki, M. B., Collins, V., Metcalfe, S., Aitken, M. A., du Sart, D., et al. (2004). Implementation of HaemScreen, a workplace-based genetic screening program for hemochromatosis. Clinical Genetics, 65, 358–367.

    Article  PubMed  CAS  Google Scholar 

  • Olynyk, J. K., Cullen, D. J., Aquilia, S., Rossi, E., Summerville, L., & Powell, L. W. (1999). A population-based study of the clinical expression of the hemochromatosis gene. New England Journal of Medicine, 341, 718–724.

    Article  PubMed  CAS  Google Scholar 

  • Ovretveit, J. (1998). Planning and managing an evaluation. In J. Ovretveit (Ed.), Evaluating health interventions: An introduction to evaluation of health treatments, services, policies and organizational interventions (pp. 158–180). Buckingham: Open University Press.

    Google Scholar 

  • Owen, J., & Rogers, P. (1999). Program evaluation: forms and approaches. Sydney: Allen & Unwin.

    Google Scholar 

  • Patton, M. (1986). Utilization-focused evaluation. Newbury Park: Sage.

    Google Scholar 

  • Robson, C. (2002). Real world research. A resource for social scientists and practitioner-researchers. Oxford, UK: Blackwell.

    Google Scholar 

  • Rossi, P., Freeman, H., & Lipsey, M. (1993). Evaluation: A systematic approach. Newbury Park: Sage.

    Google Scholar 

  • Scriven, M. (1991). Evaluation thesaurus. Newbury Park: Sage.

    Google Scholar 

  • Siebert, D. (2008). Secrets to creating effective and interesting education experiences: Tips and suggestions for clinical educators. Journal of Genetic Counselling, 17(2).

  • Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2004). Handbook of practical program evaluation. San Francisco: Wiley.

    Google Scholar 

  • Wilson, J. M., & Jungner, G. (1968). Principles and practice of screening for disease. Geneva: World Health Organisation.

    Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge Anna Flouris, Michelle Bishop and Yasmin Bylstra, and also the members of the HaemScreen team for their contributions to the program logic models.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sylvia A. Metcalfe.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Metcalfe, S.A., Aitken, M. & Gaff, C.L. The Importance of Program Evaluation: How Can it be Applied to Diverse Genetics Education Settings?. J Genet Counsel 17, 170–179 (2008). https://doi.org/10.1007/s10897-007-9138-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10897-007-9138-8

Keywords

Navigation