Abstract
The role of a genetic counselor often entails providing education to patient, community and/or health professional groups. While counseling supervision assists genetic counselors to be reflective about their clinical work and to enhance clinical skills, evaluation is a rather analogous process in the provision of education. Program evaluation of education activities can be applied to provide information about the needs of the target group (needs assessment), the delivery of the program (process evaluation) as well as determining the extent to which the education activity has met its intended aims (summative evaluation). Evaluation assists the educator to assess the impact of their program and provides an evidence base about genetics education. Although program evaluation can be a complex activity, the tools are ones that can be used by individuals to evaluate single or simple education activities. The components of evaluation are discussed with reference to genetic counseling practice and three very different examples of actual evaluations are provided to illustrate the diversity of evaluation strategy and programs to which it can be applied.
Similar content being viewed by others
References
Burke, S., Bedward, J., Thomas, H., & Farndon, P. (2005). Genetic education for non-genetic SpRs: a needs analysis. The University of Birmingham.
Burton, H. (2003). Addressing genetics, delivering health. A strategy for advancing the dissemination and application of genetics knowledge throughout our health professions. London, UK: The Wellcome Trust and Department of Health.
Burton, H., & Zimmern, R. (2005). Education in the genetics era: Genetics education for health professionals—An essential component of genetics policy. Medical Education, 39, 243–244.
Delatycki, M. B., Allen, K. J., Nisselle, A. E., Collins, V., Metcalfe, S., du Sart, D., et al. (2005). Use of community genetic screening to prevent HFE-associated hereditary haemochromatosis. Lancet, 366, 314–316.
Emery, J., & Hayflick, S. (2001). The challenge of integrating genetic medicine into primary care. British Medical Journal, 322, 1027–1030.
Fitz-Gibbon, C. T., & Morris, L. L. (1996). Theory-based evaluation. Evaluation Practice, 17, 177–184.
Funnell, S. (1997). Program logic: An adaptable tool for designing and evaluating programs. Evaluation News & Comment, 6, 5–17.
Gaff, G. L., Aitken, M., Flouris, A., & Metcalfe, S. A. (2007). A model for the development of genetics education programs for health professionals. Genetics in Medicine, 9, 451–457.
Godard, B., ten Kate, L., Evers-Kiebooms, G., & Ayme, S. (2003). Population genetic screening programmes: Principles, techniques, practices, and policies. European Journal of Human Genetics, 11(Suppl 2), S49–S87.
Hawe, P., Degeling, D., & Hall, J. (1990). Evaluating health promotion: A health worker’s guide. Sydney: MacLennan & Petty.
Hawthorne, G. (2000). Introduction to health program evaluation. Melbourne: Centre for Health Program Evaluation.
Hutchinson, L. (1999). Evaluating and researching the effectiveness of educational interventions. British Medical Journal, 318, 1267–1269.
Khoury, M. J., McCabe, L. L., & McCabe, E. R. (2003). Population screening in the age of genomic medicine. New England Journal of Medicine, 348, 50–58.
Kirk, M., McDonald, K., Anstey, S., & Longley, M. (2003). Fit for practice in the genetics era. Final Report to Department of Health. Pontypridd, University of Glamorgan.
Knowles, M. S. (Ed.) (1996). Andragogy: An emerging technology for adult learning. Boundaries of adult learning. London: Routledge.
Koelen, M. A., & van den Ban, A. W. (2004). Health education and health promotion. The Netherlands: Wageningen Academic Publishers.
Metcalfe, S., Hurworth, R., Newstead, J., & Robins, R. (2002). Needs assessment study of genetics education for general practitioners in Australia. Genetics in Medicine, 4, 71–77.
National Coalition of Health Professional Education in Genetics: http://www.nchpeg.org/. Accessed 10 July 2007.
Newman, P., & Peile, E. (2002). Valuing learners’ experience and supporting further growth: Educational models to help experienced adult learners in medicine. British Medical Journal, 325, 200–202.
Nisselle, A. E., Collins, V. R., Gason, A. A., Flouris, A., Delatycki, M. B., Allen, K. J., et al. (2006). Educational outcomes of a workplace screening program for genetic susceptibility to hemochromatosis. Clinical Genetics, 69, 163–170.
Nisselle, A. E., Delatycki, M. B., Collins, V., Metcalfe, S., Aitken, M. A., du Sart, D., et al. (2004). Implementation of HaemScreen, a workplace-based genetic screening program for hemochromatosis. Clinical Genetics, 65, 358–367.
Olynyk, J. K., Cullen, D. J., Aquilia, S., Rossi, E., Summerville, L., & Powell, L. W. (1999). A population-based study of the clinical expression of the hemochromatosis gene. New England Journal of Medicine, 341, 718–724.
Ovretveit, J. (1998). Planning and managing an evaluation. In J. Ovretveit (Ed.), Evaluating health interventions: An introduction to evaluation of health treatments, services, policies and organizational interventions (pp. 158–180). Buckingham: Open University Press.
Owen, J., & Rogers, P. (1999). Program evaluation: forms and approaches. Sydney: Allen & Unwin.
Patton, M. (1986). Utilization-focused evaluation. Newbury Park: Sage.
Robson, C. (2002). Real world research. A resource for social scientists and practitioner-researchers. Oxford, UK: Blackwell.
Rossi, P., Freeman, H., & Lipsey, M. (1993). Evaluation: A systematic approach. Newbury Park: Sage.
Scriven, M. (1991). Evaluation thesaurus. Newbury Park: Sage.
Siebert, D. (2008). Secrets to creating effective and interesting education experiences: Tips and suggestions for clinical educators. Journal of Genetic Counselling, 17(2).
Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2004). Handbook of practical program evaluation. San Francisco: Wiley.
Wilson, J. M., & Jungner, G. (1968). Principles and practice of screening for disease. Geneva: World Health Organisation.
Acknowledgements
The authors would like to acknowledge Anna Flouris, Michelle Bishop and Yasmin Bylstra, and also the members of the HaemScreen team for their contributions to the program logic models.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Metcalfe, S.A., Aitken, M. & Gaff, C.L. The Importance of Program Evaluation: How Can it be Applied to Diverse Genetics Education Settings?. J Genet Counsel 17, 170–179 (2008). https://doi.org/10.1007/s10897-007-9138-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10897-007-9138-8