Advertisement

Program Evaluation for Health and Human Service Programs: How to Tell the Right Story Successfully

  • Michael GassEmail author
  • Edward G. Foden
  • Anita Tucker
Chapter
Part of the Focused Issues in Family Therapy book series (FIFT)

Abstract

Over 50,000 children in the United States alone are placed into residential treatment programs each year. The failure to properly address these issues can compound the problems, which can then result in costly and long-term treatment issues. At both a micro-level (involving the client and the client system) and macro-level (involving an entire healthcare system), program evaluation can help protect clients’ and families’ well-being, justify costs, and monitor effectiveness. The purpose of this chapter is to provide a general understanding of the rationale, purposes, and methods of program evaluation, with specific attention to the role of family therapy in residential treatment. The primary focus of program evaluation performance will center on the five areas of needs assessment, feasibility study, process evaluation, outcome evaluation, and cost–benefit analyses. Note that program evaluation is only as effective as its ability to follow several critical standards/guidelines in its process—utility, feasibility, propriety, and accuracy.

Keywords

Program evaluation Needs assessment Feasibility study Process evaluation Outcome evaluation Cost–benefit analyses 

References

  1. Aos, S., Miller, M., & Drake, E. (2006). Evidence-based public policy options to reduce future prison construction, criminal costs, and crime rates. Olympia, WA: Washington State Institute for Public Policy.Google Scholar
  2. Calley, N. G. (2012). Juvenile offender recidivism: An examination of risk factors. Journal of Child Sexual Abuse, 21(3), 257–272. doi: 10.1080/10538712.2012.668266 CrossRefPubMedGoogle Scholar
  3. Centers for Disease Control and Prevention 1999. Framework for program evaluation in public health. MMWR; 48 (No. RR-11)Google Scholar
  4. Christenson, J. D., & Crane, D. R. (2014). Integrating costs into marriage and family therapy research. In R. B. Miller & L. Johnson (Eds.), Advanced research methods in family therapy research: A focus on validity and change (pp. 420–436). New York: Taylor and Francis.Google Scholar
  5. Davis, K. E. (2014). Expenditures for treatment of mental health disorders among children, ages 5–17, 2009–2011: Estimates for the U.S. civilian noninstitutionalized population. Retrieved from http://meps.ahrq.gov/mepsweb/data_files/publications/st440/stat440.shtml
  6. Ellis, R. H., Wilson, N. Z., & Foster, F. M. (1984). Statewide treatment outcome assessment in Colorado: The Colorado client assessment record (CCAR). Community Mental Health Journal, 20(1), 72–89.CrossRefPubMedGoogle Scholar
  7. Evaluating Residential Treatment Programs. (2006). Eating Disorders Review, 17(3). Retrieved from http://eatingdisordersreview.com/nl/nl_edr_17_3_7.html
  8. Gass, M. (2014). Program evaluation: Critical factors for measuring client change. A workshop presented at the 2014 Northeast Conference for Experiential Education. The Berkshires, MA. April 17, 2014.Google Scholar
  9. Gass, M., Gillis, H., & Russell, K. (2012). Adventure therapy theory research and practice. New York: Taylor and Francis Group.Google Scholar
  10. Gillis, H. L., Gass, M. A., & Russell, K. C. (2008). The effectiveness of project adventure’s behavior management programs for male offenders in residential treatment. Residential Treatment for Children & Youth, 25(3), 227–247.CrossRefGoogle Scholar
  11. Merikangas, K. R., He, J., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., et al. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the National Comorbidity-Study Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 49(10), 980–989.CrossRefPubMedPubMedCentralGoogle Scholar
  12. McCaffrey, B. R. (1996). Treatment protocol effectiveness study. Retrieved from https://www.ncjrs.gov/ondcppubs/publications/treat/trmtprot.html
  13. National Association for Therapeutic School and Programs. (2015). NATSAP PQ-D (Parent Questionnaire-Discharge). Bethesda, MD.Google Scholar
  14. OQ Measures. (2014). What can the Y-OQ tell you about your younger clients? Retrieved from http://www.oqmeasures.com/measures/youth-adolescent-measures/y-oq/
  15. Program Evaluation Unit, Legislative Finance Committee. (2014). Results first: Adult behavioral health programs. Retrieved from http://www.nmlegis.gov/lcs/lfc/lfcdocs/resultsfirst/Evidence-Based%20Behavioral%20Health%20Programs%20to%20Improve%20Outcomes%20for%20Adults.pdf
  16. Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2003). Evaluation: A systematic approach. New York: Sage Publications.Google Scholar
  17. Ryan, C., Epstein, N., Keitner, G., Miller, I., & Bishop, D. (2005). Evaluating and treating families. New York: Taylor and Francis.Google Scholar
  18. Substance Abuse and Mental Health Services Administration. (2012). National survey on drug use and health: Mental health findings. Rockville, MD: Substance Abuse and Mental Health Services Administration.Google Scholar
  19. United States Department of Health and Human Services. (2010). The program managers guide to program evaluation (2nd ed.). Retrieved from http://www.acf.hhs.gov/sites/default/files/opre/program_managers_guide_to_eval2010.pdf
  20. United States Government Accountability Office. (2012, January). Designing evaluations. Retrieved from http://www.gao.gov/assets/590/588146.pdf
  21. Vaughn, C. F. (2005). Residential treatment centers: Not a solution for children with mental health needs. Clearinghouse Review Journal of Poverty Law and Policy, 39(3–4), 274.Google Scholar
  22. W. K. Kellogg Foundation. (2004). W. K. Kellogg Foundation evaluation handbook. Retrieved from https://www.wkkf.org/resource-directory/resource/2010/w-k-kellogg-foundation-evaluation-handbook
  23. Warner, L. A., & Pottick, K. J. (2003). Nearly 66,000 youth live in US mental health programs. Latest findings in children’s mental health (Policy Report submitted to the Annie E. Casey Foundation). New Brunswick, NJ: Institute for Health. Health Care Policy, and Aging Research, Rutgers University, 2(1), 1–2.Google Scholar
  24. Williams-Reade, J., Gordon, B., Wray, W. (2014). A primer in program evaluation for MedFTs. In Hodgson, J., Lamson, A., Mendenhall, T., & Russell, C. (2014). Medical family therapy: Advanced applications (pp. 283–299). Switzerland: Springer International Publishing.Google Scholar
  25. Yingling, L. C. (2012). Parent-child and family assessment strategy and inventories. In Sperry, L. (Ed.), Family assessment: Contemporary and cutting-edge strategies. (2nd ed., pp. 203–229). New York: Routledge.Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Outdoor Behavioral Healthcare (OBH) Research CenterCollege of Health and Human Services, University of New HampshireDurhamUSA
  2. 2.College of Health and Human ServicesUniversity of New HampshireDurhamUSA

Personalised recommendations