Abstract
This paper describes the authors’ work in a community that received Federal funding for an integrated system of care to reduce the impact and incidence of exposure to violence for children less than six years of age. The paper includes a review of the conceptual framework that guided the work of the authors and provides a brief overview of the issue of family violence, the impact of this violence on young children, and the Federal response to this issue. In addition, a description of the Initiative and the community in which it was based is provided along with some aspects of the evaluation plan. Finally, the authors discuss how their work with this Initiative depicts an approach to facilitating change within communities.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alksnis, C., & Taylor, J. (1999). The impact of experiencing and witnessing family violence during childhood: Child and adult behavioural outcomes. Retrieved July 1, 2002 from the Correctional Service of Canada web site: http://www.csc-scc.gc.ca/text/pblct/fv/fv04/toce.shtml
American Psychological Association Presidential Task Force on Violence and the Family. (1996). Violence and the family. Washington, DC: American Psychological Association.
Appel, A. E., & Holden, G. W. (1998). The co-occurrence of spouse and physical child abuse: A review and appraisal. Journal of Family Psychology 12(4), 578–599.
Bridgeport Safe Start Community Assessment. (2001). Bridgeport, CT: Author.
Burns, B. J., Hoagwood, K., & Maultsby, L. T. (1998). Improving outcomes for children and adolescents with serious emotional and behavioral disorders: Current and future directions. In M. H. Epstein, Kutash, K., & Duchnowski, A. (Eds.), Outcomes for children and youth with emotional and behavioral disorders and their families: Programs and evaluation best practices (pp. 685–707). Austin, TX: PRO-ED, Inc.
Camic, P. M., Rhodes, J. E., & Yardley, L. (2003). Naming the stars: Integrating qualitative methods into psychological research. In P. M. Camic, J. E. Rhodes, & L. Yardley. (Eds.), Qualitative research in psychology: Expanding perspectives in methodology and design (pp. 3–15). Washington, DC: American Psychological Association.
Coffman, J. (2002). Public communication campaign evaluation: An environmental scan of challenges, criticisms, practice, and opportunities. Cambridge, MA: Harvard University, Harvard Family Research Project.
Cousins, J. B., & Earl, L. A. (1992). The case for participatory evaluation. Education Evaluation & Policy Analysis, 14(4), 397–418.
Crusto, C. A., & Wandersman, A. (2004). Setting the stage for accountability and program evaluation in community-based grant-making. In A. Roberts & K. Yeager. (Eds.), Evidence-based practice manual: Research and outcome measures in health and human services (pp. 162–177). Oxford University Press.
Edleson, J. L. (1999). Children's witnessing of adult domestic violence. Journal of Interpersonal Violence, 14(8), 839–870.
Fantuzzo, J. W., & Mohr, W. K. (1999). Prevalence and effects of child exposure to domestic violence. Future of Children, 9(3), 21–32.
Fawcett, S. B., Boothroyd, R., Shultz, J. A., Francisco, V. T., Carson, V., & Bremby, R. (2003). Building capacity for participatory evaluation within community Initiatives. Journal of Prevention & Intervention in the Community, 26(2), 21–36.
Federal Register (1999). OJJDP: Safe Start demonstration project. 64(64), 16555–16571.
Fetterman, D. M. (2001). Foundations of empowerment evaluation. Thousand Oaks, London: Sage.
Fetterman, D. M., Kaftarian, S. J., & Wandersman, A. (1996). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. London: Sage.
Friedman, S. R., & Kaufman, J. S. (2004). The status and changes in the Bridgeport system of care for young children exposed to violence in the home: 18-month follow-up focus groups. New Haven, CT: Yale University School of Medicine.
Friedman, S., Reynolds, J., Ross, E., Crusto, C. A., & Kaufman, J. S. (2004). Interagency collaboration survey and social network analyses. In J. S. Kaufman (Chair), Evaluation of a comprehensive community-based family violence Initiative. American Evaluation Association, November 2004 Atlanta, GA.
Goodman, R. M., Wandersman, A., Chinman, M., Imm, P., & Morrissey, E. (1996). An ecological assessment of community-based interventions for prevention and health promotion: Approaches to measuring community coalitions. American Journal of Community Psychology, 24, 33–61.
Greenbaum, P. (2000). Interagency collaboration survey. Unpublished measure. University of South Florida.
Hansen, M. (2002). The need for competence in children's public mental health services. In D. T. Marsh & M. A. Fristad. (Eds.), Handbook of serious emotional disturbance in children and adolescents (pp. 93–111). New York, NY: John Wiley & Sons, Inc.
Heflinger, C. A. (1996). Measuring service system coordination in managed mental health care for children and youth. Evaluation and Program Planning, 19(2), 155–163.
Hernandez, M. (2000). Using logic-models and program theory to build outcome accountability. Education & Treatment of Children, ETC, 23, 24.
Hernandez, M., & Hodges, S. (2003). Building upon the theory of change for systems of care. Journal of Emotional and Behavioral Disorders, 11(1), 19–26.
Hotaling, G. T., & Sugarman, D. B. (1986). An analysis of risk markers in husband to wife violence: The current state of knowledge. Violence & Victims, 1(2), 101–124.
Johnson, R. B. (1998). Toward a theoretical model of evaluation utilization. Evaluation and Program Planning, 21, 93– 110.
Kaufman, J. S., Ross, E., Quan, M., O'Rielly, K., & Crusto, C. (2004). Building the evaluation capacity of community-based organizations: The Bridgeport Safe Start Initiative. The Community Psychologist, 37(4), 45–47.
Kelly, J. G. (1988). A guide to conducting prevention research in the community: First steps. Binghampton, NY: The Haworth Press.
Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels. San Francisco: Berret-Koehler.
Knapp, M. S. (1995). How shall we study comprehensive, collaborative services for children and families? Educational Researcher, 24(4), 5–16.
Koch, R., Cairns, J. M., & Brunk, M. (2000). How to involve staff in developing an outcomes-oriented organization. Education and Treatment of Children, 21(1), 41–47.
Lourie, I. S., Stroul, B. A., & Friedman, R. M. (1998). Community-based systems of care: From advocacy to outcomes. In M. H. Epstein, K. Kutash, & A. Duchnowski. (Eds.), Outcomes for children and youth with emotional and behavioral disorders and their families: Programs and evaluation best practices (pp. 3–19). Austin, TX: PRO-ED, Inc.
Meyers, J., Kaufman, M., & Goldman, S. (1999). Promising practices: Training strategies for serving children with serious emotional disturbance and their families in a system of care. Systems of care: Promising practices in children's mental health, 1998 Series, Volume V. Washington, DC: Center for Effective Collaboration and Practice, American Institutes for Research.
Mohr, L. B. (1988). Impact analysis for program evaluation. Chicago: The Dorsey Press.
Nachbar, N., & Grason, H. A. (1995). Public MCH Program Functions Framework: Essential Public Health Services Promote Maternal and Child Health in America. Rockville, MD: U.S. Department of Health and Human Services.
OJJDP Juvenile Justice Bulletin. (2001). Keeping children safe: OJJDP's child protection division. Rockville, MD: Author.
OJJDP Fact Sheet. (2001). Children's exposure to violence: The safe start Initiative. Rockville, MD: Author.
O'Sullivan, R. G., & O'Sullivan, J. M. (1998). Evaluation voices: Promoting evaluation from within programs through collaboration. Evaluation and Program Planning, 21, 21–29.
Patton, M. Q. (1980). Qualitative evaluation methods. Beverly Hills: Sage.
Patton, M. Q. (1986). Utilization-focused evaluation, (2nd. ed.). Newbury Park, CA: Sage.
Patton, M. Q. (1997). Utilization-focused evaluation: The new century text (3rd. ed.). Thousand Oaks, CA: Sage.
Phillips, P. P., & Phillips, J. J. (2001). Symposium on the evaluation of training. International Journal of Training and Development, 5, 240–247.
Price, R. H., & Smith, S. S. (1985). A guide to evaluating prevention programs in mental health. (DHHS Publication No. ADM 85–1365). Washington, DC: US Government Printing Office.
Ritter, J., Stewart, M., Bernet, C., Coe, M., & Brown, S. A. (2002). Effects of childhood exposure to familial alcoholism and family violence on adolescent substance use, conduct problems, and self-esteem. Journal of Traumatic Stress, 15(2), 113–122.
Rosenblatt, A., Wyman, N., Kingdon, D., & Ichinose, C. (1998). Managing what you measure: Creating outcome-driven systems of care for youth with serious emotional disturbances. Journal of Behavioral Health Services & Research, 25(2), 177–193.
Rosnow, R. L., & Georgoudi, M. (Eds.). (1986). Contextualism and understanding in behavioral science. Implications for research and theory. New York: Praeger.
Rossi, P. H., Freeman, H. E., & Lipsey, M. W. (1999). Evaluation: A systematic approach (6th. ed.). Thousand Oaks, CA: Sage.
Shadish, W. R. (1995). Philosophy of science and the quantitative–qualitative debates: Thirteen common errors. Evaluation and Planning, 18(1), 63–75.
Stroul, B. A., & Friedman, R. M. (1986). A system of care for severely emotionally disturbed children and youth. Washington, DC: Georgetown University.
Tebes, J. K., Kaufman, J., & Watts, R. (2002). System development and system change. The Community Psychologist, 35, 13–14.
Tebes, J. K. (2005). Community science, philosophy of science, and the practice of research. American Journal of Community Psychology, 35(3–4), 213–230.
Tebes, J. K., Bowler, S., Shah, S., Connell, C., Ross, E., Simmons, R., et al. (2005). Service access and service system development in a children's behavioral health system of care. Evaluation and Program Planning, 28(2), 151–160.
Tebes, J. K., Kaufman, J. S., & Connell, C. M. (2003). The evaluation of prevention and health promotion programs. In T. P. Gullotta & M. Bloom. (Eds.), Encyclopedia of Primary Prevention and Health Promotion (pp. 42–61). New York, NY: Kluwer Academic/Plenum Publishers.
Tebes, J. K., Kaufman, J. S., Connell, C., & Ross, E. (2001, June). Designing an evaluation to inform public policy. In J.K. Tebes (Chair), Real world contexts in program evaluation. Symposium conducted at the Eighth Biennial Conference of the Society for Community Research and Action, Atlanta, GA.
Tighe, T. A., Pandina, N. G., Burchard, J. D., Kelley, D. P., Coe, M. E., Bramley, J. A., et al. (2001). Evaluation lessons learned in Vermont. In M. Hernandez. (Ed.), Developing outcome strategies in children's mental health systems of care for children's mental health (pp. 81–96). Baltimore, MD: Paul H. Brookes Publishing Co.
U.S. Census Bureau. (n.d.) Census 2000, Summary File 1 (SF 1) and Summary File 3 (SF 3). Retrieved November 9, 2004, from http://factfinder.census.gov/servlet/SAFFFacts?_event= ChangeGeoContext&geo_id=16000US0908000&_geoContext=& _street=&_county=bridgeport&_cityTown=bridgeport&_state =04000US09&_zip=&_lang=en&_sse=on&ActiveGeoDiv= &_useEV=&pctxt=fph&pgsl=010.
U.S. Department of Health and Human Services. (2000). Healthy People 2010 (2nd. ed.) With Understanding and Improving Health and Objectives for Improving Health. 2 vols. Washington, DC: Government Printing Office.
Usher, C. L. (1998). Managing care across systems to improve outcomes for families and communities. Journal of Behavioral Health Services and Research, 25(2), 217–229.
Weiss, C. H. (1972) Evaluation research: Methods of assessing program effectiveness. Englewood Cliffs, NH: Prentice-Hall.
W. K. Kellogg Foundation. (2000). Using logic models to bring together planning, evaluation & action: Logic model development guide. Battle Creek, MI: W. K. Kellogg Found-ation.
Yexley, M., Borowsky, I., & Ireland, M. (2002). Correlation between different experiences of intrafamilial physical violence and violent adolescent behavior. Journal of Interpersonal Violence, 17(7), 707–720.
Acknowledgements
This project was supported by Grant #2004-52331-CT-MC awarded by the Office of Juvenile Justice and Delinquency Prevention, Office of Justice Programs, U.S. Department of Justice. Points of view or opinions in this document are those of the authors and do not necessarily represent the official position or policies of the U.S. Department of Justice. The authors would like to thank Jack Tebes, Kathy Sikkema, Christian Connell, Tami Sullivan, and the special edition editors and reviewers for their helpful comments on earlier drafts of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kaufman, J.S., Crusto, C.A., Quan, M. et al. Utilizing Program Evaluation as a Strategy to Promote Community Change: Evaluation of a Comprehensive, Community-Based, Family Violence Initiative. Am J Community Psychol 38, 191–200 (2006). https://doi.org/10.1007/s10464-006-9086-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10464-006-9086-8