Skip to main content

Advertisement

SpringerLink
Log in

Ethnographically Informed Community Evaluation: A Framework and Approach for Evaluating Community-Based Initiatives

  • Original Paper
  • Published:
Maternal and Child Health Journal Aims and scope Submit manuscript

Abstract

Objectives: This paper describes ethnographically informed community evaluation (EICE), a framework for evaluating complex community-based interventions, and illustrates its use in the evaluation of Baltimore City Healthy Start, a federally funded infant mortality prevention project. EICE, which is influenced by cultural anthropology and assets-based community assessment, supports continuous program improvement, resident involvement, and measurement of community-level change. This approach takes into account both individual and contextual levels of analysis.

Methods: The evaluation coupled a participatory approach with qualitative and survey research methods to study community context and how it might contribute to infant mortality and influence program implementation, and to assess community change resulting from the program. Data collection included focus groups, key informant interviews, surveys, neighborhood mapping, journaling, and a study of community problem-solving.

Results: The evaluation provided program-related feedback to staff, contributed to a collective understanding of the local context, validated and augmented outcome findings, and imparted skills and a sense of empowerment to the neighborhood. Results reveal a community burdened by crime and social problems, yet showing great diversity in physical and social conditions when examined at the census block group level. Nevertheless, these social and physical hazards in the community are more salient than any specific health issue such as infant mortality.

Conclusions: EICE is a powerful evaluation approach able to respond to the complexities of community-based maternal and child health initiatives designed to institute changes across multiple domains. EICE may be used, in whole or in part, as a supplement to traditional designs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Institute of Medicine. From neurons to neighborhoods: The science of early childhood development. Washington, DC: National Academy Press; 2000.

    Google Scholar 

  2. Institute of Medicine. The future of the public’s health in the 21st century. Washington, DC: National Academies Press; 2003.

    Google Scholar 

  3. Israel B, et al. The Detroit community-academic urban research center: Development, implementation, and evaluation. J Public Health Manag 2001;7(5):1–19.

    CAS  Google Scholar 

  4. Smedley B, Syme L, editors. Promoting health: Intervention strategies from social and behavioral research. Washington, DC: National Academy Press; 2000.

    Google Scholar 

  5. Annie EV. Casey Foundation. Making Connections: A Neighborhood Transformation Family Development Initiative. 2002 [cited 2005 October 12]; Available from: www.aecf.org/initiatives/ntfd/index.htm.

  6. World Health Organization. Healthy cities around the world: An overview of the healthy cities movement in the six WHO regions. Belfast, Ireland: World Health Organization; 2003.

    Google Scholar 

  7. Thompson M-M, Vanneman J, Bloom F, editors. The Healthy Start initiative: A community-driven approach to infant mortality reduction—volume II. Early implementation: Lessons learned. ed. National Center for Education in Maternal and Child Health, Arlington, VA: Health. National Center for Education in Maternal and Child Health; 1994.

  8. U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. Early Head Start Research: Early Head Start Research and Evaluation Project (EHSRE), 1996–2005. 2005 March 25, 2005 [cited 2005 3-25-2005]; Available from: http://www.acf.hhs.gov/programs/opre/hs/faces/instruments/child_instru02/instru02_index.html.

  9. Puma M, et al. Building futures: The Head Start impact study. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Head Start Bureau; 2001.

    Google Scholar 

  10. Mann TE, Schorr LB. Learning what works: Evaluating complex social interventions. in learning what works: Evaluating complex social interventions, October 22, 1997. Washington, DC: The Brookings Institution; 1998.

  11. Annie E. Casey Foundation. Evaluating comprehensive community change. Baltimore, MD: Annie E. Casey Foundation; 1997.

    Google Scholar 

  12. Barnette JJ, Wallis AB. The missing treatment design element: Continuity of treatment when multiple postobservations are used in time-series and repeated measures study designs. Am J Eval 2005;26(1):106–23.

    Article  Google Scholar 

  13. Murphy-Berman V, Schnoes C, Chambers JM. An early stage evaluation model for assessing the effectiveness of comprehensive community initiatives: Three case studies in Nebraska. Eval Program Plann 2000;23:157–63.

    Article  Google Scholar 

  14. Gliner J, Sample P. A multimethod approach to evaluate transition into community life. Eval Program Plann 1996;19(3):225–33.

    Article  Google Scholar 

  15. Weitzman B, Silver D. Facing the challenge of evaluating a complex, multi-site initiative. Eval Exch 2003;IX(3).

  16. Kottak CP. Cultural anthropology. Boston: McGraw-Hill College; 1999.

    Google Scholar 

  17. Whitehead TL. In search of soul food. In: Baer H, Jones Y, editors. African Americans in the south. Athens, GA: University of Georgia Press; 1992.

    Google Scholar 

  18. Brown P, Inhorn MC, Smith DJ. Disease, ecology and human behavior. In: Johnson T, Sargent C, editors. Medical anthropology: A handbook of theory and method. Westport, CT: Praeger; 1996, pp. 183–219.

    Google Scholar 

  19. Jerome NW, Kandel RF, Pelto GH. An ecological approach to nutritional anthropology. In: Jerome NW, Kandel RF, Pelto GH, editors. Nutritional anthropology: Contemporary approaches to diet and culture. New York: Gordon & Breach Science Publications; 1980.

    Google Scholar 

  20. Whitehead TL. Sociocultural dynamics and food habits in a southern community. In: Douglas M, editor. Food in the social order. New York: Russell Sage Foundation; 1984.

    Google Scholar 

  21. Whitehead TL. What is ethnography? Methodological, ontological, and epistemological attributes. In: Ethnographically Informed Community and Cultural Assessment Research Systems (EICCARS) Working Paper Series, University of Maryland. College Park, MD; 2004.

  22. Freire P. Pedagogy of the oppressed. New York: Seabury Press; 1970.

    Google Scholar 

  23. Freire P. Creating alternative research methods: Learning to do it by doing it. In: Hall BL, Gillette A, Tandon R, editors. Creating knowledge: A monopoly? Participatory research in development. New Delhi: Society for Participatory Research in Asia; 1982.

    Google Scholar 

  24. Lewin K. Action research and minority problems. J Soc Issues 1946;2:34–46.

    Article  Google Scholar 

  25. Israel B, et al. Review of community-based research: Assessing partnership approaches to improve public health. Annu Rev Public Health 1998;19:173–202.

    Article  PubMed  CAS  Google Scholar 

  26. Goodman R. Community-based participatory research: Questions and challenges to an essential approach. J Public Health Manag 2001;7(5):v–vi.

    CAS  Google Scholar 

  27. Hatch J, et al. Community research: Partnership in black communities. Am J Prev Med 1993;9(2):27–31.

    PubMed  CAS  Google Scholar 

  28. Aronson R. The community evaluation of Baltimore Healthy Start: A systematic approach to studying community participation and social change. Proposal for research. Baltimore, MD: Johns Hopkins University, School of Hygiene and Public Health, Department of International Health; 1993.

    Google Scholar 

  29. Blakely EJ. The community diagnostic method: An approach to the application of community development research. New York: Human Sciences Press; 1979.

    Google Scholar 

  30. Eng E, Blanchard L. Action-oriented community diagnosis: A health education tool. Int Q Community Health Edu 1991;11(2):93–110.

    Article  Google Scholar 

  31. Nichter M. Project community diagnosis: Participatory research as a first step toward community involvement in primary health care. Soc Sci Med 1984;19(3):237–52.

    Article  PubMed  CAS  Google Scholar 

  32. Wallis AB. Community problem-solving capacity in Baltimore City Healthy Start neighborhoods. Baltimore, MD: Department of Health Management and Policy, Johns Hopkins University, School of Hygiene and Public Health; 1996.

    Google Scholar 

  33. Aronson R. The influence of residential context on pregnancy outcome: A multi-method and multi-level study. Baltimore: Department of International Health, Johns Hopkins University, School of Hygiene and Public Health; 1997.

    Google Scholar 

  34. Wallis AB, et al. ‘… you do what you gotta do.’ Journal accounts of pregnant women from the Baltimore Healthy Start project. Baltimore, MD: Department of Maternal and Child Health, School of Hygiene and Public Health, Johns Hopkins University; 1997.

    Google Scholar 

  35. O’Campo P, et al. Neighborhood risk factors for low birthweight in Baltimore: A multilevel analysis. Am J Public Health 1997;87(7):1113–8.

    Article  PubMed  CAS  Google Scholar 

  36. Dahlgren G, Whitehead M. Policies and strategies to promote social equity in health. Stockholm: Institute for the Futures Studies; 1991.

    Google Scholar 

  37. Worthman CM. Epidemiology of human development, in hormones, health, and behavior: A socio-ecological and lifespan perpsective. In: Panter-Brick C, Worthman CM, editors. Cambridge: Cambridge University Press; 1999, pp. 47–104.

  38. Bernstein J, Brocht C, Spade-Aguilar M. How much is enough? Basic family budgets for working families. Washington, DC: Economic Policy Institute; 2000, p. 14.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Public Health Education, University of North Carolina at Greensboro, Greensboro, NC, 27403, USA

    Robert E. Aronson

  2. Department of Community & Behavioral Health, College of Public Health, University of Iowa, 200 Hawkins Drive, E223-GH, Iowa City, IA, 52242, USA

    Anne B. Wallis

  3. Inner City Health Research Unit, University of Toronto, Toronto, Canada

    Patricia J. O’Campo

  4. Department of Anthropology, University of Maryland, College Park, MD, USA

    Tony L. Whitehead

  5. Baltimore City Healthy Start, Inc., Maternal, Infant Care & Special Projects, Baltimore, MD, USA

    Peter Schafer

Authors
  1. Robert E. Aronson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anne B. Wallis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patricia J. O’Campo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tony L. Whitehead
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peter Schafer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anne B. Wallis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aronson, R.E., Wallis, A.B., O’Campo, P.J. et al. Ethnographically Informed Community Evaluation: A Framework and Approach for Evaluating Community-Based Initiatives. Matern Child Health J 11, 97–109 (2007). https://doi.org/10.1007/s10995-006-0153-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10995-006-0153-4

Keywords

Search

Navigation