Abstract
In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17 %) situated in development contexts. However, the circumstances and challenges for international development and for development evaluation are distinct from those found in developed countries and therefore warrant separate consideration. To provide a more focused and detailed understanding of participatory evaluation in international development contexts, in this paper we augment our initial sample to a total of 40 studies on participatory evaluation in development published over the past 16.5 years. Based on an analysis of this research and related theoretical and conceptual contributions we identify and discuss eight emergent themes: multiplicity of relationships, consequences of stakeholder selection, characterization of participation, contextual complexity, methodological requirements, cultural influence, politics and power and learning and capacity building. We conclude with some reflections on an agenda for research.
Similar content being viewed by others
Notes
Evaluations that endeavour to be responsive to culture and cultural context are referred to by evaluators as ‘culturally competent’, ‘culturally responsive’, ‘cross-cultural’, ‘transformative’, ‘multicultural’ etc. For more information on such approaches, see Chouinard and Cousins (2009) and SenGupta et al. (2004)).
References
Abbot, J., & Guijt, I. (1997). Methodological complementarity: Creativity and compromise. PLA Notes 28. London IIED.
Abes, R. V. (2000). Strengthening citizen participation and democratization in the Philippines: ELF’s impact evaluation. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 83–94). Ottawa: International Development Research Centre.
Alkin, M. C. (Ed.). (2012). Evaluation roots (2nd ed.). Thousand Oaks, CA: Sage.
Alzate, R. D. E. (2000). Monitoring and evaluating local development through community participation: The experience of the Association of Indigenous Cabildos of Northern Cauca, Columbia. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 95–108). Ottawa: International Development Research Centre.
Anderson, G., & Gilsig, D. (1998). Participatory evaluation in Human resource development: A case study from Southeast Asia. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 150–176). West Hartford, CN: Kumarian Press.
Arnstein, S. R. (1969). The ladder of citizen inquiry. J Am Inst Plann, 35(4), 216–224.
Ayers, T. D. (1987). Stakeholders as partners in evaluation: A stakeholder-collaborative approach. Evaluation and Programme Planning, 10, 263–271.
Bagamoyo College of Arts, Tanzania Theatre Centre, Mabala, R., & Allen, K. B. (2002). Participatory action research on HIV/AIDS through a popular theatre approach in Tanzania. Evaluation and Programme Planning, 25, 333–339.
Bamberger, M. (1991). The politics of evaluation in developing countries. Evaluation and Programme Planning, 14, 325–339.
Bhola, H. S. (2003). Social and cultural contexts of educational evaluation: A global perspective. In T. Kellaghan & D. L. Stufflebeam (Eds.), International handbook of educational evaluation (pp. 397–416). Boston: Kluwer.
Biggs, S. D. (1995, March). Participatory technology development: Reflections on current advocacy and past technological development. Paper presented at the Paper presented at the Participatory technology development workshop ‘Limits of Participation’, Intermediate Technology, London, Institute of Education.
BiNiba, J. E., & Green, J. M. (2005). Major factors influencing HIV/AIDS project evaluation. Eval Rev, 29(4), 399–413.
Blauert, J., & Quintanar, E. (2000). Seeking local indicators: Participatory stakeholder evaluation of farmer-to-farmer projects. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 32–49). Ottawa: International Development Research Centre.
Bradley, J. E., Mayfield, M. V., Mehta, M. P., & Rukonge, A. (2002). Participatory evaluation of reproductive health care quality in developing countries. Social Science and Medicine, 55, 269–282.
Brisolara, S. (1998). The history of participatory evaluation and current debates in the field. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation. New Directions in Evaluation, No. 80 (pp. 25–41). San Francisco: Jossey Bass.
Carden, F. (2010). Introduction to the forum on evaluation field building in South Asia. American Journal of Evaluation, 31(2), 219–221.
Carden, F., & Alkin, M. C. (2012). Evaluation Roots: An international perspective. Journal of Multidisciplinary Evaluation, 8(17), 108–118.
Carpentier, N., & Dahlgren, P. (2011). Introduction: Interrogating audiences—Theoretical horizons of participation. Communication Management Quarterly., 21, 7–12.
Chambers, R. (1981). Rapid rural appraisal: Rationale and repertoire. Public Administration and Development, 1, 95–106.
Chambers, R. (1994). Participatory rural appraisal (PRA): Challenges, potentials, and paradigm. World Dev, 22, 1437–1454.
Chinyowa, K. C. (2011). Revisiting monitoring and evaluation strategies for applied drama and theatre practice in African contexts. The Journal of Applied Theatre and Performance, 16(3), 337–356.
Chouinard, J. A., & Cousins, J. B. (2009). A review and synthesis of current research on cross-cultural evaluation. American Journal of Evaluation, 30(4), 457–494.
Cornachione, E. B. J., Trombetta, M. R., & Casa-Nova, S. P. (2009). Evaluation use and involvement of internal stakeholders: The case of a new non-degree online programme in Brazil. Evaluation and Programme Planning, 36, 69–81.
Cornwall, A. (2008). Unpacking ‘participation’: Models, meanings and practices. Community Development Journal, 43(3), 269–283.
Cornwall, A., & Jewkes, R. (1995). What is participatory research? Social Science and Medicine, 41(12), 1667–1676.
Coupal, F., & Simoneau, M. (1998). A case study of participatory evaluation in Haiti. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation. New Directions in Evaluation, No. 80 (pp. 69–80). San Francisco: Jossey Bass.
Cousins, J. B. (2004). Crossing the bridge: Toward understanding use through empirical inquiry. In M. C. Alkin (Ed.), Evaluation roots: Tracing theorists’ views and influences (pp. 319–330). Thousand Oaks: Sage.
Cousins, J. B., & Chouinard, J. A. (2012). Participatory evaluation up close: An integration of research-based knowledge. Charlotte, NC: Information Age Publishing, Inc.
Cousins, J. B., & Earl, L. (1995). Participatory evaluation in education: Studies in evaluation use and organizational learning. London: Falmer.
Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation. New Directions in Evaluation, No. 80 (pp. 3–23). San Francisco: Jossey Bass.
Cousins, J. B., Whitmore, E., & Shulha, L. M. (2013). Arguments for a common set of principles for collaborative inquiry in evaluation. American Journal of Evaluation, 34(1), 7–22.
Crawford, G. (2003). Promoting democracy from without—Learning from within (Part II). Democratization, 10(2), 1–20.
Crishna, B. (2006). Participatory evaluation: Sharing lessons from fieldwork in Asia. Child Care Health Dev, 33(3), 217–233.
Cullen, A. E., Coryn, C. L. S., & Rugh, J. (2011). The politics and consequences of including stakeholders in international development evaluation. American Journal of Evaluation, 32(3), 345–361.
Donaldson, S. I., Azzam, T., & Conner, R. F. (Eds.). (2013a). Emerging practices in international development evaluation. Charlotte, NC: Information Age Publishers.
Donaldson, S. I., Azzam, T., & Conner, R. F. (2013b). Future directions for improving international development evaluations. In S. I. Donaldson, T. Azzam, & R. F. Conner (Eds.), Emerging practices in international development evaluation (pp. 225–241). Charlotte, NC: Information Age Publishers.
Ellis, P. (1998). Rose Hall ten years later: A case study of participatory evaluation in St. Vincent. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 199–216). West Hartford, CN: Kumarian Press.
Estella, M., & Gaventa, J. (1998). Who counts reality? Participatory monitoring and evaluation: A literature review IDS working paper (Vol. 70. Brighton, England: University of Sussex, Institute of Development Studies.
Estrella, M., Blauert, J., Campilian, D., Gaventa, J., Gonsalves, J., Guijt, I., & Ricafort, R. (Eds.). (2000). Learning from change: Issues and experiences in participatory monitoring and evaluation. Ottawa: International Development Research Centre.
Fals-Borda, O. (1980). Science and common people. Paper presented at the International Forum on Participatory Research. Yugoslavia: Ljubljana.
Fals-Borda, O., & Anisur-Rahman, M. (1991). Action and knowledge: Breaking the monopoly with participatory action research. New York: Apex Press.
Fetterman, D. (2001). Foundations of Empowerment Evaluation. Thousand Oaks: Sage.
Feuerstein, M. (1998). Participatory evaluation: Primary health care in Patna, India. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 95–107). West Hartford, CN: Kumarian Press.
Fitzpatrick, J. L. (2012). An introduction to context and its role in evaluation practice. In D. J. Rog & R. F. Conner (Eds.), Context: A framework for its influence on evaluation practice. New Directions for Evaluation. No. 135. San Francisco: Jossey-Bass.
Forss, K., Kruse, S.-E., Taut, S., & Tenden, E. (2006). Chasing a ghost? An essay on participatory evaluation and capacity development. Evaluation, 12(10), 128–144.
Gariba, S. (1998). Participatory impact assessment as a tool for change: Lessons from poverty alleviation projects in Africa. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 64–81). West Hartford, CN: Kumarian Press.
Gasper, D. (2000). Evaluating the ‘logical framework’ approach’ toward learning-oriented development evaluation. Public Administration and Development, 20, 17–28.
Gaventa, J. (2006). Finding spaces for change: A power analysis. IDS Bulletin, 37(6), 23–33.
Gaventa, J., Creed, V., & Morrissey, J. (1998). Scaling up: Participatory monitoring and evaluation of a federal empowerment program. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation. New Directions in Evaluation, No. 80 (pp. 81–94). San Francisco: Jossey Bass.
Guijt, I. (2000). Methodological issues in participatory monitoring and evaluation. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 201–216). Ottawa: International Development Research Centre.
Guijt, I., & Shah, M. K. (2000). The myth of community: Gender issues in participatory development. Stirling VA: Kumarian Press.
Hall, B. (1992). From margins to centre? The development and purpose of participatory research. American Sociologist, 23(4), 15–28.
Hamilton, C., Rai, R. K., Shrestha, R. B., Mararjan, M., Rasaily, L., & Hood, S. (2000). Exploring visions: Self-monitoring and evaluation processes within the Nepal-UK Community Forestry Project. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gconsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 15–31). Ottawa: International Development Research Centre.
Hart, R. A., & Rajbhandary, J. (2003). Using participatory methods to further the democratic goals of children’s organizations. In K. Sabo (Ed.), Youth participatory evaluation: New Directions for Evaluation, No. 98 (pp. 61–75). San Francisco: Jossey-Bass.
Hay, K. (2010). Evaluation field building in South Asia: Reflections, anecdotes, and questions. American Journal of Evaluation, 31(2), 222–231.
Holte-McKenzie, M., Forde, S., & Theobald, S. (2006). Development of a participatory monitoring and evaluation strategy. Evaluation and Programme Planning, 29, 365–376.
Hopson, R. K. (2003). Overview of multicultural and culturally competent program evaluation: Issues, challenges and opportunities. The California Endowment: Social Policy research Associates.
House, E. R. (1993). Professional evaluation: Social impact and political consequences. Thousand Oaks, CA: Sage.
Jackson, E. T., & Kassam, Y. (Eds.). (1998). Knowledge shared: Participatory evaluation in development cooperation. West Hartford, CN: Kumarian Press.
Kariuki, J., & Njuki, J. (2013). Using participatory impact diagrams to evaluate a community development project in Kenya. Development in Practice, 23(1), 90–106.
Kassam, Y., & Mustafa, K. (1982). Participatory research: An emerging alternative methodology in social science research. Toronto: International Council for Adult Education.
Kothari, U. (2001). Power, knowledge and social control in participatory development. In B. Cook & U. Kothari (Eds.), Participation: The new tyranny? (pp. 139–152). London: Zed Books.
Lawrence, A., Haylor, G., Barahona, C., & Meusch, E. (2000). Adapting participatory methods to meet different stakeholder needs: Farmers’ experiments in Bolivia and Laos. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 50–67). Ottawa: International Development Research Centre.
Leal, P. A. (2010). Participation: The ascendancy of a buzzword in the neo-liberal era. In A. Cornwall & D. Eade (Eds.), Deconstructing development discourse: Buzzwords and fuzzwords (pp. 89–100). Warwickshire, UK: Practical Action Publishing Ltd.
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage Publications, Inc.
Long, N. (1992). Introduction. In N.Long & A. Long (Eds.), Battlefields of knowledge: The interlocking of theory and practice in social research and development (pp. 3–43). London: Routledge.
Lorde, A. (1984). Sister outsider: Essays and speeches. Berkeley, CA: Crossing Press.
MacDonald, B. (1976). Evaluation and the control of education. In D. A. Tawney (Ed.), Curriculum evaluation today: Trends and implications. London: MacMillan.
Maclure, R. (2006). Pragmatism or transformation? Participatory evaluation of a humanitarian education project in Sierra Leone. Canadian Journal of Programme Evaluation, 21(1), 107–129.
Makgamata, M. M. (2009). Challenges in implementing a participatory evaluation approach: A case study of the Limpopo Literacy Teaching Evaluation Project. Education as Change, 13(1), 91–103.
Mark, M. M. (2008). Building a better evidence base for evaluation theory: Beyond general calls to a framework of types of research on evaluation. In N. Smith & P. R. Brandon (Eds.), Fundamental issues in evaluation (pp. 111–134). New York: Guilford.
McDuff, M. D. (2001). Building the capacity of grassroots conservation organizations to conduct participatory evaluation. Environ Manage, 27(5), 715–727.
McDuff, M. D., & Jacobson, S. K. (2001). Participatory evaluation of environmental education: Stakeholder assessment of the Wildlife Clubs of Kenya. International Research in Geographical and Environmental Education, 10(2), 127–148.
McGee, R., & Gaventa, J. (2011). Shifting power? Assessing the impact of transparency and accountability initiatives. IDS Working Paper, no. 383.
McTaggart, R. (1991). When democratic evaluation doesn’t seem democratic. Evaluation Practice, 12(1), 9–12.
Morgan, P. (2013). Evaluating capacity development. In S. I. Donaldson, T. Azzam, & R. F. Conner (Eds.), Emerging practices in international development evaluation (pp. 75–104). Charlotte, NC: Information Age Publishers.
Mullinix, B. B., & Akatsa-Bukachi, M. (1998). Participatory evaluation: Offering Kenyan women power and voice. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation. New Haven CT: Kumarian Press.
Nelson, N., & Wright, S. (1995). Participation and power. In N. Nelson & S. Wright (Eds.), Power and participatory development: Theory and practice (pp. 1–18). Warwickshire, UK: ITDG Publishing.
Newman, K. (2008). Whose view matters? Using participatory process to evaluate Reflect in Nigeria. Community Development Journal, 43(3), 382–394.
Njuki, J., Mapila, M., Kaaria, S., & Magombo, T. (2008). Using community indicators for evaluating research and development programmes: Experiences from Malawi. Development in Practice, 18(4–5), 633–642.
Oakley, P. (1991). Projects with people: The practice of participation in rural development. Geneva: International Labour Organisation.
Ofir, Z., Kumar, S., & Kuzmin, A. (2013). Evaluation in developing countries: What makes it different? In S. I. Donaldson, T. Azzam, & R. F. Conner (Eds.), Emerging practices in international development evaluation (pp. 11–24). Charlotte, NC: Information Age Publishers.
Parkinson, S. (2009). Power and perceptions in participatory monitoring and evaluation. Evaluation and Programme Planning, 32, 229–237.
Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.
Reagan, T. (1996). Non-western educational traditions: Alternative approaches to educational thought and practice. Mahwah, NJ: Lawrence Erlbaum.
Rebien, C. (1996). Participatory evaluation of development assistance: Dealing with power and facilitative learning. Evaluation, 2(2), 151–171.
Ridde, V., Goossens, S., & Shakir, S. (2012). Short-term consultancy and collaborative evaluation in a post-conflict and humanitarian setting: Lessons from Afghanistan. Evaluation and Programme Planning, 35, 180–188.
Robinson, S. A., & Cox, P. (1998). Process evaluation: The Nepal Health Development project. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 122–149). West Hartford, CN: Kumarian Press.
SenGupta, S., Hopson, R., & Thompson-Robinson, M. (Eds.). (2004). Cultural competence in evaluation. New Directions for Evaluation. No. 102. San Francisco: Jossey-Bass.
Sidersky, P., & Guijt, I. (2000). Experimenting with participatory monitoring in North-east Brazil: The case of AS-PTA’s Projecto Paraiba. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 68–82). Ottawa: International Development Research Centre.
Smith, N. L. (1993). Improving evaluation theory through the empirical study of evaluation practice. Evaluation Practice, 14(3), 237–242.
Smits, P. A., Champagne, F., & Brodure, J. M. (2011). A mised method study of propensity for participatory evaluation. Evaluation and Program Planning, 34, 217–227.
Smylie, J., Martin, C. M., Kaplan-Myrth, N., Steele, L., Tait, C., & Hogg, W. (2003). Knowledge translation and indigenous knowledge. Circumpolar Health, 63(2), 139–143.
Symes, J., & Jasser, S. (2000). Growing from the grassroots: Building participatory planning, monitoring and evaluation methods in PARC. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gonsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 137–149). Ottawa: International Development Research Centre.
Tandon, R. (1981). Participatory research in the empowerment of people. Convergence, 14(3), 20–29.
Torres, D. V. H. (2000). Monitoring local development with communities: The SISDEL approach in Ecuador. In M. Estella, J. Blauert, D. Campilian, J. Gaventa, J. Gconsalves, I. Guijt, D. Johnson, & R. Riacafort (Eds.), Learning from change: Issues and experiences in participatory monitoring and evaluation (pp. 109–123). Ottawa: International Development Research Centre.
Uphoff, N. T. (1985). Fitting projects to people. In M. M. Cernea (Ed.), Putting people first: Sociological variables in rural development (pp. 359–395). New York: Oxford University Press.
VeneKlasen, L., & Miller, V. (2002). A new weave of people, power and politics: The action guide for advocacy and citizen participation. Oklahoma: World Neighbours.
Von Bertrab, A., & Zambrano, L. (2010). Participatory monitoring and evaluation of a Mexico City wetland restoration effort. Ecological Restoration, 28(3), 343–352.
Weick, K. E. (2001). Making sense of the organization. Oxford, UK: Blackwell Publishing Ltd.
Whitmore, E. (1998). “We need to rebuild this house”. The role of empowerment evaluation of a Mexican farmers’ cooperative. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 217–230). West Hartford, CN: Kumarian Press.
Wilder, L., & Walpole, M. (2008). Measuring social impacts in conservation: Experience of using the Most Significant Change technique. Ornyx, 42(4), 529–538.
Willetts, J., & Crawford, P. (2007). The most significant lessons about the most significant change technique. Development in Practice, 17(3), 367–379.
Author information
Authors and Affiliations
Corresponding author
Additional information
Invited paper submitted to Educational Assessment, Evaluation and Accountability, for publication consideration for theme issue on participatory evaluation in development.
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Chouinard, J.A., Cousins, J.B. The journey from rhetoric to reality: participatory evaluation in a development context. Educ Asse Eval Acc 27, 5–39 (2015). https://doi.org/10.1007/s11092-013-9184-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11092-013-9184-8