Skip to main content

Advertisement

SpringerLink
Log in

Evaluation Criteria for Participatory Research: Insights from Coastal Uruguay

  • Published:
Environmental Management Aims and scope Submit manuscript

Abstract

Participatory research in which experts and non-experts are co-researchers in addressing local concerns (also known as participatory action research or community-based research) can be a valuable approach for dealing with the uncertainty of social–ecological systems because it fosters learning among stakeholders and co-production of knowledge. Despite its increased application in the context of natural resources and environmental management, evaluation of participatory research has received little attention. The objectives of this research were to define criteria to evaluate participatory research processes and outcomes, from the literature on participation evaluation, and to apply them in a case study in an artisanal fishery in coastal Uruguay. Process evaluation criteria (e.g., problem to be addressed of key interest to local and additional stakeholders; involvement of interested stakeholder groups in every research stage; collective decision making through deliberation; and adaptability through iterative cycles) should be considered as conditions to promote empowering participatory research. Our research contributes to knowledge on evaluation of participatory research, while also providing evidence of the positive outcomes of this approach, such as co-production of knowledge, learning, strengthened social networks, and conflict resolution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. One of the articles reviewed by Stephens and Berner (2011) is Rowe and Frewer (2000). Therefore, when the former authors cited only the latter article for defining a criterion, we have just cited Rowe and Frewer (2000) instead of Stephens and Berner (2011).

  2. Since late 2013, POPA members have been conducting a formative evaluation of their new project about the assessment of fish traps as alternative fishing gear that could mitigate the sea lions’ impact in Piriápolis.

References

  • Armitage D, Berkes F, Doubleday N (2007) Adaptive co-management: collaboration, learning and multi-level governance. University of British Columbia Press, Vancouver, British Columbia

    Google Scholar 

  • Armitage D, Berkes F, Dale A, Kocho-Schellenberg E, Patton E (2011) Co-management and the co-production of knowledge: learning to adapt in Canada’s Arctic. Glob Environ Change 21:995–1004

    Article  Google Scholar 

  • Arnold JS, Fernandez-Gimenez M (2007) Building social capital through participatory research: an analysis of collaboration on Tohono O’odham tribal rangelands in Arizona. Soc Nat Resour 20:481–495

    Article  Google Scholar 

  • Bellamy JA, Walker DH, McDonald GT, Syme GJ (2001) A systems approach to the evaluation of natural resource management initiatives. J Environ Manage 63:407–423

    Article  CAS  Google Scholar 

  • Berkes F (2009) Social aspects of fisheries management. In: Cochrane KL, Garcia SM (eds) A fishery manager’s guidebook, 2nd edn. Wiley-Blackwell, Oxford, pp 52–74

    Chapter  Google Scholar 

  • Berkes F, Colding J, Folke C (2003) Navigating social-ecological systems: building resilience for complexity and change. Cambridge University Press, Cambridge

    Google Scholar 

  • Bernard HR (2006) Research methods in anthropology: qualitative and quantitative approaches, 4th edn. Altamira Press, Lanham

    Google Scholar 

  • Biggs S (1989) Resource-poor farmer participation in research: a synthesis of experiences from nine national agricultural research systems. OFCOR Comparative Study Paper 3, International Service for National Agricultural Research, The Hague

  • Blackstock KL, Kelly GJ, Horsey BL (2007) Developing and applying a framework to evaluate participatory research for sustainability. Ecol Econ 60(4):726–742

    Article  Google Scholar 

  • Bocking S (2004) Nature’s experts: science, politics, and the environment. Rutgers University Press, New Brunswick

    Google Scholar 

  • Cambell J, Salagrama V (2001) New approaches to participation in fisheries research. FAO Fisheries Circular No. 965, Rome

  • Chevalier JM, Buckles DJ (2013) Participatory action research: theory and methods for engaged inquiry. Routledge, London and New York

    Google Scholar 

  • Chopyak J, Levesque PN (2002) Community-based research and changes in the research landscape. Bull Sci Technol Soc 22(3):203–209

    Article  Google Scholar 

  • Conley A, Moote MA (2003) Evaluating collaborative natural resource management. Soc Nat Resour 16:371–386

    Article  Google Scholar 

  • Cornwall A, Jewkes R (1995) What is participatory research? Soc Sci Med 41(12):1667–1676

    Article  CAS  Google Scholar 

  • Dunn K (2008) Interviewing. In: Hay I (ed) Qualitative research methods in human geography. Oxford University Press, Melbourne, pp 79–105

    Google Scholar 

  • Fals Borda O (1987) The application of participatory action-research in Latin America. Int Sociol 2(4):329–347

    Article  Google Scholar 

  • Fiorino DJ (1990) Citizen participation and environmental risk: a survey of institutional mechanisms. Sci Technol Human Values 15(2):226–243

    Article  Google Scholar 

  • Fisher F (2000) Citizens, experts, and the environment: the politics of local knowledge. Duke University Press, London

    Book  Google Scholar 

  • Funtowicz SO, Ravetz JR (2000) La ciencia posnormal: ciencia con la gente. Icaria, Barcelona

    Google Scholar 

  • Gaventa J, Cornwall A (2001) Power and knowledge. In: Reason P, Bradbury H (eds) The sage handbook of action research: participative inquiry and practice. Sage Publications, London, pp 70–80

    Google Scholar 

  • Guba EG, Lincoln YS (1989) Fourth generation evaluation. Sage Publications, Thousand Oaks

    Google Scholar 

  • Hartley TW, Robertson RA (2006) Stakeholder engagement, cooperative fisheries research and democratic science: the case of the Northeast Consortium. Human Ecol Rev 13(2):161–171

    Google Scholar 

  • Kemmis S, McTaggart R (2005) Participatory action research: communicative action and the public sphere. In: Denzin NK, Lincoln YS (eds) The sage handbook of qualitative research sage publications. Thousand Oaks, California, pp 559–603

    Google Scholar 

  • Kindon S (2008) Participatory action research. In: Hay I (ed) Qualitative research methods in human geography. Oxford University Press, Melbourne, pp 207–220

    Google Scholar 

  • Krefting L (1991) Rigor in qualitative research: the assessment of trustworthiness. Am J Occup Theory 45(3):214–222

    Article  CAS  Google Scholar 

  • Lázaro M, Trimble M, Umpiérrez A, Vasquez A, Pereira G (2013) Juicios Ciudadanos en Uruguay: dos experiencias de participación pública deliberativa en ciencia y tecnología. Montevideo

  • Ludwig D (2001) The era of management is over. Ecosystems 4:758–764

    Article  Google Scholar 

  • Morse JM, Barrett M, Mayan M, Olson K, Spiers J (2002) Verification strategies for establishing reliability and validity in qualitative research. Int J Qual Methods 1(2):13–22

    Google Scholar 

  • Neiland AE, Bennett E, Townsley P (2005) Participatory research approaches—what have we learned? The experience of the DFID Renewable Natural Resources Research Strategy (RNRRS) Programme 1995–2005. Summary document. Department for International Development, UK

  • Plummer R, Armitage D (2007) A resilience-based framework for evaluating adaptive co-management: linking ecology, economics and society in a complex world. Ecol Econ 61(1):62–74

    Article  Google Scholar 

  • Reason P (1994) Three approaches to participatory inquiry. In: Denzin NK, Lincoln YS (eds) Handbook of qualitative research. Sage Publications, Thousand Oaks, pp 324–339

    Google Scholar 

  • Rowe G, Frewer LJ (2000) Public participation methods: a framework for evaluation. Sci Technol Human Values 25(1):3–29

    Article  Google Scholar 

  • Rowe G, Marsh R, Frewer LJ (2004) Evaluation of a deliberative conference in science. Technol Human Values 29:88–121

    Article  Google Scholar 

  • Shirk JL, Ballard HL, Wilderman CC, Phillips T, Wiggins A, Jordan R, McCallie E, Minarchek M, Lewenstein BV, Krasny ME, Bonney R (2012) Public participation in scientific research: a framework for deliberate design. Ecol Soc 17(2):29

    Google Scholar 

  • Stephens JB, Berner M (2011) Learning from your neighbor: The value of public participation evaluation for public policy dispute resolution. Journal of Public Deliberation 7(1):Art No 10

    Google Scholar 

  • Trimble M (2013) Towards adaptive co-management of artisanal fisheries in coastal Uruguay: analysis of barriers and opportunities, with comparisons to Paraty (Brazil). Dissertation, University of Manitoba

  • Trimble M, Berkes F (2013) Participatory research towards co-management: lessons from artisanal fisheries in coastal Uruguay. J Environ Manage 128:768–778

    Article  Google Scholar 

  • Trimble M, Johnson D (2013) Artisanal fishing as an undesirable way of life? The implications for governance of fishers’ wellbeing aspirations in coastal Uruguay and southeastern Brazil. Marine Policy 37:37–44

    Article  Google Scholar 

  • Trimble M, Araujo LG, Seixas CS (2014) One party does not tango! Fishers’ non-participation as a barrier to co-management in Paraty, Brazil. Ocean and Coastal Management 92:9–18

    Google Scholar 

  • Walker GB, Daniels SE (2001) Natural resource policy and the paradox of public involvement: bringing scientists and citizens together. In: Gray GJ, Enzer MJ, Kusel J (eds) Understanding community-based ecosystem management. The Haworth Press Inc, New York, pp 253–269

    Google Scholar 

  • Webler T, Tuler S (2002) Unlocking the puzzle of public participation. Bull Sci Technol Soc 22(3):179–189

    Article  Google Scholar 

  • Wiber M, Berkes F, Charles A, Kearney J (2004) Participatory research supporting community-based fishery management. Marine Policy 28(6):459–468

    Article  Google Scholar 

  • Wilmsen C, Elmendorf W, Fisher L, Ross J, Sararthy B, Wells G (2008) Partnerships for empowerment: participatory research for community-based natural resource management. Earthscan, London

    Google Scholar 

  • Yin RK (1994) Case study research. Design and methods. Sage Publications Inc., Thousand Oaks

    Google Scholar 

  • Zurba M, Trimble M (under review) Youth as the Inheritors of Collaboration: crisis and factors that influence participation of the next generation in natural resource management. Environmental Science & Policy

Download references

Acknowledgments

This paper is part of the first author’s PhD research supported by the University of Manitoba Graduate Fellowship, Manitoba Graduate Scholarship, and the International Development Research Centre through the IDRC/CRC International Research Chairs Initiative. Special thanks to the members of POPA (Por la Pesca Artesanal en Piriápolis) for their unconditional support. Patricia Iribarne provided invaluable assistance in the field. The intellectual support of Fikret Berkes (Canada Research Chair in Community-Based Resource Management) is deeply acknowledged. We also thank Jennifer Arnold, two anonymous reviewers, and the Editorial Board for their important contributions to this article.

Author information

Author notes

  1. Micaela Trimble

    Present address: Center for Marine Studies (CEM), Federal University of Paraná (UFPR), Av. Beira-mar, s/n, Pontal do Sul - Pontal do Paraná, Paraná, 83255-976, Brazil

Authors and Affiliations

  1. Natural Resources Institute, University of Manitoba, 303-70 Dysart Road, Winnipeg, Manitoba, R3T 2N2, Canada

    Micaela Trimble

  2. Unidad de Ciencia y Desarrollo, Facultad de Ciencias, Universidad de la República (UDELAR), Montevideo, Uruguay

    Micaela Trimble & Marila Lázaro

Authors
  1. Micaela Trimble
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marila Lázaro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Micaela Trimble.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Trimble, M., Lázaro, M. Evaluation Criteria for Participatory Research: Insights from Coastal Uruguay. Environmental Management 54, 122–137 (2014). https://doi.org/10.1007/s00267-014-0276-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00267-014-0276-0

Keywords

Search

Navigation