Abstract
Scholars and practitioners around the globe are grappling with how to improve the effectiveness of complex, transboundary, and multilevel environmental regimes. International environmental agreements (IEAs) have been around for decades yet achievements and outcomes have not met expectations. While international relations scholars have primarily focused on the effectiveness of agreements between states, public policy scholars have been interested in outcomes at a variety of scales including international, national, sub-national, and local across various environmental policy domains and at the instrument and program levels. This article presents findings from a case study of environmental regime effectiveness that uses a modified version of the Oslo-Postdam solution to assess the effectiveness of the Great Lakes Water Quality Agreement, a long-standing, bilateral international environmental agreement between Canada and the USA. The findings indicate that there is a need to more broadly define international environmental agreements in complex transboundary systems to include both formal and informal regime features and multilevel governance efforts and to focus on specific policy goals and ecological outcomes associated with IEAs. This case also illustrates the potential to modify the Oslo-Postdam approach by combining expert assessment and data collection methods with traditional policy analysis and program evaluation methods in assessments of environmental regime effectiveness.
Similar content being viewed by others
Notes
Response scale for actual performance: not achieved at all (0); very little achieved (1); some achievement (2); partially achieved (3); mostly achieved (4) and fully achieved (5).
For detailed qualitative comments from open-ended survey questions, see Johns et al. (2015).
Response scale for NR and CO using a 7-point scale from: no contribution (0); low contribution (0.15); low–medium contribution (.35); medium contribution (.50); medium–high contribution (.65); high contribution (.85), and complete contribution (1.0).
In the case of GO(ii), the standard deviation is .859, meaning that 85.9% of responses fall within the range of plus or minus one standard deviation around the mean of 2.64. There was a high degree of agreement among respondents that this objective has been some or partially achieved.
We adapted this scale to 0–5 and then re-weighted to get value out of 10 (with 0 indicating no level of accomplishment to 10 being complete accomplishment) in order to apply the Oslo-Potsdam formula.
We used a quantitative question (Survey Question 2) that included a list of eight programs and measures and use the mean of responses to all those questions divided by number of possible responses (7) to arrive at value from 0 to 1.
The standard deviation is .848, meaning that 84.8% of responses fall within the range of plus or minus one standard deviation around the mean of 1.93 (within 1 response below .939 very little achieved) or 1 response above the mean at 2.93 (partially achieved).
References
Andresen, S., & Wettestad, J. (2001). Case studies of the effectiveness of international environmental regimes: Balancing textbook ideals and feasibility concerns. Report for the Fridtjof Nansen Institute.
Balsiger, J., & Prys, M. (2016). Regional agreements in international environmental politics. International Environmental Agreements, 16, 239–260.
Bang, G. (2011). Signed but not ratified: Limits to U.S. participation in international environmental agreements. Review of Policy Research, 28(1), 65–81.
Bang, G., Hovi, J., & Sprinz, D. F. (2012). US presidents and the failure to ratify multilateral environmental agreements. Climate Policy, 12(6), 755–763.
Bodin, Ö., & Österblom, H. (2013). International fisheries regime effectiveness—Activities and resources of key actors in the Southern Ocean. Global Environmental Change, 23(5), 948–956.
Breitmeier, H., Young, O., & Zurn, M. (2006). Analyzing international environmental regimes: From case study to database. Cambridge, MA: MIT Press.
Dimitrov, R., Sprinz, D., DiGuiusto, G. M., & Kelle, A. (2007). International non-regimes: A research agenda. International Studies Review, 9, 230–258.
Dombrowsky, I. (2008). Institutional design and regime effectiveness in transboundary river management: The Elbe water quality regime. Hydrology and Earth System Sciences Discussions, 12(1), 223–238.
Frantzi, S. (2008). What determines the institutional performance of environmental regimes? A case study of the Mediterranean Action Plan. Marine Policy, 32, 618–629.
Frantzi, S., Carter, N. T., & Lovett, J. C. (2009). Exploring discourses on international environmental regime effectiveness with Q methodology: A case study of the Mediterranean Action Plan. Journal of Environmental Management, 90(1), 177–186.
Gehring, T. (2004). Methodological issues in the study of broader consequences. In A. Underdal & O. R. Young (Eds.), Regime consequences: Methodological challenges and research strategies (pp. 219–247). Dordrecht: Kluwer.
Giorano, M., et al. (2014). A review of the evolution and state of transboundary freshwater treaties. International Environmental Agreements, 14, 245–264.
Grundig, F. (2012). Dealing with the temporal domain of regime effectiveness: A further conceptual development of the Oslo-Potsdam solution. International Environmental Agreements, 12, 111–127.
Helm, C., & Sprinz, D. (2000). Measuring the effectiveness of international environmental regimes. Journal of Conflict Resolution, 44(5), 630–652.
Hill, J. P., & Eichinger, D. (2013). A framework for assessing the effectiveness of programs and other measures developed to address the objectives of the Great Lakes Water Quality Agreement. Report for the International Joint Commission.
Hovi, J., Sprinz, D., & Underdal, A. (2003). The Oslo-Potsdam solution to measuring regime effectiveness: Critique, response, and the road ahead. Global Environmental Politics, 3(3), 74–96.
International Environmental Agreements Database Project. (2016). About us. https://iea.uoregon.edu.
International Joint Commission. (2011). Assessment of progress made towards restoring 759 and maintaining Great Lakes water quality since 1987.
International Joint Commission (2017) First triennial assessment of progress on 2012 great lakes water quality agreement. http://ijc.org/files/tinymce/uploaded/GLWQA/TAP.pdf.
Jackson, W., & Buhrs, T. (2015). International environmental regimes: Understanding international and ecological effectiveness. Journal of International Wildlife Law and Policy, 18, 63–83.
Johns, C., & Thorn, A. (2015). Sub-national diplomacy in the Great Lakes Region: Towards explaining variation between water quality and quantity regimes. Canadian Foreign Policy Journal, 21(3), 195–211.
Johns, C., VanNijnatten, D., & Thorn, A. (2015). Testing a framework for the effectiveness of programs and other measures related to the implementation of the Great Lakes Water Quality Agreement. Paper commissioned by the International Joint Commission.
Keohane, R. O. (1989). International institutions and state power: Essays in international relations. Boudler, CO: Westview Press.
Kutting, G. (2000). Environment, society and international relations: Towards more effective international environmental agreements. London: Routledge.
Levy, M. A., Osherenko, G., & Young, O. R. (1991). The effectiveness of international regimes: A design for large-scale collaborative research. Institute for Arctic Studies, at Dartmouth College, Hanover, New Hampshire.
Miles, E. L., et al. (2002). Comparative regime effectiveness across several cases. In E. L. Miles, S. Andresen, J. Wettestad, J. B. Skjærseth, & E. M. Carlin (Eds.), Environmental regime effectiveness: Confronting theory with evidence (pp. 3–45). Cambridge, MA: MIT Press.
Mitchell, R. B. (2006). Problem structure, institutional design, and the relative effectiveness of international environmental agreements. Global Environmental Politics, 6(3), 72–89.
Mitchell, R. B. (2008). Evaluating the performance of environmental institutions: What to evaluate and how to evaluate it? In O. R. Young, L. A. King, & H. Schroeder (Eds.), Institutions and environmental change: Principal findings, applications and research (Vol. 79, pp. 83–84).
Mitchell, R. B. (2013). Oran Young and international institutions. International Environmental Agreements, 13, 1–14.
Mitchell, R. B. (2016). International environmental agreements (IEAs) defined’. International Environmental Agreements (IEA) Database Project 2002–2016 website. https://iea.uoregon.edu/international-environmental-agreements-ieas-defined.
Skaerseth, J. (2003). Managing North Sea pollution effectively: Linking international and domestic institutions. International Environmental Agreements, 3, 167–190.
Slaughter, A.-M. (2004). A new world order. Princeton: Princeton University Press.
Sprinz, D. F., & Helm, C. (1999). The effect of global environmental regimes: A measurement concept. International Political Science Review, 20(4), 359–369.
Stokke, O. (1997). Regimes and governance systems. In O. R. Young (Ed.), Global governance, drawing insights from the environmental experience. Cambridge, MA: MIT Press.
Stokke, O. (2012). Disaggregating international regimes: A new approach to evaluation and comparison. Cambridge: MIT Press.
Sussman, G. (2004). The USA and global environmental policy: Domestic constraints on effective leadership. International Political Science Review, 25(4), 349–369.
Underdal, A. (2002). One question, two answers. In E. L. Miles, S. Andresen, J. Wettestad, J. B. Skjærseth, & E. M. Carlin (Eds.), Environmental regime effectiveness: Confronting theory with evidence (pp. 3–45). Cambridge, MA: MIT Press.
Underdal, A. (2004). Methodological challenges in the study of regime effectiveness. In A. Underdal & O. R. Young (Eds.), Regime consequences: Methodological challenges and research strategies (pp. 27–48). Dordrecht: Kluwer.
Underdal, A., & Young, O. R. (2004a). Research strategies for the future: Where do we go from here? In A. Underdal & O. R. Young (Eds.), Regime consequences: Methodological challenges and research strategies (pp. 361–380). Dordrecht: Kluwer.
Underdal, A., & Young, O. R. (Eds.). (2004b). Regime consequences: Methodological challenges and research strategies. Dordrecht: Kluwer.
United States Environmental Protection Agency and Environment Canada and Climate Change. (2016). Progress report of the parties. https://binational.net/wp-content/uploads/2016/09/PRP-160927-EN.pdf.
VanNijnatten, D. L. (2011). From the International Joint Commission to Copenhagen: Bilateral environmental management in a North American Regional Context. In C. Sands & G. Anderson (Eds.), Forgotten partnership redux: Canada–US Relations in the twenty-first century. Amherst NY: Cambria Press.
VanNijnatten, D. L. (2016). The aquatic invasion: Assembling transboundary governance capacity for prevention and detection. International Journal of Water Governance (Special issue on “Assessing Adaptive Transboundary Governance Capacity in the Great Lakes Basin”), 4(1), 91–110.
Wettestad, J. (2001). Designing effective environmental regimes: The conditional keys. Global Governance, 7(3), 317–341.
Young, O. (Ed.). (1999). The effectiveness of international environmental agreements: Causal connections and behavioural mechanisms. Cambridge, MA: MIT Press.
Young, O. R. (2001). Inferences and indices: Evaluating the effectiveness of international environmental regimes. Global Environmental Politics, 1(1), 99–121.
Young, O. R. (2002a). The institutional dimension of environmental change: Fit, interplay, and scale. Cambridge, MA: MIT Press.
Young, O. R. (2002b). Evaluating the success of international environmental regimes: Where are we now? Global Environmental Change, 12, 73–77.
Young, O. R. (2003). Determining regime effectiveness: A commentary on the Oslo-Potsdam solution. Global Environmental Politics, 3(3), 97–104.
Young, O. R. (2011). Effectiveness of international environmental regimes: Existing knowledge, cutting-edge themes, and research strategies. Proceedings of the National Academy of Sciences, 108(50), 19853–19860.
Young, O. R. (2013). Sugaring off: Enduring insights from long-term research on environmental governance. International Environmental Agreements, 13, 87–105.
Young, O. R., & Zurn, M. (2006). The international regimes database: Designing and using a sophisticated tool for institutional analysis. Global Environmental Politics, 6(3), 121–143.
Young, O. R., King, L. A., Schroeder, H. (Ed.). (2008). Institutions and environmental change : Principal findings, applications, and research frontiers. Cambridge, MA: MIT Press.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Johns, C., Thorn, A. & VanNijnatten, D. Environmental regime effectiveness and the North American Great Lakes Water Quality Agreement. Int Environ Agreements 18, 315–333 (2018). https://doi.org/10.1007/s10784-018-9385-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10784-018-9385-1