Abstract
Climate change is widely recognised as a ‘wicked’ policy problem. Agreeing and implementing governance responses is proving extremely difficult. Policy makers in many jurisdictions now emphasise their ambition to govern using the best available evidence. One obvious source of such evidence is the evaluations of the performance of existing policies. But to what extent do these evaluations provide insights into the difficult dilemmas that governors typically encounter? We address this question by reviewing the content of 262 evaluation studies of European climate policies in the light of six kinds of dilemma found in the governance literature. We are interested in what these studies say about the performance of European climate policies and in their capacity to inform evidence-based policy-making. We find that the evaluations do arrive at common findings: that climate change is framed as a problem of market and/or state failure; that voluntary measures tend to be ineffective; that market-based instruments tend to be regressive; that EU-level policies have driven climate policies in the latecomer EU Member States; and that lack of monitoring and weak enforcement are major obstacles to effective policy implementation. However, we also conclude that the evidence base these studies represent is surprisingly weak for such a high profile area. There is too little systematic climate policy evaluation work in the EU to support systematic evidence-based policy making. This reduces the scope for sound policy making in the short run and is a constraint to policy learning in the longer term.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Agnolucci P (2006) Use of economic instruments in the German renewable electricity policy. Energy Policy 18:3538–3548
Andersen MS, Barker T, Christie E et al (2007) Competitiveness effects of environmental tax reforms (COMETR) National Environmental Research Institute. University of Aarhus, Aarhus
Bennett G (1991) Dilemmas: coping with environmental problems. Earthscan, London
Böhringer C, Schwager R (2003) Die Ökologische Steuerreform in Deutschland—ein umweltpolitisches Feigenblatt. PWP 4:211–222
Börkey P, Lévèque F (1998) Voluntary approaches for environmental protection in the EU. OECD, Paris
Bressers JTA, Huitema D (1999) Economic instruments for environmental protection. Can we trust the magic carpet? Int. Polit. Sci. Rev. 20:175–196
CEC (2001) European governance. A white paper. CEC, Brussels
Commission of the European Communities (CEC) (2005) Communication from the commission: the support of electricity from renewable energy sources. CEC, Brussels
CEC (2006a) The European climate change programme. EU action against climate change. CEC, Brussels
CEC (2006b) The second European climate change programme. Working group ECCP review—topic group energy supply. Final report. CEC, Brussels
CEC (2006c) The second European climate change programme. Working group ECCP review—Transport. Final report. CEC, Brussels
CEC (2007a) Biofuels Progress Report. Report on the progress made in the use of biofuels and other renewable fuels in the Member States of the European Union. CEC, Brussels.
CEC (2007b) Green Paper follow-up action: report on progress in renewable electricity. Communication from the Commission to the Council and the European Parliament. CEC, Brussels
Department for Environment, Food and Rural Affairs (DEFRA) (2006) Synthesis of climate change policy evaluations. DEFRA, London
EAC (House of Commons Environmental Audit Committee) (2004) Budget 2004 and energy. The Stationary Office (TSO), London
EAC (2005a) Pre–budget 2004 and budget 2005: tax, appraisal, and the environment. TSO, London
EAC (2005b) The international challenge of climate change: UK leadership in the G8 and EU. TSO, London
Ecofys, Lund University, Wuppertal Institute for Climate, Environment and Energy, Politecnico di Milano (2007) From theory based policy evaluation to SMART policy design. Ecofys, Utrecht
EEA (2006) Greenhouse gas emission trends and projections in Europe 2006. EEA, Copenhagen
Egenhofer C, Fujiwara N, Gialoglou K (2005) Business consequences of the EU emissions trading scheme. Centre for European Policy Studies (CEPS), Brussels
Egenhofer C, Fujiwara N, Åhman M et al (2006a) The EU emissions trading scheme: taking stock and looking forward. CEPS, Brussels
Egenhofer C, Jansen JC, Bakker SJA et al (2006b) Revisiting EU policy options for tackling climate change: a social cost–benefit analysis of GHG emissions reductions strategies. CEPS, Brussels
Eichhammer W, Boede U, Gagelmann F et al (2001) Greenhouse gas reductions in Germany and the UK—coincidence or policy induced? Fraunhofer Institute for Systems and Innovation Research, Karlsruhe
Ellerman D, Buchner B (2006) Over-allocation or abatement? A preliminary analysis of the EU ETS based on the 2005 emissions data. Fondazione Eni Enrico Mattei, Venice
FES and Policy Studies Institute (PSI) (2005) Evaluation of the government’s energy efficiency policies and programmes. AEA Technologies, Didcot
Friends of the Earth Europe (FoEE) (2005) How the European Union responds to the global threat of climate change. FoEE, Brussels
Future Energy Solutions (FES) (2005) Climate change agreements—results of the second target period assessment. AEA Technology/DEFRA, Didcot
Glachant M, de Muizon G (2007) Climate change agreements in the UK: a successful policy experience? In: Morgenstern RD, Pizer WA (eds) Reality check: the nature and performance of voluntary environmental programs in the United States, Europe, and Japan. RFF, Washington
Glass GV, McGaw B, Smith ML (1981) Meta analysis in social research. Sage, Beverly Hills
Golder Europe EEIG (2005) Report on implementation of the landfill directive in the 15 Member States of the European Union. Golder Europe EEIG, Berkshire
Grubb M, Azar C, Persson M (2005) Allowance allocation in the European emissions trading system: a commentary. Clim Policy 5:127–136
Gunningham N, Gabrosky P (1998) Smart regulation. Clarendon, Oxford
Heikkilä I, Pekkonen J, Reinikainen E et al (2005) Energiansäästösopimusten kokonaisarviointi. Finnish Ministry of Trade and Industry, Helsinki
Huitema D, Rayner T, Massey E et al (2008) Climate change policy evaluation across Europe. ADAM P2 deliverable. Available at www.adamproject.eu
Huitema D, Mostert E, Egas W et al (2009) Adaptive water governance: assessing the institutional prescriptions of adaptive (co-)management from a governance perspective and defining a research agenda. Ecol Soc 14:26
Interwies E, Blobel D, ten Brink R et al (2002) Ökosteuer—Stand der Diskussion und der Gesetzgebung in Deutschland, auf der EU-Ebene und in den anderen europäischen Staaten. Ecologic, Berlin
IPA Energy and Water Consulting (2007) UK power sector emissions—targets or reality. IPA Energy and Water Consulting, Edinburgh
Jacobsson S, Lauber V (2006) The politics and policy of energy system transformation. Energy Policy 34:256–276
Jordan AJ (1999) The implementation of EU environmental policy: a policy problem without a political solution? Environ Plann C 17:69–90
Jordan AJ (2000) The politics of multilevel environmental governance: subsidiarity and environmental policy in the European Union. Environ Plann A 32:1307–1324
Jordan A, Liefferink D (eds) (2004) Environmental policy in Europe. Routledge, London
Jordan A, Wurzel RKW, Zito AR (eds) (2003) ‘New’ instruments of environmental governance? Cass, London
Kerr A (2007) Serendipity is not a strategy: the impact of national climate programmes on greenhouse-gas emissions. Area 39:418–430
Khan J (2006) Evaluation of the energy audit programme in Finland within the framework of the AID-EE project. Lund University, Lund
Kok MTJ, Vermeulen W, Faaij A et al (eds) (2002) Global warming and social innovation. Earthscan, London
Krarup S, Ramesohl S (2000) Voluntary agreements in energy policy—implementation and efficiency. Wuppertal Institute for Climate, Environment and Energy, Wuppertal
Kuik O, Aerts J, Berkhout F et al (2008) Post-2012 climate policy dilemmas. Clim Policy 8:317–336
Lechtenböhmer S, Grimm V, Mitze D et al (2005) Target 2020: policies and measures to reduce Greenhouse gas emissions in the EU. Wuppertal Institute and Wissenschaftszentrum Nordrhein-Westfalen, Wuppertal
Legambiente (2007) Stop al carbone per salvare il pianeta. Dal via libera del pna a riconversioni e nuove centrali agli incentivi CIP6 per il sulcis. Legambiente, Rome
Linder SH, Peters BG (1989) Instruments of government: perceptions and contexts. J Public Policy 9:35–38
Majone G (1989) Evidence, argument and persuasion in the policy process. Yale University Press, New Haven
Maslin M, Austin P, Dickson A et al (2007) Audit of UK greenhouse gas emissions to 2020. UCL Environment Institute, London
Massey E, Bergsma E (2008) Assessing adaptation in 29 European countries. Instituut voor Milieuvraagstukken (IVM), Vrije Universiteit, Amsterdam
Michaelowa A (2003) Germany. A pioneer on earthen feet? Clim Policy 1:31–43
Mitchell C, Bauknecht D, Connor PM (2006) Effectiveness through risk reduction: a comparison of the renewable obligation in England and Wales and the feed-in system in Germany. Energy Policy 3:297–305
Motiva (2006) Energy conservation agreements—progress review 2005. Motiva Oy, Helsinki
Mustonen E, Sinko P (2000) Hiilidioksidiveron vaikutus kotitalouksien tulonjakoon. Government Institute for Economic Research, Helsinki
Neuhoff K, Åhman M, Betz R et al (2006) Implications of announced phase II national allocation plans for the EU ETS. Clim Policy 6:411–422
Nilsson M, Jordan A, Turnpenny J, Hertin J, Nykvist B, Russel D (2008) The use and non-use of policy appraisal tools in public policy making: an analysis of three European countries and the European Union. Pol Sci 41:335–355
Nutley SM, Walter I, Davies HTO (2007) Using evidence: how research can inform public services. Policy Press, Bristol
Organisation for Economic Co-operation and Development (OECD) (2001) Environmental performance review: Germany. OECD, Paris
OECD (2002a) Environmental performance review: Italy. OECD, Paris
OECD (2002b) Environmental performance review: United Kingdom. OECD, Paris
OECD (2003) Environmental performance review: Poland. OECD, Paris
Oxera (2005) Policies for energy efficiency in the UK household sector. Oxera, London
Parsons W (1995) Public policy: an introduction to the theory and practice of policy analysis. Edward Elgar, Aldershot
Pierson P (2000) Not just what, but when: timing and sequence in political processes. Stud Am Polit Dev 14:72–92
Pöllänen M, Kalenoja H (2005) Linja-autoalan energiansäästösopimuksen arviointi. Finnish Ministry of Trade and Industry, Helsinki
Prime Minister’s Office and Economic Council (2000) Environmental and energy taxation in Finland—preparing for the Kyoto challenge. Prime Minister’s Office, Helsinki
Radaelli C (2007) Whither better regulation for the Lisbon Agenda? J Eur Public Policy 14:190–207
Rogge K, Schleich J, Betz R et al (2006) Increasing the ambition of EU emissions trading. Greenpeace International, Amsterdam
Rosenau JN (1992) Governance, order and change in world politics. In: Rosenau JN, Czempiel EO (eds) Governance without government. Cambridge University Press, Cambridge
Rheinisch-Westfälisches Institut für Wirtschaftsforschung (RWI) (2000) Die Klimaschutzerklärung der Deutschen Industrie unter neuen Rahmenbedingungen. Monitoringbericht 1999. RWI, Essen
Sabatier P (1986) Top-down and bottom-up approaches to implementation research: a critical analysis and suggested synthesis. J Public Policy 6:21–48
Schön D, Rein M (1994) Frame reflection. Basic Books, New York
Sijm J, Neuhoff K, Chen Y (2006) CO2 cost pass-through and windfall profits in the power sector. Clim Policy 6:49–72
Sorrell S, Sijm J (2003) Carbon trading in the policy mix. Oxford Rev Econ Pol 19:420–437
Sachverständigenrat für Umweltfragen (SRU) (2000) Umweltgutachten 2000. Schritte ins nächste Jahrtausend. SRU, Berlin
SRU (2004) Umweltgutachten 2004. Umweltpolitische Handlungsfähigkeit sichern. SRU, Berlin
SRU (2005) Umwelt und Strassenverkehr. Hohe Mobilität—Umweltverträglicher Verkehr. SRU, Berlin
Stufflebeam D (2001) The metaevaluation imperative. Am J Eval 22:183–209
Symons EJ, Speck S, Proops J (2002) The distributional effects of carbon and energy taxes. Eur. Environ. 12:203–212
Szarka J, Blühdorn I (2006) Wind power in Britain and Germany. Anglo-German Foundation for the Study of Industrial Society, London
Tiezzi S (2005) The welfare effects and the distributive impact of carbon taxation on Italian households. Energy Policy 12:1597–1612
Wissenschaftlicher Beirat beim Bundesministerium für Wirtschaft und Arbeit (WBBWA) (2004) Zur Förderung Erneuerbarer Energien. Federal Ministry for Economics and Labour, Berlin
Weidner H (2005) Global equity versus public interest? Wissenschaftszentrum Berlin, Berlin
Weiss C (1975) Evaluation research in the political context. In: Struening EL, Guttentag M (eds) Handbook of evaluation research, vol 1. Sage, London
Weiss C (1979) The many meanings of research utilization. Public Adm Rev 39:426–431
Wüstenhagen R, Bilharz M (2006) Green energy market development in Germany: effective public policy and emerging customer demand. Energy Policy 34:1681–1696
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Haug, C., Rayner, T., Jordan, A. et al. Navigating the dilemmas of climate policy in Europe: evidence from policy evaluation studies. Climatic Change 101, 427–445 (2010). https://doi.org/10.1007/s10584-009-9682-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10584-009-9682-3