1 Introduction

To achieve countries’ Nationally Determined Contributions (NDCs) and net-zero targets, as well as the collective goal of the Paris Agreement, countries need information about which policy approaches work most effectively and efficiently. Providing evidence-based guidance to countries requires the existence of harmonised climate policy data. However, to date, there is a lack of a structured and harmonised climate policy database that would cover a large number of countries over a long time period. The Climate Actions and Policies Measurement Framework (CAPMF), presented in this paper, attempts to fill the gap by compiling a climate policy database that provides selected information on countries’ mitigation policy landscapes at a granular level.

The CAPMF is a structured and harmonised climate mitigation policy database with 130 policy variables, grouped into 56 policy instruments and other climate actions (hereafter “policies”), covering 50 countries and the EU-27 as a block from 1990 to 2022. The CAPMF was developed under the OECD International Programme for Action on Climate (IPAC), which supports countries’ progress towards net-zero greenhouse gas (GHG) emissions through regular monitoring and policy evaluation (IPAC 2022). The CAPMF database is publicly available on the OECD data explorer (https://oe.cd/dx/capmf).

The CAPMF includes climate mitigation actions and policies presented in a way that is consistent with the organisation of information on policies and measures under the UNFCCC (UNFCCC 2022) and the IPCC frameworks (IPCC 2022). The CAPMF covers both climate policies with an explicit intent of advancing mitigation domestically and abroad as well as non-climate policies that have an expected positive effect on mitigation. These include sectoral, cross-sectoral, and international policies as well as market-based instruments (e.g. carbon taxes, subsidies for zero-carbon technologies), non-market-based instruments (e.g. standards, bans), and other climate actions (e.g. short-term and long-term emissions targets, climate governance, climate data).

The CAPMF is complementary to UNFCCC stocktaking efforts (UNFCCC 2022). Compared to the UNFCCC efforts, this paper goes a step further by tracking, at a more granular level, the policies that have been adopted and their level of stringency. For example, the latest UNFCCC synthesis report on NDCs revealed that 91% of countries were committed to mitigation actions in energy supply, 82% in the transport sector, and 77% in the building sector, among others (UNFCCC 2022). The work developed in this paper provides essential information at a granular scale on policy adoption and the stringency (i.e. the degree to which climate actions and policies incentivise or enable GHG emissions mitigation at home or abroad) of countries’ climate action. While policy adoption and policy stringency do not measure policy effectiveness, they are the first key steps for assessing effectiveness.

The major contributions of the CAPMF and this paper to the literature are the following:

  • The CAPMF constitutes a unique structured and harmonised climate mitigation policy data based on common definitions, across a long time period, and for a large number of countries. The CAPMF panel data comprises many more policy variables than any comparable policy database.

  • The CAPMF panel data enables researchers to carry out econometric and statistical analyses, which may support the design of comparable policy recommendations across countries.

  • This paper illustrates novel descriptive results on the evolution of climate action as well as differences in policy adoption, policy stringency, and policy mixes across countries, country groups, and over time.

  • This paper also carries out an econometric cross-country evaluation of climate policies, providing insights into the usefulness of the CAMPF for analysing the effectiveness of climate policies in terms of reducing emissions. It finds that mitigation policies, as covered by the CAPMF, are associated with an emission reduction of about 12% in the last five years. While the effects should not be interpreted causally, the econometric analysis helps establishing the relevance of the CAPMF data for tracking the relationship between climate policies and climate-related outcomes (e.g. emissions, energy intensity) and exemplifies how the CAPMF can be employed for future empirical analysis, estimating effects of climate policies on environmental and economic outcomes.

The remainder of this paper is structured as follows: Sect. 2 presents the CAPMF including its objectives, scope, and structure, and discusses the methodology for measuring the various policy variables. Section 3 presents some results of the CAPMF. Section 4 contains an empirical analysis, relating emissions with the CAPMF and its subcomponent within a regression framework. Section 5 discusses some limitations of the CAPMF and provides guidance for interpretation. Finally, Sect. 6 summarises the main findings and outlines possible future work areas. More details on, i.a., the description of policy variables and descriptive results can be found in the accompanying OECD working paper (Nachtigall et al. 2022), which this paper is based on.

2 Scope, Structure, and Methodology

2.1 Scope and Value Added

The CAPMF is a structured and harmonised database on climate mitigation actions and policies. The CAPMF considers governments’ policies at face value. It does not take into account direct or indirect outcomes or information on how climate policies are perceived.Footnote 1 The 2022 edition of the CAPMF provides 130 policy variables grouped into 56 policies for 50 countries (all but one OECD members and accession candidates, G20 countries) and the European Union as a block from 1990 to 2022.Footnote 2 Collectively, these countries contribute to more than 63% of global GHG emissions.

The CAPMF stocktaking exercise includes 75% of policy instrument types listed in the policy framework of the IPCC (2022) Working Group III report. Policies not covered by the CAPMF include bans on SF6 emissions (which represent less than 2% of global GHG emissions in 2020 (EPA 2022), or biofuel mandates, which are deliberately excluded from the CAPMF because of issues related to potential increased emissions from direct and indirect land use change. The CAPMF does, however, include some policies on GHG other than carbon dioxide (CO2), such as methane and nitrous oxide.

The CAPMF covers both climate policies with an explicit intent of advancing mitigation (e.g. carbon taxes, GHG emissions standards, subsidies for zero-carbon technologies) as well as non-climate policies that have an expected positive effect on mitigation (e.g. fuel excise taxes, energy efficiency standards, congestion charges). While it provides a toolbox of possible actions that countries may wish to consider, the CAPMF is not intended to be prescriptive to countries’ policy approaches. At this stage, the CAPMF focusses primarily on national policies, covering only a few sub-national approaches.Footnote 3

The CAPMF sources data from data collection efforts within and outside the OECD. Data sources include information from policy databases such as the OECD Policy Instruments for the Environment (PINE) database (OECD 2021), the IEA Policies and Measures database (IEA 2021), and the ITF Transport Climate Action Directory (ITF 2021). The CAPMF draws on other official data, including from the United Nations Statistical Division (UNSD), the United Nations Framework Convention on Climate Change (UNFCCC) and the World Bank.

Table 1 shows selected climate and environmental policy data bases along their respective characteristics. NewClimate Institute’s Climate Policy Database (Nascimento et al. 2021), the EEA data base on GHG policies and measures in Europe (EEA 2023), the Policy Instruments for the Environment (PINE) Database (OECD 2021) and the IEA Policies and Measures Database (IEA 2023) are inventories of national climate mitigation policies combined with a taxonomy that allows to assign different policies to sectors and policy instrument types. The EEA data base also includes planned policies as well as other details such as total GHG emissions reductions from specific policies or other objectives. The PINE data base has the largest time and country coverage of the four, as it has been in place since 1996. Moreover, it is verified by government officials.

Table 1 Key characteristics of climate policy data bases

Compared to other existing climate or environmental databases, the value added of the CAPMF is twofold: first, compared to policy databases such as the OECD Policy Instruments for the Environment (PINE) database (OECD 2021), IEA’s Policies and Measures, NewClimate Institute’s Climate Policy Database or LSE’s Climate Change Laws of the World, the CAPMF provides a harmonised panel dataset of climate policy variables consistently measured for a large set of countries and the 1990–2020 period. This harmonised dataset is designed for statistical analysis—it enables researchers to carry out descriptive or econometric analyses on the effects of climate policies on economic and environmental outcomes. In addition, the CAPMF calculates the stringency of each policy based on a harmonised methodology, allowing to track policy development.

Second, compared to harmonised panel datasets or composite indices such as the OECD Environmental Policy Stringency (EPS) Index (Botta and Koźluk 2014; Kruse et al. 2022) or German Watch's Climate Change Performance Index (CCPI), the CAPMF covers a much larger number of climate policies. For example, the EPS comprises 13 policy variables, whereas the CAPMF includes 130. The CCPI mixes output-based variables (e.g. GHG emissions) with a few policy variables based on subjective expert assessment, whereas the CAPMF is based on objective information about governments’ climate actions as written in law or other policy documents.

The CAPMF categorises policy data in two ways. First, the policy variables are categorised into sectoral, cross-sectoral, and international climate actions and policies (Section ‘Structure’). Second, they are categorised by policy type, including market-based instruments (e.g. feed-in-tariffs, emissions trading schemes), non market-based instruments (e.g. emissions limit values, bans or phase-outs of fossil fuel equipment and infrastructure), and targets, governance, and climate data (e.g. NDCs, net-zero targets, climate governance) (Table 5).

2.2 Structure

The structure of the CAPMF is aligned with relevant OECD work classifying policy instruments such as the PINE database and the EPS Index. The CAPMF is organised across three building blocks, which reflect the spectrum of countries’ climate actions and policies: sectoral policies, cross-sectoral policies, and international policies (Fig. 1).

Fig. 1
figure 1

Note: ETS: Emissions trading system; FFS: Fossil fuel support; RES: Renewable energy sources; FiT: Feed-in-tariff; RPS: Renewable Portfolio Standard; EE: Energy efficiency; ICE: Internal combustion engine; MEPS: Minimum energy performance standard; CCS: carbon capture and storage

The structure of the CAPMF

Sectoral policies are defined as policies that can be constrained to or are designed to apply to a specific source or economic sector (e.g. emission limit values for passenger cars, phase-out of power plants). This version of the CAPMF covers the IPCC source sectors, including power generation, industry, transport, and buildings. It is planned to extend the work towards agriculture, land use, land-use change, and forestry (AFOLU), and waste. In most countries, sectoral policies are proposed by the respective ministry. For each sector, the CAPMF explicitly distinguishes between market-based instruments and non market-based instruments.

Cross-sectoral actions and policies refer to policies that cut across more than one emission source or sector. These are overarching policy areas to mitigate or remove domestic GHG emissions that cannot be easily attributed to a specific sector (e.g. GHG emissions targets, climate governance).

International policies refer to policy commitments associated with international conventions or agreements where more than one country participates (e.g. participation in international climate agreements, international public climate-related finance). While international policies do not necessarily reflect domestic mitigation commitments or efforts, these policies and international coordination are vital to reaching the goals of the Paris Agreement given the global nature of the climate change challenge. Some countries explicitly highlight the importance of international policies to reduce emissions abroad (Finnish Government 2019). Supra-national policies such as those adopted by the European Union (EU) are recorded for both the EU aggregate and each Member State.

The modular structure of the CAPMF facilitates the analysis of the building blocks separately. This may be relevant for countries that have different policy approaches emphasising specific types of policy instruments. For example, practitioners may not want to take international policies into account when the major focus of their work is on domestic mitigation efforts.

Each building block consists of a number of modules (e.g. targets in national cross-sectional policies and actions). Each module encompasses a number of climate actions and policies (e.g. net-zero targets and NDC in targets) and each policy can consist of a number of policy variables (e.g. target year of net-zero targets).

More details on the policies covered by the 2022 edition of the CAPMF, including the measurement of policy variables the rationale for inclusion, the data source, a detailed description of the underlying raw data, as well as information on country and time coverage can be found in the accompanying OECD working paper (Nachtigall et al. 2022).

2.3 Methodology: Normalisation and Missing Data

The CAPMF groups its 130 policy variables into 56 policies. This is to aggregate policy variables that describe the same policy instrument or are otherwise similar in nature. For example, the CAPMF comprises four variables on feed-in-tariffs (FiT) for renewable electricity (support level and contract duration for both solar PV and wind), but only one variable for renewable energy portfolio standards. Hence, the CAPMF groups the four variables into one to assess the extent to which a country has adopted a FiT.

The CAPMF normalises each policy variable based on the in-sample distribution across all countries and years. Normalisation is necessary to map different dimensions of policy variables into one common dimension. For example, the contract duration of FiT is measured in years whereas the FiTs’ support level is measured in USD per MWh.

Normalisation also allows for determining policy stringency. Policy stringency is defined as the degree to which climate actions and policies incentivise or enable GHG emissions mitigation at home or abroad. This allows to track within-country evolution of countries’ policy stringency and ensures that countries’ policy stringency can change only if there is a change in a policy. More precisely, if a country has, for example, increased its carbon tax, this will be reflected in a higher policy stringency value. Importantly, the policy stringency is determined based on all observed data until 2022, meaning that a country’s policy stringency does not decrease if other countries strengthen their efforts.Footnote 4

For each policy variable, a stringency level between 0 and 10 is assigned as follows:

  • A level of 0 is assigned if a policy or action is not in place.

  • All other levels are assigned according to the in-sample distribution across all years and countries so that the percentiles constitute the thresholds between the levels. More precisely, a level of 10 is assigned if the value of the policy variable is at or above the 90th percentile after excluding all observations where the policy variable is not in place.Footnote 5 A level of 9 is assigned if the value falls between the 80th and 90th percentile and so on. Finally, a level of 1 is assigned if the value of the policy variable is below the 10th percentile but is in place.Footnote 6 This methodology is straightforward for most variables but needs to be interpreted carefully for some.Footnote 7

  • For binary or categorical variables, a level of 10 is assigned to the highest value of the policy variable. All other values of categorical variables are linearly mapped into the space from 1 to 10.Footnote 8

Subsequently, the policy variables describing the same ‘policy’ are grouped into one by assigning equal weights to all underlying policy variables. For example, each of the four FiT policy variables receive a weight of 0.25. The equal weighting assumption is conservative as it does not make any judgement call on the relative importance of various policy variables.Footnote 9

All policy variables with missing data receive a policy stringency of zero to enable the grouping and are labelled as ‘missing’ in the published database.Footnote 10 The CAPMF does not impute values for missing data even where this would be possible. This is a conventional way to deal with missing data because it does not require any assumption about the imputation procedure (Gachau et al. 2021).

The only exception from the treatment of missing data refers to missing data in t  1. In each annual update, the CAPMF aims to provide data for the previous year to capture an up-to-date picture of countries’ climate action. For some policy variables, however, data will not be available in such a timely manner. For those, the CAPMF imputes the missing data in t  1 based on the observation of the previous year.

3 Descriptive Results

One of the primary purposes of the CAPMF is to provide consistent data to track countries’ policy adoption and development. This section presents some selected results of the CAPMF. More results can be found in the accompanying OECD working paper (Nachtigall et al. 2022).

In 2022, high levels of average policy stringency across all policies can mainly be observed in developed countries (Fig. 2). OECD countries, notably in Europe exhibit high levels of average policy stringency, whereas particularly low levels can be found in Latin America, the Middle East and Asia. However, all countries remain far from reaching high levels of average policy stringency. On the scale from 0 to 10, the United Kingdom reached the highest level (6.3) of all countries, while Peru reached the lowest level (1.3).

Fig. 2
figure 2

Note: Shades of colour show different levels of policy stringency. Darker shades indicate higher levels of stringency, whereas lighter shades indicate lower levels of stringency. Country-level policy stringency is calculated by averaging policy stringency across all 56 policies for the year 2022

Climate policy stringency differs across countries

Countries have, on average, accelerated their climate action between 2010 and 2022 (Fig. 3). These countries both adopted new policies and increased the stringency of existing policies. Across all countries, the increase in policy adoption has been particularly focussed on auctioning renewable electricity, carbon pricing and, more recently, bans and phase out of fossil fuel equipment and infrastructure such as coal power plants. Yet, more needs to be done in most countries to reach NDCs and net-zero targets.

Fig. 3
figure 3

Note: Low stringency is defined as a stringency score of 0–3, medium stringency as 4–7 and high 8–10

Countries strengthened their climate action between 2010 and 2022.

At the country level, most countries increased the number of adopted policies between 2015 – the year of the Paris Agreement—and 2022. However, some countries did not increase the number of adopted policies and others even removed policies.

Policy adoption and stringency differ significantly across country groups (Fig. 4). This partially reflects different economic realities, starting conditions, policy path dependency, or public acceptance of climate action. Not surprisingly, non-OECD countries adopted fewer and less stringent policies than OECD countries. OECD countries, on average, adopted 39 policies with 19 stringent ones, whereas non-OECD countries adopted 25 with 10 considered highly stringent. Regionally, European countries adopted the most policies on average (37 policies), followed by Asia–Pacific (35) and the Americas (29).

Fig. 4
figure 4

Note: Number and stringency of climate policies by selected country group in 2022. Low stringency is defined as a stringency score of 0–3, medium stringency as 4–7 and high 8–10

Policy adoption and policy stringency differ across country groups

Policy adoption and policy stringency differ substantially across countries (Fig. 5). No country has adopted all policies included in the CAPMF. Policy adoption varies between 47 adopted policies in Canada, France and the United Kingdom to 13 in Peru. Heterogeneity in policy adoption partially reflects countries’ different policy approaches and climate ambition. Aggregation of climate action by county group hides important cross-country differences. For example, while most European countries have many policies with above average policy stringency in place, this does not hold true for all European countries. Similarly, some large economies in the Americas have many policies with above average stringency in place whereas other countries in the Americas have fewer and less stringent policies in place. Most Asian economies, notably big Asian emitters, also have fewer policies with below average stringency in place.

Fig. 5
figure 5

Note: Policy stringency and policy adoption by country in 2020. Bubble size is proportional to countries’ GHG emissions

Policy adoption and policy stringency differ substantially across countries

Over the last 20 years, countries’ policy mix changed (Fig. 6, Panel A). For example, in the early 2000s, market-based instruments represented less than 30% of adopted policy instruments, but they represent almost 50% in 2010. The increasing uptake of market-based instruments has occurred since 2005, primarily driven by the implementation of the EU Emissions Trading System (EU ETS) and other subsequent carbon pricing schemes. However, in the last decade the relative importance of market-based instruments decreased.

Fig. 6
figure 6

Note: Portugal and Costa Rica are included for illustrative purposes. They are the countries with the highest and lowest share of market-based instruments on the policy mix

Climate policy mixes differ substantially across countries and change over time

The policy mix also differs substantially across countries (Fig. 6, Panel B). While some countries (e.g. Portugal) primarily rely on market-based policies, such as carbon pricing under the EU ETS or Feed-in Tariffs for renewable energy, others (e.g. Costa Rica) place more emphasis on non-market-based instruments, such as minimum energy performance standards and bans or phase-outs of fossil-fuel equipment or infrastructure. While countries employ different policy mixes, on average, countries tend to strengthen climate action through several instruments at a time. This can be partially observed from the high pair-wise correlation across policy types within countries (see Appendix Tables 6 and 7). At the country group level, OECD countries use a relatively higher share of market-based instruments compared with non-OECD countries. Interestingly, policy mixes are fairly homogeneous across country groups with little variations for OECD, European, G20, and Asia–Pacific countries from the CAPMF average.

Policy adoption of specific policy instruments varies greatly across country groups as illustrated for instruments in the transport sector (Table 2). Only 4 and 6 countries adopted (city-level) congestion charges and included the transport sector in their ETS, respectively. Some countries adopted carbon taxes (17) and already announced or legislated bans or phase-outs of passenger cars with internal combustion engines (31), though the share of countries adopting these instruments is significantly lower or even zero in non-OECD countries. Most countries adopted fuel economy standards, energy labels for passenger cars, fuel excise taxes, and speed limits on motorways. However, policy adoption of fuel excise taxes and fuel economy standards is significantly lower in non-OECD countries. Compared to labels and speed limits, fuel excise taxes and fuel economy standards put more direct costs on users, potentially facing public acceptability problems. This may explain the relatively lower policy penetration in non-OECD countries. Regional differences in fossil fuel subsidy reform and investment in public rail infrastructure are likely driven by data availability constraints.

Table 2 Policy adoption of policy instruments varies greatly across country groups

It is important to remember that policy adoption and policy stringency measure governments’ climate action, but not necessarily policy effectiveness. Yet, policy adoption and stringency can be seen as a proxy for policy effectiveness as, e.g., more stringent policies can be expected to reduce emissions to a greater extent. For example, a very stringent emission limit value for coal power plants can be expected to lead to higher emissions reduction compared to a laxer one. However, the overall effects of increased policy adoption and policy stringency depend on factors such as emissions coverage and economic costs and likely have different impacts across countries.

This paper sheds more light on this. The descriptive evidence suggests that countries with relatively larger policy adoption or larger average policy stringency are associated with deeper GHG emissions reductions between 2015 and 2019 (Fig. 7). In fact, countries with an above-average number of adopted policies and above-average policy stringency were most successful in reducing their total GHG emissions as well as their GHG emissions intensity and GHG emissions per capita between 2015 and 2019 compared to countries below the respective average.Footnote 11 This analysis is purely descriptive and does not imply any causal relationship between policy adoption or policy stringency and GHG emissions reduction. The next section illustrates the relationship between policy stringency and GHG emissions reduction more in depth.

Fig. 7
figure 7

Countries with stronger climate action are associated with steeper emissions reductions

4 Empirical Analysis: The Effects of Climate Policies on GHG Emissions

This section sheds light on the environmental effectiveness of climate policies. Using regression analysis, the effect of higher climate policy stringency, as measured by the CAPMF, on country-level emissions is estimated. This serves two purposes. First, it provides an overarching assessment of mitigation policy instruments spanning 48 countries and 21 years (from 2000 to 2021).Footnote 12 Second, it establishes the relevance of the CAPMF for tracking the relationship between climate policies and climate-related outcomes such as emissions, emissions intensity, and energy intensity.

A stringency measure is built as a composite index at the country-year level by averaging across all 56 policies.Footnote 13 Using a composite index on policy stringency in a cross-country analysis builds on prior work, including the use of the OECD EPS index to assess the effects of climate policies on emissions (Frohm et al. 2023), employment (Dechezleprêtre et al. 2020) and innovation in clean technologies (Dechezleprêtre and Kruse 2022) and the OECD Effective Carbon Rates to estimate the effect of carbon pricing on CO2 emissions and government tax revenues (D’Arcangelo et al. 2022).

This section investigates the effect of climate policy stringency on several outcomes that are crucial for the low-carbon transition such as GHG emissions, CO2 emissions and energy intensity of the economy. The main emission data are taken from PRIMAP’s national historical emissions time series (Gütschow et al. 2016), which offers comprehensive country coverage and a transparent methodology.Footnote 14 Energy data are taken from the IEA’s World Energy Statistics and Balances to calculate energy intensity indicators.

The baseline empirical specification is the following:

$$Y_{ct} = {\beta{CAPMF}}_{ct - 1} + X' \,_{ct} \gamma + \delta_{c} + \delta_{t} + \varepsilon_{ct}$$
(1)

where \({Y}_{ct}\) is the outcome variable (such as log CO2 emissions) in country \(c\) and year \(t\). \({\text{CAPMF}}_{ct-1}\) is obtained averaging the stringency values across all 56 policies and is standardised to have a mean of zero and standard deviation of one. The use of a lagged CAPMF index reduces concerns of simultaneity. This approach closely follows the existing literature (Best et al. 2020; Eskander and Fankhauser 2020) in the choice of a standard set of controls \({X}_{ct}\) to isolate the effect of policy stringency on outcomes. Table 8 in “Appendix B” contains the descriptive statistics of the variables employed for the empirical analysis in this section and Table 9 in “Appendix B” shows the correlation matrix.

The controls include several economic variables (all in 2017 constant USD and in PPP) to account for time-varying confounders. The estimation equation includes (log) GDP, obtained from the OECD National Accounts and complemented with the World Bank’s World Development Indicators (WDI) as well as (log) GDP squared to accommodate any nonlinear relationship emerging from an environmental Kuznet’s curve. The Hodrick-Prescott decomposition further controls for cyclical components in GDP, the import share of GDP (calculated from WDI based on OECD National Accounts) and the service share of GDP (OECD, Trade in goods and services) control for varying economic structure. Moreover, the estimation includes (log) population from WDI and a measure of the rule of law sourced from the Worldwide Governance Indicators to control for enforcement and saliency of policies following Best et al. (2020).Footnote 15 The model also includes country fixed effects, \({\delta }_{c}\), which control for all time-invariant difference across countries, and year fixed effects, \({\delta }_{t}\), which control for time-specific shocks that are common across countries. In Table 10 in “Appendix B” control variables are added gradually to show that no individual control variable drives the results.

Controlling for output and population is especially important as they are crucial determinants of emissions that are likely to confound the policy effect. Secular growth in economic activity and population correlates with the progressive increase in climate policy stringency and their omission would lead to an upward bias of the estimation. Because output and population are kept constant by including them as independent variables, this approach is tantamount to estimating the effect of CAPMF on emission intensities (per GDP unit and capita). In turn, this shuts down those explanatory channels of emissions, including the potential slowdown of economic activity due to climate policy.

Results suggest that implementing climate policies are effective in reducing emissions, as suggested by the negative and statistically significant coefficients on CAPMF (Table 3). This effect is also substantial: a unit increase of the standardised CAPMF index is associated with a reduction of about 12% in both GHG emissions (column 1) and CO2 emissions (column 2). The results are also robust to using CO2 emissions intensity as the dependent variable (− 12%, Column 2 in Table 11) or GHG intensity (−14%).

Table 3 Effects of climate policies on environmental outcomes

Since the index is standardised, a unit increase is equal to one standard deviation. For comparison, this is approximately the average increase in the index over 5 years from 2015 to 2020. Since the index has increased by 2.3 points in the 2000–2021 period, this estimate implies that mitigation policies have contributed to an average reduction of about 28% in emissions in the period, compared to the absence of policies, while holding constant our set of control variables.Footnote 16 This estimate should be taken with care, as it is obtained by extrapolating reduced form average effects to the full sample but provides a rough estimate of the magnitude of effects. For example, it does not account for general equilibrium effects that occurred over the twenty-year period.

Next, we explore the relationship of emissions with the number of policies. Eskander and Fankhauser (2020) use the stock of mitigation policies as a proxy of policy stringency. When CO2 emissions are regressed on the stock of policies computed from the CAPMF database, results are qualitatively and quantitatively similar to theirs (column 3). Adopting a new policy is associated with a decrease in CO2 emissions by about 7%. This effect is not statistically significant anymore when the CAPMF index is used in conjunction with the number of policies (column 4). Given the CAPMF captures the stringency of climate policies it lends itself better for explaining the emission reductions associated with climate policies compared to the number of policies.

Columns 5 to 7 of Table 3 investigate the channels through which emissions have been reduced. First energy intensity (measured as total energy consumption over GDP) is introduced on the right-hand side (column 5), shutting down this channel for emission reduction. The coefficient on CAPMF reduces and is not statistically significant anymore, suggesting that most of the emission reduction attributable to mitigation policies is due to improvements in energy intensity. This hypothesis is tested by regressing energy intensity on the CAPMF (column 6), finding that a unit increase in the mitigation policy index is associated with a decrease in energy intensity of about 10%. In contrast, the effect of mitigation policies on the emission intensity of energy (CO2 emissions over total energy consumption) is close to zero and not statistically significant, although the coefficient is negative (column 7). These results together suggest that mitigation policies have reduced emissions predominantly by reducing the energy intensity of the economy, rather than by reducing the emissions produced per unit of energy consumed.

Instead of assessing the effect across all types of policies and targets on emissions, regressions in Table 4 assess the effect at a more granular level (see the structure in Fig. 1). First, market-based, non market-based, and other policies (column 1) are included separately by creating sub-indices for these policy types and standardising them with a mean of zero and standard deviation of one.Footnote 17 The stringency of market-based and ‘other’ (i.e. targets, governance and climate data) policies is significantly negatively associated with emissions, while non market-based are negatively but not significantly associated with emissions. This could be explained by systematic differences across countries, including in their ability to enforce policies. A model is estimated allowing the coefficient to vary by Annex I countries (column 2) and non-Annex I (column 3), according to the UNFCCC definition. Annex I countries exhibit a larger effect for non market-based and other policies, but the effects are not statistically different from those for non-Annex I countries.

Table 4 The effects of different policy instruments on emissions

Second, differences between cross-sectoral, sectoral, and international policies are explored (column 4). A unit increase in the stringency has larger effects on emissions for sectoral and international policies (-8%) than for cross-sectoral policies (-3%). The effect sizes are larger for sectoral policies in Annex I countries while the opposite is true for cross-sectoral policies (column 5). However, the low precision in the estimates for non-Annex I countries (column 6) cautions against a definitive conclusion as the coefficients for Annex I and non-Annex I are not significantly different from one another.

5 Discussion

The CAPMF provides a wealth of structured and harmonised data. However, they come with some limitations. This section discusses three caveats to keep in mind for the interpretation of results from the CAPMF. These include:

  • The CAPMF provides no information on implementation or enforcement

  • The CAPMF does not reflect policy effectiveness

  • The CAPMF may not accurately reflect countries’ policy approaches because it does not cover all climate actions and policies and because country circumstances may differ.

First, the CAPMF measures climate actions and policies as they are in law, but it does not account for the implementation or enforcement of climate policies. While it is difficult to observe whether policies are enforced or not, future work could attempt to include variables that monitor policy enforcement. Note also that the preliminary evidence presented in Sect. 3 suggests that countries with a higher number of adopted policies and above-average policy stringency are associated with larger emissions reductions, suggesting that countries implemented and enforced their policies.

Second, the applications of the CAPMF should be interpreted in an informative not in a normative way. In particular, it is important to keep in mind that policy stringency and policy coverage do not per se reflect policy effectiveness, and stringency needs to be interpreted carefully for some policies. By no means, the CAPMF suggests that all countries should adopt all policies to the highest possible level. Instead, different policy mixes may be required to achieve countries’ emission reduction targets and the goals of the Paris Agreement more generally, depending on national circumstances. For example, a country with only a few adopted policies may be highly effective in terms of reducing GHG emissions if it has the right policy mix in place. Conversely, a country with many policies in place might not be able to reduce GHG emissions if its policy mix is not well-tailored to its circumstances.

Countries have different starting positions and very specific circumstances regarding their abatement potential. For example, even a relatively moderate carbon price could trigger large amounts of GHG emission reductions in a country with vast low-cost abatement potential. Conversely, a high carbon price may hardly trigger any emissions reductions if applied to sectors that lack commercially viable zero-carbon alternatives.

Third, countries have different policy approaches which need to be taken into account in the interpretation of the results from the CAPMF. Policy approaches are defined as policies that are generally accepted and considered legitimate in a specific country at a specific point in time (Cerna 2013). Countries’ policy approaches to climate mitigation are the result of a complex interaction of multiple factors, including the resource base (e.g. Nordic countries may not have subsidies for solar PV for good reasons), legal traditions (e.g. carbon taxes in the European Union are levied nationally and require unanimity, which is why the EU chose to adopt an ETS), and path dependence (e.g. countries opting for ETS, but not carbon tax). Consequently, some policies included in the CAPMF may not be part of some countries’ policy approaches. For example, certain policies included in the CAPMF may not be relevant in some countries because of a lack of relevant resources (e.g. subsidies for solar PV in countries with low insolation) or lack of relevance (e.g. subsidies for renewable electricity in countries with already decarbonised electricity systems).

Another reason why countries’ policy approaches may not be fully reflected in the CAPMF are data availability constraints. In fact, the CAPMF does not cover all climate actions and policies. Strictly speaking, any conclusion or interpretation from the CAPMF is only valid for the measured climate actions and policies. Not accounting for the unmeasured climate actions can lead to misleading interpretation, notably in cross-country comparison. However, the relevance of this problem will decrease as new policies and actions are integrated into the CAPMF. The accompanying working paper presents a list of the most relevant policies currently not included (Nachtigall et al. 2022).

6 Conclusion

This paper presents the CAPMF, the most extensive, structured, and internationally harmonised climate mitigation panel data set to date. The CAPMF covers 130 policy variables that are grouped into 56 policies for 50 countries and the EU-27 from 1990 to 2022. The CAPMF database is publicly available on the OECD data explorer https://oe.cd/dx/5if. Selected indicators are also publicly available on the IPAC Climate Action Dashboard and on a dedicated data visualisation platform https://oecd-main.shinyapps.io/climate-actions-and-policies/. Using this granular data, the CAPMF allows for a stocktaking of countries’ climate policies. Insights from this stocktaking include:

  • Countries expanded their climate action between 2010 and 2022, increasing both the number of adopted policies covered by the CAPMF and their policy stringency. Most, but not all countries adopted new policies between 2015 and 2022.

  • Policy adoption and policy stringency varies considerably across countries, country groups and instruments. In 2022, the number of adopted policies varied between 13 and 47. In 2022, policy adoption also varies across policies, ranging from 0 (e.g. phase outs of cars with internal combustion engines) to 51 (ratification of at least one of the major international climate agreements).

  • Countries’ policy mixes changed over time and differ substantially across countries and country groups.

  • Countries with relatively larger policy adoption or larger average policy stringency are associated with deeper GHG emissions reductions between 2015 and 2019.

The paper also provides an empirical application of the CAPMF by investigating the relationship between climate policies and emissions. Emissions (GHG and CO2) are related in a panel regression to a composite index constructed by averaging policy stringency at the country-year level. A unit change in the standardised index (about the average change that occurred in the last five years) is associated with a reduction in emissions by 13%. Reduction in energy intensity of the economy is a key determinant of emission abatement, accounting for about half of the policy-induced reduction. These results are robust to different specifications as well as different ways of averaging the data. While the effects should not be interpreted causally, the econometric analysis establishes the relevance of the CAPMF data for tracking the relationship between climate policies and climate-related outcomes. It showcases how the CAPMF can be used in future empirical analyses to estimate effects of climate policies across countries and sectors. Using micro-data, future work may be able to identify potentially causal effects of environmental policies on firm outcomes across sectors and countries.

Future work can be divided into two work streams: First, the continuation and expansion of policy stocktaking and data collection. The CAPMF could be extended towards sectors and modules currently not included (i.e. agriculture, LULUCF, waste, and climate finance) as well as other policy variables in already existing modules when data become available or is collected through questionnaires (e.g. policies to promote sustainable transport modes, climate governance).

Second and more importantly, the policy data of the CAPMF could be used to carry out a number of qualitative and quantitative analyses. While Sect. 4 offered preliminary empirical evidence on the relationship between an aggregated CAPMF index and emissions, the novel data opens up several possibilities for further empirical research. Some questions that can be addressed with this new data include, but are not limited to:

  • Investigating the environmental effectiveness of climate policy instruments and different policy mixes. This analysis would shed light on the relative importance of different types of policies or instruments and could carve out the effectiveness under different country contexts.

  • Assessing the socio-economic effects (e.g. employment, investment, productivity, income distribution) of climate policies. This research agenda would contribute to the analysis of the effects of environmental policies on economic and environmental outcomes.

  • Investigate the effect of mitigation policies on industries, firms, and households. Country-level variation in mitigation policy stringency can be interacted with an industry-, firm- or household-level exposure to study more micro effects of mitigation policies and reinforce the identification of their causal effects.