1 Introduction

The increase in GHG concentrations during the last decades is considered to be the main reason for global warming. The Kyoto Protocol to the United Nations Framework Convention on Climate Change (UNFCC), whose term ended in 2012, stipulated the reporting of GHG emissions at national scale. The recent goal of the UNFCC is to establish post-Kyoto emission reductions targets for the period from 2012. Meantime, the European Union (EU-27), as a Party to the UNFCC, has set ambitious targets for the year 2020: the reduction of GHG emissions by 20 % (or 30 %—see below) by 2020 compared with 1990 levels (EEA 2010b).

Overall, EU-27 GHG emissions are decreasing. According to the inventory report (EEA 2010a), the EU-27 is well on track to achieve its emission reduction target of 20 %. This overall trend is projected to continue until 2020. However, the 20 % reduction target compared to 1990 would therefore remain out of reach without the implementation of additional measures, such as the EU’s energy and climate change package (EC 2008). This package underlines the objectives of limiting the rise in global average temperature to no more than 2 °C above preindustrial levels (EC 2009). So, the Member States agreed to cut GHG emissions by at least 20 % of 1990 levels (30 % if other developed countries commit to comparable cuts), which equals a 14 % reduction compared with 2005 levels; to cut energy consumption by 20 % of projected 2020 levels by improving energy efficiency; and to increase the use of renewables (wind, solar, biomass, etc.) to 20 % of total final energy consumption.

Uncertainty in GHG emissions is a crucial component of inventories. It specifies the absence of confidence in the inventory inputs as a result of casual factors, such as uncertainty of emission sources and emission factors, absence of transparency in the inventory process (IPCC 2006; API/CONCAWE/IPIECA 2009), and so on. In compliance with international obligations, countries should have guarantees that reported GHG emissions are sufficiently accurate. Up to now, GHG emissions and the corresponding uncertainties are still reported separately and are not considered in carbon emission trading (Ermolieva et al. 2010).

The application of a number of existing techniques to analyze emissions and emission changes against their uncertainty could provide useful knowledge that countries would like to have available prior to agreeing to emission targets (Jonas et al. 2004, 2010a, b; Bun et al. 2010). At the same time, countries should strive to provide more accurate results regarding GHG emissions. In order to decrease the level of uncertainty, the knowledge of inventory processes has to be expanded and the key reasons and emission sources that determine the level of uncertainty have to be identified.

Experience in assessing the uncertainty in GHG inventories and changes in uncertainty in relative terms is still insufficient (Lieberman et al. 2007; Jonas et al. 2010a, b; NRC 2010). So far, no studies have been done on the analysis of changes in uncertainties that countries reported in their national inventory reports. For example, from year to year countries report different values of relative uncertainties in total GHG emissions. What is the main reason for changes in reported uncertainties: structural changes in emissions or increased knowledge about inventory processes? How will uncertainties change in the future due to structural changes in GHG emissions under new policy treaties (e.g., the EU’s 2020 targets)? Answers to these questions will help to better communicate the uncertainty and can be used to improve the setting of emission targets in the future.

Here, we conducted an analysis of the changes in uncertainty in relative terms in the past and nearby future for European countries. The input data (uncertainties by source) were derived from national inventory reports (NIR 2003–2008), and emissions scenarios were taken from the Greenhouse Gas and Air Pollution Interactions and Synergies (GAINS) model (IIASA 2010).

Our study is divided into two parts: (1) diagnostic analysis of the historical change in uncertainty, particularly the influence of structural changes in emissions; (2) a diagnostic exercise with one step forward: we calculate the total uncertainty with which we will have to cope at a specified point in time in the future using today’s diagnostic capabilities. The paper presents an analysis of the historical change in uncertainty of CO2 emissions for the EU-15 as a whole and for individual countries; and it also includes estimates of total uncertainty in GHG emissions under scenarios of changes in emissions considering the EU’s “20-20-20” targets.

2 Methodological background

Parties to the UNFCCC publish their GHG inventory reports annually in consistency with standardized guidelines for national agencies developed by the Intergovernmental Panel on Climate Change (IPCC 1997, 2006). Parties are obliged to include in their reports direct or alternative estimates of uncertainty in results of GHG inventories. The quality of reported uncertainty varies significantly from country to country because countries do not use the same method for their emission and uncertainty assessments. The estimates of CO2 emissions from fossil fuels consumption are the most accurate for comparison with other source categories (uncertainties are estimated in the range of ±5 %) (Marland et al. 2008).

The EU member states started to report their uncertainties in GHG emissions in different years. The first estimates of relative uncertainty were added to GHG inventory reports in 2000 and they did not cover all source categories and gases. In contrast, GHG emissions were calculated much earlier. The ranges of total uncertainty of GHG emissions for the EU-15 are available from the year 2003; the uncertainty of CO2 emissions from fossil fuel combustion (stationary) has been detailed by source only since 2005.

Total uncertainty changes over time due to increased knowledge of inventorying GHGs and structural changes in emission sources (and sinks). The first estimates of changes in uncertainties in the past were provided in the Interim Report (Hamal 2010). The reported uncertainties in the national inventory reports reflect precision and do not consider accuracy. Precision expresses the degree of reproducibility of repeated emissions (random errors). Accuracy is the difference between the reported emissions estimate and the actual value (systematic errors). Hamal (2010) calculated combined relative uncertainties (for the EU-15), which consider accuracy and precision, using knowledge of emissions recalculations to estimate biases (systematic errors). The results, fitted with a trend function that follows an exponential curve with a decrease of approximately 4.24 % each year, are displayed in Fig. 1. This change in uncertainty is expected to be more significant for the LULUCF (Land Use, Land-Use Change and Forestry) sector and for other GHGs that are less certain.

Fig. 1
figure 1

Total uncertainty ranges fitted with exponential trend function (Source: Hamal 2010)

The decrease (Fig. 1) in the past is believed to be almost exclusively caused by “learning” and only marginally by structural changes in fossil fuel consumption. “Learning” means the process of increasing knowledge of emission factors, other parameters, and activity data and improving the inventory methods and models. However, some structural changes in emissions as the result of implementing new energy measures can cause more significant decreases or even increases in uncertainty. This happens because the uncertainty of emissions from different fuels is not the same (i.e., combustion of liquid and other fuels involves a bigger uncertainty than that of solid and gaseous fuels).

Structural changes in emissions occur all the time; for example the structure of fossil fuels consumption changes, and each fuel has a different emission factor. Replacing consumption of one fuel by another could result in an increase or decrease in the total uncertainty.

In the next two chapters, we present the methodology used to analyse historical changes in relative uncertainty and future estimates of uncertainty in GHG emissions from stationary sources. Table 1 includes a description of data sources used in the study.

Table 1 Data description

2.1 Historical change in uncertainty of CO2 emissions

We have analyzed the change in total uncertainty of CO2 emissions by the following steps:

  1. 1.

    Collecting data on GHG emissions and their uncertainties by source categories (Table 1).

  2. 2.

    Calculation of the contribution of uncertainties in total emissions (fraction, %) at the beginning and end of the investigated period:

    $$ {\tilde{U}}_i=\frac{x_i}{{\displaystyle {\sum}_{j=1}^n{x}_j}}\cdot {U}_i\kern1em \mathrm{or}\kern1em {\tilde{U}}_i={r}_i\cdot {U}_i, $$
    (1)

    where \( {\tilde{U}}_i \) is the combined uncertainty in category i as a proportion of total emissions (%); U i is the relative uncertainty of emissions in category i, i = 1.. n (see Table 1) (%); x i is the uncertain quantity (emissions) of category i (see Table 1); r i  = x i /∑ n j = 1 x j is the fraction of source category i in total emissions.

    Formula (1) follows from Approach 1 described in Chapter 3 of the IPCC Guidelines (IPCC 2006).

  3. 3.

    Analysis of the change in uncertainty due to increased knowledge: We consider that if uncertainty of elementary category (U i ) changes during the investigated period it changes due to the learning process, for example increased knowledge on uncertainty of emission factors or activity data, while the structural change (r i ) always occurs; for shorter periods it is negligible but for longer ones it could be very significant.

  4. 4.

    If the change in uncertainty occurs in category i due to increased knowledge, we use elements from deterministic factor analysis theory to compare the influence of the structural change in emissions and the “learning” on this change:

    $$ \varDelta {\tilde{U}}_i=\varDelta {\tilde{U}}_{i,r}+\varDelta {\tilde{U}}_{i,U}, $$
    (2)
    $$ \varDelta {\tilde{U}}_{i,r}=\varDelta {\tilde{U}}_i\cdot \ln \left(\frac{r_i^1}{r_i^0}\right)/ \ln \left(\frac{{\tilde{U}}_i^1}{{\tilde{U}}_i^0}\right),\kern0.5em \varDelta {\tilde{U}}_{i,U}=\varDelta {\tilde{U}}_i\cdot \ln \left(\frac{U_i^1}{U_i^0}\right)/ \ln \left(\frac{{\tilde{U}}_i^1}{{\tilde{U}}_i^0}\right), $$
    (3)

    where \( \varDelta {\tilde{U}}_{i,r} \) is the absolute change in relative uncertainty due to the structural change in emissions (%), \( \varDelta {\tilde{U}}_{i,U} \) is the absolute change in relative uncertainty due to “learning” in source category i (%); super-indices 1 and 0 mean the end and the beginning of the investigated period, respectively.

    If the change in uncertainty occurs in category i only due to the structural change in emissions, we go to the next step.

  5. 5.

    Analysis of change in relative uncertainty of CO2 emissions for every source category and for the sector as whole.

    A detailed example of uncertainty analysis of CO2 emissions (stationary sources) by the steps described above is presented in Table 2, where the calculations are made for Finland, as it is one of the first countries that started to report uncertainties in GHG emissions in 2000. During the investigated period (2000–2008), knowledge of the inventory processes in some categories increased, and structural changes in fossil fuel consumption also occurred.

    Table 2 The analysis of the relative uncertainty of CO2 emissions (stationary sources) without LULUCF for Finland (2000–2008)

2.2 Future changes in uncertainty

Using today’s diagnostic capabilities we are able to measure and distinguish between “learning” and structural change in the past and also in the future. We would call this “a diagnostic exercise with one step forward”. We estimate the total uncertainty by combining uncertainties in GHG emissions from different sectors. Our main assumption is that our future knowledge of uncertainty in activity data and carbon content will be the same as today’s knowledge in relative terms. So, relative uncertainty is kept constant in both activity data and carbon content during the investigated period.

To combine uncertainties, the Tier 1 approach described in Chapter 3 of the IPCC Guidelines (IPCC 2006) is used:

  • Uncertainty in the results of multiplication of uncertain values is computed as:

    $$ {U}_{total}=\sqrt{U_1^2+{U}_2^2+\cdots +{U}_n^2}, $$
    (4)

    where U total is the combined uncertainty in relative terms; U i is relative uncertainty in value i.

  • Uncertainty in the results of addition and subtraction:

    $$ U{}_{total}=\frac{\sqrt{{\left({U}_1\cdot {x}_1\right)}^2+{\left({U}_2\cdot {x}_2\right)}^2+\dots +{\left(U{}_n\cdot {x}_n\right)}^2}}{\left|{x}_1+x{}_2+\dots +{x}_n\right|}, $$
    (5)

    where x i is uncertain quantity i.

While implementing Formulas (4) and (5), correlation between years is not considered, as we estimate the total uncertainty at one point in time.

The GHG inventory is principally the sum of products of emission factors, activity data, and other estimation parameters. Therefore, Approach 1 can be implemented repeatedly to estimate the uncertainty of the total inventory. We use Formula (4) to combine uncertainties in activity data and emission factor, and Formula (5) to combine uncertainties from fossil fuels consumption.

3 Results and discussion

Fossil fuel consumption is the most precise and the main key source of GHG emissions. The relative uncertainty of GHG emissions from fossil fuel burning is still considerable (up to 10 %) and influences the results of GHG inventories. The main causes of uncertainty are uncertainties in emission factors, activity data, and methods used (so far, UNFCC methods are the most reasonable). Other sectors’ emission sources, such as industrial processes, agriculture, forestry and other land uses, and waste, cause lower emissions of certain kinds. For some countries, the uncertainties in GHG emissions in these categories can be less than 25 % or more than 100 % (NRC 2010) due to the insufficient accuracy of input data and models. Sectors other than energy are not key emission sources but might be key uncertainty sources of total uncertainty of GHG inventories because of the large size of the uncertainties. Our analysis is focused mainly on the uncertainty of fossil fuel CO2 emissions as it is the key source of GHG emissions in EU countries and the main object of international climate agreements and emission trading.

3.1 Historical change in uncertainty of CO2 emissions

To date only a few studies have analysed the change in relative uncertainties in GHG emissions due to structural changes in emissions and “learning” (Hamal 2010; Lesiv 2012). Here, the uncertainty analysis has been carried out for the EU-15 as a whole and for individual countries. The reported uncertainty for the EU-15 covers a short period only, which is not sufficient to carry out a proper analysis of the change in uncertainty and the factors influencing total uncertainty in relative terms. During the period 2003–2008 the emission structure did not change significantly, so the main reason for the change in uncertainty is the so-called “learning process”. For such a short period it is impossible to find any tendency of the change in uncertainty.

Further research focuses on the country level because data on uncertainties of CO2 emissions (stationary sources) are available for a longer period for individual countries. The analysis was carried out for the 15 member states.

One of the biggest GHG emitters is Germany, whose share of total emissions of the EU-15 is about 30 %. The reported uncertainty of CO2 emissions decreased by 13 % during the period 2003–2008. During that period the structure of uncertainty estimates changed several times. The results of uncertainty analysis are shown in Table 3. The decrease in uncertainty is caused mainly by increased knowledge of the inventory processes in category “1.A.2. Manufacturing Industries and Construction”.

Table 3 The analysis of relative uncertainty of CO2 emissions (stationary sources) without LULUCF for Germany (2003–2008)

Table 4 represents the results of analysis of the change in historical uncertainty of CO2 emissions (stationary sources) without LULUCF for Germany for the period 1990–2008 under the assumption that the relative uncertainty by category in 1990 is equal to the first estimates of uncertainty reported in 2003. During this period there were significant structural changes in fossil fuel consumption: a decrease in use of solid fuels and an increase in use of gaseous fuels. Mainly the decreasing solid fuels consumption in the category “1.A.2. Manufacturing industries and construction” reflected the decrease in total uncertainty. The ranges of total uncertainty during 1990–2008 were reduced by approximately 16 % (considering only precision).

Table 4 The analysis of relative uncertainty of CO2 emissions (stationary sources) without LULUCF for Germany (2000–2008)

The results of the uncertainty analysis for the EU-15 Member States are summarized in Table 5, except for Luxemburg, which first reported the uncertainty of GHG emissions in 2007. Countries are sorted by emitters starting from the largest, that is, Germany, because of its larger contribution to the total emissions and uncertainty of the EU-15. The last column of Table 5, “Analysis of the influence of individual factors on the change in uncertainty” includes the “decrease” or “increase” in uncertainty and the main cause of its change.

Table 5 The analysis of the historical change in uncertainty of CO2 emissions without LULUCF (stationary sources) for the EU’s Member States

Structural change in emissions always occurs and over longer periods it could significantly influence the total uncertainty in relative terms. The analysis of the historical change in total uncertainty of CO2 emissions (stationary sources) shows that for individual countries the structural change in emissions may be the main factor in the uncertainty change while for the EU-15 total uncertainty varies mainly due to the increased knowledge on inventory processes (“learning”). For example, for Italy, France, the Netherlands, Belgium, Greece, and Denmark, changes in uncertainty of CO2 emissions are caused mainly by structural changes in emissions; in contrast, for Germany, the UK, Austria, Portugal, Finland, and Sweden, they are caused mainly by “learning” (the change in estimates of emission factors and activity data).

3.2 Future change in uncertainty of total GHG emissions

Based on the above past analysis and considering the EU’s ambitious targets under the Integrated Energy and Climate Change package, more structural changes in fuel consumption are expected in the future. The estimation of relative uncertainty in GHG emissions for a certain point of time in the future would show whether uncertainty in total inventory results will increase or decrease and would identify the main reason for changes in uncertainty.

Further, the results of uncertainty estimates for the year 2020 are described. As mentioned in Section 2.2, we assume that our future knowledge of uncertainty in activity data and carbon content will be the same as today’s knowledge in relative terms. In other words, relative uncertainty is kept constant during the investigated period. For our calculations we took emission scenarios developed at the International Institute for Applied Systems Analysis (GAINS) because they are based on countries’ emission projections and reflect the results of implementing new policies and measures and also a baseline scenario. More information on the above scenarios is available on the GAINS website (IIASA 2010).

The calculations were based on the GAINS emission scenarios for the EU-15 for the year 2020 (see Box 1).

The results of calculation of the total uncertainty are shown in Fig. 2. “C&E package + NitrDir; OPTV5” is the only scenario that results in a decrease in total uncertainty in relative terms due to the structural change, because it assumes an appreciable emission reduction in the agricultural sector, which is characterized by high uncertainties.

Fig. 2
figure 2

Change (%) in total uncertainty of GHG emissions for EU-15 in 2020 under GAINS emissions scenarios (without LULUCF)

Assessments of total uncertainty in relative terms were also made while considering possible reductions in uncertainties of GHG emissions in fugitive emissions and the agricultural and waste sectors, which could be achieved in the future (2020). We assumed that the uncertainty of fugitive emissions will decrease to 25 %, that of GHG emissions in agriculture to 50 %, and that of GHG emissions from waste to 15 %. These assumptions were based on given possible improvements in uncertainty assessment in a few years for developed countries (NRC 2010). The results are illustrated in Fig. 3.

Fig. 3
figure 3

Reduction (%) in total uncertainty of GHG emissions for the EU-15 in 2020 under GAINS emissions scenarios considering possible increases in knowledge in sectors with high uncertainty (without LULUCF)

Figure 3 shows that reductions in uncertainties in fugitive emissions, agriculture, and waste can cause a significant decrease in total uncertainty in relative terms. Even in the case of the “worst” emission scenario, “C&E package; current legislation”, which does not consider implementation of new policies legislatively, the total uncertainty decreases over time. Comparison of the results achieved (Figs. 2 and 3) shows that “learning” is a driving factor of decreases in total uncertainty in relative terms.

The conducted analysis is based on reported uncertainties in relative terms that consider only precision. The recalculations of total uncertainty considering accuracy increase uncertainty ranges and reinforce the influence of increased knowledge on inventory processes (Hamal 2010).

The estimates of uncertainty in CO2 emissions from stationary sources are the most certain and can be improved more because not all countries use higher tier inventory methods and emission factors or other estimation parameters and their associated uncertainties, which should be estimated from original research including country-specific data.

In terms of global carbon accounting, the sizes of changes in uncertainties are not that large. However, at country level these changes in uncertainties over time should be considered while establishing new international agreements on GHG emission targets. Also, decreased uncertainties in GHG emissions will make emissions trading between countries clearer.

Box 1. GAINS emission scenarios

C&E (Climate & Energy) package + NitrDir; OPTV5 Footnote 1—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets; and an agricultural projection that explores the potential implications of a full implementation of the Nitrates Directive (EC 1991);

NEC2007 baseline; current policy—an emission scenario that employs the PRIMES baseline projection of November 2007, which illustrates a business-as-usual case without further climate measures, and an agricultural projection that reflects national perspectives on the development of the agricultural sector;

C&E package; EP targets; OPTV5—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets, and an agricultural projection that reflects national perspectives on the development of the agricultural sector; it meets more stringent environmental objectives in 2020, as requested by the European Parliament;

C&E package; OPTV5—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets, and an agricultural projection that reflects national perspectives on the development of the agricultural sector;

C&E package; MRRV5 Footnote 2 is based on the activity projections of the EU’s “20-20-20” targets and estimates the potential for further emission reductions that are achievable through a full application of the most advanced technical (add-on) emission control measures that are on the market today;

C&E package + PrimPM2.5; OPTV5—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets and an agricultural projection that reflects national perspectives on the development of the agricultural sector and that health impacts of particulate matter are solely caused by primary emissions of PM2.5; that is, that secondary aerosols would not cause negative health effects;

C&E package + IMO light; OPTV5—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets and an agricultural projection that reflects national perspectives on the development of the agricultural sector and the new limits for emissions that were agreed at a meeting of the International Maritime Organisation (IMO) Marine Environment Protection Committee (MEPC) in April 2008;

C&E package; least-cost of CLE presents the least-cost implementation of the emission levels of the current policy case of the EU’s “20-20-20” strategy;

C&E package + NoRen; OPTV5—an optimized emission scenario that assumes an energy projection that is consistent with the EU’s “20-20-20” targets (the 20 % renewable target is met in this scenario within each country without international trading) and an agricultural projection that reflects national perspectives on the development of the agricultural sector;

PRIMES_2009—PRIMES baseline scenario of the year 2009;

C&E package; current policy assumes baseline for NECD plus the EU’s “20-20-20” strategy;

C&E package; current legislation2014the “current legislation” projection for the Climate and Energy Package.

4 Conclusions

Total uncertainty in relative terms changes over time due to structural changes in GHG emissions and the increased knowledge of inventory processes or so-called “learning”. Analysis of the historical change in uncertainty has been carried out for the EU-15 as well as for individual countries. The achieved results confirm that the uncertainty of CO2 emissions of the EU-15 has changed historically mainly due to increased knowledge of GHG inventory processes. In contrast, for some individual countries (Italy, France, Netherlands, Belgium, Greece, Denmark) total uncertainty of CO2 emissions (excluding LULUCF) changed in the past only due to structural changes in emissions. Germany, as the biggest European GHG emitter, reported a considerable decrease in uncertainty caused by “learning”. The recalculations of total uncertainty considering accuracy lessen the influence of the structural change in emissions.

The calculations of total uncertainty in relative terms considering today’s knowledge of inventory processes have been based on the GAINS emission scenarios until 2020. The estimates of total uncertainty that assume constant relative uncertainty during the investigated period show the increase in uncertainty for most of the emission scenarios except the scenario “C&E package + NitrDir; OPTV5”, which is consistent with the EU’s “20-20-20” targets and an agricultural projection that explores the potential implications of a full implementation of the Nitrates Directive. Such an increase in total uncertainty is caused by the increased proportion of renewables, which have less certain emission factors and activity data, and decreased proportion of emission categories (agriculture, waste, etc.) in energy consumption. These changes in uncertainty due to structural change in emissions are negligible, though, while the estimates of total uncertainty of GHG emissions that assume a possible decrease in uncertainty in future due to the “learning” based on the GAINS emissions scenarios show a considerable decrease in total uncertainty. Thus improving our knowledge of fugitive emissions and the agricultural and waste sectors could cause significant reductions in total GHG emissions uncertainties.

This study underlines that “learning” is the main reason for the change in uncertainty in the last few decades and could be a very important factor in uncertainty reduction in the near future. Scientists and experts should put more effort into increasing knowledge of the inventory processes, especially in sectors (agriculture, waste, etc.) which are expected to be the main drivers of uncertainties in GHG emissions.