Leakage risks of geologic CO2 storage and the impacts on the global energy system and climate change mitigation
This study investigated how subsurface and atmospheric leakage from geologic CO2 storage reservoirs could impact the deployment of Carbon Capture and Storage (CCS) in the global energy system. The Leakage Risk Monetization Model was used to estimate the costs of leakage for representative CO2 injection scenarios, and these costs were incorporated into the Global Change Assessment Model. Worst-case scenarios of CO2 leakage risk, which assume that all leakage pathway permeabilities are extremely high, were simulated. Even with this extreme assumption, the associated costs of monitoring, treatment, containment, and remediation resulted in minor shifts in the global energy system. For example, the reduction in CCS deployment in the electricity sector was 3% for the “high” leakage scenario, with replacement coming from fossil fuel and biomass without CCS, nuclear power, and renewable energy. In other words, the impact on CCS deployment under a realistic leakage scenario is likely to be negligible. We also quantified how the resulting shifts will impact atmospheric CO2 concentrations. Under a carbon tax that achieves an atmospheric CO2 concentration of 480 ppm in 2100, technology shifts due to leakage costs would increase this concentration by less than 5 ppm. It is important to emphasize that this increase does not result from leaked CO2 that reaches the land surface, which is minimal due to secondary trapping in geologic strata above the storage reservoir. The overall conclusion is that leakage risks and associated costs will likely not interfere with the effectiveness of policies for climate change mitigation.
KeywordsCarbon capture, utilization and storage Geologic CO2 storage Leakage risk Climate change mitigation Integrated assessment modeling GCAM Carbon tax Representative concentration pathways
Transitions to carbon-neutral economies to reduce climate change risks require that energy systems worldwide be decarbonized. CO2 Capture and Storage (CCS) technologies are important components of the energy technology portfolios that facilitate this transformation because they can mitigate CO2 emissions while meeting energy demand with carbon-intensive energy technologies (IPCC 2014a; Schleussner et al. 2016). CCS comprises CO2 capture from large stationary sources (e.g., coal or natural gas power plants) and transport to locations where it is injected into porous geologic formations deep underground to isolate it from the atmosphere (Benson and Surles 2006). The latter part is referred to as Geologic CO2 Storage (GCS). The worldwide potential capacity of GCS has been estimated at 2000 to 4000 GtCO2 (IPCC 2014a; Metz et al. 2005), which is equivalent to 60 to 120 years of the global emissions of CO2 from the consumption of energy in 2012.
Integrated assessment models (IAMs), incorporating the physical and cost characteristics of energy technologies and the interactions between climate and energy systems, enable evaluation of the timing and magnitude of decarbonization of the energy system and of how policy instruments may incentivize the deployment of CO2 mitigation technologies (Calvin et al. 2012; Edenhofer et al. 2010; Edmonds et al. 2004; Fawcett et al. 2015; IPCC 2014a; Kriegler et al. 2014; van Vuuren et al. 2011). Specifically, IAMs have been used to analyze CCS deployment for various scenarios of technological availability and options for regulatory control (Bosetti et al. 2012; Griffin et al. 2014; Kalkuhl et al. 2015; Kanudia et al. 2014; Koelbl et al. 2014; Muratori et al. 2016, 2017; Smith et al. 2015; van der Zwaan and Gerlagh 2009, 2016; van der Zwaan and Smekens 2009). In most of these analyses, CCS technologies are used for 20–80% of primary energy production under various scenarios. These analyses also show that stringent climate goals can be met without CCS technologies, but doing so increases estimated mitigation costs by 50–250% (e.g., IPCC 2014a). CCS may become more attractive with the potential of “negative emissions” by coupling it with bioenergy and air capture (Lackner et al. 2012).
There are potential obstacles to large-scale CCS deployment, including the possibility of leakage from GCS reservoirs (Bielicki et al. 2014, 2015; Blackford et al. 2013; Fitts and Peters 2013; Hepple and Benson 2005; Herzog 2011; Leung et al. 2014). The economic implications of leakage have been investigated, some using integrated assessment models, by considering the economic burden that would fall on future generations or lost carbon credits when leaked CO2 returns to the atmosphere (Gerlagh and van der Zwaan 2012; Ha-Duong and Keith 2003; Keller et al. 2008; Teng and Tondeur 2007; van der Zwaan and Gerlagh 2009, 2016; van der Zwaan and Smekens 2009). While these normative studies provide valuable insights on “acceptable” rates of leakage to the atmosphere, they do not consider the geophysical processes that control the outcomes and economic consequences of leakage.
In fact, an abundance of field and modeling studies have illuminated the subsurface systems and geophysical processes associated with GCS, especially in deep saline aquifers (for a review, see (Celia et al. 2015)). The data and the practical models resulting from these studies have enabled quantitative analysis of leakage risk and the associated costs (Bielicki et al. 2016). For example, previous work has investigated leakage risk in sedimentary basins by simulating worst-case scenarios of reservoir siting and leaking-well permeabilities (Bielicki et al. 2015, 2016). One major finding is that, even at unrealistically high well permeability, leaked CO2 is very unlikely to be released to the atmosphere because of the interception by overlying geologic strata (Bielicki et al. 2016), which was termed as “secondary trapping.”
Previous studies have also examined the unique economic consequences that can result from four leakage outcomes (Bielicki et al. 2014, 2016): leaked fluids may (1) accumulate in formations overlying the storage reservoir, but remain isolated from other subsurface activities; (2) interfere with another subsurface activity (e.g., natural gas storage, deep-well injection of wastes); (3) cause groundwater contamination; or (4) reach the land surface and escape into the atmosphere. The first outcome could be considered “benign leakage”. Even though it has no negative physical effects, regulatory requirements may involve costly remedial actions and incur economic consequences that need to be considered with those of other leakage outcomes.
To date, however, the wealth of knowledge in the GCS community has rarely been integrated into IAM analyses. Existing integrated assessment analyses of leakage have accounted for only seepage to the atmosphere using assumed leakage rates, while the subsurface outcomes of leakage, and their expected costs, have not been addressed. This study bridges this research gap and answers the question: How could the economic consequences of leakage, which arise from the geophysical processes of the subsurface system, affect the deployment of CCS in the global energy system?
We developed a model framework that uses the Leakage Risk Monetization Model (LRiMM) to estimate CO2 leakage and its expected costs (Bielicki et al. 2016) and then modifies the costs for GCS in the Global Change Assessment Model (GCAM) (Calvin et al. 2012). As a demonstration, leakage was simulated using a geophysical representation of the Michigan sedimentary basin and injection scenarios into the Mt. Simon sandstone. While offshore storage is a potentially important option for GCS (van der Zwaan and Gerlagh 2016), we focused on onshore GCS. An array of leakage scenarios was examined by considering multiple geographic locations of injection. Consistent with the prior work (Bielicki et al. 2015), we used permeability values for the potential leakage pathways that represent worst-case leakage scenarios. The resulting monetized leakage risk curves were extrapolated to represent onshore GCS opportunities worldwide. Although there have been no comparative studies of worldwide storage opportunities, and it is thus difficult to state with certainty that our basin and formation are representative of GCS opportunities worldwide, they are considered to be typical targets for CO2 storage. For example, their geophysical properties are comparable to those of the sites chosen for current onshore GCS projects (Celia et al. 2015) and are consistent with the geophysical properties that are required to meet the capacity, injectivity, and containment of suitable geologic CO2 storage sites. In addition, oil and gas activities tend to be co-located with the areas that are suitable for GCS (Metz et al. 2005), which is the case with the basin that we studied. Here, we investigated the impacts of leakage risk on CCS deployment in the energy sector and the resulting changes in stored CO2 under four mitigation scenarios: two CO2 tax scenarios and two Representative Concentration Pathways (RCP) (Moss et al. 2010). Changes in CO2 atmospheric concentrations and CO2 allowance prices are also examined under the CO2 tax and RCPs scenarios, respectively.
2 Model framework and simulation conditions
2.1 The leakage risk monetization model and study area
LRiMM quantifies the Monetized Leakage Risk (MLR)—the expected cost of leakage—for a given injection scenario (Bielicki et al. 2016). LRiMM includes a three-dimensional geospatial representation of the sedimentary basin, a semi-analytical model for estimating leakage (Celia et al. 2011), and the Leakage Impact Valuation (LIV) method that estimates the economic consequences of leakage (Bielicki et al. 2014). For detailed model descriptions, we refer readers to the original paper (Bielicki et al. 2016).
In this application, the 3D geospatial model was limited to the Michigan sedimentary basin due to data availability. It represents a sedimentary basin that has multiple subsurface uses (Bielicki et al. 2015), with a deep saline aquifer (Mt. Simon sandstone) that has potential (6–95 GtCO2) for commercial-scale GCS (Medina et al. 2011). The 3D geophysical characterization of the Michigan sedimentary basin, the range of leakage pathway permeabilities (10−10, 10−12, 10−14, and 10−16 m2), the information on other subsurface activities (e.g., natural gas storage, deep-well waste injection), and the probabilistic approach used to account for uncertainty in critical geophysical parameters in the current study have been detailed in previous investigations (Bielicki et al. 2015, 2016). It should be noted that we used a range of leakage pathway permeability values that are much higher than those reported for properly plugged wells (10−14 to 10−18 m2 (Tao and Bryant 2014)) or abandoned oil and gas wells (10−13 to 10−21 m2 (Kang et al. 2015)). We advance the prior work by sampling many different sites within the basin (see Supplementary Materials for details of the 42 injection sites) to create an array of possible leakage outcomes and interactions with other subsurface resources.
At each site, we simulated injection of 1 MtCO2/year continuously for 50 years, following the common practices envisioned for commercial-scale GCS (National Energy Technology Laboratory 2012), and the subsequent CO2 migration, brine displacement, and pressure propagation throughout the geologic formations. As a result, a probabilistic representation of different leakage outcomes was generated.
For each leakage outcome, the LIV method constructs low- and high-cost storylines that describe the financial exposure of various stakeholders. These costs are weighted by the pressure buildup and CO2 plume size at the site and then multiplied by the probability of the leakage outcome to compute the MLR. The total MLR is the sum of the MLRs for all possible leakage outcomes and stakeholders. This expected cost (in 2010 USD) is only calculated for the operational period because the probabilities and consequences of leakage decrease as pressure buildup dissipates after injection ends and is divided by 1.5 to represent the 1990 USD used in GCAM.
2.2 The global change assessment model
GCAM identifies the least-cost portfolio of energy technologies for a CO2 emissions mitigation target. It models the interactions between the global climate, economic, and energy systems and uses a partial equilibrium, recursive, dynamic, and deterministic approach to solve the entire system at 5-year intervals up to the year 2100. Detailed model descriptions and a list of GCAM publications are available at http://www.globalchange.umd.edu/gcam/. Here, we highlight the energy system and the attributes associated with CCS (Fig. 1).
In GCAM, CCS can be applied to cement production facilities and to three types of energy technologies: (1) liquids refining, using coal, or biomass, (2) hydrogen production, and (3) electricity generation using coal, natural gas, oil, or biomass. The costs of CCS in GCAM include those that are specific to each energy technology (Muratori et al. 2017), and those that are generic across technologies (i.e., the costs associated with GCS). Our approach was to modify the GCS costs by adding the cost of leakage risk.
The global onshore GCS capacity in GCAM totals 5800 GtCO2.1 This capacity is divided into four grades with increasing cost: 0.5, 10, 60, and 29.5%, and each grade has a unique GCS cost curve. The unmodified costs range from $0.03 to $55.90/tCO2 (in 1990 USD), and the majority of the CO2 storage capacity is available at a price between $3.74 to $7.47/tCO2, which is consistent with the range of costs in the literature (Herzog 2011). The unlimited offshore GCS capacity is available at a cost of $96 /tCO2 (1990 USD), which is higher than the majority of the onshore GCS costs.
2.3 Modifying cost curves
A total of 2100 MtCO2 was injected at the 42 sites. The unique MLR for each tonne of CO2 was rank-ordered so that each incremental tonne of CO2 goes to the site that has the lowest MLR. To upscale the marginal cost curve of leakage risk that was determined for the Michigan basin to GCS opportunities worldwide, this rank-ordered curve was divided into four grades in accordance with the onshore GCS capacity percentages in GCAM. Within each grade, the marginal cost curve of leakage risk was added to the original GCS cost curve, under the assumption that leakage risk increases with GCS cost. While there is little evidence on the correlation between leakage risk and GCS costs, this assumption generates modified cost curves that are similar to those that are generated with no correlation between GCS costs and leakage risk (see Supplementary Materials).
We did not modify the cost curves for offshore GCS storage because LRiMM was developed for onshore GCS. Even if LRiMM results were applicable to offshore GCS, the large offshore GCS capacity in GCAM implies that effectively unlimited capacity is available at negligible risk. In addition, because offshore GCS is available at a higher cost in GCAM, adding costs of leakage risk is unlikely to significantly alter GCS deployment.
2.4 Climate change mitigation scenarios
Ctax1: $2.73/tCO2 in 2020 and reaches $135/tCO2 by 2100 (in 1990 USD).
Ctax2: $6.82/tCO2 in 2020 and reaches $338/tCO2 by 2100 (in 1990 USD).
The Ctax1 scenario is much less effective in mitigating CO2 emissions than the Ctax2 scenario, in which atmospheric CO2 peaks at 520 ppm around 2070 and decreases below 480 ppm by 2100.
The two RCP scenarios (RCP2.6 and RCP4.5) provide the opportunity to investigate the responses of the energy system to leakage under different CO2 emissions mitigation scenarios. To implement an RCP scenario in GCAM, a trajectory of radiative forcing is specified, and the CO2 allowance price is solved at every time step from the year 2020 such that the resulting energy production, economic activities, and GHGs emissions satisfy the radiative forcing constraint (Muratori et al. 2017). In the stringent RCP2.6 scenario, the radiative forcing reaches ~3.0 W/m2, atmospheric CO2 peaks around 490 ppm, and then both metrics decline by 2100 (van Vuuren et al. 2011). The RCP4.5 scenario models a radiative forcing that never exceeds 4.5 W/m2 (~600 ppm CO2 equivalent) (Thomson et al. 2011).
3 Results and discussion
3.1 Marginal cost curves of leakage risk
Because the MLR curves for leakage pathway permeabilities of 10−12 to 10−16 m2 are essentially the same (differ by < $0.5/tCO2, Fig. 2c), we only implemented in GCAM the MLR curves for two leakage cases: “high” and “extremely high,” which correspond to leakage pathway permeability of 10−12 and 10−10 m2, respectively. These cases are worst-case scenarios because (a) the permeability values are very high compared to reported field measurements and (b) these values are assigned to all of the 45,000 leakage pathways within the basin (Bielicki et al. 2015). The results are compared with those for a “no leakage” case in which all leakage pathways are assumed impervious.
The majority of the leakage costs result from leakage that does not reach groundwater or the land surface (Fig. 2d). On average, 74% of the MLR in the extremely high leakage case and 90% in the high leakage case are attributed to cost that arises from the benign leakage that undergoes secondary trapping. The remaining costs are incurred when leakage interferes with other subsurface activities—mostly with oil and gas production; the costs due to groundwater contamination and surface seepage are negligible. Even in the extremely high leakage case, only 0.005% of the total amount of injected CO2 migrates into the groundwater aquifer after 50 years of simulated injection over all of the 42 injection sites.
3.2 Impact on CCS deployment and the global energy system
The GCS costs in GCAM, and the increased costs due to leakage risk, do not vary across the fuels and sectors that deploy CCS (see Supplementary Material). Here, we focus on the electricity sector, which has more CO2 stored than others. We quantify the projected changes in CCS deployment in terms of the amount of electricity that is generated by CCS technologies: coal, natural gas, oil, and biomass facilities with CCS.
The decrease in the electricity generated by CCS technologies does not produce an equivalent decrease in the total electricity generation, partly because of the increase in the use of fossil fuels and biomass without CCS. In the extremely high leakage case with Ctax2, the cumulative electricity production using fossil fuels and biomass decreases by only 106 EJ. There are smaller increases in the use of fossil fuels and biomass without CCS under the more stringent climate goal (e.g., RCP2.6).
The shift to energy technologies that do not emit CO2, mostly nuclear, further reduces the impact of leakage risk on electricity generation. For all of the leakage cases and mitigation scenarios that we investigated, the reduction in cumulative electricity generation is within 1% of the no leakage case.
Overall, total primary energy production is essentially unaffected across the scenarios (<1% difference, see Supplementary Material). Accordingly, the energy end-use sectors are not noticeably affected by leakage risk. For example, the use of different types of fuels (e.g., delivered gas, electricity, refined liquids) in the transportation sector for the leakage cases changes <0.1% from the no leakage case under all CO2 emissions mitigation scenarios (see Supplementary Material).
3.3 Impact on atmospheric CO2 concentrations
For the atmospheric CO2 concentration, the indirect effects of the increased cost of GCS with leakage are greater than the direct effects of CO2 seepage. The surface seepage of CO2 that would increase the atmospheric CO2 concentration by 1 ppm (~2.2 GtC) amounts to 0.7 and 1.2% of the CO2 that is stored under Ctax2 (1104 GtCO2, no leakage) and Ctax1 (649 GtCO2, no leakage), respectively. These values are orders of magnitude greater than the seepage of CO2 to the atmosphere for the worst-case scenarios considered here. Even if secondary trapping is ineffective and all of the leaked CO2 eventually reaches the surface, which is ~0.003 and ~0.2% for the high and extremely high leakage cases, respectively, the resulting increase in the atmospheric CO2 concentration would be much less than 1 ppm.
For the RCP scenarios, the goal is to achieve a desired trajectory of radiative forcing, and thus, the atmospheric CO2 concentration is not affected by the leakage risk. Instead, CO2 prices for the leakage cases increase in addition to some shifts in the energy system (see the Supplementary Material).
3.4 Uncertainties and implications
Our primary finding is that leakage risk is likely to have a negligible effect on CCS deployment in the global energy system and the effectiveness of climate change mitigation policies—especially for more stringent climate mitigation targets. Here, we discuss this finding in the context of uncertainties generated by the model framework’s assumptions, approaches, and abstractions.
The GCAM projections of the effects of leakage are expected to be greater than from other IAMs because inter-model comparison studies have shown that GCAM tends to deploy CCS more than other IAMs (van der Zwaan et al. 2013; Wilkerson et al. 2015). The increase in CO2 storage costs from the worst-case leakage cases considered here leads to at most a small reduction in the deployment of CCS, which is negligible compared with the inter-model discrepancies. Further, the projected atmospheric CO2 concentrations under the two CO2 tax scenarios are higher than those for the no leakage case by only a few ppm. Such differences are within the uncertainties in climate modeling (IPCC 2014b) and are negligible when compared to the increase in atmospheric CO2 concentration that would result from not using CCS (Fig. 4a). In addition, since the impact of the worst-case scenario assumption on the overall leakage costs is far greater than that may arise from other geophysical modeling options (e.g., the choice of target formation, see Supplementary Materials), we feel confident that the primary finding of our study would hold for a wide range of sedimentary basin conditions.
This is not to say that leakage risk is not important in CCS deployment and operational decision-making. It will always be important to carefully site GCS reservoirs, monitor CO2 movement in the subsurface, and track the potential for environmental damage (Herzog 2011, Pawar et al. 2015). Furthermore, the costs of leakage may still be substantial for some stakeholders at individual storage reservoirs (Bielicki et al. 2016).
Our second major finding is that the indirect effects of leakage risk are greater than the direct effects of surface seepage on CO2 emissions mitigation. As such, it is important to ensure a twofold assessment, i.e., for potential GCS reservoirs to be assessed on the probability for leaked CO2 to reach the atmosphere and on the consequences of leakage that remains in the subsurface. The twofold assessment can guide GCS siting to minimize leakage costs from interferences with subsurface activities. The benign CO2 leakage that is contained in the subsurface by secondary trapping may account for the majority of the expected cost of leakage risk. If secondary trapping was to be considered a reliable backup trapping mechanism, then relaxing the requirements to address leakage could further reduce costs and the effect of leakage on CCS deployment and on the atmospheric CO2 concentration could be even smaller than what was predicted by our GCAM simulations.
This work is the first to develop a model framework that quantifies the extent to which the physical processes of secondary trapping and the economic costs of leakage from GCS reservoirs affect the deployment of CCS and other CO2 emissions mitigation technologies in the global energy system. In some respects, our results are similar to those from past IAM studies of leakage from GCS reservoirs that consider only seepage of leaked CO2 to the atmosphere. However, we conclude that twofold assessment of surface seepage and of subsurface leakage is needed for GCS siting. Such a framework provides critical information regarding secondary trapping and its associated costs, which are substantial but may be reduced if secondary trapping were to be considered a reliable backup trapping mechanism. Our study gives further confidence that CCS has the potential to become an important technology for achieving climate goals, even with the expected costs of leakage risk and the seepage of CO2 to the atmosphere. While acknowledging the uncertainties in quantifying leakage rates and risks, and recognizing the limitations and uncertainties in the integrated assessment modeling framework, we conclude that, from the perspective of energy system level least-cost simulation and modeling, the expected cost of leakage risk is unlikely to significantly hinder global CCS deployment or the effectiveness of policy for mitigating climate change.
This work was supported by the Program in Science, Technology, and Environmental Policy at Princeton University through the William Clay Ford, Jr. ‘79 and Lisa Vanderzee Ford ‘82 Graduate Fellowship fund, and NSF Grants from CBET (1438278) and the Sustainable Energy Pathways program (1230691).
H.D. designed and conducted the study, interpreted results, and wrote the paper. J.M.B. designed the study, interpreted results, and wrote the paper. M.O, J.P.F., and C.A.P wrote the paper.
- Blackford J, Hattam C, Widdicombe S, Burnside N, Naylor M, Kirk K, Maul P, Wright I (2013) CO2 leakage from geological storage facilities: environmental, societal and economic impacts, monitoring and research strategies. Geological Storage of Carbon Dioxide (CO2): Geoscience, Technologies, Environmental Aspects and Legal Frameworks, p 149–178Google Scholar
- Edenhofer O, Knopf B, Barker T et al (2010) The economics of low stabilization: model comparison of mitigation strategies and costs. Energy J 31:11–48Google Scholar
- Fitts JP, Peters CA (2013) Caprock fracture dissolution and CO2 leakage. In: DePaolo DJ, Cole DR, Navrotsky A, Bourg IC (eds) Reviews in Mineralogy & Geochemistry Vol. 77, pp 459–479. doi:10.2138/rmg.2013.77.13.
- IEA (2014) CO2 Emissions From Fuel Combustion Highlights 2014 Edition. https://www.connaissancedesenergies.org/sites/default/files/pdfactualites/co2_emissions_from_fuel_combustion_2014.pdf.
- IPCC (2014a) Climate Change 2014: Mitigation of Climate Change. Contribution of Working Group III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change [Edenhofer O, Pichs-Madruga R, Sokona Y, Farahani E, Kadner S, Seyboth K, Adler A, Baum I, Brunner I, Eickemeier P, Kriemann B, Savolainen J, Schlömer S, von Stechow C, Zwickel T and Minx JC (eds.)]. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA.Google Scholar
- IPCC (2014b) Summary for Policymakers. In: Climate change 2014: impacts, adaptation, and vulnerability. Part A: global and sectoral aspects. Contribution of Working Group II to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change [Field CB, Barros VR, Dokken DJ, Mach KJ, Mastrandrea MD, Bilir TE, Chatterjee M, Ebi KL, Estrada YO, Genova RC, Girma B, Kissel ES, Levy AN, MacCracken S, Mastrandrea PR, and White LL (eds.)]. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, pp. 1–32Google Scholar
- Metz B, Davidson O, de Coninck H, Loos M, Meyer L (2005) IPCC special report on carbon dioxide capture and storage. Cambridge: Cambridge University Press for the Intergovernmental Panel on Climate Change. Climate Change 2014: Impacts, Adaptation, and Vulnerability. Part A: Global and Sectoral Aspects. Contribution of Working Group II to the Fifth Assessment Report of the Intergovernmental Panel of Climate ChangeGoogle Scholar
- National Energy Technology Laboratory (2012) The 2012 United States Carbon Utilization and Storage Atlas – Fourth Edition (Atlas IV). https://www.netl.doe.gov/File%20Library/Research/Coal/carbonstorage/atlasiv/Atlas-IV-2012.pdf
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.