A framework for testing dynamic classification of vulnerable scenarios in ensemble water supply projections
Recent water resources planning studies have proposed climate adaptation strategies in which infrastructure and policy actions are triggered by observed thresholds or “signposts.” However, the success of such strategies depends on whether thresholds can be accurately linked to future vulnerabilities. This study presents a framework for testing the ability of adaptation thresholds to dynamically identify vulnerable scenarios within ensemble projections. Streamflow projections for 91 river sites predominantly in the western USA are used as a case study in which vulnerability is determined by the ensemble members with the lowest 10% of end-of-century mean annual flow. Illustrative planning thresholds are defined through time for each site based on the mean streamflow below which a specified fraction of scenarios is vulnerable. We perform a leave-one-out cross-validation to compute the frequency of incorrectly identifying or failing to identify a vulnerable scenario (false positives and false negatives, respectively). Results show that in general, this method of defining thresholds can identify vulnerable scenarios with low false positive rates (< 10%), but with false negative rates for many rivers remaining higher than random chance until roughly 2060. This finding highlights the tradeoff between frequently triggering unnecessary action and failing to identify potential vulnerabilities until later in the century, and suggests room for improvement in the threshold-setting technique that could be benchmarked with this approach. This testing framework could extend to thresholds defined with multivariate statistics, or to any application using thresholds and ensemble projections, such as long-term flood and drought risk, or sea level rise.
Any opinions, findings, and conclusions are those of the authors and do not necessarily reflect the views or policies of the NSF. We further acknowledge the World Climate Research Program’s Working Group on Coupled Modeling and the climate modeling groups listed in the Supplement of this paper for producing and making available their model output.
This work was partially supported by the U.S. National Science Foundation grants CNS-1639268 and CNH-1716130.
- Anderson J, Chung F, Anderson M, Brekke L, Easton D, Ejeta M, Peterson R, Snyder R (2008) Progress on incorporating climate change into management of California’s water resources. Clim Chang 87(1 SUPPL). https://doi.org/10.1007/s10584-007-9353-1.
- Brekke L, Wood A, Pruitt T (2014) Downscaled CMIP3 and CMIP5 hydrology climate projections: release of hydrology projections, comparison with preceding information, and summary of user needs, US Bureau of Reclamation. Available at: https://gdo-dcp.ucllnl.org/downscaled_cmip_projections/techmemo/BCSD5HydrologyMemo.pdf
- Dottori F, Szewczyk W, Ciscar J-C, Zhao F, Alfieri L, Hirabayashi Y, Bianchi A, Mongelli I, Frieler K, Betts R, Feyen L (2018) Increased human and economic losses from river flooding with anthropogenic warming. Nat Clim Chang. https://doi.org/10.1038/s41558-018-0257-z.
- Fletcher SM, Miotti M, Swaminathan J, Klemun MM, Strzepek K, Siddiqi A (2017) Water supply infrastructure planning: decision-making framework to classify multiple uncertainties and evaluate flexible design. J Water Resour Plan Manag 143(10):4017061. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000823. CrossRefGoogle Scholar
- Frigg R, Smith LA, Stainforth DA (2013) The Myopia of Imperfect Climate Models : The Case of UKCP09, 80(December):886–897Google Scholar
- Hallegatte S, Shah A, Lempert R, Brown C, Gill S (2012) Investment decision making under deep uncertainty: application to climate change, Policy Research Working Paper, (6193), p 41. https://doi.org/10.1596/1813-9450-6193
- Herman JD, Reed PM, Zeff HB, Characklis GW (2015) How should robustness be defined for water systems planning under change? J Water Resour Plan Manag 141(10):4015012. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000509. CrossRefGoogle Scholar
- Herman JD, Zeff HB, Lamontagne JR, Reed PM, Characklis GW (2016) Synthetic drought scenario generation to support bottom-up water supply vulnerability assessments. J Water Resour Plan Manag 142(11):4016050. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000701. CrossRefGoogle Scholar
- Jeuland M, Whittington D (2014) Water resources planning under climate change: assessing the robustness of real options for the Blue Nile. Water Resour Res:2086–2107. https://doi.org/10.1002/2013WR013705.Received.
- Kwadijk JCJ, Haasnoot M, Mulder JPM, Hoogvliet MMC, Jeuken ABM, van der Krogt RAA, van Oostrom NGC, Schelfhout HA, van Velzen EH, van Waveren H, de Wit MJM (2010) Using adaptation tipping points to prepare for climate change and sea level rise: a case study in the Netherlands. Wiley Interdiscip Rev Clim Chang 1(5):729–740. https://doi.org/10.1002/wcc.64 CrossRefGoogle Scholar
- Leung LR, Qian Y, Bian X, Washington WM, Han J, Roads JO (2004) Mid-century ensemble regional climate change scenarios for the western United States. Clim Chang 62(1–3):75–113. https://doi.org/10.1023/B:CLIM.0000013692.50640.55. CrossRefGoogle Scholar
- Luckman BH (1998) Landscape and climate change in the Central Canadian Rockies during the 20th century. Can Geogr 42(4):319–336. https://doi.org/10.1111/j.1541-0064.1998.tb01349.x CrossRefGoogle Scholar
- Mote PW, Hamlet AF, Clark MP, Lettenmaier DP (2005) Declining mountain snowpack in Western North America, (January), pp. 39–49. https://doi.org/10.1175/BAMS-86-1-39
- Pederson GT, Gray ST, Woodhouse CA, Betancourt JL, Fagre DB, Littell JS, Watson E, Luckman BH, Graumlich LJ (2011) The unusual nature of recent snowpack declines in the North American Cordillera 543(July): 332–336Google Scholar
- Ray PA, Bonzanigo L, Wi S, Yang YCE, Karki P, García LE, Rodriguez DJ, Brown CM (2018) Multidimensional stress test for hydropower investments facing climate, geophysical and financial uncertainty. Glob Environ Chang 48(January 2017):168–181. https://doi.org/10.1016/j.gloenvcha.2017.11.013 CrossRefGoogle Scholar
- Seaber PR, Kapinos FP, Knapp GL (1987) Hydrologic unit maps: US Geological Survey Water Supply Paper 2294.Google Scholar
- US Global Change Research Program (2009) Global climate change impacts in the United States. Cambridge University PressGoogle Scholar
- Zeff HB, Kasprzyk JR, Herman JD, Reed PM, Characklis GW (2014) Navigating financial and supply reliability tradeoffs in regional drought management portfolios. Water Resour Res:4906–4923. https://doi.org/10.1002/2013WR015126.Received.