Abstract
The ability of a suite of models contributing to the sixth phase of the Coupled Model Intercomparison Project (CMIP6) to simulate observed large-scale atmospheric circulation patterns over the Pacific Northwest of North America is evaluated. Twelve representative patterns of 500-hPa geopotential height (Z500) anomalies are identified using the self-organizing map method applied to reanalysis. CMIP6 Z500 anomalies from simulations of the historical period are mapped to each reanalysis-derived pattern, and the resulting differences between patterns, as well as differences in frequency of pattern occurrence, are quantified. In general, models are able to simulate the range of Z500 patterns with reasonable fidelity, although model skill varies across the 25-member ensemble. Surface temperature and precipitation anomalies associated with each Z500 pattern are found to also be reasonably simulated by the models, with some biases noted. This boosts confidence that the models are simulating temperature and precipitation patterns for the correct physical reasons. The models exhibit a range of skill at simulating pattern occurrence frequency and pattern persistence, with more agreement in winter than summer. Results indicate that the CMIP6 models are appropriate for assessing future projections of key atmospheric circulation patterns and their impacts on temperature and precipitation over the region.
This is a preview of subscription content, access via your institution.













Data availability
The data used in this study was obtained from the World Research Climate Program (https://esgf-node.llnl.gov/projects/cmip6/) and the Goddard Earth Sciences Data and Information Services Center (https://disc.gsfc.nasa.gov/datasets?project=MERRA-2).
References
Abatzoglou JT (2016) Contribution of Cutoff Lows to Precipitation across the United States. J Appl Meteorol Climatology 55(4):893–899. https://doi.org/10.1175/JAMC-D-15-0255.1
Abatzoglou JT, Juang CS, Williams AP, Kolden CA, Westerling AL (2021) Increasing Synchronous Fire Danger in Forests of the Western United States. Geophys Res Lett 48(2). https://doi.org/10.1029/2020GL091377. e2020GL091377
Agel L, Barlow M (2020) How Well Do CMIP6 Historical Runs Match Observed Northeast U.S. Precipitation and Extreme Precipitation–Related Circulation? J Clim 33(22):9835–9848. https://doi.org/10.1175/JCLI-D-19-1025.1
Agel L, Barlow M, Colby F, Binder H, Catto JL, Hoell A, Cohen J (2019) Dynamical analysis of extreme precipitation in the US northeast based on large-scale meteorological patterns. Clim Dyn 52(3):1739–1760. https://doi.org/10.1007/s00382-018-4223-2
Aragon CM, Loikith PC, McCullar N, Mandilag A (2020) Connecting local-scale heavy precipitation to large-scale meteorological patterns over Portland, Oregon. Int J Climatol 40(11):4763–4780. https://doi.org/10.1002/joc.6487
Arritt RW, Rummukainen M (2011) Challenges in Regional-Scale Climate Modeling. Bull Am Meteorol Soc 92(3):365–368. https://doi.org/10.1175/2010BAMS2971.1
Bailey A, Chase TN, Cassano JJ, Noone D (2011) Changing Temperature Inversion Characteristics in the U.S. Southwest and Relationships to Large-Scale Atmospheric Circulation. J Appl Meteorol Climatology 50(6):1307–1323. https://doi.org/10.1175/2011JAMC2584.1
Belleflamme A, Fettweis X, Lang C, Erpicum M (2013) Current and future atmospheric circulation at 500 hPa over Greenland simulated by the CMIP3 and CMIP5 global models. Clim Dynamics; Heidelberg 41(7–8):2061–2080. http://dx.doi.org.proxy.lib.pdx.edu/https://doi.org/10.1007/s00382-012-1538-2
Boucher O, Servonnat J, Albright AL, Aumont O, Balkanski Y, Bastrikov V, Bekki S, Bonnet R, Bony S, Bopp L, Braconnot P, Brockmann P, Cadule P, Caubel A, Cheruy F, Codron F, Cozic A, Cugnet D, D’Andrea F, Vuichard N (2020) Presentation and Evaluation of the IPSL-CM6A-LR Climate Model. J Adv Model Earth Syst 12(7) e2019MS002010. https://doi.org/10.1029/2019MS002010
Brewer MC, Mass CF (2016) Projected Changes in Western U.S. Large-Scale Summer Synoptic Circulations and Variability in CMIP5 Models. J Clim 29(16):5965–5978. https://doi.org/10.1175/JCLI-D-15-0598.1
Brewer MC, Mass CF, Potter BE (2013) The West Coast Thermal Trough: Mesoscale Evolution and Sensitivity to Terrain and Surface Fluxes. Mon Weather Rev 141(8):2869–2896. https://doi.org/10.1175/MWR-D-12-00305.1
Bu L, Zuo Z, An N (2022) Evaluating boreal summer circulation patterns of CMIP6 climate models over the Asian region. Clim Dyn 58(1):427–441. https://doi.org/10.1007/s00382-021-05914-6
Budikova D (2009) Role of Arctic sea ice in global atmospheric circulation: A review. Glob Planet Change 68(3):149–163. https://doi.org/10.1016/j.gloplacha.2009.04.001
Cannon AJ (2020) Reductions in daily continental-scale atmospheric circulation biases between generations of global climate models: CMIP5 to CMIP6. Environ Res Lett 15(6):064006. https://doi.org/10.1088/1748-9326/ab7e4f
Cassano EN, Glisan JM, Cassano JJ, Jr WJG, Seefeldt MW (2015) Self-organizing map analysis of widespread temperature extremes in Alaska and Canada. Climate Res 62(3):199–218. https://doi.org/10.3354/cr01274
Cassano JJ, Uotila P, Lynch A (2006) Changes in synoptic weather patterns in the polar regions in the twentieth and twenty-first centuries, part 1: Arctic. Int J Climatol 26(8):1027–1049. https://doi.org/10.1002/joc.1306
Cassano JJ, Uotila P, Lynch AH, Cassano EN (2007) Predicted changes in synoptic forcing of net precipitation in large Arctic river basins during the 21st century. J Geophys Research: Biogeosciences 112(G4). https://doi.org/10.1029/2006JG000332
Collow ABM, Bosilovich MG, Koster RD (2016) Large-Scale Influences on Summertime Extreme Precipitation in the Northeastern United States. J Hydrometeorol 17(12):3045–3061. https://doi.org/10.1175/JHM-D-16-0091.1
Crimmins MA (2006) Synoptic climatology of extreme fire-weather conditions across the southwest United States. Int J Climatol 26(8):1001–1016. https://doi.org/10.1002/joc.1300
DeAngelis AM, Broccoli AJ, Decker SG (2013) A Comparison of CMIP3 Simulations of Precipitation over North America with Observations: Daily Statistics and Circulation Features Accompanying Extreme Events. J Clim 26(10):3209–3230. https://doi.org/10.1175/JCLI-D-12-00374.1
Duffy PB, Arritt RW, Coquard J, Gutowski W, Han J, Iorio J, Kim J, Leung L-R, Roads J, Zeledon E (2006) Simulations of Present and Future Climates in the Western United States with Four Nested Regional Climate Models. J Clim 19(6):873–895. https://doi.org/10.1175/JCLI3669.1
Eyring V, Bony S, Meehl GA, Senior CA, Stevens B, Stouffer RJ, Taylor KE (2016) Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization. Geosci Model Dev 9(5):1937–1958. https://doi.org/10.5194/gmd-9-1937-2016
Fabiano F, Meccia VL, Davini P, Ghinassi P, Corti S (2021) A regime view of future atmospheric circulation changes in northern mid-latitudes. Weather and Climate Dynamics 2(1):163–180. https://doi.org/10.5194/wcd-2-163-2021
Fernandez-Granja JA, Casanueva A, Bedia J, Fernandez J (2021) Improved atmospheric circulation over Europe by the new generation of CMIP6 earth system models. Clim Dyn 56(11):3527–3540. https://doi.org/10.1007/s00382-021-05652-9
Gao X, Schlosser CA, Xie P, Monier E, Entekhabi D (2014) An Analogue Approach to Identify Heavy Precipitation Events: Evaluation and Application to CMIP5 Climate Models in the United States. J Clim 27(15):5941–5963. https://doi.org/10.1175/JCLI-D-13-00598.1
Gelaro R, McCarty W, Suárez MJ, Todling R, Molod A, Takacs L, Randles CA, Darmenov A, Bosilovich MG, Reichle R, Wargan K, Coy L, Cullather R, Draper C, Akella S, Buchard V, Conaty A, da Silva AM, Gu W, Zhao B (2017) The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2). J Clim 30(14):5419–5454. https://doi.org/10.1175/JCLI-D-16-0758.1
Gibson PB, Perkins-Kirkpatrick SE, Renwick JA (2016) Projected changes in synoptic weather patterns over New Zealand examined through self-organizing maps. Int J Climatol 36(12):3934–3948. https://doi.org/10.1002/joc.4604
Gibson PB, Pitman AJ, Lorenz R, Perkins-Kirkpatrick SE (2017) The Role of Circulation and Land Surface Conditions in Current and Future Australian Heat Waves. J Clim 30(24):9933–9948. https://doi.org/10.1175/JCLI-D-17-0265.1
Gleckler PJ, Taylor KE, Doutriaux C (2008) Performance metrics for climate models. J Geophys Research: Atmos 113. https://doi.org/10.1029/2007JD008972
Glisan JM, Gutowski WJ, Cassano JJ, Cassano EN, Seefeldt MW (2016) Analysis of WRF extreme daily precipitation over Alaska using self-organizing maps. J Geophys Research: Atmos 121(13):7746–7761. https://doi.org/10.1002/2016JD024822
Grotjahn R (2013) Ability of CCSM4 to simulate California extreme heat conditions from evaluating simulations of the associated large scale upper air pattern. Clim Dyn 41(5):1187–1197. https://doi.org/10.1007/s00382-013-1668-1
Grotjahn R, Black R, Leung R, Wehner MF, Barlow M, Bosilovich M, Gershunov A, Gutowski WJ, Gyakum JR, Katz RW, Lee Y-Y, Lim Y-K, Prabhat (2016) North American extreme temperature events and related large scale meteorological patterns: A review of statistical methods, dynamics, modeling, and trends. Clim Dyn 46(3):1151–1184. https://doi.org/10.1007/s00382-015-2638-6
Grotjahn R, Faure G (2008) Composite Predictor Maps of Extraordinary Weather Events in the Sacramento, California, Region. Weather Forecast 23(3):313–335. https://doi.org/10.1175/2007WAF2006055.1
Guan B, Molotch NP, Waliser DE, Fetzer EJ, Neiman PJ (2013) The 2010/2011 snow season in California’s Sierra Nevada: Role of atmospheric rivers and modes of large-scale variability. Water Resour Res 49(10):6731–6743. https://doi.org/10.1002/wrcr.20537
Guan B, Waliser DE (2015) Detection of atmospheric rivers: Evaluation and application of an algorithm for global studies. J Geophys Research: Atmos 120(24):12514–12535. https://doi.org/10.1002/2015JD024257
Harvey BJ, Cook P, Shaffrey LC, Schiemann R (2020) The Response of the Northern Hemisphere Storm Tracks and Jet Streams to Climate Change in the CMIP3, CMIP5, and CMIP6 Climate Models. Journal of Geophysical Research: Atmospheres, 125(23), e2020JD032701. https://doi.org/10.1029/2020JD032701
Hewitson BC, Crane RG (2002) Self-organizing maps: Applications to synoptic climatology. Climate Res 22(1):13–26. https://doi.org/10.3354/cr022013
Higgins ME, Cassano JJ (2009) Impacts of reduced sea ice on winter Arctic atmospheric circulation, precipitation, and temperature. J Geophys Research: Atmos 114(D16). https://doi.org/10.1029/2009JD011884
Holden ZA, Swanson A, Luce CH, Jolly WM, Maneta M, Oyler JW, Warren DA, Parsons R, Affleck D (2018) Decreasing fire season precipitation increased recent western US forest wildfire activity. Proceedings of the National Academy of Sciences, 115(36), E8349–E8357. https://doi.org/10.1073/pnas.1802316115
Horton DE, Johnson NC, Singh D, Swain DL, Rajaratnam B, Diffenbaugh NS (2015) Contribution of changes in atmospheric circulation patterns to extreme temperature trends. Nature 522(7557):465–469. https://doi.org/10.1038/nature14550
Horton RM, Mankin JS, Lesk C, Coffel E, Raymond C (2016) A Review of Recent Advances in Research on Extreme Heat Events. Curr Clim Change Rep 2(4):242–259. https://doi.org/10.1007/s40641-016-0042-x
Johnson NC, Feldstein SB (2010) The Continuum of North Pacific Sea Level Pressure Patterns: Intraseasonal, Interannual, and Interdecadal Variability. J Clim 23(4):851–867. https://doi.org/10.1175/2009JCLI3099.1
Johnson NC, Feldstein SB, Tremblay B (2008) The Continuum of Northern Hemisphere Teleconnection Patterns and a Description of the NAO Shift with the Use of Self-Organizing Maps. J Clim 21(23):6354–6371. https://doi.org/10.1175/2008JCLI2380.1
Khadka D, Babel MS, Abatan AA, Collins M (2022) An evaluation of CMIP5 and CMIP6 climate models in simulating summer rainfall in the Southeast Asian monsoon domain. Int J Climatol 42(2):1181–1202. https://doi.org/10.1002/joc.7296
Lennard C, Hegerl G (2015) Relating changes in synoptic circulation to the surface rainfall response using self-organising maps. Clim Dyn 44(3):861–879. https://doi.org/10.1007/s00382-014-2169-6
Liu P, Zhu Y, Zhang Q, Gottschalck J, Zhang M, Melhauser C, Li W, Guan H, Zhou X, Hou D, Peña M, Wu G, Liu Y, Zhou L, He B, Hu W, Sukhdeo R (2018) Climatology of tracked persistent maxima of 500-hPa geopotential height. Clim Dyn 51(1):701–717. https://doi.org/10.1007/s00382-017-3950-0
Loikith PC, Broccoli AJ (2012) Characteristics of Observed Atmospheric Circulation Patterns Associated with Temperature Extremes over North America. J Clim 25(20):7266–7281. https://doi.org/10.1175/JCLI-D-11-00709.1
Loikith PC, Broccoli AJ (2015) Comparison between Observed and Model-Simulated Atmospheric Circulation Patterns Associated with Extreme Temperature Days over North America Using CMIP5 Historical Simulations. J Clim 28(5):2063–2079. https://doi.org/10.1175/JCLI-D-13-00544.1
Loikith PC, Lintner BR, Sweeney A (2017) Characterizing Large-Scale Meteorological Patterns and Associated Temperature and Precipitation Extremes over the Northwestern United States Using Self-Organizing Maps. J Clim 30(8):2829–2847. https://doi.org/10.1175/JCLI-D-16-0670.1
Mahoney K, Swales D, Mueller MJ, Alexander M, Hughes M, Malloy K (2018) An Examination of an Inland-Penetrating Atmospheric River Flood Event under Potential Future Thermodynamic Conditions. J Clim 31(16):6281–6297. https://doi.org/10.1175/JCLI-D-18-0118.1
Mearns L, McGinnis S, Korytina D, Arritt R, Biner S, Bukovsky M, Chang H-I, Christensen O, Herzmann D, Jiao Y, Kharin S, Lazare M, Nikulin G, Qian M, Scinocca J, Winger K, Castro C, Frigon A, Gutowski W (2017) The NA-CORDEX dataset [Data set]. UCAR/NCAR. https://doi.org/10.5065/D6SJ1JCH
Mechem DB, Wittman CS, Miller MA, Yuter SE, de Szoeke SP (2018) Joint Synoptic and Cloud Variability over the Northeast Atlantic near the Azores. J Appl Meteorol Climatology 57(6):1273–1290. https://doi.org/10.1175/JAMC-D-17-0211.1
Mote PW, Salathé EP (2010) Future climate in the Pacific Northwest. Clim Change 102(1):29–50. https://doi.org/10.1007/s10584-010-9848-z
Mueller B, Seneviratne SI (2014) Systematic land climate and evapotranspiration biases in CMIP5 simulations. Geophys Res Lett 41(1):128–134. https://doi.org/10.1002/2013GL058055
Prein AF, Mearns LO (2021) U.S. Extreme Precipitation Weather Types Increased in Frequency During the 20th Century. Journal of Geophysical Research: Atmospheres, 126(7), e2020JD034287. https://doi.org/10.1029/2020JD034287
Radić V, Cannon AJ, Menounos B, Gi N (2015) Future changes in autumn atmospheric river events in British Columbia, Canada, as projected by CMIP5 global climate models. J Geophys Research: Atmos 120(18):9279–9302. https://doi.org/10.1002/2015JD023279
Reusch DB, Alley RB, Hewitson BC (2007) North Atlantic climate variability from a self-organizing map perspective. J Geophys Research: Atmos 112(D2). https://doi.org/10.1029/2006JD007460
Rogers CDW, Kornhuber K, Perkins-Kirkpatrick SE, Loikith PC, Singh D (2021) Six-fold increase in historical Northern Hemisphere concurrent large heatwaves driven by warming and changing atmospheric circulations. J Clim 1(aop):1–39. https://doi.org/10.1175/JCLI-D-21-0200.1
Rupp DE, Abatzoglou JT, Hegewisch KC, Mote PW (2013) Evaluation of CMIP5 20th century climate simulations for the Pacific Northwest USA. J Geophys Research: Atmos 118(19) 10,884 – 10,906. https://doi.org/10.1002/jgrd.50843
Salathé EP, Hamlet AF, Mass CF, Lee S-Y, Stumbaugh M, Steed R (2014) Estimates of Twenty-First-Century Flood Risk in the Pacific Northwest Based on Regional Climate Model Simulations. J Hydrometeorol 15(5):1881–1899. https://doi.org/10.1175/JHM-D-13-0137.1
Salathé EP, Leung LR, Qian Y, Zhang Y (2010) Regional climate model projections for the State of Washington. Clim Change 102(1–2):51–75. https://doi.org/10.1007/s10584-010-9849-y
Schlef KE, Moradkhani H, Lall U (2019) Atmospheric Circulation Patterns Associated with Extreme United States Floods Identified via Machine Learning. Sci Rep 9(1):7171. https://doi.org/10.1038/s41598-019-43496-w
Sinha P, Mann ME, Fuentes JD, Mejia A, Ning L, Sun W, He T, Obeysekera J (2018) Downscaled rainfall projections in south Florida using self-organizing maps. Sci Total Environ 635:1110–1123. https://doi.org/10.1016/j.scitotenv.2018.04.144
Skific N, Francis JA, Cassano JJ (2009) Attribution of Projected Changes in Atmospheric Moisture Transport in the Arctic: A Self-Organizing Map Perspective. J Clim 22(15):4135–4153. https://doi.org/10.1175/2009JCLI2645.1
Slinskey EA, Loikith PC, Waliser DE, Guan B, Martin A (2020) A Climatology of Atmospheric Rivers and Associated Precipitation for the Seven U.S. National Climate Assessment Region. J Hydrometeorol 21(11):2439–2456. https://doi.org/10.1175/JHM-D-20-0039.1
Stahl K, Moore RD, Mckendry IG (2006) The role of synoptic-scale circulation in the linkage between large-scale ocean–atmosphere indices and winter surface climate in British Columbia, Canada. Int J Climatol 26(4):541–560. https://doi.org/10.1002/joc.1268
Swales D, Alexander M, Hughes M (2016) Examining moisture pathways and extreme precipitation in the U.S. Intermountain West using self-organizing maps. Geophys Res Lett 43(4):1727–1735. https://doi.org/10.1002/2015GL067478
Teng H, Branstator G (2017) Causes of Extreme Ridges That Induce California Droughts. J Clim 30(4):1477–1492. https://doi.org/10.1175/JCLI-D-16-0524.1
U.S. Global Change Research Program, Wuebbles DJ, Fahey DW, Hibbard KA, Dokken DJ, Stewart BC, Maycock TK (2017) Climate Science Special Report: Fourth National Climate Assessment, Volume I. U.S. Global Change Research Program. https://doi.org/10.7930/J0J964J6
Warner MD, Mass CF, Salathé EP (2012) Wintertime Extreme Precipitation Events along the Pacific Northwest Coast: Climatology and Synoptic Evolution. Mon Weather Rev 140(7):2021–2043. https://doi.org/10.1175/MWR-D-11-00197.1
Wild M, Folini D, Hakuba MZ, Schär C, Seneviratne SI, Kato S, Rutan D, Ammann C, Wood EF, König-Langlo G (2015) The energy balance over land and oceans: An assessment based on direct observations and CMIP5 climate models. Clim Dyn 44(11):3393–3429. https://doi.org/10.1007/s00382-014-2430-z
Zadra A, Williams K, Frassoni A, Rixen M, Adames ÁF, Berner J, Bouyssel F, Casati B, Christensen H, Ek MB, Flato G, Huang Y, Judt F, Lin H, Maloney E, Merryfield W, Niekerk AV, Rackow T, Saito K, Yadav P (2018) Systematic Errors in Weather and Climate Models: Nature, Origins, and Ways Forward. Bull Am Meteorol Soc 99(4):ES67–ES70. https://doi.org/10.1175/BAMS-D-17-0287.1
U.S. Global Change Research Program, Wuebbles, D. J., Fahey, D. W., Hibbard, K. A., Dokken, D. J., Stewart, B. C., & Maycock, T. K. (2017). Climate Science Special Report: Fourth National Climate Assessment, Volume I. U.S. Global Change Research Program. https://doi.org/10.7930/J0J964J6
Warner, M. D., Mass, C. F., & Salathé, E. P. (2012). Wintertime Extreme Precipitation Events along the Pacific Northwest Coast: Climatology and Synoptic Evolution. Monthly Weather Review, 140(7), 2021–2043. https://doi.org/10.1175/MWR-D-11-00197.1
Wild, M., Folini, D., Hakuba, M. Z., Schär, C., Seneviratne, S. I., Kato, S., Rutan, D., Ammann, C., Wood, E. F., & König-Langlo, G. (2015). The energy balance over land and oceans: An assessment based on direct observations and CMIP5 climate models. Climate Dynamics, 44(11), 3393–3429. https://doi.org/10.1007/s00382-014-2430-z
Zadra, A., Williams, K., Frassoni, A., Rixen, M., Adames, Á. F., Berner, J., Bouyssel, F., Casati, B., Christensen, H., Ek, M. B., Flato, G., Huang, Y., Judt, F., Lin, H., Maloney, E., Merryfield, W., Niekerk, A. V., Rackow, T., Saito, K., … Yadav, P. (2018). Systematic Errors in Weather and Climate Models: Nature, Origins, and Ways Forward. Bulletin of the American Meteorological Society, 99(4), ES67–ES70. https://doi.org/10.1175/BAMS-D-17-0287.1
Acknowledgements
Partial support for this work was provided by the NASA Enabling Tools for the National Climate Assessment (NCA) Program (GPT, HL, DEW). Partial support was provided by the Modelling Analysis and Prediction Program (PCL). We thank the Regional Climate Model Evaluation System team at JPL for their helpful contributions to this work. We thank Ben Lintner for help with methodology development. We also thank the Portland Water Bureau for providing partial support for GPT and CMA.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study. The first draft of the manuscript was written by Graham P Taylor, and all authors read and approved the final manuscript.
Corresponding author
Additional information
Corresponding Author:
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Taylor, G.P., Loikith, P.C., Aragon, C.M. et al. CMIP6 model fidelity at simulating large-scale atmospheric circulation patterns and associated temperature and precipitation over the Pacific Northwest. Clim Dyn (2022). https://doi.org/10.1007/s00382-022-06410-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00382-022-06410-1