Until now, climate model intercomparison has focused primarily on annual and global averages of various quantities or on specific components, not on how well the general dynamics in the models compare to each other. In order to address how well models agree when it comes to the dynamics they generate, we have adopted a new approach based on climate networks. We have considered 28 pre-industrial control runs as well as 70 20th-century forced runs from 23 climate models and have constructed networks for the 500 hPa, surface air temperature (SAT), sea level pressure (SLP), and precipitation fields for each run. We then employed a widely used algorithm to derive the community structure in these networks. Communities separate “nodes” in the network sharing similar dynamics. It has been shown that these communities, or sub-systems, in the climate system are associated with major climate modes and physics of the atmosphere (Tsonis AA, Swanson KL, Wang G, J Clim 21: 2990–3001 in 2008; Tsonis AA, Wang G, Swanson KL, Rodrigues F, da Fontura Costa L, Clim Dyn, 37: 933–940 in 2011; Steinhaeuser K, Ganguly AR, Chawla NV, Clim Dyn 39: 889–895 in 2012). Once the community structure for all runs is derived, we use a pattern matching statistic to obtain a measure of how well any two models agree with each other. We find that, with the possible exception of the 500 hPa field, consistency for the SAT, SLP, and precipitation fields is questionable. More importantly, none of the models comes close to the community structure of the actual observations (reality). This is a significant finding especially for the temperature and precipitation fields, as these are the fields widely used to produce future projections in time and in space.
Kistler R et al (2001) The NCEP/NCAR 50-year reanalysis: monthly means, CD-ROM and documentation. Bull Am Meteorol Soc 82:247–267CrossRefGoogle Scholar
Mirchev M, Duane G, Tang W, Kocarev L (2012) Improved modeling by coupling imperfect models. Commun Nonlinear Sci Numer Simul 17:2741–2751CrossRefGoogle Scholar
Newman MEJ, Girvan M (2004) Finding and evaluating community structure in Networks. Phys Rev E 69:026113CrossRefGoogle Scholar
Randall DA et al (2007) Cilmate models and their evaluation. In: Solomon S, Qin D, Manning M, Chen Z, Marquis M, Averyt KB, Tignor M, Miller HL (eds) Climate change 2007: the physical science basis. Contribution of working group I to the fourth assessment report of the Intergovernmental Panel on Climate Change. Cambridge University Press, CambridgeGoogle Scholar