Abstract
global climate models (GCMs) structure is a source of uncertainty in climate change projections. Therefore, evaluation of the performances of GCMs is crucial for development of adaptation and mitigation measures and risk reduction against climate change impacts. This study quantified the performances of 10 GCMs of the Coupled Model Intercomparison Project 5 (CMIP5) and their CMIP6 equivalents in replicating precipitation over East Asia during 1975–2005. The CMIP5 and CMIP6 GCMs and their multi-model ensembles (MMEs) were annually and seasonally compared with the Global Precipitation Climatology Centre (GPCC) precipitation. Compromise Programming was used to rank GCMs by aggregating their scores obtained using statistical performance indices. Taylor diagram was used to assess their relative performances and GCMs’ ability to replicate seasonal precipitation distribution was evaluated. Results revealed most CMIP6 GCMs’ have better replicability of GPCC precipitation than CMIP5 GCMs. The MME mean of the CMIP6 showed better replicability of annual and seasonal GPCC precipitation than that of CMIP5. The CMIP6 MME also showed efficiency in simulating the seasonal precipitation distribution over East Asia. This study indicates improvements of some CMIP5 GCMs in their CMIP6 equivalents over East Asia. Findings from this study can be significant to policy makers and engineers in reducing the uncertainties in prediction of events such as floods and droughts.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aguayo R, León-Muñoz J, Garreaud R, Montecinos A (2021) Hydrological droughts in the southern Andes (40–45° S) from an ensemble experiment using CMIP5 and CMIP6 models. Scientific Reports 11(1):1–16, DOI: https://doi.org/10.1038/s41598-021-84807-4
Ahmed K, Sachindra DA, Shahid S, Demirel MC, Chung E-S (2019a) Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics. Hydrology and Earth System Sciences 23:4803–4824, DOI: https://doi.org/10.5194/hess-23-4803-2019
Ahmed K, Shahid S, Sachindra D, Nawaz N, Chung E-S (2019b) Fidelity assessment of general circulation model simulated precipitation and temperature over Pakistan using a feature selection method. Journal of Hydrology 573:281–298, DOI: https://doi.org/10.1016/j.jhydrol.2019.03.092
Aich V, Liersch S, Vetter T, Huang S, Tecklenburg J, Hoffmann P, Koch H, Fournet S, Krysanova V, Müller EN, Hattermann FF (2014) Comparing impacts of climate change on streamflow in four large African river basins. Hydrology and Earth System Sciences 18(4):1305–1321, DOI: https://doi.org/10.5194/hess-18-1305-2014
Alamgir M, Mohsenipour M, Homsi R, Wang X, Shahid S, Shiru MS, Alias NE, Yuzir A (2019) Parametric assessment of seasonal drought risk to crop production in Bangladesh. Sustainability 11:1442, DOI: https://doi.org/10.3390/su11051442
Almazroui M, Islam MN, Saeed S, Saeed F, Ismail M (2020a) Future changes in climate over the arabian peninsula based on CMIP6 multimodel simulations. Earth Systems and Environment 4:611–630, DOI: https://doi.org/10.1007/s41748-020-00183-5
Almazroui M, Saeed F, Saeed S, Islam MN, Ismail M, Klutse NAB, Siddiqui MH (2020b) Projected change in temperature and precipitation over Africa from CMIP6. Earth Systems and Environment 4:455–475, DOI: https://doi.org/10.1007/s41748-020-00161-x
Aryal A, Shrestha S, Babel MS (2019) Quantifying the sources of uncertainty in an ensemble of hydrological climate-impact projections. Theoretical and Applied Climatology 135:193–209, DOI: https://doi.org/10.1007/s00704-017-2359-3
Asdak C, Supian S (2018) Watershed management strategies for flood mitigation: A case study of Jakarta’s flooding. Weather and Climate Extremes 21:117–122, DOI: https://doi.org/10.1016/j.wace.2018.08.002
Ashrafi S, Gholami H, Najafi M (2020) Uncertainties in runoff projection and hydrological drought assessment over Gharesu basin under CMIP5 RCP scenarios. Journal of Water and Climate Change 11:145–163, DOI: https://doi.org/10.2166/wcc.2020.088
Ayugi B, Tan Q Rouyun N, Zeyao D, Ojara M, Mumo L, Babaousmail H, Ongoma V (2020) Evaluation of meteorological drought and flood scenarios over Kenya, East Africa. Atmosphere 11(3):307, DOI: https://doi.org/10.3390/atmos11030307
Becker A, Finger P, Meyer-Christoffer A, Rudolf B, Schamm K, Schneider U, Ziese M (2013) A description of the global land-surface precipitation data products of the global precipitation climatology centre with sample applications including centennial (trend) analysis from 1901—present. Earth System Science Data 5:71–99, DOI: https://doi.org/10.5194/essd-5-71-2013
Chen J, Brissette FP, Lucas-Picher P, Caya D (2017) Impacts of weighting climate models for hydro-meteorological climate change studies. Journal of Hydrology 549:534–546, DOI: https://doi.org/10.1016/j.jhydrol.2017.04.025
Chhin R, Yoden S (2018) Ranking CMIP5 GCMs for model ensemble selection on regional scale: Case study of the Indochina Region. Journal of Geophysical Research: Atmospheres 123(17):8949–8974, DOI: https://doi.org/10.1029/2017JD028026
Das J, Poonia V, Jha S, Goyal MK (2020) Understanding the climate change impact on crop yield over Eastern Himalayan Region: Ascertaining GCM and scenario uncertainty. Theoretical and Applied Climatology 142:467–482, DOI: https://doi.org/10.1007/s00704-020-03332-y
Evans JP, Argueso D, Olson R, Di Luca A (2017) Bias-corrected regional climate projections of extreme rainfall in south-east Australia. Theoretical and Applied Climatology 130:1085–1098, DOI: https://doi.org/10.1007/s00704-016-1949-9
Eyring V, Bony S, Meehl GA, Senior CA, Stevens B, Stouffer RJ, Taylor KE (2016) Overview of the coupled model intercomparison project phase 6 (CMIP6) experimental design and organization. Geoscientific Model Development 9:1937–1958, DOI: https://doi.org/10.5194/gmd-9-1937-2016
Funk C, Husak G, Michaelsen J, Love T, Pedreros D (2007) Third generation rainfall climatologies: Satellite rainfall and topography provide a basis for smart interpolation. Proceedings of the JRC-FAO workshop, March 27–29, Nairobi, Kenya, 283–296
Gidden M, Riahi K, Smith S, Fujimori S, Luderer G, Kriegler E, van Vuuren DP, van den Berg M, Feng L, Klein D (2019) Global emissions pathways under different socioeconomic scenarios for use in CMIP6: A dataset of harmonized emissions trajectories through the end of the century. Geoscientific Model Development Discussions 12:1443–1475, DOI: https://doi.org/10.5194/gmd-12-1443-2019
Grose MR, Narsey S, Delage F, Dowdy AJ, Bador M, Boschat G, Chung C, Kajtar J, Rauniyar S, Freund M (2020) Insights from CMIP6 for Australia’s future climate. Earth’s Future 8:e2019EF001469, DOI: https://doi.org/10.1029/2019EF001469
Gusain A, Ghosh S, Karmakar S (2020) Added value of CMIP6 over CMIP5 models in simulating Indian summer monsoon rainfall. Atmospheric Research 232:104680, DOI: https://doi.org/10.1016/j.atmosres.2019.104680
Hawkins E, Sutton R (2009) The potential to narrow uncertainty in regional climate predictions. Bulletin of the American Meteorological Society 90:1095–1108, DOI: https://doi.org/10.1175/2009BAMS2607.1
Homsi R, Shiru MS, Shahid S, Ismail T, Harun SB, Al-Ansari N, Chau K-W, Yaseen ZM (2020) Precipitation projection using a CMIP5 GCM ensemble model: A regional investigation of Syria. Engineering Applications of Computational Fluid Mechanics 14:90–106, DOI: https://doi.org/10.1080/19942060.2019.1683076
Iqbal Z, Shahid S, Ahmed K, Ismail T, Nawaz N (2019) Spatial distribution of the trends in precipitation and precipitation extremes in the sub-Himalayan region of Pakistan. Theoretical and Applied Climatology 137:2755–2769, DOI: https://doi.org/10.1007/s00704-019-02773-4
Jung I-W, Chang H, Moradkhani H (2011) Quantifying uncertainty in urban flooding analysis considering hydro-climatic projection and urban development effects. Hydrology and Earth System Sciences 15(2):617–633, DOI: https://doi.org/10.5194/hess-15-617-2011
Khan N, Sachindra D, Shahid S, Ahmed K, Shiru MS, Nawaz N (2020) Prediction of droughts over Pakistan using machine learning algorithms. Advances in Water Resources 139:103562, DOI: https://doi.org/10.1016/j.advwatres.2020.103562
Kim J-H, Sung J-H, Chung E-S, Kim S-U, Son M, Shiru MS (2021) Comparison of projection in meteorological and hydrological droughts in the Cheongmicheon watershed for RCP4. 5 and SSP2-4.5. Sustainability 13(4):2066, DOI: https://doi.org/10.3390/su13042066
Knutti R Furrer R, Tebaldi C, Cermak J, Meehl GA (2010) Challenges in combining projections from multiple climate models. Journal of Climate 23:2739–2758, DOI: https://doi.org/10.1175/2009JCLI3361.1
Kwak J, Kim S, Singh VP, Kim HS, Kim D, Hong S, Lee K (2015) Impact of climate change on hydrological droughts in the upper Namhan River basin, Korea. KSCE Journal of Civil Engineering 19(2):376–384, DOI: https://doi.org/10.1007/s12205-015-0446-5
Lutz AF, ter Maat HW, Biemans H, Shrestha AB, Wester P, Immerzeel WW (2016) Selecting representative climate models for climate change impact studies: An advanced envelope-based selection approach. International Journal of Climatology 36:3988–4005, DOI:https://doi.org/10.1002/joc.4608
Manawi SMA, Nasir KAM, Shiru MS, Hotaki SF, Sediqi MN (2020) Urban flooding in the northern part of Kabul City: Causes and mitigation. Earth Systems and Environment 4:599–610, DOI: https://doi.org/10.1007/s41748-020-00165-7
O’Neill BC, Tebaldi C, van Vuuren DP, Eyring V, Friedlingstein P, Hurtt G, Knutti R, Kriegler E, Lamarque J-F, Lowe J, Meehl GA, Moss R, Riahi K, Sanderson BM (2016) The scenario model intercomparison project (ScenarioMIP) for CMIP6. Geoscientific Model Development 9:3461–3482, DOI: https://doi.org/10.5194/gmd-9-3461-2016
Onyutha C, Tabari H, Rutkowska A, Nyeko-Ogiramoi P, Willems P (2016) Comparison of different statistical downscaling methods for climate change rainfall projections over the Lake Victoria basin considering CMIP3 and CMIP5. Journal of Hydro-Environment Research 12:31–45, DOI: https://doi.org/10.1016/j.jher.2016.03.001
Prudhomme C, Davies H (2009) Assessing uncertainties in climate change impact analyses on the river flow regimes in the UK. Part 1: Baseline climate. Climatic Change 93:177–195, DOI: https://doi.org/10.1007/s10584-008-9464-3
Qian W, Kang H-S, Lee D-K (2002) Distribution of seasonal rainfall in the East Asian monsoon region. Theoretical and Applied Climatology 73(3):151–168, DOI: https://doi.org/10.1007/s00704-002-0679-3
Raju KS, Sonali P, Kumar DN (2017) Ranking of CMIP5-based global climate models for India using compromise programming. Theoretical and Applied Climatology 128:563–574, DOI: https://doi.org/10.1007/s00704-015-1721-6
Rezaei F, Ahmadzadeh MR, Safavi HR (2017) SOM-DRASTIC: Using self-organizing map for evaluating groundwater potential to pollution. Stochastic Environmental Research and Risk Assessment 31:1941–1956, DOI: https://doi.org/10.1007/s00477-016-1334-3
Rivera JA, Arnould G (2020) Evaluation of the ability of CMIP6 models to simulate precipitation over Southwestern South America: Climatic features and long-term trends (1901–2014). Atmospheric Research 241:104953, DOI: https://doi.org/10.1016/j.atmosres.2020.104953
Sa’adi Z, Shiru MS, Shahid S, Ismail T (2020) Selection of general circulation models for the projections of spatio-temporal changes in temperature of Borneo Island based on CMIP5. Theoretical and Applied Climatology 139:351–371, DOI: https://doi.org/10.1007/s00704-019-02948-z
Salman SA, Shahid S, Afan HA, Shiru MS, Al-Ansari N, Yaseen ZM (2020) Changes in climatic water availability and crop water demand for Iraq region. Sustainability 12:3437, DOI: https://doi.org/10.3390/su12083437
Salman SA, Shahid S, Ismail T, Al-Abadi AM, Wang X-J, Chung E-S (2019) Selection of gridded precipitation data for Iraq using compromise programming. Measurement 132:87–98, DOI: https://doi.org/10.1016/j.measurement.2018.09.047
Samal RK, Kansal ML (2015) Sustainable development contribution assessment of renewable energy projects using AHP and compromise programming techniques. 2015 international conference on energy, power and environment: Towards sustainable growth (ICEPE), June 12–13, Shillong, India, DOI: https://doi.org/10.1109/EPETSG.2015.7510096
Sheffield J, Carmago SJ, Fu R, Hu Q, Jiang X, Johnson N, Karnauskas KB, Kim ST, Kinter J, Kumar S, Langenbrunner B, Maloney E, Mariotti A, Meyerson JE, Neelin JD, Nigam S, Pan Z, Ruiz-Barradas A, Seager R, Serra YL, Sun D-Z, Wang C, Xie S-P, Yu J-Y, Zhang T, Zhao M (2013) North American climate in CMIP5 experiments. Part II: Evaluation of historical simulations of intraseasonal to decadal variability. Journal of Climate 26:9247–9290, DOI: https://doi.org/10.1175/JCLI-D-12-00593.1
Shiogama H, Stone D, Emori S, Takahashi K, Mori S, Maeda A, Ishizaki Y, Allen MR (2016) Predicting future uncertainty constraints on global warming projections. Scientific Reports 6:18903, DOI: https://doi.org/10.1038/srep18903
Shiru MS, Park I (2020) Comparison of ensembles projections of rainfall from four bias correction methods over Nigeria. Water 12:3044, DOI: https://doi.org/10.3390/w12113044
Shiru MS, Shahid S, Alias N, Chung E-S (2018) Trend analysis of droughts during crop growing seasons of Nigeria. Sustainability 10:871, DOI: https://doi.org/10.3390/su10030871
Shiru MS, Shahid S, Chung E-S, Alias N (2019a) Changing characteristics of meteorological droughts in Nigeria during 1901–2010. Atmospheric Research 223:60–73, DOI: https://doi.org/10.1016/j.atmosres.2019.03.010
Shiru MS, Shahid S, Chung E-S, Alias N, Scherer L (2019b) A MCDM-based framework for selection of general circulation models and projection of spatio-temporal rainfall changes: A case study of Nigeria. Atmospheric Research 225:1–16, DOI: https://doi.org/10.1016/j.atmosres.2019.03.033
Shiru MS, Shahid S, Dewan A, Chung E-S, Alias N, Ahmed K, Hassan QK (2020) Projection of meteorological droughts in Nigeria during growing seasons under climate change scenarios. Scientific Reports 10:10107, DOI: https://doi.org/10.1038/s41598-020-67146-8
Song YH, Nashwan MS, Chung E-S, Shahid S (2021) Advances in CMIP6 INM-CM5 over CMIP5 INM-CM4 for precipitation simulation in South Korea. Atmospheric Research 247:105261, DOI: https://doi.org/10.1016/j.atmosres.2020.105261
Sun Q, Miao C, Duan Q (2015) Comparative analysis of CMIP3 and CMIP5 global climate models for simulating the daily mean, maximum, and minimum temperature sand daily precipitation over China. JGR: Atmospheres 120:4806–4824, DOI: https://doi.org/10.1002/2014JD022994
Sung JH, Park J, Jeon J-J, Seo SB (2020) Assessment of inter-model variability in meteorological drought characteristics using CMIP5 GCMs over South Korea. KSCE Journal of Civil Engineering 24(9): 2824–2834, DOI: https://doi.org/10.1007/s12205-020-0494-3
Tanveer ME, Lee M-H, Bae D-H (2016) Uncertainty and reliability analysis of CMIP5 climate projections in South Korea using REA method. Procedia Engineering 154:650–655, DOI: https://doi.org/10.1016/j.proeng.2016.07.565
Taylor KE, Stouffer RJ, Meehl GA (2012) An overview of CMIP5 and the experiment design. Bulletin of the American Meteorological Society 93:485–498, DOI: https://doi.org/10.1175/BAMS-D-11-00094.1
Tebaldi C, Smith RL, Nychka D, Mearns LO (2005) Quantifying uncertainty in projections of regional climate change: A Bayesian approach to the analysis of multimodel ensembles. Journal of Climate 18:1524–1540, DOI: https://doi.org/10.1175/JCLI3363.1
Willmott CJ (1982) Some comments on the evaluation of model performance. Bulletin of the American Meteorological Society 63:1309–1313
Woldemeskel FM, Sharma A, Sivakumar B, Mehrotra R (2016) Quantification of precipitation and temperature uncertainties simulated by CMIP3 and CMIP5 models. Journal of Geophysical Research: Atmospheres 121(1):3–17
Wu T, Lu Y, Fang Y, Xin X, Li L, Li W, Jie W, Zhang J, Liu Y, Zhang L (2019) The Beijing climate center climate system model (BCC-CSM): The main progress from CMIP5 to CMIP6. Geoscientific Model Development 12:1573–1600, DOI: https://doi.org/10.5194/gmd-12-1573-2019
Xin X, Wu T, Zhang J, Yao J, Fang Y (2020) Comparison of CMIP6 and CMIP5 simulations of precipitation in China and the East Asian summer monsoon. International Journal of Climatology 40:6423–6440, DOI: https://doi.org/10.1002/joc.6590
Yue S, Hashino M (2007) Probability distribution of annual, seasonal and monthly precipitation in Japan. Hydrological Sciences Journal 52:863–877, DOI: https://doi.org/10.1623/hysj.52.5.863
Zamani Y, Monfared SAH, Hamidianpour M (2020) A comparison of CMIP6 and CMIP5 projections for precipitation to observational data: The case of Northeastern Iran. Theoretical and Applied Climatology 142:1613–1623, DOI: https://doi.org/10.1007/s00704-020-03406-x
Zeleny M (1973) Compromise programming. In: Multiobjective optimization: Behavioral and computational considerations. Springer, Boston, MA, USA
Zhai J, Mondal SK, Fischer T, Wang Y, Su B, Huang J, Tao H, Wang G, Ullah W, Uddin J (2020) Future drought characteristics through a multi-model ensemble from CMIP6 over South Asia. Atmospheric Research 246:105111, DOI: https://doi.org/10.1016/j.atmosres.2020.105111
Zhang J, Wang C, Yang X, Zhao Y, Liu Z, Wang J, Chen Y (2009) Impact forecast of future climate change on maize water requirement in three provinces of Northeast China. Transactions of the Chinese Society of Agricultural Engineering 25:50–55
Zhao C, Jiang Z, Sun X, Li W, Li L (2020) How well do climate models simulate regional atmospheric circulation over East Asia? International Journal of Climatology 40:220–234, DOI: https://doi.org/10.1002/joc.6205
Zhou T, Chen X, Wu B, Guo Z, Sun Y, Zou L, Man W, Zhang L, He C (2017) A robustness analysis of CMIP5 models over the East Asia-Western North Pacific domain. Engineering 3:773–778, DOI: https://doi.org/10.1016/J.ENG.2017.05.018
Acknowledgments
This study was supported by the Research Program funded by SeoulTech (Seoul National University of Science and Technology).
Author information
Authors and Affiliations
Corresponding author
Electronic Supplementary Material
Rights and permissions
About this article
Cite this article
Shiru, M.S., Shahid, S., Chae, ST. et al. Replicability of Annual and Seasonal Precipitation by CMIP5 and CMIP6 GCMs over East Asia. KSCE J Civ Eng 26, 1978–1989 (2022). https://doi.org/10.1007/s12205-022-0992-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-022-0992-6