Abstract
This study assesses the performance of 37 global climate models (GCMs) from the Coupled Model Inter-comparison Project Phase 6 (CMIP6) in simulating extreme precipitation in Madagascar. In this study, six extreme precipitation indices from the Expert Team on Climate Change Detection and Indices (ETCCDI) were used, namely consecutive dry days (CDD), heavy precipitation days (R10MM), very heavy precipitation days (R20MM), maximum 5-day precipitation (RX5DAY), extremely wet days (R99P), and simple daily intensity (SDII). The performance of the model was evaluated from 1998 to 2014 against the Tropical Rainfall Measuring Mission 3B42 (TRMM) and the Global Precipitation Climatology Project (GPCP). The results show that most of the models in CMIP6 reasonably reproduce the annual precipitation cycle of the study area. The results also suggested that models from CMIP6 tend to underestimate extreme precipitation indices such as CDD, R20MM, SDII, and R99P. However, for R10MM and RX5DAY, the performance of individual models varies remarkably. By looking at the performance metrics, not a single model consistently performed well. Model performance changes with the reference data, the extreme precipitation indices, and the performance metrics. However, the findings of this study indicate that overall, multi-model ensemble mean outperforms most individual models. The study lays the basis for the analysis and projection of future extreme precipitation in Madagascar but also provides scientific evidence for the choice of models.
Similar content being viewed by others
Data availability
The datasets used in the current study are available at the Earth System Grid Federation (ESGF) at https://esgf-node.llnl.gov/search/cmip6/. Tropical Rainfall Measuring Mission 3B42 (TRMM) can be accessed at https://rb.gy/agn5mh and Global Precipitation Climatology Project is available at https://rb.gy/uvr2vx.
References
Abdelmoaty HM, Papalexiou SM, Rajulapati CR, AghaKouchak A (2021) Biases beyond the mean in CMIP6 extreme precipitation: a global investigation. Earth’s Future 9(10):e2021EF002196. https://doi.org/10.1029/2021EF002196
Akinsanola A, Zhou W (2019) Projections of West African summer monsoon rainfall extremes from two CORDEX models. Clim Dyn 52(3–4):2017–2028. https://doi.org/10.1007/s00382-018-4238-8
Akinsanola A, Kooperman GJ, Pendergrass AG, Hannah WM, Reed KA (2020) Seasonal representation of extreme precipitation indices over the United States in CMIP6 present-day simulations. Environ Res Lett 15(9):094003. https://doi.org/10.1088/1748-9326/ab92c1
Akinsanola A, Ongoma V, Kooperman GJ (2021) Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa. Atmos Res 254:105509. https://doi.org/10.1016/j.atmosres.2021.105509
Alexander LV, Arblaster JM (2017) Historical and projected trends in temperature and precipitation extremes in Australia in observations and CMIP5. Weather and Climate Extremes 15:34–56. https://doi.org/10.1016/j.wace.2017.02.001
Almazroui M, Saeed F, Saeed S, Nazrul Islam M, Ismail M, Klutse NAB, Siddiqui MH (2020) Projected change in temperature and precipitation over Africa from CMIP6. Earth Systems and Environment 4(3):455–475. https://doi.org/10.1007/s41748-020-00161-x
Antonelli A, Smith RJ, Perrigo AL, Crottini A, Hackel J, Testo W, Farooq H, Torres Jiménez MF, Andela N, Andermann T, Andriamanohera AM, Andriambololonera S, Bachman SP, Bacon CD, Baker WJ, Belluardo F, Birkinshaw C, Borrell JS, Cable S, … Ralimanana H (2022) Madagascar’s extraordinary biodiversity: evolution, distribution, and use. Science 378(6623). https://doi.org/10.1126/science.abf0869
Ayugi B, Zhihong J, Zhu H, Ngoma H, Babaousmail H, Rizwan K, Dike V (2021) Comparison of CMIP6 and CMIP5 models in simulating mean and extreme precipitation over East Africa. Int J Climatol 41(15):6474–6496. https://doi.org/10.1002/joc.7207
Ayugi B, Shilenje ZW, Babaousmail H, Lim Kam Sian KT, Mumo R, Dike VN, Iyakaremye V, Chehbouni A, Ongoma V (2022) Projected changes in meteorological drought over East Africa inferred from bias-adjusted CMIP6 models. Nat Hazards 113(2):1151–1176. https://doi.org/10.1007/s11069-022-05341-8
Barimalala R, Raholijao N, Pokam W, Reason CJC (2021) Potential impacts of 15 °C, 2 °C global warming levels on temperature and rainfall over Madagascar. Environ Res Lett 16(4):044019. https://doi.org/10.1088/1748-9326/abeb34
Barimalala R, Desbiolles F, Blamey RC, Reason C (2018) Madagascar Influence on the South Indian Ocean Convergence Zone, the Mozambique Channel Trough and Southern African Rainfall. Geophys Res Lett 45(20):11380–11389. https://doi.org/10.1029/2018GL079964
Carter AL, Gilchrist H, Dexter KG, Gardner CJ, Gough C, Rocliffe S, Wilson AMW (2022) Cyclone impacts on coral reef communities in Southwest Madagascar. Front Mar Sci 9:753325. https://doi.org/10.3389/fmars.2022.753325
Chen H, Sun J, Lin W, Xu H (2020) Comparison of CMIP6 and CMIP5 models in simulating climate extremes. Science Bulletin 65(17):1415–1418. https://doi.org/10.1016/j.scib.2020.05.015
Chen CA, Hsu H-H, Liang H-C (2021) Evaluation and comparison of CMIP6 and CMIP5 model performance in simulating the seasonal extreme precipitation in the Western North Pacific and East Asia. Weather and Climate Extremes 31:100303. https://doi.org/10.1016/j.wace.2021.100303
Culbertson KA, Treuer TLH, Mondragon-Botero A, Ramiadantsoa T, Reid JL (2022) The eco-evolutionary history of Madagascar presents unique challenges to tropical forest restoration. Biotropica 54(4):1081–1102. https://doi.org/10.1111/btp.13124
Dunham AE, Erhart EM, Wright PC (2011) Global climate cycles and cyclones: consequences for rainfall patterns and lemur reproduction in southeastern Madagascar. Glob Chang Biol 17(1):219–227. https://doi.org/10.1111/j.1365-2486.2010.02205.x
Eyring V, Bony S, Meehl GA, Senior CA, Stevens B, Stouffer RJ, Taylor KE (2016) Overview of the coupled model intercomparison project phase 6 (CMIP6) experimental design and organization. Geoscientific Model Development 9(5):1937–1958. https://doi.org/10.5194/gmd-9-1937-2016
Farquhar S, Nirindrainy AF, Heck N, Saldarriaga MG, Xu Y (2022) The impacts of long-term changes in weather on small-scale fishers’ available fishing hours in Nosy Barren, Madagascar. Front Mar Sci 9:841048. https://doi.org/10.3389/fmars.2022.841048
Faye A, Akinsanola AA (2022) Evaluation of extreme precipitation indices over West Africa in CMIP6 models. Clim Dyn 58(3–4):925–939. https://doi.org/10.1007/s00382-021-05942-2
Geris J, Comte J-C, Franchi F, Petros AK, Tirivarombo S, Selepeng AT, Villholth KG (2022) Surface water-groundwater interactions and local land use control water quality impacts of extreme rainfall and flooding in a vulnerable semi-arid region of Sub-Saharan Africa. J Hydrol 609:127834. https://doi.org/10.1016/j.jhydrol.2022.127834
Gimeno L, Sorí R, Vázquez M, Stojanovic M, Algarra I, Eiras‐Barca J, Gimeno‐Sotelo L, Nieto R (2022) Extreme precipitation events. WIREs Water 9(6):e1611. https://doi.org/10.1002/wat2.1611
Harrington LJ, Wolski P, Pinto I, Ramarosandratana AM, Barimalala R, Vautard R, Philip S, Kew S, Singh R, Heinrich D, Arrighi J, Raju E, Thalheimer L, Razanakoto T, van Aalst M, Li S, Bonnet R, Yang W, Otto FEL, van Oldenborgh GJ (2022) Limited role of climate change in extreme low rainfall associated with southern Madagascar food insecurity, 2019–21. Environmental Res: Climate 1(2):021003. https://doi.org/10.1088/2752-5295/aca695
Huffman GJ, Adler RF, Morrissey MM, Bolvin DT, Curtis S, Joyce R, McGavock B, Susskind J (2001) Global precipitation at one-degree daily resolution from multisatellite observations. J Hydrometeorol 2(1):36–50. https://doi.org/10.1175/1525-7541(2001)002%3c0036:GPAODD%3e2.0.CO;2
Huffman GJ, Bolvin DT, Nelkin EJ, Wolff DB, Adler RF, Gu G, Hong Y, Bowman KP, Stocker EF (2007) The TRMM multisatellite precipitation analysis (TMPA): quasi-global, multiyear, combined-sensor precipitation estimates at fine scales. J Hydrometeorol 8(1):38–55. https://doi.org/10.1175/JHM560.1
Huffman GJ, Adler RF, Bolvin DT, Nelkin EJ (2010) The TRMM multi-satellite precipitation analysis (TMPA)(Chapter 1). In: Hossain F, and Gebremichael M (eds) Satellite rainfall applications for surface hydrology, Springer Verlag, Berlin, 3–22. https://doi.org/10.1007/978-90-481-2915-7_1
Jeferson de Medeiros F, Prestrelo de Oliveira C, Avila-Diaz A (2022) Evaluation of extreme precipitation climate indices and their projected changes for Brazil: from CMIP3 to CMIP6. Weather Climate Extremes 38:100511. https://doi.org/10.1016/j.wace.2022.100511
Kim J, Ivanov VY, Fatichi S (2016) Climate change and uncertainty assessment over a hydroclimatic transect of Michigan. Stoch Env Res Risk Assess 30(3):923–944. https://doi.org/10.1007/s00477-015-1097-2
Kim Y-H, Min S-K, Zhang X, Sillmann J, Sandstad M (2020) Evaluation of the CMIP6 multi-model ensemble for climate extreme indices. Weather and Climate Extremes 29:100269. https://doi.org/10.1016/j.wace.2020.100269
Lim Kam Sian KT, Wang J, Ayugi BO, Nooni IK, Ongoma V (2021) Multi-decadal variability and future changes in precipitation over Southern Africa. Atmosphere 12(6):742. https://doi.org/10.3390/atmos12060742
Lim Kam Sian LT, Hagan DF, Ayugi BO, Nooni IK, Ullah W, Babaousmail H, Ongoma V (2022) Projections of precipitation extremes based on bias-corrected coupled model intercomparison project phase 6 models ensemble over southern Africa. Int J Climatol 42(16):8269–8289. https://doi.org/10.1002/joc.7707
Majdi F, Hosseini SA, Karbalaee A, Kaseri M, Marjanian S (2022) Future projection of precipitation and temperature changes in the Middle East and North Africa (MENA) region based on CMIP6. Theoret Appl Climatol 147(3–4):1249–1262. https://doi.org/10.1007/s00704-021-03916-2
Moradian S, Torabi Haghighi A, Asadi M, Mirbagheri SA (2023) Future changes in precipitation over Northern Europe based on a multi-model ensemble from CMIP6: focus on Tana River Basin. Water Resour Manage 37(6–7):2447–2463. https://doi.org/10.1007/s11269-022-03272-4
Mukherjee S, Aadhar S, Stone D, Mishra V (2018) Increase in extreme precipitation events under anthropogenic warming in India. Weather and Climate Extremes 20:45–53. https://doi.org/10.1016/j.wace.2018.03.005
Nematchoua MK, Ricciardi P, Orosa JA, Buratti C (2018) A detailed study of climate change and some vulnerabilities in Indian Ocean: a case of Madagascar island. Sustain Cities Soc 41:886–898. https://doi.org/10.1016/j.scs.2018.05.040
Nikulin G, Jones C, Giorgi F, Asrar G, Büchner M, Cerezo-Mota R, Christensen OB, Déqué M, Fernandez J, Hänsler A, van Meijgaard E, Samuelsson P, Sylla MB, Sushama L (2012) Precipitation climatology in an ensemble of CORDEX-Africa regional climate simulations. J Clim 25(18):6057–6078. https://doi.org/10.1175/JCLI-D-11-00375.1
Obahoundje S, Diedhiou A (2022) Potential impacts of climate, land use and land cover changes on hydropower generation in West Africa: a review. Environ Res Lett 17(4):043005. https://doi.org/10.1088/1748-9326/ac5b3b
Ogega OM, Koske J, Kung’u JB, Scoccimarro E, Endris HS, Mistry MN (2020) Heavy precipitation events over East Africa in a changing climate: results from CORDEX RCMs. Clim Dyn 55(3–4):993–1009. https://doi.org/10.1007/s00382-020-05309-z
Ongoma V, Chen H, Gao C, Nyongesa AM, Polong F (2018) Future changes in climate extremes over Equatorial East Africa based on CMIP5 multimodel ensemble. Nat Hazards 90(2):901–920. https://doi.org/10.1007/s11069-017-3079-9
Puri P, Puri V (2022) The “First climate change famine” from 2017–2022?- An analysis of the economics and geography of great SUD drought of Madagascar (1901–2021). ACADEMICIA: An Int Multidisciplinary Res J 12(3):100–113. https://doi.org/10.5958/2249-7137.2022.00184.7
Rabezanahary Tanteliniaina MF, Andrianarimanana MH (2023) Projection of future drought characteristics in the Great South of Madagascar using CMIP6 and bias-correction spatial disaggregation method. Theoret Appl Climatol. https://doi.org/10.1007/s00704-023-04727-3
Ralaingita MI, Ennis G, Russell-Smith J, Sangha K, Razanakoto T (2022) The Kere of Madagascar: a qualitative exploration of community experiences and perspectives. Ecol Soc 27(1):42. https://doi.org/10.5751/ES-12975-270142
Ralimanana H, Perrigo AL, Smith RJ, Borrell JS, Faurby S, Rajaonah MT, Randriamboavonjy T, Vorontsova MS, Cooke RSC, Phelps LN, Sayol F, Andela N, Andermann T, Andriamanohera AM, Andriambololonera S, Bachman SP, Bacon CD, Baker WJ, Belluardo F., … Antonelli A (2022) Madagascar’s extraordinary biodiversity: threats and opportunities. Science 378(6623). https://doi.org/10.1126/science.adf1466
Rama Rao CA, Raju BMK, Samuel J, Ravindra Chary G (2022) Risk management in rainfed agriculture in India. In Climate change adaptations in dryland agriculture in semi-arid areas. Springer Nature, Singapore, pp 351–365. https://doi.org/10.1007/978-981-16-7861-5_26
Randriamarolaza LYA, Aguilar E, Skrynyk O, Vicente-Serrano SM, Domínguez-Castro F (2022) Indices for daily temperature and precipitation in Madagascar, based on quality-controlled and homogenized data, 1950–2018. Int J Climatol 42(1):265–288. https://doi.org/10.1002/joc.7243
Randriamparany ST, Randrianalijaona TM (2022) The vulnerability of Antandroy women to droughts in Ambovombe Androy (Madagascar). Int J Disaster Risk Reduct 72:102821. https://doi.org/10.1016/j.ijdrr.2022.102821
Randriatsara HH-RH, Hu Z, Ayugi B, Makula EK, Vuguziga F, Nkunzimana A (2022) Interannual characteristics of rainfall over Madagascar and its relationship with the Indian Ocean sea surface temperature variation. Theoret Appl Climatol 148(1–2):349–362. https://doi.org/10.1007/s00704-022-03950-8
Randriatsara HHH, Hu Z, Xu X, Ayugi B, Sian KTCLK, Mumo R, Ongoma V, Holtanova E (2023) Performance evaluation of CMIP6 HighResMIP models in simulating precipitation over Madagascar. Int J Climatol 43(12):5401–5421. https://doi.org/10.1002/joc.8153
Shiru MS, Chung E-S (2021) Performance evaluation of CMIP6 global climate models for selecting models for climate projection over Nigeria. Theoret Appl Climatol 146(1–2):599–615. https://doi.org/10.1007/s00704-021-03746-2
Sillmann J, Kharin VV, Zhang X, Zwiers FW, Bronaugh D (2013) Climate extremes indices in the CMIP5 multimodel ensemble: Part 1 Model evaluation in the present climate. J Geophysical Res: Atmospheres 118(4):1716–1733
Srivastava A, Grotjahn R, Ullrich PA (2020) Evaluation of historical CMIP6 model simulations of extreme precipitation over contiguous US regions. Weather and Climate Extremes 29:100268. https://doi.org/10.1016/j.wace.2020.100268
Stouffer RJ, Eyring V, Meehl GA, Bony S, Senior C, Stevens B, Taylor KE (2017) CMIP5 scientific gaps and recommendations for CMIP6. Bull Am Meteor Soc 98(1):95–105. https://doi.org/10.1175/BAMS-D-15-00013.1
Tabari H (2020) Climate change impact on flood and extreme precipitation increases with water availability. Sci Rep 10(1):13768. https://doi.org/10.1038/s41598-020-70816-2
Tanteliniaina MFR, Chen J, Adyel TM, Zhai J (2020) Elevation dependence of the impact of global warming on rainfall variations in a tropical island. Water 12(12):3582. https://doi.org/10.3390/w12123582
Xin X, Wu T, Zhang J, Yao J, Fang Y (2020) Comparison of CMIP6 and CMIP5 simulations of precipitation in China and the East Asian summer monsoon. Int J Climatol 40(15):6423–6440. https://doi.org/10.1002/joc.6590
Zamani Y, HashemiMonfared SA, AzhdariMoghaddam M, Hamidianpour M (2020) A comparison of CMIP6 and CMIP5 projections for precipitation to observational data: the case of Northeastern Iran. Theoret Appl Climatol 142(3–4):1613–1623. https://doi.org/10.1007/s00704-020-03406-x
Acknowledgements
The authors acknowledge the World Climate Research Programme, which, through its Working Group on Coupled Modelling, coordinated and promoted CMIP6. We thank the climate modeling groups for producing and making available their model output, the Earth System Grid Federation (ESGF) for archiving the data and providing access, and the multiple funding agencies who support CMIP6 and ESGF.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Conceptualization, data collection and analysis, formal analysis, data curation, and writing of original draft were performed by Mirindra Finaritra Rabezanahary Tanteliniaina. Supervision and Conceptualization were performed by Zhai Jun. Writing, review and editing were performed by Mihasina Harinaivo Andrianarimanana. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rabezanahary Tanteliniaina, M.F., Zhai, J. & Andrianarimanana, M.H. Performance evaluation of CMIP6 in simulating extreme precipitation in Madagascar. Theor Appl Climatol 155, 4089–4100 (2024). https://doi.org/10.1007/s00704-024-04868-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00704-024-04868-z