1 Introduction

More than three hundred million people live in West Africa and this population is expected to double in the next two decades. The economy of West Africa is mainly based on the rain-fed agricultural and pastoral sectors, so West Africans and, more specifically, the people of the Sahel, are strongly dependent on the four-month rainfall season that generally occurs between June and September. This dependence seems to have been exacerbated recently, probably due, at least partly, to climate variability and change: local surveys and reports indicate concerns about a later monsoon onset, increasingly severe dry spells and flash floods, destruction of biodiversity, etc. (e.g. IPCC 2013, 2014).

Recognition of the vital role of the West African monsoon (WAM) has led to some international multidisciplinary research projects in recent years, such as AMMA (African Monsoon Multidisciplinary Analysis; Redelsperger et al. 2002), THORPEX-AFRICA (THe Observing system Research and Predictability EXperiment; Shapiro and Thorpe 2004), WAMME (West African monsoon modeling and evaluation; Druyan et al. 2010), IRIACC/FACE (International Research Initiative on Adaptation to Climate Change/Faire face Aux Changements Ensemble; http://face.ete.inrs.ca/). A major objective of these initiatives was to understand the physical mechanisms involved in the WAM variability at different spatial and temporal scales and thus to improve the numerical models used for weather prediction and for climate projections. Special attention has been devoted to the intraseasonalFootnote 1 scales that affect day-to-day life and economic activities more directly. Three main intraseasonal scales of variability have been studied: (1) the 30–90-day scale, which is an MJO- (Madden and Julian Oscillation; Madden and Julian 1971) like activity (Janicot et al. 2009), (2) the 10–25-day scale (Sultan et al. 2003) involving atmosphere–ocean interactions, and (3) the 1–10-day scale, which is driven by meteorological events occurring at synoptic scale to mesoscale, such as the African Easterly Waves (AEWs; Kiladis et al. 2006) and Mesoscale Convective Systems (MCSs; Mathon et al. 2002), respectively.

Short-term weather forecasting and future projection of the WAM intraseasonal activity are a huge challenge for the scientific community (Hourdin et al. 2010) because of the complexity of the dynamical and physical processes of the WAM. Roehrig et al. (2013) pointed out the poor suitability of coarse-mesh Global Climate Models (GCMs) for handling the intraseasonal and meteorological scales overall. Yet, Mathon et al. (2002) highlighted the importance of the meteorological events over the Sahel: about 80 % of the annual rainfall is brought by a relatively small number of MCSs, mainly associated with AEWs through complex physical processes (Cornforth et al. 2009). The representation of such scales requires a more precise description of the physical processes related to surface conditions over land and ocean, the boundary layer, clouds, and also radiation and convection (e.g. see Taylor et al. 2011; Guichard et al. 2009). Therefore, more sophisticated models involving finer resolution and more detailed parameterization (e.g. McCrary et al. 2014) need to be designed for this particular WAM region. Regional modeling is one of these tools and it is expected to provide a better representation of the local or regional weather events than can be obtained from coarse-mesh modeling (Gallée et al. 2004; Paeth et al. 2005), thus offering a way to develop applications for adaptation to and mitigation of specifically severe weather events. For example, Oettli et al. (2011) investigated the perspective of using Regional Climate Models (RCMs) for crop-yield prediction and highlighted a promising result with the RCM ensemble prediction approach. Crétat et al. (2013) assessed the representation of the monsoon physics during intense rainfall events and showed the significant added value of RCMs in comparison with GCMs.

In line with these ideas, the Coordinated Regional Downscaling Experiments (CORDEX, Giorgi et al. 2009) project is one of the leading endeavors aiming to provide a complete and homogeneous dataset describing the recent past and the future of the WAM region. From these simulations, Nikulin et al. (2012) and Gbobaniyi et al. (2013) have shown, for time scales ranging from interannual to seasonal, an added value of RCMs when they are driven by ERA-Interim reanalysis (ERAI; Dee et al. 2011) rather than by coarse-mesh driving boundary conditions.

Fewer studies have targeted the ability of RCMs to reproduce the monsoon intraseasonal events such as rainfall onset and retreat, AEW intermittency, or the precipitation diurnal cycle. Druyan et al. (2010) have shown that reanalysis-driven RCMs are much more realistic (relatively to GCM-driven) in representing the African monsoon dynamics, such as the structure of the African Easterly Jet (AEJ), the low-level circulation and, hence, the humidity and heat transport. Sylla et al. (2010) have investigated the intraseasonal variability of the WAM using RegCM3Footnote 2 (Regional Climate Model version 3). They demonstrated the model’s ability to represent the WAM dynamics and, more specifically, the AEWs and their related AEJ. Even though this study showed the high potential of RegCM3 to handle very subtle interactions between the AEWs and the AEJ, it was quite limited in terms of quantitative evidence, such as the extent to which this synoptic-scale activity determines the monsoon precipitation. The recent studies by Gbobaniyi et al. (2013), Diallo et al. (2014) and Mounkaila et al. (2015) broadly show a good representation of the WAM onset by RCMs participating in CORDEX. Mariotti et al. (2014) have shown better performance of RCMs in comparison with GCMs in reproducing the AEW activity, but their analysis is qualitative. Crétat et al. (2015) conducted a more detailed analysis on the relationship between AEWs and daily rainfall, using various regional simulations, and revealed the fairly good performance of RCM in terms of spatial and temporal phases. Although a set of arguments tends to confirm the real added value of RCMs, Flaounas et al. (2011) have shown a decisive impact of physical parameterizations on the monsoon onset and precipitation intraseasonal variability, implying that substantial work is still needed to calibrate or to adapt RCMs for Africa.

As previously noted, a large part of the WAM precipitation is attributable to intraseasonal activity and, therefore, the ability of RCMs to represent the intraseasonal variability is closely related with their performance regarding the day-to-day rainfall. Parry et al. (2007) highlighted the necessity of understanding and representing these daily rainfall statistics since they are often more useful (than seasonal means) for impact and adaptation studies. Diaconescu et al. (2015) used two ERAI-driven RCMs to analyze the local onset and retreat of the WAM, as well as the daily precipitation statistics such as the occurrences of wet days, consecutive wet and dry days, and extreme rainfall. Their study reveals the difficulty that reanalyses, such as ERAI, have in adequately representing these indices, in particular the statistics of events with precipitation higher than 10 mm day−1. More recently, a study by Klutse et al. (2015) compared 10 RCMs with observations and noted a generalized weakness of RCMs in producing higher-order daily precipitation statistics such as intensity, frequency or duration. The WAM local onset/retreat is another intraseasonal event of great interest but, until now, it has been the subject of only a few comprehensive assessments, especially at local scale (in contrast with large-scale onset) in RCM simulations. Diaconescu et al. (2015) pointed out the difficulties of RCM simulations as well as reanalyses to simulate the local onset over the Sahel region. In this paper, in order to obtain a more comprehensive idea of the intra-seasonality in RCMs and its impacts (quantitatively), a set of daily precipitation indices are evaluated against satellite observations and presented as a performance matrix.

Assessments of the intraseasonal variability may be strongly related to the meteorological variable involved overall in the tropical region. For example, a model with good skill in capturing dynamical AEWs does not necessarily have good skill in capturing the associated convective features (MCSs) since these two phenomena, although strongly interacting, occur at different time and space scales (Fink and Reiner 2003). It has to be added that the interactions between the WAM dynamics and convective processes are complex but determine the monsoon activity overall at synoptic scales (Poan et al. 2014). Investigating the intraseasonal variability therefore requires looking into both dynamical and convective parameters.

This paper will use the integrated-column water vapor (also called Precipitable Water, hereafter PW) as a proxy integrating the monsoon dynamics and thermodynamics. PW presents the advantage of being relatively better predicted for time scales longer than the diurnal cycle in models (Bock et al. 2007). In addition, Poan et al. (2013) have shown that PW is well suited to following the intraseasonal activity of the WAM, particularly over the Sahel. Concerning convective activity, the daily total precipitation will be used. While PW, as an integrated variable, is sensitive to atmospheric phenomena lasting long enough (~3–5 days) to affect the total column content, precipitation is more affected by shorter scales (less than 3 days). Therefore, combining these two variables allows the whole spectrum of variability to be analyzed, from the longest (up to 90-day period) to the shortest (1-day period) time scales. Focusing on the climate of the recent past (1989–2008), this paper aims to assess the ability of the RCMs (from available CORDEX runs) to represent the WAM intraseasonal variability spectrum in comparison with observations. This analysis is a step forward in assessing models since a “fair” representation of the monsoon mean state is not sufficient to qualify a model as a “good” one.

The paper is organized as follows. The data and methodology are described in Sect. 2. In Sect. 3, the climatology of the WAM is discussed in terms of PW and precipitation as simulated by RCMs, reanalysis and observations. Section 4 analyses the WAM intraseasonal variability through PW filtered variance and precipitation frequency distribution. In Sect. 5, the WAM local onset/retreat and some daily precipitation indices are evaluated. Finally, Sect. 6 summarizes the main findings and suggests further developments.

2 Data and methodology

2.1 Observational datasets and reanalysis

The RCM daily precipitation will be evaluated against the Africa Rainfall Climatology version 2 (ARC2; Novella and Thiaw 2012) daily-precipitation data from the Climate Prediction Center (CPC). This is a satellite-based and observationally constrained dataset that covers the African continent (from 40°S to 40°N and from 20°W to 55°E) on a very fine-mesh grid: 0.1° × 0.1°. The dataset is available from 1983 to the present through the CPC site. In order to give some measure of the uncertainty in satellite-based observations, two other sets of satellite-based and observationally-constrained daily precipitation were used:

  • TRMM 3B42 version 6 (Tropical Rainfall Measuring Mission; Huffman et al. 2007) providing 3-hourly precipitations on a 0.25°-mesh grid covering the tropical regions since 1998.

  • GPCP-1DD version 1.2 (Huffman et al. 2001) global daily precipitation from the Global Precipitation Climatology Project (GPCP), available from 1998 to present on a 1°-mesh grid.

From previous studies (e.g. Sylla et al. 2012), it is known that observational data have less and less consistency when higher order statistics on daily precipitation over West Africa are assessed. Therefore, it became difficult to select one of our satellite data sets as a reference to compare RCMs. However, mainly because of its longer time period, ARC2 will be considered in the majority of analyses, while TRMM and GPCP will help to nuance the comments.

Precipitation and PW from ERAI are also used to compare the RCM-simulated daily fields. The data cover the recent period of 1979 to 2009 and are offered on a 0.75°-mesh grid. It should be borne in mind that there is no station-precipitation assimilation in ERAI, and hence the reanalysis precipitation is a prognostic variable that is a by-product of the assimilation of other atmospheric variables and the short-term forecast of the ECMWF model.

2.2 RCM data

A subset of six CORDEX-Africa RCMs was available in this study for the evaluation of historical experiments. The model boundary conditions were given by ERAI for the CORDEX project evaluation and by simulations from three Coupled GCMs for the historical CORDEX project, namely CanESM2 (Arora et al. 2011), MPI-ESM-MR (Jungclaus et al. 2013) noted here as MPI, and EC-EARTH (Hazeleger et al. 2012). To avoid any confusion, most of the results from these GCM-driven simulations will be shown in the Appendix and so will be commented only briefly. The RCM simulations are provided on a 0.44° horizontal grid. Details of each RCM are summarized in Table 1. The CRCM5 (Hernández-Díaz et al. 2013; Laprise et al. 2013) data were acquired directly from the Centre pour l’Étude et la Simulation du Climat à l’Échelle Régionale (ESCER Centre) at UQAM (http://www.escer.uqam.ca/), CanRCM4 (Scinocca et al. 2016) data were provided by the Canadian Centre for Climate Modelling and Analysis division of the Climate Research Branch of Environment Canada (CCCma/CRB/EC; http://www.ec.gc.ca/ccmac-cccma/), and the other RCM data were obtained through the Earth System Grid Federation (ESGF; for details see http://www.cordex.org/index.php/output). Note that the HIRHAM5 PW field was not available at the time of the present study.

Table 1 Ensemble of RCM simulations used over the current climate from both reanalysis and GCM-driven conditions, with the detailed description of domain size, model’s main characteristics, grid projection and time range as well as with the main sub-grid scale parametrization references

2.3 Methodology and definitions

As shown in the data section, several RCMs were involved in this analysis with the main purpose of highlighting their consistency versus their spread due to the different choices made for each RCM (as shown in the review by Paeth et al. 2011). Ideally, all the simulations involved in the CORDEX project should have been used. However, only 6 of all available RCMs could be selected from the database, mainly because of the necessity of having PW. In the discussion, attention will be paid to model spreads which, in turn, will be raised as key topics for future improvements.

Most of the analyses shown in this paper involve conversions between time and frequency domains. For temporal filtering, the Lanczos filter described by Duchon (1979) was used in different modes such as high-pass (“hp”) and band-pass (“bp”) filtering. Since boundary effects are a critical issue in data filtering, it is worth mentioning that the filtering was applied to all the data ranging from January to December of each year, even though only the summer rainy months (June-July–August-September, JJAS) were kept for the analysis, thus reducing spurious boundary effects. The JJAS time period corresponds to the main humid period over the WAM region, especially in the Sahel/Sudan area (e.g. Sultan et al. 2003).

To analyze the periodicities involved in the intraseasonal anomalies, we used a Fast Fourier Transform (FFT) algorithm. This classical method allows any time-discrete signal to be described through its power spectral density (PSD). The contribution of each frequency to the total time variance of the signal can thus be analyzed. The choice was made to plot the normalized PSD for each dataset. By doing this, we could compare the relative importance of each time scale of the different models regardless of their initial differences in amplitude.

Wavelet analysis is also used in this study. The protocol defined by Torrence and Compo (1998) was applied to the daily rainfall at each grid point, then spatially averaged over specific regions. This technique provides an overview of the contributions of different intraseasonal scales represented in RCMs, ERAI and observations for a specific year, such as 2009, which was marked by intense, sustained rainy events over West Africa. Sultan et al. (2003) showed that such an analysis was particularly useful to reveal the WAM intraseasonal modes. It is worth mentioning that the FFT and the wavelet analysis were applied to the intraseasonal signal, defined for each variable as its 90-day high-pass filtered (hp90) variance, as used in recent studies (e.g. Chauvin et al. 2010).

The second part of our analysis is devoted to the assessment of daily precipitation indices. Diaconescu et al. (2015) give details on the background concepts supporting the selection of these indices, while Gachon et al. (2007) show the climatology of such indices using numerous stations over West Africa. The Root Mean Square Error (RMSE, against ARC2 used as reference dataset) is used as the metric and the information is summarized using a condensed performance matrix (e.g. Gleckler et al. 2008). For each index, the matrix records the ratio of each model RMSE and the highest RMSE among all models.

The WAM onset corresponds to a significant decrease in precipitation near the Guinea coast (5–10°N) and, conversely, its durable establishment over the northern latitudes (10–17°N). Sultan et al. (2005) highlighted what was at stake in the region’s socio-economic life during the onset, presenting it as the most important intraseasonal event, crucial for agro-pastoral yields. Therefore it is important for RCMs to be able to capture the monsoon onset (and its retreat) for both present and future climates. In the literature on the WAM (e.g. Vellinga et al. 2013; Fitzpatrick et al. 2015), two main features can be used for detecting the onset: (1) the large-scale onset that focuses on the shift (or jump) of the sustained rainy band from its Guinean position (~5°N) to a Sudanese position (~10°N), (2) the local onsets are related to more agricultural purposes and represent the effective start of sustained rainfall at a specific location. The large-scale precipitation onset has been quite widely analyzed, in particular in CORDEX simulations (among others, Gbobaniyi et al. 2013; Nikulin et al. 2012; Diaconescu et al. 2015) and most RCMs tend to improve the onset occurrence in comparison with ERAI and GCMs. The local onset is more complicated to reproduce since precipitation structures are more affected by smaller scale processes in this case (Marteau et al. 2011). Fitzpatrick et al. (2015) recently studied this issue by comparing different data and/or definitions, and revealed that there was poor consistency in local onset while large-scale onsets were quite well correlated. In this paper, the focus is on local onset and the intention is to see how good RCM skills are at smaller scales, and hence whether they can be used in agricultural domains, for instance.

The local onset computation is based on the method of Diaconescu et al. (2015) here, which takes its inspiration from a study by Liebmann and Marengo (2001). An onset function is defined, for each grid point, as the cumulative sum of daily precipitation anomalies from day 1 (1st January) to day 365 (31st December). The anomalies are computed against the grid-point climatological mean, which, in our case, is a 20-year mean. Physically, this definition allows the weight (or impact) of any daily rainy event on the whole season state to be taken into account at the time it occurs. In addition, from an agricultural point of view, a given event will not be “useful” if (1) it is not sufficient to change the trajectory of the onset function or (2) it is not sustained by companion events to keep the function moving in the same direction. From this function, the onset date is detected as the day the function reaches its minimum and, conversely, its maximum for the retreat. By comparison, Vellinga et al. (2013) defined their local onset as the date when a certain threshold (e.g. 20 %) of the average seasonal total rainfall was reached at a given location. Finally, given that there is still no consensus defining the WAM local (and even regional) onset, it has to be agreed that one might be cautious when analyzing the onset issues from different approaches (as argued by Fitzpatrick et al. 2015).

The time average will be computed more often over 1989–2008 (except for TRMM and GPCP, 1998–2008). Since ARC2 is the longest available set of observational data, it will be considered as the reference for precipitation, while ERAI will be the reference for PW. Bock et al. (2007) have shown the accuracy of ERAI PW using ground-based GPS observations over West Africa.

3 Climatological background: column-integrated humidity and monsoon precipitation

3.1 On the relationship between precipitable water and observed rainfall

The physical link between PW and tropical rainfall has been inferred and discussed by recent studies (Holloway and Neelin 2007; Neelin et al. 2009). The amount of PW and its time variations integrate thermodynamic (specific humidity) and dynamic (wind) processes, respectively, and therefore it can provide suitable information on the evolution of the monsoon. More specifically, over the Sahel, the humidity supply is the essential factor for building up moist static energy since the heat reservoir is already huge. Bock et al. (2007) showed high correlations between the WAM rainfall and PW at 5 ground-based GPS stations, both at seasonal and intraseasonal scales. It was also inferred by Bock et al. (2008) that no rainfall occurs when PW is smaller than 30 mm. At synoptic scale, Poan et al. (2013) have shown that PW is particularly well suited for the detection and monitoring of the AEW dynamics, as well as the associated precipitation.

More generally, over tropical oceanic regions, Holloway and Neelin (2007) showed that, considering its relatively long autocorrelation time, PW can integrate both synoptic and mesoscale physics, while precipitation is more sensitive to shorter (a few hours) time-scale processes. Finally, PW is expected to provide a “smoothed” view of the relatively chaotic patterns of precipitation. In this paper, the performance of RCMs in representing PW consistently with rainfall is discussed.

Figure 1a displays ERAI PW JJAS climatology (colors represent mm) and variance (contours in mm2). The thick green line delimits the 30-mm threshold, below which no significant rainfall is observed. The notable meridional gradient of humidity is delimited by southern (south of 15°N) values higher than 40 mm and low values (<30 mm) north of 20°N. In between, in the Sahel area, lies the sharp gradient but also the band of high variability. For example, Table 2 shows a variation of approximately 22 mm of PW between 10°N and 20°N around the Greenwich meridian, with an increase between 15°N and 20°N. The seasonal-mean precipitation displayed in Fig. 1b (ARC2) is consistent with the overall patterns of PW from ERAI showing a south-to-north decrease. Over the Sahel, rainfall seems to occur only where PW exceeds 30 mm (south of 20°N). The northern contour of 1 mm day−1 follows the maximum of PW variance remarkably well (Fig. 1a). Over the topography of Guinea, Cameroon and Ethiopia, the lower values of PW are anti-correlated with the maximum in precipitation.

Fig. 1
figure 1

1989–2008 Seasonal (June–July–August–September, JJAS) mean fields. a ERAI PW (colors in mm) and variance (contours in mm2); the thick green line delimits the 30-mm PW threshold below which no significant rainfall is observed. b ARC2 precipitation (colors in mm day−1); the thick blue lines delimit the 1 mm day−1 precipitation. The triangles indicate the location of three main topographical features: FD Fouta Djallon, CM Cameroon Mountain, ET Ethiopian Highlands

Table 2 JJAS climatology of different indices computed using daily precipitation and PW from RCMs, ERAI and satellites observations, and spatially averaged over three specific locations

Despite a fair representation of PW in ERAI (as noted by Bock et al. 2007), Fig. 2a, b as well as Table 2 clearly show the difficulties of ERAI in reproducing rainfall consistent with observations. The rain belt is particularly far south and the 1 mm day−1 contour barely goes north of 15°N. Precipitation of only 0.9 mm day−1 occurs at 15°N (near the Greenwich meridian) while ARC2 shows 2.5 mm day−1 (see Table 2). The southward position of the rainfall is particularly striking west of 5°E. The seasonal maximum is trapped south of 10°N. Regarding the observational data shown in Table 2, although the TRMM and ARC2 datasets are consistent with each other, the average daily precipitation rate appears higher in the former than in the latter. However, TRMM climatology uses only 11 years (1998–2008) and that might slightly influence the seasonal-mean values, as the last decade has been more humid with more extreme rainfall over the Sahel than previous decades (e.g. Mouhamed et al. 2013; Sarr et al. 2014).

Fig. 2
figure 2

Same as Fig. 1, but for ERAI and ERAI-driven RCMs, the names of which are given in the titles

Being a reanalyzed variable, ERAI PW agrees with observations (e.g. radio-sounding of humidity) quite well and can be regarded as being as accurate as GPS observations (as shown by Poan et al. 2013). On the other hand, ERAI rainfall shows large discrepancies with respect to observed data, at least over the Sahel. In other words, although necessary, an accurate representation of the monsoon large-scale dynamics and thermodynamics is not sufficient to produce an accurate precipitation field. It also implies that the model physical parameterizations are very important, specifically over the Sahel where diabatic processes (e.g. boundary layer, cumulus convection) are important.

3.2 Joint analysis of the seasonal PW and precipitation in regional models

Figure 2 presents the JJAS climatological mean for PW (upper panels) and precipitation (lower panels) for ERAI and as simulated by five RCMs driven by ERAI. Table 2 also gives details on PW and rainfall (mean values and meridional gradients), sampling the monsoon region at different locations from East to West: inland (15°E), Greenwich (0°E) and over the western coast (15°W), all along the 15°N parallel. The indices are computed using a 2° latitude/longitude square (~5 × 5 RCM grid points) centered on each location. This table aims to give a quantitative assessment of RCM behaviors in the critical Sahel band where both humidity and precipitation gradients are strong, and therefore difficult to reproduce. The seasonal-mean structure of PW shown in Fig. 2 implies that all RCMs represent the climatology (position and amplitude) described in Sect. 3 a quite well, namely the sharp north–south humidity gradient as well as the Sahel zonal band of high variability. In fact, RCM-simulated PW is of the same order as ERAI, except in the CCLM model, where it appears particularly higher. On the other hand, more discrepancies and dispersion between RCMs appear when PW variance is considered. Over the Sahel, Couvreux et al. (2010) showed that more than 75 (88 %) of PW mean (variance) is brought by levels below 700 hPa, suggesting that a good representation of low-level circulation is crucial to obtaining the right quantities of PW. In agreement with previous studies (e.g. Sylla et al. 2009), it can be speculated here that most RCMs, because of improving local/regional processes, tend to better simulate the low-level circulation, together with the mean temperature and humidity gradients. From a more detailed analysis, Table 2 reveals that the spatial distribution is reproduced by RCMs with variable levels of success, especially near the Greenwich meridian and inland (15°E), where the differences with ERAI are quite substantial. However, it is important to keep in mind that PW is a “freely” simulated variable in RCMs (inside the domain) while, in ERAI, it should be strongly constrained by the observation data assimilation procedure.

Over the Sahel, the low-level temperature gradient explains the existence of the African Easterly Jet (AEJ) near 600 hPa (Thorncroft and Blackburn 1999). That temperature gradient combined with the humidity gradients constitute a baroclinic energy reservoir that is strongly involved in the genesis and the development of summer atmospheric disturbances such as AEWs (Leroux and Hall 2009). Consequently, it seems important that RCMs reproduce this baroclinic mean state over the Sahel, which can be inferred through PW meridional gradient. In fact, Hsieh and Cook (2007) demonstrated that their RCM was able to handle the energetics of the AEJ-AEW system quite accurately. As can be inferred from Table 2 and Fig. 2k, RCA4 is the closest model to ERAI in representing the position and the amplitude of the baroclinic zone. In particular, the 30 mm contour of PW, which is the marker of the Inter Tropical Discontinuity (ITD) according to Bock et al. (2008), is quite well reproduced. The JJAS-mean precipitation of RCA4 is also consistent with the observations, except near the western coast, where it is overestimated with respect to ARC2. For instance, the mean rainfall and its south/north gradients (Table 2) at 0° and 15°E are better simulated in RCA4 than in ERAI. Some similarities can be noted between RCA4 and CanRCM4, although the latter seems slightly wetter over 15–20°N.

CCLM and RACMO22T present a relatively moister Sahel and a weaker PW gradient than ERAI, and their seasonal-mean PW is clearly overestimated between 10 and 20°N, with all values above 40 mm (Fig. 2g, i). The Saharan Heat Low region (minimum of PW north of 20°N in Fig. 1a) is almost nonexistent in the west or confined over Libya and Egypt in the east. Regarding the precipitation field, these RCMs simulate the precipitation patterns north of 17°N relatively well despite the fact that they overestimate PW. However, as shown by the 1 mm day−1 contour as well as their maximum rain belt (10–15°N), these 2 RCMs tend to have zonally symmetric behavior and so do not reproduce the variations shown in observations (i.e. ARC2 in Fig. 1b). Note that a subset of these RCMs was assessed by Paeth et al. (2011) with similar remarks considering their biases in mean precipitation.

CRCM5 has quite singular behavior with an underestimation/overestimation of the average amount of rainfall over the northern/southern Sahel, leading to stronger humidity gradients around the 15°N band (Fig. 2d). For example, around 0°E, PW decreases by ~31 mm from 10°N to 20°N in CRCM5, whereas in ERAI it decreases by ~21 mm (Fig. 2c and a, respectively). This excessive gradient in CRCM5 appears to be related to its overestimated precipitation south of or near 10°N, and almost no rainfall north of 15°N. More generally, despite significant discrepancies with respect to ERAI PW, most of the RCMs tend to improve the spatial distribution of precipitation shown by ERAI over the whole Sahel area. It also seems clear that, when RCMs have a good representation of PW (such as RCA4), they reproduce the seasonal-mean rainfall more accurately.

4 WAM intraseasonal scales in RCMs

In principle, regional modeling is expected to significantly improve the way general features of the WAM dynamics are represented and, in particular, its intraseasonal activity, such as onset–retreat, persistent dry–wet spells, and also AEWs with respect to coarse-scale driving fields. As the humidity field is one of the key (and limiting) factors for convection over the Sahel, PW has been proposed by Poan et al. (2013) as an index to follow the WAM intraseasonal fluctuations as it can follow deep convective activity as well as low-level dynamics. This perspective is analyzed below with RCM simulations.

4.1 Intraseasonality from the precipitable water perspective

Figure 3 presents PW variance filtered at two intraseasonal sub-scales: the 10–90-day band-pass and the 1–10-day high-pass, referred to hereafter as low- and high-frequency (or synoptic) scales, respectively. These two subscales were chosen in order to distinguish between monsoon activity due to meteorological phenomena, and its relatively slower (biweekly to monthly and seasonal) temporal variations that are more often related to broader time and space phenomena involving interactions with the two surrounding oceanic basins (Indian and Atlantic). ERAI variance displayed in Fig. 3a, b has been discussed in Poan et al. (2013) and only some essential elements are recalled here for the comparison with the RCMs. Firstly, maximum variance in both frequencies is confined between 15°N and 25°N (similarly to the total variance shown in Fig. 2) with, however, quite a strong east–west asymmetry. As shown by Leroux et al. (2010), low-frequency variability is greater and mainly prevails over Eastern Africa, east of 10°E (Fig. 3a), then decreases westward from 15°E. Conversely, the 1–10-day band (Fig. 3b), first weaker east of 20°E, rapidly becomes predominant further west, reaching a maximum over the west coast. This 1–10-day variance structure is consistent with the well-known pattern of AEWs, which are triggered over the eastern mountains and then grow quickly on the mean-state baroclinic energy as they propagate westward (Burpee 1972).

Fig. 3
figure 3

1989–2008 JJAS PW Intraseasonal variance partitioning (contours in mm2). For each pair of rows, the top panels show the 10–90-day band-pass variance and the bottom panels the 10-day high-pass variance for each dataset, the names of which are given in the titles. The colors show the seasonal mean PW (as in Fig. 2)

As for ERAI, the RCM intraseasonal variance reproduces the overall pattern of the mean JJAS variance, confining the highest values along the strong gradient zone. Considering more specifically the distribution within the two frequency bands, most of RCM simulations seem rather inaccurate in comparison with the reanalysis. First, the large Eastern African low-frequency activity shown in all RCMs simulations (variance field in 10–90-day) is consistent with the analysis of Alaka and Maloney (2012) showing that the MJO dry and wet phase oscillations induce strong PW fluctuations over this region. Although this MJO-like behavior seems fairly consistent with ERAI fields and the findings of Alaka and Maloney (2012) east of 10°E - Central to Eastern Africa, the low-frequency activity appears to be overestimated in all RCMs over the rest of the continental Sahel. This is reminiscent of some results on the WAM intraseasonal-scale analysis with CMIP5 GCMs by Roehrig et al. (2013) and implies that, even in RCMs, there is still an overrepresentation of the impacts of larger-scale phenomena (from oceanic basins, tropical waves such as MJO). Regarding the 1–10-day variability, only two RCMs (RCA4 in Fig. 3k–l and CRCM5 in Fig. 3c, d) are able to reproduce the zonally westward growth structure of the PW variance. In fact, except for these two models, there is no clear distinction in the intraseasonal variance distribution between the two sub-scales. For instance, CCLM (Fig. 3g, h) and RACMO22T (Fig. 3i, j) display structures that are almost analogous for the two frequency bands, concentrating the variance east of the Greenwich meridian, with a northward shift of the variance field. Therefore, the westward increase in synoptic variability is not well reproduced, implying that these RCMs might not be efficient to handle AEW dynamics or their relative contribution to the intraseasonal (rainfall) variability. As discussed in the introduction, numerous studies have illustrated RCMs’ ability to represent the dynamics of AEWs, but without any clear links to the Eastern region activity that, at least partly, controls AEW intermittency (e.g. Mekonnen et al. 2006; Leroux et al. 2010). From this PW perspective (which may be verified with another dynamical field), it appears that the eastern low-frequency/western high-frequency connection remains a weakness for current RCM simulations (but to a lesser extent for RCA4 and CRCM5).

Figure 4 summarizes, in two regional sub-domains identified as coastal [20°W–10°W; 12–20°N] and continental [5°W–5°E; 12–20°N], the PW “total” intraseasonal variance (hp90 variance) and the previously discussed variance divided in two frequency bands. For each model (combining RCMs driven by ERAI and by GCMs), “total” variance normalized by ERAI one is shown, while the two frequency bands are analyzed in terms of relative contributions to their sum. For example, over the coastal region, CRCM5 driven by ERAI has approximately the same variance as ERAI (~103 % of ERAI variance): 42 % of this intraseasonal variance is due to low-frequency activity while the rest (~58 %) is due to synoptic scales. This sub-scale partitioning stays close to the ERAI one for most RCMs over the western coast. However, the inter-model spread in terms of total PW variance among RCMs is more substantial over the central WAM region (i.e. 5°W–5°E). This is especially the case when RCMs are driven by GCMs instead of ERAI, especially for the two Canadian RCMs (not shown). Hence, the lateral boundary conditions appear to have significant effects on the “total” intraseasonal variance for the two Canadian RCMs over the central WAM area, with quite a large overestimation of the total PW variance when CRCM5 and CanRCM4 are driven by the CanESM2 model. This sensitivity of the intraseasonal variability to the boundary conditions has been also noted in Pohl and Douville (2011), but contrasts with the conclusions of Sylla et al. (2009) who found that GCM biases (or boundary conditions) had quite a small impact on RCM performance.

Fig. 4
figure 4

Regional average of PW intraseasonal variance distribution across different time scales over JJAS for 1989–2005: the “total intraseasonal scale” as 90-day high-pass variance (var_hp90 in blue), the “low frequency scale” as 10–90-day band-pass variance (var_bp10-90 in red) and the “high frequency scale” as 10-day high-pass variance (var_hp10 in green), for the coastal [20°W–10°W, 12–20°N] and the continental [5°W–5°E, 12–20°N] regions. The var_hp90 bars represent the ratio (%) of each simulation variance relatively to that of ERAI, while the hp10 and the bp10–90 bars represent for each simulation, the ratio relatively the “total” intraseasonal variance within each simulation. Note that two GCM-driven simulations are also represented

Regarding the partitioning of this variance into the two frequency bands, the reference ERAI shows the predominance of the synoptic scales in both regions, with a growing fraction as the transient structures propagate westward. As discussed above, the majority of RCMs encounter difficulty in reproducing this behavior according to the chosen region. For example, although CRCM5 simulates the distribution quite similarly to reanalysis over the coast (as illustrated by the ratios), the differences with ERAI increase over the continent. In addition, it should be noted that, although CRCM5, RCA4 and, to a lesser extent, CanRCM4 reproduce the synoptic variance structure quite well (as shown in Fig. 3), they display an inaccurate ratio over the continental area (as shown in Fig. 4) due mainly to an overestimation of the low-frequency variability (>10 days) over the central and western Sahel. This has the effect of increasing longer timescale phenomena at the expense of meteorological events or high-frequency variability. Reducing the proportion of low-frequency variability is therefore a challenge that must be met by most RCMs and, by extension, by GCMs as already shown by Roehrig et al. (2013), if they are to better represent scale interactions crucial for AEW triggering, development and intermittency (Leroux et al. 2010).

4.2 Intraseasonality from the precipitation perspective

4.2.1 Illustration with the 2009 season: wavelet analysis

To illustrate the WAM intraseasonal activity in terms of precipitation, Fig. 5 displays the rainfall time series and their corresponding wavelet spectrum during the year 2009. We focus on the region [5°W–0°E; 10–15°N] (in Burkina Faso, including Ouagadougou) and the 2009 season, as this year was abnormally humid, with a devastating flood (more than 200 mm/day) that occurred on 1st September 2009, the wettest day at Ouagadougou for more than 90 years (BBC News 2009). Galvin (2010) has documented this meteorological event and shown that it was associated with two successive, strong AEWs within which intense MCSs occurred. This case study allows us to evaluate how RCMs (in reanalysis-driven mode) can represent the intraseasonal variability of the WAM and, more specifically, when extreme events occur within the season. The time series (top panel) show the daily precipitation and its anomalies over the year 2009. The wavelets (bottom panel) represent the time series (on X-axis) of the precipitation variance (in color scale, in mm2 days−2) for each time scale (2 to 90 days on Y-axis). The vertical blue (red) dashed line represents the average date of local onset (retreat), computed following the method described in Sect. 2.3 and averaged over the domain. The first top panels from the three observed datasets reveal quite similar results for both precipitation time series and wavelet spectrum. The time series imply that a large amount of the rainfall variability is ascribable to the intraseasonal fluctuations (red curve). The monsoon onset (blue dashed line) occurs around early June and is consistent with the beginning of persistent rainfall or wet spells (i.e. duration and intensity of regular precipitation events). A small difference between observations comes from ARC2 data (Fig. 5b) (the higher resolution dataset), which shows an onset earlier by about 2 weeks and a later retreat than TRMM and GPCP. The three intraseasonal scales of the WAM discussed previously can be seen quite distinctly in the wavelet spectrum, with the energy decreasing progressively from the synoptic scale (less than 10-day fluctuations), through the 10–25 day to the 30–90-day bands. Isolated rainy events start in late May-early June, as the atmosphere becomes increasingly humid. Then, more regular and intense events take place between June and August, after which comes an important decrease in the intraseasonal activity, signaling the monsoon retreat. The flooding event of later August-early September (around day 240) can be seen in all the observational datasets. Even though a remarkable intensity is visible around day 240 at synoptic scale, there is also a non-negligible contribution of lower (intermediate) frequency at the 10–25 day scale (especially in ARC2).

Fig. 5
figure 5

Overview of the monsoon season 2009 across the Burkina Faso region [10–15°N; 5°W–0°E] from TRMM, ARC2, GPCP, ERAI and ERAI-driven RCMs. For each pair of panels, the top plot curves represent daily precipitation time series (in black, mm day−1) and their intraseasonal anomalies as 90-day high-pass filtered (in red). The bottom panels give the wavelet daily rainfall variance spectrum in mm2 day−2 computed from the intraseasonal anomalies. The vertical blue (red) line represents the date of the onset (retreat) in day of year (ranked between 1 and 365) for each dataset mentioned in the title

The RCM and ERAI time series show marked discrepancies, ranging from “too dry” (ERAI, Fig. 5d) to “too wet” (HIRHAM5, Fig. 5h) conditions. ERAI deviation from observations is salient (consistent with the strong dry biases shown by Nikulin et al. 2012), even though it benefits from the assimilation of various variables to simulate its rainfall. Throughout the season, it shows a systematic underestimation (more severe among RCMs) of rainfall intensity and duration, and of the length of the monsoon season. In general, ERAI presents a dominant and persistent 30–90 day mode, occurring quite early in the season, and then a few synoptic events, among them the intense rainfall around the flooding period (i.e. near day 240) is quite weak. The RCM simulations generally improve the variability in time series as well as the onset-retreat timing and, except for RCA4 (Fig. 5j), they capture the intense precipitation event that occurred near day 240, and that caused the flooding episode, quite well. The wavelets computed on RCM simulations, as opposed to ERAI, reveal a more intense synoptic-scale activity (below 10 days), more often after June, and so seem more consistent with observations. Differences among RCMs and the three observational datasets appear mainly in the low frequencies, where RCMs generally overestimate the variability, especially above 25 days. Figure 5 also shows that a majority of RCMs simulate an onset that is too early, except from HIRHAM5 and RACMO22T, which tend to show a later onset.

The use of three different versions of CanRCM4 (not shown) reveals that, more than resolution or dynamical spectral nudging, the physical parameterization has a greater role to play in the intraseasonal monsoon variability and in its modulation at various timescales over the continental Sahel area. This is consistent with the findings of Flaounas et al. (2011), who showed drastic changes depending on the physical parameterizations.

4.2.2 Precipitation frequency spectrum analysis

After the illustration of season 2009, the following analysis (Fig. 6) aims to give a climatological view of the WAM precipitation intraseasonal spectrum. Normalized power spectrum densities (PSDs), computed over 1989–2008 for each RCM and for the two previously discussed sub-regions, are therefore displayed in Fig. 6. On each panel, ERAI (red) and ARC2 (blue) corresponding PSDs are superimposed so that comparisons can be made.

Fig. 6
figure 6

1989–2008 JJAS average of daily rainfall normalized power spectral density (PSD), for ARC2, ERAI and each ERAI-driven RCM, averaged over two regions of the Sahel: the coastal region [20°W–10°W; 12°N–17°N] (left) and the continental region [5°W–5°E; 12°N–17°N]. The normalization was performed with respect to the total intraseasonal variance in each box and for each dataset

It is interesting to compare the PSDs from ARC2 and ERAI by considering just the blue and red curves on Fig. 6a. Over the continent (right), the ARC2 spectrum (blue) shows the separation between the synoptic scales and the low frequencies distinctly. The low frequencies peak around 40–30 days, consistently with the MJO energy peak. This scale was described by Matthews (2004) as a remote response to the intraseasonal activity over the warm pool. Over the continent, an important role is played by scales shorter than 10 days. These scales are associated with the activity of AEWs, which have been classified in two typical time periods: 6–9 days (Diedhiou et al. 1999) and 2–5 days (Reed et al. 1977). The coastal region spectrum has a quite different structure and does not show a noticeable separation between the two scales. The synoptic-scale energy peaks between 6 and 3 days, and then tends to decrease sharply, unlike the continental one. This implies that convection occurs on relatively longer time scales at the coast, while it is more intermittent or sporadic over land. Finally, it is worth mentioning that both TRMM and GPCP spectra, computed over the same regions (not shown), present the same scale patterns as the ARC2 spectrum.

The spectrum of ERAI displays a flat maximum from the lowest frequencies (90 day period) up to the 10-day period. It is apparently unable to distinguish the MJO-linked activity and the 10–25-day period fluctuations. This plateau is also consistent with the wavelet analysis of the 2009 season, where most of the variability arises at longer time scales. At synoptic scales, the spectrum peaks around a 7–5-day period and this can be related to an AEW-like mode, even though that period range is higher than what is generally expected. The contribution of scales shorter than 5 days is significantly reduced compared with observations. This PSD analysis therefore confirms, as could be inferred from the 2009 wavelet analysis, that ERAI experiences strong difficulties in representing the occurrence and, above all, the intensity of synoptic to mesoscale systems over the Sahel. That might be why it shows large dry biases at these latitudes (Nikulin et al. 2012).

The general picture of all RCM PSDs (see Fig. 11 in the Appendix) shows an “ERAI-like behavior” marked by a non-realistic excess of the low-frequency variability, especially over the continent. The intraseasonal maximum variability around 30–40-day in the observations is not significantly or distinctly reproduced by the RCMs. RACMO (Fig. 6c), CCLM (Fig. 6d) and HIRHAM5 (Fig. 6f) realistically improve the PSD for both regions even though the tail of the spectrum (higher frequencies) is weaker. Some RCMs show a strong regional sensitivity by improving the PSD for one region while degrading it for another. For instance, CRCM5 in Fig. 6a shows, on the one hand, a remarkably ARC2-like PSD over the coast (left) and, on the other hand, a particularly misrepresented PSD over the continent. Finally, RCA4 (Fig. 6e) exacerbates the imbalance of the low-frequency to high-frequency ratio, consistently with its wavelet representation in Fig. 5g.

A quantitative assessment of the African monsoon rainfall variability is shown in Fig. 7 with the intraseasonal partitioning (10–90 day, 3–10 day, 1–3 day in Fig. 7b) of the daily precipitation over the continental and coastal regions, from ERAI-driven RCM simulations, ERAI and observations. The climatological mean for each region is represented in Fig. 7a. First, the three observations are quite similar regarding both JJAS-mean rainfall and their intraseasonal variance distribution. The synoptic scales (i.e. 3–10 day and 1–3 day, by order of importance) explain more than 80 % of the precipitation intraseasonal variability, consistently with the conclusions of Mathon et al. (2002) on the influence of MCSs on the seasonal rainfall amount. The highest frequency (1–3-day period) is almost twice as important as the lowest frequency (10–90-day period) whatever the region.

Fig. 7
figure 7

1989–2008 JJAS mean precipitation (top, in mm day−1) and its intraseasonal variance ratio (bottom, in  %) split into three subscales: 10–90-day band-pass (green), 3–10-day band-pass (purple), and 3-day high-pass (blue). GPCP and TRMM data correspond to the 1998–2008 period

Regarding the RCMs, the large dispersion of JJAS average among models (Fig. 7a) is closely related to the inaccurate partitioning of the intraseasonal variability between the lowest (10–90-day period) and the highest frequency (1–3-day period), with rather accurate values for intermediate frequency (i.e. 3–10-day period). Some studies (e.g. Sylla et al. 2010; Mariotti et al. 2014) have highlighted the ability of RCMs to represent AEWs based on 700–600 hPa, 3–10-day filtered meridional wind fluctuations. Our analysis reveals that, in terms of precipitation activity, this scale is not the most critical for RCMs. In fact, the models mainly underestimate the highest frequency (1–3 day period) and conversely overestimate the lowest (10–90-day) one, and their respective contributions to the precipitation variance. This is also the case for the ERAI products. However, this partitioning among various time scales is slightly better reproduced over the coastal area than over the interior of the Sahel area for the majority of RCMs (except ERAI). Consequently, their JJAS mean rainfall shows better agreement with the observations over the western WAM region than over the continental area. The assessment of such aspects in GCMs by Roehrig et al. (2013) has shown a more exacerbated tendency of GCMs to overestimate (underestimate) low (high) frequencies.

5 WAM onset/retreat and daily precipitation indices

This section aims to evaluate some specific aspects of the WAM intraseasonal variability, namely its onset/retreat and the resulting precipitation indices related to the occurrence, duration and intensity of daily events during the monsoon season. The day-to-day rainfall activity and its analysis are of crucial importance, not only for economic activity throughout the Sahel, but also because this complements the analysis of the partitioning of low and high frequencies in the mean daily rainfall. There is a straightforward relationship between a model’s ability to handle the intraseasonal spectrum and its performance regarding the daily precipitation statistics that account for the occurrence of events (e.g. onset/retreat and wet/dry days), their duration and their intensity (e.g. dry/wet spells and high quantiles). Thus, this section is used to propose a more precise quantification of how RCMs improve (or not) the intraseasonality of the WAM with respect to their driving boundary conditions.

5.1 Monsoon climatological local onset-retreat

As discussed in the methodology section, the onset-retreat is computed locally, at each grid point, following Diaconescu et al. (2015). Figure 8 presents the climatological local onset over the Sahel region from ARC2, ERAI and the six RCMs driven by ERAI. The onset patterns from ARC2 recall the meridional structure of WAM precipitation. The first long-lasting rainy events start in early May (day 120) at around 10°N, then progressively move northward, leading to an onset in late June - early July at latitudes around 15°N. The date of onset occurrence is not zonally symmetric. In fact, east of 5°E, onset is delayed by about 2–3 weeks (for a given latitude) between 10°N and 16°N, with no onset occurring farther north around these longitudes. As highlighted by the seasonal-mean rainfall fields, ERAI also misrepresents the meridional structure of the onset over both coastal and continental areas. In fact, the onset is clearly delayed by at least one to three weeks over the Sahel area west of 5°E. Conversely, over central Africa (or east of 5°E), ERAI onset is too far north compared to ARC2, as eastern Niger and the greater part of Chad are areas where rainfall is known to be scarce, with a reduction in the occurrence of wet days and a delay in the onset over the 12–15°N bands in western Chad, and early onset in eastern Chad (Gachon et al. 2007).

Fig. 8
figure 8

Climatological (1989–2008) local onset date over the Sahel (in day of year) for ARC2, ERAI and ERAI-driven RCMs. The two red boxes delimit the continental and the coastal regions

The opposite (and unrealistic) behavior of onset over the continent given by the two Canadian RCMs (CRCM5 and CanRCM4) and RCA4 highlights the difficulty of simulating both the right date and the right location of the onset over the continental Sahel area (Fig. 8c, d). For example, the CRCM5 onset appears too far south (even farther south than in ERAI) while CanRCM4 is too far north. Also, both RCMs have some difficulties representing the latitudinal gradient of rainfall installation over most continental areas. Over the coastal region, however, they represent the patterns quite well, especially CRCM5 which is quite similar to ARC2. RCA4, despite its successful simulation of the seasonal-mean precipitation (at least over the continent), also misrepresents the meridional structure of the onset associated with rainfall patterns. However, it is worth noting its particularly good skill over the coastal region.

The other three RCMs perform quite well in general for the onset occurrence over the western Sahel. East of 5°E, however, they experience difficulties in simulating the onset dates obtained by observations. HIRHAM5, CCLM and RACMO handle the onset latitudinal variation pretty well, especially over the continental area, and have also shown a distinguishable intraseasonal power density spectrum (PSDs in Fig. 6). Unlike CanRCM4, CRCM5 and RCA4, they capture the higher energy better at synoptic scales (AEW and MCS activity). Thus, this analysis reinforces the importance of the day-to-day activity and the so-called meteorological scales for longer scale patterns such as the WAM onset. Some analyses with RCMs driven by GCMs (Fig. 12) reveal a notably smaller impact of the driver. This may lend support to conclusions by Crétat et al. (2013) that physical parameterizations are crucial if RCMs are to handle the day-to-day rainfall variability and by extension the onset. As also suggested by Flaounas et al. (2012), larger scale dynamics, such as the Indian monsoon, also control the WAM onset and, therefore, the skill of RCMs should improve if the driving GCMs handle these large-scale dynamics correctly.

Along with the onset, the monsoon rainfall retreat is also an intraseasonal event of interest, as it also controls the length of the rainy season. In fact, for agricultural purposes, the consequences of a delayed onset can be reduced by a later retreat. Also, from a climate change point of view, it is important to understand whether the length of the rainy season (retreat date minus onset date) will change significantly (e.g. Biasutti and Sobel 2009). Figure 9 displays the Julian date of the local retreat occurrence from observations, ERAI and RCMs driven by ERAI. ARC2 (Fig. 9a) reveals a progressive meridional retreat of the monsoon, first by the end of August from the northern latitudes (~18°N), then in mid to late September for the 16–14°N bands. Finally, after mid-October, no more significant rainfall appears north of 10°N. There seems to be a later retreat near the coastal region, probably due to the local humidity supplied by the low-level westerlies, and the role played by the Guinea plateau in inducing upward motion and local convection. In fact, over the Fouta Djallon area (Guinea), the convective activity is found to increase in frequency and intensity due to the orographic forcing of water vapor in an area of convergence between monsoon and Harmattan fluxes, with heavy rain released over the southwest side of the Guinea plateau. In general, the retreat is better captured by RCMs than the onset. In fact, the abrupt northward shift of the monsoon at its onset time contrasts with the smooth retreat of the ITCZ. Hence, the rain belt retreat is a larger scale phenomenon that is less abrupt, with weaker meridional gradients than the onset, and so the retreat is less complex to represent by reanalysis and RCMs. Except CRCM5 (Fig. 9d), which tends to simulate a noticeably earlier retreat (10–20 days earlier north of ~14°N), all RCMs improve the simulated retreat with respect to ERAI, especially CCLM, RACMO22T and RCA4 (although the last does not represent the onset particularly well). As for the onset, using GCMs as driving conditions (Fig. 13) for various RCMs generally keeps differences in the same range as when they are driven by ERAI.

Fig. 9
figure 9

Same as Fig. 8, but for local retreat date

5.2 Daily precipitation indices: definitions

The daily precipitation indices are assessed with respect to three criteria: the occurrence, the intensity and the duration of a given rainy event. Gachon et al. (2007) performed a quantitative analysis of a larger number of indices over the Sahel region using ground-based observations. The indices used in the current analysis are presented in Table 3 using the same definition as in Gachon et al. (2007) and Diaconescu et al. (2015).

Table 3 Summary of the precipitation indices used to evaluate RCMs

R1mm is related to the occurrence of rainy events (defined as daily precipitation ≥ 1 mm day−1), while other indices such as SDII, R20mm or Rd3 account for both occurrence and intensity (i.e. mean intensity per wet day, percentage of days with daily precipitation ≥ 20 mm/day, or maximum amount of rainfall over three consecutive days, respectively). CDD is the dry spell index (maximum number of Consecutive Dry Days). According to Gachon et al. (2007), 20 mm day−1 falls climatologically within the 70th and the 80th percentiles of daily rainfall over the Sahel. In a Sahelian context with strong vulnerability as well as large needs concerning water supply, the moderate to heavy rainy events require due consideration. With the Rd3 and R20mm indices, the ability of RCMs to capture these relatively important events is then evaluated. The CDD index is also of great interest for farming activities. Overall, in a future climate-change perspective, it can be interesting in terms of agricultural adaptation (e.g. choice of crop variety).

5.3 Daily precipitation indices: performance matrix

A performance matrix is used to summarize the results of the evaluation of the daily precipitation indices (defined in Table 3). Gleckler et al. (2008) have discussed the interest of using objective metrics to compare simulations and also the systematic related difficulties, which include the availability and the quality of reference observational data, and the lack of accepted standard measures of model performance. The metric used in the study of Gleckler et al. (2008) was the relative RMSE against the “typical” error for all models, which is the median RMSE for a given index. In the present study, given the relatively limited number of RCMs, this “typical” error is not used and, instead, the maximum RMSE is used so that the “best” possible performer (which is the reference itself) will have 0 while the “less” skillful RCMs will have a score of 1. In this manner, the performance matrix has the advantage of ranking models (relatively to a particular criterion) without losing the information on their individual deviation with respect to the reference. Table 4 shows the actual values of mean and standard deviation for each index over the periods where data are available.

Table 4 Mean values of daily precipitation indices (described in Table 3)

Figure 10 presents the performance matrix for the 6 ERAI-driven RCMs, ERAI, TRMM and GPCP (the last 2 are used for 1998–2008) with respect to ARC2, for the continental (bottom triangle) and the coastal (upper triangle) sub-regions. In general, there is a large spread between datasets and among indices within the same dataset. First, TRMM and GPCP analyses of observations show a reasonable consistency with ARC2 for all indices except the SDII and R20mm (i.e. for moderate- and high-intensity rainfall), consistently with Sylla et al. (2012) who showed marked discrepancies among observations for higher-order indices. For most of the indices, observations clearly differ from models by their smaller RMSE (for mean rainfall, number of wet days, the maximum rainfall cumulated over three consecutive days and finally the longest dry spell). In addition, Table 4 shows an appreciable consistency between GPCP and ARC2 over the continental region: on average ~31 wet days for GPCP against 33 for ARC2; 13 CDD with day 198 (around mid-July) as the medium date of occurrence for GPCP against 12 CDD occurring around day 208 for ARC2; and, finally, ~58 mm as R3d for GPCP against ~54 mm for ARC2. TRMM indices show larger discrepancies that cannot be explained solely by the difference of resolution since GPCP is even coarser.

Fig. 10
figure 10

Daily precipitation index performance matrix. For a given index, values are computed as the ratio between each dataset RMSE and the maximum value of all datasets RMSE. The RMSE is computed against ARC2 rainfall

For the Simple Daily Intensity Index (SDII) and R20mm index, substantial differences exist between observations. A large discrepancy arises between ARC2 and TRMM in terms of SDII over the continent, TRMM giving 16 mm day−1 while ARC2 notes only 10 mm day−1. This is probably due to the fact that TRMM tends to overestimate precipitation over the Sahel (e.g. Fig. 8a) and ARC2 to underestimate it (Novella and Thiaw 2012). Considering the R20mm, TRMM appears to be the closest to ARC2 for both regions and this implies that the differences between these two observations in SDII come from moderate to lower (than 20 mm day−1) intensity rainfall.

ERAI shows quite good and equivalent behavior in both coastal and continental regions, except for the CDD index, which is the least well reproduced over the continental area, as also noted north of 17°N with a dry bias over this region (see Fig. 2b). Among all the models, the mean precipitation and the occurrence of wet days are best reproduced by ERAI over both regions. As a reanalysis, ERAI can be expected to capture the main features of the monsoon weather (like relatively large-scale phenomena such as AEWs) and therefore be “accurate” in finding their average effect. In fact, Diaconescu et al. (2015) showed that ERAI presented higher correlation (in comparison with the 2 Canadian RCMs) as well as smaller R1mm RMSE relatively to observations. However, for the moderate- to high-intensity rainfall indices (i.e., SDII and R20mm), ERAI performed poorly, with the lowest skill of all models over the coast. In fact, ERAI produced insufficient rainfall values (i.e. fewer occurrences of intense rainfall), with SDIIs of ~6 and 12 mm day−1 and R20mms of ~1 and 5 mm day−1 for ERAI and ARC2, respectively (see Table 4).

The large majority of RCMs exhibit behavior that is similar to (but less good than) that of ERAI when RMean and R1mm are considered, but this varies between the two regions. For example, for RMean, RCA4 presents the highest/lowest relative RMSE over the coast/continent. CanRCM4 overestimates the wet days (R1mm) over the continent with ~88 wet days against 33 for ARC2, consistently with its too-early onset (Fig. 8c) over this area. Conversely, CRCM5 and HIRHAM5 are quite similar to ERAI, with quite accurate numbers of wet days. The SDII and R20mm are better reproduced by most of RCMs (except RACMO22T) than by ERAI. This is in line with our previous analysis showing that RCMs resolve the physics of moderate to heavy rainy events better, with a significant added value. For example, using the ensemble mean of 10 RCMs (including the 6 used here), Klutse et al. (2015) evaluated the correlation with observations at more than 0.8 over the Sahel for extreme precipitation. Finally, for these two indices, RCM skill with respect to ARC2 is similar to those from various observed data and, in some cases, even better (RCA4 and CRCM5 for the SDII index).

The Rd3 and the CDD indices are used to characterize the strongest accumulation of rain during a 3-day wet spell, and the longest dry spell, respectively. In fact, their occurrence and persistence during the monsoon season are of high importance for the socio-economic activities of the Sahel. A large spread in terms of skills can be observed among RCMs regarding these two indices in Fig. 10. The overall weakness of RCM performances for these two indices recalls the analysis in Sect. 4: despite improving (relative to ERAI) the representation of high-frequency variability, RCMs still misrepresent the spectrum of these time scales directly influenced by the meteorological events and their high-frequency distribution. Furthermore, RCMs perform CDD and Rd3 with two apparently contradictory tendencies. For example, CRCM5 performs well for Rd3 over both coastal and continental regions but it exhibits one of the largest errors for CDD. On the other hand, the best CDD obtained with RACMO22T and HIRHAM5 contrasts with their smallest skill for Rd3. As noted by Crétat et al. (2013), these different behaviors in RCMs are potentially linked with their physical parameterizations, i.e. intermittency of convective precipitation, but deeper investigations (outside the scope of the present study) are needed to better study the question. Finally, when driven by GCMs (Fig. 14), RCM skill globally tends to decrease regardless of the region but their “ranking” does not change. Even surprisingly, the SDII and the R20mm indices remain slightly improved relatively to ERAI ones for most of the RCMs.

6 Conclusion and future work

During recent years, notable progress has been made in understanding WAM dynamics and the related physical processes (e.g. review by Nicholson 2013) as well as its socio-economic stakes (e.g. Moron et al. 2015). Awareness of ongoing climate-change impacts is also growing and, more than ever, adaptation, mitigation and resilience policies need to be developed for the Sahel area. In this context, improved weather/climate information, including simulations, are required and a considerable number of projects (including CORDEX-Africa) have been setup to meet this need. Our study is an attempt to provide a verification of these simulations by addressing one crucial aspect of the WAM field, its intraseasonal variability.

The study combines the daily rainfall and precipitable water to evaluate the RCM CORDEX simulations over the WAM region. Although relevant for the Sahelian weather analysis, PW derived from RCMs has never been analyzed in climatological mode. The evaluation of six RCMs driven by ERAI and by three GCMs (in Appendix) is performed using ERAI and ARC2 verification data. The climatology of observed precipitation and reanalyzed PW confirms previous findings: (1) the 30-mm PW contour is approximately the threshold below which precipitation hardly occurs, (2) the Sahel (12–20°N) is characterized by a sharp PW gradient consistent with a sharp decrease in precipitation northward, (3) even though ERAI has a relatively accurate PW, it fails to capture the summer rain belt position.

Furthermore, RCMs have been evaluated through their simulated seasonal precipitation and PW. This reveals three different tendencies in model behaviors over the Sahel baroclinic zone: (1) models that exhibit a northward bias in the position of the monsoon (e.g. CCLM, RACMO22T, CanRCM4 and, to some extent, HIRHAM5) are too moist over the Sahel and therefore displace the baroclinic zone towards the Sahara; this group of RCMs shows a systematic overly wet monsoon between 10 and 15°N and abnormally humid Sahel between 15 and 20°N; (2) models that exhibit a southward bias in the position of the monsoon (e.g. CRCM5), despite capturing the structure of the baroclinic zone associated PW gradients, keep the rainy belt trapped in southern West Africa (around 10°N) as does ERAI, leading to a relatively dry Sahel; and, finally (3) some models, such as RCA4 that have the merit of representing seasonal structures that are close enough to both ERAI PW and ARC2 rainfall.

Considering the intraseasonal scales, models have been assessed regarding their variance distribution in two intraseasonal subscales, the low-frequency scale (longer than 10-day period) and the high-frequency scale (shorter than 10-day period), which are mainly attributable to synoptic and meteorological events. In terms of PW variability, RCMs tend to overestimate the intraseasonal anomalies over the continental Sahel. More specifically, time scales longer than 10 days make an excessively strong contribution, instead of synoptic scales as shown by ERAI. Over the western coast, most RCMs are able to reproduce high-frequency features mainly due to the westward growing AEW systems. Finally, it appears that, regardless of the region, RCMs skills in reproducing the intraseasonal subscales decrease when they are driven by GCMs instead of ERAI.

Furthermore, the study investigates the frequency-time distribution of rainfall predicted by RCMs through spectrum analysis. The 2009 summer season, characterized by intense rainfall in September and an associated flooding event, is examined in the light of ARC2 wavelet analysis and illustrates two aspects: (1) the poor representation of ERAI regarding the shorter scale events, leading to a relatively flat precipitation time series, and (2) in RCMs, the relative excess of high-frequency activity, despite low-frequency activity being overestimated. The analysis of the whole period (1989–2008) allows the 2009 summer case results to be generalized to RCMs, which tend to improve the representation of synoptic scales within the whole intraseasonal spectrum by increasing the presence of very short time scales (<3 days). Such scales are influenced by the well-known MCSs (or SLs), usually embedded in AEWs or sometimes generated more locally when surface conditions are favorable. The interactions between MCSs and AEWs are complicated by the fact that, while being closely related, they occur at different time and space scales. The analysis implies that RCMs partly resolve this critical issue even though some improvements are still needed.

The last part of the study focuses on the evaluation of daily precipitation indices related to the occurrence, intensity and persistence of rainfall, and on the monsoon onset/retreat. The one-moment indices (JJAS mean rainfall, wet days) are relatively well calculated by ERAI, and RCM simulations are more or less similar to ERAI depending on whether the continental or the coastal region is considered. When higher-order indices are used (SDII or R20mm), the skills of both observations and simulations decrease drastically, revealing the difficulty of representing the occurrence and duration of intense events. Nevertheless, the statistics from RCMs are relatively better, in general, than those from ERAI. This result is consistent with the scales analysis that highlights the inability of ERAI to capture individual meteorological events, namely the MCSs responsible for moderate to heavy rainfall.

A recent review by Di Luca et al. (2015) on the added value of RCMs pointed out a real difficulty in defining and deriving their added values. Regarding the Sahelian context, we believe that the present paper proposes an interesting way of assessing, at least qualitatively, the added value of RCMs relatively to coarser (or less resolved) model simulations. From our study and reviews of previous literature, the main successes (+) and challenges (–) of the RCM approach can be summarized as:

  1. 1.

    The mean state:

    1. (+)

      The seasonal mean state of the WAM precipitation is improved (in comparison with reanalyses and GCMs) and systematic biases are reduced due to a better representation of monsoon fluxes and interactions with diverse land surfaces.

    2. (–)

      There are still some important biases over the northern flank of the Sahel (north of 15°N), the southern Guinea ocean-continent border and the topographic areas where smaller/local scale processes seem to play an important role.

  2. 2.

    The intraseasonal scales:

    1. (+)

      The intraseasonal spectrum is better resolved through more important temporal and spatial variability of rainfall. The 1–10 day scale phenomena such as AEWs and the related convective activity have more realistic impact on the shape of the spectrum.

    2. (–)

      Like ERAI, RCMs still overestimate the low-frequency (10–90-day) activity and this has the effect of artificially increasing the intraseasonal variability in general. In addition, the well-known separation of the “short” intraseasonal scale (10–25-day) and the “long” one (25–60-day) does not appear clearly. This implies, for instance, that RCMs would hardly capture the MJO effects over the WAM region.

  3. 3.

    The WAM onset/retreat:

    1. (+)

      Two RCMs really improve the simulation of the local onset. Interestingly, it is found that a good representation of the energy balance between low-frequency/high-frequency, rather than a good seasonal mean structure, leads to a remarkably good onset structure. The monsoon retreat is handled pretty well by the majority of RCMs.

    2. (–)

      Consistently, because of exaggeration of the impact of low-frequencies, some RCMs completely misrepresent the meridional structure of the onset, leading to unrealistic occurrence dates.

  4. 4.

    The daily precipitation indices:

    1. (+)

      In comparison with ERAI (comparison with GCMs is still needed), RCMs tend to predict the occurrence and intensity of moderate to high precipitation events better. This appears to be related to the improvement of meteorological scale phenomena (e.g. MCSs).

    2. (–)

      ERAI outperforms all RCMs in terms of wet day occurrence and seasonal mean precipitation correlation. This result was to be expected since RCMs could hardly capture the chronology of meteorological events.

In a context of climate change, a growing number of applications are expected to favor the development of adaptation strategies and mitigation policies. For the Sahel, many issues hinge on the quality of the monsoon prediction and thus of its intraseasonal activity over the current and future periods. This study lays the basis for understanding such aspects starting from RCM historical simulations. Future work will be directed toward answering two parallel questions: (1) How (and why) do RCMs represent the intraseasonal variability of the WAM according to the different climate scenarios? (2) Which aspects of RCM physics and/or dynamics can be improved to reduce the impact of low-frequency timescale biases on the intraseasonality of the monsoon? In line with some recent works (e.g. Diallo et al. 2012, Vizy et al. 2013), these aspects will be considered in further studies by means of an ensemble of RCM runs using various combinations of RCM/GCM downscaling over the WAM area. As implied in this study, those further works will need substantial analysis of physical processes at meteorological scales, as it is crucial to resolve this scale well for any climatological application.