Improving prediction of two ENSO types using a multi-model ensemble based on stepwise pattern projection model

This study focuses on improving prediction of the two types of ENSO by combining multi-model ensemble (MME) with a statistical error correction method that is based on a stepwise pattern projection and applied to all models before doing the MME. We evaluate such a combinational approach using five dynamical model datasets from the North American Multi-model Ensemble (NMME) project for the period of 1982–2010. The prediction skills of the proposed MME show an improvement over most tropical Pacific regions. With regard to the two ENSO types, improvements in prediction skills of the proposed MME are particularly evident for the Niño indices for short lead time. The differences between the Eastern Pacific and Central Pacific ENSO types are more pronounced in the corrected forecasts compared with the uncorrected ones. The zonal center position of sea surface temperature anomalies for the corrected MME is closer to the observed than that for the uncorrected MME. The results indicate that reducing prediction errors of each model member by a good correction method before applying the MME method can provide an effective way for empirically improving forecasts of the two ENSO types.


Introduction
El Niño-Southern Oscillation (ENSO) is the most pronounced climate phenomena in the tropical Pacific with a sustained period of warming and cooling in sea surface temperatures (SST) in the central and east-central equatorial Pacific. As the dominant mode of natural climate variability, it has a major impact on the global climate and particularly the East Asian climate variability (e.g., Brönnimann 2007; Rasmusson and Carpenter 1982;Zhang et al. 1996;Zhai et al. 2016). A successful ENSO prediction can offer decision-makers with an opportunity to take the anticipated climate anomalies into account, which potentially help to reduce the social and economic losses induced by this natural phenomenon. Many studies showed that coupled atmosphere-ocean general circulation models (CGCMs) has become a powerful tool for ENSO prediction. However, it still remains challenging to predict the two ENSO types due to model biases and other deficiencies (Yu and Kim 2010;Ham and Kug 2012).
A large amount of evidence indicates that there exist two flavors of ENSO events in the tropical Pacific ; Kao and Yu 2009;Kug et al. 2009;Larkin and Harrison 2005a), with distinctly different climate impacts (e.g., Hegyi et al. 2014;Hegyi and Deng 2011;Kim et al. 2009;Wang and Wang 2014;Weng et al. 2007;Zhang et al. 2012;Zhang et al. 2011). In contrast to the canonical ENSOs featured by SST anomalies in the eastern Pacific, the noncanonical types are featured by SST anomalies centered in the equatorial central Pacific (e.g., Ashok et al. 2007; Kao and Yu 2009;Kug et al. 2009; Jin 2011, 2013;Wang and Ren 2017;Weng et al. 2007;Xiang et al. 2013). This non-canonical type is alternatively referred to as dateline El Niño (Larkin and Harrison 2005a), El Niño Modoki Weng et al. 2007), CP El Niño (Kao and Yu 2009), and warm-pool El Niño ). In this study, we adopt the terminology of the EP and CP ENSO to describe the two types.
In recent years, major advancements have been made in examining the typical features and mechanisms of the two ENSO types (Yeh et al. 2014 and references therein). Many previous studies revealed that the CP-type of El Niño has become more frequent since the late 1970s ; Kao and Yu 2009;Kug et al. 2009;Larkin and Harrison 2005a, b;Ren and Jin 2013), and the frequency tends to increase under a warming climate (Yeh et al. 2009). Large amounts of international studies have also focused on the prediction assessments and predictability for the two ENSO types using single models and multi-models (e.g., Hendon et al. 2009;Imada et al. 2015;Jeong et al. 2012;Lee et al. 2017;Ren et al. 2019a;Yang and Jiang 2014). Their studies indicated that the CP ENSO may be more difficult to predict due to their smaller amplitude (Imada et al. 2015;Zhu et al. 2015), even though they tend to possess longer persistence or a weaker persistence barrier than the EP ENSO (Kim et al. 2009;Ren et al. 2016;Tian et al. 2019). Barnston et al. (2012) pointed out that the prediction skill of ENSO experienced a clear interdecadal decline since the 2000s and that the major factor causing such a decline in prediction skill is related to the ENSO diversity. Most dynamical models have difficulty in capturing the typical observed features of the two ENSO types (e.g., Yu and Kim 2010). Therefore, exploring how to improve the performance of the climate models in distinguishing the two types of ENSO is essential for further improving seasonal climate predictions (e.g., Ren et al. 2019a).
Together with increased understanding of the ENSOrelated physical processes, numerous efforts have been made to improve ENSO predictions (e.g., Cane et al. 1986;Chen et al. 1995Chen et al. , 2004Cheng et al. 2010;Ham et al. 2009;Izumo et al. 2010;Kang and Kug 2000;Liu and Ren 2017;Luo et al. 2005Luo et al. , 2008Ren et al. 2014;Zebiak and Cane 1987;Zheng et al. 2006;Zhu et al. 2012Zhu et al. , 2017. Among them, applying post-processing procedures is one way that has been proposed in the past decades, e.g., the multi-model ensemble (MME) technique (Barnston et al. 2003;Palmer et al. 2004Palmer et al. , 2010Wang et al. 2009;Kirtman et al. 2014) and the statistical error correction (or downscaling) method (e.g. Anthony et al. 2015;Latif et al. 1998;Luo et al. 2008;Zhang et al. 2003), which have been demonstrated to be able to reduce the uncertainty of coupled models.
As an effective and relatively simple approach, MME combines various dynamical predictions, which differ in their representations of physical processes, in their numerical schemes, or in their use of observations to construct initial conditions. The model errors contained in individual models are expected to cancel each other (DelSole et al. 2014;Hagedorn et al. 2005;Tippett and Barnston 2008). As a result, MME prediction systems are currently utilized at several operational centers that routinely provide MME seasonal forecasts, among which the most popular and frequently viewed project is the North American Multi-model Ensemble (NMME) project (Kirtman et al. 2014). The NMME is a collaboration project from US modeling centers and the Canadian Meteorological Centre (CMC), aimed at improving subseasonal-to-seasonal prediction capability (Kirtman et al. 2014). Furthermore, the NMME project has proven effective at forecasting ENSO and its relevant climate variables (Kirtman et al. 2014). Hence, the hindcast datasets from the NMME system are used in this work. Ren et al. (2019a) found that the MME has a limited ability to predict the different zonal positions of SST anomaly centers between the two types, despite considerable successes in prediction skill of the Niño indices. As another promising approach, empirical or statistical correction methods have been widely used in climate prediction (Feddersen et al. 1999;Graham et al. 1994;Kang et al. 2004;Kug et al. 2004Kug et al. , 2007bKug et al. , 2008aRen et al. 2014;Sailor and Li 1999;Von Storch et al. 1993;Ward and Navarra 1997;Zorita et al. 1995;Zorita and Von Storch 1999). Based on a pattern projection model (Kug et al. 2007b), Kug et al. (2008a) proposed a Stepwise Pattern Projection Model (SPPM) that effectively improved the prediction skill of Seoul National University (SNU) coupled GCM. The main idea of the SPPM is to produce a prediction at the predictand grid by projecting the predictor field onto its covariance pattern with the one-point predictand after selecting the predictor domain. The SPPM combined with MME method has been successfully applied to the seasonal prediction (Kug et al. 2008b;Min et al. 2014).
As previously mentioned, the current generation of climate models has a limited capability of reproducing the typical observed features of the two ENSO types. However, in comparison to the number of studies on prediction of the canonical ENSO, relatively few studies have been conducted to improve the skill of the dynamical models in predicting the two ENSO types. Therefore, we aim at carrying out an effective method by combining the SPPM and MME technique to improve the predictions of two types of ENSO. The prediction skill of the combinational method will compare against the uncorrected MME and individual models. The data and MME methodologies used are described in Sect. 2. The results of MME predictions using four different MME schemes are presented in Sect. 3. Section 4 gives a brief summary and discussion.

Hindcast datasets
The NMME has been launched in the United States (Kirtman et al. 2014), with real-time experimental operational forecasts made at National Oceanic and Atmospheric Administration (NOAA)/National Centers for Environmental Prediction (NCEP) starting in August 2011. In this study, we select five models from the NMME (Becker et al. 2014;Kirtman et al. 2014), including Climate Forecast System, version 2 (CFSv2; Saha et al. 2006Saha et al. , 2014, the Forecast-Oriented Low Ocean Resolution (FLOR) version of Geophysical Fluid Dynamics Laboratory (GFDL) Climate Model (Delworth et al. 2006;Vecchi et al. 2014), 2.1 version of GFDL (Delworth et al. 2006) and Community Climate System Model, version 4 (CCSM4; Danabasoglu et al. 2012). All hindcasts and the climatology are based on the period of 1982-2010. The predicted anomalies are derived by subtracting climatology which are a function of both initial condition and lead time, and no additional time smoothing is applied. At different calendar months and lead time, the predicted anomalies are derived by subtracting their corresponding climatology. The number of ensemble member ranges from 10 to 24 and descriptions for each prediction model are given in Table 1. Since each prediction model has several ensemble members, the ensemble mean of each model is taken. Using the five different SST predictions, the final SST prediction is made by an ensemble mean.

Observational dataset
For validation, the SST datasets used are the observed monthly mean from the Improved Extended Reconstructed Sea Surface Temperature version 3b (ERSST v3b) (Smith et al. 2008;Smith and Reynolds 2004) produced by the National Centers for Environmental Information (NCEI). Observational anomalies in this paper are calculated from the climatology during the period of 1982-2010. For comparison purpose, the ensemble mean prediction of each model is interpolated to a common 2° latitude × 2° longitude grid.

Stepwise pattern projection model (SPPM)
In this study, we employ the SPPM to correct the systematic errors in each model before applying the MME method. The leave-one-out cross validation process is used. The data at the target year are completely excluded in the cross-validation process. The main idea of the SPPM is to produce the corrected SST prediction at each grid by projecting the model prediction field onto the covariance pattern between the large-scale model prediction field and the one-point observed predictand (Kug et al. 2008a). The predictand is the observed SST at each grid point, indicated by Y(t). The predictor is an SST pattern of model variable in an optimal domain, denoted by Ψ (x, y, t), where x denote the east-west longitude grids, y denote north-south latitude grids and t denote temporal grids, respectively.
The optimal predictor domain (D), whose selection plays a crucial role in the SPPM, can be automatically selected by calculating correlation coefficients between a predictand and the two-dimensional candidate predictors. Among all possible predictor grid points, the grid points having a relatively high correlation are selected as the optimal predictor grid points. First of all, only grids with correlation more than 0.95 are used as a reconstructed domain. When the grid number of the first group is less than 200 grid points, the grids with correlation more than 0.9 are also included as a reconstructed domain, and so on. If the grid numbers are not enough in spite of using all the grids with correlation more than 0.3, the corresponding climatological value of the model will be used as a final prediction. The selected grid points can be located in several regions. As a result, the reconstructed domain is regarded as a predictor domain (D). In this study, the whole global SST anomalies are used to search the optimal predictor domain.
Using the selected predictors, a corrected prediction can be produced based on the SPPM. Firstly, a linear regression prediction model is established as where P indicates a projected time series from the covariance pattern and model prediction Ψ(x, y, t) as: The Cov(x,y) is the covariance pattern between the predictand Y(t) and predictor field Ψ(x, y, t) with in the predictor domain (D), as follow: where, T indicates a training period. The covariance pattern indicates a pattern of the model prediction which is related to the observed predictand. With the change of predictand grid, the covariance pattern will be different. The regression coefficient of Eq. (1), α, can be expressed as The result of the corrected model prediction Ŷ for target year, t f , is indicated as For more details on the SPPM procedure, one may refer to Kug et al. (2008a).
After applying SPPM, the final SST prediction is made by equal weighting ensemble method, called "corrected MME". As a comparison, the mean SST anomalies of each model without statistical correction procedure are also averaged and called "uncorrected MME".

Niño indices for two types of ENSO
The Niño4, Niño3.4, and Niño3 indices are calculated by averaging SST anomalies in the regions (5° S-5° N, 150° W-160° E; 5° S-5° N, 120°-170° W; and 5° S-5° N, 90°-150° W, respectively). To measure the two ENSO types, the Niño warm-pool index (NiñoWPI) and Niño cold-tongue index (NiñoCTI) as proposed by Ren and Jin (2011) have been used to represent the CP and EP types, respectively. The two new indices are simply a piecewise combination of the Niño3 and Niño4 indices conditioned by the ENSO phase. The formula is as follows: Here, N 3 and N 4 denote Niño3 and Niño4 indices, respectively. The parameter α of this formula is determined by a minimization procedure to make the apparent clusters along the indicated diagonal centered on the transformed coordinate axes as much as possible. The clusters mentioned above are the points of WP El Niño and CT El Niño in the phase space of the Niño3 and Niño4 indices. α of the observation is set to 2/5 as shown in Eq. (6), which is consistent with the study of Ren and Jin (2011). For each uncorrected and corrected model, α is determined by such a minimization procedure, respectively. For detailed description of the procedure, one may refer to Jin (2011, 2013).

Prediction skills of the El Niño
To quantitatively present how well the SPPM improves the performance of SST predictions, the spatial distributions of temporal correlation coefficients (TCC) between observed SST anomalies and predicted SST anomalies for lead times of 4 months are presented in Fig. 1. As expected, positive correlations are found almost throughout the Pacific oceans and the high correlation regions are generally located in the central equatorial Pacific. The uncorrected individual models exhibit correlations > 0.6 over the tropical Pacific (10° S-10° N, 165° E-90° W), but the correlations are difficult to reach 0.8. The uncorrected MME has marginally better skill than those individual models, with the correlations > 0.8 covering a small area. The corrected predictions perform better than corresponding uncorrected ones, especially the corrected MME, as they show the largest areas where correlations > 0.8 in the ENSO region. The area-averaged skill over the equatorial Pacific domain between 15° S and 15° N is 0.53 (0.67), 0.59 (0.65), 0.51 (0.66), 0.55 (0.65), 0.58 (0.67) for the five uncorrected (corrected) models and 0.63 (0.70) for the uncorrected MME (corrected MME), respectively. The TCC increments of the corrected prediction over the uncorrected prediction are significant over central Pacific. Besides, it is clear that the positive increments of the correlations are much larger in the vicinity of western equatorial Pacific for CM2p1_a and CM2p1. Note that significant negative correlations are found in the same region from TCC map, which may come from the westward shift biases of ENSO anomalies. The corrected MME improve the TCC skills over western equatorial Pacific regions. The TCC skills of the uncorrected MME are maintained at around 0.2 while the corrected MME are maintained at more than 0.5, indicating that the corrected MME can provide a greater capacity of error correction. Figure 2 gives the correlation coefficients of Niño3.4 index as a function of lead time, which are widely used in the verification of ENSO prediction skill (Barnston et al. 1997). It can be seen that the correlation coefficients of all . 1 Spatial patterns of temporal correlation coefficients of the uncorrected individual models (a-e), uncorrected MME (f), corrected individual models (g-k), and corrected MME (l) at 4-month lead as well as the difference between corrected and uncorrected results (mr), respectively. Black dots denote confidence levels greater than 99% the uncorrected individual models are above 0.6 at 6-month lead time but no one exceeds 0.7. The uncorrected MME exhibits a relatively reliable prediction skill with the correlation coefficient above 0.7 at the 6-month lead time, showing a slightly better skill level than the uncorrected individual models. This agrees with the results that multi-model forecasts are generally more skillful than single-model forecasts (Krishnamurti et al. 1999;Kharin and Zwiers 2002;Palmer et al. 2004;Jan van Oldenborgh et al. 2005;Kug et al. 2007a). Whereas, it is difficult for the uncorrected MME to exceed the skill of the SPPM. Correlation coefficients for most of the corrected individual models are consistently higher than those from the uncorrected MME forecasts for most lead months. The red solid line is for the corrected MME with a correlation coefficient of 0.8 at 6-month lead and over 0.7 for up to a 9-month lead time. It is clear that the corrected MME outperforms any of the corrected individual models and the uncorrected MME in forecasting Niño3.4 SST for all lead months. The Niño 3.4 skill score for the corrected MME increases by more than 11% on average compared with the uncorrected MME, and more than 24% on average compared with the CM2p1_a (the worst one), during all lead months. Figure 3 illustrates the changing of the Niño 3.4 index skill scores with the initial months. It is encouraging to see that the skill scores at nearly all the initial and lead months are increased by applying the SPPM and MME.
The corrected MME has a significantly high skill, with correlation score of around 0.9 for 9-month lead initialized in June (Fig. 3a). As we know, the prediction skill of ENSO always experiences a more obvious decline during boreal spring than during other seasons, which is referred to as the spring predictability barrier (e.g., Webster and Yang 1992;McPhaden 2003;Duan et al. 2016a, b). Although the skill still drops sharply during springtime for the corrected MME, the barriers are visibly much stronger for the uncorrected MME (Fig. 3b). To clearly show the skill improvement of the corrected MME, the skill differences between the corrected forecasts and uncorrected forecasts are illustrated in Fig. 3c-h. It shows that the skills of the corrected forecasts are consistently higher than those for the uncorrected forecasts, with the improvements seen on most lead months and initial months. In particular, the target month with a significant improvement usually occurs in spring and winter of the next year, indicating that the increased skills of the corrected MME can be attributed to a weakening of the spring barriers.

Prediction skills of the two types of ENSO
In this section, we will comprehensively assess the effectiveness of the SPPM and MME in improving predictions of the two types of ENSO. Figure 4 shows the TCC skill scores in term of the (a) Niño3, (b) Niño4, (c) NiñoCT and (d) NiñoWP indices from the corrected and uncorrected individual models. The skill scores feature a gradual decline with increasing lead months for all the Niño indices. Both Niño3 and NiñoCT indices, which are sometimes used to represent the EP type, show higher TCC skill in corrected models at all lead months, except that FLOR_B and CCSM4 remain higher skill than the uncorrected models within 5 lead months. For Niño4 SST prediction, each corrected model presents significant superiority over uncorrected one. The NiñoWP index shows relatively lower skills compared to the other indices. For NiñoWP SST prediction, the corrected FLOR_B and CCSM4 have comparable skills with their uncorrected ones, while other corrected models have higher skills at lead month up to 5 months. The NiñoWPI skill for the uncorrected models decreases fast at short lead months. When lead time is longer than 2 months, it is hard for the corrected models to beat the skill of the uncorrected models as the lead time gets longer. In general, however, the SPPM can significantly contribute to the skills of the Niño3, Niño4 and NiñoCT and NiñoWP indices for most models and lead months compared to the uncorrected models. We further examine the skill scores in term of the four Niño indices in the uncorrected and corrected MME (Fig. 5). The Niño3 and Niño4 indices show relatively higher skills compared to the other two, which is consistent with the results from Fig. 4. The TCC skill scores of the Niño3 and Niño4 indices in the corrected MME are significantly higher than those for the uncorrected MME at all lead months. Meanwhile, the skill scores are obviously improved for the corrected MME when lead time is less than 6 months for NiñoCT SST prediction, while up to 3-month lead time for NiñoWPI SST prediction. Now we focus on how well the combinational SPPM and MME method can capture the main features of the two types of ENSO. Figure 6 shows the regression patterns of observed SST onto normalized observational NiñoCTI and NiñoWPI, and those for the model hindcasts are given in Figs. 7 and 8. The observed patterns clearly present that the magnitude of the SST anomalies tends to be weaker during CP ENSO compared to EP ENSO. The EP ENSO exhibits significant anomalous SST warming in the central and eastern equatorial Pacific, while the CP ENSO show obvious SST anomalies only existing in the central Pacific.
The regression patterns of predicted SST anomalies on the normalized NiñoCTI for the 4-month lead are shown in Fig. 7. Compared with the observed patterns (Fig. 6), all the uncorrected forecasts capture the general features in the eastern and central Pacific, but some of them tend to produce stronger-than-observed warm SST anomalies over central Pacific. The uncorrected models from GFDL (Figs. 7b, d, f) extend positive anomalies westwards to 150° E while the observational limit it around 170° E. A similar discrepancy to observations is found in the uncorrected MME. In addition, although most of the uncorrected models well simulate positive anomalies center in central Pacific, they fail to depict the maximum positive anomalies observed near the . 3 The TCC skill scores of the Niño3.4 index as a function of lead month (x-axis) and initial month (y-axis) for the MMEs (a, b), and the TCC differences between corrected forecasts and uncorrected forecasts (c-h) east boundary of the equatorial pacific. As for the forecasts from the corrected models, though the amplitudes of the SST anomalies are slightly overestimated in the eastern Pacific, the spatial range of positive anomalies and the location of the positive value center are highly consistent with those in the observed pattern. Compared to the forecasts from the uncorrected models, it is clearly seen that the corrected models generally better capture the features of EP ENSO, with most pattern correlation coefficients (PCCs) are generally higher in the corrected models. Figure 8 shows the regression patterns on the normalized NiñoWPI. The SST anomalies from model hindcasts are generally weaker in the CP ENSO than in the EP ENSO, agreeing well with the observations. However, almost all the results (Fig. 8) have bias in overestimating the magnitudes of SST anomalies related to CP ENSO and exhibiting warming SST anomalies extending to the eastern boundary, particularly the uncorrected CM2p1_a and uncorrected CM2p1. This may be due to the influence of the model EP events whose SST anomalies remain strong in this region. It is also obvious that the locations of the maximum SST anomalies from the uncorrected CM2p1_a, CM2p1 and the uncorrected MME exist to the east of the observed center. The other uncorrected models show a maximum over the central Pacific. In comparison, the positive value centers from the corrected models are closer to the observed center. This conclusion can be seen more clearly in Fig. 9 when we extract main longitudinal center positions of the two types. Furthermore, a comparison between Figs. 7 and 8 show that the uncorrected CM2p1_a and CM2p1 fail to depict the differences between CP ENSO and EP ENSO. In contrast, the ability of the corrected models to distinguish the patterns of the two types is significantly higher than that of the uncorrected models.
In addition, Fig. 9 presents the center longitude index (CLI, proposed by Ren et al. 2019a) that is defined as the longitude where the amplitude of equatorial-mean (5° S-5° N) SST anomalies reaches maximum, which collectively contrasts the center positions of the SST anomaly patterns as shown in Figs. 6, 7 and 8 for the regressed EP and CP ENSO patterns. Since many models have common biases in exaggerating positive values near the eastern boundary, Fig. 4 The TCC skill scores of Niño3, Niño4, NiñoCT, and NiñoWP indices in the uncorrected individual models (dashed line), and corrected individual models (solid line), based on the cross validations during 1982-2010 the centers that appear east of 90° W have been ignored. In observation, the SST center of the EP type is steadily located west of 105° W and that of the CP type is east of 168° W. In Fig. 9a, almost all of the models show maximum SST anomalies to the west of the observed maximum. It is interesting to see that the uncorrected MME is one of the forecasts farthest from the observed. Thus, we may conclude that the MME method has a limit ability to distinguish the two types in terms of their center positions, which is consistent with the result of Ren et al. (2019a).
After the correction, almost all of the models have center positions closer to the observed compared to the uncorrected results, except that CFS_v2 shows a strong eastward shift while the uncorrected CFS_v2 has a clear westward displacement. Still, the corrected MME is not the best one among the corrected ones, but the center positions of the corrected MME is closer to the observed center than that in the uncorrected MME. For the CP type, both the uncorrected CCSM4 and CFS_v2 have positions close to the observed while the other models show a clear eastward displacement, especially the CM2p1_a, CM2p1 and the MME with lead time ranging from 1 to 5 months. Similar to the findings from EP type, most models have the position closer to the observation after the correction, except for CFS_v2. Comparing the two MME, the center position from the corrected MME is much closer to the observed. Therefore, we conclude that the MME after the error correction has an advantage in predicting the locations of the SST centers in term of the two types of ENSO.

Summary and discussions
Successful ENSO prediction will help decision makers to reduce the social and economic loss. However, ENSO prediction is still far from perfect. The decline in prediction skill of ENSO is believed to be related to the increased occurrences of CP-type ENSOs. Therefore, it is essential to improve the predictions of the two types of ENSO. In this paper, the five models from the NMME are used to construct an MME prediction together with a statistical error correction method (SPPM) for all the models. The prediction skills of the combinational method show an improvement over most regions and lead times. The MME after the correction also has an advantage in distinguishing the patterns between the two types of ENSO.
To assess the value of the combinational method, the prediction skill of the corrected MME has been compared with the uncorrected MME and single models. We evaluated the spatial distribution of the TCCs between the predicted and observed SST anomalies. It shows that the corrected MME always has the highest prediction skill over the tropical Pacific. Increased skill suggests that the corrected MME can effectively eliminate prediction errors, particularly over the equatorial western Pacific where some individual models have serious biases. The results of Niño3.4 index skill indicate that the corrected MME is generally more skillful at most initial and lead months. Compared with the uncorrected MME, the averaged skill for the corrected MME has increased by more than 11%. Although the corrected MME still features a spring predictability barrier, it achieves more significant improvements over the uncorrected MME for the target months in spring. This suggests that its spring predictability barrier appears to be much weaker than the uncorrected MME and single models.
We examined the ability of the SPPM-MME combined procedure to improve prediction of the two types of ENSO. The SPPM can significantly contribute to the skills of the Niño indices in terms of the CP ENSO and EP ENSO for most models and lead months, indicating that the SPPM has the potential to increase prediction skill for the two ENSO types, which are currently difficult to be simulated adequately in climate models. Further analysis shows that the corrected MME has a great advantage in improving the skills for the Niño3 and Niño4 indices at all lead months, and for the NiñoWPI and NiñoCTI at short lead time compared to the uncorrected MME.
The regression analysis has been used to evaluate spatial differences between the two types of ENSO in the forecasts and we found significant differences among the uncorrected models. For the EP ENSO, some of the uncorrected . 7 Regression patterns of the predicted seasonal SST anomalies from uncorrected forecasts (left) and corrected forecasts (right) at 4-month lead on the normalized NiñoCTI. Blue dots denote the SST anomaly center longitudes where the amplitude of equatorial-mean (5° S-5° N) SST anomaly reaches maximum. Black numbers on right top of panels are pattern correlation coefficients (PCCs) between the model patterns and the corresponding observation pattern models overestimate the magnitude of the SST anomalies and some of the models have a bias in extending the anomalies westward to 150° E while the observations limit extension around 170° E. Almost all of the uncorrected models have failed to reproduce the maximum anomalies around western boundary of equatorial Pacific. However, the center location, the range and magnitude of SST anomalies in the corrected forecasts are highly consistent with the observed. For the WP ENSO, the results from both the corrected and uncorrected forecast have a bias in exhibiting SST anomalies extending eastwards to the eastern boundary. The SST patterns of the corrected models are better than the uncorrected ones, with most PCCs higher in the former. In general, the differences between the two types are more pronounced in the corrected forecasts compared with the uncorrected forecasts. We also focused on the center positions of the SST anomalies. Almost all of the uncorrected models show maximum SST anomalies to the west of the observed maximum for the EP type and a clear eastward displacement for the CP type at short lead months. The corrected forecasts have center positions closer to the observation compared with the uncorrected ones, except for CFS_v2. In addition, we noted that though the corrected MME is not the best one among the corrected forecasts, the center positions of the corrected MME is much closer to the observed center than that of the uncorrected MME. From the aforementioned results, we demonstrate that the corrected MME has the potential to effectively correct ENSO prediction. In this study, it is difficult for the uncorrected MME to exceed the skill of the SPPM at most lead months, which indicates that it is insufficient to improve realistic ENSO prediction only by the MME method. Moreover, our results are consistent with the previous study (Ren et al. 2019a), where the MME method has no evident contributions to distinguishing the two types in terms of their center positions. However, the ability of distinguishing the two types in majority of models can be improved by the SPPM. Therefore, the SPPM-MME combination method can empirically improve the performance of the climate models in reproducing the differences between the two ENSO types. In general, the corrected MME provides an effective way of empirically improving ENSO forecasts, particularly with regard to forecasts of the two ENSO types. Also, it is of interest that patterns of all models for the CP type have a small positive territory in the eastern Pacific compared to the observed. Further improvement of a dynamical model itself is still required. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.