Skip to main content

Advertisement

Log in

Model performance metrics and process diagnostics for boreal summer intraseasonal variability

  • Published:
Climate Dynamics Aims and scope Submit manuscript

Abstract

Representation of the boreal summer intraseasonal oscillations (BSISO) is evaluated in the 20-year climate simulations from 27 general circulation models (GCMs), produced as part of a global multi-model evaluation project coordinated to study the vertical structure and physical processes of the Madden–Julian oscillation (MJO). Model performance metrics are developed to assess the simulated BSISO characteristics, with a special focus on its northward propagation over the Asian monsoon domain. Several process-oriented diagnostics developed by the MJO community are also tested for the BSISO. Simulating the phase speed and meridional extent of BSISO northward propagation, the northwest–southeast tilted rain-band structure and the quasi-biweekly mode are identified as some of the persisting problems for many GCMs. Interestingly, many of the GCMs, which capture BSISO eastward propagation, also show good fidelity in simulating BSISO northward propagation. Meridional vertical profiles of anomalous wind, temperature and diabatic heating of BSISO are better simulated in the GCMs that simulate the northward propagation. Process-oriented diagnostics based on seasonal mean vertical shear of zonal and meridional wind, large-scale rain fraction and relative humidity are also examined, but it still remains challenge to find a process diagnostic which is strongly linked to BSISO northward propagation. The complex spatial structure and presence of multi-scale disturbances, demand the development of more focused GCM evaluation metrics and process diagnostics specifically for the BSISO.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Notes

  1. https://www.earthsystemcog.org/projects/gass-yotc-mip/.

References

  • Abhilash S, Sahai AK, Pattanaik S, Goswami BN, Kumar A (2014) Extended range prediction of active-break spells of Indian summer monsoon rainfall using an ensemble prediction system in NCEP climate forecast system. Int J Climatol 34:98–113

    Article  Google Scholar 

  • Annamalai H, Slingo JM (2001) Active/break cycles: diagnosis of the intraseasonal variability of the Asian summer monsoon. Clim Dyn 18:85–102

    Article  Google Scholar 

  • Annamalai H, Sperber KR (2005) Regional heat sources and the active and break phases of boreal summer intraseasonal (30–50 day) variability. J Atmos Sci 62:2726–2748

    Article  Google Scholar 

  • Bechtold P, Kohler M, Jung T, Doblas-Reyes F, Leutbecher M, Rodwell MJ, Vitart F, Balsamo G (2008) Advances in simulating atmospheric variability with the ECMWF model: from synoptic to decadal time-scales. Q J Meteorol Soc 134:1337–1351

    Article  Google Scholar 

  • Bellon G, Sobel A (2008a) Poleward-propagating intraseasonal monsoon disturbances in an intermediate-complexity axisymmetric model. J Atmos Sci 65:470–489

    Article  Google Scholar 

  • Bellon G, Sobel A (2008b) Instability of the axisymmetric monsoon flow and intraseasonal oscillation. J Geophys Res 113:D07109. doi:10.1029/2007JD008968

    Article  Google Scholar 

  • Benedict JJ, Randall DA (2007) Observed characteristics of the MJO relative to maximum rainfall. J Atmos Sci 64:2332–2354

    Article  Google Scholar 

  • Bessafi M, Wheeler MC (2006) Modulation of south Indian ocean tropical cyclones by the Madden–Julian oscillation and convectively coupled equatorial waves. Mon Weather Rev 134:638–656

    Article  Google Scholar 

  • Bollasina M, Ming Y (2013) The general circulation model precipitation bias over the southwestern equatorial Indian Ocean and its implications for simulating the South Asian monsoon. Clim Dyn 40:823–838

    Article  Google Scholar 

  • Boos WR, Kuang Z (2010) Mechanisms of poleward propagating, intraseasonal convective anomalies in cloud system-resolving models. J Atmos Sci 67:3673–3691

    Article  Google Scholar 

  • Bretherton CS, Peters ME, Back LE (2004) Relationships between water vapor path and precipitation over the tropical oceans. J Clim 17:1517–1528

    Article  Google Scholar 

  • Chatterjee P, Goswami BN (2004) Structure, genesis and scale selection of the tropical quasi-biweekly mode. Q J R Meteorol Soc 130:1171–1194

    Article  Google Scholar 

  • Chattopadhyay R, Goswami BN, Sahai AK, Fraedrich (2009) Role of stratiform rainfall in modifying the northward propagation of monsoon intraseasonal oscillation. J Geophys Res 114:D19114

    Article  Google Scholar 

  • Dee DP et al (2011) The ERA-interim reanalysis: configuration and performance of the data assimilation system. Q J R Meteorol Soc 137:553–597

    Article  Google Scholar 

  • DeMott CA, Stan C, Randall DA (2013) Northward propagation mechanisms of the boreal summer intraseasonal oscillation in the ERA-interim and SP-CCSM. J Clim 26:1973–1992

    Article  Google Scholar 

  • Drbohlav H-K, Wang (2005) Mechanism of the northward-propagating intraseasonal oscillation: insights from a zonally symmetric model. J Climate 20:952–972

    Article  Google Scholar 

  • Fu X, Wang B, Li T, McCreary JP (2003) Coupling between northward-propagating, intraseasonal oscillations and sea surface temperature in the Indian Ocean. J Atmos Sci 60:1733–1753

    Article  Google Scholar 

  • Gleckler PJ, Taylor KE, Doutriaux C (2008) Performance metrics for climate models. J Geophys Res Atmos 113:D06104

    Article  Google Scholar 

  • Goswami BN (2005) South Asian monsoon, Chapter 2. In: Lau WKM, Waliser DE (eds) Intraseasonal variability of the atmosphere-ocean climate system. Praxis, Springer, Berlin, pp 19–61

    Chapter  Google Scholar 

  • Goswami BN, Ajaya Mohan RS (2001) Intra-seasonal oscillations and inter-annual variability of the Indian summer monsoon. J Clim 14:1180–1198

    Article  Google Scholar 

  • Goswami BN, Ajaya Mohan RS, Xavier PK, Sengupta D (2003) Clustering of synoptic activity by Indian summer monsoon intraseasonal oscillations. Geophys Res Lett 30(8):1431

    Article  Google Scholar 

  • Halder M, Mukhopadhyay P, Halder S (2012) Study of the microphysical properties associated with the monsoon intraseasonal ocsillation as seen from the TRMM observations. Ann Geophys 30:897–910

    Article  Google Scholar 

  • Hendon HH, Liebmann B (1990) The intraseasonal (30–50 day) oscillation of the Australian summer monsoon. J Atmos Sci 47:2909–2924

    Article  Google Scholar 

  • Holloway CE, Neelin JD (2009) Moisture vertical structure, column water vapor, and tropical deep convection. J Atmos Sci 66:1665–1683

    Article  Google Scholar 

  • Houze RA (1982) Cloud clusters and large-scale vertical motions in the tropics. J Meteor Soc Jpn 60:396–410

    Google Scholar 

  • Huffman GJ, Adler RF, Rudolf B, Schneider U, Keehn PR (1995) Global precipitation estimates based on a technique for combining satellite-based estimates, rain-gauge analysis, and NWP model precipitation information. J Clim 8:1284–1295

    Article  Google Scholar 

  • Jiang X, Waliser DE (2008) Northward propagation of the subseasonal variability over the eastern Pacific warm pool. Geophys Res Lett 35:L09814

    Google Scholar 

  • Jiang X, Waliser DE (2009) Two dominant subseasonal variability modes of the eastern Pacific ITCZ. Geophys Res Lett 36:L04704

    Google Scholar 

  • Jiang X, Li T, Wang B (2004) Structures and mechanisms of the northward propagating boreal summer intraseasonal oscillation. J Clim 17:1022–1039

    Article  Google Scholar 

  • Jiang X et al (2009) Vertical heating structures associated with the MJO as characterized by TRMM estimates, ECMWF reanalyses, and forecasts: a case study during 1998/99 winter. J Clim 22:6001–6020

    Article  Google Scholar 

  • Jiang X, Waliser DE, Li J-L, Woods C (2011) Vertical cloud structures of the boreal summer intraseasonal variability based on CloudSat observations and ERA-interim reanalysis. Clim Dyn 36:2219–2232

    Article  Google Scholar 

  • Jiang X et al (2015) Vertical structure and physical processes of the Madden–Julian oscillation: exploring key model physics in climate simulations. J Geophys Res Atmos 120:4718–4748

    Article  Google Scholar 

  • Kang I-S et al (2002) Intercomparison of the climatological variations of Asian summer monsoon precipitation simulated by 10 GCMs. Clim Dyn 19:383–395

    Article  Google Scholar 

  • Kang I-S, Kim D, Kug J-S (2010) Mechanism for northward propagation of boreal summer intraseasonal oscillation: convective momentum transport. Geophys Res Lett 37: L24804

    Article  Google Scholar 

  • Kemball-Cook S, Wang B (2001) Equatorial waves and air–sea interaction in the boreal summer intraseasonal oscillation. J Clim 14:2923–2942

    Article  Google Scholar 

  • Khairoutdinov M, DeMott C, Randall D (2008) Evaluation of the simulated interannual and subseasonal variability in an AMIP-style simulation using the CSU multiscale modeling framework. J Clim 21:413–431

    Article  Google Scholar 

  • Kikuchi K, Wang B (2009) Global perspective of the quasi-biweekly oscillation. J Clim 22:1340–1359

    Article  Google Scholar 

  • Kikuchi K, Wang B, Kajikawa Y (2011) Bimodal representation of the tropical intraseasonal oscillation. Clim Dyn. doi:10.1007/s00382-011-1159-1

    Google Scholar 

  • Kim D, Sobel AH, Maloney ED, Frierson DMW, Kang I-S (2011) A systematic relationship between intraseasonal variability and mean state bias in AGCM simulations. J Clim 24:5506–5520

    Article  Google Scholar 

  • Kim D et al (2014) Process-oriented MJO simulation diagnostic: moisture sensitivity of simulated convection. J Clim 27:5379–5395

    Article  Google Scholar 

  • Klingaman NP, Woolnough SJ (2014) Using a case-study approach to improve the Madden–Julian oscillation in the Hadley Centre model. Q J R Meteorol Soc 140:2491–2505

    Article  Google Scholar 

  • Klingaman NP et al (2015a) Vertical structure and physical processes of the Madden–Julian oscillation: linking hindcast fidelity to simulated diabatic heating and moistening. J Geophys Res Atmos. doi:10.1002/2014JD022374

    Google Scholar 

  • Klingaman NP, Jiang X, Xavier PK, Petch J, Waliser D, Woolnough SJ (2015b) Vertical structure and physical processes of the Madden–Julian oscillation: synthesis and summary. J Geophys Res Atmos. doi:10.1002/2015JD023196

    Google Scholar 

  • Lappen C-L, Schumacher C (2012) Heating in the tropical atmosphere: what level of detail is critical for accurate MJO simulations in GCMs? Clim Dyn 39:2547–2568

    Article  Google Scholar 

  • Lau KM, Chan PH (1988) Intraseasonal and interannual variations of tropical convection: a possible link between the 40–50 day oscillation and ENSO? J Atmos Sci 45:506–521

    Article  Google Scholar 

  • Lau KM, Waliser DE (2011) Intraseasonal variability of the atmosphere-ocean climate system, 2nd edn. Springer, Heidelberg, p 613

    Google Scholar 

  • Lawrence DM, Webster PJ (2002) The boreal summer intraseasonal oscillation: relationship between northward and eastward movement of convection. J Atmos Sci 59:1593–1606

    Article  Google Scholar 

  • Lin J-L et al (2006) Tropical intraseasonal variability in 14 IPCC AR4 climate models. Part I: convective signals. J Clim 19:2665–2690

    Article  Google Scholar 

  • Lin J-L et al (2008) Subseasonal variability associated with Asian summer monsoon simulated by 14 IPCC AR4 coupled GCMs. J Clim 21:4541–4567

    Article  Google Scholar 

  • Madden RA (1986) Seasonal-variations of the 40–50 day oscillation in the tropics. J Atmos Sci 43:3138–3158

    Article  Google Scholar 

  • Madden RA, Julian PR (1972) Description of global-scale circulation cells in tropics with a 40–50 day period. J Atmos Sci 29:1109–1123

    Article  Google Scholar 

  • Madden RA, Julian PR (1994) Observations of the 40–50-day tropical oscillation: a review. Mon Weather Rev 122:814–837

    Article  Google Scholar 

  • Maloney ED, Esbensen SK (2007) Satellite and buoy observations of boreal summer intraseasonal variability in the tropical northeast Pacific. Mon Weather Rev 135:3–19

    Article  Google Scholar 

  • Maloney ED, Hartmann DL (2001) The sensitivity of intraseasonal variability in the NCAR CCM3 to changes in convective parameterization. J Clim 14:2015–2034

    Article  Google Scholar 

  • Maloney ED, Jiang X, Xie S-P, Benedict J (2014) Process-oriented diagnosis of East Pacific warm pool intraseasonal variability. J Clim 27:6305–6324

    Article  Google Scholar 

  • McPhaden MJ (1999) Genesis and evolution of the 1997–98 El Nino. Science 283:950–954

    Article  Google Scholar 

  • Neena JM, Goswami BN (2010) Extension of potential predictability of Indian summer monsoon dry and wet spells in recent decades. Q J R Meteorol Soc 136:583–592

    Google Scholar 

  • Oh JH, Kim KY, Lim GH (2012) Impact of MJO on the diurnal cycle of rainfall over the western Maritime Continent in the austral summer. Clim Dyn 38:1167–1180

    Article  Google Scholar 

  • Petch J, Waliser D, Jiang X, Xavier P, Woolnough S (2011) A global model inter-comparison of the physical processes associated with the MJO. GEWEX News 21(3):3–5

    Google Scholar 

  • Phillips TJ, Potter GL, Williamson DL, Cederwall RT, Boyle JS, Fiorino M, Hnilo JJ, Olson JG, Xie S, Yio JJ (2004) Evaluating parameterizations in general circulation models: climate simulation meets weather prediction. Bull Am Meteorol Soc 85:1903–1915

    Article  Google Scholar 

  • Randall D, Khairoutdinov M, Arakawa A, Grabowski W (2003) Breaking the cloud parameterization deadlock. Bull Am Meteor Soc 84:1547–1564

    Article  Google Scholar 

  • Raymond DJ (2001) A new model of the Madden–Julian oscillation. J Atmos Sci 58:2807–2819

    Article  Google Scholar 

  • Reynolds RW, Rayner NA, Smith TM, Stokes DC, Wang W (2002) An improved in situ and satellite SST analysis for climate. J Clim 15:1609–1625

    Article  Google Scholar 

  • Sabeerali CT, Dandi AR, Dhakate A, Salunke K, Mahapatra S, Rao SA (2013) Simulations of boreal summer intraseasonal oscillations in the latest CMIP5 coupled GCMs. J Geophys Res Atmos 118:4401–4420

    Article  Google Scholar 

  • Schumacher C, Houze RA (2003) Stratiform rain in the tropics as seen by the TRMM precipitation radar. J Clim 16:1739–1756

    Article  Google Scholar 

  • Seo KH, Wang WQ (2010) The Madden–Julian oscillation simulated in the NCEP climate forecast system model: the importance of stratiform heating. J Clim 23:4770–4793

    Article  Google Scholar 

  • Sikka DR, Gadgil S (1980) On the maximum cloud zone and the ITCZ over Indian longitudes during the southwest monsoon. Mon Weather Rev 108:1840–1853

    Article  Google Scholar 

  • Sobel A, Maloney E (2012) An idealized semi-empirical framework for modeling the Madden–Julian oscillation. J Atmos Sci 69:1691–1705

    Article  Google Scholar 

  • Sperber KR, Annamalai H (2008) Coupled model simulations of boreal summer intraseasonal (30–50 day) variability, Part I: systematic errors and caution on use of metrics. Clim Dyn 31:345–372

    Article  Google Scholar 

  • Sperber KR et al (2000) Predictability and the relationship between subseasonal and interannual variability during the Asian summer monsoon. Q J Roy Meteorol Soc 126:2545–2574

    Article  Google Scholar 

  • Sperber KR et al (2001) Dynamical seasonal predictability of the Asian summer monsoon. Mon Weather Rev 129:2226–2248

    Article  Google Scholar 

  • Sperber KR, Annamali H, Kang I-S, Kitoh A, Moise A, Turner A, Wang B, Zhou T (2013) The Asian summer monsoon: an intercomparison of CMIP5 versus CMIP3 of the late twentieth-century. Clim Dyn 41:2711–2744

    Article  Google Scholar 

  • Stan C, Khairoutdinov M, DeMott CA, Krishnamurthy V, Straus DM, Randall DA, Kinter JL, Shukla J (2010) An ocean-atmosphere climate simulation with an embedded cloud resolving model. Geophys Res Lett 37(1):L01702. doi:10.1029/2009GL040822

    Article  Google Scholar 

  • Suhas E, Neena JM, Goswami BN (2013) An Indian monsoon intrasesaonal ocsillations (MISO) index for real-time monitoring and forecast verification. Clim Dyn 40:2605–2616

    Article  Google Scholar 

  • Takayabu YN, Iguchi T, Kachi M, Shibata A, Kanzawa H (1999) Abrupt termination of the 1997–1998 El Nino in response to a Madden–Julian oscillation. Nature 402:279–282

    Article  Google Scholar 

  • Thayer-Calder K, Randall DA (2009) The role of convective moistening in the Madden–Julian oscillation. J Atmos Sci 66:3297–3312

    Article  Google Scholar 

  • Tian B, Waliser DE, Fetzer EJ (2006) Modulation of the diurnal cycle of tropical deep convective clouds by the MJO. Geophys Res Lett 33:L20704

    Article  Google Scholar 

  • Waliser DE (2006a) Intraseasonal variations. In: Wang B (ed) The Asian monsoon. Springer, Heidelberg, p 787

    Google Scholar 

  • Waliser DE (2006b) Intraseasonal variability. In: Wang B (ed) The Asian monsoon. Springer, Heidelberg, p 844

    Google Scholar 

  • Waliser DE, Stern W, Schubert S, Lau KM (2003a) Dynamic predictability of intraseasonal variability associated with the Asian summer monsoon. Q J R Meteorol Soc 129:2897–2925

    Article  Google Scholar 

  • Waliser DE, Jin K, Kang IS, Stern WF, Schubert SD, Wu MLC, Lau KM, Lee MI, Krishnamurthy V, Kitoh A, Meehl GA, Galin VY, Satyan V, Mandke SK, Wu G, Liu Y, Park CK (2003b) AGCM simulations of intraseasonal variability associated with the Asian summer monsoon. Clim Dyn 21(5–6):423–446

    Article  Google Scholar 

  • Waliser D, Sperber K, Hendon H, Kim D, Wheeler M, Weickmann K, Zhang C, Donner L, Gottschalck J, Higgins W, Kang IS, Legler D, Moncrieff M, Vitart F, Wang B, Wang W, Woolnough S, Maloney E, Schubert S, Stern W (2009) MJO simulation diagnostics. J Clim 22:3006–3030

    Article  Google Scholar 

  • Wang WQ, Schlesinger ME (1999) The dependence on convection parameterization of the tropical intraseasonal oscillation simulated by the UIUC 11-layer atmospheric GCM. J Clim 12:1423–1457

    Article  Google Scholar 

  • Wang B, Xie X (1997) A model for boreal summer intraseasonal oscillation. J Atmos Sci 54:72–86

    Article  Google Scholar 

  • Wang B, Webster P, Kikuchi K, Yasunari T, Qi YJ (2006) Boreal summer quasi-monthly oscillation in the global tropics. Clim Dyn 27:661–675

    Article  Google Scholar 

  • Webster PJ, Magana VO, Palmer TN, Shukla J, Tomas RA, Yanai M, Yasunari T (1998) Monsoons: processes, predictability, and the prospects for prediction. J Geophys Res 103:14451–14510

    Article  Google Scholar 

  • Wheeler M, Kiladis GN (1999) Convectively coupled equatorial waves: analysis of clouds and temperature in the wavenumber-frequency domain. J Atmos Sci 56:374–399

    Article  Google Scholar 

  • Xavier PK et al (2015) Vertical structure and physical processes of the Madden–Julian oscillation: biases and uncertainties at short range. J Geophys Res Atmos. doi:10.1002/2014JD022718

    Google Scholar 

  • Yanai M, Esbensen S, Chu J-H (1973) Determination of bulk properties of tropical cloud clusters from large-scale heat and moisture budgets. J Atmos Sci 30:611–627

    Article  Google Scholar 

  • Zhang CD (2005) The Madden–Julian oscillation. Rev Geophys. doi:10.1029/2004RG000158

    Google Scholar 

  • Zhang CD, Dong M (2004) Seasonality in the Madden–Julian oscillation. J Clim 17:3169–3180

    Article  Google Scholar 

  • Zhang GJ, Song X (2009) Interaction of deep and shallow convection is key to Madden–Julian oscillation simulation. Geophys Res Lett 36:L09708. doi:10.1029/2009GL037340

    Google Scholar 

  • Zhou L, Neale RB, Jochum M, Murtugudde R (2012) Improved Madden–Julian oscillations with improved physics: the impact of modified convection parameterizations. J Clim 25:1116–1136

    Article  Google Scholar 

Download references

Acknowledgments

The multi-model output analyzed in this study is available for free download from https://earthsystemcog.org/projects/gassyotc-mip/. This study was supported by Indian National Monsoon Mission. Neena Mani and Xianan Jiang acknowledge the support of JIFRESSE-UCLA. X. Jiang acknowledges support by US NSF Climate and Large-Scale Dynamics Program under Award AGS-1228302, and NOAA Climate Program Office under Awards NA12OAR4310075, NA15OAR4310098, and NA15OAR4310177. D. W.’s contribution was carried out on behalf of the Jet Propulsion Laboratory, California Institute of Technology, under a contract with NASA. We thank Drs. Ken Sperber, Harry Hendon and Steve Woolnough for useful suggestions and discussions that helped this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. M. Neena.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 2431 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Neena, J.M., Waliser, D. & Jiang, X. Model performance metrics and process diagnostics for boreal summer intraseasonal variability. Clim Dyn 48, 1661–1683 (2017). https://doi.org/10.1007/s00382-016-3166-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00382-016-3166-8

Keywords

Navigation