Summary
Sharing knowledge and experience about NWP verification among forecasting centres, research institutions and environmental agencies in the Alpine area has been one of the main goals of the EU FORALPS project – INTERREG IIIB Alpine Space. In this framework, state-of-the-art verification techniques employed by project partners have been shared and applied to numerical simulations of selected case studies of rainfall events on the north-eastern Alpine area. In this work, a multi-method approach is presented. Simulations of two events with three limited area models (LAMs) are verified with traditional and more innovative techniques, including both traditional eyeball methods, categorical scores and skill scores, along with advanced object-oriented techniques such as the continuous rain area (CRA) analysis. Simulations of satellite observed fields (METEOSAT-7 Water Vapour channel) are also employed, to check qualitatively the impact of initialisation on the model error growth. Most importantly, it is shown how this multiplicity of perspective allows a deeper understanding of the results and facilitates their interpretation, thus suggesting that this multi-method approach should be followed in future works.
Similar content being viewed by others
References
C Accadia S Mariani M Casaioli A Lavagnini A Speranza (2003) ArticleTitleSensitivity of precipitation forecast skill scores to bilinear interpolation and a simple nearest-neighbor average method on high-resolution verification grids Wea Forecast 18 918–932 Occurrence Handle10.1175/1520-0434(2003)018<0918:SOPFSS>2.0.CO;2
C Accadia S Mariani M Casaioli A Lavagnini A Speranza (2005) ArticleTitleVerification of precipitation forecasts from two limited-area models over Italy and comparison with ECMWF forecasts using a resampling technique Wea Forecast 20 276–300 Occurrence Handle10.1175/WAF854.1
SL Barnes (1964) ArticleTitleA technique for maximizing details in numerical weather map analysis J Appl Meteor 3 396–409 Occurrence Handle10.1175/1520-0450(1964)003<0396:ATFMDI>2.0.CO;2
Barnes SL (1973) Mesoscale objective analysis using weighted time-series observations. NOAA Tech. Memo. ERL NSSL-62, National Severe Storms Laboratory, Norman, OK 73069, 60 pp [NTIS COM-73-10781]
M Casaioli S Mariani C Accadia N Tartaglione A Speranza A Lavagnini M Bolliger (2006) ArticleTitleUnsatisfying forecast of a Mediterranean cyclone: a verification study employing state-of-the-art techniques Adv Geosci 7 379–386
EE Ebert JL McBride (2000) ArticleTitleVerification of precipitation in weather systems: determination of systematic errors J Hydrol 239 179–202 Occurrence Handle10.1016/S0022-1694(00)00343-7
R Fehlmann C Quadri HC Davies (2000) ArticleTitleAn Alpine rainstorm: sensitivity to the mesoscale upper-level structure Wea Forecast 15 4–28 Occurrence Handle10.1175/1520-0434(2000)015<0004:AARSTT>2.0.CO;2
GK Gilbert (1884) ArticleTitleFinley’s tornado predictions Amer Met J 1 166–172
M Göber E Zsótér DS Richardson (2008) ArticleTitleCould a perfect model ever satisfy a naïve forecaster? On grid box mean versus point verification Meteorol Appl 15 359–365 Occurrence Handle10.1002/met.78
JS Grams WA Gallus SE Koch LS Wharton A Loughe EE Ebert (2006) ArticleTitleThe use of a modified Ebert-McBride technique to evaluate mesoscale model QPF as a function of convective system morphology during IHOP 2002 Wea Forecast 21 288–306 Occurrence Handle10.1175/WAF918.1
AW Hanssen WJA Kuipers (1965) ArticleTitleOn the relationship between the frequency of rain and various meteorological parameters Meded Verh 81 2–15
SE Koch M des Jardins PJ Kocin (1983) ArticleTitleAn interactive Barnes objective map analysis scheme for use with satellite and conventional data J Climate Appl Meteor 22 1487–1503 Occurrence Handle10.1175/1520-0450(1983)022<1487:AIBOMA>2.0.CO;2
A Lanciani S Mariani M Casaioli C Accadia N Tartaglione (2008) ArticleTitleA multiscale approach for precipitation verification applied to the FORALPS case studies Adv Geosci 16 3–9 Occurrence Handle10.5194/adgeo-16-3-2008
Mariani S, Casaioli M (2008) Forecast verification: a summary of common approaches and examples of application. FORALPS Technical Report 5. Università degli Studi di Trento, Dipartimento di Ingegneria Civile e Ambientale, Trento, Italy, 60 pp
S Mariani M Casaioli C Accadia MC Llasat F Pasi S Davolio M Elementi G Ficca R Romero (2005) ArticleTitleA limited area model intercomparison on the “Montserrat-2000” flash-flood event using statistical and deterministic methods Nat Hazards Earth Sys Sci 5 565–581 Occurrence Handle10.5194/nhess-5-565-2005
S Mariani C Accadia N Tartaglione M Casaioli M Gabella S Chr Michaelides A Speranza (2008) ArticleTitleMultisensor comparison and numerical modeling of atmospheric water fields: a VOLTAIRE case study over Cyprus Wea Forecast 23 674–701 Occurrence Handle10.1175/2007WAF2007032.1
I Mason (1989) ArticleTitleDependence of the critical success index on sample climate and threshold probability Aust Meteor Mag 37 75–81
Panofsky HA, Brier GW (1958) Some applications of statistics to meteorology. Pennsylvania State University, University Park, 224 pp
JT Schaefer (1990) ArticleTitleThe critical success index as an indicator of warning skill Wea Forecast 5 570–575 Occurrence Handle10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2
A Speranza C Accadia M Casaioli S Mariani G Monacelli R Inglesi N Tartaglione PM Ruti A Carillo A Bargagli G Pisacane F Valentinotti A Lavagnini (2004) ArticleTitlePOSEIDON: an integrated system for analysis and forecast of hydrological, meteorological and surface marine fields in the Mediterranean area Nuovo Cimento C 27 329–345
A Speranza C Accadia S Mariani M Casaioli N Tartaglione G Monacelli PM Ruti A Lavagnini (2007) ArticleTitleSIMM: an integrated forecasting system for the Mediterranean area Meteorol Appl 14 337–350 Occurrence Handle10.1002/met.34
DB Stephenson (2000) ArticleTitleUse of the “odds ratio” for diagnosing forecast skill Wea Forecast 15 221–232 Occurrence Handle10.1175/1520-0434(2000)015<0221:UOTORF>2.0.CO;2
DS Wilks (1995) Statistical methods in the atmospheric science Academic Press San Diego 467
P Xie PA Arkin (1995) ArticleTitleAn intercomparison of gauge observations and satellite estimates of monthly precipitation J Appl Meteor 34 1143–1160 Occurrence Handle10.1175/1520-0450(1995)034<1143:AIOGOA>2.0.CO;2
Author information
Authors and Affiliations
Corresponding author
Additional information
Correspondence: Stefano Mariani, Agenzia per la Protezione dell’Ambiente e per i Servizi Tecnici (APAT), Via Curtatone 3, 00185 Rome, Italy
Rights and permissions
About this article
Cite this article
Mariani, S., Casaioli, M., Lanciani, A. et al. A multi-method intercomparison approach for precipitation fields modelled by LAMs in the Alpine area: Two FORALPS case studies. Meteorol Atmos Phys 103, 79–92 (2009). https://doi.org/10.1007/s00703-008-0340-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00703-008-0340-5