Abstract
Forecast verification is an essential part of any forecast system. Verification results can be used in many ways: in the development process to ensure changes are leading to the desired improvements and to assure users and relevant authorities the forecasts have the required level of skill and can help to maximise the value a user gains from the forecast. In this section, we look at the challenges of verifying both deterministic and probabilistic turbulence forecasts. We investigate the different potential sources of truth data for use in verification with some discussion of the advantages and disadvantages of each. We also look at the possible methodologies and metrics that can be applied with some suggestions on the most appropriate ways to verify turbulence forecasts.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Barné, H.: DELICAT Demonstration of Lidar based clear air turbulence detection, Final report. Thales avionics. http://delicat.inoe.ro/files/DELICAT_Final_report_PUBLIC.pdf (2014)
Bedka, K.M., Brunner, J., Dworak, R., Feltz, W., Otkin, J., Greenwald, T.: Objective satellite-based overshooting top detection using infrared window channel brightness temperature gradients. J. Appl. Meteorol. Climatol. 49(2), 181–202 (2010). doi:10.1175/2009JAMC2286.1
Dutton, M.J.O.: Probability forecasts of clear-air turbulence based on numerical output. Meteorol. Mag. 109, 293–310 (1980)
Ebert, E.: Forecast verification issues methods and FAQ. Bureau of Meteorology website: http://www.cawcr.gov.au/projects/verification/
Ellrod, G.P., Knapp, D.L.: An objective clear-air turbulence forecasting technique: verification and operational use. Wea. Forecasting 7, 150–165 (1992)
FAA: Aeronautical Information Manual 7-1-20. https://www.faa.gov/air_traffic/publications/ATpubs/AIM/ (2014)
Feltz, W.F., Bedka, K.M., Otkin, J.A., Greenwald, T., Ackerman, S.A.: Understanding satellite-observed mountain-wave signatures using high-resolution numerical model data. Wea. Forecasting 24, 76–86 (2009)
Ferro, C.A.T., Stephenson, D.B.: Extremal Dependence Indices: improved verification measures for deterministic forecasts of rare binary events. Wea. Forecasting 26, 699–713 (2011)
Gilleland, E.: Confidence intervals for verification. Research Applications Laboratory, National Centre for Atmospheric Research: Boulder, CO, USA (2008)
Gill, P.G.: Objective verification of World Area Forecast Centre clear air turbulence forecasts. Meteorol. Appl. 21, 3–11 (2014)
Gill, P.G., Stirling, A.J.: Including convection in global turbulence forecasts. Meteorol. Appl. 20, 107–114 (2013)
Gill, P.G., Buchanan, P.: An ensemble base turbulence forecasting system. Meteorol. Appl. 21, 12–19 (2014)
Hamill, T.M., Juras, J.: Measuring forecast skill: is it real skill or is it the varying climatology? Q. J. Roy. Meteorol. Soc. 132, 2905–2923 (2006)
ICAO: Guidance on the Harmonized WAFS Grids for Cumulonimbus Cloud, Icing and Turbulence Forecasts. Version 2.5. (2012)
Jerrett, D., Turp, D.J.: Characterisation of events identified in the GADS aircraft dataset. Met Office Forecasting Research Technical Report. Met Office: Exeter, UK (2005)
Jolliffe, I.T., Stephenson, D.B.: Forecast verification A practitioner’s guide in atmospheric science, 2nd edn. Wiley, West Sussex, England (2012)
Kim, J.-H., Chan, W.N., Sridhar, B., Sharman, R.D.: Combined winds and turbulence prediction system for automated air-traffic management application. J. Appl. Meteorol. Clim. 54(4), 766–784 (2015)
Kane, T.L., Brown, B.G., Bruintjes, R.T.: Characteristics of pilot reports of icing. Preprints of 14th Conf on Probability and Statistics, 11–16 January 1998, Phoenix, AZ. American Meteorological Society: Boston, MA (1998)
Lankford, T.T.: Aviation weather handbook. McGraw Hill, New York, NY (2000)
Lunnon, R.W.: Use of GRIB Hazard Forecasts in Flight Planning. WAFC Science meeting, Washington. DC, USA. ICAO website: http://www.icao.int/safety/meteorology/WAFSOPSG/Seminars%20and%20Workshops/WAFC%20Science%20Coordination%20Meeting/Presentations/Use%20of%20GRIB%20hazard%20forecasts%20in%20flight%20planning.ppt (2009)
McClish, D.K.: Analyzing a portion of the ROC curve. Med. Decis. Making 9, 190–195 (1989)
Mylne, K.R.: Decision-making from probability forecasts based on forecast value. Meteorol. Appl. 9, 307–315 (2002)
Overeem, A.: Verification of clear-air turbulence forecasts. Technical Report TR 244, Koninklijk Nederlands Meteorologisch Instituut: De Bilt; 76 pp. (2002)
Richardson, D.: Skill and relative economic value of the ECMWF ensemble prediction system. Q. J. Roy. Meteorol. Soc. 126, 649–667 (2000)
Schwartz, B.: The quantitative use of PIREPs in developing aviation weather guidance products. Wea. Forecasting 11, 372–384 (1996)
Sharman, R., Tebaldi, C., Wiener, G., Wolff, J.: An integrated approach to mid- and upper-level turbulence forecasting. Wea. Forecasting 21(3), 268–287 (2006)
Sherman, D.J.: The Australian implementation of AMDAR/ACARS and the use of derived equivalent gust velocity as a turbulence indicator. Structures Report No 418, Department of Defence, Defence Science and Technology Organisation, Aeronautical Research Laboratories, Melbourne, Victoria (1985)
Takacs, A., Holland, L., Hueftle, R., Brown, B., Holmes, A.: Using in situ eddy dissipation rate (EDR) observations for turbulence forecast verification. Report to the FAA Aviation Weather Research Program (October 2005). Research Applications Laboratory, National Center for Atmospheric Research: Boulder, CO; 28 pp. (2005)
Tenenbaum, J.: GADS Quality Control and turbulence. Personal communication. 27 April 2014 (2014)
Truscott, B.S.: EUMETNET AMDAR AAA AMDAR Software Developments – Technical Specification. Doc. Ref. E_AMDAR/TSC/003. Met Office. Exeter. UK (2000)
Wilks, D.S.: Statistical Methods in the Atmospheric Sciences. International Geophysics Series, 3rd edn. Elsevier Academic Press, Oxford, UK (2011)
Wimmers, A., Feltz, W.: A prediction scheme for aircraft turbulence at tropopause folds using satellite imagery and EDR data. Joint 2007 EUMETSAT Meteorological Satellite Conference and the 15th Satellite Meteorology & Oceanography Conference of the American Meteorological Society. Amsterdam, The Netherlands, 24–28 September 2007. https://www.eumetsat.int/cs/idcplg?IdcService=GET_FILE&dDocName=pdf_conf_p50_s3_21_wimmers_p&allowInterrupt=1&noSaveAs=1&RevisionSelectionMethod=LatestReleased (2007)
Wimmers, A., Feltz, W.: Tropopause folding turbulence product. Center for satellite applications and algorithm theoretical basis document. http://www.goesr.gov/products/ATBDs/option2/Aviation_Turbulence_v1.0_no_color.pdf (2010)
WMO: AMDAR Reference Manual. WMO-No. 958 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Crown Copyright
About this chapter
Cite this chapter
Gill, P.G. (2016). Aviation Turbulence Forecast Verification. In: Sharman, R., Lane, T. (eds) Aviation Turbulence. Springer, Cham. https://doi.org/10.1007/978-3-319-23630-8_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-23630-8_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23629-2
Online ISBN: 978-3-319-23630-8
eBook Packages: EngineeringEngineering (R0)