Skip to main content

Aviation Turbulence Forecast Verification

  • Chapter
  • First Online:
Aviation Turbulence

Abstract

Forecast verification is an essential part of any forecast system. Verification results can be used in many ways: in the development process to ensure changes are leading to the desired improvements and to assure users and relevant authorities the forecasts have the required level of skill and can help to maximise the value a user gains from the forecast. In this section, we look at the challenges of verifying both deterministic and probabilistic turbulence forecasts. We investigate the different potential sources of truth data for use in verification with some discussion of the advantages and disadvantages of each. We also look at the possible methodologies and metrics that can be applied with some suggestions on the most appropriate ways to verify turbulence forecasts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Barné, H.: DELICAT Demonstration of Lidar based clear air turbulence detection, Final report. Thales avionics. http://delicat.inoe.ro/files/DELICAT_Final_report_PUBLIC.pdf (2014)

  • Bedka, K.M., Brunner, J., Dworak, R., Feltz, W., Otkin, J., Greenwald, T.: Objective satellite-based overshooting top detection using infrared window channel brightness temperature gradients. J. Appl. Meteorol. Climatol. 49(2), 181–202 (2010). doi:10.1175/2009JAMC2286.1

    Article  Google Scholar 

  • Dutton, M.J.O.: Probability forecasts of clear-air turbulence based on numerical output. Meteorol. Mag. 109, 293–310 (1980)

    Google Scholar 

  • Ebert, E.: Forecast verification issues methods and FAQ. Bureau of Meteorology website: http://www.cawcr.gov.au/projects/verification/

  • Ellrod, G.P., Knapp, D.L.: An objective clear-air turbulence forecasting technique: verification and operational use. Wea. Forecasting 7, 150–165 (1992)

    Article  Google Scholar 

  • FAA: Aeronautical Information Manual 7-1-20. https://www.faa.gov/air_traffic/publications/ATpubs/AIM/ (2014)

  • Feltz, W.F., Bedka, K.M., Otkin, J.A., Greenwald, T., Ackerman, S.A.: Understanding satellite-observed mountain-wave signatures using high-resolution numerical model data. Wea. Forecasting 24, 76–86 (2009)

    Article  Google Scholar 

  • Ferro, C.A.T., Stephenson, D.B.: Extremal Dependence Indices: improved verification measures for deterministic forecasts of rare binary events. Wea. Forecasting 26, 699–713 (2011)

    Article  Google Scholar 

  • Gilleland, E.: Confidence intervals for verification. Research Applications Laboratory, National Centre for Atmospheric Research: Boulder, CO, USA (2008)

    Google Scholar 

  • Gill, P.G.: Objective verification of World Area Forecast Centre clear air turbulence forecasts. Meteorol. Appl. 21, 3–11 (2014)

    Article  Google Scholar 

  • Gill, P.G., Stirling, A.J.: Including convection in global turbulence forecasts. Meteorol. Appl. 20, 107–114 (2013)

    Article  Google Scholar 

  • Gill, P.G., Buchanan, P.: An ensemble base turbulence forecasting system. Meteorol. Appl. 21, 12–19 (2014)

    Article  Google Scholar 

  • Hamill, T.M., Juras, J.: Measuring forecast skill: is it real skill or is it the varying climatology? Q. J. Roy. Meteorol. Soc. 132, 2905–2923 (2006)

    Article  Google Scholar 

  • ICAO: Guidance on the Harmonized WAFS Grids for Cumulonimbus Cloud, Icing and Turbulence Forecasts. Version 2.5. (2012)

    Google Scholar 

  • Jerrett, D., Turp, D.J.: Characterisation of events identified in the GADS aircraft dataset. Met Office Forecasting Research Technical Report. Met Office: Exeter, UK (2005)

    Google Scholar 

  • Jolliffe, I.T., Stephenson, D.B.: Forecast verification A practitioner’s guide in atmospheric science, 2nd edn. Wiley, West Sussex, England (2012)

    Google Scholar 

  • Kim, J.-H., Chan, W.N., Sridhar, B., Sharman, R.D.: Combined winds and turbulence prediction system for automated air-traffic management application. J. Appl. Meteorol. Clim. 54(4), 766–784 (2015)

    Article  Google Scholar 

  • Kane, T.L., Brown, B.G., Bruintjes, R.T.: Characteristics of pilot reports of icing. Preprints of 14th Conf on Probability and Statistics, 11–16 January 1998, Phoenix, AZ. American Meteorological Society: Boston, MA (1998)

    Google Scholar 

  • Lankford, T.T.: Aviation weather handbook. McGraw Hill, New York, NY (2000)

    Google Scholar 

  • Lunnon, R.W.: Use of GRIB Hazard Forecasts in Flight Planning. WAFC Science meeting, Washington. DC, USA. ICAO website: http://www.icao.int/safety/meteorology/WAFSOPSG/Seminars%20and%20Workshops/WAFC%20Science%20Coordination%20Meeting/Presentations/Use%20of%20GRIB%20hazard%20forecasts%20in%20flight%20planning.ppt (2009)

  • McClish, D.K.: Analyzing a portion of the ROC curve. Med. Decis. Making 9, 190–195 (1989)

    Article  Google Scholar 

  • Mylne, K.R.: Decision-making from probability forecasts based on forecast value. Meteorol. Appl. 9, 307–315 (2002)

    Article  Google Scholar 

  • Overeem, A.: Verification of clear-air turbulence forecasts. Technical Report TR 244, Koninklijk Nederlands Meteorologisch Instituut: De Bilt; 76 pp. (2002)

    Google Scholar 

  • Richardson, D.: Skill and relative economic value of the ECMWF ensemble prediction system. Q. J. Roy. Meteorol. Soc. 126, 649–667 (2000)

    Article  Google Scholar 

  • Schwartz, B.: The quantitative use of PIREPs in developing aviation weather guidance products. Wea. Forecasting 11, 372–384 (1996)

    Article  Google Scholar 

  • Sharman, R., Tebaldi, C., Wiener, G., Wolff, J.: An integrated approach to mid- and upper-level turbulence forecasting. Wea. Forecasting 21(3), 268–287 (2006)

    Article  Google Scholar 

  • Sherman, D.J.: The Australian implementation of AMDAR/ACARS and the use of derived equivalent gust velocity as a turbulence indicator. Structures Report No 418, Department of Defence, Defence Science and Technology Organisation, Aeronautical Research Laboratories, Melbourne, Victoria (1985)

    Google Scholar 

  • Takacs, A., Holland, L., Hueftle, R., Brown, B., Holmes, A.: Using in situ eddy dissipation rate (EDR) observations for turbulence forecast verification. Report to the FAA Aviation Weather Research Program (October 2005). Research Applications Laboratory, National Center for Atmospheric Research: Boulder, CO; 28 pp. (2005)

    Google Scholar 

  • Tenenbaum, J.: GADS Quality Control and turbulence. Personal communication. 27 April 2014 (2014)

    Google Scholar 

  • Truscott, B.S.: EUMETNET AMDAR AAA AMDAR Software Developments – Technical Specification. Doc. Ref. E_AMDAR/TSC/003. Met Office. Exeter. UK (2000)

    Google Scholar 

  • Wilks, D.S.: Statistical Methods in the Atmospheric Sciences. International Geophysics Series, 3rd edn. Elsevier Academic Press, Oxford, UK (2011)

    Google Scholar 

  • Wimmers, A., Feltz, W.: A prediction scheme for aircraft turbulence at tropopause folds using satellite imagery and EDR data. Joint 2007 EUMETSAT Meteorological Satellite Conference and the 15th Satellite Meteorology & Oceanography Conference of the American Meteorological Society. Amsterdam, The Netherlands, 24–28 September 2007. https://www.eumetsat.int/cs/idcplg?IdcService=GET_FILE&dDocName=pdf_conf_p50_s3_21_wimmers_p&allowInterrupt=1&noSaveAs=1&RevisionSelectionMethod=LatestReleased (2007)

  • Wimmers, A., Feltz, W.: Tropopause folding turbulence product. Center for satellite applications and algorithm theoretical basis document. http://www.goesr.gov/products/ATBDs/option2/Aviation_Turbulence_v1.0_no_color.pdf (2010)

  • WMO: AMDAR Reference Manual. WMO-No. 958 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philip G. Gill .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Crown Copyright

About this chapter

Cite this chapter

Gill, P.G. (2016). Aviation Turbulence Forecast Verification. In: Sharman, R., Lane, T. (eds) Aviation Turbulence. Springer, Cham. https://doi.org/10.1007/978-3-319-23630-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-23630-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-23629-2

  • Online ISBN: 978-3-319-23630-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics