Evaluating Predictive Performance

  • Michael ScheuererEmail author
  • Tilmann GneitingEmail author
Conference paper
Part of the Lecture Notes in Earth System Sciences book series (LNESS)


Many statistical methods such as (generalized) linear regression, time series approaches or geostatistical techniques are concerned with forecasting and interpolating uncertain, unknown, or partially known quantities. To address and quantify prediction uncertainty, the forecaster ought to provide a full predictive probability distribution over the quantity or event of interest, rather than just a point forecast. In this paper we provide a brief review on diagnostic and quantitative methods for the evaluation of predictive distributions that have developed in the context of probabilistic forecasting. We also discuss the issue of deriving optimal point forecasts from a predictive distribution and illustrate the proposed evaluation methods with a data example on one day ahead predictions of ozone concentrations.


Eigenvalue method Model reduction Groundwater 


  1. 1.
    Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1–3.CrossRefGoogle Scholar
  2. 2.
  3. 3.
    Gneiting, T. (2011). Making and evaluating point forecasts. Journal of American Statistical Association, 106, 746–762.CrossRefGoogle Scholar
  4. 4.
    Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007). Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society: Series B, 69, 243–268.CrossRefGoogle Scholar
  5. 5.
    Gneiting, T., & Raftery, A. E. (2007). Strictly proper scoring rules, prediction and estimation. Journal of American Statistical Association, 102, 359–378.CrossRefGoogle Scholar
  6. 6.
    Moyeed, R. A., & Papritz, A. (2002). An empirical comparison of Kriging methods for nonlinear spatial point prediction. Mathematical Geology, 34, 365–386.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Institute of Applied MathematicsUniversity of HeidelbergHeidelbergGermany

Personalised recommendations