Skip to main content

Advertisement

Log in

Mape_Maker: A Scenario Creator

  • Original Paper
  • Published:
Energy Systems Aims and scope Submit manuscript

Abstract

We describe algorithms for creating probabilistic scenarios for renewables power production. Our approach allows for tailoring of forecast uncertainty, such that scenarios can be constructed to capture the situation where the underlying forecast methodology is more (or less) accurate than it has been historically. Such scenarios can be used in studies that extend into the future and may need to consider the possibility that forecast technology will improve. Our approach can also be used to generate alternative realizations of renewable energy production that are consistent with historical forecast accuracy, in effect serving as a method for creating families of realistic alternatives—which are often critical in simulation-based analysis methodologies. We illustrate the methods using real data for day-ahead wind forecasts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Abbreviations

\(x_t\) :

Timeseries of independent input data (e.g. actuals)

\(y_t\) :

Timeseries of dependent input data (e.g. forecasts)

\({\mathcal {X}}\) :

Set of paired input data (actuals, forecasts) or (forecasts, actuals)

\(x^{SID}_t\) :

Timeseries of simulation input data

\({\mathcal {X}}_{SID}\) :

Set of Simulation Input Data (SID) upon which the simulation is performed

\({\tilde{r}}\) :

Target MARE (Mean Absolute Relative Error)

\(\tilde{\pmb {\varepsilon }}_t\) :

Random vector of simulated errors

\(\tilde{\pmb {y}}_t\) :

Random vector of simulated values

\(\tilde{\pmb {u}}_t\) :

Random vector of uniform base process

\({\pmb {{\mathcal {E}}}}\) :

Random variable of the error

\({\tilde{{\pmb {{\mathcal {E}}}}}}\) :

Random variable of the simulated error

\({\mathbf {X}}\) :

Random variable of the input

\({\mathbf {Z}}\) :

Joint random variable : \(Z=({\pmb {{\mathcal {E}}}}, {\mathbf {X}})\)

\(f_{X} \) :

Marginal density function of the input data \({\mathcal {X}}\)

\(f_{\varepsilon } \) :

Marginal density function of the error random variable

\(f_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Conditional density function of the error given the input

\(F_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Cumulative distribution function of the error given the input

a :

Percent of data used to estimate each conditional distribution

\(I_{x}^a\) :

Interval of 2a fraction of data around x in \({\mathcal {X}}\)

\({\bar{x}}(x, a)\) :

Center of the interval \(I_{x}^a\)

cap :

Capacity

\(b( \cdot ; \alpha , \beta , l, s)\) :

Density function of a beta for parameters : \(\alpha , \beta , l, s\)

\(\hat{{\mathcal {S}}}_x\) :

Set of estimated beta parameters of the conditional distributions \({{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}\) over \({\mathcal {X}}\)

\({\hat{m}}(x)\) :

Expected value of the absolute estimated error given the input

\({\tilde{m}}(x, {\tilde{r}}, \omega )\) :

Expected value of the absolute simulated error given the input, a target MARE, and a weight function

\(\omega _{{\mathcal {X}}}(\cdot )\) :

Weight function over \({\mathcal {X}}\)

\({\hat{F}}_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Cumulative distribution function of the estimated error given the input

\({\hat{f}}_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Estimated conditional density function of the error given the input in \({\mathcal {X}}\)

\(m_{max}(x)\) :

Maximum value of the expected value of the absolute estimated error, given x

\(r_{{\hat{m}}}\) :

Expected value of the mean absolute relative estimated error over \({\mathcal {X}}\)

\({\hat{r}}\) :

Mean absolute relative error over \({\mathcal {X}}\) under the estimated conditional distributions

\({\tilde{F}}_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Cumulative distribution function of the simulated error given the input

\({\tilde{f}}_{{{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}}\) :

Simulation conditional density function of the error given the input in \({\mathcal {X}}_{SID}\)

\(\tilde{{\mathcal {S}}}_{x,m}\) :

Set of simulation beta parameters of the conditional distributions \({{\pmb {{\mathcal {E}}}}|{{\mathbf {X}}=x}}\) over the SID

\(\omega _{{\mathcal {X}}_{SID}}(\cdot )\) :

Weight function over \({\mathcal {X}}_{SID}\)

\(P_{SID}\) :

Distribution plausibility score

\(\tilde{\pmb {z}}_t\) :

Random vector of base process

\(\phi \) :

Cdf of the standard normal distribution

\(({\hat{z}}_i)_{i \le n}\) :

Estimated base process

\((a_i, b_i)_{i \le p}\) :

ARMA parameters of the estimated base process

\(\sigma _{\delta }\) :

Standard deviation of the error of the estimated base process

d :

Mean of the curvature of target input data

References

  1. Biller, Bahar, Nelson, Barry L.: Fitting time-series input processes for simulation. Oper. Res. 53, 549–559 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  2. Bludszuweit, Hans, Domínguez-Navarro, José Antonio, Llombart, Andrés: Statistical analysis of wind power forecast error. IEEE Trans. Power Syst. 23(3), 983–991 (2008)

    Article  Google Scholar 

  3. Dvorkin, Y., Wang, Y., Pandzic, H., Kirschen, D.: Comparison of scenario reduction techniques for the stochastic unit commitment. In: 2014 IEEE PES General Meeting|Conference Exposition, pp. 1–5 (2014)

  4. Feng, Yonghan, Rios, Ignacio, Ryan, Sarah M., Spurkel, Kai, Watson, Jean-Paul, Wets, Roger J.-B., Woodruff, David L.: Toward scalable stochastic unit commitment. Part 1: Load scenario generation. Energy Syst. 6(3), 309–329 (2015)

    Article  Google Scholar 

  5. Kolassa, S., Martin, R.: Percentage errors can ruin your day (and rolling the dice shows how). Foresight Int. J. Appl. Forecast. 23, 21–27 (2011)

    Google Scholar 

  6. Morales, Juan M., Minguez, Roberto, Conejo, Antonio J.: A methodology to generate statistically dependent wind speed scenarios. Appl. Energy 87(3), 843–855 (2010)

    Article  Google Scholar 

  7. Pinson, P., Kariniotakis, G., Nielsen, H.A., Nielsen, T.S., Madsen, H.: Properties of quantile and interval forecasts of wind generation and their evaluation. In: Proceedings of the European Wind Energy Conference mnd Exhibition, Athens (2006). http://www.ewea.org

  8. Pinson, P., Madsen, H., Nielsen, H.A., Papaefthymiou, G., Klöckl, B.: From probabilistic forecasts to statistical scenarios of short-term wind power production. Wind Energy 12, 51–62 (2008)

    Article  Google Scholar 

  9. Pinson, Pierre, Girard, Robin: Evaluating the quality of scenarios of short-term wind power generation. Appl. Energy 96, 12–20 (2012)

    Article  Google Scholar 

  10. Pinson, Pierre, Madsen, Henrik, Nielsen, Henrik Aa, Papaefthymiou, George, Klöckl, Bernd: From probabilistic forecasts to statistical scenarios of short-term wind power production. Wind Energy 12(1), 51–62 (2009)

    Article  Google Scholar 

  11. Pinson, P., Tastu, J.: Discrimination ability of the energy score. Technical Report (2013)

  12. Sari, Didem, Lee, Youngrok, Ryan, Sarah, Woodruff, David: Statistical metrics for assessing the quality of wind power scenarios for stochastic unit commitment. Wind Energy 19(5), 873–893 (2016)

    Article  Google Scholar 

  13. Sharma, Kailash Chand, Jain, Prerna, Bhakar, Rohit: Wind power scenario generation and reduction in stochastic programming framework. Electric Power Compon. Syst. 41(3), 271–285 (2013)

    Article  Google Scholar 

  14. Staid, Andrea, Watson, Jean-Paul, Wets, Roger J.-B., Woodruff, David L.: Generating short-term probabilistic wind power scenarios via nonparametric forecast error density estimators. Wind Energy 20(12), 1911–1925 (2017)

    Article  Google Scholar 

  15. Wang, Jianhui, Shahidehpour, Mohammad, Li, Zuyi: Security-constrained unit commitment with volatile wind power generation. IEEE Trans. Power Syst. 23(3), 1319–1327 (2008)

    Article  Google Scholar 

  16. Woodruff, David L., Deride, Julio, Staid, Andrea, Watson, Jean-Paul, Glevogt, Gerrit, Silva-Monroy, Cesar: Constructing probabilistic scenarios for wide-area solar power generation. Sol. Energy 160(15), 153–167 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344. This document was prepared as an account of work sponsored by an agency of the United States government. Neither the United States government nor Lawrence Livermore National Security, LLC, nor any of their employees makes any warranty, expressed or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or Lawrence Livermore National Security, LLC. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or Lawrence Livermore National Security, LLC, and shall not be used for advertising or product endorsement purposes. We are grateful for the referees’ comments, which improved the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David L. Woodruff.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Putting It All Together

Putting It All Together

In this section we summarize the process to deliver a simulation with correct targets.

1.1 Procedures for Estimation

First, as shown in Algorithm 1, we preprocess the data and estimate the conditional distributions using the methods explained in Sect. 2.3. This results in a set of beta distribution parameters for each input from the whole dataset, called \(\hat{{\mathcal {S}}}\). To estimate the parameters we recall that the user should specify a data fraction for the sampling (e.g., 0.05). (The software provides an option to produce a curve for the scores described in Sect. 2.4.)

figure a

Next, as shown in Algorithm 2, we estimate the partitioning of the mean absolute percent errors according to the input and we encode this information in the weight function. An important feature of this procedure is the computation of \(r_{{\hat{m}}}\) which is the expected mean absolute relative error from the conditional distributions (which may be close in value to, but is different from, \({\hat{r}}\).) This procedure is explained in Sect. 3.3.

figure b

The next phase, shown in Algorithm 3, is estimation of the underlying base_process that generates autocorrelation in the time series of the errors. This is done by using the CDF B of the beta distribution whose parameters have been inferred in step 1. Then we operate a grid search over the p and q parameters to select the order of the model that minimizes the BIC criterion. We save the coefficients. Recalling that we want the marginal of Z to follow a standard normal, we set the variance of the errors of the base process so that \(Var[{\mathbf {Z}}_t] = 1\). This procedure is explained in Sect. 4.

figure c

1.2 Procedures to Deliver the Target MARE

First, as shown in Algorithm 4, given a target MARE \({\tilde{r}}\), and a \({\mathcal {X}}_{SID}\) we verify that \({\tilde{r}}\) is feasible. If it is, we aim at targeting a mean absolute error for each conditional distribution with input in the \({\mathcal {X}}_{SID}\). For this, we compute a target function using the estimated weight function (see Sect. 3.4).

figure d

Second, as shown in Algorithm 5, according to a target function \({\tilde{m}}\), we assign adjusted parameters for each conditional distribution whose input is in the \({\mathcal {X}}_{SID}\). We adjust the location parameters from the estimated values while keeping the shape parameters. See Sect. 3.2.

figure e

1.3 Procedure to Simulate the Output

Using methods summarized in Algorithm 6, we simulate a base process sample of length \(|{\mathcal {X}}_{SID}|\) and use the simulated conditional distributions to obtain conditioned errors. We directly get the simulation by summing the errors and the input data. Finally, if the user asks for it, we optimize the curvature a posteriori, see Sect. 5.

figure f

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goujard, G., Watson, JP. & Woodruff, D.L. Mape_Maker: A Scenario Creator. Energy Syst 14, 731–757 (2023). https://doi.org/10.1007/s12667-020-00408-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12667-020-00408-6

Navigation