SVRs and Uncertainty Estimates in Wind Energy Prediction
- 2 Citations
- 1.5k Downloads
Abstract
While Support Vector Regression, SVR, is one of the algorithms of choice in modeling problems, construction of its error intervals seems to have received less attention. On the other hand, general noise cost functions for SVR have been recently proposed. Taking this into account, this paper describes a direct approach to build error intervals for different choices of residual distributions. We also discuss how to fit these noise models and estimate their parameters, proceeding then to give a comparison between intervals obtained using this method. under different ways to estimate SVR parameters as well as the intervals obtained by employing a full SVR Bayesian framework. The proposed approach is shown on a synthetic problem to provide better accuracy when models fitted coincide with the noise injected into the problem. Finally, we apply it to wind energy forecasting, exploiting predicted energy magnitudes to define intervals with different widths.
Keywords
Support Vector Regression Noise Model Uncertainty Estimate Uncertainty Interval Noise DistributionPreview
Unable to display preview. Download preview PDF.
References
- 1.Shawe-Taylor J., Cristianini N.: An introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press (2000)Google Scholar
- 2.Yang, H., Chan, L., King, I.: Support vector machine regression for volatile stock market prediction. In: Yin, H., Allinson, N., Freeman, R., Keane, J., Hubbard, S. (eds.) IDEAL 2002. LNCS, vol. 2412, pp. 391–396. Springer, Heidelberg (2002)Google Scholar
- 3.Kramer, O., Gieseke, F.: Short-term wind energy forecasting using support vector regression. In: Corchado, E., Snášel, V., Sedano, J., Hassanien, A.E., Calvo, J.L., Ślȩzak, D. (eds.) SOCO 2011. AISC, vol. 87, pp. 271–280. Springer, Heidelberg (2011)Google Scholar
- 4.Gala Y., Fernandez, A., Díaz J., Dorronsoro J.R.: Support vector forecasting of solar radiation values. In: Pan, J.-S., Polycarpou, M.M., Woźniak, M., de Carvalho, A.C.P.L.F., Quintián, H., Corchado, E. (eds.) HAIS 2013. LNCS (LNAI), vol. 8073, pp. 51–60. Springer, Heidelberg (2013)Google Scholar
- 5.Chu, W., Keerthi, S.S., Ong, C.J.: Bayesian support vector regression using a unified loss function. IEEE Transactions on Neural Networks 15, 29–44 (2004)Google Scholar
- 6.Chang, C., Lin, C.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2, 27 (2011)Google Scholar
- 7.Lin, C., Weng, R.: Simple Probabilistic Predictions for Support Vector Regression. National Taiwan University, Taipei (2004) Google Scholar
- 8.Hu, Q., Zhang, S., Xie, Z., Mi, J., Wan, J.: Noise model based \(\nu \)-support vector regression with its application to short-term wind speed forecasting. In: Neural Networks, vol. 57, pp. 1–11. Elsevier (2014)Google Scholar
- 9.Pontil, M., Mukherjee, S., Girosi, F.: On the noise model of support vector machines regression. In: Arimura, H., Jain, S., Sharma, A. (eds.) ALT 2000. LNCS, vol. 1968, pp. 316–324. Springer, Heidelberg (2000)Google Scholar
- 10.Celik, A. N.: A statistical analysis of wind power density based on the Weibull and Rayleigh models at the southern region of Turkey. In: Renewable Energy, vol. 29, pp. 593–604. Elsevier (2004)Google Scholar
- 11.Gnanadesikan, R., Pinkham, R.S., Hughes, L.P.: Maximum likelihood estimation of the parameters of the beta distribution from smallest order statistics. In: Technometrics, vol. 9, pp. 607–620. Taylor & Francis Group (1967)Google Scholar
- 12.Lehmann, E.L., Romano J.P.: Testing statistical hypotheses. Springer Science & Business Media (2006)Google Scholar
- 13.UCI Machine Learning Repository. https://archive.ics.uci.edu/ml/datasets.html
- 14.StatLib Datasets Archive. http://lib.stat.cmu.edu/datasets/
- 15.Delve Datasets. http://www.cs.utoronto.ca/ delve/data/datasets.html
- 16.Cherkassky, V., Ma, Y.: Practical selection of SVM parameters and noise estimation for SVM regression. In: Neural Networks, vol. 17, pp. 113–126. Elsevier (2004)Google Scholar
- 17.Johnson, N.L., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, vol. 2. John Wiley & Sons (1995)Google Scholar