Advertisement

Daily Rainfall Prediction with SVR Using a Novel Hybrid PSO-SA Algorithms

  • Jiansheng Wu
  • Long Jin
Part of the Communications in Computer and Information Science book series (CCIS, volume 163)

Abstract

In this study, a novel hybrid evolutionary algorithm is proposed to improve the regression accuracy of support vector regression (SVR) based on the Particle Swarm Optimization (PSO) and Simulated Annealing (SA) algorithms, called SVR–PSO–SA. This optimization mechanism combined PSO with SA to simultaneously optimize the type of kernel function and the kernel parameter setting of SVR. It is troublesome to escape from the local optima for multi–objective optimization. To avoid premature convergence of PSO, this paper present a new hybrid evolutionary algorithm based on the idea that PSO ensures fast convergence, while SA brings the search out of local optima because of its strong local–search ability. The proposed the hybrid evolutionary algorithm was applied to optimize all parameter setting of SVR for the performance of SVR. The SVR–PSO–SA model is tested at daily rainfall forecasting in Guangxi, China. The results showed that the new SVR–PSO–SA model outperforms the traditional SVR models. Specifically, the new SVR–PSO–SA model can successfully identify the optimal type of kernel function and all the optimal values of the parameters of SVR with the lowest prediction error values in rainfall forecasting.

Keywords

Particle Swarm Optimization Support Vector Regression Mean Absolute Percentage Error Normalize Mean Square Error Support Vector Regression Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Jiangsheng, W., Long, J.: Study on the Meteorological Prediction Model Using the Learning Algorithm of Neural Networks Ensemble Based on PSO agorithm. Journal of Tropical Meteorology 15(1), 83–88 (2009)Google Scholar
  2. 2.
    Kannan, M., Prabhakaran, S., Ramachandran, P.: Rainfall Forecasting Using Data Mining Technique. International Journal of Engineering and Technology 2(6), 397–401 (2010)Google Scholar
  3. 3.
    Jiansheng, W., Enhong, C.: A Novel Nonparametric Regression Ensemble for Rainfall Forecasting Using Particle Swarm Optimization Technique Coupled with Artificial Neural Network. In: Yu, W., He, H., Zhang, N. (eds.) ISNN 2009. LNCS, vol. 5553, pp. 49–58. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  4. 4.
    Vapnik, V., Golowich, S., Smola, A.: Support Vector Method for Function Approximation, Regression Estimation and Signal Processing. In: Mozer, M., Jordan, M., Petsche, T. (eds.) Advance in Neural Information Processing System, vol. 9, pp. 281–287. MIT, Cambridge (1997)Google Scholar
  5. 5.
    Thissen, U., Van Brakel, R., De Weijer, A.P., Melssen, W.J., Buydens, L.M.C.: Using Support Vector Machines for Time Series Prediction. Chemometrics and Intelligent Laboratory Systems 69, 35–49 (2003)CrossRefGoogle Scholar
  6. 6.
    Jiansheng, W., Mingzhe, L., Long, J.: Least Square Support Vector Machine Ensemble for Daily Rainfall Forecasting Based on Linear and Nonlinear Regression. In: Zeng, Z., Wang, J. (eds.) Advances in Neural Network Research and Applications. LNEE, vol. 67, pp. 55–64. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Huang, S.C., Wu, T.K.: Integrating GA-based time-scale feature extractions with SVMs for stock index forecasting. Expert Systems with Applications 35, 2080–2088 (2008)CrossRefGoogle Scholar
  8. 8.
    Duan, K., Keerthi, S., Poo, A.: Evaluation of simple performance measures for tuning SVM hyperparameters. Technical Report, Department of Mechanical Engineering, Singapore: National University of Singapore (2001)Google Scholar
  9. 9.
    Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by Simulated Annealing. Journal of Science 220, 671–680 (1983)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Al-khedhairi, A.: Simulated Annealing Metaheuristic for Solving P–Median Problem. International Journal of Contemporary Mathematical Sciences 3(28), 1357–1365 (2008)MathSciNetzbMATHGoogle Scholar
  11. 11.
    Kennedy, J., Eberhart, R.C.: Swarm Intelligence. Morgan Kaufmann Academic Press (2001)Google Scholar
  12. 12.
    Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948. IEEE Press, Los Alamitos (1995)Google Scholar
  13. 13.
    Kennedy, J., Eberhart, R.C.: A Discrete Binary Version of the Particle Swarm Optimization Algorithm. In: Proceedings of the World Multiconference on Systemics, Cybernetics and Informatics, Piscataway, NJ, pp. 4104–4109 (1997)Google Scholar
  14. 14.
    Lin, S.W., Ying, K.C., Chen, S.C.: Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications 35, 1817–1824 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jiansheng Wu
    • 1
  • Long Jin
    • 2
  1. 1.Department of Mathematics and ComputerLiuzhou Teacher CollegeLiuzhouChina
  2. 2.Guangxi Research Institute of Meteorological Disasters MitigationNaningChina

Personalised recommendations