Automatic Design of Radial Basis Function Networks Through Enhanced Differential Evolution
During the creation of a classification model, it is vital to keep track of numerous parameters and to produce a model based on the limited knowledge inferred often from very confined data. Methods which aid the construction or completely build the classification model automatically, present a fairly common research interest. This paper proposes an approach that employs differential evolution enhanced through the incorporation of additional knowledge concerning the problem in order to design a radial basis neural network. The knowledge is inferred from the unsupervised learning procedure which aims to ensure an initial population of good solutions. Also, the search space is dynamically adjusted i.e. narrowed during runtime in terms of the decision variables count. The results obtained on several datasets suggest that the proposed approach is able to find well performing networks while keeping the structure simple. Furthermore, a comparison with a differential evolution algorithm without the proposed enhancements and a particle swarm optimization algorithm was carried out illustrating the benefits of the proposed approach.
KeywordsDifferential evolution Initial population k-means Neural network Radial basis function
This work was supported by research project grant No. 165-0362980-2002 from the Ministry of Science, Education and Sports of the Republic of Croatia.
- 1.Bache, K., Lichman, M.: UCI machine learning repository (2013). http://archive.ics.uci.edu/ml
- 2.Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press Inc., New York (1995) Google Scholar
- 3.Huang, C.M., Hsieh, C.T., Wang, Y.S.: Evolution of radial basic function neural network for fast restoration of distribution systems with load variations. Electr. Power Energy Syst. 33(4), 961–968 (2011)Google Scholar
- 5.Korürek, M., Doğan, B.: ECG beat classification using particle swarm optimization and radial basis function neural network. Expert Syst. Appl. 37(12), 7563–7569 (2010)Google Scholar
- 6.Martinović, G., Bajer, D.: Impact of NNA implementation on GA performance for the TSP. In: 5th International Conference on Bioinspired Optimization Methods and their Applications, pp. 173–184. Jožef Štefan Institute, Ljubljana, Slovenia (2012)Google Scholar
- 7.Martinović, G., Bajer, D.: Data clustering with differential evolution incorporating macromutations. In: Panigrahi, B.K., Suganthan, P.N., Das, S., Dash, S.S. (eds.) SEMCCO 2013, Part I. LNCS, vol. 8297, pp. 158–169. Springer, Heidelberg (2013). http://dx.doi.org/10.1007/978-3-319-03753-0_15 CrossRefGoogle Scholar
- 10.Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer-Verlag New York Inc., Secaucus (2005) Google Scholar
- 11.Qin, Z., Chen, J., Liu, Y., Lu, J.: Evolving RBF neural networks for pattern classification. In: Hao, Y., Liu, J., Wang, Y.-P., Cheung, Y., Yin, H., Jiao, L., Ma, J., Jiao, Y.-C. (eds.) CIS 2005. LNCS (LNAI), vol. 3801, pp. 957–964. Springer, Heidelberg (2005). http://dx.doi.org/10.1007/11596448_142 CrossRefGoogle Scholar
- 13.Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic Press, New York (2008)Google Scholar