Automatic Design of Radial Basis Function Networks Through Enhanced Differential Evolution

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9121)

Abstract

During the creation of a classification model, it is vital to keep track of numerous parameters and to produce a model based on the limited knowledge inferred often from very confined data. Methods which aid the construction or completely build the classification model automatically, present a fairly common research interest. This paper proposes an approach that employs differential evolution enhanced through the incorporation of additional knowledge concerning the problem in order to design a radial basis neural network. The knowledge is inferred from the unsupervised learning procedure which aims to ensure an initial population of good solutions. Also, the search space is dynamically adjusted i.e. narrowed during runtime in terms of the decision variables count. The results obtained on several datasets suggest that the proposed approach is able to find well performing networks while keeping the structure simple. Furthermore, a comparison with a differential evolution algorithm without the proposed enhancements and a particle swarm optimization algorithm was carried out illustrating the benefits of the proposed approach.

Keywords

Differential evolution Initial population k-means Neural network Radial basis function 

Notes

Acknowledgments

This work was supported by research project grant No. 165-0362980-2002 from the Ministry of Science, Education and Sports of the Republic of Croatia.

References

  1. 1.
    Bache, K., Lichman, M.: UCI machine learning repository (2013). http://archive.ics.uci.edu/ml
  2. 2.
    Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press Inc., New York (1995) Google Scholar
  3. 3.
    Huang, C.M., Hsieh, C.T., Wang, Y.S.: Evolution of radial basic function neural network for fast restoration of distribution systems with load variations. Electr. Power Energy Syst. 33(4), 961–968 (2011)Google Scholar
  4. 4.
    Ince, T., Kiranyaz, S., Gabbouj, M.: Evolutionary RBF classifier for polarimetric SAR images. Expert Syst. Appl. 39(5), 4710–4717 (2012). http://dx.doi.org/10.1016/j.eswa.2011.09.082 Google Scholar
  5. 5.
    Korürek, M., Doğan, B.: ECG beat classification using particle swarm optimization and radial basis function neural network. Expert Syst. Appl. 37(12), 7563–7569 (2010)Google Scholar
  6. 6.
    Martinović, G., Bajer, D.: Impact of NNA implementation on GA performance for the TSP. In: 5th International Conference on Bioinspired Optimization Methods and their Applications, pp. 173–184. Jožef Štefan Institute, Ljubljana, Slovenia (2012)Google Scholar
  7. 7.
    Martinović, G., Bajer, D.: Data clustering with differential evolution incorporating macromutations. In: Panigrahi, B.K., Suganthan, P.N., Das, S., Dash, S.S. (eds.) SEMCCO 2013, Part I. LNCS, vol. 8297, pp. 158–169. Springer, Heidelberg (2013). http://dx.doi.org/10.1007/978-3-319-03753-0_15 CrossRefGoogle Scholar
  8. 8.
    Martinović, G., Bajer, D., Zorić, B.: A differential evolution approach to dimensionality reduction for classification needs. Int. J. Appl. Math. Comput. Sci. 24(1), 111–122 (2014). http://dx.doi.org/10.2478/amcs-2014-0009 MATHMathSciNetGoogle Scholar
  9. 9.
    Naveen, N., Ravi, V., Rao, C.R., Chauhan, N.: Differential evolution trained radial basis function network: application to bankruptcy prediction in banks. Int. J. Bio-Inspired Comput. 2(3/4), 222–232 (2010). http://dx.doi.org/10.1504/IJBIC.2010.033090 Google Scholar
  10. 10.
    Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer-Verlag New York Inc., Secaucus (2005) Google Scholar
  11. 11.
    Qin, Z., Chen, J., Liu, Y., Lu, J.: Evolving RBF neural networks for pattern classification. In: Hao, Y., Liu, J., Wang, Y.-P., Cheung, Y., Yin, H., Jiao, L., Ma, J., Jiao, Y.-C. (eds.) CIS 2005. LNCS (LNAI), vol. 3801, pp. 957–964. Springer, Heidelberg (2005). http://dx.doi.org/10.1007/11596448_142 CrossRefGoogle Scholar
  12. 12.
    Storn, R., Price, K.: Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4), 341–359 (1997). http://dx.doi.org/10.1023/A:1008202821328 MATHMathSciNetGoogle Scholar
  13. 13.
    Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic Press, New York (2008)Google Scholar
  14. 14.
    Zheng, S., Li, Z., Wang, H.: A genetic fuzzy radial basis function neural network for structural health monitoring of composite laminated beams. Expert Syst. Appl. 38(9), 11837–11842 (2011). http://dx.doi.org/10.1016/j.eswa.2011.03.072 Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Dražen Bajer
    • 1
  • Bruno Zorić
    • 1
  • Goran Martinović
    • 1
  1. 1.Faculty of Electrical EngineeringJ.J. Strossmayer University of OsijekOsijekCroatia

Personalised recommendations