Advertisement

Automatic Construction of Radial-Basis Function Networks Through an Adaptive Partition Algorithm

  • Ricardo Ocampo-Vega
  • Gildardo Sanchez-AnteEmail author
  • Luis E. Falcon-Morales
  • Humberto Sossa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9703)

Abstract

Radial-Basis Function Neural Networks (RBFN) are a well known formulation to solve classification problems. In this approach, a feedforward neural network is built, with one input layer, one hidden layer and one output layer. The processing is performed in the hidden and output layers. To adjust the network for any given problem, certain parameters have to be set. The parameters are: the centers of the radial functions associated to the hidden layer and the weights of the connections to the output layer. Most of the methods either require a lot of experimentation or may demand a lot of computational time. In this paper we present a novel method based on a partition algorithm to automatically compute the amount and location of the centers of the radial-basis functions. Our results, obtained by running it in seven public databases, are comparable and even better than some other approaches.

Keywords

Radial-basis functions Neural networks Adaptive parameter adjustment Classification 

Notes

Acknowledgments

The authors thank Tecnológico de Monterrey, Campus Guadalajara, as well as IPN-CIC under project SIP 20161126, and CONACYT under project 155014 and 65 within the framework of call: Frontiers of Science 2015 for the economical support to carry out this research.

References

  1. 1.
    Bishop, C.M., et al.: Pattern Recognition and Machine Learning. Information Science and Statistics, vol. 1. Springer, New York (2006)zbMATHGoogle Scholar
  2. 2.
    Miller, A., Blott, B., et al.: Review of neural network applications in medical imaging and signal processing. Med. Biol. Eng. Comput. 30(5), 449–464 (1992)CrossRefGoogle Scholar
  3. 3.
    Willis, M., Montague, G., Di Massimo, C., Tham, M., Morris, A.: Artificial neural network based predictive control. In: Advanced Control of Chemical Processes (ADCHEM 1991): Selected Papers from the IFAC Symposium, p. 261, 14–16 October 1991. Toulouse, France (2014)Google Scholar
  4. 4.
    Le, T.H.: Applying artificial neural networks for face recognition. Adv. Artif. Neural Syst. 2011, 16 (2011). doi: 10.1155/2011/673016. Article ID 673016Google Scholar
  5. 5.
    Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRefGoogle Scholar
  6. 6.
    Maren, A.J., Harston, C.T., Pap, R.M.: Handbook of Neural Computing Applications. Academic Press, New York (2014)zbMATHGoogle Scholar
  7. 7.
    Haykin, S.: Neural Networks and Learning Machines. Number v. 10 in Neural networks and learning machines. Prentice Hall, Upper Saddle River (2009)Google Scholar
  8. 8.
    Park, J., Sandberg, I.W.: Universal approximation using radial-basis-function networks. Neural Comput. 3(2), 246–257 (1991)CrossRefGoogle Scholar
  9. 9.
    Chen, S., Cowan, C.F., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Networks 2(2), 302–309 (1991)CrossRefGoogle Scholar
  10. 10.
    Moody, J., Darken, C.J.: Fast learning in networks of locally-tuned processing units. Neural Comput. 1(2), 281–294 (1989)CrossRefGoogle Scholar
  11. 11.
    Poggio, T., Girosi, F.: Networks for approximation and learning. Proc. IEEE 78(9), 1481–1497 (1990)CrossRefzbMATHGoogle Scholar
  12. 12.
    Kurban, T., Beşdok, E.: A comparison of RBF neural network training algorithms for inertial sensor based terrain classification. Sensors 9(8), 6312–6329 (2009)CrossRefGoogle Scholar
  13. 13.
    Chun-Tao, M., Kun, W., Li-yong, Z.: A new training algorithm for RBF neural network based on PSO and simulation study. In: WRI World Congress on Computer Science and Information Engineering, vol. 4, pp. 641–645 (2009)Google Scholar
  14. 14.
    Oh, S.K., Kim, W.D., Pedrycz, W., Park, B.J.: Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization. Fuzzy Sets Syst. 163(1), 54–77 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Reiner, P.D.: Algorithms for Optimal Construction and Training of Radial Basis Function Neural Networks. Ph.D. thesis, Auburn University (2015)Google Scholar
  16. 16.
    Sossa, H., Guevara, E.: Efficient training for dendrite morphological neural networks. Neurocomputing 131, 132–142 (2014)CrossRefGoogle Scholar
  17. 17.
    Ritter, G.X., Iancu, L., Urcid, G.: Morphological perceptrons with dendritic structure. In: Proceedings of the IEEE International Conference on Fuzzy Systems, vol. 2, pp. 1296–1301. IEEE (2003)Google Scholar
  18. 18.
    Fun, M.H., Hagan, M.T.: Recursive orthogonal least squares learning with automatic weight selection for Gaussian neural networks. In: Proceedings of the International Joint Conference on Neural Networks, vol. 3, pp. 1496–1500 (1999)Google Scholar
  19. 19.
    Bache, K., Lichman, M.: UCI machine learning repository (2013)Google Scholar
  20. 20.
    Babu, G.S., Suresh, S.: Sequential projection-based metacognitive learning in a radial basis function network for classification problems. IEEE Trans. Neural Netw. Learn. Syst. 24(2), 194–206 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ricardo Ocampo-Vega
    • 1
  • Gildardo Sanchez-Ante
    • 1
    Email author
  • Luis E. Falcon-Morales
    • 1
  • Humberto Sossa
    • 2
  1. 1.Tecnologico de Monterrey, Campus GuadalajaraZapopanMexico
  2. 2.Instituto Politecnico Nacional-CICDistrito FederalMexico

Personalised recommendations