Abstract
In this chapter, we present a multiobjective evolutionary algorithm based design procedure for radial-basis function neural networks. A Hierarchical Rank Density Genetic Algorithm (HRDGA) is proposed to evolve the neural network’s topology and parameters simultaneously. Compared with traditional genetic algorithm based designs for neural networks, the hierarchical approach addresses several deficiencies highlighted in literature. In addition, the rank-density based fitness assignment technique is used to optimize the performance and topology of the evolved neural network to tradeoff between the training performance and network complexity. Instead of producing a single optimal solution, HRDGA provides a set of near-optimal neural networks to the designers so that they can have more flexibility for the final decision-making based on certain preferences. In terms of searching for a near-complete set of candidate networks with high performances, the networks designed by the proposed algorithm prove to be competitive, or even superior, to three state-of-the-art designs for radial-basis function neural networks to predict Mackey-Glass chaotic time series.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
R.K. Belew, J. McInerney, N.N. Schraudolph. Evolving networks: Using genetic algorithms with connectionist learning, CSE Technical Report, University of California at Dan Diego, CS90–174, 1990
A.W. Bruce, D.C. Timothy. Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction. IEEE Transactions Neural Networks, 7:869–880, 1996
E.J. Chang, R.P. Lippmann. Using genetic algorithms to improve pattern classification performance. Neural Information Processing Systems, 797–803, 1991
S. Chen, C.F. Cowan, P.M. Grant. Orthogonal least square learning algorithm for radial basis function networks. IEEE Trans. Neural Networks, 2:302–309, 1991
D. Dasgupta, D.R. McGregor. Designing application-specific neural networks using the structured genetic algorithm. In: Proc. Int. Workshop on Combinations of Genetic Algorithms and Neural Networks, pp.87–96, 1992
A. Doering, M. Galicki, H. Witte. Structure optimization of neural networks with the A*-Algorithm. IEEE Trans. Neural Networks, 8:1434–1445, 1997
C.M. Fonseca, P.J. Fleming. An overview of evolutionary algorithms in multiobjective optimization. Evolutionary Computation, 3:1–16, 1995
X.M. Gao, S.J. Ovaska, Z.O. Hartimo. Speech signal restoration using an optimal neural network structure. In: Proc. of the IEEE Int. Conf. Neural Networks, pp.1841–1846, 1996
S. Geman, E. Bienenstock , R. Dousat. Neural networks and the bias/variance dilemma. Neural Computation, 2:303–314, 1989
C.L. Hwang, A.S.M. Masud. Multiple objective decision making—methods and applications. Springer, Berlin
T. Kaylani, S. Dasgupta. A new method for initializing radial basis function classifiers. In: Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, pp.2584- 2587, 1994
T.Y. Ke, K.S. Tang, K.F. Man, P.C. Luk. Hierarchical genetic fuzzy controller for a solar power plant. In: Proc. IEEE Int. Symp. Industrial Electronics, pp.584–588, 1998
J.D. Kelly, L. Davis. Hybridizing the genetic algorithm and the K-nearest neighbors classification algorithm. In: Proc. Intl. Conf. Genetic Algorithms, pp.377–383, 1991
T. Krink, R.K. Ursem. Parameter control using agent based patchwork model. In: Proc. IEEE Congress on Evolutionary Computation, pp.77–83, 2000
S. Lucas. Specifying intrinsically adaptive architectures. In: Proc. 1st IEEE Symp. Combination of Evolutionary Computation and Neural Networks, pp.224–231, 2000
G.F. Miller, P.M. Todd, S.U. Hedge. Designing neural networks using genetic algorithms. In: Proc. 3rd Int. Conf. Genetic Algorithms, pp.379–384, 1989
S.W. Moon, S.G. Kong. Block-based neural network. IEEE Transactions on Neural Networks, 12:307–317, 2001
A.K. Morales. Non-standard norms in genetically trained neural networks. In: Proc. IEEE Symp. Combination of Evolutionary Computation and Neural Networks, pp.43–51, 2000
N. Murata, S. Yoshizawa, S. Amari. Network information criterion - determining the number of hidden units for an artificial neural network model. IEEE Transactions on Neural Networks, 5:865–872, 1994
P.D. Wasserman. Advanced Method in Neural Computing. VNR, New York, 1993
D. Whitley, T. Starkweather, C. Bogart. Genetic algorithms and neural networks: optimizing connections and connectivity. Parallel Computting, 14:347–361, 1990
X. Yao. Evolving artificial neural network. International Journal of Neural Systems. 4:203–222, 1993
G.G. Yen, H. Lu. Hierarchical genetic algorithm based neural network design. In: Proc. IEEE Symp. Combination of Evolutionary Computation and Neural Networks, pp.168–175, 2000
B. Zhang, D. Cho. Evolving neural trees for time series prediction using Bayesian evolutionary algorithms. In: Proc. IEEE Symp. Combination of Evolutionary Computation and Neural Networks, 17–23, 2000
E. Zitzler, L. Thiele. Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach. IEEE Trans. Evolutionary Computation, 3:257–271, 1999
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer
About this chapter
Cite this chapter
Yen, G.G. (2006). Multi-Objective Evolutionary Algorithm for Radial Basis Function Neural Network Design. In: Jin, Y. (eds) Multi-Objective Machine Learning. Studies in Computational Intelligence, vol 16. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-33019-4_10
Download citation
DOI: https://doi.org/10.1007/3-540-33019-4_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30676-4
Online ISBN: 978-3-540-33019-6
eBook Packages: EngineeringEngineering (R0)