How to Stop the Evolutionary Process in Evolving Neural Network Ensembles
In practice, two criteria have often been used to stop the evolutionary process in evolving neural network (NN) ensembles. One criterion is to stop the evolution when the maxial generation is reached. The other criterion is to stop the evolution when the evolved NN ensemble, i.e., the whole population, is satisfactory according to a certain evaluation. This paper points out that NN ensembles evolved from these two criteria might not be robust by having different performance. In order to make the evolved NN ensemble more stable, an alternative solution is to combine a number of evolved NN ensembles. Experimental analyses based on n-fold cross-validation have been given to explain why the evolved NN ensembles could be very different and how such difference could disappear or be reduced in the combination.
KeywordsMutual Information Correct Rate Constructive Method Individual Network Pruning Method
Unable to display preview. Download preview PDF.
- 3.Fogel, D.B.: Evolutionary Computation: Towards a New Philosophy of Machine Intelligence. IEEE Press, New York (1995)Google Scholar
- 7.Liu, Y., Yao, X., Zhao, Q., Higuchi, T.: Evolving a cooperative population of neural networks by minimizing mutual information. In: Proc. of the 2001 Conference on Evolutionary Computation, pp. 384–389. IEEE Press, Los Alamitos (2001)Google Scholar
- 8.Liu, Y., Yao, X.: Maintaining population diversity by minimizing mutual information. In: Proceedings of the 2002 Genetic and Evolutionary Computation Conference (GECCO 2002), pp. 652–656. Morgan Kaufmann, San Francisco (2002)Google Scholar
- 11.Wallace, C.S., Patrick, J.D.: Coding decision trees, Technical Report 91/153, Dept. of Computer Science, Monash University, Clayton, Victoria 3168, Australia (1991)Google Scholar