Ensembles of RBFs Trained by Gradient Descent
Building an ensemble of classifiers is an useful way to improve the performance. In the case of neural networks the bibliography has centered on the use of Multilayer Feedforward (MF). However, there are other interesting networks like Radial Basis Functions (RBF) that can be used as elements of the ensemble. Furthermore, as pointed out recently the network RBF can also be trained by gradient descent, so all the methods of constructing the ensemble designed for MF are also applicable to RBF. In this paper we present the results of using eleven methods to construct a ensemble of RBF networks. The results show that the best method is in general the Simple Ensemble.
KeywordsRadial Basis Function Gradient Descent Radial Basis Function Neural Network Ensemble Method Error Reduction
Unable to display preview. Download preview PDF.
- 5.Freund, Y., Schapire, R.: Experiments with a New Boosting Algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148–156 (1996)Google Scholar
- 7.Auda, G., Kamel, M.: EVOL: Ensembles Voting On-Line. In: Proc. of the World Congress on Computational Intelligence, pp. 1356–1360 (1998)Google Scholar
- 8.Liu, Y., Yao, X.: A Cooperative Ensemble Learning System. In: Proc. of the World Congress on Computational Intelligence, pp. 2202–2207 (1998)Google Scholar
- 9.Jang, M., Cho, S.: Ensemble Learning Using Observational Learning Theory. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1281–1286 (1999)Google Scholar