A Comparative Study of Local Classifiers Based on Clustering Techniques and One-Layer Neural Networks
In this article different approximations of a local classifier algorithm are described and compared. The classification algorithm is composed by two different steps. The first one consists on the clustering of the input data by means of three different techniques, specifically a k-means algorithm, a Growing Neural Gas (GNG) and a Self-Organizing Map (SOM). The groups of data obtained are the input to the second step of the classifier, that is composed of a set of one-layer neural networks which aim is to fit a local model for each cluster. The three different approaches used in the first step are compared regarding several parameters such as its dependence on the initial state, the number of nodes employed and its performance. In order to carry out the comparative study, two artificial and three real benchmark data sets were employed.
KeywordsLocal Model Radial Basis Function Breast Cancer Dataset Nonlinear Activation Function Input Data Point
Unable to display preview. Download preview PDF.
- 1.Hecht-Nielsen, R.: Neurocomputing. Addison-Wesley, Reading, MA (1990)Google Scholar
- 2.Ridella, S., Rovetta, S., Zunino, R.: The k-winner machine model. In: IJCNN 2000. Int. Joint Conference on Neural Networks, vol. 1, pp. 106–111. IEEE, Los Alamitos (2000)Google Scholar
- 3.Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004)Google Scholar
- 4.Carpenter, G., Grossberg, S.: The art of adaptive pattern recognition by a self-organizing neural network. IEEE Computer 21(3), 77–88 (1988)Google Scholar
- 12.Newman, D., Hettich, S., Blake, C., Merz, C.: UCI repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
- 13.MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: 5-th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. University of California Press, Berkeley (1967)Google Scholar
- 14.Fritzke, B.: A growing neural gas network learns topologies. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (eds.) Advances in Neural Information Processing Systems 7 (NIPS 1994), pp. 625–632. MIT Press, Cambridge, MA (1995)Google Scholar
- 15.Rodríguez-Pena, R.M., Pérez-Sánchez, B., Fontenla-Romero, O.: A novel local classification method using growing neural gas and proximal support vector machines. In: IJCNN 2007. Int. Joint Conference on Neural Networks, IEEE, Los Alamitos (2007)Google Scholar
- 16.Computational Intelligence Laboratory, Department of Informatics, Nicolaus Copernicus University: Datasets used for classification: comparison of results (Last access July 17, 2007), http://www.fizyka.umk.pl/kmk/projects/datasets.html