A Performance Study of Gaussian Kernel Classifiers for Data Mining Applications
Radial basis function (RBF) models have been successfully employed to study a broad range of data mining problems and benchmark data sets for real world scientific and engineering applications. In this paper we investigate RBF models with Gaussian kernels by developing classifiers in a systematic way. In particular, we employ our newly developed RBF design algorithm for a detailed performance study and sensitivity analysis of the classification models for the popular Monk’s problems. The results show that the accuracy of our classifiers is very impressive while our classification approach is systematic and easy to implement. In addition, differing complexity of the three Monk’s problems is clearly reflected in the classification error surfaces for test data. By exploring these surfaces, we acquire better understanding of the data mining classification problems. Finally, we study the error surfaces to investigate trade-offs between different choices of model parameters to develop efficient and parsimonious models for a given application.
KeywordsRadial Basis Function Test Error Training Error Error Surface Learn Classifier System
Unable to display preview. Download preview PDF.
- 1.Goel, A.L., Shin, M.: Radial basis functions: an algebraic approach (with data mining applications). In: Tutorial notes, European conference on Machine Learning, September 2004, Pisa, Italy (2004)Google Scholar
- 4.Thrun, S.B., et al.: The Monk’s problems: a performance comparison of different learning algorithms. Technical Report CMU-CS-91-197, Carnegie Mellon University (1991)Google Scholar
- 7.Xiong, H., Swamy, M.N.S., Ahmad, M.O.: Optimizing the kernel in the empirical feature space. IEEE Trans. on Neural Networks (March 2005)Google Scholar
- 8.Mitchell, M.W.: An architecture for situated learning agents. Ph.D. Dissertation, Monash University, Australia (2003)Google Scholar
- 10.Toh, K., Tran, Q.-L., Srinivasan, O.: Benchmarking a reduced multivariate polynomial pattern classifier. IEEE Trans. on Pattern Analysis and Machine Intelligence 16(2), 460–474 (2005)Google Scholar
- 11.UCI machine learning data repository. http://www.ics.uci.edu/~mlearn/MLRepository.html