Fuzzy Gaussian Process Classification Model
Soft labels allow a pattern to belong to multiple classes with different degrees. In many real world applications the association of a pattern to multiple classes is more realistic; to describe overlap and uncertainties in class belongingness. The objective of this work is to develop a fuzzy Gaussian process model for classification of soft labeled data. Gaussian process models have gained popularity in the recent years in classification and regression problems and are example of a flexible, probabilistic, non-parametric model with uncertainty predictions. Here we derive a fuzzy Gaussian model for a two class problem and then explain how this can be extended to multiple classes. The derived model is tested on different fuzzified datasets to show that it can adopt to various classification problems. Results reveal that our model outperforms the fuzzy K-Nearest Neighbor (FKNN), applied on the fuzzified dataset, as well as the Gaussian process and the K-Nearest Neighbor models used with crisp labels.
KeywordsFuzzy Classification Gaussian Process(es) Soft labels
Unable to display preview. Download preview PDF.
- 3.El Gayar, N.: Fuzzy Neural Network Models for Unsupervised and Confidence-Based Learning. PhD thesis, Dept. of Comp. Sc., University of Alexandria (1999)Google Scholar
- 5.Kuncheva, L.: Fuzzy classifier design. Physica-verlag (2000)Google Scholar
- 7.Borasca, B., Bruzzone, L., Carlin, L., Zusi, M.: A fuzzy-input fuzzy-output svm technique for classification of hyperspectral remote sensing images. In: NORSIG 2006, Reykjavk (2006)Google Scholar
- 10.Villmann, T., Hammer, B., Schleif, F., Geweniger, T.: Fuzzy labeled neural gas for fuzzy classification. In: WSOM 2005, Paris, France, September 2005, pp. 283–290 (2005)Google Scholar
- 11.Villmann, T., Schleif, F., Hammer, B.: Fuzzy labeled soft nearest neighbor classification with relevance learning. In: ICMLA 2005, December 2005, pp. 11–15. IEEE Press, Los Angeles, USA (2005)Google Scholar
- 14.Rasmussen, C., Williamsm, C.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)Google Scholar
- 15.Fisher, R.: The use of multiple measurements in taxonomic problems. Annual Eugenics 7, Part II, 179–188 (1936)Google Scholar
- 16.Murphy, P., Aha, D.: UCI repository of machine learning databases. PhD thesis, University of California, Dept. of Information and Computer Science, Irvine, CA (1992)Google Scholar
- 17.Merz, J., Murphy, P.: UCI repository of machine learning databases (1996), http://www.ics.uci.edu/learn/MLRepository.html