Classification Based on Possibilistic Likelihood
Classification models usually associate one class for each new instance. This kind of prediction doesn’t reflect the uncertainty that is inherent in any machine learning algorithm. Probabilistic approaches rather focus on computing a probability distribution over the classes. However, making such a computation may be tricky and requires a large amount of data. In this paper, we propose a method based on the notion of possibilistic likelihood in order to learn a model that associates a possibility distribution over the classes to a new instance. Possibility distributions are here viewed as an upper bound of a family of probability distributions. This allows us to capture the epistemic uncertainty associated with the model in a faithful way. The model is based on a set of kernel functions and is obtained through an optimization process performed by a particle swarm algorithm. We experiment our method on benchmark dataset and compares it with a naive Bayes classifier.
KeywordsParticle Swarm Optimization Benchmark Dataset Epistemic Uncertainty Possibility Distribution Possibility Theory
Unable to display preview. Download preview PDF.
- 2.Borgelt, C., Kruse, R.: Efficient maximum projection of database-induced multivariate possibility distributions. In: Proc. 7th IEEE Int. Conf. on Fuzzy Systems, pp. 663–668 (1998)Google Scholar
- 8.Dubois, D., Prade, H.: On data summarization with fuzzy sets. In: Proc. of the 5th Inter. Fuzzy Systems Assoc. World Congress (IFSA 1993), Seoul, pp. 465–468 (1993)Google Scholar
- 9.Dubois, D., Prade, H., Sandri, S.: On possibility/probability transformations. In: Proceedings of Fourth IFSA Conference, pp. 103–112. Kluwer Academic Publ. (1993)Google Scholar
- 11.Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)Google Scholar
- 12.Langley, P., Iba, W., Thompson, K.: An analysis of bayesian classifiers. In: Proceedings of AAAI 1992, vol. 7, pp. 223–228 (1992)Google Scholar
- 14.Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmman, San Francisco (1988)Google Scholar
- 16.Serrurier, M., Prade, H.: Maximum-likelihood principle for possibility distributions viewed as families of probabilities (regular paper). In: IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Taipei, Taiwan, pp. 2987–2993 (2011)Google Scholar