A Method to Enhance the ‘Possibilistic C-Means with Repulsion’ Algorithm based on Cluster Validity Index
- 2 Citations
- 973 Downloads
Abstract
In this paper, we examine the performance of fuzzy clustering algorithms as the major technique in pattern recognition. Both possibilistic and probabilistic approaches are explored. While the Possibilistic C-Means (PCM) has been shown to be advantageous over Fuzzy C-Means (FCM) in noisy environments, it has been reported that the PCM has an undesirable tendency to produce coincident clusters. Recently, an extension of the PCM has been presented by Timm et al., by introducing a repulsion term. This approach combines the partitioning property of the FCM with the robust noise insensibility of the PCM. We illustrate the advantages of both the possibilistic and probabilistic families of algorithms with several examples and discuss the PCM with cluster repulsion. We provide a cluster valid-ity function evaluation algorithm to solve the problem of parameter optimization. The algorithm is especially useful for the unsupervised case, when labeled data is unavailable.
Keywords
Fuzzy Cluster Membership Degree Cluster Validity Validity Function Possibilistic ApproachPreview
Unable to display preview. Download preview PDF.
References
- [1]Jain, A. K. and Dubes, R. C. (1988), Algorithms for clustering data, Prentice Hall, New Jersey.zbMATHGoogle Scholar
- [2]Zadeh, L. A. (1965), “Fuzzy Sets,” Information and Control, vol. 8, pp. 338–353.zbMATHMathSciNetCrossRefGoogle Scholar
- [3]Bezdek, J. C., (1982), Pattern recognition with fuzzy objective function algorithms, Plenum Press, New York.zbMATHGoogle Scholar
- [4]Krishnapuram, R. and Keller, J. (1993), “A possibilistic approach to clustering,” IEEE Trans. Fuzzy Systems, vol. 1, pp. 98–110.CrossRefGoogle Scholar
- [5]Timm, H., Borgelt, C. and Kruse, R. (2001), “Fuzzy cluster analysis with cluster repulsion,” In Proc. of the European Symp. on Intelligent Tech., Hybrid Syst. and their implementation on Smart Adapt. Syst., Tenerife, Spain.Google Scholar
- [6]Krishnapuram, R. and Keller, J. (1996), “The Possibilistic C-Means algorithm: Insights and recommendations”, IEEE Trans. Fuzzy Systems, vol. 4, pp. 385–393.CrossRefGoogle Scholar
- [7]Barni, M., Cappellini V., and Mecocci, A. (1996), “Comments on ‘A Possibilistic Approach to Clustering’,” IEEE Trans. Fuzzy Systems, vol. 4, pp. 393–396.CrossRefGoogle Scholar
- [8]Bezdek, J. C. and Pal, N. R. (1998), “Some New Indexes of Cluster Validity,” IEEE Trans, on SMC, Part B, vol. 28, no.3, pp. 301–315.Google Scholar
- [9]Dave, R. N. and Krishnapuram, R. (1997), “Robust clustering methods: a unified view,” IEEE Trans. Fuzzy Systems, vol. 5 no. 2, pp.270–293.CrossRefGoogle Scholar
- [10]Fisher, R. (1936), “The use of multiple measurements in taxonomic problems,” Annals of Eugenics, vol.7, no. 2, 179–188.Google Scholar
- [11]Merz, C. J. and Murphy, P. M. (1996), UCI Repository of Machine Learning Databases, http://www.ics.uci.edu/~mlearn/MLRepository.html, University of California, Department of Information and computer Science.Google Scholar