Abstract
There is a trend in recent machine learning community to construct a nonlinear version of a linear algorithm using the 'kernel method', e.g. Support Vector Machines (SVMs), kernel principal component analysis, kernel fisher discriminant analysis and the recent kernel clustering algorithms. In unsupervised clustering algorithms using kernel method, typically, a nonlinear mapping is used first to map the data into a potentially much higher feature space, where clustering is then performed. A drawback of these kernel clustering algorithms is thatthe clustering prototypes lie in high dimensional feature space and hence lack clear and intuitive descriptions unless using additional projection approximation from the feature to the data space as done in the existing literatures. In this paper, a novel clustering algorithm using the 'kernel method' based on the classical fuzzy clustering algorithm (FCM) is proposed and called as kernel fuzzy c-means algorithm (KFCM). KFCM adopts a new kernel-induced metric in the data space to replace the original Euclidean norm metric in FCM and the clustered prototypes still lie in the data space so that the clustering results can be reformulated and interpreted in the original space. Our analysis shows that KFCM is robust to noise and outliers and also tolerates unequal sized clusters. And finally this property is utilized to cluster incomplete data. Experiments on two artificial and one real datasets show that KFCM hasbetter clustering performance and more robust than several modifications of FCM for incomplete data clustering.
Similar content being viewed by others
References
Bezdek, J. C.: Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
Wu, K. L. and Yang, M. S.: Alternative c-means clustering algorithms, Pattern Recognition vol. 35, pp. 2267–2278, 2002.
Girolami, M.: Mercer kernel-based clustering in feature space, IEEE Trans. Neual Networks 13(3) (2002), 780–784.
Zhang, L., Zhou, W. D. and Jiao, L. C.: Kernel clustering algorithm, Chinese J. Computers 25(6) (2002), 587–590 (in Chinese).
Zhang, D. Q. and Chen, S. C.: Fuzzy clustering using kernel methods, In: Procedings of Inter. Conf. Controland Automatation (ICCA'02), June 16–19, pp. 123–128, Xiamen, China, 2002.
Muller, K. R. and Mika, S. et al.: An introduction to Kernel-based learning algorithms, IEEE Trans. NeuralNetworks 12(2) (2001), 181–202.
Vapnik, V. N.: StatisticalLearning Theory. Wiley, New York, 1998.
Hathaway, R. J. and Bezdek, J. C.: Clustering incomplete relational data using the non-Euclidean relational fuzzy c-means algorithm. Pattern Recognition Letters 23 (2002), 151–160.
Jain, A. K. and Dubes, R. C.: Algorithms for Clustering Data, Englewood Cliffs, NJ, 1988.
Gaul, W. and Schader, M.: Pyramidal classi.cation based on incomplete data, J. Classification 11 (1994), 171–193.
Schafer, J. L.: Analysis of Incomplete Multivariate Data, Chapman & Hall, London, 1997.
Hathaway, R. J. and Bezdek, J. C.: Fuzzy c-means clustering of incomplete data, IEEE Trans. Syst. Man. Cybernetics 31(5) (2001), 735–744.
Jolliffe, L. T.: PrincipalComponent Analysis, Springer-Verlag, 1986.
Rudin, W.: Principles of Mathematical Analysis, McGraw-Hill Book Company, New York, 1976.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Zhang, DQ., Chen, SC. Clustering Incomplete Data Using Kernel-Based Fuzzy C-means Algorithm. Neural Processing Letters 18, 155–162 (2003). https://doi.org/10.1023/B:NEPL.0000011135.19145.1b
Issue Date:
DOI: https://doi.org/10.1023/B:NEPL.0000011135.19145.1b