Fuzzy C-Means Algorithm with Divergence-Based Kernel

  • Young-Soo Song
  • Dong-Chul Park
  • Chung Nguyen Tran
  • Hwan-Soo Choi
  • Minsoo Suk
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4223)


A Fuzzy C-Means algorithm with a Divergence-based Kernel (FCMDK) for clustering Gaussian Probability Density Function (GPDF) data is proposed in this paper. The proposed FCMDK is based on the Fuzzy C-Means algorithm and employs a kernel method for data transformation. The kernel method adopted in the proposed FCMDK is used to transform input data into a feature space of a higher dimensionality so that the nonlinear problems residing in input space can be linearly solved in the feature space. In order to deal with GPDF data, a divergence-based kernel employing a divergence distance measure for its similarly measure is used for data transformation. The proposed FCMDK is used for clustering GPDF data in an image classification model. Experiments and results on Caltech data sets demonstrate that the proposed FCMDK is more efficient than other conventional algorithms.


Feature Space Discrete Cosine Transform Gaussian Mixture Model Kernel Method Membership Grade 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kohonen, T.: The Self-Organizing Map. Proc. IEEE 78, 1464–1480 (1990)CrossRefGoogle Scholar
  2. 2.
    Hartigan, J.: Clustering Algorithms. Wiley, New York (1975)MATHGoogle Scholar
  3. 3.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum, New York (1981)MATHGoogle Scholar
  4. 4.
    Muller, K.R., Mika, S., Ratsch, G., Tsuda, K., Scholkopf, B.: An Introduction to Kernel-Based Learning Algorithms. IEEE Transactions on Neural Networks 12(2), 181–201 (2001)CrossRefGoogle Scholar
  5. 5.
    Cover, T.M.: Geomeasureal and Statistical Properties of Systems of Linear Inequalities in Pattern Recognition. Electron. Computing EC-14, 326–334 (1965)Google Scholar
  6. 6.
    Girolami, M.: Mercer Kernel-Based Clustering in Feature Space. IEEE Trans. on Neual Networks 13(3), 780–784 (2002)CrossRefGoogle Scholar
  7. 7.
    Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machine. Cambridge Univ. Press, Cambridge (2000)Google Scholar
  8. 8.
    Chen, J.H., Chen, C.S.: Fuzzy Kernel Perceptron. IEEE Trans. on Neural Networks 13(6), 1364–1373 (2002)CrossRefGoogle Scholar
  9. 9.
    Chen, S., Zhang, D.: Robust Image Segmentation using FCM with Spatial Constraints Based on New Kernel-Induced Distance Measure. IEEE Trans. on Systems, Man and Cybernetics 34(4), 1907–1916 (2004)CrossRefGoogle Scholar
  10. 10.
    Daugman, J.G.: Complete Discrete 2D Gabor Transform by Neural Networks for Image Analysis and Compression. IEEE Trans. on Acoust., Speech, and Signal Processing 36, 1169–11179 (1988)MATHCrossRefGoogle Scholar
  11. 11.
    Pun, C.M., Lee, M.C.: Extraction of Shift Invariant Wavelet Features for Classification of Images with Different Sizes. IEEE Trans. on Pattern Analysis and Machine Intelligence 26(9), 1228–1233 (2004)CrossRefGoogle Scholar
  12. 12.
    Huang, Y.L., Chang, R.F.: Texture Features for DCT-Coded Image Retrieval and Classification. In: ICASSP Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 6, pp. 3013–3016 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Young-Soo Song
    • 1
  • Dong-Chul Park
    • 1
  • Chung Nguyen Tran
    • 1
  • Hwan-Soo Choi
    • 1
  • Minsoo Suk
    • 2
  1. 1.Dept. of Information EngineeringMyong Ji UniversityKorea
  2. 2.School of Info. and Comm. Eng.Sungkyunkwan UniversityKorea

Personalised recommendations