Semi-supervised Agglomerative Hierarchical Clustering Using Clusterwise Tolerance Based Pairwise Constraints

  • Yukihiro Hamasuna
  • Yasunori Endo
  • Sadaaki Miyamoto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6408)


Recently, semi-supervised clustering has been remarked and discussed in many researches. In semi-supervised clustering, pairwise constraints, that is, must-link and cannot-link are frequently used in order to improve clustering results by using prior knowledges or informations. In this paper, we will propose a clusterwise tolerance based pairwise constraint. In addition, we will propose semi-supervised agglomerative hierarchical clustering algorithms with centroid method based on it. Moreover, we will show the effectiveness of proposed method through numerical examples.


semi-supervised clustering agglomerative hierarchical clustering centroid method clusterwise tolerance pairwise constraints 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chapelle, O., Schölkopf, B., Zien, A. (eds.): Semi-Supervised Learning. MIT Press, Cambridge (2006)Google Scholar
  2. 2.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)CrossRefzbMATHGoogle Scholar
  3. 3.
    Miyamoto, S., Ichihashi, H., Honda, K.: Algorithms for Fuzzy Clustering. Springer, Heidelberg (2008)zbMATHGoogle Scholar
  4. 4.
    Wagstaff, K., Cardie, C., Rogers, S., Schroedl, S.: Constrained k-means clustering with background knowledge. In: Proc. of the 18th International Conference on Machine Learning (ICML 2001), pp. 577–584 (2001)Google Scholar
  5. 5.
    Basu, S., Banerjee, A., Mooney, R.J.: Active semi-supervision for pairwise constrained clustering. In: Proc. of the SIAM International Conference on Data Mining (SDM 2004), pp. 333–344 (2004)Google Scholar
  6. 6.
    Basu, S., Bilenko, M., Mooney, R.J.: A probabilistic framework for semi-supervised clustering. In: Proc. of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2004), pp. 59–68 (2004)Google Scholar
  7. 7.
    Miyamoto, S., Yamazaki, M., Terami, A.: On semi-supervised clustering with pairwise constraints. In: Proc. of The 7th International Conference on Modeling Decisions for Artificial Intelligence (MDAI 2009), pp. 245–254 (2009) (CD-ROM)Google Scholar
  8. 8.
    Endo, Y., Hamasuna, Y., Yamashiro, M., Miyamoto, S.: On semi-supervised fuzzy c-means clustering. In: Proc. of 2009 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2009), pp. 1119–1124 (2009)Google Scholar
  9. 9.
    Yan, B., Domeniconi, C.: An adaptive kernel method for semi-supervised clustering. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS (LNAI), vol. 4212, pp. 521–532. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    Kulis, B., Basu, S., Dhillon, I., Mooney, R.: Semi-supervised graph clustering: a kernel approach. Machine Learning 74(1), 1–22 (2009)CrossRefGoogle Scholar
  11. 11.
    Talavera, L., Béjar, J.: Integrating declarative knowledge in hierarchical clustering tasks. In: Hand, D.J., Kok, J.N., Berthold, M.R. (eds.) IDA 1999. LNCS, vol. 1642, pp. 211–222. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  12. 12.
    Klein, D., Kamvar, S., Manning, C.: From instance-level constraints to space-level constraints: making the most of prior knowledge in data clustering. In: Proc. of the 19th International Conference on Machine Learning (ICML 2002), pp. 307–314 (2002)Google Scholar
  13. 13.
    Davidson, I., Ravi, S.S.: Agglomerative hierarchical clustering with constraints: theoretical and empirical results. In: Proc. of 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (KDD 2005), pp. 59–70 (2005)Google Scholar
  14. 14.
    Hamasuna, Y., Endo, Y., Miyamoto, S.: On Tolerant Fuzzy c-Means. Journal of Advanced Computational Intelligence and Intelligent Informatics (JACIII) 13(4), 421–427 (2009)CrossRefGoogle Scholar
  15. 15.
    Endo, Y., Murata, R., Haruyama, H., Miyamoto, S.: Fuzzy c-Means for Data with Tolerance. In: Proc. of International Symposium on Nonlinear Theory and Its Applications (Nolta 2005), pp. 345–348 (2005)Google Scholar
  16. 16.
    Miyamoto, S.: Fuzzy Sets in Information Retrieval and Cluster Analysis. Kluwer, Dordrecht (1990)CrossRefzbMATHGoogle Scholar
  17. 17.
    Miyamoto, S.: Introduction to Cluster Analysis: Theory and Applications of Fuzzy Clustering, Morikita-Shuppan, Tokyo (1999) (in Japanese)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Yukihiro Hamasuna
    • 1
    • 2
  • Yasunori Endo
    • 1
  • Sadaaki Miyamoto
    • 1
  1. 1.Department of Risk Engineering, Faculty of Systems and Information EngineeringUniversity of TsukubaTsukubaJapan
  2. 2.Research Fellow of the Japan Society for the Promotion of ScienceJapan

Personalised recommendations