Clustering with XCS and Agglomerative Rule Merging

  • Liangdong Shi
  • Yinghuan Shi
  • Yang Gao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5788)


In this paper, we present a more effective approach to clustering with eXtended Classifier System (XCS) which is divided into two phases. The first phase is the XCS learning process with rule compact, during which we alter the XCS mechanisms and propose a new way to calculate rewards. After learning, the rules are evolved to form the final population consisting of rules with homogeneous data distribution. The second phase is merging the learnt rules to generate final clusters. We achieve this by modelling the rules as sub-graphs and merging the sub-graphs based on some criteria similar to CHAMELEON. Experimental results validate the effectiveness on a number of datasets, which contain clusters of different shapes, densities and distances.


clustering Learning Classifier System genetic algorithm reinforcement learning rule merging 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wilson, S.W.: Classifier fitness based on accuracy. Evolutionary Computation 3(2), 149–175 (1995)CrossRefGoogle Scholar
  2. 2.
    Wilson, S.W.: Get real! xcs with continuous-valued inputs. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 1999. LNCS (LNAI), vol. 1813, pp. 209–222. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  3. 3.
    Bernadó-Mansilla, E., Garrell-Guiu, J.M.: Accuracy-based learning classifier systems: Models, analysis and applications to classification tasks. Evolutionary Computation 11(3), 209–238 (2003)CrossRefGoogle Scholar
  4. 4.
    Butz, M.V.: Learning classifier systems. In: Proceedings of the 2007 GECCO conference companion on Genetic and evolutionary computation (2007)Google Scholar
  5. 5.
    Sarafis, I.A., Trinder, P.W., Zalzala, A.M.S.: Nocea: A rule-based evolutionary algorithm for efficient and effective clustering of massive high-dimensional databases. Appl. Soft Comput. 7(3), 668–710 (2007)CrossRefGoogle Scholar
  6. 6.
    Tamee, K., Bull, L., Pinngern, O.: Towards clustering with xcs. In: Proceedings of the 9th Genetic and Evolutionary Computation Conference, pp. 1854–1860 (2007)Google Scholar
  7. 7.
    Shi, L., Gao, Y., Wu, L., Shang, L.: Clustering with xcs on complex structure dataset. In: Australasian Joint Conference on Artificial Intelligence, pp. 489–499 (2008)Google Scholar
  8. 8.
    Karypis, G., Han, E.H., Kumar, V.: Chameleon: Hierarchical clustering using dynamic modeling. IEEE Computer 32(8), 68–75 (1999)CrossRefGoogle Scholar
  9. 9.
    Wilson, S.W.: Compact rulesets from xcsi. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2001. LNCS (LNAI), vol. 2321, pp. 197–210. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  10. 10.
    Gao, Y., Huang, J.Z., Wu, L.: Learning classifier system ensemble and compact rule set. Connect. Sci. 19(4), 321–337 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Liangdong Shi
    • 1
  • Yinghuan Shi
    • 1
  • Yang Gao
    • 1
  1. 1.State Key Laboratory for Novel Software TechnologyNanjing UniversityJiangsuChina

Personalised recommendations