Ensemble Learning Classifier System and Compact Ruleset
The aim of this paper is twofold, to improve the generalization ability, and to improve the readability of learning classifier system. Firstly, an ensemble architecture of LCS (LCSE) is described in order to improve the generalization ability of the original LCS. Secondly, an algorithm is presented for compacting the final classifier population set in order to improve the readability of LCSE, which is an amendatory version of CRA brought by Wilson. Some test experiments are conducted based on the benchmark data sets of UCI repository. The experimental results show that LCSE has better generalization ability than single LCS, decision tree, neural network and their bagging methods. Comparing with the original population rulesets, compact rulesets have readily interpretable knowledge like decision tree, whereas decrease the prediction precision lightly.
KeywordsEnsemble Learn Decision Tree Algorithm Prediction Precision System Ensemble Good Generalization Ability
Unable to display preview. Download preview PDF.
- 1.http://www.cs.waikato.ac.nz/~ml/weka/ (last visit July 23, 2006)
- 3.Gao, Y., Huang, J.Z., Rong, H., Gu, D.: Learning classifier system ensemble for data mining. In: Genetic and Evolutionary Computation Conference (GECCO2005) workshop program, Washington, pp. 63–66. ACM Press, New York (2005)Google Scholar
- 8.Wilson, S.W.: Compact rulesets from xcsi. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2001. LNCS (LNAI), vol. 2321, pp. 192–210. Springer, Heidelberg (2002)Google Scholar