An Automatic Programming ACO-Based Algorithm for Classification Rule Mining

  • Juan Luis Olmo
  • José María Luna
  • José Raúl Romero
  • Sebastián Ventura
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 71)


In this paper we present a novel algorithm, named GBAP, that jointly uses automatic programming with ant colony optimization for mining classification rules. GBAP is based on a context-free grammar that properly guides the search process of valid rules. Furthermore, its most important characteristics are also discussed, such as the use of two different heuristic measures for every transition rule, as well as the way it evaluates the mined rules. These features enhance the final rule compilation from the output classifier. Finally, the experiments over 17 diverse data sets prove that the accuracy values obtained by GBAP are pretty competitive and even better than those resulting from the top Ant-Miner algorithm.


Genetic Programming Rule Mining Transition Rule Automatic Programming Pheromone Amount 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ávila, J., Gibaja, E., Zafra, A., Ventura, S.: A niching algorithm to learn discriminant functions with multi-label patterns. In: Corchado, E., Yin, H. (eds.) IDEAL 2009. LNCS, vol. 5788, pp. 570–577. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Banzhaf, W., Nordin, P., Keller, R.E., Francone, F.D.: Genetic Programming - An Introduction; On the Automatic Evolution of Computer Programs and its Applications. Morgan Kaufmann, San Francisco (1998)zbMATHGoogle Scholar
  3. 3.
    Clark, P., Boswell, R.: Rule induction with CN2: Some recent improvements. In: Kodratoff, Y. (ed.) EWSL 1991. LNCS, vol. 482, pp. 151–163. Springer, Heidelberg (1991)CrossRefGoogle Scholar
  4. 4.
    Dorigo, M., Blum, C.: Ant colony optimization theory: a survey. Theoretical Computer Science 344, 243–278 (2005)zbMATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    Espejo, P.G., Ventura, S., Herrera, F.: A survey on the application of genetic programming to classification. IEEE Transactions on System, Man and Cybernetics Part C (2008) (in press)Google Scholar
  6. 6.
    Geyer-Schulz, A.: Fuzzy Rule-Based Expert Systems and Genetic Machine Learning. Studies in Fuzziness, vol. 3. Physica-Verlag, Heidelberg (1995)Google Scholar
  7. 7.
    Kotsiantis, S.B., Zaharakis, I.D., Pintelas, P.E.: Machine learning: a review of classification and combining techniques. Artificial Intelligence Reviews 26, 159–190 (2006)CrossRefGoogle Scholar
  8. 8.
    Koza, J.R.: Genetic programming: on the programming of computers by means of natural selection. The MIT Press, Cambridge (1992)zbMATHGoogle Scholar
  9. 9.
    Larose, D.T.: Discovering Knowledge in Data: An Introduction to Data Mining. Wiley, Chichester (2005)zbMATHGoogle Scholar
  10. 10.
    Parpinelli, R., Freitas, A.A., Lopes, H.S.: Data mining with an ant colony optimization algorithm. IEEE Trans. on Evolutionary Computation 6, 321–332 (2002)CrossRefGoogle Scholar
  11. 11.
    Roux, O., Fonlupt, C.: Ant programming: or how to ants for automatic programming. In: Dorigo, M., et al. (eds.) ANTS 2000, pp. 121–129 (2000)Google Scholar
  12. 12.
    Witten, I.H., Frank, E.: Data Mining Practical Machine Learning Tools and Techniques. Morgan Kauffman, San Francisco (2005)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Juan Luis Olmo
    • 1
  • José María Luna
    • 1
  • José Raúl Romero
    • 1
  • Sebastián Ventura
    • 1
  1. 1.Dept. of Computer Science and Numerical AnalysisUniversity of CordobaCordobaSpain

Personalised recommendations