Abstract
This paper proposes Particle Swarm Optimization (PSO) algorithm to discover classification rules. The potential IF-THEN rules are encoded into real-valued particles that contain all types of attributes in data sets. Rule discovery task is formulized into an optimization problem with the objective to get the high accuracy, generalization performance, and comprehensibility, and then PSO algorithm is employed to resolve it. The advantage of the proposed approach is that it can be applied on both categorical data and continuous data. The experiments are conducted on two benchmark data sets: Zoo data set, in which all attributes are categorical, and Wine data set, in which all attributes except for the classification attribute are continuous. The results show that there is on average the small number of conditions per rule and a few rules per rule set, and also show that the rules have good performance of predictive accuracy and generalization ability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases: An overview. Advances in Knowledge Discovery and Data Mining, 1–34 (1996)
Noda, E., Freitas, A.A., Lopes, H.S.: Discovering interesting prediction rules with a genetic algorithm. In: Angeline, P.J., Michalewicz, Z., Schoenauer, M., Yao, X., Zalzala, A. (eds.) Proceedings of the Congress on Evolutionary Computation, Mayflower Hotel, Washington D.C., USA, vol. 2, pp. 1322–1329. IEEE Press, Los Alamitos (1999)
Jong, K.A.D., Spears, W.M., Gordon, G.: Using genetic algorithms for concept learning. Machine Learning 13, 161–188 (1993)
Bojarczuk, C.C., Lopes, H.S., Freitas, F.: Discovering comprehensible classification rules using genetic programming: a cas study in a medical domain. In: Banzhaf, W., Daida, J., Eiben, A.E., Garzon, M.H., Honavar, V., Jakiela, M., Smith, R.E. (eds.) Proc. of the Genetic and Evolutionary Computation Conf. GECCO 1999, pp. 953–958. Morgan Kaufmann, San Francisco (1999)
Freitas, A.A.: A genetic programming framework for two data mining tasks: Classification and generalized rule induction. In: Koza, J.R., Deb, K., Dorigo, M., Fogel, D.B., Garzon, M., Iba, H., Riolo, R.L. (eds.) Genetic Programming 1997: Proceedings of the Second Annual Conference, Stanford University, CA, USA, pp. 96–101. Morgan Kaufmann, San Francisco (1997)
De Falco, I., Della Cioppa, A., Tarantino, E.: Discovering interesting classification rules with genetic programming. Applied Soft Computing 1, 257–269 (2001)
Sousa, T., Neves, A., Silva, A.: Swarm optimisation as a new tool for data mining. In: 17th International Parallel and Distributed Processing Symposium (IPDPS 2003), pp. 144–144. IEEE Computer Society, Los Alamitos (2003)
Sousa, T., Neves, A., Silva, A.: A particle swarm data miner. In: 11th Portuguese Conference on Artificial Intelligence, Workshop on Artificial Life and Evolutionary Algorithms, pp. 43–53 (2003)
Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceeding of IEEE International Conference on Neural Networks (ICNN 1995), Perth, Western Australia, vol. 4, pp. 1942–1947. IEEE, Los Alamitos (1995)
Blake, C., Merz, C.J.: UCI repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Shi, Y., Eberhart, R.C.: A modified particle swarm optimizer. In: IEEE Congress on Evolutionary Computation (CEC 1998), Piscataway, NJ, pp. 69–73. IEEE, Los Alamitos (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, Y., Qin, Z., Shi, Z., Chen, J. (2004). Rule Discovery with Particle Swarm Optimization. In: Chi, CH., Lam, KY. (eds) Content Computing. AWCC 2004. Lecture Notes in Computer Science, vol 3309. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30483-8_35
Download citation
DOI: https://doi.org/10.1007/978-3-540-30483-8_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23898-0
Online ISBN: 978-3-540-30483-8
eBook Packages: Springer Book Archive