Abstract
In this paper, a new hybrid metaheuristic learning algorithm is introduced to choose the best parameters for the classification method PROAFTN. PROAFTN is a multi-criteria decision analysis (MCDA) method which requires values of several parameters to be determined prior to classification. These parameters include boundaries of intervals and relative weights for each attribute. The proposed learning algorithm, identified as PSOPRO-RVNS as it integrates particle swarm optimization (PSO) and Reduced Variable Neighborhood Search (RVNS), is used to automatically determine all PROAFTN parameters. The combination of PSO with RVNS allows to improve the exploration capabilities of PSO by setting some search points to be iteratively re-explored using RVNS. Based on the generated results, experimental evaluations show that PSOPRO-RVNS outperforms six well-known machine learning classifiers in a variety of problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aha, D.: Lazy learning. Kluwer Academic Publishers, Dordrecht (1997)
Al-Obeidat, F., Belacel, N., Mahanti, P., Carretero, J.A.: Discretization techniques and genetic algorithm for learning the classification method proaftn. In: Eighth International Conference On Machine Learning and Applications, pp. 685–688. IEEE, Los Alamitos (2009)
Alpaydin, E.: Introduction to machine learning. MIT Press, Cambridge (2004)
Asuncion, A., Newman, D.J.: UCI machine learning repository (2007)
Belacel, N.: Multicriteria Classification methods: Methodology and Medical Applications. PhD thesis, Free University of Brussels, Belgium (1999)
Belacel, N.: Multicriteria assignment method PROAFTN: methodology and medical application. European Journal of Operational Research 125(1), 175–183 (2000)
Belacel, N., Boulassel, M.: Multicriteria fuzzy assignment method: A useful tool to assist medical diagnosis. Artificial Intelligence in Medicine 21(1-3), 201–207 (2001)
Belacel, N., Raval, H., Punnen, A.: Learning multicriteria fuzzy classification method PROAFTN from data. Computers and Operations Research 34(7), 1885–1898 (2007)
Belacel, N., Vincke, P., Scheiff, M., Boulassel, M.: Acute leukemia diagnosis aid using multicriteria fuzzy assignment methodology. Computer Methods and Programs in Biomedicine 64(2), 145–151 (2001)
Belacel, N., Wang, Q., Richard, R.: Web-integration of PROAFTN methodology for acute leukemia diagnosis. Telemedicine Journal and e-Health 11(6), 652–659 (2005)
Cooper, G., Herskovits, E.: A bayesian method for the induction of probabilistic networks from data. Machine Learning 9(4), 309–347 (1992)
Demšar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1–30 (2006)
Eberhart, R., Kennedy, J.: Particle swarm optimization. In: Proc. of the 1995 IEEE Int. Conf. on Neural Networks, vol. 4, pp. 1942–1948 (1995)
Fenton, N.E., Wang, W.: Risk and confidence analysis for fuzzy multicriteria decision making. Knowledge-Based Systems 19(6), 430–437 (2006)
Hansen, P., Mladenovic, N.: Variable neighborhood search for the p-median. Location Science 5(4), 207–226 (1997)
Hansen, P., Mladenovic, N.: Variable neighborhood search: Principles and applications. European Journal of Operational Research 130(3), 449–467 (2001)
Jabeur, K., Guitouni, A.: A generalized framework for concordance/discordance-based multi-criteria classification methods. In: 2007 10th International Conference on Information Fusion, July 2007, pp. 1–8 (2007)
Kennedy, J., Eberhart, R.C.: Swarm intelligence. Morgan Kaufmann Pubs., San Francisco (2001)
Pang, S., Kim, D., Bang, S.Y.: Face membership authentication using SVM classification tree generated by membership-based lle data partition. IEEE Transactions on Neural Networks 16(2), 436–446 (2005)
Poli, R.: Analysis of the publications on the applications of particle swarm optimisation. Journal of Artificial Evolution and Applications 8(2), 1–10 (2008)
Quinlan, J.R.: Improved use of continuous attributes in C4.5. Journal of Artificial Intelligence Research 4, 77–90 (1996)
Roy, B.: Multicriteria methodology for decision aiding. Kluwer Academic, Dordrecht (1996)
Shirvany, Y., Hayati, M., Moradian, R.: Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Applied Soft Computing 9(1), 20–29 (2009)
Subramanian, D.K., Ananthanarayana, V.S., Narasimha Murty, M.: Knowledge-based association rule mining using and-or taxonomies. Knowledge-Based Syst. 16(1), 37–45 (2003)
Witten, H.: Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann Series in Data Management Systems (2005)
Zopounidis, C., Doumpos, M.: Multicriteria classification and sorting methods: A literature review. European Journal of Operational Research 138(2), 229–246 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Al-Obeidat, F., Belacel, N., Carretero, J.A., Mahanti, P. (2010). Automatic Parameter Settings for the PROAFTN Classifier Using Hybrid Particle Swarm Optimization. In: Farzindar, A., Kešelj, V. (eds) Advances in Artificial Intelligence. Canadian AI 2010. Lecture Notes in Computer Science(), vol 6085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13059-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-13059-5_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13058-8
Online ISBN: 978-3-642-13059-5
eBook Packages: Computer ScienceComputer Science (R0)