Abstract
Classification is an essential task in the field of Machine Learning, where developing a classifier that minimizes errors on unknown data is one of its central problems. It is known that the analytic center is a good approximation of the center of mass of the version space that is consistent with the Bayes-optimal decision surface. Therefore, in this work, we propose an evolutionary algorithm, relying on the convexity properties of the version space, that evolves a population of perceptron classifiers in order to find a solution that approximates its analytic center. Hyperspherical coordinates are used to guarantee feasibility when generating new individuals and enabling exploration to be uniformly distributed through the search space. To evaluate the individuals we consider using a potential function that employs a logarithmic barrier penalty. Experiments were performed on real datasets, and the obtained results indicate concrete possibilities for applying the proposed algorithm for solving practical problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agmon, S.: The relaxation method for linear inequalities. Can. J. Math. 6, 382–392 (1954)
Alon, U., et al.: Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. United States Am. 96(12), 6745–6750 (1999)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Eiben, A., Schippers, C.: On evolutionary exploration and exploitation. Fundam. Inf. 35, 35–50 (1998)
Enes, K.B., Villela, S.M., Fonseca Neto, R.: Version space reduction based on ensembles of dissimilar balanced perceptrons. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 1448–1454 (2016)
Gilad-Bachrach, R., Navot, A., Tishby, N.: Bayes and tukey meet at the center point. In: Shawe-Taylor, J., Singer, Y. (eds.) COLT 2004. LNCS (LNAI), vol. 3120, pp. 549–563. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-27819-1_38
Golub, T.R., et al.: Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286, 531–537 (1999)
Herbrich, R., Graepel, T., Campbell, C.: Bayes point machines. J. Mach. Learn. Res. 1, 245–279 (2001)
Kaiser, M.J., Morin, T.L., Trafalis, T.B.: Centers and invariant points of convex bodies. In: Applied Geometry And Discrete Mathematics (1990)
Lasserre, J.B.: An analytical expression and an algorithm for the volume of a convex polyhedron in \({R}^n\). J. Optim. Theory Appl. 39, 363–377 (1983)
McCulloch, W.S., Pitts, W.: A Logical Calculus of the Ideas Immanent in Nervous Activity, pp. 15–27. MIT Press, Cambridge (1988)
Michalski, R.S., Carbonell, J.G., Mitchell, T.M.: Machine Learning: An Artificial Intelligence Approach. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-662-12405-5
MinShu, M.: Genetic algorithms designed for solving support vector classifier. In: International Symposium on Data, Privacy, and E-Commerce, pp. 167–169 (2007)
Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)
Moon, P.H., Spencer, D.E.: Field Theory Handbook : Including Coordinate Systems, Differential Equations, and Their Solutions. Springer, Heidelberg (1988). https://doi.org/10.1007/978-3-642-83243-7
Nesterov, Y., Nemirovskii, A.S.: Interior point polynomial methods in convex programming: Theory and algorithms (1993)
Novikoff, A.: On convergence proofs on perceptrons. In: Proceedings of the Symposium on the Mathematical Theory of Automata, vol. 12, pp. 615–622 (1962)
Paquet, U., Engelbrecht, A.: Training support vector machines with particle swarms. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1593–1598 (2003)
Raupp, F.M., Svaiter, B.F.: Analytic center of spherical shells and its application to analytic center machine. Comput. Optim. Appl. 43(3), 329–352 (2009)
Rosenblatt: The perceptron, a perceiving and recognizing automaton, Project Para. Cornell Aeronautical Laboratory (1957)
Singh, D., et al.: Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1(2), 203–209 (2002)
Trafalis, T., Malyscheff, A.: An analytic center machine. Mach. Learn. 46, 203–223 (2002)
Zhu, Z., Ong, Y.S., Dash, M.: Markov blanket-embedded genetic algorithm for gene selection. Pattern Recogn. 40, 3236–3248 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Goulart, R.M., Villela, S.M., Borges, C.C.H., Neto, R.F. (2020). An Evolutionary Analytic Center Classifier. In: Cerri, R., Prati, R.C. (eds) Intelligent Systems. BRACIS 2020. Lecture Notes in Computer Science(), vol 12319. Springer, Cham. https://doi.org/10.1007/978-3-030-61377-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-61377-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61376-1
Online ISBN: 978-3-030-61377-8
eBook Packages: Computer ScienceComputer Science (R0)