Abstract
Support Vector Machines (SVM) from statistical learning are very powerful methods which can be used as (e.g.binary) classifiers or discriminators in a wide range of applications. Advantages of SVM are that weak prior assumptions about both model and data suffice. Moreover, optimization of the SVM essentially regularizes the emerging data model by restricting the model to special data points, the support vectors, usually a small subset from the training data. In our paper we discuss ways of detecting informative and typical subsets from SVM solutions, with the aim of extracting simple rules.
Keywords
- Support Vector Machine
- Support Vector
- Linear Discriminant Analysis
- Tenfold Cross Validation
- Linear Support Vector Machine
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
BREIMAN, L., FRIEDMAN, J.H., OLSHEN, R.A. and STONE, C.J. (1984): Classification and Regression Trees. Wadsworth & Brooks, Pacific Grove, California.
CHEN, Y. and WANG, J.Z. (2003): Support Vector Learning for Fuzzy Rule-Based Classification Systems, Working Paper, Department of Computer Science and Engineering, The Pennsylvania State University, 1–30
DeFALCO, I., Della CIOPA, A. and TARANTINO, E. (2002): Discovering interesting classification rules with genetic programming. Applied Soft Computing 1: 257–269
DUCH, W., SETIONO, R. and ZURADA, J.M. (2004): Computational Intelligence Methods for Rule-Based Data Understanding. Proceedings of the IEEE, Vol.92, No.5, May 2004, 771–805
HOFFMANN, F., BAESENS, B., MARTENS, J., PUT, F. and VANTHIENEN J. (2002): Comparing a genetic fuzzy and a neurofuzzy classifier for credit scoring. Royal Institute of Technology, Center for Autonomous Systems, 8pp, http://www.nada.kth.se/hoffmann/FLINS2002.pdf
KOHONEN, T. (2001): Self-Organizing Maps. Springer, New York.
SCHEBESCH, K.B. and STECKING, R. (2003a): Support Vector Machines for Credit Scoring: Extension to Non Standard Cases. Submitted to Proceedings of the 27th Annual Conference of the GfKl 2003.
SCHEBESCH, K.B. and STECKING, R. (2003b): Support Vector Machines for Credit Applicants: Detecting Typical and Critical Regions, in: Credit Scoring & Credit Control VIII, Credit Research Center, University of Edinburgh, 3–5 September 2003, 13pp
SCHÖLKOPF, B. and SMOLA, A. (2002): Learning with Kernels. The MIT Press, Cambridge.
STECKING, R. and SCHEBESCH, K.B. (2003): Support Vector Machines for Credit Scoring: Comparing to and Combining with some Traditional Classification Methods, in: Schader, M., Gaul, W. and Vichi, M. (Eds.): Between Data Science and Applied Data Analysis, Springer, Berlin, 604–612
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schebesch, K.B., Stecking, R. (2005). Extracting Rules from Support Vector Machines. In: Fleuren, H., den Hertog, D., Kort, P. (eds) Operations Research Proceedings 2004. Operations Research Proceedings, vol 2004. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-27679-3_51
Download citation
DOI: https://doi.org/10.1007/3-540-27679-3_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24274-1
Online ISBN: 978-3-540-27679-1
eBook Packages: Business and EconomicsBusiness and Management (R0)