A New Approach to Symbolic Classification Rule Extraction Based on SVM

  • Dexian Zhang
  • Tiejun Yang
  • Ziqiang Wang
  • Yanfeng Fan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4099)


There still exist two key problems required to be solved in the classification rule extraction, i.e. how to select attributes and discretize continuous attributes effectively. The lack of efficient heuristic information is the fundamental reason that affects the performance of currently used approaches. In this paper, a new measure for determining the importance level of the attributes based on the trained SVM is proposed, which is suitable for both continuous attributes and discrete attributes. Based on this new measure, a new approach for rule extraction from trained SVM and classification problems with continuous attributes is proposed. The performance of the new approach is demonstrated by several computing cases. The experimental results prove that the approach proposed can improve the validity of the extracted rules remarkably compared with other rule extracting approaches, especially for the complicated classification problems.


Mutual Information Class Label Continuous Attribute Attribute Selection Rule Extraction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Fu, L.M.: Rule generation from neural networks. IEEE Transactions on Systems, Man and Cybernetics 8, 1114–1124 (1994)Google Scholar
  2. 2.
    Towell, G., Shavlik, J.A.: The extraction of refined rules from knowledge-based neural networks. Machine Learning 1, 71–101 (1993)Google Scholar
  3. 3.
    Lu, H.J., Setiono, R., Liu, H.: NeuroRule: a connectionist approach to data mining. In: Proceedings of 21th International Conference on Very Large Data Bases, Zurich, Switzerland, pp. 81–106 (1995)Google Scholar
  4. 4.
    Zhou, Z.H., Jiang, Y., Chen, S.F.: Extracting symbolic rules from trained neural network ensembles. AI Communications 6, 3–15 (2003)Google Scholar
  5. 5.
    Sestito, S., Dillon, T.: Knowledge acquisition of conjunctive rules using multilayered neural networks. International Journal of Intelligent Systems 7, 779–805 (1993)CrossRefGoogle Scholar
  6. 6.
    Craven, M.W., Shavlik, J.W.: Using sampling and queries to extract rules from trained neural networks. In: Proceedings of the 11th International Conference on Machine Learning, New Brunswick, NJ, USA, pp. 37–45 (1994)Google Scholar
  7. 7.
    Maire, F.: Rule-extraction by backpropagation of polyhedra. Neural Networks 12, 717–725 (1999)CrossRefGoogle Scholar
  8. 8.
    Setiono, R., Leow, W.K.: On mapping decision trees and neural networks. Knowledge Based Systems 12, 95–99 (1999)CrossRefGoogle Scholar
  9. 9.
    Battiti, R.A.: Using mutual information for selecting featuring in supervised net neural learning. IEEE Trans on Neural Networks 5, 537–550 (1994)CrossRefGoogle Scholar
  10. 10.
    Bollacker, K.D., Ghosh, J.C.: Mutual information feature extractors for neural classifiers. In: Proceedings of 1996 IEEE international Conference on Neural Networks, Washington, pp. 1528–1533 (1996)Google Scholar
  11. 11.
    Dash, M., Liu, H., Yao, J.C.: Dimensionality reduction of unsupervised data. In: Proceedings of the 9th International Conference on Tools with Artificial Intelligence, Newport Beach, pp. 532–539 (1997)Google Scholar
  12. 12.
    Fu, X.J., Wang, L.P.: Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Transactions on Systems, Man and Cybernetics, Part B - Cybernetics 33, 399–409 (2003)CrossRefGoogle Scholar
  13. 13.
    Kamarthi, S.V., Pittner, S.: Accelerating neural network training using weight extrapolation. Neural Networks 12, 1285–1299 (1999)CrossRefGoogle Scholar
  14. 14.
    Blake, C., Keogh, E., Merz, C.J.: UCI repository of machine learning databases. Department of Information and Computer Science, University of California, Irvine, CA. (1998),

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Dexian Zhang
    • 1
  • Tiejun Yang
    • 1
  • Ziqiang Wang
    • 1
  • Yanfeng Fan
    • 2
  1. 1.School of Information Science and EngineeringHenan University of TechnologyZheng ZhouChina, P.R.C
  2. 2.Computer CollegeNorthwestern Polytechnical UniversityXi’anChina, P.R.C

Personalised recommendations