Rule improvement through decision boundary detection using sensitivity analysis
Rule extraction from artificial neural networks (ANN) provides a mechanism to interpret the knowledge embedded in the numerical weights. Classification problems with continuous-valued parameters create difficulties in determining boundary conditions for these parameters. This paper presents an approach to locate such boundaries using sensitivity analysis. Inclusion of this decision boundary detection approach in a rule extraction algorithm resulted in significant improvements in rule accuracies.
KeywordsArtificial Neural Network Decision Boundary Attribute Evaluation Rule Extraction Rule Accuracy
Unable to display preview. Download preview PDF.
- [Cohn et al 1994] D Cohn, L Atlas, R Ladner, Improving Generalization with Active Learning, Machine Learning, Vol 15, 1994, pp 201–221.Google Scholar
- [Craven et al 1993] MW Craven and JW Shavlik, 1993. Learning Symbolic Rules using Artificial Neural Networks, Proceedings of the Tenth International Conference on Machine Learning, Amherst: USA, pp. 79–95.Google Scholar
- [Engelbrecht et al 1996] AP Engelbrecht, I Cloete, A Sensitivity Analysis algorithm for Pruning Feedforward Neural Networks, IEEE International Confernece in Neural Networks, Washington, Vol 2, 1996, pp 1274–1277Google Scholar
- [Engelbrecht et al 1998a] AP Engelbrecht and I Cloete, 1998. Selective Learning using Sensitivity Analysis, 1998 International Joint Conference on Neural Networks (IJCNN'98), Alaska: USA, pp. 1150–1155.Google Scholar
- [Engelbrecht 1998b] AP Engelbrecht, 1998. Sensitivity Analysis of Multilayer Neural Networks, submitted PhD dissertation, Department of Computer Science, University of Stellenbosch, Stellenbosch: South Africa.Google Scholar
- [Towell 1994] GG Towell and JW Shavlik, Refining Symbolic Knowledge using Neural Networks, Machine Learning, Vol. 12, 1994, pp 321–331.Google Scholar
- [Viktor et al 1995] HL Viktor, AP Engelbrecht and I Cloete, 1995. Reduction of Symbolic Rules from Artificial Neural Networks using Sensitivity Analysis, IEEE International Conference on Neural Networks (ICNN'95), Perth: Australia, pp. 1788–1793.Google Scholar
- [Viktor et al 1998a] HL Viktor, AP Engelbrecht, I Cloete, Incorporating Rule Extraction from ANNs into a Cooperative Learning Environment, Neural Networks & their Applications (NEURAP'98), Marseilles, France, March 1998, pp 386–391.Google Scholar
- [Viktor 1998] HL Viktor, 1998. Learning by Cooperation: An Approach to Rule Induction and Knowledge Fusion, submitted PhD dissertation, Department of Computer Science, University of Stellenbosch, Stellenbosch: South Africa.Google Scholar