Abstract
At present, algorithms of the ID3 family are not based on background knowledge. For that reason, most of the time they are neither logical nor understandable to experts. These algorithms cannot perform different types of generalization as others can do (Michalski, 1983; Kodratoff, 1983), nor can they can reduce the cost of classifications. The algorithm presented in this paper tries to generate more logical and understandable decision trees than those generated by ID3-like algorithms; it executes various types of generalization and at the same time reduces the classification cost by means of background knowledge. The background knowledge contains the ISA hierarchy and the measurement cost associated with each attribute. The user can define the degrees of economy and generalization. These data will influence directly the quantity of search that the algorithm must undertake. This algorithm, which is an attribute version of the EG2 method (Núñez, 1988a, 1988b), has been implemented and the results appear in this paper comparing them with other methods.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Bratko, I., & Kononenko, I. (1987). Learning rules from incomplete and noisy data. In B.Phelps (Ed.), Interactions in artificial intelligence and statistical methods. Hampshire: Technical Press.
Cendrowska, J. (1989). PRISM: An algorithm for inducing modular rules. In B. Gaines, & J. Boose (Eds.), Knowledge acquisition for knowledge based systems (Vol. 1). Academic Press.
Duda, R. (1981). Model design in the prospector consultant system for mineral exploration. In D.Michie (Ed.), Expert systems in the microelectronic age. Edinburgh, Scotland: Edinburgh University Press.
Forsyth, R., & Rada, R. (1986). Machine learning applications in expert systems and information retrieval. West Sussex, England: Ellis Horwood Publishers.
Gaines, B. (1989). Knowledge acquisition: The continuum linking machine learning and expertise transfer. In J. Boose, B. Gaines, & J. Ganascia (Eds.), Proceedings of the EKAW 89. Paris.
Hunt, E.B., Marin, J., & Stone, P.J. (1966). Experiments in induction. New York: Academic Press.
Kodratoff, Y., & Ganascia, J. (1986). Improving the generalization step. In R.S.Michalski, J.G.Carbonell, & T.M.Mitchell (Eds.), Machine learning (Vol. 2), Los Altos, CA: Morgan Kaufmann.
Larson, D., & Michalski, R. (1977). Inductive inference of VL decision rules. Proceedings of the WPDIS-77. Sigart.
Lavrac, N., Mozetic, I., & Kononenko, I. (1986). An experimental comparison of two learning programs in three medical domains. Proceedings of ISSEK Workshop 1986. Glasgow: Turing Institute.
Michalski, R. (1983). Theory and methodology of inductive learning. In R.S.Michalski, J.G.Carbonell, & T.M.Mitchell (Eds.), Machine learning (Vol. 1). Los Altos, CA: Morgan Kaufmann.
Núñez, M. (1988a). El metodo de aprendizaje EG2: Una aplicacion de conociminento de base a ejemplos estructurados. Master thesis in knowledge engineering, Universidad Politecnica de Madrid.
Núñez, M. (1988b). Economic induction: A case study. In D.Sleeman (Ed.), Proceedings of the Third European Working Session on Learning. London: Pitman Publishing.
Núñez, M. (1990). Decision tree induction using domain knowledge. In B.Wielinga, J.Boose, B.Gaines, G.Schreiber, & M.vanSomeren (Eds.), Current trends in knowledge acquisition. Amsterdam, The Netherlands: IOS Press.
Quinlan, J.R. (1979). Discovering rules by induction from large collection of examples. In D. Michie (Ed.), Expert systems in the microelectronic age. Edinburgh University Press.
Quinlan, J.R. (1989). Simplifying decision trees. In B. Gaines, & J. Boose (Eds.), Knowledge acquisition for knowledge based systems (Vol. 1). Academic Press.
Shannon, C.E., & Warren, W. (1971). The mathematical theory of communication. University of Illinois Press.
Tan, M., & Schlimmer, J. (1989). Cost-sensitive concept learning of sensor use in approach and recognition. Proceedings of the Sixth International Workshop on Machine Learning. Ithaca, New York.
Tan, M., & Schlimmer, J. (1990). CSL: A cost-sensitive learning system for sensing and grasping objects. IEEE International Conference on Robotics and Automation, Cincinnati, Ohio.
Winston, P.H. (1977). Artificial intelligence. Addison-Wesley.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Núñez, M. The use of background knowledge in decision tree induction. Mach Learn 6, 231–250 (1991). https://doi.org/10.1007/BF00114778
Issue Date:
DOI: https://doi.org/10.1007/BF00114778