Abstract
This paper is aimed at showing the benefits obtained by explicitly introducing a priori control knowledge into the inductive process. The starting point is Michalski's Induce system, which has been modified and augmented. Although the basic philosophy has been changed as little as possible, Induce has been radically modified from the algorithmic point of view, resulting in the new learning system Rigel. The main ideas taken from Induce are the sequential learning of descriptions of each concept against all the others, the Covering algorithm, the Star definition, and the VL2 representation language. The modifications consist of a new way of computing the Star, the use of a separate body of heuristic knowledge to strongly direct the search, the implementation of a larger subset of the VL2 language, a reasoned way of selecting the seed, and the use of rules to evaluate the worthiness of the inductive assertions. The effectiveness of Rigel has been tested both on artificial and on real-world case studies.
Article PDF
Similar content being viewed by others
References
Anderson, J.R., & Kline, P.J. (1979).A learning system and its psychological implications.Proceedings of the Sixth International Joint Conference on Artificial Intelligence (pp.16-21).Tokyo, Japan: Morgan Kaufmann.
Bergadano, F., Giordana, A., & Saitta L. (1988).Automated concept acquisition in noisy environments.IEEE Transactions on Pattern Analysis and Machine Intelligence, 10, 555-577.
Bergadano, R, Gemello, R., Giordana, A., & Saitta L. (1989).SMART:A problem solver for learning from examples.Fundamenta Informaticae.
Bergadano, F., & Oiordana, A.(1988).A knowledge intensive approach to concept induction.Proceedings of the Fifth International Conference on Machine Learning (pp.305-317).Ann Arbor, MI: Morgan Kaufmann.
Bergadano, F, & Giordana, A.(in press).Guiding induction with domain theories.In R.S. Michalski & Y. Kodratoff (Eds.), Machine learning:An artificial intelligence approach (Vol.3).San Mateo, CA: Morgan Kaufmann.
Carbonell, J.G., Michalski, R.S. & Mitchell, T.M.(1983).Machine learning:An artificial intelligence approach (Vol.1).San Mateo, CA: Morgan Kaufmann.
Danyluk, A.P.(1987).The use of explanations for similarity-based learning.Proceedings of the Tenth International Conference on Artificial Intelligence (pp.274-276).Milan, Italy: Morgan Kaufmann.
De Jong, G., & Mooney, R.(1986).Explanation-based learning:An alternative view.Machine Learning, 1, 145-176.
Gemello, R., & Mana, F.(1988).Controlling inductive search in RIGEL learning system.Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems.Urbino, Italy: Springer Verlag.
Gemello, R., Mana, F, & Viano, G.(1988).Inducing conceptual discrimination rules from examples:An appli-cation to image recognition.Proceedings of the Third International Symposium on Methodologies for Intelligent Systems (pp.313-321).Torino, Italy: North-Holland.
Gemello, R., & Mana, F.(1989).An integrated characterization and discrimination scheme to improve learning efficiency in large data sets.Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (pp.719-724).Detroit, MI: Morgan Kaufmann.
Hayes-Roth, F., & McDermott, J.(1978).An interference matching technique for inducing abstractions.Communications of ACM, 21, 401-410.
Haussler, D.(1987).Learning conjunctive concepts in structural domains.Proceedings of the Sixth National Con-ference on Artificial Intelligence (pp.466-470).Seattle, WA: Morgan Kaufmann.
Haussler, D.(1988).Quantifying inductive bias:AI learning algorithms and Valiant's learning framework, Arti-ficial Intelligence, 36, 177-221.
Iba, W., Wogulis, J., & Langley, P.(1988).Trading off simplicity and coverage in incremental concept learning. Proceedings of the Fifth International Conference on Machine Learning (pp.73-79).Ann Arbor, MI: Morgan Kaufmann.
Kearns, M., Li, M., Pitt, L., & Valiant, L.(1987).Recent results on Boolean concept learning.Proceedings of the Fourth International Workshop on Machine Learning (pp.337-352).Irvine, CA: Morgan Kaufmann.
Kodratoff, Y., & Ganascia, J.G.(1986).Improving the generalization step in learning.In J.G.Carbonell, R.S. Michalski, & T.M.Mitchell (Eds.), Machine Learning:An artificial intelligence approach (Vol.2).San Mateo, CA: Morgan Kaufmann.
Langley P.(1987).A general theory of discrimination learning.In D. Klahr, P. Langley, & R. Neches (Eds.), Production system models of learning and development.Cambridge, MA: MIT Press.
Lebowitz, M.(1986).Integrated learning:Controlling explanation.Cognitive Science, 10, 219-240.
Mangili, R., & Viano, G.(1987).A dynamic programming approach to knowledge based contour segmentation. Proceedings of the Fourth International Conference on Image Analysis and Processing (pp.136-147).Cefelu', Italy.
Michalski, R.S.(1983).A theory and methodology of inductive learning.In J.G. Carbonell, R.S. Michalski, & T.M. Mitchell (Eds.), Machine learning:An artificial intelligence approach (Vol.1).San Mateo, CA: Morgan Kaufmann.
Michalski, R.S.(1980).Pattern recognition as a rule-guided inductive inference.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2, 349-361.
Michalski, R.S., & Stepp, R.E.(1986).Induce 3:A program for learning structural descriptions from examples (Internal Report).Urbana-Champaign: University of Illinois, Department of Computer Science.
Michalski, R.S., Mozetic, I., Hong, & Lavrac, N.(1986).The AQ15 inductive learning system:An overview and experiments (Intelligent Systems Group Report).Urbana-Champaign: University of Illinois, Department of Computer Science.
Michalski, R.S., & Larson, J.B.(1983).Incremental generation of VL1 hypotheses:The underlying methodology and the description of the program AQU (Intelligent Systems Group Report).Urbana-Champaign: University of Illinois, Department of Computer Science.
Michalski, R.S., & Stepp, R.E.(1983).How to structure structured objects.Proceedings of the International Machine Learning Workshop (pp.156-160).Monticello, IL.
Mitchell, T.M.(1982).Generalization as search.Artificial Intelligence, 18, 203-226.
Mitchell, T.M., Keller, R.M., & Kedar-Cabelli, S.T.(1986).Explanation-based generalization:A unifying view. Machine Learning, 1, 47-80.
Pazzani, M.J.(1988).Integrating explanation-based and empirical learning methods in OCCAM.Proceedings of the Third European Working Session on Learning (pp.147-165).Glasgow, UK.
Pearl, J.(1979).Capacity and error estimate for Boolean classifiers with limited complexity.IEEE Transaction on Pattern Analysis and Machine Intelligence, 10, 350-355.
Plotkin, G.D.(1970).A note on inductive generalization.In B. Meltzer & D. Michie (Eds.), Machine Intelligence (Vol.5).Edinburgh, UK: Edinburgh University Press.
Quinlan, J.R.(1986).Induction of decision trees.Machine Learning, 1, 81-106.
Utgoff, P.(1988).ID5:An incremental ID3.Proceedings of the Fifth International Conference on Machine Learn-ing (pp.107-120).Ann Arbor, MI: Morgan Kaufmann.
Valiant, L.(1985).Learning disjunctions of conjunctions.Proceedings of the Ninth International Joint Conference on Artificial Intelligence (pp.560-566).Los Angeles, CA: Morgan Kaufmann.
Vapnik, V.N., & Chervonenkis, A.(1971).On the uniform convergence of relative frequencies of events to their probabilities.Theory of Probability and its Applications, XVI, 264-280.
Vere, S.(1975).Induction of concepts in the predicate calculus.Proceedings of the Fourth International Joint Conference on Artificial Intelligence (pp.351-356).Tbilisi, USSR: Morgan Kaufmann.
Vere, S.(1980).Multilevel counterfactuals for generalizations of relational concepts and productions.Artificial Intelligence, 14, 139-164.
Winston, P.(1975).Learning structural descriptions from examples.In P.H. Winston (Ed.), The psychology of computer vision.New York: McGraw Hill.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gemello, R., Mana, F. & Saitta, L. Rigel: An Inductive Learning System. Machine Learning 6, 7–35 (1991). https://doi.org/10.1023/A:1022637916400
Issue Date:
DOI: https://doi.org/10.1023/A:1022637916400