Skip to main content
SpringerLink
Log in

Machine learning: a survey of current techniques

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Machine learning is the essence of machine intelligence. When we have systems that learn, we will have true artificial intelligence. Many machine-learning strategies exist, this paper reviews the state of the art in machine learning and provides a glimpse of the pioneers of present machine-learning systems and strategies. Learning in noisy domains, the evolutionary learning, learning by analogy and explanation-based learning are just some of the methods covered. Emphasis is placed on the algorithms employed by many of the systems, and the merits and disadvantages of various approaches. Finally an examination of VanLehn's theory of impasse-driven learning is made.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, J. R. (1976) Language, Memory and Thought. Laurence Erlbaum Associates, Hillsdale, N.J.

    Google Scholar 

  • Anderson, J. R. (1983) The Architecture of Cognition. Harvard University, Cambridge, Mass.

    Google Scholar 

  • Anzai, Y. & Simon, H. A. (1979) The theory of learning by doing. Psychology Review, 86, 124–140.

    Google Scholar 

  • Brieman, L., Friedman, J. H., Olshen, R. A. & Stone, C. J. (1984) Classification and Regression Trees. Belmont, California: Wadsworth International Group.

    Google Scholar 

  • Brownowski, J. (1973) The Ascent of Man. British Broadcasting Corporation.

  • Cestnik, B., Kononenko, I. & Bratko. (1987) ASSISTANT 86: A knowledge elicitation tool for sophisticated users. In Progress in Machine Learning (eds I.Bratko & N.Lavrac). Sigma Press, Wilmslow.

    Google Scholar 

  • Clark, P. & Niblett, T. (1987) Induction in noisy domains. In Progress in Machine Learning. (eds I.Bratko & N.Lavrac) Sigma Press, Wilmslow.

    Google Scholar 

  • Desimone, R. (1987) Learning Control Knowledge Within an Explanation-Based Learning Framework. In Progress in Machine Learning (eds. I.Bratko & N.Lavrac). Sigma Press, Wilmslow.

    Google Scholar 

  • Forgy, C. L. & McDermott, J. (1977) OPS, a domain-independent production system language. Proceedings of the Fifth International Joint Computer Cinference, MIT AI Laboratory, Cambridge MA.

  • Forsyth, R. (1981) BEAGLE: a Darwinian approach to putter recognition Kybernetics, 10, 159–166.

    Google Scholar 

  • Forsyth, R. & Rada, R. (1986) Machine Learning: Application in Expert System and Information retrieval. London, Wiley.

    Google Scholar 

  • Gams, M. & Lavrac, N. (1987) Review of five empirical learning Systems within a proposed schemata. In Progress in Machine Learning. (eds. I.Bratko & N.Lavrac). Sigma Press, Wilmslow.

    Google Scholar 

  • Hunt, E. (1966) Experiments in Induction. Academic Press, New York.

    Google Scholar 

  • Keane, M. T. (1988) Analogical Problem Solving. Ellis Horwood, Chichester.

    Google Scholar 

  • Kononenko, I., Bratko, I. & Roskar, E. (1984) Experiments in automatic learning of medical diagnostic rules. Technical Report, Jozef Stefan Institute, Ljubljana, Yugoslavia.

  • Laird, J. E., Newell, A. & Rosenbloom, P. S. (1986) SOAR: An architecture for general intelligence, Artificial Intelligence, Vol 1 p.1–64.

    Google Scholar 

  • Langley, P. (1987) A general theory for discrimination learning. In Production System Models of Learning and Development (eds D.Klahr, P.Langley & R.Neches). MIT, Cambridge, Mass.

    Google Scholar 

  • Lenat, D. B. (1976) AM: An artificial intelligence approach to discovery in mathematics as heuristic search. In Knowledge-based Systems in Artificial Intelligence (eds R.Davis & D. B.Lenat, 1980). McGraw-Hill, New York.

    Google Scholar 

  • Lenat, D. B. (1983) The role of Heuristics in learning by discovery: case study 2: The EURISKO program; Heuristics used to develop new heuristics. In Machine Learning an Artificial Intelligene Approach (eds R.Michalski, J.Carbonell & T.Mitchell). Morgan Kaufmann, California.

    Google Scholar 

  • McDonald, C. G. (1987) Children's Errors in Subtraction: A rational reconstruction. Unpublished departmental research reportno. 8. Oxford Polytechnic, U.K.

    Google Scholar 

  • Michalski, R. S. & Larson, J. B. (1978) Selection of most representative training examples and incremental generation of VL1 hypotheses: the underlying methodology and description of programs ESEL and AQ11, Report 867, University of Illinois.

  • Michalski, R. S. & Negri, P. G. (1977) An experiment on inductive learning in chess end games. In Machine Intelligence. (eds E. W.Elcock & D.Michie) Wiley, U.K.

    Google Scholar 

  • Michalski, R. S., Mozetic, I., Hong, J. & Lavrac, N. (1986) The multi-purpose incremental learning system AQ15 and its testing application to three medical domains. Proceedings of AAAI-86, Philadelphia.

  • Mitchell, T. M., Keller, R. M. & Kedar-Cabelli, S. T. (1986) Explanation-Based Generalisations: A Unifying View, Machine Learning, 1, 47–80.

    Google Scholar 

  • Mostow, D. J. (1981) Mechanical transformation of task heurstics into operational procedures. Report number CS-81–113, Computer Science Department, Carnegie-Mellon University, cited In T. Dietterich, Learning and inductive inference, In The Handbook of Artificial Intelligence, Vol 3, (eds P.Cohen & E.Feigenbaum, 1982). Stanford: Pitman.

    Google Scholar 

  • Murray, R. N. & Gbedemah, G. L. (1983) Foundations of Education in the Caribbean. Hodder & Stoughton, London.

    Google Scholar 

  • Nealon, J. L. (1985) Description, critical review and proposed development of the ID3 algorithm. Unpublished departmental reportNo. 14, Oxford Polytechnic, UK.

    Google Scholar 

  • Neches, R., Langley, P., Klahr, D. (1987) Learning, development and production systems. In Production System Models of Learning and Development (eds D. P.Langley & R.Neches). MIT, Cambridge, Mass.

    Google Scholar 

  • Newell, A. (1973) Production systems: Models of control structures. In Visual Information Processing, (ed. Chase, W. C.), Academic Press, New York, pp. 360–414.

    Google Scholar 

  • Newell, A. & Simon, H. A. (1972) Human Problem Solving. Prentice-Hall, Englewood Cliffs.

    Google Scholar 

  • Schank, R. (1982) Dynamic Memory: A theory of learning in computers and people. Cambridge University Press, Cambridge.

    Google Scholar 

  • VanLehn, K. (1987a) Towards a Theory of Impasse-driven Learning. Technical report PCG-1, Carnegie-Mellon University, Pittsburg.

    Google Scholar 

  • VanLehn, K. (1987b) Flexible execution of cognitive procedures. Technical report PCG-5, Carnegie-Mellon University, Pittsburg.

    Google Scholar 

  • Winston, P. H. (1980) Learning and Reasoning by analogy. CACM Vol. 23, No. 12.

    Google Scholar 

  • Winston, P. H. (1984) Artificial Intelligence, MIT, Addison-Wesley, Reading, Mass.

    Google Scholar 

  • Young, R. (1979) Production Systems for modelling Human Cognition. In Expert Systems in the Microelectronic Age (ed. D. Michie), pp. 35–45, Edinburgh University Press.

  • Young, R. & O'Shea, T. Children's Errors in Subtraction, Cognitive Science, 1981, 153–177.

Further Reading

  • Brown, J. S. & VanLehn, K. (1980) Repair Theory: A generative theory of bugs in procedural skills. Cognitive Science, 4, 379–426.

    Google Scholar 

  • Clancey, W. J. (1983) The epistemology of a rule-based expert system: A framework for explanation. Artificial Intelligence, 20, 215–251.

    Google Scholar 

  • Dietterich, T. G. & Michalski, R. S. (1981) Inductive learing of structural descriptions: Evaluation criteria and comparative review of selected methods. Artificial Intelligence, 16, 257–294.

    Google Scholar 

  • Fahlman, S. (1979) NETL: A system for representing and using Real World Knowledge. MIT, Cambridge, Mass.

    Google Scholar 

  • Kintsch, W. & Greeno, J. G. (1985) Understanding and Solving Word Arithmetic Problems, Psychological Review, 92, No. 1, 109–129.

    Google Scholar 

  • Klahr, D., Langley, P. & Neches, R. (1987) Production System Models of Learning and Development. MIT, Cambridge, Mass.

    Google Scholar 

  • McClelland, J. L., Rumelhart, D. and the PDP Research Group (1986) Parallel Distributed Processing. MIT, Cambridge, Mass.

    Google Scholar 

  • McDermott, J. & Forgy, C. (1978) Production System Conflict Resolution Strategies. In Pattern Directed Inference Systems. (eds D. A.Waterman & F.Hayes-Roth), Academic Press, New York.

    Google Scholar 

  • McDonald, C. G. (1988) Production Systems as cognitive models of Human Problem Solving, M.Phil. Thesis, Oxford Polytechnic, UK.

  • Newell, A., Shaw, J. C. & Simon, H. A. (1963) Empirical explorations of the Logic Theory Machine: A case study in heuristics. In Computers and Thought, (eds E.Feigenbaum & J.Feldman), McGraw-Hill, New York.

    Google Scholar 

  • Newell, A., Shaw, J. C. & Simon, H. A. (1960) Report on a general problem solving program for a computer. In Information Processing: Proceedings of the International Conference on Information Processing, UNESCO, Paris, 256–264.

  • Quinlan, J. R. (1979) Discovering rules by induction from large collections of examples. In Expert Systems in the Microelectronic Age (ed. D.Michie), Edinburgh University Press, Edinburgh.

    Google Scholar 

  • VanLehn, K. (1981) On the Representation of Procedures in Repair Theory. In The Development of Mathematical Thinking. (ed H. P.Ginsburg), Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Ward, P. & Mellor, S. (1988) Structured Development for Real-Time Systems. Vol. 1. Yourdon Press, Englewood Cliffs, New Jersey.

    Google Scholar 

  • Winston, P. H. (1975) Learning structural descriptions from examples. In The Psychology of Computer Vision. (ed. P. H.Winston), McGraw-Hill, New York.

    Google Scholar 

  • Woods, P. & Hartley, J. R. (1971) Some learning models for arithmetic tasks and their use in computer based learning. British Journal of Educational Psychology, 41, 39–48.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Coventry Polytechnic, Coventry, UK

    Carlton McDonald

Authors
  1. Carlton McDonald
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

McDonald, C. Machine learning: a survey of current techniques. Artif Intell Rev 3, 243–280 (1989). https://doi.org/10.1007/BF00141197

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00141197

Keywords

Search

Navigation