Abstract
The paper first examines the contours of artificial intelligence (AI) at its beginnings, more than sixty years ago, and points out the important place that machine learning already had at that time. The ambition of AI of making machines capable of performing any information processing task that the human mind can do, means that AI should cover the two modes of human thinking: the instinctive (reactive) one and the deliberative one. This also corresponds to the difference between mastering a skill without being able to articulate it and holding some pieces of knowledge that one can use to explain and teach. In case a function-based representation applies to a considered AI problem, the respective merits of learning a universal approximation of the function vs. a rule-based representation are discussed, with a view to better draw the contours of AI. Moreover, the paper reviews the relative positions of knowledge and data in reasoning and learning, and advocates the need for bridging the two tasks. The paper is also a plea for a unified view of the various facets of AI as a science.
A preliminary version of this paper was presented at the 2018 IJCAI-ECAI workshop “Learning and Reasoning: Principles & Applications to Everyday Spatial and Temporal Knowledge”, Stockholm, July 13–14.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
One would notice the word ‘logical’ in the title of this pioneering paper.
- 2.
Still this function-based approach is often cast in a probabilistic modeling paradigm.
References
Agrawal, R., Imielinski, T., Swami, A.N.: Mining association rules between sets of items in large databases. In: Buneman, P., Jajodia, S. (eds.) Proceedings 1993 ACM SIGMOD International Conference on Management of Data, Washington, DC, 26–28 May 1993, pp. 207–216. ACM Press (1993)
Amel, K.R.: From shallow to deep interactions between knowledge representation, reasoning and machine learning. In: BenAmor, N., Theobald, M. (eds.) Proceedings 13th International Conference Scala Uncertainity Mgmt (SUM 2019), Compiègne, LNCS, 16–18 December 2019. Springer, Heidelberg (2019)
Augustin, T., Coolen, F.P.A., De Cooman, G., Troffaes, M.C.M.: Introduction to Imprecise Probabilities. Wiley, Hoboken (2014)
Baader, F., Horrocks, I., Lutz, C., Sattler, U.: An Introduction to Description Logic. Cambridge University Press, Cambridge (2017)
Bach, S.H., Broecheler, M., Huang, B., Getoor, L.: Hinge-loss Markov random fields and probabilistic soft logic. J. Mach. Learn. Res. 18, 109:1–109:67 (2017)
Bajcsy, R., Reynolds, C.W.: Computer science: the science of and about information and computation. Commun. ACM 45(3), 94–98 (2002)
Balkenius, C., Gärdenfors, P.: Nonmonotonic inferences in neural networks. In: Proceedings 2nd International Conference on Principle of Knowledge Representation and Reasoning (KR 1991), Cambridge, MA, pp. 32–39 (1991)
Benferhat, S., Dubois, D., Prade, H.: Possibilistic and standard probabilistic semantics of conditional knowledge bases. J. Log. Comput. 9(6), 873–895 (1999)
Benferhat, S., Dubois, D., Lagrue, S., Prade, H.: A big-stepped probability approach for discovering default rules. Int. J. Uncert. Fuzz. Knowl.-based Syst. 11(Suppl.–1), 1–14 (2003)
Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)
Besold, T.R., Garcez, A.D.A., Stenning, K., van der Torre, L., van Lambalgen, M.: Reasoning in non-probabilistic uncertainty: logic programming and neural-symbolic computing as examples. Minds Mach. 27(1), 37–77 (2017)
Bichler, O., Querlioz, D., Thorpe, S.J., Bourgoin, J.-P., Gamrat, C.: Extraction of temporally correlated features from dynamic vision sensors with spike-timing-dependent plasticity. Neural Netw. 32, 339–348 (2012)
Bounhas, M., Pirlot, M., Prade, H., Sobrie, O.: Comparison of analogy-based methods for predicting preferences. In: BenAmor, N., Theobald, M. (eds.) Proceedings 13th International Conference on Scala Uncertainity Mgmt (SUM 2019), Compiègne, LNCS, 16–18 December. Springer, Heidelberg (2019)
Bounhas, M., Prade, H., Richard, G.: Analogy-based classifiers for nominal or numerical data. Int. J. Approx. Reasoning 91, 36–55 (2017)
Brabant, Q., Couceiro, M., Dubois, D., Prade, H., Rico, A.: Extracting decision rules from qualitative data via sugeno utility functionals. In: Medina, J., Ojeda-Aciego, M., Verdegay, J.L., Pelta, D.A., Cabrera, I.P., Bouchon-Meunier, B., Yager, R.R. (eds.) IPMU 2018. CCIS, vol. 853, pp. 253–265. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91473-2_22
Cohen, W.W.: TensorLog: a differentiable deductive database. CoRR, abs/1605.06523 (2016)
Cohen, W.W., Yang, F., Mazaitis, K.: TensorLog: deep learning meets probabilistic DBs. CoRR, abs/1707.05390 (2017)
Couceiro, M., Hug, N., Prade, H., Richard, G.: Analogy-preserving functions: a way to extend Boolean samples. In: Proceedings 26th International Joint Conference on Artificial Intelligence, (IJCAI 2017), Melbourne, 19–25 August, pp. 1575–1581 (2017)
Couso, I., Dubois, D.: A general framework for maximizing likelihood under incomplete data. Int. J. Approx. Reasoning 93, 238–260 (2018)
d’Alché-Buc, F., Andrés, V., Nadal, J.-P.: Rule extraction with fuzzy neural network. Int. J. Neural Syst. 5(1), 1–11 (1994)
Darwiche, A.: Human-level intelligence or animal-like abilities?. CoRR, abs/1707.04327 (2017)
d’Avila Garcez, A.S., Broda, K., Gabbay, D.M.: Symbolic knowledge extraction from trained neural networks: a sound approach. Artif. Intell. 125(1–2), 155–207 (2001)
d’Avila Garcez, A.S., Gabbay, D.M., Lamb, L.C.: Value-based argumentation frameworks as neural-symbolic learning systems. J. Logic Comput. 15(6), 1041–1058 (2005)
d’Avila Garcez, A.S., Lamb, L.C., Gabbay, D.M.: Connectionist modal logic: representing modalities in neural networks. Theor. Comput. Sci. 371(1–2), 34–53 (2007)
Donadello, I., Serafini, L., Garcez, A.D.A.: Logic tensor networks for semantic image interpretation. In: Sierra, C. (ed) Proceedings 26th International Joint Conference on Artificial Intelligence (IJCAI 2017), Melbourne, 19–25 August 2017, pp. 1596–1602 (2017)
Dubois, D., Godo, L., Prade, H.: Weighted logics for artificial intelligence - an introductory discussion. Int. J. Approx. Reasoning 55(9), 1819–1829 (2014)
Dubois, D., Prade, H.: Soft computing, fuzzy logic, and artificial intelligence. Soft Comput. 2(1), 7–11 (1998)
Dubois, D., Prade, H., Richard, G.: Multiple-valued extensions of analogical proportions. Fuzzy Sets Syst. 292, 193–202 (2016)
Dubois, D., Prade, H., Rico, A.: The logical encoding of Sugeno integrals. Fuzzy Sets Syst. 241, 61–75 (2014)
Dubois, D., Prade, H., Schockaert, S.: Generalized possibilistic logic: foundations and applications to qualitative reasoning about uncertainty. Artif. Intell. 252, 139–174 (2017)
Dupin de Saint-Cyr, F., Lang, J., Schiex, T.: Penalty logic and its link with Dempster-Shafer theory. In: de Mántaras, R.L., Poole, D. (eds.) Proceedings 10th Annual Conference on Uncertainty in Artificial Intelligence (UAI 1994), Seattle, 29–31 July, pp. 204–211 (1994)
Fahandar, M.A., Hüllermeier, E.: Learning to rank based on analogical reasoning. In: Proceedings 32th National Conference on Artificial Intelligence (AAAI 2018), New Orleans, 2–7 February 2018 (2018)
Fakhraei, S., Raschid, L., Getoor, L.: Drug-target interaction prediction for drug repurposing with probabilistic similarity logic. In: SIGKDD 12th International Workshop on Data Mining in Bioinformatics (BIOKDD). ACM (2013)
Farnadi, G., Bach, S.H., Moens, M.F., Getoor, L., De Cock, M.: Extending PSL with fuzzy quantifiers. In: Papers from the 2014 AAAI Workshop Statistical Relational Artificial Intelligence, Québec City, 27 July, pp. WS-14-13, 35–37 (2014)
Gilboa, I., Schmeidler, D.: Case-based decision theory. Q. J. Econ. 110, 605–639 (1995)
Hájek, P., Havránek, T.: Mechanising Hypothesis Formation - Mathematical Foundations for a General Theory. Springer, Heidelberg (1978). https://doi.org/10.1007/978-3-642-66943-9
Hebb, D.O.: The Organization of Behaviour. Wiley, Hoboken (1949)
Heitjan, D., Rubin, D.: Ignorability and coarse ckata. Ann. Statist. 19, 2244–2253 (1991)
Hobbes, T.: Elements of philosophy, the first section, concerning body. In: Molesworth, W. (ed.) The English works of Thomas Hobbes of Malmesbury, vol. 1. John Bohn, London, 1839. English translation of "Elementa Philosophiae I. De Corpore" (1655)
Hohenecker, P., Lukasiewicz, T.: Ontology reasoning with deep neural networks. CoRR, abs/1808.07980 (2018)
Hüllermeier, E.: Inducing fuzzy concepts through extended version space learning. In: Bilgiç, T., De Baets, B., Kaynak, O. (eds.) IFSA 2003. LNCS, vol. 2715, pp. 677–684. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-44967-1_81
Hüllermeier, E.: Learning from imprecise and fuzzy observations: data disambiguation through generalized loss minimization. Int. J. Approx. Reasoning 55(7), 1519–1534 (2014)
Jaeger, M.: Ignorability in statistical and probabilistic inference. JAIR 24, 889–917 (2005)
Kahneman, D.: Thinking, Fast and Slow. Farrar, Straus and Giroux, New York (2011)
Kolodner, J.L.: Case-Based Reasoning. Morgan Kaufmann, Burlington (1993)
Kotlowski, W., Slowinski, R.: On nonparametric ordinal classification with monotonicity constraints. IEEE Trans. Knowl. Data Eng. 25(11), 2576–2589 (2013)
Kraus, S., Lehmann, D., Magidor, M.: Nonmonotonic reasoning, preferential models and cumulative logics. Artif. Intell. 44, 167–207 (1990)
Kuzelka, O., Davis, J., Schockaert, S.: Encoding Markov logic networks in possibilistic logic. In: Meila, M., Heskes, T. (eds.) Proceedings 31st Conference on Uncertainty in Artificial Intelligence (UAI 2015), Amsterdam, 12–16 July 2015, pp. 454–463. AUAI Press (2015)
Kuzelka, O., Davis, J., Schockaert, S.: Learning possibilistic logic theories from default rules. In: Kambhampati, S. (ed.) Proceedings 25th International Joint Conference on Artificial Intelligence (IJCAI 2016), New York, 9–15 July 2016, pp. 1167–1173 (2016)
Kuzelka, O., Davis, J., Schockaert, S.: Induction of interpretable possibilistic logic theories from relational data. In: Sierra, C. (ed.) Proceedings 26th International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, 19–25 August 2017, pp. 1153–1159 (2017)
LeCun, Y., Bengio, Y., Hinton, G.E.: Deep learning. Nature 521(7553), 436–444 (2015)
Mamdani, E.H., Assilian, S.: An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Man-Mach. Stu. 7, 1–13 (1975)
Marquis, P., Papini, O., Prade, H.: Eléments pour une histoire de l’intelligence artificielle. In: Panorama de l’Intelligence Artificielle. Ses Bases Méthodologiques, ses Développements, vol. I, pp. 1–39. Cépaduès (2014)
Marquis, P., Papini, O., Prade, H.: Some elements for a prehistory of Artificial Intelligence in the last four centuries. In: Proceedings 21st Europoen Conference on Artificial Intelligence (ECAI 2014), Prague, pp. 609–614. IOS Press (2014)
McCarthy, J., Minsky, M., Roch-ester, N., Shannon, C.E.: A proposal for the Dartmouth summer research project on artificial intelligence, august 31, 1955. AI Mag. 27(4), 12–14 (2006)
McCulloch, W.S., Pitts, W.: A logical calculus of ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133 (1943)
Miclet, L., Bayoudh, S., Delhay, A.: Analogical dissimilarity: definition, algorithms and two experiments in machine learning. JAIR 32, 793–824 (2008)
Miclet, L., Prade, H.: Handling analogical proportions in classical logic and fuzzy logics settings. In: Sossai, C., Chemello, G. (eds.) ECSQARU 2009. LNCS (LNAI), vol. 5590, pp. 638–650. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02906-6_55
Mitchell, T.: Version spaces: an approach to concept learning. Ph.D. thesis, Stanford (1979)
More, T.: On the construction of Venn diagrams. J. Symb. Logic 24(4), 303–304 (1959)
Mushthofa, M., Schockaert, S., De Cock, M.: Solving disjunctive fuzzy answer set programs. In: Calimeri, F., Ianni, G., Truszczynski, M. (eds.) LPNMR 2015. LNCS (LNAI), vol. 9345, pp. 453–466. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23264-5_38
Narodytska, N.: Formal analysis of deep binarized neural networks. In: Lang, J. (ed.) Proceedings 27th International Joint Conference Artificial Intelligence (IJCAI 2018), Stockholm, 13–19 July 2018, pp. 5692–5696 (2018)
Newell, A., Simon, H.A.: The logic theory machine. a complex information processing system. In: Proceedings IRE Transactions on Information Theory(IT-2), The Rand Corporation, Santa Monica, Ca, 1956. Report P-868, 15 June 1956, pp. 61-79, September 1956
Nilsson, N.J.: The Quest for Artificial Intelligence : A History of Ideas andAchievements. Cambridge University Press, Cambridge (2010)
Nin, J., Laurent, A., Poncelet, P.: Speed up gradual rule mining from stream data! A B-tree and OWA-based approach. J. Intell. Inf. Syst. 35(3), 447–463 (2010)
Pearl, J.: Causality, vol. 2000, 2nd edn. Cambridge University Press, Cambridge (2009)
Perfilieva, I., Dubois, D., Prade, H., Esteva, F., Godo, L., Hodáková, P.: Interpolation of fuzzy data: analytical approach and overview. Fuzzy Sets Syst. 192, 134–158 (2012)
Pinkas, G.: Propositional non-monotonic reasoning and inconsistency in symmetric neural networks. In: Mylopoulos, J., Reiter, R. (eds.) Proceedings 12th International Joint Conference on Artificial Intelligence, Sydney, 24–30 August 1991, pp. 525–531. Morgan Kaufmann (1991)
Pinkas, G.: Reasoning, nonmonotonicity and learning in connectionist networks that capture propositional knowledge. Artif. Intell. 77(2), 203–247 (1995)
Pinkas, G., Cohen, S.: High-order networks that learn to satisfy logic constraints. FLAP J. Appl. Logics IfCoLoG J. Logics Appl. 6(4), 653–694 (2019)
Prade, H.: Reasoning with data - a new challenge for AI? In: Schockaert, S., Senellart, P. (eds.) SUM 2016. LNCS (LNAI), vol. 9858, pp. 274–288. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45856-4_19
Prade, H., Richard, G.: From analogical proportion to logical proportions. Logica Universalis 7(4), 441–505 (2013)
Prade, H., Rico, A., Serrurier, M.: Elicitation of sugeno integrals: a version space learning perspective. In: Rauch, J., Raś, Z.W., Berka, P., Elomaa, T. (eds.) ISMIS 2009. LNCS (LNAI), vol. 5722, pp. 392–401. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04125-9_42
Prade, H., Rico, A., Serrurier, M., Raufaste, E.: Elicitating sugeno integrals: methodology and a case study. In: Sossai, C., Chemello, G. (eds.) ECSQARU 2009. LNCS (LNAI), vol. 5590, pp. 712–723. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02906-6_61
Prade, H., Serrurier, M.: Bipolar version space learning. Int. J. Intell. Syst. 23, 1135–1152 (2008)
Raufaste, E.: Les Mécanismes Cognitifs du Diagnostic Médical : Optimisation et Expertise. Presses Universitaires de France (PUF), Paris (2001)
Richardson, M., Domingos, P.M.: Markov logic networks. Mach. Learn. 62(1–2), 107–136 (2006)
Rocktäschel, T., Riedel, S.: End-to-end differentiable proving. In: Guyon, I., et al. (eds.) Proceedings 31st Annual Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, 4–9 December 2017, pp. 3791–3803 (2017)
Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(6), 386–408 (1958)
Rückert, U., De Raedt, L.: An experimental evaluation of simplicity in rule learning. Artif. Intell. 172(1), 19–28 (2008)
Samuel, A.: Some studies in machine learning using the game of checkers. IBM J. 3, 210–229 (1959)
Schockaert, S., Prade, H.: Interpolation and extrapolation in conceptual spaces: a case study in the music domain. In: Rudolph, S., Gutierrez, C. (eds.) RR 2011. LNCS, vol. 6902, pp. 217–231. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23580-1_16
Schockaert, S., Prade, H.: Interpolative and extrapolative reasoning in propositional theories using qualitative knowledge about conceptual spaces. Artif. Intell. 202, 86–131 (2013)
Selfridge, O.G.: Pandemonium: a paradigm for learning. In: Blake, D.V., Uttley, A.M. (ed) Symposium on Mechanisation of Thought Processes, London, 24–27 November 1959, vol. 1958, pp. 511–529 (1959)
Serafini, L., Garcez, A.S.A.: Logic tensor networks: deep learning and logical reasoning from data and knowledge. In: Besold, T.R., Lamb, L.C., Serafini, L., Tabor, W. (eds.) Proceedings 11th International Workshop on Neural-Symbolic Learning and Reasoning (NeSy 2016), New York City, 16–17 July 2016, vol. 1768 of CEUR Workshop Proceedings (2016)
Serafini, L., Donadello, I., Garcez, A.S.A.: Learning and reasoning in logic tensor networks: theory and application to semantic image interpretation. In: Seffah, A., Penzenstadler, B., Alves, C., Peng, X. (eds.) Proceedings Symposium on Applied Computing (SAC 2017), Marrakech, 3–7 April 2017, pp. 125–130. ACM (2017)
Serrurier, M., Dubois, D., Prade, H., Sudkamp, T.: Learning fuzzy rules with their implication operators. Data Knowl. Eng. 60(1), 71–89 (2007)
Serrurier, M., Prade, H.: Introducing possibilistic logic in ILP for dealing with exceptions. Artif. Intell. 171(16–17), 939–950 (2007)
Shannon, C.E.: Programming a computer for playing chess. Philos. Mag. (7th series) XLI (314), 256–275 (1950)
Solomonoff, R.J.: An inductive inference machine. Tech. Res. Group, New York City (1956)
Turing, A.M.: Intelligent machinery. Technical report, National Physical Laboratory, London, 1948. Also. In: Machine Intelligence, vol. 5, pp. 3–23. Edinburgh University Press (1969)
Turing, A.M.: Computing machinery and intelligence. Mind 59, 433–460 (1950)
Ughetto, L., Dubois, D., Prade, H.: Implicative and conjunctive fuzzy rules - a tool for reasoning from knowledge and examples. In: Hendler, J., Subramanian, D. (eds.) Proceedings 16th National Confernce on Artificial Intelligence, Orlando, 18–22 July 1999, pp. 214–219 (1999)
Walley, P.: Statistical Reasoning with Imprecise Probabilities. Chapman and Hall, London (1991)
Walley, P.: Measures of uncertainty in expert systems. Artif. Intell. 83(1), 1–58 (1996)
Wiener, N.: Cybernetics or Control and Communication in the Animal and the Machine. Wiley, Hoboken (1949)
Zadeh, L.A.: Thinking machines - a new field in electrical engineering. Columbia Eng. Q. 3, 12–13 (1950)
Zadeh, L.A.: Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans. Syst. Man Cybern. 3(1), 28–44 (1973)
Acknowledgements
The authors thank Emiliano Lorini, Dominique Longin, Gilles Richard, Steven Schockaert, Mathieu Serrurier for useful exchanges on some of the issues surveyed in this paper. This work was partially supported by ANR-11-LABX-0040-CIMI (Centre International de Mathématiques et d’Informatique) within the program ANR-11-IDEX-0002-02, project ISIPA.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Dubois, D., Prade, H. (2019). Towards a Reconciliation Between Reasoning and Learning - A Position Paper. In: Ben Amor, N., Quost, B., Theobald, M. (eds) Scalable Uncertainty Management. SUM 2019. Lecture Notes in Computer Science(), vol 11940. Springer, Cham. https://doi.org/10.1007/978-3-030-35514-2_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-35514-2_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35513-5
Online ISBN: 978-3-030-35514-2
eBook Packages: Computer ScienceComputer Science (R0)