Article

Machine Learning

, Volume 89, Issue 3, pp 215-231

First online:

k-Optimal: a novel approximate inference algorithm for ProbLog

  • Joris RenkensAffiliated withDepartment of Computer Science, Katholieke Universiteit Leuven Email author 
  • , Guy Van den BroeckAffiliated withDepartment of Computer Science, Katholieke Universiteit Leuven
  • , Siegfried NijssenAffiliated withDepartment of Computer Science, Katholieke Universiteit Leuven

Abstract

ProbLog is a probabilistic extension of Prolog. Given the complexity of exact inference under ProbLog’s semantics, in many applications in machine learning approximate inference is necessary. Current approximate inference algorithms for ProbLog however require either dealing with large numbers of proofs or do not guarantee a low approximation error. In this paper we introduce a new approximate inference algorithm which addresses these shortcomings. Given a user-specified parameter k, this algorithm approximates the success probability of a query based on at most k proofs and ensures that the calculated probability p is (1−1/e)p pp , where p is the highest probability that can be calculated based on any set of k proofs. Furthermore a useful feature of the set of calculated proofs is that it is diverse. Our experiments show the utility of the proposed algorithm.

Keywords

Inductive logic programming Statistical relational learning Decision theory Approximative inference