Discriminative Markov Logic Network Structure Learning Based on Propositionalization and χ2-Test

  • Quang-Thang Dinh
  • Matthieu Exbrayat
  • Christel Vrain
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6440)


In this paper we present a bottom-up discriminative algorithm to learn automatically Markov Logic Network structures. Our approach relies on a new propositionalization method that transforms a learning dataset into an approximative representation in the form of boolean tables, from which to construct a set of candidate clauses according to a χ 2-test. To compute and choose clauses, we successively use two different optimization criteria, namely pseudo-log-likelihood (PLL) and conditional log-likelihood (CLL), in order to combine the efficiency of PLL optimization algorithms together with the accuracy of CLL ones. First experiments show that our approach outperforms the existing discriminative MLN structure learning algorithms.


Markov Logic Network Structure Learning Relational Learning Propositionalization Inductive Logic Programming 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Friedman, N., Getoor, N., Koller, D., Pfeffer, A.: Learning Probabilistic Relational Models. In: IJCAI 1999, pp. 1300-1309. Springer, Heidelberg (1999)Google Scholar
  2. 2.
    Kersting, K., De Raedt, L.: Adaptive Bayesian Logic Programs. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, pp. 104–117. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Neville, J., Jensen, D.: Dependency Networks for Relational Data. In: Perner, P. (ed.) ICDM 2004. LNCS (LNAI), vol. 3275, pp. 170–177. Springer, Heidelberg (2004)Google Scholar
  4. 4.
    Richardson, M., Domingos, P.: Markov Logic Networks. Mach. Learn. 62, 107–136 (2006)CrossRefGoogle Scholar
  5. 5.
    Bishop, M.C.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2007)zbMATHGoogle Scholar
  6. 6.
    Della Pietra, S., Della Pietra, V., Lafferty, J.: Inducing Features of Random Fields. Carnegie Mellon University (1995)Google Scholar
  7. 7.
    Sha, F., Pereira, F.: Shallow Parsing with CRFs. In: HLT-NAACL 2003, pp. 213–220. ACL (2003)Google Scholar
  8. 8.
    Singla, P., Domingos, P.: Discriminative Training of MLNs. In: AAAI 2005, pp. 868–873. MIT Press, Cambridge (2005)Google Scholar
  9. 9.
    Lowd, D., Domingos, P.: Efficient Weight Learning for MLNs. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladenič, D., Skowron, A. (eds.) PKDD 2007. LNCS (LNAI), vol. 4702, pp. 200–211. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    Huynh, T.N., Mooney, R.J.: Max-Margin Weight Learning for MLNs. In: Buntine, W., Grobelnik, M., Mladenić, D., Shawe-Taylor, J. (eds.) ECML PKDD 2009. LNCS, vol. 5781, pp. 564–579. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  11. 11.
    Biba, M., Ferilli, S., Esposito, F.: Discriminative Structure Learning of Markov Logic Networks. In: Železný, F., Lavrač, N. (eds.) ILP 2008. LNCS (LNAI), vol. 5194, pp. 59–76. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  12. 12.
    Kok, S., Domingos, P.: Learning the Structure of MLNs. In: ICML 2005, pp. 441–448. ACM, New York (2005)Google Scholar
  13. 13.
    Mihalkova, L., Mooney, R.J.: Bottom-up Learning of MLN Structure. In: ICML 2007, pp. 625–632. ACM, New York (2007)Google Scholar
  14. 14.
    Biba, M., Ferilli, S., Esposito, F.: Structure Learning of Markov Logic Networks through Iterated Local Search. In: ECAI 2008, pp. 361–365. IOS Press, Amsterdam (2008)Google Scholar
  15. 15.
    Kok, S., Domingos, P.: Learning Markov Logic Network Structure via Hypergraph Lifting. In: ICML 2009, pp. 505–512. ACM, New York (2009)Google Scholar
  16. 16.
    Huynh, N.T., Mooney, R.J.: Discriminative Structure and Parameter Learning for Markov Logic Networks. In: ICML 2008, pp. 416–423. ACM, New York (2008)Google Scholar
  17. 17.
    De Raedt, L.: Logical and Relational Learning. Springer, Heidelberg (2008)CrossRefzbMATHGoogle Scholar
  18. 18.
    Richards, B.L., Mooney, R.J.: Learning Relations by Pathfinding. In: AAAI 1992, pp. 50–55 (1992)Google Scholar
  19. 19.
    Silverstein, G., Pazzani, M.: Relational Clichés: Constraining Constructive Induction during Relational Learning. In: ML 1991, pp. 203–207 (1991)Google Scholar
  20. 20.
    Jorge, A.: Iterative Induction of Logic Programs - An Approach to Logic Program Synthesis from Incomplete Specifications. PhD thesis. Univ. of Porto (1998)Google Scholar
  21. 21.
    Agresti, A.: Categorical Data Analysis. John Wiley and Sons, Chichester (2002)CrossRefzbMATHGoogle Scholar
  22. 22.
    Davis, J., Goadrich, M.: The Relationship between Precision-Recall and ROC Curves. In: ICML 2006, pp. 233–240. ACM, New York (2006)Google Scholar
  23. 23.
    Kok, S., Domingos, P.: Learning Markov Logic Networks Using Structural Motifs. In: ICML 2010, pp. 551–558. OmniPress (2010)Google Scholar
  24. 24.
    Davis, J., Domingos, D.: Bottom-Up Learning of Markov Network Structure. In: ICML 2010, pp. 271–278. OmniPress (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Quang-Thang Dinh
    • 1
  • Matthieu Exbrayat
    • 1
  • Christel Vrain
    • 1
  1. 1.LIFOUniversité d’OrléansOrleans Cedex 2France

Personalised recommendations