Meta-Interpretive Learning of Data Transformation Programs

  • Andrew Cropper
  • Alireza Tamaddoni-Nezhad
  • Stephen H. Muggleton
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9575)

Abstract

Data transformation involves the manual construction of large numbers of special-purpose programs. Although typically small, such programs can be complex, involving problem decomposition, recursion, and recognition of context. Building such programs is common in commercial and academic data analytic projects and can be labour intensive and expensive, making it a suitable candidate for machine learning. In this paper, we use the meta-interpretive learning framework (MIL) to learn recursive data transformation programs from small numbers of examples. MIL is well suited to this task because it supports problem decomposition through predicate invention, learning recursive programs, learning from few examples, and learning from only positive examples. We apply Metagol, a MIL implementation, to both semi-structured and unstructured data. We conduct experiments on three real-world datasets: medical patient records, XML mondial records, and natural language taken from ecological papers. The experimental results suggest that high levels of predictive accuracy can be achieved in these tasks from small numbers of training examples, especially when learning with recursion.

Keywords

Predictive Accuracy Transformation Rule Medical Patient Record Transformation Language Prolog Program 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgements

The first author acknowledges the support of the BBSRC and Syngenta in funding his PhD Case studentship. The second author acknowledges the support from the IMI eTRIKS project. The third author would like to thank the Royal Academy of Engineering and Syngenta for funding his present 5 year Research Chair.

References

  1. 1.
    Aitken, J.S.: Learning information extraction rules: An inductive logic programming approach. In: ECAI, pp. 355–359 (2002)Google Scholar
  2. 2.
    Berardi, M., Malerba, D.: Learning recursive patterns for biomedical information extraction. In: Muggleton, S.H., Otero, R., Tamaddoni-Nezhad, A. (eds.) ILP 2006. LNCS (LNAI), vol. 4455, pp. 79–93. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Craven, M., Kumlien, J., et al.: Constructing biological knowledge bases by extracting information from text sources. ISMB 1999, 77–86 (1999)Google Scholar
  4. 4.
    Cropper, A., Muggleton, S.H.: Learning efficient logical robot strategies involving composable objects. In: Proceedings of the 24th International Joint Conference Artificial Intelligence (IJCAI 2015), pp. 3423–3429. IJCAI (2015)Google Scholar
  5. 5.
    Cropper, A., Muggleton, S.H.: Logical minimisation of meta-rules within meta-interpretive learning. In: Davis, J., Ramon, J. (eds.) ILP 2014. LNCS, vol. 9046, pp. 62–75. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-23708-4_5 CrossRefGoogle Scholar
  6. 6.
    Goadrich, M., Oliphant, L., Shavlik, J.: Learning ensembles of first-order clauses for recall-precision curves: a case study in biomedical information extraction. In: Camacho, R., King, R., Srinivasan, A. (eds.) ILP 2004. LNCS (LNAI), vol. 3194, pp. 98–115. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  7. 7.
    Gulwani, S.: Automating string processing in spreadsheets using input-output examples. In: Proceedings of the 38th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL 2011, Austin, TX, USA, 26–28 January 2011, pp. 317–330 (2011)Google Scholar
  8. 8.
    Le, V., Gulwani, S.: Flashextract: A framework for data extraction by examples. In: ACM SIGPLAN Notices, vol. 49, pp. 542–553. ACM (2014)Google Scholar
  9. 9.
    Lin, D., Dechter, E., Ellis, K., Tenenbaum, J.B., Muggleton, S.H.: Bias reformulation for one-shot function induction. In: Proceedings of the 23rd European Conference on Artificial Intelligence (ECAI 2014), pp. 525–530. IOS Press, Amsterdam (2014)Google Scholar
  10. 10.
    Manine, A.-P., Alphonse, E., Bessières, P.: Extraction of genic interactions with the recursive logical theory of an ontology. In: Gelbukh, A. (ed.) CICLing 2010. LNCS, vol. 6008, pp. 549–563. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  11. 11.
    Tamaddoni-Nezhad, A., Muggleton, S.: Stochastic refinement. In: Frasconi, P., Lisi, F.A. (eds.) ILP 2010. LNCS, vol. 6489, pp. 222–237. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Muggleton, S.H., Lin, D., Pahlavi, N., Tamaddoni-Nezhad, A.: Meta-interpretive learning: application to grammatical inference. Mach. Learn. 94, 25–49 (2014)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Muggleton, S.H., Lin, D., Tamaddoni-Nezhad, A.: Meta-interpretive learning of higher-order dyadic datalog: predicate invention revisited. Mach. Learn. 100(1), 49–73 (2015). doi: 10.1007/s10994-014-5471-y MathSciNetCrossRefMATHGoogle Scholar
  14. 14.
    Quinlan, J.R., Cameron-Jones, R.M.: FOIL: a midterm report. In: Brazdil, P.B. (ed.) ECML 1993. LNCS, vol. 667. Springer, Heidelberg (1993)Google Scholar
  15. 15.
    De Raedt, L., Kersting, K.: Probabilistic inductive logic programming. In: De Raedt, L., Frasconi, P., Kersting, K., Muggleton, S.H. (eds.) Probabilistic Inductive Logic Programming. LNCS (LNAI), vol. 4911, pp. 1–27. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  16. 16.
    Srinivasan, A.: The Aleph Manual. University of Oxford, Oxford (2007)Google Scholar
  17. 17.
    Sunderland, K.D.: The diet of some predatory arthropods in cereal crops. J. Appl. Ecol. 12(2), 507–515 (1975)CrossRefGoogle Scholar
  18. 18.
    Bo, W., Knoblock, C.A.: An iterative approach to synthesize data transformation programs. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI) (2015)Google Scholar
  19. 19.
    Bo, W., Szekely, P., Knoblock, C.A.: Learning data transformation rules through examples: preliminary results. In: Proceedings of the Ninth International Workshop on Information Integration on the Web, IIWeb 2012, pp. 8:1–8:6. ACM, New York, NY, USA (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Andrew Cropper
    • 1
  • Alireza Tamaddoni-Nezhad
    • 1
  • Stephen H. Muggleton
    • 1
  1. 1.Department of ComputingImperial College LondonLondonUK

Personalised recommendations