Skip to main content
SpringerLink
Log in

CrossOIE: Cross-Lingual Classifier for Open Information Extraction

  • Conference paper
  • First Online:
Computational Processing of the Portuguese Language (PROPOR 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12037))

Abstract

Open information extraction (Open IE) is the task of extracting open-domain assertions from natural language sentences. Considering the low availability of datasets and tools for this task in languages other than English, recently it has been proposed that multilingual resources can be used to improve Open IE methods for different languages. In this work, we present the CrossOIE, a multilingual publicly available relation tuple validity classifier that scores Open IE systems’ extractions based on their estimated quality and can be used to improve Open IE systems and assist in the creation of Open IE benchmarks for different languages. Experiments show that our model trained using a small corpus in English, Spanish, and Portuguese can trade recall performance for up to 27% improvement in precision. This result was also archived in a zero-shot scenario, demonstrating a successful knowledge transfer across the languages.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://github.com/BrikerMan/Kashgari.

References

  1. Akbik, A., Bergmann, T., Blythe, D., Rasul, K., Schweter, S., Vollgraf, R.: FLAIR: an easy-to-use framework for state-of-the-art NLP. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pp. 54–59 (2019)

    Google Scholar 

  2. Akbik, A., Chiticariu, L., Danilevsky, M., Kbrom, Y., Li, Y., Zhu, H.: Multilingual information extraction with polyglotie. In: COLING (Demos), pp. 268–272 (2016)

    Google Scholar 

  3. Batista, D.S., Forte, D., Silva, R., Martins, B., Silva, M.: Extracçao de relaçoes semânticas de textos em português explorando a dbpédia e a wikipédia. Linguamatica 5(1), 41–57 (2013)

    Google Scholar 

  4. Bender, E.M.: Linguistically naïve != language independent: why NLP needs linguistic typology. In: Proceedings of the EACL 2009 Workshop on the Interaction between Linguistics and Computational Linguistics: Virtuous, Vicious or Vacuous? pp. 26–32. Association for Computational Linguistics, Athens, March 2009. https://www.aclweb.org/anthology/W09-0106

  5. Chen, X., Awadallah, A.H., Hassan, H., Wang, W., Cardie, C.: Zero-resource multilingual model transfer: Learning what to share. arXiv preprint arXiv:1810.03552 (2018)

  6. Claro, D., Souza, M., CastellĂŁ Xavier, C., Oliveira, L.: Multilingual open information extraction: challenges and opportunities. Information 10(7), 228 (2019)

    Article  Google Scholar 

  7. Collovini, S., et al.: IberLEF 2019 Portuguese named entity recognition and relation extraction tasks. In: Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019), vol. 2421, pp. 390–410. CEUR-WS.org (2019)

    Google Scholar 

  8. Cui, L., Wei, F., Zhou, M.: Neural open information extraction. arXiv preprint arXiv:1805.04270 (2018)

  9. Del Corro, L., Gemulla, R.: Clausie: clause-based open information extraction. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 355–366. ACM (2013)

    Google Scholar 

  10. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  11. Ettinger, A.: What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models. arXiv preprint arXiv:1907.13528 (2019)

  12. Faruqui, M., Kumar, S.: Multilingual open relation extraction using cross-lingual projection. arXiv preprint arXiv:1503.06450 (2015)

  13. Gamallo, P., Garcia, M.: Multilingual open information extraction. In: Pereira, F., Machado, P., Costa, E., Cardoso, A. (eds.) EPIA 2015. LNCS (LNAI), vol. 9273, pp. 711–722. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23485-4_72

    Chapter  Google Scholar 

  14. Glauber, R., Claro, D.B.: A systematic mapping study on open information extraction. Expert Syst. Appl. 112, 372–387 (2018)

    Article  Google Scholar 

  15. Glauber, R., Claro, D.B., de Oliveira, L.S.: Dependency parser on open information extraction for Portuguese texts - DptOIE and DependentIE on IberLEF. In: Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019), vol. 2421, pp. 442–448. CEUR-WS.org (2019)

    Google Scholar 

  16. Glauber, R., de Oliveira, L.S., Sena, C.F.L., Claro, D.B., Souza, M.: Challenges of an annotation task for open information extraction in Portuguese. In: Villavicencio, A., et al. (eds.) PROPOR 2018. LNCS (LNAI), vol. 11122, pp. 66–76. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99722-3_7

    Chapter  Google Scholar 

  17. Lample, G., Conneau, A.: Cross-lingual language model pretraining. arXiv preprint arXiv:1901.07291 (2019)

  18. LĂ©chelle, W., Gotti, F., Langlais, P.: Wire57: A fine-grained benchmark for open information extraction. arXiv preprint arXiv:1809.08962 (2018)

  19. Matthews, B.W.: Comparison of the predicted and observed secondary structure of t4 phage lysozyme. Biochimica et Biophysica Acta (BBA)-Protein Structure 405(2), 442–451 (1975)

    Article  Google Scholar 

  20. Sanches, L.M.P., Cardel, V.S., Machado, L.S., Souza, Marlo, Salvador, L.N.: Disambiguating open IE: identifying semantic similarity in relation extraction by word embeddings. In: Villavicencio, A., et al. (eds.) PROPOR 2018. LNCS (LNAI), vol. 11122, pp. 93–103. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99722-3_10

    Chapter  Google Scholar 

  21. Pereira, V., Pinheiro, V.: Report-um sistema de extração de informações aberta para língua portuguesa. In: Proceedings of Symposium in Information and Human Language Technology, pp. 191–200. Sociedade Brasileira de Computação (2015)

    Google Scholar 

  22. Pires, T., Schlinger, E., Garrette, D.: How multilingual is multilingual bert? arXiv preprint arXiv:1906.01502 (2019)

  23. Sena, C.F.L., Claro, D.B.: Pragmatic information extraction in Brazilian Portuguese documents. In: Villavicencio, A., et al. (eds.) PROPOR 2018. LNCS (LNAI), vol. 11122, pp. 46–56. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99722-3_5

    Chapter  Google Scholar 

  24. Sena, C.F.L., Claro, D.B.: Inferportoie: a Portuguese open information extraction system with inferences. Nat. Lang. Eng. 25(2), 287–306 (2019). https://doi.org/10.1017/S135132491800044X

    Article  Google Scholar 

  25. Sena, C.F.L., Glauber, R., Claro, D.B.: Inference approach to enhance a Portuguese open information extraction. In: Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS, pp. 442–451, INSTICC, ScitePress, Porto (2017). https://doi.org/10.5220/0006338204420451

  26. Stanovsky, G., Michael, J., Zettlemoyer, L., Dagan, I.: Supervised open information extraction. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 885–895 (2018)

    Google Scholar 

  27. Sun, M., Li, X., Wang, X., Fan, M., Feng, Y., Li, P.: Logician: a unified end-to-end neural approach for open-domain information extraction. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 556–564. ACM (2018)

    Google Scholar 

  28. Wu, S., Dredze, M.: Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT. CoRR abs/1904.09077 (2019). http://arxiv.org/abs/1904.09077

  29. Zadrozny, B., Elkan, C.: Transforming classifier scores into accurate multiclass probability estimates. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 694–699. ACM (2002)

    Google Scholar 

  30. Zeiler, M.D.: Adadelta: an adaptive learning rate method. arXiv preprint arXiv:1212.5701 (2012)

  31. Zhang, S., Duh, K., Van Durme, B.: MT/IE: cross-lingual open information extraction with neural sequence-to-sequence models. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pp. 64–70 (2017)

    Google Scholar 

Download references

Acknowledgements

Authors would like to thank FAPESB, CNPQ and Capes for their financial support.

Author information

Authors and Affiliations

  1. FORMAS Research Group, Computer Science Department, LaSiD Laboratory, Institute of Mathematics and Statistics, Federal University of Bahia, Salvador, Bahia, Brazil

    Bruno Souza Cabral, Rafael Glauber, Marlo Souza & Daniela Barreiro Claro

Authors
  1. Bruno Souza Cabral
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rafael Glauber
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marlo Souza
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniela Barreiro Claro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniela Barreiro Claro .

Editor information

Editors and Affiliations

  1. University of Évora, Evora, Portugal

    Paulo Quaresma

  2. University of Évora, Evora, Portugal

    Renata Vieira

  3. University of SĂŁo Paulo, SĂŁo Carlos, Brazil

    Sandra AluĂ­sio

  4. University of Lisbon, Lisbon, Portugal

    Helena Moniz

  5. INESC-ID/ISCTE-IUL, Lisbon, Portugal

    Fernando Batista

  6. University of Évora, Evora, Portugal

    Teresa Gonçalves

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cabral, B.S., Glauber, R., Souza, M., Claro, D.B. (2020). CrossOIE: Cross-Lingual Classifier for Open Information Extraction. In: Quaresma, P., Vieira, R., Aluísio, S., Moniz, H., Batista, F., Gonçalves, T. (eds) Computational Processing of the Portuguese Language. PROPOR 2020. Lecture Notes in Computer Science(), vol 12037. Springer, Cham. https://doi.org/10.1007/978-3-030-41505-1_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41505-1_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41504-4

  • Online ISBN: 978-3-030-41505-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation