Skip to main content
SpringerLink
Log in

Information Extraction/Entailment of Common Law and Civil Code

  • Conference paper
  • First Online:
New Frontiers in Artificial Intelligence (JSAI-isAI 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12758))

Included in the following conference series:

Abstract

With the recent advancements in machine learning models, we have seen improvements in Natural Language Inference (NLI) tasks, but legal entailment has been challenging, particularly for supervised approaches. In this paper, we evaluate different approaches on handling entailment tasks for small domain-specific data sets provided in the Competition on Legal Information Extraction/Entailment (COLIEE). This year COLIEE had four tasks, which focused on legal information processing and finding textual entailment on legal data. We participated in all the four tasks this year, and evaluated different kinds of approaches, including classification, ranking, and transfer learning approaches against the entailment tasks. In some of the tasks, we achieved competitive results when compared to simpler rule-based approaches, which so far have dominated the competition for the last six years.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Extracted pages to from https://ja.wikibooks.org/wiki/

  2. 2.

    The articles where translated from Japanese to English using the Google translation API.

References

  1. Bender, E.M., Koller, A.: Climbing towards NLU: on meaning, form, and understanding in the age of data. In: Proceedings of ACL 2020 (2020). https://doi.org/10.18653/v1/2020.acl-main.463

  2. Branting, K., et al.: Semi-supervised methods for explainable legal prediction. In: Proceedings of ICAIL 2019 (2019). https://doi.org/10.1145/3322640.3326723

  3. Goldberg, Y., Levy, O.: word2vec explained: deriving Mikolov et al’.s negative-sampling word-embedding method (2014). http://arxiv.org/abs/1402.3722

  4. Hudzina, J., Vacek, T., Madan, K., Custis, T., Schilder, F.: Statutory entailment using similarity features and decomposable attention models. In: Proceedings of COLIEE 2019 (2019)

    Google Scholar 

  5. Kim, M., Rabelo, J., Goebel, R.: Statute law information retrieval and entailment. In: Proceedings of ICAIL 2019 (2019). https://doi.org/10.1145/3322640.3326742

  6. Liu, Y., et al.: Roberta: a robustly optimized BERT pretraining approach (2019). https://arxiv.org/abs/1907.11692

  7. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of EMNLP (2014)

    Google Scholar 

  8. Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(140), 1–67 (2020). http://jmlr.org/papers/v21/20-074.html

    MathSciNet  MATH  Google Scholar 

  9. Son, N.T., Phan, V.A., Minh, N.L.: Recognizing entailments in legal texts using sentence encoding-based and decomposable attention models. In: Proceedings of COLIEE 2017 (2017). http://www.easychair.org/publications/paper/347231

  10. Trivedi, H., Kwon, H., Khot, T., Sabharwal, A., Balasubramanian, N.: Repurposing entailment for multi-hop question answering tasks. In: Proceedings of NAACL 2019 (2019). https://doi.org/10.18653/v1/N19-1302

  11. Wang, A., et al.: SuperGLUE: a stickier benchmark for general-purpose language understanding systems. arXiv preprint arXiv:1905.00537 (2019)

  12. Williams, A., Nangia, N., Bowman, S.: A broad-coverage challenge corpus for sentence understanding through inference. In: Proceedings of NAACL-HLT 2018 (2018). http://aclweb.org/anthology/N18-1101

  13. Wolf, T., et al.: HuggingFace’s transformers: state-of-the-art natural language processing. ArXiv abs/1910.03771 (2019)

    Google Scholar 

  14. Yoshioka, M., Kano, Y., Kiyota, N., Satoh, K.: Overview of Japanese statute law retrieval and entailment task at COLIEE-2018 (2018). https://sites.ualberta.ca/~rabelo/COLIEE2019/COLIEE2018_SL_summary.pdf

Download references

Author information

Authors and Affiliations

  1. Center for AI and Cognitive Computing, Thomson Reuters, Eagan, USA

    John Hudzina, Kanika Madan, Dhivya Chinnappa, Jinane Harmouche, Hiroko Bretz, Andrew Vold & Frank Schilder

Authors
  1. John Hudzina
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kanika Madan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dhivya Chinnappa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jinane Harmouche
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hiroko Bretz
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Andrew Vold
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Frank Schilder
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John Hudzina .

Editor information

Editors and Affiliations

  1. Tokyo Institute of Technology, Tokyo, Japan

    Naoaki Okazaki

  2. Kansai Uversity, Osaka, Japan

    Katsutoshi Yada

  3. National Institute of Informatics, Tokyo, Japan

    Ken Satoh

  4. Keio University, Tokyo, Japan

    Koji Mineshima

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hudzina, J. et al. (2021). Information Extraction/Entailment of Common Law and Civil Code. In: Okazaki, N., Yada, K., Satoh, K., Mineshima, K. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2020. Lecture Notes in Computer Science(), vol 12758. Springer, Cham. https://doi.org/10.1007/978-3-030-79942-7_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-79942-7_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-79941-0

  • Online ISBN: 978-3-030-79942-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation