Skip to main content
SpringerLink
Log in

Transforming legal text interactions: leveraging natural language processing and large language models for legal support in Palestinian cooperatives

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

In recent years, there has been a remarkable transformation in our interaction with legal texts due to the widespread utilization and adoption of natural language processing technology. This technology has advanced the analysis and enhanced the understanding of complex legal terminology and contexts. Moreover, the emergence of recent generative large language models (LLMs), particularly ChatGPT, has also introduced a revolutionary contribution to the way legal texts can be processed and comprehended. This paper focuses on the development of a cooperative legal question-answering LLM-based chatbot. Our work involves formulating a set of legal questions pertaining to Palestinian cooperatives and their associated regulations. We compare the auto-generated answers provided by the chatbot with correspondences prepared by a legal expert.To assess the chatbot’s performance, we evaluate its responses to 50 queries generated by the legal expert and compare them to their relevance judgments. The results indicate that the chatbot achieved an impressive overall accuracy rate of 82% in answering the queries, with an F1 score equivalent to 79%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

Not available.

References

  1. Sheik R, Parida SS, Nirmala SJ (2023) A hybrid model utilizing transfer learning for legal citation linking. Int J Inf Technol 15:2783–2792. https://doi.org/10.1007/s41870-023-01323-6

  2. Onifade OF, Ibitoye AO, Mitra P (2018) Embedded fuzzy bilingual dictionary model for cross language information retrieval systems. Int J Inf Technol 10:457–463

    Google Scholar 

  3. Dale R (2019) Law and word order: Nlp in legal tech. Nat Lang Eng 25(1):211–217

    Article  Google Scholar 

  4. Sakulwichitsintu S (2023) Parichartbot: a chatbot for automatic answering for postgraduate students of an open university. Int J Inf Technol 15(3):1387–1397

    Google Scholar 

  5. Lee M, Srivastava M, Hardy A, Thickstun J, Durmus E, Paranjape A, Gerard-Ursin I, Li XL, Ladhak F, Rong F et al (2022) Evaluating human-language model interaction. arXiv preprint arXiv:2212.09746

  6. Omar R, Mangukiya O, Kalnis P, Mansour E (2023) Chatgpt versus traditional question answering for knowledge graphs: current status and future directions towards knowledge graph chatbots. arXiv preprint arXiv:2302.06466

  7. Fang C, Wilkenfeld JN, Navick N, Gibbs JL (2023) “AI am here to represent you”: Understanding how institutional logics shape attitudes toward intelligent technologies in legal work. Manag Commun Q 37(4):941–970

  8. Rajendra JB, Thuraisingam SA (2022) Artificial intelligence and its impact on the legal fraternity. UUM J Legal Stud (UUMJLS) 13(1):129–161

    Google Scholar 

  9. OGB: Official Gazette Bureau (2017) 138. https://lab.pna.ps/ar/Category/20. Accessed 10 May 2023

  10. Cooperative Work Agency: Annual Report (2021) Cooperative Work Agency. https://cwa.pna.ps/publications/201. Accessed 15 May 2023

  11. Gupta I, Chatterjee I, Gupta N (2023) A two-staged nlp-based framework for assessing the sentiments on Indian supreme court judgments. Int J Inf Technol 15:2783–2792. https://doi.org/10.1007/s41870-023-01323-6

  12. Ghosh S, Naskar SK (2022) Detecting context-based in-claim numerals in financial earnings conference calls. Int J Inf Technol 14(5):2559–2566

    Google Scholar 

  13. Sil R, Roy A (2020) A novel approach on argument based legal prediction model using machine learning. In: 2020 international conference on smart electronics and communication (ICOSEC). IEEE, pp 487–490

  14. Phelps T, Ashley K (2022) “Alexa, write a memo’’: the promise and challenges of AI and legal writing. Legal Writ J Legal Writ Inst 26:329

    Google Scholar 

  15. Elaraby M, Litman D (2022) Arglegalsumm: improving abstractive summarization of legal documents with argument mining. arXiv preprint arXiv:2209.01650

  16. Mandal S, Gandhi R, Siy H (2017) Modular norm models: a lightweight approach for modeling and reasoning about legal compliance. In: 2017 IEEE 15th international conference on dependable, autonomic and secure computing, 15th international conference on pervasive intelligence and computing, 3rd international conference on big data intelligence and computing and cyber science and technology congress (DASC/PiCom/DataCom/CyberSciTech). IEEE, pp 657–662

  17. Trautmann D, Petrova A, Schilder F (2022) Legal prompt engineering for multilingual legal judgement prediction. arXiv preprint arXiv:2212.02199

  18. Pettinato Oltz T (2023) Chatgpt, professor of law. Professor of Law (2023)

  19. Queudot M, Charton É, Meurs M-J (2020) Improving access to justice with legal chatbots. Stats 3(3):356–375

    Article  Google Scholar 

  20. White J, Hays S, Fu Q, Spencer-Smith J, Schmidt DC (2023) Chatgpt prompt patterns for improving code quality, refactoring, requirements elicitation, and software design. arXiv preprint arXiv:2303.07839

  21. Liu J (2023) LlamaIndex (GPT Index) is a data framework for your LLM applications. https://github.com/jerryjliu/llama_index. Accessed 15 May 2023

  22. Maree M, Belkhatir M (2010) A coupled statistical/semantic framework for merging heterogeneous domain-specific ontologies. In: 2010 22nd IEEE international conference on tools with artificial intelligence, vol 2. IEEE, pp 159–166

  23. Casas J, Tricot M-O, Abou Khaled O, Mugellini E, Cudré-Mauroux P (2020) Trends and methods in chatbot evaluation. In: In companion publication of the 2020 international conference on multimodal interaction (ICMI '20 companion). Association for Computing Machinery, New York, NY, USA, 280–286. https://doi.org/10.1145/3395035.3425319

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Department of Information Technology, Arab American University, Jenin, Palestine

    Mohammed Maree

  2. Cooperative Work Agency, Ramallah, Palestine

    Rabee Al-Qasem & Banan Tantour

Authors
  1. Mohammed Maree
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rabee Al-Qasem
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Banan Tantour
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Maree.

Additional information

Rabee Al-Qasem and Banan Tantour are contributed equally to this work.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maree, M., Al-Qasem, R. & Tantour, B. Transforming legal text interactions: leveraging natural language processing and large language models for legal support in Palestinian cooperatives. Int. j. inf. tecnol. 16, 551–558 (2024). https://doi.org/10.1007/s41870-023-01584-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-023-01584-1

Keywords

Search

Navigation