Prof. NGUYEN's team, Computing Science Research Area, achieved the highest performance in the COLIEE-2024
Professor NGUYEN, Minh Le's team, Computing Science Research Area, achieved the highest performance in Task3, and Task4 of the Competition on Legal Information Extraction/Entailment (COLIEE) 2024, an international competition for information extraction and entailment recognition in legal documents.
COLIEE is an international legal document processing competition. It aims to find AI techniques for addressing legal case retrieval problems, and this is the 11th time the competition has been held. There were four tasks in total, two each from both statute law and case law, and participants solved the problems using AI and presented papers on their methods and the results of their experiments with automated solutions, and Prof. Nguyen's team received first place in two of those tasks (statute law) .
COLIEE-2024 was held in co-located with JURISIN-2024 (International Workshop on Juris-informatics), an associated event of the Japanese Society for Artificial Intelligence International Symposia on AI (JSAI-isAI).
※Reference:COLIEE-2024
JURISIN-2024
■Date Awarded
May 29, 2024
■Team Name and Members
CAPTAIN:Phuong Nguyen, Cong Nguyen, Hiep Nguyen, Minh Nguyen, An Trieu, Dat Nguyen, Le-Minh Nguyen
■Title
Large Language Model for Legal Text Retrieval and Entailment
■Abstract
Recently, the Large Language Models (LLMs) have made a great contribution to massive Natural Language Processing (NLP) tasks. This year, our team, CAPTAIN, utilizes the power of LLM for legal information extraction tasks of the COLIEE competition. To this end, the LLMs are used to understand the complex meaning of legal documents, summarize the important points of legal statute law articles and legal document cases, and find the relations between them and specific legal cases. By using various prompting techniques, we explore the hidden relation between the legal query case and its relevant statute law as supplementary information for testing cases.
The experimental results show the promise of our approach, with first place in the task of legal statute law entailment and competitive performance to the state-of-the-art (SOTA) methods on tasks of legal statute law retrieval and legal case entailment in the COLIEE 2024 competition.
■Comment
COLIEE 2024 is a prestigious competition in the field of Legal AI. This year, the Nguyen Lab achieved the highest overall performance in the competition, winning first place in two of the four tasks. We are incredibly honored to receive this award and would like to express our deep gratitude to JAIST for providing our team with an excellent research environment. This recognition encourages our students and all members of the lab, motivating us to continue conducting research and strive for more significant achievements in the future.
June 14, 2024