Legal Information Extraction/Entailment Competition (COLIEE-2018) - Call for Participation

Dear Colleagues,
We cordially invite you to participate in the Legal Information Extraction and Entailment Competition (COLIEE-2018), derived from the Case Law Competition and Statute Law Competition. The registration deadline is June 30th, 2018.

Please see details below or on the website We look forward to your participation for COLIEE-2018.

Competition on Legal Information Extraction/Entailment (COLIEE) 2018, run in association with the Workshop on Juris-informatics (JURISIN) 2018
November 12-13, 2018, Yokohama, Japan

As an associated event of JURISIN 2018, we are happy to announce the 5th Competition on Legal Information Extraction and Entailment (COLIEE-2018), derived from the case law competition and statute law competition.

There are four tasks in the competition. Tasks 1 and 2 are case law competition, and tasks 3 and 4 are statute law competition. Task 1 is the legal case retrieval task, and it involves reading a new case Q, and extracting supporting cases S1, S2…, Sn for the decision of Q from the entire case law corpus. Task 2 is the legal case entailment task, and it
involves the identification of a paragraph from existing cases that entails the decision of a new case. Task 3 is to extract articles from Japanese civil codes which contribute to solving a bar exam yes/no question, and Task 4 is to check entailment of a question from given civil code article(s).

Detailed description can be found in the URL below.

The data for Task 1 and Task 2 are in English, but the data for Task 3 and Task 4 are available both in Japanese and English (translation from Japanese bar exams and civil code). And you can choose any (or both) language data and any task for participation.

The intention is to build a community of practice regarding legal textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.

We require participants to submit a paper on their method and experimental results to JURISIN 2018 workshop in accordance with an instruction specified at and to present the paper at the special session of JURISIN 2018.

These papers will be reviewed in the same way of usual submission to JURISIN 2018 and extended versions could be submitted to an LNAI post-proceeding of JSAI-IsAI2018 (the name of symposium in which JURISIN 2018 is included). The selected paper will be published in the LNAI post-proceedings.

Important dates:
Jun. 30, 2018 Task Registration Due.
Jun. 30, 2018 Dry run data release.
Jul. 31, 2018 Formal run data release.
Aug. 15, 2018 Formal run submission due.
Aug. 21, 2018 Notification of Evaluation results and Release of gold standard answers.
Aug. 30, 2018 Paper submission due.
Sep. 30, 2018 Notification of acceptance.
Oct. 10, 2018 Camera ready papers due.
Nov. 12-13, 2018 JURISIN 2018 Workshop with COLIEE-2018

Application Details:
Potential participants to COLLIE-2018 should respond to this call for
participation by submitting an application. To apply, submit the application
and memorandums of the following URL to miyoung2(at) .


Memorandum for Tasks 1 and/or 2 (Case law competition)

Memorandum for Tasks 3 and/or 4 (Statute law competition, English Data)

Memorandum for Tasks 3 and/or 4 (Statute law competition, Japanese Data)

We will send an acknowledgement to the email address supplied in the form
once we have processed the form.

Task coordinators:
Mi-Young Kim, University of Alberta, Canada
Randy Goebel, University of Alberta, Canada
Ken Satoh, National Institute of Informatics, Japan
Yoshinobu Kano, Shizuoka University, Japan
Masaharu Yoshioka, Hokkaido University, Japan

Questions and further information:

Get in touch with us on Linkedin

Join the IAAIL group on Linkedin! Your posts will be shared on the IAAIL website

Contact us

International Association for AI and Law

Send us an email