NTCIR-12 IMine-2 Search Intent Mining Task

Welcome to the NTCIR-12 IMine-2 Task. Our goal is to explore and evaluate the technologies of understanding user intents behind the query and satisfying different user intents. IMine-2 is a core task of NTCIR-12 and also a succeeding work of IMine@NTCIR-10, INTENT2@NTCIR-10, and INTENT@NTCIR-9. If you are new to the IMine/INTENT tasks, you may want to start by reading overview papers of IMine, INTENT2, and INTENT.


Really thank you for participating the NTCIR-12 IMine-2 Task! The overview paper of IMine-2 can be found at here.
(April 4th 2016) Note: Evaluation and assessment results for VI subtask are now released. Please download via the dataset page.
(February 26th 2016) Note: Evaluation and assessment results for QU subtask are now released. Please download via the dataset page.

(November 17st 2015) Note: Run submission due is approaching! Please check the submission page to submit your runs.

 
(November 1st 2015) Note: Run submission due is extended to November 20th, 2015!

(October 9th 2015) Note: For those who participate in Japanese Query Understanding subtask, user agreement form for Yahoo! Search Query Data is now available!!
(September 4th 2015) Note: Run submission due is extended to November 15th, 2015!
(August 27th 2015) Note: Run submission formats are now available. Plesae check the submission page.
(August 17th 2015) Note: task guideline, topics, and data collections are released. Please check task guideline and download the data from dataset page.


Overview

IMine-2 is a second round of IMine task (IMine-1): please refer to the overview of IMine-1. The scope of IMine is highly related to the search result diversification in IR. Taking over the basic task designs in IMine-1, IMine-2 will more focus on vertical intents behind a query. IMine-2 comprises of two subtasks: Query Understanding (QU) and Vertical Incorporating (VI) subtasks, which correspond to the Subtopic Mining subtask and the Document Ranking subtask in IMine-1, respectively.

In QU subtask, in addition to identifying the subtopics of a query, participants are required to predict which vertical resources (e.g., images, news, shopping, encyclopedia) should be presented for the subtopic. In VI subtask, in addition to diversifying the conventional organic results, participants are required to identify which position in the organic result lists should be presented as vertical results.

Schedule

July 2015 August 17th, 2015 Task Guideline released, Data collection released.
June 30th 2015 July 31st 2015October 31st, 2015 NTCIR-12 Task Registration due
October 31st, 2015 November 15th, 2015 November 20th, 2015 Run submissions due
December 2015 Evaluation begins
January 2016 Evaluation ends
February 1st, 2016 Early draft overview paper released (pdf)
Feburary 1st, 2016mid Feburary 2016 Evaluation results released
March 1st, 2016 Draft papers due
May 2016 Camera ready papers due
June 7th-10th, 2016 NTCIR-12 conference

Participation

To participate in the 12th NTCIR IMine-2 task, please read How to participate NTCIR-12 task and register via NTCIR-12 online registration page.

Organizers

  • Takehiro Yamamoto, Kyoto University
  • Yiqun Liu, Tsinghua University
  • Min Zhang, Tsinghua University
  • Zhicheng Dou, Renmin University of China
  • Ke Zhou, Yahoo! Labs
  • Ilya Markov, University of Amsterdam
  • Makoto P. Kato, Kyoto University
  • Hiroaki Ohshima, Kyoto University
  • Sumio Fujita, Yahoo! Japan

Contact

If any question, please send Email to imine2-organizers at dl.kuis.kyoto-u.ac.jp

Links

NTCIR-12
NTCIR-11 IMine-1
NTCIR-11 IMine TaskMine subtask