Welcome to the NTCIR-12 IMine-2 Task. Our goal is to explore and evaluate the technologies of understanding user intents behind the query and satisfying different user intents. IMine-2 is a core task of NTCIR-12 and also a succeeding work of IMine@NTCIR-10, INTENT2@NTCIR-10, and INTENT@NTCIR-9. If you are new to the IMine/INTENT tasks, you may want to start by reading overview papers of IMine, INTENT2, and INTENT.
(April 4th 2016) Note: Evaluation and assessment results for VI subtask are now released. Please download via the dataset page.
(February 26th 2016) Note: Evaluation and assessment results for QU subtask are now released. Please download via the dataset page.
(February 1st 2016) Note: Ealy draft overview paper is now available here.
November 17st 2015) Note: Run submission due is approaching! Please check the submission page to submit your runs.
(November 1st 2015) Note: Run submission due is extended to November 20th, 2015!
(October 9th 2015) Note: For those who participate in Japanese Query Understanding subtask, user agreement form for Yahoo! Search Query Data is now available!!
(September 4th 2015) Note: Run submission due is extended to November 15th, 2015!
(August 27th 2015) Note: Run submission formats are now available. Plesae check the submission page.
(August 17th 2015) Note: task guideline, topics, and data collections are released. Please check task guideline and download the data from dataset page.
IMine-2 is a second round of IMine task (IMine-1): please refer to the overview of IMine-1. The scope of IMine is highly related to the search result diversification in IR. Taking over the basic task designs in IMine-1, IMine-2 will more focus on vertical intents behind a query. IMine-2 comprises of two subtasks: Query Understanding (QU) and Vertical Incorporating (VI) subtasks, which correspond to the Subtopic Mining subtask and the Document Ranking subtask in IMine-1, respectively.
In QU subtask, in addition to identifying the subtopics of a query, participants are required to predict which vertical resources (e.g., images, news, shopping, encyclopedia) should be presented for the subtopic. In VI subtask, in addition to diversifying the conventional organic results, participants are required to identify which position in the organic result lists should be presented as vertical results.
|Task Guideline released, Data collection released.|
|NTCIR-12 Task Registration due|
|Run submissions due|
|December 2015||Evaluation begins|
|January 2016||Evaluation ends|
|February 1st, 2016||Early draft overview paper released (pdf)|
|Evaluation results released|
|March 1st, 2016||Draft papers due|
|May 2016||Camera ready papers due|
|June 7th-10th, 2016||NTCIR-12 conference|
- Takehiro Yamamoto, Kyoto University
- Yiqun Liu, Tsinghua University
- Min Zhang, Tsinghua University
- Zhicheng Dou, Renmin University of China
- Ke Zhou, Yahoo! Labs
- Ilya Markov, University of Amsterdam
- Makoto P. Kato, Kyoto University
- Hiroaki Ohshima, Kyoto University
- Sumio Fujita, Yahoo! Japan
If any question, please send Email to imine2-organizers at dl.kuis.kyoto-u.ac.jp