NTCIR-11 IMine Search Task Mining (TaskMine) Subtask

Overview

Task Mining Task (TaskMine) is a subtask of the NTCIR-11 IMine Task.

The information needs of a web search engine user are sometimes related to complex tasks, which cannot be satisfied with a single query or session. For example, for a searcher who is planning to “move to a new house,” the searcher first has to know what steps are needed to achieve the task like “submit notification of moving in,” “submit notification of moving out,” “ask an electronic company for cutting of power” and so on. Moreover, the searcher has to know when these steps should be done. As another example, for a searcher who wants to “lose weight,” there may exist several possible solutions for the task like “do physical exercise,” “take calories intake,” “take diet pills.” In this way, tasks behind searchers’ information needs are comprised of several “subtasks.”

The goal of TaskMine is to understand the relationship among tasks for supporting the Web searchers. Particularly, this pilot task aims to explore the methods of automatically finding subtasks of a given task. Understanding structures of such complex tasks would be beneficial to the searchers. For example, the system can automatically suggest the user alternative tasks, and/or offer diversified documents by treating their subtasks as its intents.

This year, we will focus on Japanese queries and Japanese textual output.

News

  • Submission due has been extended to June 13th, 2014 (Mar 30th)
  • Test queries and submission formats released (Mar 31st)
  • Sample queries and outputs released (Jan 8th)

Schedule

Jan 2014 First call for participation, web page launch
Jan 20th, 2014 Registration due
Feb 2014 Sample tasks (queries) and subtasks (outputs) released
Mar 31, 2014 Test queries released
May 31, 2014Jun 13, 2014 Run submissions due
June 1, 2014 Evaluation begins
Jul 2014 Evaluation ends
Aug 2014 Evaluation results released
Sep 2014 Draft papers due
Nov 2014 Camera ready papers due
Dec 2014 NTCIR-11 conference

Registration

Please register via registration link to participate in this subtask.

Organisers

  • Takehiro Yamamoto (Kyoto University)
  • Makoto P. Kato (Kyoto University)
  • Hiroaki Ohshima (Kyoto University)