You can track task completion on the pool page or by clicking Statistics. You can also get notifications by email, in the browser or on the Messages page. In the Profile, open the Notifications tab and choose which notifications you want to receive and how you want to receive them.
Field | Overview |
---|---|
Approximate completion time | The anticipated time for finishing tasks, in days and hours. Calculated using the average time per task suite. Formula: , where:
The time is updated as task suites are completed by Tolokers. Recommendations |
Average assignment submit time | The average time for completing a task suite in the pool. Specified in seconds. Calculated based on 1000 recently completed task suites. Recommendations |
Expired task suites | The number of expired task suites. Includes the pages that Tolokers failed to complete on time. You specify the time allotted for a task suite when setting up a pool. The task can also get the expired status when the Toloker clicks Exit. In this case, the Toloker can return to the task again, unless it was completed by someone else or the requester deleted it from the pool. Recommendations |
Skipped task suites | The number of task suites skipped by Tolokers. Includes the pages that the Tolokers decided to skip and moved on to the next tasks. When the Toloker clicks Skip, the task gets the skipped status. In this case, the Toloker can no longer return to the task. Recommendations |
Submit time | The time between the start and completion of the pool. Displayed if all pool tasks are completed. |
Start date | Pool start date |
Completion date | The date when all pool tasks were completed. |
Assignments | The graph shows the number of tasks by type:
Recommendations |
Average overlap | The average number of Tolokers who completed the same task in the pool. Recommendations |
Assignment submit time | The average time spent by Tolokers to complete a task suite in the pool. Specified in seconds. |
Budget spent (+ fee) | The amount of money spent in the pool. The fee amount is shown in parentheses. If you spent more than you planned, check the price settings in the pool and the quality control rules. For example, Dynamic pricing and Recompletion of assignments from banned users increase the cost of the pool. Recommendations |
Approximate budget (+ fee) | The amount of money spent and expected costs (if all the tasks are completed and all responses are approved). The fee amount is shown in parentheses. Recommendations |
Spending (excluding fee) | The graph shows the amount of money spent without the fee:
|
Average cost per task | The average price in USD per general task in the pool, including overlap. Note that this is the price per task, not per suite with overlap. Recommendations |
Earnings per hour | Average Toloker earnings per hour of data labeling in the pool, in US dollars. Earnings include bonuses. |
Quality on control tasks and training tasks in the pool Quality on control tasks and training tasks | This graph shows the percentage of correct responses in the control and training tasks. Recommendations |
Blocked by rules | The number of Tolokers banned by the quality control rules. Note that the number of Tolokers is counted separately for each rule. Recommendations |
Banned Tolokers | The total number of Tolokers banned in this pool. The graph shows two indicators:
Note that the graph only shows banned Tolokers. It doesn't include Tolokers whose access is suspended. Recommendations |
Active Tolokers with access to the pool | The number of Tolokers selected for the pool with filters. The number includes only Tolokers who viewed and completed tasks in Toloka in the last hour. Recommendations |
Interested in pool | The number of Tolokers who started or completed at least one task suite. It includes both interested and engaged Tolokers. Recommendations |
Submitted in pool | The number of Tolokers who completed at least one task suite. Recommendations |
Submitted assignments per Toloker | The average number of task suites per Toloker. If your pool is large and it is taking a long time to finish it, but there are very few task suites per Toloker, you may have incorrectly configured quality control rules or filters. Recommendations |
Tolokers completing tasks in the pool | This graph shows the total number of Tolokers who completed at least one task suite in the pool. Recommendations |
Last updated:Â August 3, 2023