Creating a pool

If you already have a pool and you want to create an identical one, clone the existing pool. If not, create a new pool.

New pool

A pool contains the settings of a set of task that are sent out for completion. The task interface is described in the customizable project.

Tip. You can first test the pool settings in the sandbox and then move them to the Toloka production version along with the project.

To create a pool, follow the instructions:

  1. Click Add pool on the project page.

  2. Set the parameters and click Save.

Tasks in pools will automatically be available in the web version of Toloka and the mobile app. If you want to change the default settings and limit the visibility of the task for any of the versions, add the Client filter and select the desired value: Toloka web version or Toloka for mobile.

Pool parameters

Parameter

Overview

Name

The pool name shown only to you (as a requester) on the customizable project page.

Public description

Will be displayed instead of the project description in the task list for Tolokers and linked training.

Private description

If necessary, you can add a private project description that will only be available to you.

Training

This field is only available if you have training pools in the project.

Training pool that will be linked to the main one.

Pool type

This field should be filled in when you set tasks for 0 cents. Choose an option from the list:

  • Examination — Control tasks to assess how well Tolokers completed their training.
  • Training — A main pool which consists only of training tasks and can have a zero cost. Use it to train Tolokers before performing real tasks if the training pool doesn't work well for your project.
  • Retry — Control tasks to give a second chance to Tolokers who passed the training and exam but made a lot of mistakes while completing the general tasks.
  • Other — If none of the above apply.
Level required

This field is only available if you have filled in the Training field.

Percentage of correct responses in training tasks (from 0 to 100) required to be admitted to the pool tasks. The calculation is based on the first response the Toloker gave in each task.

The minimum required level that you can set is 5. Tolokers who complete training with apercentage below this level won't have access to tasks.

Price per task suite

Payment per task suite in US dollars. For cents, use the dot (".") as a separator. The minimum price is $0.01. For more information, see the Setting up pricing section.

dynamic pricing

This parameter allows you to vary the task price depending on the Toloker's skill level. Learn more

Adult content

Whether the tasks have porn content. Tasks with porn content are only issued to Tolokers who have agreed to complete these types of tasks.

If you aren't sure whether the tasks have porn content, select "Yes".

Users filter

By setting the filters, you choose Tolokers that meet your requirements to complete your task. There are filter sets, filters by various criteria, and filters by skills that you can create yourself.

If you are working with Russian-language texts in the task, you don't need to display the project for non-Russian speakers. You can set a filter for the Russian language. Similarly, you can filter Tolokers by place of residence in a particular country or city, and so on. Learn more

If you give training tasks to Tolokers, you can add a skill to the pool to choose Tolokers who already completed training. Learn more about skills

Offline accept

Turn on this option to review the completed tasks manually.

Set the time period when you can check the tasks and reject them if the results are poor.

Learn more about task review here and here.

Captcha frequency

The frequency of captcha display:

  • “No” — Don't show captchas.

  • “Low” — Show a captcha after every 20 assignments.

  • “Medium”/ “High” — Show a captcha after every 10 assignments.

To show the captcha to Tolokers, set the quality control rule.

Review period

The number of days for reviewing and accepting tasks (max: 21). The Toloker will see the deadline for checking the tasks:

  • In the task information on the Toloka main page.

  • In the history of completed tasks.

Overlap

The number of Tolokers who should complete each task in the pool.

Configure this parameter if you need several people to complete your task. Overlap is necessary in tasks for collecting photo datasets, recording audio, or conducting surveys. In other types of tasks, it can improve the quality of results.

To save money, you can set up dynamic overlap (also known as incremental relabeling or IRL).

Dynamic overlap will help you save money. Learn more.

dynamic-overlap

You can use this parameter if you specify fixed values for the input data fields. It lets you save your budget and avoid setting fixed overlap for all pool tasks.

You set the range, the service analyzes the responses, their consistency, the level of Tolokers' skills and, if necessary, increases the overlap within the range you specified.

Speed / Quality

A setting for choosing Tolokers for your tasks. If you want to get responses very quickly, the quality may be doubtful. If you want very high quality, be prepared to wait longer. Find a balance that meets your needs. Learn more.

Time on task

The time allowed for completing a task suite, in seconds. Uncompleted tasks are redistributed to other Tolokers.

We recommend spending no more than 60 seconds per task (including the time for page loading and sending responses).

If you set the interval too long, the tasks will stay open for a long time. If it is too short, the tasks won't be completed and paid for.

Keep task order

Option disabled (default value)

The uploaded tasks are grouped in pages and given to Tolokers in random order. Within the page, the task order is always random.

Example

If you specified 2 tasks per suite when uploading the TSV file with image links to the pool, the system can generate them as follows:

Tasks in the file Page 1 Page 2 Page 3
Image 1 Image 2 Image 6 Image 4
Image 2 Image 5 Image 1 Image 3
Image 3
Image 4
Image 5
Image 6
Tasks in the file Page 1 Page 2 Page 3
Image 1 Image 2 Image 6 Image 4
Image 2 Image 5 Image 1 Image 3
Image 3
Image 4
Image 5
Image 6

Option enabled

Tasks will be grouped on pages in the order they are listed in the TSV file.
Example

If you specified 2 tasks per suite when uploading the TSV file with image links to the pool, you are equally likely to get pages where the first link goes first and the second goes second, and the other way round:

Tasks in the file Page 1 Page 2 Page 3
Image 1 Image 1 Image 3 Image 5
Image 2 Image 2 Image 4 Image 6
Image 3 or or or
Image 4 Image 2 Image 4 Image 6
Image 5 Image 1 Image 3 Image 5
Image 6
Tasks in the file Page 1 Page 2 Page 3
Image 1 Image 1 Image 3 Image 5
Image 2 Image 2 Image 4 Image 6
Image 3 or or or
Image 4 Image 2 Image 4 Image 6
Image 5 Image 1 Image 3 Image 5