Pool parameters

ParameterOverviewFound in the block
Pool nameThe pool name shown only to you (as a requester) on the project page.General information
Public descriptionWill be displayed instead of the project description in the task list for Tolokers and linked training.General information
Private commentIf necessary, you can add a private pool description that will only be available to you.General information
Price per task suite, $Payment per task suite in US dollars. For cents, use the dot (".") as a separator. If the Pool type is General tasks, the minimum price per task suite is $0.005. For other pool types, you can set the price to zero. To learn more about price management, go to Setting up pricing.Price
OverlapThe number of Tolokers who should complete each task in the pool.

Configure this parameter if you need several people to complete your task. Overlap is necessary in tasks for collecting photo datasets, recording audio, or conducting surveys. In other types of tasks, it can improve the quality of results.

To save money, you can set up dynamic overlap (also known as incremental relabeling or IRL). Learn more.
Price
My tasks may contain shocking or pornographic contentWhether the tasks have some content which can be marked as adult, including shocking or pornographic content. Tasks with such content are only given to Tolokers who agree to complete these types of tasks.

If you aren't sure whether the tasks have such content, enable this option.
Audience
Filters

By setting the filters, you choose Tolokers that meet your requirements to complete your task. There are filters by various criteria, and filters by skills that you can create yourself.

You can filter Tolokers by language, country, city, and so on. Learn more

If you give training tasks to Tolokers, you can add a skill to the pool to choose Tolokers who already completed training. Learn more about skills

Audience
Speed/quality balanceA setting for choosing Tolokers for your tasks. If you want to get responses very quickly, the quality may be doubtful. If you want very high quality, be prepared to wait longer. Find a balance that meets your needs. Learn more.Audience
Review task responses manuallyTurn on this option to review the completed tasks manually.

Set the time period when you can check the tasks and reject them if the results are poor.

To learn more about manual review, go to Reviewing assignments.
Quality control
TrainingThis field is only available if you have training pools in the project.

Training pool that will be linked to the main one.
Quality control
Level required, %This field is only available if you have filled in the Training field.

Percentage of correct responses in training tasks (from 0 to 100) required to be admitted to the pool tasks. The calculation is based on the first response the Toloker gave in each task.

The minimum required level that you can set is 5. Tolokers who complete training with apercentage below this level won't have access to tasks.
Quality control
General tasksThe number of general tasks per suite.Smart mixing
Control tasksThe number of control tasks per suite.Smart mixing
Training tasksThe number of training tasks per suite.Smart mixing
Min general tasksThe minimum number of general tasks per suite.Smart mixing
Min control tasksThe minimum number of control tasks per suite.Smart mixing
Min training tasksThe minimum number of training tasks per suite.Smart mixing
Allow partial task suites
Note

This option is available only if the Smart mixing method is selected.

The setting determines the output in the last task suite if it has less than the required number of general tasks.

By default, the option is enabled.
Smart mixing
Keep task order from uploaded data
Note

This option is available only if the Smart mixing method is selected.

Option disabled (default value)

The uploaded tasks are grouped in suites and given to Tolokers in random order. Within the suite, the task order is always random.

Example

Option enabled

Tasks will be grouped on suites in the order they are listed in the task file.

Example

If the pool has an overlap, the next task is distributed only when the previous task is completed by the necessary number of Tolokers.

Use this parameter to:

  • Speed up collection of task responses for majority vote check.

  • Assign tasks by priority.

    Put important tasks in the beginning of the file. They will be completed faster and with the necessary overlap.

Smart mixing
Review period in days

The number of days for reviewing and accepting tasks (max: 21). The Toloker will see the deadline for checking the tasks:

  • In the task information on the Toloka main page.
  • In the history of completed tasks.
Quality control
Dynamic pricingThis parameter allows you to vary the task price depending on the Toloker's skill level. Learn moreDynamic pricing and overlap
Dynamic overlapYou can use this parameter if you specify fixed values for the input data fields. It lets you save your budget and avoid setting fixed overlap for all pool tasks.

You set the range, the service analyzes the responses, their consistency, the level of Tolokers' skills and, if necessary, increases the overlap within the range you specified.
Dynamic pricing and overlap
Pool priority within the projectNumber from 0 to 100. Allows you to rank a pool within a project. First, a Toloker is assigned tasks from a pool with higher priority.Additional settings
Time per task suite, secThe time allowed for completing a task suite, in seconds. Uncompleted tasks are redistributed to other Tolokers.

We recommend spending no more than 60 seconds per task (including the time for page loading and sending responses).

If you set the interval too long, the tasks will stay open for a long time. If it is too short, the tasks won't be completed and paid for.
Additional settings
Keep pool open after completion, secThe interval during which the pool will remain open from the moment all tasks are completed. Minimum — 0 (1 if you use dynamic overlap), maximum — 259200 seconds (three days).

For example, you can use this parameter if you need an open pool where you regularly upload new tasks.
Additional settings
Pool closing dateThe date the pool closes. The pool closes automatically on this date, even if the tasks aren't marked up.Additional settings
Pool type

Specify the pool type:

  • General tasks: The main pool that contains your regular tasks.

  • Exam: A pool that contains only control tasks.

  • Training: A main pool that consists only of training tasks and can have zero cost. Use it to train Tolokers before performing real tasks if the training pool doesn't work well for your project.

  • Retry: A pool that helps Tolokers who make mistakes improve their skills and get a second chance to complete tasks.

  • Other: If none of the previous options fit.

Note

If the price per task suite is zero, you must select the pool type.

Additional settings

Last updated: June 26, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary