Editing a pool

You can edit a pool which doesn't have the Archived status. While editing, an open pool switches to the “CLOSED_FOR_UPDATE” status. For example, this way you can change the payout amount in a running pool.

To edit the pool parameters, click at the top of the pool page or in the list of pools on the project page.

General information

Pool type

Select the value in the Pool type drop-down list.

Pool name

Set the Pool name (visible only to you) field. Only you will see this pool name on the project page.

Pool description

Specify the pool description which will be displayed instead of the project description in the task list for Tolokers. By default, Tolokers see the description from the project settings. To use a different description, uncheck the Use project description box and set Public description. If necessary, click + Private comment to add a private project description that only you will see.

Price

Price per task suite, $

Payment per task suite in US dollars. For cents, use the dot (".") as a separator. If the Pool type is General tasks, the minimum price per task suite is $0.005. For other pool types, you can set the price to zero. To learn more about price management, go to Setting up pricing.

Toloker interest at this price

Calculated automatically. Shows how the price meets Tolokers' expectations.

Number of tasks per suite

Calculated automatically. Shows the number of tasks per suite recommended for this type of project.

Overlap

The number of Tolokers who should complete each task in the pool.

Configure this parameter if you need several people to complete your task. Overlap is necessary in tasks for collecting photo datasets, recording audio, or conducting surveys. In other types of tasks, it can improve the quality of results.

To save money, you can set up dynamic overlap (also known as incremental relabeling or IRL).

Dynamic overlap will help you save money. Learn more.

Task price

Calculated automatically.

Audience

Adult content

Whether the tasks have some content which can be marked as adult, including shocking or pornographic content. Tasks with such content are only given to Tolokers who agree to complete these types of tasks.

If you aren't sure whether the tasks have such content, enable the My tasks may contain shocking or pornographic content option.

Filters and skills

By setting the filters, you choose Tolokers that meet your requirements to complete your task. There are filters by various criteria, and filters by skills that you can create yourself.

You can filter Tolokers by language, country, city, and so on. Learn more

If you give training tasks to Tolokers, you can add a skill to the pool to choose Tolokers who already completed training. Learn more about skills

Speed/quality balance

A setting for choosing Tolokers for your tasks. You can set the percentage or number of top-rated Tolokers.

When there are many Tolokers, you can get results quickly, but the quality of the Tolokers' responses may be poor. Find a balance that meets your needs. Learn more.

Quality control

Review responses manually

Turn on this option to review the completed tasks manually.

Set the time period when you can check the tasks and reject them if the results are poor.

Learn more about the manual review and reviewing Tolokers' responses.

Review period in days

The number of days for reviewing and accepting tasks (max: 21). The Toloker will see the deadline for checking the tasks:

• In the task information on the Toloka main page.

• In the history of completed tasks.

Quality control rules

You can add other quality control rules by clicking Add a quality control rule. You can select ready-made sets of rules or set the rules you need manually. Learn more.

Smart mixing

General tasks

The number of general tasks per suite.

Control tasks

The number of control tasks per suite.

Training tasks

The number of training tasks per suite.

Min general tasks

The minimum number of general tasks per suite.

Min control tasks

The minimum number of control tasks per suite.

Min training tasks

The minimum number of training tasks per suite.

Allow partial task suites

The setting determines the output in the last task suite if it has less than the required number of general tasks.

By default, the option is enabled.

Keep task order from uploaded data

Option disabled (default value)

The uploaded tasks are grouped in suites and given to Tolokers in random order. Within the suite, the task order is always random.

Option enabled

Tasks will be grouped on suites in the order they are listed in the task file.

If the pool has an overlap, the next task is distributed only when the previous task is completed by the necessary number of Tolokers.

Use this parameter to:

• Speed up collection of task responses for majority vote check.

• Assign tasks by priority.

  Put important tasks in the beginning of the file. They will be completed faster and with the necessary overlap.

Dynamic pricing and overlap

Dynamic pricing

This parameter allows you to vary the task price depending on the Toloker's skill level. Learn more.

Dynamic overlap

You can use this parameter if you specify fixed values for the input data fields. It lets you save your budget and avoid setting fixed overlap for all pool tasks.

You set the range, the service analyzes the task responses, their consistency, the level of Tolokers' skills and, if necessary, increases the overlap within the range you specified. Learn more.

Optional settings

Pool priority within the project

Number from 0 to 100. Allows you to rank a pool within a project. First, a Toloker is assigned tasks from a pool with higher priority.

Time per task suite, sec

The time allowed for completing a task suite, in seconds. Uncompleted tasks are redistributed to other Tolokers.

We recommend spending no more than 60 seconds per task (including the time for page loading and sending responses).

If you set the interval too long, the tasks will stay open for a long time. If it is too short, the tasks won't be completed and paid for.

Keep pool open after completion, sec

The interval during which the pool will remain open from the moment all tasks are completed. Minimum — 0 (1 if you use dynamic overlap), maximum — 259200 seconds (three days).

For example, you can use this parameter if you need an open pool where you regularly upload new tasks.

Pool closing date

The date the pool closes. The pool closes automatically on this date, even if the tasks aren't marked up.

Pool type

Specify the pool type:

• General tasks: The main pool that contains your regular tasks.

• Exam: A pool that contains only control tasks.

• Training: A main pool that consists only of training tasks and can have zero cost. Use it to train Tolokers before performing real tasks if the training pool doesn't work well for your project.

• Retry: A pool that helps Tolokers who make mistakes improve their skills and get a second chance to complete tasks.

• Other: If none of the previous options fit.

curl -X PUT 'https://toloka.dev/api/v1/pools/32267581' \
     -H 'Content-Type: application/json' \
     -H 'Authorization: ApiKey PlaceYourRealApiKey_Here' \
     -d '{"id":"32267581","project_id":"81776","private_name":"Transcript of audio recordings","may_contain_adult_content":true,"will_expire":"2023-03-09T00:00:00","auto_close_after_complete_delay_seconds":0,"reward_per_assignment":0.070,"metadata":{},"assignment_max_duration_seconds":600,"auto_accept_solutions":true,"auto_accept_period_day":21,"assignments_issuing_config":{"issue_task_suites_in_creation_order":false},"filter":{"and":[{"or":[{"category":"profile","key":"languages","operator":"IN","value":"EN"}]}]},"quality_control":{"configs":[{"collector_config":{"type":"ASSIGNMENT_SUBMIT_TIME","uuid":"38830d4b-930b-43ab-a98f-f52e992fd11a","parameters":{"fast_submit_threshold_seconds":15}},"rules":[{"conditions":[{"key":"fast_submitted_count","operator":"GTE","value":2}],"action":{"type":"RESTRICTION_V2","parameters":{"scope":"PROJECT","duration_unit":"PERMANENT"}}}]}]},"defaults":{"default_overlap_for_new_task_suites":3},"priority":0,"owner":{"id":"6c6e20dc86cca2ae787afcb2629de162","myself":true},"type":"REGULAR","status":"OPEN","created":"2022-03-10T07:41:53.626","speed_quality_balance":{"percent":100,"type":"TOP_PERCENTAGE_BY_QUALITY"}}'
Copy text

What's next

• Add tasks to the pool

• Learn more about how to set up a pool:

  • Setting up pricing.
  • Dynamic overlap.
  • Selective majority vote control.
  • Filters.
  • Speed/quality balance.
  • Setting up quality control.
  • Reviewed assignments.

For developers

• Toloka API: Editing pool
• Toloka API: Changing pool priority
• Toloka-Kit: Editing pool
• Toloka-Kit: Patching pool
• Toloka-Kit recipe: Change pool priority

Troubleshooting

Last updated: August 3, 2023