Creating a pool

If you already have a pool and you want to create an identical one, clone the existing pool. If not, create a new pool.

New pool

A pool contains the settings of a set of task that are sent out for completion. The task interface is described in the project.

To create a pool:

1. Click Create new pool on the project page.

2. Select the value in the Pool type drop-down list.

   Pool types
   Note

   If the price per task suite is zero, you must select the pool type.

3. Set the Pool name (visible only to you) field. Only you will see this pool name on the project page.

4. Specify the pool description which will be displayed instead of the project description in the task list for Tolokers. By default, Tolokers see the description from the project settings. To use a different description, uncheck the Use project description box and set Public description. If necessary, click + Private comment to add a private project description that only you will see.

5. Click Create.

6. Follow the steps in the pool wizard:

   Note

   After each step click Save to apply changes or Cancel to discard them.

   1. Select the audience for your task

      Select Tolokers using filters. Tasks will only be shown to matching Tolokers, rather than to all of them.

      Click the Add filter button and set the filter parameters.

   2. Setup quality control

      Quality control lets you get more accurate responses and restrict access to tasks for cheating users. Quality control consists of rules. All rules work independently.

      To learn more, see the Quality control overview section.

   3. Set the task price and overlap

      In the Price per task suite, $ field, set the amount of money to pay per task suite done by one Toloker.

      Pay attention to the Toloker interest at this price indicator. It shows how your price meets expectations of Tolokers. If the interest is low, you can raise price per task suite to have a bigger number of Tolokers in the project. If the interest is high, you can reduce price to save money.

      In the Overlap field, define how many Tolokers must do each task.

      You can also set up dynamic pricing and dynamic overlap.

   4. Prepare and upload data

      Upload tasks to the pool. This step will be enabled after you complete the previous steps.

   5. Add control tasks for checking performance

      Add control tasks to monitor the quality of task completion:

      1. Enter correct task responses.

      2. Select the fields to use.

      3. Click Save and go to next or Skip task.

      4. Click Save all control tasks.

      Note

      This step will be enabled after you complete the previous steps. You can skip this step by clicking Do it later.

   6. Double-check your project and try out tasks

      At this step, check how the task will look from the Toloker's point of view.

      Note

      This step will be enabled after you complete the previous steps. You can skip this step by clicking Do it later.

   7. Add optional pool settings

      Set up advanced pool settings.

      Note

      This step will be enabled after you complete the previous steps. You can skip this step by clicking Use default settings.

After all the steps, you'll see the Set up is finished and your pool is ready for labeling tip on the pool page.

Tasks in pools will automatically be available in the web version of Toloka and the mobile app. If you want to change the default settings and limit the visibility of the task for any of the versions, add the Client filter and select the desired value: Toloka web version or Toloka for mobile.

curl -X POST 'https://toloka.dev/api/v1/pools' \
     -H 'Content-Type: application/json' \
     -H 'Authorization: ApiKey PlaceYourRealApiKey_Here' \
     -d '{"project_id":"83859","private_name":"First pool","will_expire":"2030-01-01T00:00:00.000Z","reward_per_assignment":0.05,"assignment_max_duration_seconds":300,"auto_accept_solutions":false,"defaults":{"default_overlap_for_new_task_suites":1}}'
Copy text

Pool parameters

Project moderation

Moderation begins when you launch the first pool of a new project in which the pools have not been started before.

This usually takes about 1 hour. In some cases, the moderation process may take longer. Note that tasks are not available to Tolokers during moderation. Once it's finished, you'll get a message with the results.

If your project successfully passes moderation and you didn't pause the pool, Tolokers will start your tasks.

Otherwise, you'll see the Your project didn't pass moderation label under the project name. In this case, you won't be able to launch pools and Tolokers won't see tasks from the project.

If your project is rejected, press the Contact support button on the pool page or on the project page to find out why and get specific recommendations.

Use the recommendations to fix the task content and let us know when it's ready to check. If everything is OK, your project will be approved, and Tolokers will be able to start your tasks. If not, we'll tell you what else you need to do. Also you can clone the rejected project, make changes and launch it again.

How Tolokers see pools

Tolokers can't see pools inside the project and select specific tasks (except for field tasks, where they can select points on the map). They also can't see pool settings, the number of tasks, or completion progress.

If at least one pool from the project is available to the Toloker, then this project is displayed on the main page as a card with the name, description, and price for the task. After selecting a project, the Toloker is issued a task from the pool. When they complete it, another one is issued, and so on.

A single project card is displayed if the pools in it differ only by name, quality control, or filters. In the latter case, the project card only includes tasks from the pools that the Toloker has access to.

Several cards are displayed if the pools differ in these settings:

• Acceptance type
• Public description
• Task price

This is useful if you want to combine tasks in pools by subject, duration of audio recordings, or difficulty of evaluation.

Cloning a pool

To clone a pool, click → Clone at the top of the pool page or in the list of pools on the project page.

If you need to change the pool settings, open edit mode.

What's next

• Start a pool.

• Learn more about how to set up a pool:

  • Setting up pricing.
  • Dynamic overlap.
  • Selective majority vote control.
  • Filters.
  • Speed/quality balance.
  • Setting up quality control.
  • Reviewed assignments.

For developers

• Toloka API: Creating pool
• Toloka-Kit recipe: Create pool

Troubleshooting

Last updated: August 3, 2023