Speed/quality balance

By default, your tasks are available to all Tolokers. If you set filters, they are available only to those who match them.

When there are many Tolokers, you can get results quickly, but the quality of the Tolokers' responses may be poor.

If you want to improve speed or quality of labeling, use the Speed/quality balance pool setting.

It allows you to select Tolokers based on real-time assumption of how well Tolokers might handle your tasks. This assumption takes into account large amount of data about Tolokers behavior in the system, previously completed projects, and the current project type:

  • TOP % — allows you to set the percentage of top-rated Tolokers who will have access to your task.

    Example
  • Online — allows you to set the maximum number of top-rated Tolokers who will have access to your task.

    Example
Note

If there are too few Tolokers who match the filters, the platform will display no values in the Speed and Quality fields replacing them with dashes.

How does it work?

A personalized quality forecast is based on a large amount of data about user behavior in the system, how other Tolokers completed your task, and the task itself. Based on this data, we predict in real time how well each particular user will handle your task. We select top-rated Tolokers by comparing quality forecasts for all Tolokers.

Recommendations

  • Make sure that the total number of Tolokers exceeds the one required to complete your task several times. Otherwise, your task may not be completed due to lack of Tolokers.

  • If you don't know what settings to choose, make the task available only to top-rated Tolokers. For example, set 20% in the TOP % setting. If the tasks completion speed is insufficient, increase the value to get results faster.

What's next

See also

For developers

Troubleshooting

Why has the speed of pool completion dropped?
What does the labeling speed depends on?
How can I speed up the pool completion?
Contact support

Last updated: February 28, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary