Speed/quality balance

  1. How does it work?
  2. Improve the quality of results
  3. Recommendations
  4. What's next
  5. Troubleshooting

By default, your tasks are available to all performers. If you set filters, they are available only to those who match them.

When there are many performers, you can get results quickly, but the quality of the performers' responses may be poor. The number of active performers (who will see the task if you publish it now) is displayed in the TOP % tab to the left of the slider:

You can select performers for your task based on a personalized quality forecast.

How does it work?

A personalized quality forecast is based on a large amount of data about user behavior in the system, how other users completed your task, and the task itself. Based on this data, we predict in real time how well each particular user will handle your task. We select the best performers by comparing quality forecasts for all users.

Improve the quality of results

You can select only the best performers using one of the filters in the personalized quality forecast:
  • TOP % — Allows you to set the percentage of the best performers who will have access to your task.

  • Online — Allows you to set the maximum number of the best performers who will have access to your task.

  • Time — Allows you to set the desired pool completion time. The service automatically calculates the required performer quality forecast based on the number of task suites, overlap, and the number of active performers. The pool may actually be completed faster or slower.

Recommendations

  • Make sure that the total number of performers exceeds the one required to complete your task several times. Otherwise, your task may not be completed due to lack of performers.

  • If you don't know what settings to choose, make the task available only to the best performers. For example, set 20% in the TOP % setting. If the tasks completion speed is insufficient, increase the value to get results faster.

Troubleshooting

Why has the speed of pool completion dropped?
Possible reasons:

  • You've stopped the main pool. This could limit the number of performers with access to the pool. Start the training pool again. There will be more performers who can access the tasks.

  • The filters you set are too strict. For example, a strong restriction on a certain skill that most users don't have.
  • Too many users are banned. Ease the quality control rules.
How can I speed up the pool completion?