Quality control rules allow you to get more accurate responses and restrict access to tasks to cheating Tolokers. All rules work independently.
To keep track of how often Tolokers make mistakes:
Results of checking: Evaluate Tolokers based on the number of accepted and rejected task suite responses.
To protect your project from robots and cheaters:
To attract a variety of Tolokers:
To allow recompletion of certain assignments:
Toloka has presets of quality control rules. Currently, there are three of them:
Elementary — suitable for requesters who need tasks to be completed by a large number of Tolokers in a short time.
Basic — suitable for those who need to balance quality and quantity.
Advanced — a set with a large number of rules required for complex tasks.
The table shows the rules included in each of the sets.
|Earnings||Skipped assignments||Control tasks||Majority vote||Submitted answers||Fast responses|
Go to pool editing (click in the upper-right corner of the pool page) and click Add a quality control rule in the Quality control section.
You can copy quality control settings from another pool. To do this, click Copy audience filters and quality control settings in the Audience section.
Last updated: February 15, 2023