toloka.client.collectors.GoldenSet | Source code
GoldenSet(self,*,uuid: Optional[UUID] = None,history_size: Optional[int] = None)
Collects control and training task statistics for a Toloker.
Use control tasks to assign a skill to Tolokers based on their responses and block Tolokers who submit incorrect responses.
It is better not to use this collector if:
The collector can be used with conditions:
The collector can be used with actions:
The ID of a collector. Note that when you clone a pool, both pools start using the same collector, because it is not cloned. Usually, it is not an intended behavior. For example, in this case one collector gathers history size from both pools.
The maximum number of recent control or training tasks used to calculate the statistics. If
The example shows how to accept all assignments if more than 80% of responses to control tasks are correct.
new_pool = toloka.pool.Pool(....)new_pool.quality_control.add_action(collector=toloka.collectors.GoldenSet(history_size=5),conditions=[toloka.conditions.GoldenSetCorrectAnswersRate > 80,toloka.conditions.GoldenSetAnswersCount >= 5,],action=toloka.actions.ApproveAllAssignments())