GoldenSetIncorrectAnswersRate

toloka.client.conditions.GoldenSetIncorrectAnswersRate | Source code

GoldenSetIncorrectAnswersRate(
self,
operator: CompareOperator,
value: Optional[float] = None
)

The percentage of incorrect responses to control tasks.

GoldenSetIncorrectAnswersRate is used with collectors:

Examples:

pool = toloka.client.pool.Pool()
pool.quality_control.add_action(
collector=toloka.client.collectors.GoldenSet(history_size=5),
conditions=[
toloka.client.conditions.GoldenSetIncorrectAnswersRate >= 40,
toloka.client.conditions.GoldenSetAnswersCount >= 5,
],
action=toloka.client.actions.RejectAllAssignments()
)

Last updated: August 28, 2023

Toloka-Kit
OverviewGetting API keyQuick start
Recipes
Reference
toloka.client
toloka.async_client
toloka.autoquality [autoquality]
toloka.metrics
toloka.streaming