CorrectAnswersRate

toloka.client.conditions.CorrectAnswersRate | Source code

CorrectAnswersRate(
self,
operator: CompareOperator,
value: Optional[float] = None
)

The percentage of correct responses.

CorrectAnswersRate is used with collectors:

Examples:

pool = toloka.client.pool.Pool()
pool.quality_control.add_action(
collector=toloka.client.collectors.MajorityVote(answer_threshold=2),
conditions=[
toloka.client.conditions.TotalAnswersCount > 9,
toloka.client.conditions.CorrectAnswersRate < 60,
],
action=toloka.client.actions.RejectAllAssignments(public_comment='Too low quality')
)

Last updated: August 28, 2023

Toloka-Kit
OverviewGetting API keyQuick start
Recipes
Reference
toloka.client
toloka.async_client
toloka.autoquality [autoquality]
toloka.metrics
toloka.streaming