AcceptanceRate

toloka.client.collectors.AcceptanceRate | Source code

AcceptanceRate(
    self,
    *,
    uuid: Optional[UUID] = None,
    history_size: Optional[int] = None
)
Copy text

Counts accepted and rejected Toloker's assignments.

If non-automatic acceptance is set in the pool, you may use this collector to:

• Set a Toloker's skill.
• Block access for Tolokers with too many rejected responses.

The collector can be used with conditions:

• TotalAssignmentsCount — Total count of checked assignments submitted by a Toloker.
• AcceptedAssignmentsRate — A percentage of accepted assignments.
• RejectedAssignmentsRate — A percentage of rejected assignments.

The collector can be used with actions:

• RestrictionV2 blocks access to projects or pools.
• ApproveAllAssignments accepts all Toloker's assignments.
• RejectAllAssignments rejects all Toloker's assignments.
• SetSkill sets Toloker's skill value.
• SetSkillFromOutputField sets Toloker's skill value using an output field.

Parameters description

Examples:

The example shows how to block a Toloker if they make too many mistakes. If more than 35% of responses are rejected, then the Toloker is restricted to access the project. The rule is applied after collecting 3 or more responses.

new_pool = toloka.client.pool.Pool()
new_pool.quality_control.add_action(
    collector=toloka.client.collectors.AcceptanceRate(),
    conditions=[
        toloka.client.conditions.TotalAssignmentsCount > 2,
        toloka.client.conditions.RejectedAssignmentsRate > 35,
    ],
    action=toloka.client.actions.RestrictionV2(
        scope=toloka.client.user_restriction.UserRestriction.PROJECT,
        duration=15,
        duration_unit='DAYS',
        private_comment='The Toloker often makes mistakes',
    )
)
Copy text

Last updated: August 28, 2023