Toloka documentation

QualityControl

toloka.client.quality_control.QualityControl | Source code

QualityControl(
    self,
    *,
    training_requirement: Optional[TrainingRequirement] = None,
    captcha_frequency: Union[CaptchaFrequency, str, None] = None,
    configs: Optional[List[QualityControlConfig]] = ...,
    checkpoints_config: Optional[CheckpointsConfig] = None
)

Quality control unit settings and pool ID with training tasks

Quality control lets you get more accurate responses and restrict access to tasks for cheating performers. Quality control consists of rules. All rules work independently.

Parameters Description

Parameters Type Description
training_requirement Optional[TrainingRequirement]

Parameters of the training pool that is linked to the pool with the main tasks.

captcha_frequency Optional[CaptchaFrequency]

Frequency of captcha display (By default, captcha is not shown): LOW - show every 20 tasks. MEDIUM, HIGH - show every 10 tasks.

configs Optional[List[QualityControlConfig]]

List of quality control units. See QualityControl.QualityControlConfig

checkpoints_config Optional[CheckpointsConfig]

Random check majority opinion. Datailed description in QualityControl.CheckpointsConfig.

Examples:

How to set up quality control on new pool.

new_pool = toloka.pool.Pool(....)
new_pool.quality_control.add_action(
    collector=toloka.collectors.AssignmentSubmitTime(history_size=5, fast_submit_threshold_seconds=20),
    conditions=[toloka.conditions.FastSubmittedCount > 1],
    action=toloka.actions.RestrictionV2(
        scope=toloka.user_restriction.UserRestriction.ALL_PROJECTS,
        duration=10,
        duration_unit='DAYS',
        private_comment='Fast responses',  # Only you will see this comment
    )
)

Methods Summary

Method Description
add_action Adds new QualityControlConfig to QualityControl object. Usually in pool.