CheckpointsConfig

toloka.client.quality_control.QualityControl.CheckpointsConfig | Source code

CheckpointsConfig(
    self,
    *,
    real_settings: Optional[Settings] = None,
    golden_settings: Optional[Settings] = None,
    training_settings: Optional[Settings] = None
)
Copy text

A selective majority vote check configuration.

This quality control method checks some of Toloker's responses against the majority of Tolokers. To do this, it changes the overlap of those tasks.

An example of the configuration:

• For the first 100 tasks completed by a Toloker in the pool, every 5th task is checked. The overlap of these tasks is increased to 5.

• After completing 100 tasks, every 25th task is checked.

Learn more about the Selective majority vote check.

Parameters description

Last updated: August 28, 2023