Toloka documentation

Control tasks

    This indicator shows the average ratio of control tasks to other tasks within per task suites. A large percentage of control tasks lets you improve the quality but, at the same time, it may make labeling more expensive.

    How to calculate

    Pcontrol=TcontrolTtotal×100P_{control} = \frac{T_{control}}{T_{total}}\times100

    where:

    • PcontrolP_{control} is the percentage of control tasks.

    • TcontrolT_{control} is the number of control tasks.

    • TtotalT_{total} is the total number of tasks.

    The indicator estimation criteria depends on the pool type.

    • A good indicator is 30%.

    • A low indicator is < 30%.

    • A good indicator is 100%.

    • A low indicator is > 90%.