Toloka documentation

Control tasks

This indicator shows the average ratio of control tasks to other tasks within per task suites. A large percentage of control tasks lets you improve the quality but, at the same time, it may make labeling more expensive.

How to calculate

Pcontrol=TcontrolTtotal×100P_{control} = \frac{T_{control}}{T_{total}}\times100

where:

  • PcontrolP_{control} is the percentage of control tasks.

  • TcontrolT_{control} is the number of control tasks.

  • TtotalT_{total} is the total number of tasks.

The indicator estimation criteria depends on the pool type.

  • A good indicator is 30%.

  • A low indicator is < 30%.

  • A good indicator is 100%.

  • A low indicator is > 90%.

See also