Toloka documentation

Submission rate

This indicator shows the percentage of successfully submitted tasks and helps identify issues related to incorrect settings:

  • The indicator does not show any value. Perhaps the set criteria for selecting Tolokers are too strict and your tasks are not available to them.

  • A low percentage of submitted tasks indicates problems with the settings of individual fields.

  • The percentage of submitting tasks is zero. In this case, check whether the field names specified in the task interface are correct.

How to calculate

Psubm=Tsubm+Taccept+TrejectTsubm+Taccept+Treject+Texpire+Tskip×100P_{subm} = \frac{T_{subm}+T_{accept}+T_{reject}}{T_{subm}+T_{accept}+T_{reject}+T_{expire}+T_{skip}}\times100

where:

  • PsubmP_{subm} is the percentage of submitted tasks.

  • TsubmT_{subm} is the number of submitted tasks.

  • TacceptT_{accept} is the number of accepted tasks.

  • TrejectT_{reject} is the number of rejected tasks.

  • TexpireT_{expire} is the number of tasks that were not submitted within the allowed time.

  • TskipT_{skip} is the number of skipped tasks.

How to estimate

  • A good indicator is > 90%.

  • A low indicator is < 90%.

See also