Control tasks

Control tasks contain samples of correct responses. They allow you to monitor the quality of task completion without having to check all the responses. Control tasks simplify the verification process, help identify Tolokers' qualifications, and save your time.

Note. To save time, you can opt for having your control tasks edited by Toloka experts. In this case, markup is performed within the pool.

When to use

Use control tasks to assign a skill to Tolokers based on their responses and ban Tolokers who submit incorrect responses.

Don't use it if:
  • You have a lot of response options.
  • Tolokers need to attach a file to their assignment.
  • Tolokers need to transcribe text.
  • Tolokers need to select objects in a photo.
  • Tasks don't have a correct or incorrect response. For example: “Which image do you like best?” or “Choose the page design option that you like best”.

How to configure

Attention.

The If and then fields in this rule are mandatory. If you don't fill in at least one field, you won't be able to save the rule.

Field

Overview

Recent control and training task responses to use

The number of the Toloker's last responses to control tasks.

If this field is not filled in, the calculation includes only control task responses in the pool to which the rule applies.

If the field is filled in, the corresponding number of control task responses is used. The rule takes into account responses from both the current pool and other pools where this field is filled in.

Learn more about how this field works.

If

A condition for performing the action in the then field:
  • number of responses — The number of completed control and training tasks.

  • correct responses (%) — The percentage of correct responses in training and control tasks (from 0 to 100).

  • incorrect responses (%) — The percentage of incorrect responses in training and control tasks (from 0 to 100).

  • number of control responses — The number of completed control tasks.
  • correct control responses (%) — The percentage of correct responses in control tasks (from 0 to 100).
  • incorrect control responses (%) — The percentage of incorrect responses in control tasks (from 0 to 100).

To add multiple conditions, click .

then