How to edit tasks by yourself

You can turn a general task into a control task by adding the correct answer, or into a training task by adding the correct answer and a hint.

What makes a good hint?
Restriction

Task markup is available only for training pools and pools uploaded with “smart mixing”.

How do I mark up tasks?

  1. Make sure the pool isn't running.

  2. Go to the pool page and click either the Control tasks or Training tasks indicator in the Tasks block.

    Click Control or Training tasks
  3. Create a control or a training task from another type of task clicking the appropriate button.

    Create control or training tasks
  4. Select the correct response in the task preview block.

  5. Select the output data fields that should be checked.

  6. Add a hint if you're creating a training task.

  7. Click Save and go to next.

Example of task markup
Tip

When creating control tasks, enter only correct responses that answer the question. So for an image classification task, Image loading error is not a correct response that answers the task question.

How to improve the reliability of control tasks

After you have created the control tasks, make sure that different variations of correct task responses occur with the same frequency. This will help avoid random guessing in responses.

  1. Go to the pool page and click the Control tasks indicator in the Tasks block.

  2. Check the Distribution of correct responses for control tasks chart.

    The distribution of responses is shown as a percentage.

Example of response distribution

Correct
Incorrect

How to view the control tasks statistics

You can view the number and percentage of correct responses to the control tasks or training tasks.

To do this, go to the pool page and click the Control tasks or Training tasks indicator in the Tasks block.

The response statistics is shown in the Responses from Tolokers and Correct responses, % columns.

Alternative way

  1. Click Edit in the Tasks block on the pool page.

  2. Click the tab with the type of the task.

  3. Find the task in the list and click .

The response statistics is shown in the Responses and Correct fields at the right.

How to edit tasks

  1. Make sure the pool isn't running.

  2. Go to the pool page and click Edit in the Tasks block.

  3. Click the tab with the type of the task.

  4. Find the task in the list and click . Editing mode opens.

How to delete a task from the pool

  1. Make sure the pool isn't running.

  2. Go to the pool page and click Edit in the Tasks block.

  3. Click the tab with the type of the task.

  4. Find the task in the list and click . You can also delete a task from the pool in editing mode.

Tip

If you set the overlap to 0 via the API, the task won't be visible to Tolokers, and you won't have to delete it.

What's next

See also

Troubleshooting

Uploading tasks to a pool
How many tasks should be in a suite?
How many control tasks do I need to add?
How are the correct control task responses counted?
Contact support

Last updated: May 3, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary