How to edit tasks by yourself
You can turn a general task into a control task by adding the correct answer, or into a training task by adding the correct answer and a hint.
Task markup is available only for training pools and pools uploaded with “smart mixing”.
How do I mark up tasks?
-
Make sure the pool isn't running.
-
Go to the pool page and click either the Control tasks or Training tasks indicator in the Tasks block.
-
Create a control or a training task from another type of task clicking the appropriate button.
-
Select the correct response in the task preview block.
-
Select the output data fields that should be checked.
-
Add a hint if you're creating a training task.
-
Click Save and go to next.
When creating control tasks, enter only correct responses that answer the question. So for an image classification task, Image loading error is not a correct response that answers the task question.
How to improve the reliability of control tasks
After you have created the control tasks, make sure that different variations of correct task responses occur with the same frequency. This will help avoid random guessing in responses.
-
Go to the pool page and click the Control tasks indicator in the Tasks block.
-
Check the Distribution of correct responses for control tasks chart.
The distribution of responses is shown as a percentage.
Example of response distribution
How to view the control tasks statistics
You can view the number and percentage of correct responses to the control tasks or training tasks.
To do this, go to the pool page and click the Control tasks or Training tasks indicator in the Tasks block.
The response statistics is shown in the Responses from Tolokers and Correct responses, % columns.
Alternative way
-
Click
→ Edit in the Tasks block on the pool page. -
Click the tab with the type of the task.
-
Find the task in the list and click
.
The response statistics is shown in the Responses and Correct fields at the right.
How to edit tasks
-
Make sure the pool isn't running.
-
Go to the pool page and click
→ Edit in the Tasks block. -
Click the tab with the type of the task.
-
Find the task in the list and click
. Editing mode opens.
How to delete a task from the pool
-
Make sure the pool isn't running.
-
Go to the pool page and click
→ Edit in the Tasks block. -
Click the tab with the type of the task.
-
Find the task in the list and click
. You can also delete a task from the pool in editing mode.
If you set the overlap to 0 via the API, the task won't be visible to Tolokers, and you won't have to delete it.
What's next
See also
Troubleshooting
Last updated: May 3, 2023