Quality control lets you get more accurate responses and restrict access to tasks for cheating Tolokers. Quality control consists of rules. All rules work independently.
To set up quality control:
Open the project page.
Go to the Quality control tab.
Click Set quality control.
Click Add Quality Control Rule.
In the list that appears, select the appropriate rules. If you aren't sure what quality control rules you need, select a ready-made protection set of rules with default settings.
Make settings for the rules you added. Below is a list of rules with links to detailed information about the rule settings.
To keep track of how often Tolokers make mistakes:
Majority vote: Quality is based on matching the response from the majority of Tolokers who complete the same task.
Results of checking: Evaluate Tolokers based on the number of accepted and rejected responses.
To protect your project from robots and cheaters:
To attract a variety of Tolokers:
To allow recompletion of certain assignments:
Create a task pool in the project.
Learn more about how to set up a project:
Last updated: February 15, 2023