Quality control rules

  1. List of rules
  2. Quality control presets
  3. How to set up quality control
  4. Troubleshooting

Quality control rules allow you to get more accurate responses and restrict access to tasks to cheating Tolokers. All rules work independently.

List of rules

  • To keep track of how often Tolokers make mistakes:
    • Control tasks: Use them to assign a skill to Tolokers based on their responses to control tasks and ban Tolokers who submit incorrect responses.
    • Majority vote: Quality is based on matching the response from the majority of Tolokers who complete the same task.
    • Results of checking: Evaluate Tolokers based on the number of accepted and rejected responses.
  • To protect your project from robots and cheaters: