Quality control rules

Quality control rules allow you to get more accurate responses and restrict access to tasks to cheating Tolokers. All rules work independently.

List of rules

  • To keep track of how often Tolokers make mistakes:
    • Control tasks: Use them to assign a skill to Tolokers based on their responses to control tasks and ban Tolokers who submit incorrect responses.
    • Majority vote: Quality is based on matching the response from the majority of Tolokers who complete the same task.
    • Results of checking: Evaluate Tolokers based on the number of accepted and rejected responses.
  • To protect your project from robots and cheaters: