Which overlap should I choose?
Research shows that the optimal overlap for task assignment is 3 to 5. Beyond this, quality increases only slightly while price increases significantly. Be sure to check the section about incremental relabeling
, which is a smart way to control costs on overlap.
How many control tasks should I add?
If a task set consists of several hundred tasks, then 10% of the pool should be control tasks. If the set contains thousands of tasks, just 1% is enough.
How do I create control tasks?
There are two ways to create control tasks: