Overlap is the number of Tolokers who should complete each task in the pool.
You can set overlap in the pool settings:
Task type | Recommended overlap |
---|---|
Most tasks have automatic acceptance | from 3 to 5 |
Simple task | 3 |
Reviewed task | 1 |
You can change overlap after the pool is started. To do this, open the pool editing mode and set the new overlap value. You don't need to restart the pool. Updating the settings is usually fast, but if there are many tasks, it may take several minutes.
Dynamic overlap lets you change overlap depending on:
How well the Tolokers do on the task.
How well Tolokers' responses match each other.
This type of overlap helps you save money without reducing the quality of data labeling.
Selective majority vote verification allows you to set up majority vote check for only a portion of tasks.
This type of overlap helps you save money and speed up pool completion.