This rule is necessary to filter out cheating Tolokers who complete tasks too quickly and carelessly. You can also use it to provide protection against robots that can distort the final results in the pool.
Restrict the pool access for Tolokers who respond too quickly to:
Restrict access for Tolokers who cheat in their responses. In this case, set the time required to complete a task suite when giving random task responses.
Provide anti-robot protection. In this case, set twice as little time for task suite completion.
To estimate the time required to complete a task suite:
Complete a task in the sandbox, if you didn't start the tasks yet.
Look up the Average assignment submit time in pool statistics if the tasks are already running.
Field | Overview |
---|---|
Recent task suites to use | The number of recent assignments submitted by the Toloker. If this field is not filled in, the calculation includes only recent task suites from the pool to which the rule applies. If the field is filled in, the corresponding number of task suites is used. The rule takes into account the task suites from both this pool and other pools where this field is filled in. To learn more about how this field works, go to Parameter "Remember values". |
Minimum time per task suite | The task suite completion time (in seconds). Everything that is completed faster is considered a fast task suite response. |
If | A condition for performing the action in the then field:
To add multiple conditions, click . |
then | Action to perform for the If condition:
|
You noticed that the pool closed too quickly and the final result was unsatisfactory. To prevent this from happening again, you decided to filter out Tolokers who complete tasks too quickly.
Examples are provided for simple classification. There are 10 tasks per suite.
The assignments submitted by banned Tolokers will be taken into account if you don't reject them using manual review. They can be reassigned by setting up the Recompletion of assignments from banned users rule.
A Toloker who completes a task suite in less than 10 seconds will be banned and won't be able to access your tasks.
A Toloker who completes two task suites in less than 20 seconds is suspended from accessing the pool and can't complete your tasks for 10 days.
Last updated:Â July 26, 2023