You can use this rule to:
Resend rejected task suites for recompletion to other Tolokers.
If you rejected a task suite, you may want it to be completed by a different Toloker instead of the one whose response you rejected. To do this, you can increase the overlap for this task suite only. This is especially helpful if you have the overlap value set to 1.
Save money on re-completing task suites that you have already accepted.
If you reviewed and accepted a task suite, it may not make sense for other Tolokers to complete it. To avoid this, you can reduce the overlap only for accepted task suites.
Set key values in the quality_control.configs
array in the pool settings.
Re-assign task suites that didn't pass manual review.
{ "configs": [ { "collector_config": { "type": "ASSIGNMENTS_ASSESSMENT" }, "rules": [ { "conditions": [ { "key": "rejected_assignments_count", "operator": "GTE", "value": "1" }, { "key": "assessment_event", "operator": "EQ", "value": "REJECT" } ], "action": { "type": "CHANGE_OVERLAP", "parameters": { "delta": 1, "open_pool": true, } } } ] } ]}
Parameter | Overview |
---|---|
configs[] | array of objects | required Array of quality control settings. |
configs[].collector_config | object | required Parameters for collecting statistics (for example, the number of tasks skipped in the pool). |
configs[].collector_config.type | string | required Criteria for the quality control rule:
|
configs[].collector_config.parameters | object | required if
Parameters for collecting data (depends on the quality control rule specified in the |
configs[].collector_config.parameters.history_size | integer | required The maximum number of the Toloker's recent responses in the project to use for calculating the percentage of correct responses. If this field is omitted, the calculation is based on all the Toloker's responses in the pool. |
configs[].rules | object | required Parameters for the control rule conditions and actions. |
configs[].rules.conditions | object | required Conditions (for example, 10 task suites skipped in a row). Multiple conditions are combined with the AND operator. |
configs[].rules.conditions.key | string | required
|
configs[].rules.conditions.operator | string | required
|
configs[].rules.conditions.value | string | required The number of task suites with a specific status. |
configs[].rules.action | object | required The action to perform if conditions are met (for example, block access to the project). |
configs[].rules.action.type | string | requiredCHANGE_OVERLAP — Change the overlap. For example, to re-assign a task suite to other Tolokers or cancel the recompletion of accepted task suites. |
configs[].rules.action.parameters | object | required Action parameters. |
configs[].rules.action.parameters.scope | string | required
|
configs[].rules.action.parameters.skill_id | string | required if Required if type=SET_SKILL_FROM_OUTPUT_FIELD .ID of the skill to update as tasks are completed. |
configs[].rules.action.parameters.from_field | string | required if
|
configs[].rules.action.parameters.skill_value | integer | required if Required if type=SET_SKILL_FROM_OUTPUT_FIELD .A fixed value to assign to the skill (a number from 0 to 100). |
configs[].rules.action.parameters.delta | integer | required if Required if type=CHANGE_OVERLAP .The value determines the amount to change the overlap by. |
configs[].rules.action.parameters.public_comment | string | required if Required if type=REJECT_ALL_ASSIGNMENTS .Comments (the reason for rejecting responses). Available to the requester and the Toloker. |
configs[].rules.action.parameters.duration_unit | string Ban duration unit:
|
configs[].rules.action.parameters.duration | integer Ban duration. |
configs[].rules.action.parameters.private_comment | string Comments (the reason for blocking access). Visible only to the requester. |
configs[].rules.action.parameters.open_pool | boolean
|
Last updated: August 8, 2023