Recompletion of assignments

Toloka can resend tasks for completion if:

  • The Toloker lost access to the pool because of the skill filter.
  • The requester banned the Toloker from tasks.
  • The tasks didn't pass review during post-acceptance.

Set key values in the quality_control.configs array in the pool settings.

Request body

Re-assign task suites if a quality control rule or skill filter was triggered.

{
"configs": [
{
"collector_config": {
"type": "USERS_ASSESSMENT"
},
"rules": [
{
"conditions": [
{
"key": "pool_access_revoked_reason",
"operator": "EQ",
"value": "SKILL_CHANGE"
},
{
"key": "skill_id",
"operator": "EQ",
"value": "2626"
}
],
"action": {
"type": "CHANGE_OVERLAP",
"parameters": {
"delta": 1,
"open_pool": true
}
}
}
]
}
]
}
ParameterOverview
configs[]array of objects | required

Array of quality control settings.
configs[].collector_configobject | required

Parameters for collecting statistics (for example, the number of tasks skipped in the pool).
configs[].collector_config.typestring | required

Criteria for the quality control rule:

  • GOLDEN_SET — The number of correct and incorrect control task responses.
  • MAJORITY_VOTE — The percentage of task responses that matched the majority vote.
  • INCOME — Payment for tasks completed by the Toloker over the past 24 hours.
  • SKIPPED_IN_ROW_ASSIGNMENTS — The number of task suites skipped in a row.
  • ANSWER_COUNT — The number of task suites completed by the Toloker in the pool.
  • ASSIGNMENT_SUBMIT_TIME — The number of "fast" task suite responses (the minimum response speed is set in the parameters).
  • ACCEPTANCE_RATE — The percentage of Toloker responses that were rejected during manual review.
  • ASSIGNMENTS_ASSESSMENT — The number of assignments accepted or rejected with manual review enabled.
  • USERS_ASSESSMENT — The Toloker's skill value and their bans.
configs[].collector_config.parameters

object | required if

Required if configs[].collector_config.type is equal to one of the values:

  • GOLDEN_SET
  • MAJORITY_VOTE
  • ASSIGNMENT_SUBMIT_TIME

Parameters for collecting data (depends on the quality control rule specified in the type key).

configs[].collector_config.parameters.history_sizeinteger | required

The maximum number of the Toloker's recent responses in the project to use for calculating the percentage of correct responses.

If this field is omitted, the calculation is based on all the Toloker's responses in the pool.
configs[].rulesobject | required

Parameters for the control rule conditions and actions.

configs[].rules.conditionsobject | required

Conditions (for example, 10 task suites skipped in a row). Multiple conditions are combined with the AND operator.
configs[].rules.conditions.key

string | required

The value that is checked in the rule:

  • pool_access_revoked_reason — The reason the Toloker lost access to the pool.
configs[].rules.conditions.operator

string | required

Comparison operator (the key data is compared with the threshold value from value):

  • EQ — Equal to.
  • NE — Not equal to.
  • GT — Greater than.
  • LT — Less than.
  • GTE — Greater than or equal to.
  • LTE — Less than or equal to.
configs[].rules.conditions.value

string | required

The reason the Toloker lost access to the pool:

  • SKILL_CHANGE — The skill level changed.
  • RESTRICTION — The Toloker was blocked by a quality control rule (for example, for fast task suite responses).
configs[].rules.actionobject | required

The action to perform if conditions are met (for example, block access to the project).
configs[].rules.action.typestring | required

CHANGE_OVERLAP — Change the overlap. For example, to re-assign a task suite to other Tolokers or cancel the recompletion of accepted task suites.
configs[].rules.action.parametersobject | required

Action parameters.
configs[].rules.action.parameters.scope

string | required

Scope:

  • POOL — pool. Affects the Toloker's rating.
  • PROJECT — The project. Affects the Toloker's rating.
  • ALL_PROJECTS — All the requester's projects.
configs[].rules.action.parameters.skill_idstring | required if

Required if type=SET_SKILL_FROM_OUTPUT_FIELD.

ID of the skill to update as tasks are completed.
configs[].rules.action.parameters.from_field

string | required if

Required if type=SET_SKILL_FROM_OUTPUT_FIELD.

The value to assign to the skill:

  • correct_answers_rate — The percentage of correct responses.
  • wrong_answers_rate — The percentage of incorrect responses.
configs[].rules.action.parameters.skill_valueinteger | required if

Required if type=SET_SKILL_FROM_OUTPUT_FIELD.

A fixed value to assign to the skill (a number from 0 to 100).
configs[].rules.action.parameters.deltainteger | required if

Required if type=CHANGE_OVERLAP.

The value determines the amount to change the overlap by.
configs[].rules.action.parameters.public_commentstring | required if

Required if type=REJECT_ALL_ASSIGNMENTS.

Comments (the reason for rejecting responses). Available to the requester and the Toloker.
configs[].rules.action.parameters.duration_unitstring

Ban duration unit:

  • MINUTES — Minutes.
  • HOURS — Hours.
  • DAYS — Days.
  • PERMANENT — Permanent ban.
configs[].rules.action.parameters.durationinteger

Ban duration.

configs[].rules.action.parameters.private_commentstring

Comments (the reason for blocking access). Visible only to the requester.
configs[].rules.action.parameters.open_pool

boolean

Determines whether to re-open a closed pool:

  • true — Open the pool after making changes if it is closed.
  • false — Don't open the pool after making changes, if it is closed.

See also

Contact support

Last updated: August 8, 2023

Toloka API
OverviewAccessing the APIRate limiting
Quick start
Configuration for Template BuilderToloker selection
Quality control rules
Filters
Task actions
Subscriptions to events
3d-party platform integration
Reference
Project
Pool
Training
Webhook-subscription
Skill
User-restriction
Task
Task-suite
Operation
Assignment
Attachment
Aggregated-solution
User-bonus
Message-thread
User-metadata
Requester
All classes and methods