Number of tasks completed

Overview

You can limit the number of tasks in the pool per Toloker, in order to:

Get responses from as many Tolokers as possible (for this purpose, set a low threshold, such as one task suite).
Protect yourself from robots (for this purpose, the threshold should be higher, such as 10% of the pool's tasks).

Set key values in the quality_control.configs array in the pool settings.

Request body

If a Toloker completes 12 task suites, you can ban them from your project for a given number of days, hours, minutes (at a time or in total) or permanently.

Ban for 10 days

{
  "configs": [
    {
      "collector_config": {
        "type": "ANSWER_COUNT"
      },
      "rules": [
        {
          "conditions": [
            {
              "key": "assignments_accepted_count",
              "operator": "GTE",
              "value": 12
            }
          ],
          "action": {
            "type": "RESTRICTION_V2",
            "parameters": {
              "scope": "POOL",
              "duration_unit": "DAYS",
              "duration": 10,
              "private_comment": "Completed 12 pages of tasks in the pool"
            }
          }
        }
      ]
    }
  ]
}

To set a different ban period, change the applicable parameter for the action key:

for 12 hours

for 30 minutes

permanently

{
  ...
    "action": {
      "type": "RESTRICTION_V2",
      "parameters": {
        "scope": "POOL",
        "duration_unit": "HOURS",
        "duration": 12,
        "private_comment": "Completed 12 pages of tasks in the pool"
      }
    }
  ...
}

Parameter	Overview
configs[]	array of objects \| required Array of quality control settings.
configs.collector_config	object \| required Parameters for collecting statistics (for example, the number of tasks skipped in the pool).
configs.collector_config.type	string \| required Criteria for the quality control rule: `GOLDEN_SET` — The number of correct and incorrect responses in the control tasks. `MAJORITY_VOTE` — The percentage of responses that matched the majority vote. `CAPTCHA` — The number of captchas entered successfully and unsuccessfully. `INCOME` — Payment for tasks completed by the Toloker over the past 24 hours. `SKIPPED_IN_ROW_ASSIGNMENTS` — The number of task suites skipped in a row. `ANSWER_COUNT` — The number of task suites completed by the Toloker in the pool. `ASSIGNMENT_SUBMIT_TIME` — The number of "fast" responses (the minimum response speed is set in the parameters). `ACCEPTANCE_RATE` — The percentage of Toloker responses that were rejected during manual review. `ASSIGNMENTS_ASSESSMENT` — The number of assignments accepted or rejected with manual review enabled. `USERS_ASSESSMENT` — The Toloker's skill value and their bans.
configs.rules.conditions	object \| required Conditions (for example, 10 task suites skipped in a row). Multiple conditions are combined with the "OR" operator.
configs.rules.conditions.key	string \| required Values that are checked in the condition: `assignments_accepted_count` — The number of task suites completed by the Toloker.
configs.rules.conditions. operator	string \| required Comparison operator (the `key` data is compared with the threshold value from `value`): `EQ` ("Equal") — Equal to. `NE` ("Not equal to") — Not equal to. `GT` ("Greater than") — Greater than. `LT` ("Less than") — Less than. `GTE` ("Greater than equal to") — Greater than or equal to. `LTE` ("Less than equal to") — Less than or equal to.
configs.rules.conditions. value	integer \| required The threshold value of the variable specified in `key`.
configs.rules.action	object \| required The action to perform if conditions are met (for example, block access to the project).
configs.rules.action.type	string \| required Type of action: `RESTRICTION` — Ban access to projects or pools. `SET_SKILL_FROM_OUTPUT_FIELD` — Set the "percentage of correct responses" as the skill value (used in control tasks and majority vote rules). You can use the skill value for filtering Tolokers. `CHANGE_OVERLAP` — Change the overlap. For example, to re-assign a task suite to other Tolokers or cancel the recompletion of already accepted assignments. `REJECT_ALL_ASSIGNMENTS` — Reject all Toloker responses. For example, after a certain number of Toloker responses, it became clear that the Toloker completed tasks poorly. `APPROVE_ALL_ASSIGNMENTS` — Accept all Toloker responses. For example, if the Toloker completes most tasks well and you are satisfied with this result. `SET_SKILL` — Assign the specified constant value to the skill.
configs.rules.action. parameters	object \| required Action parameters.
configs.rules.action. parameters.scope	string \| required Scope: `POOL` — pool. Affects the Toloker's rating. `PROJECT` — The project. Affects the Toloker's rating. `ALL_PROJECTS` — All the requester's projects.
configs.collector_config. parameters	object \| required if Required if configs.collector_config.type=``GOLDEN_SET, `MAJORITY_VOTE`, `CAPTCHA`, `ASSIGNMENT_SUBMIT_TIME`. Parameters for collecting data (depends on the quality control rule specified in the `type` key).
configs.rules.action. parameters.skill_id	string \| required if Required if `type=SET_SKILL_FROM_OUTPUT_FIELD`. ID of the skill to update as tasks are completed.
configs.rules.action. parameters.from_field	string \| required if Required if `type=SET_SKILL_FROM_OUTPUT_FIELD`. The value to assign to the skill: `correct_answers_rate` — The percentage of correct responses. `wrong_answers_rate` — The percentage of incorrect responses.
configs.rules.action. parameters.skill_value	integer \| required if Required if `type=SET_SKILL_FROM_OUTPUT_FIELD`. A fixed value to assign to the skill (a number from 0 to 100).
configs.rules.action. parameters.delta	integer \| required if Required if `type=CHANGE_OVERLAP`. The value determines the amount to change the overlap by.
configs.rules.action. parameters.public_comment	string \| required if Required if `type=REJECT_ALL_ASSIGNMENTS`. Comments (the reason for rejecting responses). Available to the requester and the Toloker.
configs.rules.action. parameters.duration_unit	string Ban duration unit: `MINUTES` — Minutes `HOURS` — Hours `DAYS` — Days `PERMANENT` — Permanent ban
configs.rules.action. parameters.duration	integer Ban duration.
configs.rules. action.parameters. private_comment	string Comments (the reason for blocking access). Visible only to the requester.
configs.rules.action. parameters.open_pool	boolean Determines whether to re-open a closed pool: `true` — Open the pool after making changes if it is closed. `false` — Don't open the pool after making changes, if it is closed.

Number of tasks completed

Overview

Request body

Ban for 10 days

See also